Sriharsha Chintalapani
891ff465a0
Fix #2838 : Fix airflow example DAG to import airflow libs ( #2839 )
2022-02-18 10:47:07 +05:30
Vivek Ratnavel Subramanian
b285d5b505
Fix #2719 : Change Events should create a new thread against the data entity ( #2814 )
2022-02-17 11:54:40 -08:00
Sriharsha Chintalapani
162068e273
Fix #2811 : Log level option for running metadata ( #2820 )
...
* Fix #2811 : Log level option for running metadata
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
2022-02-17 10:10:22 -08:00
Igor Kramer
316e02cdfd
FIX #2802 : Skip partitions and add datatypes ( #2803 )
...
* ISSUE-2802: Skip partitions and add datatypes
* ISSUE-2802: formatting changes
2022-02-17 10:09:09 -08:00
Suresh Srinivas
c2b3f4a1d9
Fixes #2806 - Webhook changes using PUT API does not reflect updated data as well as version change in list API ( #2829 )
2022-02-17 09:42:18 -08:00
Shailesh Parmar
d9963e0792
Added test suits for multiple file ( #2796 )
2022-02-17 22:11:56 +05:30
Ayush Shah
c79f1f286d
Added Users to TableQueries ( #2826 )
...
* Added Users to TableQueries
* User EntityReference
* User EntityReference modification
2022-02-17 20:46:14 +05:30
kshinde2512
a9446e0209
Added negative tests and added some assertions ( #2825 )
...
Co-authored-by: kushal <kushalshinde2512@gmail.com>
2022-02-17 17:51:46 +05:30
Sriharsha Chintalapani
165f5bb0e9
Fix #2819 : Kafka connector security settings along with all configs to be retrieved ( #2823 )
...
* Fix #2811 : Log level option for running metadata
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
2022-02-17 15:17:43 +05:30
Alberto Miorin
b3b5f44c23
Fix #1876 : Allow dots in entity names ( #2700 )
...
Add getter and setter for `name` into EntityInterface
Refactor code in utility method.
Rename the escape method.
Fix webhook.
Fix pipeline tests
Fix airflowPipeline tests
Fix role, team, and user tests
Replace . with _DOT_ to keep compatibility with the past and avoid a migration.
Remove the Python code that was replacing the . with _DOT_.
Restore "no dots" for services and implement the JSON Schema rule.
** Entites escaping dots
1. AirflowPipeline
2. Chart
3. Dashboard
4. Database
5. Location
6. Metrics
7. MlModel
8. Pipeline
9. Table
10. Topic
** Entities rejecting dots
1. Database Service
2. Dashboard Service
3. Messaging Service
4. Pipeline Service
5. Storage Service
** Entities accepting dots
1. Bots
2. Policy
3. Report
4. Role
5. Team
6. User
7. Webhook
** Fields escaping dots
1. Column
2. Task
Add escape for Column and TableConstraints
Add escape to Task
Remove the Python code. It will be added in a follow-up PR.
Fix Pipeline entity tests
2022-02-17 08:21:53 +01:00
Mayur Singal
419448a28f
Issue 2727: Added Databricks Connector ( #2745 )
...
* Issue #2727 : Added Databricks Connector
* optional db and licence info
* make core_bump_version_dev
* host_port fix
* fixed service_type
* change package to sqlalchemy-databricks
* Update databaseService.json
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 11:22:13 +05:30
Hendry Suwanda
3b9142886a
Fix #790 Make assertResponse & assertResponseContains shorter on all … ( #2821 )
2022-02-16 21:28:36 -08:00
Suresh Srinivas
ab0a4f5e36
Fixes #2667 Intermittent failures on WebhookResourceTest ( #2822 )
2022-02-16 21:27:24 -08:00
Mayur Singal
dfebc85c4e
fix #2790 : fixed usage ingestion issue ( #2805 )
2022-02-17 10:46:23 +05:30
Sachin Chaurasiya
8555966f61
Fix: Lineage Value is not changing on fqn change. ( #2795 )
2022-02-17 10:14:27 +05:30
Sriharsha Chintalapani
50799227e4
Fix #2817 : Remove indexing of Glossary as another Elasticsearch index ( #2818 )
2022-02-16 20:10:26 -08:00
codingwithabhi
088dba3a1f
azuresql-config-added ( #2711 )
...
* azuresql-config-added
* rebased-with-main
* tables-ingestion-added
* duplicate-files-removed
* Update azuresql.py
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 09:23:07 +05:30
Suresh Srinivas
65527ee191
Fixes #2815 - Less verbose code for adding and finding relationships ( #2816 )
2022-02-16 19:31:43 -08:00
Suresh Srinivas
4eee1e93cb
Fixes #2812 - Add support for querying glossary term filtered by glossary or parent term ( #2813 )
2022-02-16 19:31:13 -08:00
Suresh Srinivas
bc3032ea42
Fixes #2799 - Rename Glossary JSON schema title fields ( #2804 )
2022-02-16 09:54:11 -08:00
Sachin Chaurasiya
20594dd607
Fix #2784 UI : Remove Tags API call from entities details page. ( #2786 )
2022-02-16 23:14:31 +05:30
Suresh Srinivas
ac59a092ea
Fixes #2779 Change the webhook state names ( #2782 )
2022-02-16 08:59:37 -08:00
codingwithabhi
9011b27bf6
table-filter-added ( #2770 )
...
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-16 19:26:40 +05:30
Suresh Srinivas
983d534da0
Issue2775 - Add support for reviewers and related terms to Glossary ( #2776 )
...
* Fixes #2760 - Add entities for Glossary and initial API
* Fixing merge issues
* Fixes #2775 Add support for reviewers and related terms to Glossary
2022-02-15 23:11:51 -08:00
Pere Miquel Brull
1ddd2453e2
Prep feature task issue template ( #2781 )
2022-02-16 08:06:18 +01:00
Suresh Srinivas
f1740e5ec4
Create feature_task.md
...
Template for creating issues that capture a task from a larger feature
2022-02-15 21:59:56 -08:00
Suresh Srinivas
e4cbcd8788
Create feature_task
2022-02-15 21:57:57 -08:00
Ayush Shah
4aee82bfd8
Fix for #2597 - added check with column type mapping ( #2598 )
...
* Fix for #2597 - added check with column type mapping
* Optimized Column Type Parsing
* Optimized Column Type Parsing
* SQL Source Bigquery Policy Tags check added
2022-02-16 11:05:12 +05:30
codingwithabhi
f1c62a70b7
service-type-added ( #2769 )
2022-02-16 10:56:40 +05:30
Sriharsha Chintalapani
0ccba07059
Minor Fix: elastic search mappings ( #2772 )
2022-02-16 10:44:11 +05:30
Mayur Singal
78f5b51e63
fix #2663 : added table queries put request ( #2768 )
2022-02-15 21:12:38 -08:00
Mayur Singal
5e4cd516bf
issue #2712 : Added SingleStore Connector ( #2747 )
2022-02-15 21:11:46 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API ( #2761 )
...
* Fixes #2760 - Add entities for Glossary and initial API
* Fixing merge issues
2022-02-15 20:54:46 -08:00
darth-coder00
56a45faf1c
Implemented Listing, Add, Update and Delete Webhook functionalities ( #2714 )
...
* Implemented Listing, Add and Delete Webhook functionalities
* Implementing Edit Webhook and minor changes
* Minor updates
* Minor changes for generate button
* Addressing comments
* Addressing comment
2022-02-16 01:16:24 +05:30
Mayur Singal
44cca4d020
fix #2663 : added table queries in sample data ( #2763 )
2022-02-15 15:45:58 +05:30
Sachin Chaurasiya
3f5c8b8d95
Fix #2568 Show database/entity_name in Lineage Node Label. ( #2744 )
...
* Fix #2568 Show database/entity_name in Lineage Node Label.
* Changing `/` to `.` as separator.
2022-02-15 12:21:20 +05:30
Matt
5261c2bad8
Define Relationship in json-schema ( #2756 )
...
* Move Relationship type to json-schema
* Replace Relationship with EntityRelationshipType (backward compatible)
* Add documentation about entity relationship
2022-02-14 21:16:21 -08:00
darth-coder00
036a7dcd9d
Added new Unit tests ( #2754 )
2022-02-15 10:26:49 +05:30
darth-coder00
4c67a8d3d2
Fix : #2694 removed entity api calls for recently viewed data ( #2755 )
2022-02-15 07:50:04 +05:30
Pere Miquel Brull
76f4ccd590
Fix #2735 - Simplify Airflow properties extraction ( #2749 )
...
* Simplify lineage properties extraction
* Add network name
* Format
2022-02-14 16:53:42 +01:00
Sriharsha Chintalapani
562d6b39ef
Fix #2704 : Add suggestions API to query users and teams like autocomplete ( #2742 )
2022-02-14 07:47:07 -08:00
kshinde2512
d58fb32dd0
Revamp Teams page ( #2741 )
...
* Revamp Teams page
* adding options
Co-authored-by: kushal <kushalshinde2512@gmail.com>
2022-02-14 18:00:36 +05:30
Matt
4b77d5630b
Use Getter/Setter for FernetConfiguration ( #2743 )
2022-02-14 02:42:06 -08:00
SeungwanJo
7ca7f087ab
[Add] refine slack url ( #2739 )
2022-02-13 09:45:53 -08:00
deweybat
d60a085ff2
Added logging for the back off in AbstractEventPublisher as well as information about subsequent retries ( #2737 )
...
* Added logging for the back off in AbstractEventPublisher as well as information about subsequent retries
* Adding changeEvent to logging message
2022-02-13 18:22:24 +01:00
Pere Miquel Brull
1b2ea54d4f
Fix #2316 - Append Tasks & Add Status in Airflow ( #2738 )
...
* Add license
* Add date to timestamp helper
* Prepare pipeline status operation
* Update and clean tasks from client
* Update tasks from client
* Check if pipeline is empty
* Keep all current pipeline info
* Append and clean tasks
* format
* Add status information
* Test pipelineStatus update
* Update task on clear
* Log status on callback
* Update lineage and status docs
* Update lineage docs
* Format
* Logic to handle DAG status
* Lint and format
* Update lineage tests
2022-02-13 17:51:25 +01:00
Mayur Singal
06ed718235
Fix #2715 : Added clickhouse datatypes ( #2732 )
2022-02-12 10:03:03 -08:00
Ayush Shah
f189c760bc
Ordinal Position modified ( #2733 )
2022-02-12 10:02:47 -08:00
Pere Miquel Brull
53aeddf2c6
Fix #2226 - Add pipeline & task status ( #2692 )
...
* Add pipeline & task status
* Bump core version
* Simplify validateColumn
* Add apiResponse
* Use enum and timestamp
* Simplify validate and use timestamp for executionDate
* mvn format
2022-02-12 16:21:31 +01:00
codingwithabhi
b51c0d92b1
added-named-parameter ( #2680 )
...
* added-named-parameter
* metadata-config-fix-and-connector-tested
2022-02-11 07:53:46 -08:00
