2916 Commits

Author SHA1 Message Date
Mayur Singal
841bb39d3b
Fix #5553: Clean cache support added in topology runner (#5554)
* Fix #5553: Clean cache support added in topology runner

* used get_ctx_default
2022-06-22 08:02:52 +02:00
Mayur Singal
9fbe07d2d0
Fix #5544: Downgrading Kafka Version (#5545) 2022-06-21 13:22:04 -07:00
Mario Taddeucci
a3f809d789
Fixing airflow lineage configs scopes (#5507) 2022-06-21 18:11:58 +02:00
Pere Miquel Brull
0ecc9f0da6
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
2022-06-21 18:02:50 +02:00
Mayur Singal
ba1b099301
[ISSUE-5198]: Clean stage file after processing (#5555) 2022-06-21 17:24:57 +02:00
Onkar Ravgan
d717f8cc17
Added pipeline metadata to the edge lines (#5552)
Added pipeline metadata to the edge lines (#5552)
2022-06-21 17:22:37 +02:00
Pere Miquel Brull
a14de6eee1
Fix #5367 - MlFlow connector & MLServices (#5446)
Fix #5367 - MlFlow connector & MLServices (#5446)
2022-06-21 14:54:36 +02:00
Teddy
5067e24374
[ISSUE-4723] Fix Snowflake Case Sensitive Error with Profiler (#5533)
* Fixed snowflake profiler + enabled profiler integration tests

* Fixed py formating
2022-06-20 22:23:17 +02:00
Onkar Ravgan
1c709ed0f9
Fixed mode test connection (#5531)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-20 22:51:22 +05:30
Teddy
c151a34c70
[ISSUE-4659] Add Additional GE Tests to the Profiler (#5506)
* Added table tests 'column count to be between' and 'column name to be in set'

* Added 'column values to be in set' test

* Fixed wrong filed name when invoking TestCaseResult

* Added col min and col max to be between

* Fix formatting

* Fix test after adding column name list to table profile

* Added 'column values sum between' test

* Added 'table column name to exist' test

* Fixed JSON description white space + spelling mistake
2022-06-20 08:54:42 +02:00
Abhishek Pandey
9c8a58f345
dataclass-added-in-airbyte-client (#5512) 2022-06-20 06:33:45 +02:00
Onkar Ravgan
21dac15176
Added Mode Connector (#5475)
* rebase with main

* Added lineage for mode

* added lineagerunner and enum constants

* added host port

* refactored mode according to new dashboard topology

* checkstyle fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-19 23:59:38 +05:30
Abhishek Pandey
196b023643
airflow-test-connection-fixed (#5502)
* airflow-test-connection-fixed

* airbyte-test-connection-added
2022-06-17 23:08:18 +05:30
Mayur Singal
1d6b7e8525
Fix #3289: Added precision details of column (#5437)
* Fix #3289: Added precision details of column

* Resolved review comments
2022-06-17 14:12:54 +02:00
Mayur Singal
f53a07815e
Fix #5409: Implement Dashboard Topology (#5495)
* Fix #5409: Dashboard Service

* Fix #5409: Implement Topology to Dashboards

* Removed print
2022-06-17 15:22:54 +05:30
Mayur Singal
0ee87b2d99
Fix #5484: Postgress Connector Fix (#5485) 2022-06-16 16:11:50 +05:30
Mayur Singal
430d32a9c6
Fix #5090: Added Local TableType (#5450)
Fix #5090: Added Local TableType (#5450)
2022-06-15 10:41:48 +02:00
Abhishek Pandey
e8975aac01
datalake-csv-files-ingestion-added (#5343)
datalake-csv-files-ingestion-added (#5343)
2022-06-15 08:57:21 +02:00
Pere Miquel Brull
0a9e36f1b4
Fix Snowflake get comments query (#5451) 2022-06-14 18:02:30 -07:00
Teddy
28336b0a43
Fix #3575 Data Quality - Partitioned Tables (#5441)
Co-authored-by: Teddy Crepineau <teddycrepineau@Teddys-MacBook-Pro.local>
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-06-14 12:37:44 -07:00
Onkar Ravgan
5537db2ab4
Added DBT Cloud support (#5436)
Added DBT Cloud support (#5436)
2022-06-13 18:05:13 +02:00
Milan Bariya
ab7689d7a8
FIX 5131: Fix Get Pipeline Status from Airflow metadata connector (#5396)
FIX 5131: Fix Get Pipeline Status from Airflow metadata connector (#5396)
2022-06-13 17:44:21 +02:00
Pere Miquel Brull
02fece727b
Fix #5307 - Define a better topology for Ingestion Sources (#5366)
Fix #5307 - Define a better topology for Ingestion Sources (#5366)
2022-06-13 12:17:54 +02:00
Mayur Singal
8ac83509a1
Fix #4549: Added Snowflake Session Query Tag (#5404)
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-06-13 10:19:48 +02:00
Pere Miquel Brull
d9d30b2cba
Fix #5416 - Revisit Looker Test Connection (#5422)
Fix #5416 - Revisit Looker Test Connection (#5422)
2022-06-13 08:07:04 +02:00
Mayur Singal
51a275c481
Fix #1121: Added Airbyte Source (#5372)
Fix #1121: Added Airbyte Source (#5372)
2022-06-13 06:45:25 +02:00
Onkar Ravgan
7c387d6d54
Optimized Snowflake fetch tags (#5376)
* optimized snowflake fetch tags

* fixed same named entities issue

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2022-06-09 22:24:40 +05:30
Snyk bot
c717cb1545
fix: ingestion/tests/integration/lineage/airflow/requirements.txt to reduce vulnerabilities (#5178)
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-FLASKAPPBUILDER-2433100
2022-06-08 13:36:31 -07:00
Pere Miquel Brull
8e9d0a73f6
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
Fix #3573 - Sample Data refactor & ORM converter improvements (#5265)
2022-06-08 16:10:40 +02:00
Mayur Singal
b15ce6f52b
Fix #5338: Dashboard Connector's to return create entities (#5341)
Fix #5338: Dashboard Connector's to return create entities (#5341)
2022-06-08 11:03:48 +02:00
Sriharsha Chintalapani
f7438f5469
Fix #5330: Support Advanced search provide multiple field suggestions (#5331)
* ES suggest

* Fix #5330: Support Advanced search provide multiple field suggestions

* UI : Change table-suggest to metadata-suggest

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-06-08 13:02:00 +05:30
Mayur Singal
273b3e9c4b
Fix #5260: Refactor Superset Lineage (#5290) 2022-06-07 09:04:10 +02:00
Onkar Ravgan
519b5b3a6b
Tableau Lineage Fix (#5315)
* rebase with main

* removed process_charts method

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-07 09:00:20 +02:00
Milan Bariya
5e3f190f5d
Add: Add databaseSchema filed in Yaml file (#5316) 2022-06-07 12:12:41 +05:30
Mayur Singal
fe757624bd
Fix #4243: Fixed Amundsen Ingestion (#5319) 2022-06-07 07:23:34 +02:00
Mayur Singal
a2e25d7cc3
Fix #5317: Fixed Redash Lineage (#5318) 2022-06-07 07:18:09 +02:00
yug-shah0106
dd03693b0b
Fix #5220 Antd installed and updated design on my-data page (#5173) 2022-06-06 14:37:06 -07:00
Milan Bariya
ec1aca926a
Fix #5210: Review database field for connectors (#5225)
* Fix #5210: Review database field for connectors
2022-06-06 10:48:23 +05:30
Sriharsha Chintalapani
65330f24ef
Fix #5305: Add simple webhook server to metadata command to test metadata events (#5306) 2022-06-06 10:07:09 +05:30
Sriharsha Chintalapani
0119f7fc38
Fix #5196: defaultRoles not present in results of team_search_index, Fix #5195: ES - Need teams as EntityReference in user_search_index, Fix #5111: Add ElasticSearch index & APIs for MlModel (#5308) 2022-06-06 10:06:56 +05:30
Sriharsha Chintalapani
a056ccd9a0
Fix #5303: Add an option to ElasticSearch connector to re-create indexes (#5304) 2022-06-05 13:47:44 -07:00
Pere Miquel Brull
9138c70dee
Fix #4696 - Only store URL suffixes when extracting metadata (#5281)
* Only store URL suffix

* Fix test service name
2022-06-03 11:43:40 +02:00
Pere Miquel Brull
49fa5c4f7f
Add Oracle LENGTH (#5287) 2022-06-03 11:39:43 +02:00
Mayur Singal
b3428771a3
Fix #4767: Refactor Usage & Lineage (#5190)
Fix #4767: Refactor Usage & Lineage (#5190)
2022-06-03 10:12:28 +02:00
Onkar Ravgan
93ae064ffd
Fixed Metabase Lineage (#5270)
* Fixed Metabase Lineage

* removed get chained calls

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-02 16:41:17 +02:00
Onkar Ravgan
a5ff3a3499
Removed connectionOptions dictionary (#5264)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-02 15:07:22 +02:00
Onkar Ravgan
c1fa31eacc
DBT Models Lineage Fix (#5252)
DBT Models Lineage Fix (#5252)
2022-06-01 18:35:51 +02:00
Onkar Ravgan
4671ca00b0
Refactored PowerBi Connector (#5107)
Refactored PowerBi Connector (#5107)
2022-06-01 10:36:12 +02:00
Abhishek Pandey
ba88aa1668
Issue 4660: Bigquery ADC FIx (#5241)
* fixed-bigquery-adc
2022-06-01 13:52:55 +05:30
Pere Miquel Brull
6ca9b816bd
Fix #3396 - Linting in OMeta 2022-06-01 08:36:07 +02:00