Suman Maharana
cdca199ec8
Fix #16370 - Added view/DDL definition rule ( #16486 )
...
* added rule includeDDL
* code optimize
* review changes
2024-06-05 11:11:04 +05:30
Onkar Ravgan
29028eabb3
fixed oracle e2e count ( #16530 )
2024-06-04 20:37:21 +05:30
Teddy
656da03b14
fix: None type is not iterable ( #16496 )
2024-05-31 10:17:28 +00:00
Mayur Singal
22be0edd79
MINOR: Ignore Cluster Information from columns ( #16495 )
2024-05-31 15:41:12 +05:30
Ayush Shah
a98f6b8dd0
MINOR: Kafka Setup SSL Arg Fix ( #16469 )
2024-05-30 16:03:03 +05:30
Suman Maharana
5ba7769b76
Fix #16425 : Correct Schema Definition for Databricks ( #16441 )
...
* Fix Incorrect Schema Definition for Databricks
* Catalog name is showing correctly
2024-05-30 12:29:12 +05:30
Suman Maharana
0677c4794f
Only Parse view query ( #16470 )
2024-05-30 11:55:33 +05:30
Imri Paran
c8dd9971b4
added usage query to logs in case of error ( #16455 )
2024-05-29 17:14:03 +00:00
Antoine Balliet
0abd3ca5fe
fix: ingestion for dbt > 1.8.0 resource_type is not an enum ( #16415 )
...
* fix: resource_type is not an enum
* feat: add log to display finis
* improve readability
* use getattr to be compatible
* format
2024-05-28 17:00:04 +02:00
Imri Paran
067fb510ab
MINOR: test case for usage->delete->usage ( #16409 )
...
* test: added test case to demonstrate cache issue
2024-05-28 11:23:43 +02:00
Imri Paran
a4c516d2c7
Fixes 16305: Added Test Case for Matching Enum ( #16362 )
...
* Added Test Case for Matching Enum
1. Implemented the test case using the `matchEnum` parameter.
2. Added integration tests.
3. Added migrations.
* fix tests
* fixed tests
* format
* fixed tests
* clear search cache before running ingestion
* format
* changed scopt of aws fixture
* moved migrations to 1.5.0
2024-05-28 09:30:30 +02:00
gpby
d909a3141e
Teradata Connector ( #16373 )
...
* [WIP] add teradata connector
* [WIP] add teradata ingestion
* [WIP] add teradata connector
* [WIP] add teradata connector
* [WIP] add teradata connector
* [WIP] add teradata connector
* [WIP] add teradata connector
* [WIP] add teradata connector
* Reformat code
* Remove unused databaseName property
2024-05-28 06:40:22 +02:00
Maxim Martynov
18b2a22958
Fix OpenLineage ingestor ( #16416 )
...
* Fix OpenLineage ingestor
* py format
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-05-27 13:47:01 +05:30
Ayush Shah
e1a4937744
Fix SSL issue ( #16412 )
2024-05-26 18:49:35 +00:00
juntao
8dd613caa5
Fixes #16235 : need quote fullyQualifiedName in Ingestion Framework ( #16273 )
...
* Fixes #16235 : need quote fullyQualifiedName in Ingestion Framework
* MINOR: fix UT issue
* revert: fix UT issue
* revert code
* revert code
* format code
2024-05-23 17:45:47 +02:00
Akash Jain
015d71c9de
chore: Update main branch for 1.5.0 Release ( #16401 )
2024-05-23 18:46:15 +05:30
Pere Miquel Brull
17aed8a9e9
MINOR - Fix GX version ( #16394 )
2024-05-22 19:25:42 +00:00
Imri Paran
d5bf30ccd3
MINOR: trino integration test ( #16291 )
...
* added trino integration test
* - removed warnings for classes which are not real tests
- removed "helpers" as its being used
* use a docker network instead of host
* print logs for hive failure
* removed superset unit tests
* try pinning requests for test
* try pinning requests for test
* wait for hive to be ready
* fix trino fixture
* - reduced testcontainers_config.max_tries to 5
- remove intermediate containers
* print with logs
* disable capture logging
* updated db host
* removed debug stuff
* removed debug stuff
* removed version pin for requests
* reverted superset
* ignore trino integration on python 3.8
2024-05-22 15:12:00 +00:00
Mayur Singal
8845823758
MINOR: remove newline char in lineage queries ( #16361 )
2024-05-22 16:35:38 +05:30
Mayur Singal
a2c68f6901
MINOR: Fix UC missing table type ( #16376 )
2024-05-22 14:13:01 +05:30
Mayur Singal
89829949ce
MINOR: Fix flaky pytests ( #16379 )
2024-05-22 14:12:34 +05:30
harshsoni2024
a1a68ae73b
restrict requests version on setup ( #16365 )
2024-05-21 18:13:37 +05:30
Mayur Singal
ed792fd77b
MINOR: DDL Change log level to debug ( #16360 )
2024-05-21 15:13:55 +05:30
Teddy
4de6fae26e
Minor: None query res check on table metrics ( #16334 )
...
* fix: None query res check on table metrics
* style: ran python linting
2024-05-20 10:52:21 -07:00
Mayur Singal
199613fab0
MINOR: Do not populate schema def if not found ( #16345 )
2024-05-20 20:06:33 +05:30
Suman Maharana
bd3f47a563
MINOR - Added quicksight pydantic models ( #16269 )
...
* Added quicksight pydantic models
* pyformat
* resolved type hints
* Renamed sheet -> chart in models
2024-05-17 08:40:20 +02:00
Mayur Singal
1798b647c3
MINOR: Bump Collate Sqllineage Version ( #16293 )
2024-05-17 08:39:37 +02:00
Mayur Singal
7b52f5a6b0
MINOR: Fix kafka connection storage ( #16313 )
2024-05-17 11:59:08 +05:30
Pere Miquel Brull
263afbeb5c
MINOR - pkg_resources is deprecated ( #16316 )
2024-05-17 07:56:07 +02:00
harshsoni2024
d6046c811c
MINOR: superset pytest fix ( #16299 )
...
* superset testcontainer image tag fix
* update chart data acc. to runtime
2024-05-17 07:27:36 +02:00
Imri Paran
7af7f9322f
MINOR: skip pbit test ( #16312 )
...
* skip superset test in CI
* fixed pytest mark
* format
* format
* skip pbi
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-05-17 07:27:12 +02:00
Pere Miquel Brull
53185fd30b
MINOR - Add Integration Test for S3 Storage ( #16277 )
...
* MINOR - Add Integration Test for S3 Storage
* MINOR - Add Integration Test for S3 Storage
* MINOR - Add Integration Test for S3 Storage
* format
* format
2024-05-16 10:03:27 +02:00
Pere Miquel Brull
f1f15cfc07
MINOR - Remove setuptools req ( #16276 )
...
* MINOR - Remove setuptools req
* relax system req
* fix
2024-05-16 10:03:15 +02:00
Pere Miquel Brull
f4369ded8d
MINOR - Allow dict-based xlets in Airflow ( #16262 )
2024-05-15 15:08:09 +02:00
Mayur Singal
a677910982
Fix #16211 : Fix special charechter encoding in trino username ( #16258 )
...
* Fix #16211 : Fix special charechter encoding in trino username
* fix test and add comments
2024-05-15 14:48:22 +05:30
Mayur Singal
945cd35148
MINOR: Fix Oracle SP Lineage for begin...end SP call ( #16240 )
2024-05-15 14:46:57 +05:30
Onkar Ravgan
f231e552e1
Fixed saphana connection ( #16255 )
2024-05-15 11:01:17 +05:30
IceS2
d91ec3d6a0
MINOR: Fix data insights misbehaving due to validation error ( #16251 )
...
* Add a Try/Except block to allow the ingestion to continue if ValidationError occurs
* Fix checkstyle
* Fix linter
2024-05-14 14:37:56 +02:00
Imri Paran
c277233ef1
MINOR: use archive instead of volume for postgres test ( #16245 )
...
* using archive instead of volume for postgres test
* format
* remove usage of request
2024-05-14 09:11:16 +00:00
Ayush Shah
1971d8b019
Minor: Fix AzureSQL Authentication mode error ( #16225 )
2024-05-13 11:05:27 +05:30
Suman Maharana
0e2736ee74
MINOR: Removed supportsDDL from json schemas ( #16171 )
2024-05-10 17:40:12 +05:30
Suman Maharana
8dc623e280
Added KafkaConnect Connector ( #16217 )
2024-05-10 14:29:45 +05:30
Onkar Ravgan
38f3863002
Added limits to dagster graphql queries ( #16202 )
2024-05-10 09:31:49 +02:00
Mayur Singal
96668c881d
MINOR: Fix missing attribute get_table_owner ( #16214 )
2024-05-10 06:46:41 +02:00
harshsoni2024
f5a176c5f2
issue-9281: column lineage for powerbi ( #16135 )
...
* issue-9281: col. lineage for powerbi
* issue-9281: error handling for columns fqn
2024-05-09 19:15:26 +05:30
Ayush Shah
88f6ccd000
Fix Hive Profiler Interface ( #16193 )
2024-05-09 16:56:48 +05:30
Huanjie Guo
1a6f009757
Fixes 16185: try - catch the usage parsing error ( #16188 )
...
* try catch the exception in parsing usage
* Update usage-workflow-query-logs.md
* Update usage-workflow-query-logs.md
* Update usage-workflow-query-logs.md
* Update usage-workflow-query-logs.md
2024-05-09 12:19:07 +02:00
Prajwal214
e191034c18
Minor: Updated Python Dependency for GreenPlum ( #16139 )
2024-05-09 08:57:25 +05:30
Fredrik Möllerstrand
5ce81b36ac
MINOR: Remove duplicated code in S3Source ( #16153 )
2024-05-08 12:00:37 +02:00
Pere Miquel Brull
39eed12f32
MINOR - Version match logic update & Airflow docs ( #16157 )
...
* airflow docs
* update version validation
* MINOR - docs and version match
2024-05-08 07:37:14 +02:00
