12076 Commits

Author SHA1 Message Date
Harshal Sheth
dd1a06fb55
feat(ingest/fivetran): add safeguards on table/column lineage (#11674) 2024-10-21 12:29:45 +05:30
deepgarg-visa
2f85bc1ecb
fix(docs): fix businessattributes doc (#11653) 2024-10-19 18:28:32 -07:00
Shirshanka Das
3b1b76244d
feat(sdk):platform-resource - complex queries (#11675) 2024-10-19 14:53:28 -07:00
Harshal Sheth
8f7f2c1724
feat(ingest/fivetran): protect against high sync volume (#11589) 2024-10-18 14:29:03 -07:00
Harshal Sheth
dfd7293f8d
feat(ingest/looker): include project name in model/explore properties (#11664)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-10-18 13:05:06 -07:00
Jay Feldman
7e4d4aba12
fix(ingest/looker): Remove bad imports from looker_common (#11663) 2024-10-18 12:58:52 -07:00
Andrew Sikowitz
72d1236669
feat(ingest/transformer/domain): Add support for on conflict do nothing to dataset domain transformers (#11649) 2024-10-18 12:01:39 -07:00
Tamas Nemeth
ba7a43f530
fix(ingest/dagster): Fix JobSnapshot import is broken (#11672) 2024-10-18 20:16:08 +02:00
Andrew Sikowitz
dcf4793c3d
fix(ingest/dbt): Prevent lineage cycles when parsing sql of dbt models (#11666) 2024-10-18 03:13:18 -07:00
Shirshanka Das
011e5b97e7
fix(sdk): platform resource - support indexed queries when urns are i… (#11660) 2024-10-18 10:12:05 +02:00
Mayuri Nehate
179a6714a6
feat(ingest): ensure sqlite file delete on clean exit (#11612) 2024-10-18 10:33:28 +05:30
Harshal Sheth
6e3724b2da
perf(ingest): streamline CLL generation (#11645) 2024-10-17 17:50:59 -07:00
Harshal Sheth
d7ccf3b2c3
docs(airflow): add known limitations for automatic lineage (#11652) 2024-10-17 16:36:18 -07:00
Harshal Sheth
523a456f5c
fix(ingest/redshift): fix syntax error in temp sql (#11661) 2024-10-17 12:33:04 -07:00
Harshal Sheth
6f193221c9
fix(ingest/dbt): fix bug in CLL pruning (#11614) 2024-10-17 20:50:42 +02:00
Tamas Nemeth
cf3634a6a9
fix(ingest/bigquery): Not setting platform instance for bigquery platform resources (#11659) 2024-10-17 19:57:02 +02:00
Harshal Sheth
68cd17b34e
fix(ingest/redshift): reduce sequence limit for LISTAGG (#11621)
Co-authored-by: treff7es <treff7es@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-10-17 10:08:37 -07:00
Harshal Sheth
6b09346ca5
feat(ingest): add offline flag to SQL parser CLI (#11635) 2024-10-17 08:14:06 -07:00
Harshal Sheth
8b42ac8cde
fix(ingest): run sqllineage in process by default (#11650) 2024-10-16 20:47:48 -07:00
Harshal Sheth
b8144699fd
chore(ingest): reorganize unit tests (#11636) 2024-10-16 19:18:32 -07:00
Harshal Sheth
d34717fd82
fix(ingest): remove default value from DatahubClientConfig.server (#11570) 2024-10-16 13:50:33 -07:00
david-leifker
5db78c6d8a
fix(ci): fix build and test workflow (#11644) 2024-10-16 12:02:58 -05:00
david-leifker
4be66458de
docs(custom-plugins): add overview image (#11634) 2024-10-16 10:45:03 -05:00
sid-acryl
ce909c8b8b
feat(ingest/powerbi): link cross workspace dataset into assets (#11560) 2024-10-16 08:28:05 -07:00
david-leifker
06698308df
feat(docker-profiles): allow version override for quickstartDebug (#11643) 2024-10-16 10:22:59 -05:00
Harshal Sheth
58f5b4a0cb
fix(ingest): add preset deps (#11637) 2024-10-16 17:23:01 +05:30
Tamas Nemeth
e76647dd7a
feat(ingest/bigquery): Generate platform resource entities for BigQuery labels (#11602)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2024-10-16 10:04:01 +02:00
Hyejin Yoon
2f2a7af584
feat: add quickstart post (#11623) 2024-10-15 23:49:59 -07:00
david-leifker
2bc96e9e69
fix(ci): metadata-io req python (#11632) 2024-10-15 14:43:36 -05:00
david-leifker
14a22bfeaf
fix(ci): add runtime limit (#11630) 2024-10-15 13:14:46 -05:00
david-leifker
555f391c24
fix(ci): Update contributor-open-pr-comment.yml (#11631) 2024-10-15 13:14:21 -05:00
david-leifker
5d3e464c21
feat(validations): Ingest and metadata schema validators (#11619)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-10-15 12:35:41 -05:00
david-leifker
fdae71d25f
docs(ingestion): add architecture diagrams (#11628) 2024-10-15 11:44:55 -05:00
Hyejin Yoon
8653b56bf6
feat: add contributor pr open comment action (#11487)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-15 11:12:58 -05:00
deepgarg-visa
b4b91421e8
fix(search): make graphql query autoCompleteForMultiple to show exact matches first (#11586) 2024-10-15 10:16:56 -05:00
Jay
c834cdb0ab
feat(docs-site) brought back announcement banner (#11618) 2024-10-15 10:55:23 -04:00
david-leifker
d8ede691f0
fix(ci): ensure py 3.10 (#11626) 2024-10-15 09:34:30 -05:00
Aseem Bansal
1eec2c4238
fix(ingest): drop empty fields (#11613) 2024-10-15 14:53:45 +05:30
Harshal Sheth
be1b8806a7
fix(airflow): fix lint related to dag_run field (#11616) 2024-10-15 14:09:41 +05:30
Harshal Sheth
0d06a61365
docs: add docs on term suggestion (#11606) 2024-10-14 20:38:23 -07:00
Harshal Sheth
e0939c7ecd
docs(apis): update OpenAPI disclaimer (#11617) 2024-10-14 17:14:55 -07:00
Andrew Sikowitz
3078c5a4c9
fix(ingest/preset): Add skip_on_failure to root_validator decorator (#11615) 2024-10-14 13:13:17 -07:00
david-leifker
09d70bc02c
feat(openapi-v3): support async and createIfNotExists params on aspect (#11609) 2024-10-14 14:27:36 -05:00
Semion Sidorenko
62c39cdcd3
fix(ingest/superset): parse postgres platform correctly (#11540) 2024-10-14 11:57:38 -07:00
Mayuri Nehate
b74ba11d93
fix(ingest/delta-lake): skip file count if require_files is false (#11611) 2024-10-14 18:21:05 +05:30
skrydal
3387110b41
fix(ingestion/redshift): Fix for Redshift COPY-based lineage (#11552) 2024-10-14 11:35:34 +02:00
Shirshanka Das
38ac1007d6
fix(sdk): platform resource api for non existent resources (#11610) 2024-10-14 10:25:19 +02:00
david-leifker
413331933a
fix(spark-lineage-legacy): fix check jar script (#11608) 2024-10-11 19:08:25 -05:00
david-leifker
b5cf729c9b
fix(bootstrap): fix early bootstrap mcps (#11605) 2024-10-11 15:29:58 -05:00
Gabe Lyons
36fc0c4e23
docs(structured-properties): example to read structured properties fr… (#11603) 2024-10-11 13:23:54 -07:00