312 Commits

Author SHA1 Message Date
sid-acryl
86b8175627
fix(ingestion/kafka): OAuth callback execution (#11900) 2024-11-22 13:08:23 +05:30
Felix Lüdin
e4d010d757
docs(ingest/sac): add additional permission for SAP Analytics Cloud source to docs (#11903) 2024-11-20 16:05:50 -08:00
sagar-salvi-apptware
fd2da83ff4
feat(ingest/cassandra): Add support for Cassandra as a source (#11822) 2024-11-15 20:41:21 +05:30
skrydal
becda8fd34
docs(ingest): transformer docs and java example (#11859) 2024-11-15 20:19:45 +05:30
sagar-salvi-apptware
5d17ecb290
feat(ingest/dremio): Dremio Source Ingestion (#11598)
Co-authored-by: Jonny Dixon <jonny.dixon@acryl.io>
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-05 22:06:35 +05:30
noggi
94bcb79b84
feat(ingestion): Add execution request cleanup job (#11765) 2024-10-31 10:59:21 -07:00
Harshal Sheth
cd1ad16852
docs(dbt-cloud): reference service accounts in docs (#11750) 2024-10-29 21:25:00 -07:00
sid-acryl
8c53c54081
feat(ingestion/powerbi): ingest powerbi app (#11629) 2024-10-29 09:19:37 +01:00
Harshal Sheth
e96323a2a2
feat(ingest/fivetran): show connector filter reason (#11695) 2024-10-23 13:49:49 +05:30
Andrew Sikowitz
72d1236669
feat(ingest/transformer/domain): Add support for on conflict do nothing to dataset domain transformers (#11649) 2024-10-18 12:01:39 -07:00
sid-acryl
59a2f70858
feat(ingest/powerbi): fix subTypes and add workspace_type_filter (#11523)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-11 08:54:50 -07:00
Ellie O'Neil
732543f201
docs(datahub source): Add urn exclusions to docs (#11568) 2024-10-09 13:35:57 +05:30
sagar-salvi-apptware
660fbf8e57
fix(ingestion/transformer): Add container support for ownership and domains (#11375) 2024-10-01 11:39:07 -07:00
Jonny Dixon
a8e6a06ea4
docs(ingest/dbt): update run result paths examples (#11138) 2024-09-27 10:11:06 -07:00
sagar-salvi-apptware
68fb97f7f1
fix(ingest/openapi): update recipe for DataHub OpenAPI with url_complement and bearer token (#10980) 2024-09-25 16:54:13 -07:00
Tamas Nemeth
dea2ef00c4
feat(ingest/gc): Add dry run mode to gc recipe (#11413) 2024-09-18 13:43:22 +02:00
Tamas Nemeth
e7a3890943
feat(ingest/gc): Add dataflow and soft deleted entities cleanup (#11102) 2024-09-18 10:01:16 +02:00
Harshal Sheth
f082287a07
docs(ingest/dbt): add docs on hiding sources (#11334) 2024-09-10 10:13:25 -07:00
Harshal Sheth
9b64b117c7
docs(ingest/dbt): clarify dbt ingestion docs (#11312) 2024-09-09 09:01:46 +02:00
Aseem Bansal
efc42df3d9
ci: update outdated actions for java and python setup (#11261) 2024-08-29 14:27:35 +05:30
Aseem Bansal
15c1cfc386
ci(build): update outdated action & pin deepdiff lib (#11260) 2024-08-28 19:53:42 +05:30
Felix Lüdin
ce99bc4f22
feat(ingest): add ingestion source for SAP Analytics Cloud (#10958)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-26 11:29:15 -07:00
Mayuri Nehate
223650dd7a
feat(ingest): add bigquery-queries source (#10994)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-25 22:51:00 -07:00
Harshal Sheth
e0c13fda27
feat(ingest/dbt): add support for urns in add_owner directive (#11221) 2024-08-23 13:52:21 -04:00
Tamas Nemeth
ef6a410091
feat(ingest/s3): Partition support improvements (#11083)
- Partition autodetection
- Option to find min/max/min-max partition of a dataset
- Generating Partition aspects
2024-08-22 17:55:43 +02:00
sagar-salvi-apptware
608c5cfc33
fix(ingestion/transformer): extend dataset_to_data_product_urns_pattern to support containers (#11124) 2024-08-16 17:18:35 +05:30
sid-acryl
d5eda0de7e
doc(ingestion/tableau): doc update for derived permission (#11054)
Co-authored-by: Pedro Silva <pedro.cls93@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 10:26:47 -07:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container (#11013) 2024-07-30 15:17:04 +05:30
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin (#10881)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
sid-acryl
c30f4c7fb5
doc(ingest/looker): fix doc for sql parsing documentation (#10883)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-19 18:09:37 +05:30
Joel Pinto Mata (KPN-DSH-DEX team)
13b6febce9
feat(ingest/abs): Adding azure blob storage ingestion source (#10813) 2024-07-17 11:06:05 +02:00
Mayuri Nehate
ff1c6b895e
feat(ingest/BigQuery): refactor+parallelize dataset metadata extraction (#10884) 2024-07-16 11:46:42 -07:00
Tamas Nemeth
d204d5654a
fix(ingestion/spark): Platform instance and column level lineage fix (#10843)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-09 13:54:06 +02:00
sagar-salvi-apptware
640d42dc65
feat(ingest/transformer): tags to terms transformer (#10758)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-07-02 15:30:05 +05:30
Mayuri Nehate
b6ec52bf5c
docs(classification): correct the casing for full name infotype (#10782) 2024-07-01 10:45:25 -07:00
Teppo Naakka
b223281305
feat(ingest/powerbi): powerbi dataset profiling (#9355) 2024-06-28 14:50:08 -07:00
Harshal Sheth
f4be88d0a9
feat(ingest): set pipeline name in system metadata (#10190)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-06-27 15:00:35 -07:00
Alex Waldron
edb9cf61f7
fix(docs): formatting of transformers code blocks (#10670) 2024-06-14 17:02:34 -07:00
Davi Arnaut
d29d2c3b90
docs(ingest): Add Oracle prerequisites (#10712) 2024-06-14 08:46:57 -10:00
sagar-salvi-apptware
d69966074a
fix(ingest/bigquery): Map BigQuery policy tags to datahub column-level tags (#10669) 2024-06-14 16:43:12 +05:30
Andrew Sikowitz
46dbb10940
docs(ingest): Rename csv / s3 / file source and sink (#10675) 2024-06-11 11:44:13 -07:00
sid-acryl
2c3943d723
fix(doc): Fix doc typo in transformer (#10658) 2024-06-07 09:16:28 -07:00
Woong Seok Kang
5b4fc9612f
docs(ingest): remove trailing comma on athena permission (#10634) 2024-06-04 21:59:43 -07:00
Eric L (CCCS)
c04b3bc2e4
fix(ingest/iceberg): update iceberg source to support newer versions of pyiceberg at runtime (#10614) 2024-06-04 09:45:29 -07:00
sid-acryl
666de9e4e6
fix(ingestion/powerbi): Databricks support for table lineage (#10416) 2024-05-22 18:57:45 +05:30
sagar-salvi-apptware
5fbf781558
fix(ingest/transformer): Add dataset domains based on tags using transformer (#10458) 2024-05-15 14:13:03 +05:30
Hyejin Yoon
10cbbd7619
docs: fix docs utms & slack footer (#10481) 2024-05-12 16:39:33 -07:00
Davi Arnaut
94d424b7d4
fix(docs): adjust new requirements for DynamoDB ingestion (#10470) 2024-05-09 10:22:33 -05:00
dushayntAW
c00ddb2a0d
fix(ingest/transformer): new transformer to clean user URN for datasetUsageStatistics aspect (#10398) 2024-05-03 13:24:48 +05:30
Ellie O'Neil
d82750b891
DynamoDB IAM auth (#10419) 2024-05-02 16:02:40 -07:00