284 Commits

Author SHA1 Message Date
Mayuri Nehate
2323affde1
feat(ingest): add display name for dynamodb tables (#12534) 2025-02-10 17:54:56 +05:30
Brock Griffey
ac13f255e6
feat(ingestion/snowflake):adds streams as a new dataset with lineage and properties. (#12318)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-02-05 10:48:37 +05:30
Chakru
7f6e3995d3
docs(iceberg): add iceberg user guide (#12533) 2025-02-05 00:57:56 +05:30
Harshal Sheth
35e2bbb960
fix(ingest): avoid multiprocessing "fork" start method (#12543) 2025-02-03 22:19:37 -08:00
Harshal Sheth
7a32256005
docs(ingest/mode): add details on authentication/permissions for mode (#12508) 2025-01-30 12:32:10 -08:00
sagar-salvi-apptware
563656c4d5
feat(ingestion/lookml): resolve access notation for LookML Constant (#12277)
Co-authored-by: Siddique Bagwan <siddique.bagwan@acryl.io>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2025-01-28 12:25:45 +05:30
Harshal Sheth
1ca95cc2ab
docs(ingest/tableau): tweak permissions docs (#12460) 2025-01-27 08:55:23 -08:00
Harshal Sheth
cb47577ac5
docs(ingest/tableau): clarify impact of lower permissions (#12452) 2025-01-23 11:45:22 -08:00
Aseem Bansal
8ac35fa9ee
fix(ingest/redshift): example recipe fix (#12413) 2025-01-21 20:03:55 +05:30
Gabe Lyons
a3c7a336fa
docs(ingest/mssql): update mssql_recipe.yml to include convert_urn_to_lowerc… (#12355) 2025-01-15 11:50:27 -08:00
Harshal Sheth
a6cd995df6
docs(ingest): refactor docgen process (#12300) 2025-01-10 10:35:13 -08:00
skrydal
30a77c022a
fix(ingestion/classifier): temporary measure to avoid deadlocks for classifier (#12261) 2025-01-06 22:12:56 +01:00
Harshal Sheth
fb471f112e
docs(tableau): clarify docs around tableau permissions (#12270) 2025-01-06 10:32:46 -08:00
Gabe Lyons
d2b67cab6d
docs(queries_v2): set use_queries_v2 to true in snowflake_recipe.yml (#12269) 2025-01-03 11:57:34 -08:00
Mayuri Nehate
c0b49a638f
docs(ingest/snowflake): update permissions for dynamic tables (#12074) 2024-12-12 15:32:15 +05:30
Mayuri Nehate
becf51575e
docs(ingest/athena): update recipe with aws key pair example (#12076) 2024-12-11 18:21:58 +05:30
sagar-salvi-apptware
57b12bd9cb
fix(ingest): replace sqllineage/sqlparse with our SQL parser (#12020) 2024-12-10 08:36:01 -08:00
k-bartlett
dc87b51369
feat(ingest): connector for Neo4j (#11526)
Co-authored-by: kbartlett <keith.bartlett@fullsight.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
Co-authored-by: Jay Feldman <8128360+feldjay@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: deepgarg-visa <149145061+deepgarg-visa@users.noreply.github.com>
Co-authored-by: Felix Lüdin <13187726+Masterchen09@users.noreply.github.com>
2024-12-02 14:53:28 +05:30
Jonny Dixon
337f2b95f5
fix(docs): fix sample business glossary (#11669) 2024-11-29 11:59:18 -08:00
sagar-salvi-apptware
c42f779859
fix: Add option for disabling ownership extraction (#11970)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-29 21:28:31 +05:30
skrydal
816fd3dba7
fix(ingestion/iceberg): Improvements to iceberg source (#11987) 2024-11-28 15:34:20 +00:00
sagar-salvi-apptware
b357f87f94
fix(ingest/sigma): migrate sigma workbooks from container to dashboard (#11939) 2024-11-26 18:56:30 +05:30
sid-acryl
86b8175627
fix(ingestion/kafka): OAuth callback execution (#11900) 2024-11-22 13:08:23 +05:30
Felix Lüdin
e4d010d757
docs(ingest/sac): add additional permission for SAP Analytics Cloud source to docs (#11903) 2024-11-20 16:05:50 -08:00
sagar-salvi-apptware
fd2da83ff4
feat(ingest/cassandra): Add support for Cassandra as a source (#11822) 2024-11-15 20:41:21 +05:30
skrydal
becda8fd34
docs(ingest): transformer docs and java example (#11859) 2024-11-15 20:19:45 +05:30
sagar-salvi-apptware
5d17ecb290
feat(ingest/dremio): Dremio Source Ingestion (#11598)
Co-authored-by: Jonny Dixon <jonny.dixon@acryl.io>
Co-authored-by: Jonny Dixon <45681293+acrylJonny@users.noreply.github.com>
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
2024-11-05 22:06:35 +05:30
noggi
94bcb79b84
feat(ingestion): Add execution request cleanup job (#11765) 2024-10-31 10:59:21 -07:00
Harshal Sheth
cd1ad16852
docs(dbt-cloud): reference service accounts in docs (#11750) 2024-10-29 21:25:00 -07:00
sid-acryl
8c53c54081
feat(ingestion/powerbi): ingest powerbi app (#11629) 2024-10-29 09:19:37 +01:00
Harshal Sheth
e96323a2a2
feat(ingest/fivetran): show connector filter reason (#11695) 2024-10-23 13:49:49 +05:30
Andrew Sikowitz
72d1236669
feat(ingest/transformer/domain): Add support for on conflict do nothing to dataset domain transformers (#11649) 2024-10-18 12:01:39 -07:00
sid-acryl
59a2f70858
feat(ingest/powerbi): fix subTypes and add workspace_type_filter (#11523)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-10-11 08:54:50 -07:00
Ellie O'Neil
732543f201
docs(datahub source): Add urn exclusions to docs (#11568) 2024-10-09 13:35:57 +05:30
sagar-salvi-apptware
660fbf8e57
fix(ingestion/transformer): Add container support for ownership and domains (#11375) 2024-10-01 11:39:07 -07:00
Jonny Dixon
a8e6a06ea4
docs(ingest/dbt): update run result paths examples (#11138) 2024-09-27 10:11:06 -07:00
sagar-salvi-apptware
68fb97f7f1
fix(ingest/openapi): update recipe for DataHub OpenAPI with url_complement and bearer token (#10980) 2024-09-25 16:54:13 -07:00
Tamas Nemeth
dea2ef00c4
feat(ingest/gc): Add dry run mode to gc recipe (#11413) 2024-09-18 13:43:22 +02:00
Tamas Nemeth
e7a3890943
feat(ingest/gc): Add dataflow and soft deleted entities cleanup (#11102) 2024-09-18 10:01:16 +02:00
Harshal Sheth
f082287a07
docs(ingest/dbt): add docs on hiding sources (#11334) 2024-09-10 10:13:25 -07:00
Harshal Sheth
9b64b117c7
docs(ingest/dbt): clarify dbt ingestion docs (#11312) 2024-09-09 09:01:46 +02:00
Aseem Bansal
efc42df3d9
ci: update outdated actions for java and python setup (#11261) 2024-08-29 14:27:35 +05:30
Aseem Bansal
15c1cfc386
ci(build): update outdated action & pin deepdiff lib (#11260) 2024-08-28 19:53:42 +05:30
Felix Lüdin
ce99bc4f22
feat(ingest): add ingestion source for SAP Analytics Cloud (#10958)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-26 11:29:15 -07:00
Mayuri Nehate
223650dd7a
feat(ingest): add bigquery-queries source (#10994)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-25 22:51:00 -07:00
Harshal Sheth
e0c13fda27
feat(ingest/dbt): add support for urns in add_owner directive (#11221) 2024-08-23 13:52:21 -04:00
Tamas Nemeth
ef6a410091
feat(ingest/s3): Partition support improvements (#11083)
- Partition autodetection
- Option to find min/max/min-max partition of a dataset
- Generating Partition aspects
2024-08-22 17:55:43 +02:00
sagar-salvi-apptware
608c5cfc33
fix(ingestion/transformer): extend dataset_to_data_product_urns_pattern to support containers (#11124) 2024-08-16 17:18:35 +05:30
sid-acryl
d5eda0de7e
doc(ingestion/tableau): doc update for derived permission (#11054)
Co-authored-by: Pedro Silva <pedro.cls93@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 10:26:47 -07:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container (#11013) 2024-07-30 15:17:04 +05:30