312 Commits

Author SHA1 Message Date
Hyejin Yoon
704ca650ad
docs: add slack utm component in docs (#10214) 2024-04-30 12:54:54 +09:00
Harshal Sheth
e64229b036
feat(ingest/dbt): handle complex dbt sql + improve docs (#10323) 2024-04-24 11:13:32 -07:00
Raj Tekal
996e5b0130
chore(metadata) Addressing vulnerabilities (#10296) 2024-04-19 12:53:50 -07:00
Pablo Osinaga
62c7ac706b
feat(ingest/metabase): add ability to exclude other users collections (#10330) 2024-04-19 12:53:17 -07:00
Harshal Sheth
8ecafbe802
fix(ingest/kafka): clarify meta-mapping docs (#10320) 2024-04-18 10:47:43 -07:00
Mayuri Nehate
529710ab9d
fix(ingest/databricks): handle and report config parse failure, updat… (#10261) 2024-04-17 12:14:16 -07:00
Tamas Nemeth
d463a16b49
chore(ingest/presto-on-hive): Renaming presto-on-hive to hive-metastore source (#10278) 2024-04-16 23:35:16 +02:00
Shubham Jagtap
90c1249e7d
feat(ingest/sigma): Sigma connector integration (#10037)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-15 20:18:31 -07:00
dushayntAW
f860f7907d
fix(ingest/transformer): replace externalUrl in dataset properties (#10281) 2024-04-15 20:14:42 +05:30
Dotan Mor
fa0c1b3fa9
feat(ingest/cockroachdb): add cockroachdb ingestion (#10226) 2024-04-09 18:36:51 -07:00
Mayuri Nehate
6997abd42e
feat(ingest/nifi): ingest process group as browse path v2, incremental lineage (#10202)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-04-09 17:44:20 +05:30
dushayntAW
e82e8ba715
fix(ingestion/datahub): moved urn_pattern config to source config (#10215) 2024-04-08 15:54:07 +05:30
Shubham Jagtap
fa139a582e
feat(ingestion/transformer): Handle overlapping while mapping in extract ownership from tags transformer (#10201) 2024-04-04 12:19:11 -07:00
dushayntAW
8c70aa15f2
fix(ingestion/datahub): add allow/deny URN option (#10174) 2024-04-03 17:33:33 +05:30
Shubham Jagtap
9f2c5d36f3
feat(ingestion/bigquery): BigQuery Owner Label to Datahub Ownership (#10047) 2024-03-28 15:50:25 -07:00
Mayuri Nehate
9928d70c1d
fix(ingest/databricks): support hive metastore schemas with special char (#10049) 2024-03-27 09:41:46 -07:00
dushayntAW
dd502ae662
fix(ingest): added new transformer to cleanup suffix/prefix in owner URN (#10067) 2024-03-22 15:23:03 +05:30
Harshal Sheth
6c3834b38c
feat(ingest/dbt): add option to skip sources (#10077) 2024-03-21 09:10:24 +01:00
Harshal Sheth
1f9ce9d7d8
feat(ingest/dbt): point dbt assertions at dbt nodes (#10055) 2024-03-18 18:13:01 -07:00
dushayntAW
3a4bdef44a
fix(ingest/unity): generate sibling and lineage (#9894) 2024-03-18 20:22:17 +05:30
Mayuri Nehate
77c72dad01
feat(ingest): add classification to bigquery, redshift (#10031) 2024-03-13 22:45:28 -07:00
Harshal Sheth
0c7ca4cd3e
docs(ingest/lookml): update known discrepancy list (#9941)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-02-29 12:39:32 -08:00
Aditya Malik
92b1cfa194
feat(ingest): Support for JSONL in s3 source with max_rows support (#9921)
Co-authored-by: Aditya <aditya.malik@quillbot.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-28 15:05:30 +01:00
Shubham Jagtap
a1f2216da7
feat(ingest/qlik): Qlik cloud connector integration (#9682)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-26 11:27:37 -08:00
Shubham Jagtap
5921a334d3
feat(ingestion/trino): Add sibling support in ingestion (#9853) 2024-02-26 13:55:11 +05:30
tom
f7f0b14f37
fix(ingestion/metabase): Fetch Dashboards through Collections (#9631)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-25 17:51:41 -08:00
Harshal Sheth
f14dc4ded2
feat(ingest): improve sql tests + dbt reporting (#9649) 2024-01-23 08:37:23 +01:00
Pedro Silva
0906ce832d
fix(docs): Correct Kafka Connect sink documentation (#9672) 2024-01-19 16:45:22 -08:00
Mayuri Nehate
f2e78db92e
feat(ingest/databricks): ingest hive metastore by default, more docs (#9601)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-18 14:26:33 -08:00
Harshal Sheth
cf200a32ae
fix(docs-website): update copy around the video on index (#9661) 2024-01-18 12:33:19 -08:00
ethan-cartwright
dfb2f7e596
feat(classifier): Add support for excluding list of exact column names (#9472)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
2024-01-16 19:12:23 -08:00
Shubham Jagtap
0486319bc8
feat(ingestion/fivetran): Add fivetran bigquery destination support (#9531)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-10 14:18:36 -05:00
Harshal Sheth
aa28837eed
docs(slack): add note about private Slack channels (#9589) 2024-01-09 22:07:14 +01:00
Shubham Jagtap
cb8002413e
feat(ingestion/transformer): Add dataset dataproduct transformer (#9491)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-05 17:03:22 -05:00
skrydal
a495d652e0
feat(ingestion): Add typeUrn handling to ownership transformers (#9370) 2023-12-13 14:34:20 -05:00
Andrew Sikowitz
e4d8dcbc02
docs(ingest/sql-queries): Rearrange sections (#9426) 2023-12-11 09:43:23 -05:00
Andrew Sikowitz
a6726c12dd
docs(ingest/sql-queries): Add documentation (#9406) 2023-12-07 17:03:37 +01:00
Andrew Sikowitz
27f23ecdd5
feat(ingest/unity): GE Profiling (#8951) 2023-12-06 13:59:23 -05:00
Tamas Nemeth
3ee82590cd
fix(ingest/redshift): Identify materialized views properly + fix connection args support (#9368) 2023-12-05 17:42:29 +01:00
Harshal Sheth
82f375ded6
docs(ingest/lookml): clarify that ssh key has no passphrase (#9348) 2023-12-01 14:33:20 +05:30
Harshal Sheth
4d9eb12cba
feat(ingest/dbt): support custom ownership types in dbt meta (#9332) 2023-12-01 14:33:10 +05:30
terratrue-daniel
ab10e6bc58
feat(ingest/mssql): enable TLS encryption for SQLServer using pytds (#9256) 2023-11-29 13:32:26 +05:30
Harshal Sheth
2031bd4de1
docs(ingest): update docs on adding stateful ingestion (#9327) 2023-11-28 18:31:56 -05:00
Shubham Jagtap
e73e926999
feat(integration/fivetran): Fivetran connector integration (#9018)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-11-07 23:02:41 -08:00
sachinsaju
dae320c9bc
docs(teradata): teradata doc external link 404 fix (#9152) 2023-10-31 15:58:39 -07:00
Pedro Silva
86e0023a4e
feat(ingestion): Adds more advanced configurations for runtime debugging (#8998) 2023-10-21 16:20:59 +01:00
Tamas Nemeth
1007204cda
feat(ingest/teradata): view parsing (#9005) 2023-10-13 15:07:19 -04:00
Tamas Nemeth
a8f0080c08
feat(ingest/teradata): Teradata source (#8977) 2023-10-12 15:14:45 -07:00
Pedro Silva
f6e1312063
feat(ingestion): Adds support for memory profiling (#8856)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-10-12 18:43:14 +01:00
Jinlin Yang
6310e51eb0
feat(ingestion/dynamodb): implement pagination for list_tables (#8910) 2023-10-05 09:33:31 +05:30