3975 Commits

Author SHA1 Message Date
Harshal Sheth
82e5a049ca
fix(ingest/redshift): reduce severity of SQL parsing issues (#10924) 2024-07-17 13:44:07 +02:00
Joel Pinto Mata (KPN-DSH-DEX team)
13b6febce9
feat(ingest/abs): Adding azure blob storage ingestion source (#10813) 2024-07-17 11:06:05 +02:00
pie1nthesky
298c299cf1
feat(ingest/postgres): fetch table sizes for profile (#10864) 2024-07-16 16:06:42 -07:00
Patrick Franco Braz
4b83adfa9f
fix(ingest/bigquery): changes helper function to decode unicode scape sequences (#10845) 2024-07-16 15:50:54 -07:00
Nadav Gross
a8b07c5fe6
feat(ingestion/sqlglot): add optional default_dialect parameter to sqlglot lineage (#10830) 2024-07-16 12:28:14 -07:00
Mayuri Nehate
ff1c6b895e
feat(ingest/BigQuery): refactor+parallelize dataset metadata extraction (#10884) 2024-07-16 11:46:42 -07:00
ethan-cartwright
12ee485302
Add feature flag for view defintions (#10914)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
2024-07-16 10:54:43 -07:00
sid-acryl
bb1ba091cd
fix(ingestion/tableau): human-readable message for PERMISSIONS_MODE_SWITCHED error (#10866)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-16 10:36:51 -07:00
Gabe Lyons
ea2216ad64
fix(structured properties): allow application of structured properties without schema file (#10918) 2024-07-16 08:18:37 -07:00
Nicholas Pena
cfcd216924
feat(dataset): add support for external url in Dataset (#10877) 2024-07-15 15:57:23 -07:00
Aseem Bansal
437bacb0e6
feat(ingest): grafana connector (#10891)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-15 14:12:18 -07:00
John Joyce
8967db0de7
refactor(redshift): Improve redshift error handling with new structured reporting system (#10870)
Co-authored-by: John Joyce <john@Johns-MBP.lan>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-15 11:57:21 -07:00
Harshal Sheth
ea7d6a91e5
fix(ingest): improve auto_materialize_referenced_tags_terms error handling (#10906) 2024-07-12 22:32:54 -07:00
Harshal Sheth
a4bce6af1c
feat(ingest): add snowflake-queries source (#10835) 2024-07-12 15:08:51 -07:00
Gabe Lyons
423af83ef1
feat(rest-emitter): adding async flag to rest emitter (#10902)
Co-authored-by: Gabe Lyons <gabe.lyons@acryl.io>
2024-07-12 13:30:21 -07:00
sid-acryl
aa92a99130
fix(ingestion/looker): column name missing in explore (#10892) 2024-07-12 13:17:53 +05:30
Harshal Sheth
89bda5bdd9
fix(ingest/redshift): handle multiline alter table commands (#10727) 2024-07-11 16:32:37 -07:00
Harshal Sheth
351e434856
fix(ingest/dbt): always encode tag urns (#10799) 2024-07-11 16:32:16 -07:00
Harshal Sheth
82bd3c248f
fix(ingest): only populate audit stamps where accurate (#10604) 2024-07-11 13:26:57 -07:00
Harshal Sheth
44930dfd1e
fix(ingest/looker): add missing dependency (#10876) 2024-07-11 13:25:13 -07:00
Harshal Sheth
418f7e05cd
feat(ingest/lookml): shallow clone repos (#10888) 2024-07-11 13:24:08 -07:00
Harshal Sheth
e5d42715f0
fix(build): upgrade vercel builds to Node 20.x (#10890) 2024-07-11 13:23:57 -07:00
sid-acryl
609847fa59
fix(ingestion/looker): Add sqlglot dependency and remove unused sqlparser (#10874) 2024-07-09 12:51:08 -07:00
haeniya
3e86192b29
feat(ingestion/tableau): optionally ingest multiple sites and create site containers (#10498)
Co-authored-by: Yanik Häni <Yanik.Haeni1@swisscom.com>
2024-07-09 11:49:41 -07:00
Tamas Nemeth
d204d5654a
fix(ingestion/spark): Platform instance and column level lineage fix (#10843)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-09 13:54:06 +02:00
Shubham Jagtap
b6c7fe8267
refactor(ingestion): remove company domain for security reason (#10839) 2024-07-08 21:15:20 -07:00
Tamas Nemeth
1c8e8c32b5
chore(ingest): Mypy 1.10.1 pin (#10867) 2024-07-08 19:43:45 +02:00
Aseem Bansal
41b9e15235
feat(ingest/audit): add client id and version in system metadata props (#10829) 2024-07-08 09:38:12 -07:00
sid-acryl
43bac365bc
fix(ingestion/lookml): liquid template resolution and view-to-view cll (#10542) 2024-07-08 09:26:39 -07:00
Mayuri Nehate
54b9d98177
ci(ingest): pin dask dependency for feast (#10865) 2024-07-08 18:52:11 +05:30
ipolding-cais
97638c3b9a
fix(ingest/tableau): quote special characters in external URL (#10842) 2024-07-07 21:49:49 -07:00
Mayuri Nehate
6e50bcc7ea
fix(ingest/nifi): remove duplicate upstream jobs (#10849) 2024-07-04 09:27:06 +02:00
John Joyce
fa3e381f83
refactor(ingest): Refactor structured logging to support infos, warnings, and failures structured reporting to UI (#10828)
Co-authored-by: John Joyce <john@Johns-MBP.lan>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-03 19:20:58 -07:00
cburroughs
c24d7805bd
chore(ingest): update acryl-datahub-classify version (#10844) 2024-07-03 16:32:46 -07:00
Julien Jehannet
73cdfeb6c2
feat(ingest/glue): add helper method to permit user or group ownership (#10784) 2024-07-03 10:24:41 -07:00
david-leifker
ea6bc61787
fix(ingestion): fix datajob patcher (#10827) 2024-07-03 11:47:08 -05:00
sagar-salvi-apptware
b8af2b9d69
fix(ingestion/glue): ensure date formatting works on all platforms for aws glue (#10836) 2024-07-03 18:05:37 +05:30
Aseem Bansal
e45f7a4167
feat(cli): add more details to get cli (#10815) 2024-07-03 12:25:15 +05:30
skrydal
099021c7a3
feat(ingest/glue): allow ingestion of empty databases from Glue (#10666)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-03 11:43:12 +05:30
jordanjeremy
226b059684
fix(ingest): correct profile_day_of_week implementation (#10818) 2024-07-03 11:42:55 +05:30
Chris Collins
b651d81289
feat(SDK) Add StructuredPropertyPatchBuilder in python sdk and provide sample CRUD files (#10824) 2024-07-02 12:39:08 -04:00
dushayntAW
40418d9184
fix(ingestion/unity-catalog): fixed issue with profiling with GE turned on (#10752)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-07-02 15:31:43 +05:30
sagar-salvi-apptware
640d42dc65
feat(ingest/transformer): tags to terms transformer (#10758)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-07-02 15:30:05 +05:30
Ellie O'Neil
2d453c8eb2
docs(ingest): add business glossary examples (#9851) 2024-07-01 17:56:25 -04:00
Chris Collins
6745dfb45e
feat(SDK) Add FormPatchBuilder in python sdk and provide sample CRUD files (#10821) 2024-07-01 17:48:09 -04:00
sid-acryl
3e4749624f
feat(ingest/lookml): ingest field tags (#10792)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-01 11:15:51 -07:00
Oleksandr Simonchuk
8b4e302881
feat(ingest): add and use file system abstraction in file source (#8415)
Co-authored-by: oleksandrsimonchuk <oleksandr.si@appsflyer.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-01 10:47:07 -07:00
Mayuri Nehate
b6ec52bf5c
docs(classification): correct the casing for full name infotype (#10782) 2024-07-01 10:45:25 -07:00
Tim Drahn
93616f7869
fix(ingestion): ingest emails as empty if no ldap attribute (#9433)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-01 11:53:41 +05:30
Teppo Naakka
b223281305
feat(ingest/powerbi): powerbi dataset profiling (#9355) 2024-06-28 14:50:08 -07:00