Sergio Gómez Villamor
|
31edb46dbc
|
feat(ingestion): adds env property in ContainerProperties (#11214)
Co-authored-by: siladitya2 <siladitya2@gmail.com>
|
2024-09-18 14:56:52 +05:30 |
|
Alisa Aylward
|
675b225c5b
|
feat(ingest/snowflake): Add cluster formula to dataset properties (#11254)
|
2024-08-29 16:11:35 -07:00 |
|
Alisa Aylward
|
ca2e134d34
|
fix(ingest/snowflake): exclude snowflake excluded tags (#11250)
|
2024-08-27 08:48:59 -07:00 |
|
Alisa Aylward
|
88b3893b5c
|
feat(ingest/snowflake): allow iceberg tables in lineage and access metadata (#10961)
|
2024-08-22 01:20:51 +00:00 |
|
Harshal Sheth
|
a4bce6af1c
|
feat(ingest): add snowflake-queries source (#10835)
|
2024-07-12 15:08:51 -07:00 |
|
John Joyce
|
fa3e381f83
|
refactor(ingest): Refactor structured logging to support infos, warnings, and failures structured reporting to UI (#10828)
Co-authored-by: John Joyce <john@Johns-MBP.lan>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-07-03 19:20:58 -07:00 |
|
Harshal Sheth
|
0d677e4992
|
fix(ingest/snowflake): fix column batcher (#10781)
|
2024-06-25 22:21:54 -07:00 |
|
Harshal Sheth
|
0dc0bc5761
|
feat(ingest/snowflake): performance improvements (#10746)
|
2024-06-25 14:46:55 -07:00 |
|
Harshal Sheth
|
2d727a960b
|
feat(ingest/snowflake): support more than 10k views in a db (#10718)
|
2024-06-18 07:37:39 +02:00 |
|
Harshal Sheth
|
62c6704f69
|
feat(ingest/snowflake): refactor + parallel schema extraction (#10653)
|
2024-06-14 13:23:07 -07:00 |
|
Harshal Sheth
|
e842161849
|
feat(ingest): add fast query fingerprinting (#10619)
|
2024-06-05 13:47:44 -07:00 |
|
Harshal Sheth
|
3d5735cbc5
|
chore(ingest): run pyupgrade for python 3.8 (#10513)
|
2024-05-15 22:31:05 -07:00 |
|
Mayuri Nehate
|
f6627efe71
|
fix(ingest/snowflake): add more reporting for usage aggregation, handle lineage errors (#10279)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-05-07 08:42:39 -07:00 |
|
Harshal Sheth
|
7d31420b69
|
feat(ingest): materialize terms produced by ingestion (#10249)
|
2024-04-18 10:48:16 -07:00 |
|
Harshal Sheth
|
a70e775a12
|
feat(ingest): emit platform for query entities (#10103)
|
2024-03-26 11:22:53 -07:00 |
|
Mayuri Nehate
|
77c72dad01
|
feat(ingest): add classification to bigquery, redshift (#10031)
|
2024-03-13 22:45:28 -07:00 |
|
Harshal Sheth
|
7e2076e852
|
feat(ingest): add query formatting to sql aggregator (#10025)
|
2024-03-11 15:34:44 -07:00 |
|
Mayuri Nehate
|
8047d0b514
|
feat(ingest/snowflake): generate query nodes for snowflake (#9966)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2024-03-06 15:11:37 -08:00 |
|
Harshal Sheth
|
ecda3e6187
|
feat(ingest): pydantic v2 compatibility (#9434)
|
2023-12-18 18:26:33 -05:00 |
|
Tamas Nemeth
|
03590a1948
|
fix(ingest/snowflake) - Fixing snowflake url with default region (#9443)
|
2023-12-18 13:54:31 -05:00 |
|
Tamas Nemeth
|
0ea6145a9d
|
fix(ingest/profiling): Add option to enable external table profiling (#9463)
|
2023-12-15 00:12:45 +01:00 |
|
Mayuri Nehate
|
08fb730676
|
fix(ingest): drop deprecated database_alias from sql sources (#9299)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-11-28 15:49:49 -05:00 |
|
Tamas Nemeth
|
f794a90515
|
fix(ingest/snowflake): Apply email filter on all usage metrics (#9269)
|
2023-11-23 09:45:25 +01:00 |
|
Harshal Sheth
|
ec9725026d
|
chore(ingest): remove legacy memory_leak_detector (#9158)
|
2023-11-02 09:39:08 -07:00 |
|
Mayuri Nehate
|
e02b9096bd
|
fix(ingest/snowflake): missing view downstream cll if platform instance is set (#8966)
|
2023-10-27 12:03:43 -07:00 |
|
Mayuri Nehate
|
f402090c1e
|
feat(ingest): support view lineage for all sqlalchemy sources (#9039)
|
2023-10-26 09:14:32 -07:00 |
|
Mayuri Nehate
|
8d175ef7ef
|
feat(ingest): incremental lineage source helper (#8941)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-10-09 13:34:25 -07:00 |
|
Aseem Bansal
|
2bc685d3b9
|
ci: tweak ci to decrease wait time of devs (#8945)
|
2023-10-05 09:31:32 +05:30 |
|
Mayuri Nehate
|
cc94ffbf6c
|
fix(ingest): stateful redundant run skip handler (#8467)
|
2023-08-28 15:03:31 +05:30 |
|
Andrew Sikowitz
|
8141e2d649
|
remove(ingest/snowflake): Remove legacy snowflake lineage (#8653)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
|
2023-08-23 15:57:46 -04:00 |
|
Mayuri Nehate
|
ddcd5109dc
|
feat(ingest): allow relative start time config (#8562)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-08-14 17:48:06 -07:00 |
|
Mayuri Nehate
|
b4e104f190
|
fix(ingest/snowflake): maintain qualified name casing, do not lowercase (#8574)
|
2023-08-04 10:43:22 -07:00 |
|
mohdsiddique
|
6a36118b4f
|
feat(ingestion/snowflake): use user email-id in urn generation for top users stat (#8513)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
|
2023-08-03 08:30:50 +05:30 |
|
Mayuri Nehate
|
e67f811034
|
feat(classification): allow parallelisation to reduce time (#8368)
|
2023-08-02 09:53:39 +05:30 |
|
Andrew Sikowitz
|
3a21c27f06
|
feat(ingest): Turn on browse path v2 creation (#8342)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-07-06 16:43:42 -04:00 |
|
Andrew Sikowitz
|
aa5e02d0ec
|
feat(ingest): Create zero usage aspects (#8205)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
|
2023-06-22 17:07:50 -04:00 |
|
Mayuri Nehate
|
ab3fe0da81
|
refractor(classification): datahub classifier init (#8193)
|
2023-06-12 05:07:03 -07:00 |
|
Mayuri Nehate
|
ac06cf3d3f
|
feat(classification): configurable minimum values threshold (#8186)
|
2023-06-07 21:28:13 -07:00 |
|
Mayuri Nehate
|
983a8ca675
|
feat(classification): support for regex based custom infotypes (#8177)
|
2023-06-06 14:41:51 +02:00 |
|
Harshal Sheth
|
4e9c652707
|
feat(ingest): add env to container properties (#8027)
|
2023-05-22 12:07:16 -07:00 |
|
Mayuri Nehate
|
c845c75a2d
|
feat(ingest/snowflake): add config option to specify deny patterns for upstreams (#7962)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
|
2023-05-08 14:13:57 -07:00 |
|
Mayuri Nehate
|
3212e74969
|
feat(ingest/snowflake): optionally emit all upstreams irrespective of recipe pattern (#7842)
|
2023-04-24 11:01:15 -07:00 |
|
Mayuri Nehate
|
5fd7981532
|
fix(ingest/snowflake): fix incorrect tag urn case, improve tag display name (#7758)
|
2023-04-07 13:07:08 -07:00 |
|
Mayuri Nehate
|
1fda92441f
|
feat(snowflake): improve snowflake lineage perf and memory, push down to snowflake (#7710)
|
2023-04-07 11:06:06 -07:00 |
|
Shirshanka Das
|
17e85979dd
|
refactor(ingest): subtypes - standardize (#7437)
|
2023-02-28 13:11:07 -08:00 |
|
Andrew Sikowitz
|
8fd2cc5f20
|
fix(ingest/snowflake): Improve memory usage of metadata extraction (#7349)
|
2023-02-20 14:46:10 +01:00 |
|
Aseem Bansal
|
372f673aef
|
chore(ci): mark tests correctly (#7337)
|
2023-02-15 16:32:53 +05:30 |
|
Tamas Nemeth
|
0cdb5e4b4b
|
refactor(ingest/containers): Refactoring container creation to common place (#6877)
|
2023-01-21 00:14:31 +01:00 |
|
Fredrik Sannholm
|
e0aa812621
|
feat(ingest): allow extracting snowflake tags (#6500)
|
2023-01-04 16:05:23 -05:00 |
|
Tamas Nemeth
|
ead0074169
|
deprecate(ingest): bigquery - Removing bigquery-legacy source (#6851)
Co-authored-by: John Joyce <john@acryl.io>
|
2022-12-29 13:19:05 -08:00 |
|