Adriano Vega Llobell
|
3d7962cf17
|
fix(ingest/sql): improve handling of views with dots in their names (#9183)
|
2023-11-28 17:58:42 -05:00 |
|
Mayuri Nehate
|
08fb730676
|
fix(ingest): drop deprecated database_alias from sql sources (#9299)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-11-28 15:49:49 -05:00 |
|
Tamas Nemeth
|
f794a90515
|
fix(ingest/snowflake): Apply email filter on all usage metrics (#9269)
|
2023-11-23 09:45:25 +01:00 |
|
RyanHolstien
|
a62d52e6b1
|
feat(mysql): upgrade to version 8.2 for quickstart (#9241)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
|
2023-11-22 13:54:12 -06:00 |
|
Tim
|
01874808af
|
fix(ingest/athena): detect decimal type correctly (#9270)
|
2023-11-20 16:57:48 +01:00 |
|
Adriano Vega Llobell
|
d0fa5de9f0
|
fix(sql-parser): convert platform instance to lowercase when building table urns (#9181)
|
2023-11-16 13:58:49 -05:00 |
|
Harshal Sheth
|
19aa215068
|
feat(ingest/dbt): dbt column-level lineage (#8991)
|
2023-11-13 19:00:30 -05:00 |
|
Shubham Jagtap
|
a187127ac5
|
feat(ingestion): file-based state checkpoint provider (#9029)
|
2023-11-10 14:36:00 -08:00 |
|
Andrew Sikowitz
|
2c58c63780
|
fix(ingest/datahub-source): Order by version in memory (#9185)
|
2023-11-06 15:58:57 -05:00 |
|
Harshal Sheth
|
ec9725026d
|
chore(ingest): remove legacy memory_leak_detector (#9158)
|
2023-11-02 09:39:08 -07:00 |
|
Harshal Sheth
|
bab9d1c931
|
fix(ingest): fully support MCPs in urn_iter primitive (#9157)
|
2023-11-01 20:47:18 -07:00 |
|
Harshal Sheth
|
55f14530a3
|
feat(ingest): bump sqlglot parser (#9155)
|
2023-11-01 12:42:52 +05:30 |
|
Harshal Sheth
|
ea1273281e
|
feat(ingest): sql parser perf + asyncio fixes (#9119)
|
2023-10-30 20:57:59 -07:00 |
|
Harshal Sheth
|
ce0f36b8bc
|
feat(sqlparser): support more update syntaxes + fix bug with subqueries (#9105)
|
2023-10-30 14:23:19 -07:00 |
|
Harshal Sheth
|
0bd2d9a36c
|
feat(ingest): add entity_supports_aspect helper (#9120)
|
2023-10-30 14:22:05 -07:00 |
|
Mayuri Nehate
|
f402090c1e
|
feat(ingest): support view lineage for all sqlalchemy sources (#9039)
|
2023-10-26 09:14:32 -07:00 |
|
Andrew Sikowitz
|
6c932e8afe
|
feat(ingest/bigquery): Attempt to support raw dataset pattern (#9109)
|
2023-10-25 13:17:09 -07:00 |
|
Andrew Sikowitz
|
8a80e858a7
|
build(ingest): Bump avro pin: security vulnerability (#9042)
|
2023-10-25 13:06:12 -04:00 |
|
siddiquebagwan-gslab
|
b612545220
|
feat(ingestion/redshift): support auto_incremental_lineage (#9010)
|
2023-10-25 15:26:06 +05:30 |
|
skrydal
|
378d84a346
|
fix(ui): Fixes handling of resources filters in UI (#9087)
|
2023-10-24 21:12:11 +01:00 |
|
Harshal Sheth
|
d13553f53a
|
feat(sqlparser): extract CLL from updates (#9078)
|
2023-10-24 12:24:50 -07:00 |
|
Andrew Sikowitz
|
adf8c8db38
|
refactor(ingest): Move sqlalchemy import out of sql_types.py (#9065)
|
2023-10-24 08:59:56 +02:00 |
|
Harshal Sheth
|
8fb95e88a1
|
feat(sqlparser): parse create DDL statements (#9002)
|
2023-10-23 12:40:42 -07:00 |
|
Tim
|
1eaf9c8c5f
|
feature(ingest/athena): introduce support for complex and nested schemas in Athena (#8137)
Co-authored-by: dnks23 <dominik.s23@live.de>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: Tim <tim@MBP-von-Tim.fritz.box>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-10-18 09:39:59 -07:00 |
|
Andrew Sikowitz
|
d2eb42373f
|
fix(ingest/sqlalchemy): Fix URL parsing when sqlalchemy_uri provided (#9032)
|
2023-10-18 17:34:45 +02:00 |
|
Mayuri Nehate
|
c81a339bfc
|
build(ingest): remove ratelimiter dependency (#9008)
|
2023-10-16 09:27:57 -07:00 |
|
Andrew Sikowitz
|
6bc7425353
|
feat(cli/datacontract): Add data quality assertion support (#8968)
Co-authored-by: Mayuri Nehate <33225191+mayurinehate@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
|
2023-10-13 12:36:18 -04:00 |
|
Tamas Nemeth
|
a8f0080c08
|
feat(ingest/teradata): Teradata source (#8977)
|
2023-10-12 15:14:45 -07:00 |
|
Tamas Nemeth
|
c381806110
|
feat(ingestion): Adding config option to auto lowercase dataset urns (#8928)
|
2023-10-12 13:56:30 +02:00 |
|
Tamas Nemeth
|
dd418de76d
|
fix(ingest/bigquery): Fix shard regexp to match without underscore as well (#8934)
|
2023-10-12 13:10:59 +02:00 |
|
Harshal Sheth
|
84bba4dc44
|
feat(ingest): add output schema inference for sql parser (#8989)
|
2023-10-11 22:31:17 -07:00 |
|
siddiquebagwan-gslab
|
10a190470e
|
feat(ingestion/redshift): CLL support in redshift (#8921)
|
2023-10-10 20:24:08 -07:00 |
|
Mayuri Nehate
|
57f855ecd1
|
feat(ingest): refactor + simplify incremental lineage helper (#8976)
|
2023-10-09 23:48:21 -07:00 |
|
Mayuri Nehate
|
8d175ef7ef
|
feat(ingest): incremental lineage source helper (#8941)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-10-09 13:34:25 -07:00 |
|
Harshal Sheth
|
3cede10ab3
|
feat(ingest/dbt): support use_compiled_code and test_warnings_are_errors (#8956)
|
2023-10-05 10:29:47 -07:00 |
|
Harshal Sheth
|
817c371fbf
|
feat: data contracts models + CLI (#8923)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: John Joyce <john@acryl.io>
|
2023-10-04 20:11:06 -07:00 |
|
ethan-cartwright
|
e2afd44bfe
|
feat(dbt-ingestion): add documentation link from dbt source to institutionalMemory (#8686)
Co-authored-by: Ethan Cartwright <ethan.cartwright@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-10-04 20:38:58 +00:00 |
|
Andrew Sikowitz
|
301d3e6b1c
|
test(ingest/unity): Add Unity Catalog memory performance testing (#8932)
|
2023-10-04 10:23:13 -04:00 |
|
Upendra Rao Vedullapalli
|
13508a9d88
|
feat(bigquery): excluding projects without any datasets from ingestion (#8535)
Co-authored-by: Upendra Vedullapalli <upendra.rao.vedullapalli@entur.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
|
2023-10-04 09:20:51 -04:00 |
|
Harshal Sheth
|
a300b39f15
|
feat(ingest/airflow): airflow plugin v2 (#8853)
|
2023-10-04 16:23:15 +05:30 |
|
Aseem Bansal
|
ad313ad282
|
feat(transfomer): add transformer to get ownership from tags (#8748)
|
2023-10-04 14:06:03 +05:30 |
|
hariishaa
|
622816dcb8
|
feat(metadata-ingestion): implement mlflow source (#7971)
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
|
2023-09-26 13:51:30 -04:00 |
|
Mayuri Nehate
|
874109f76e
|
feat(ingest/snowflake): allow shares config without platform instance (#8803)
|
2023-09-25 14:04:05 +05:30 |
|
Mayuri Nehate
|
5c40390a92
|
feat(ingest/kafka): support metadata mapping from kafka avro schemas (#8825)
Co-authored-by: Daniel Messias <danielcmessias@gmail.com>
Co-authored-by: Deepankarkr <deepankar.kumar@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
|
2023-09-22 17:11:42 -07:00 |
|
Harshal Sheth
|
2a0200b047
|
feat(ingest): bump acryl-sqlglot (#8882)
|
2023-09-21 14:28:51 -07:00 |
|
Mayuri Nehate
|
cdb9f5ba62
|
feat(bigquery): add better timers around every API call (#8626)
|
2023-09-15 11:55:39 -07:00 |
|
Harshal Sheth
|
0e8000cf18
|
feat(ingest): drop sql_metadata parser (#8765)
|
2023-09-07 11:32:28 -07:00 |
|
Harshal Sheth
|
4ffad4d9b9
|
chore(ingest): upgrade sqlglot fork (#8775)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
|
2023-09-06 12:49:44 -07:00 |
|
Mayuri Nehate
|
e680a97046
|
fix(ingest/bigquery): fix partition and median queries for profiling (#8778)
|
2023-09-06 12:48:11 -07:00 |
|
cccs-eric
|
6fe60a274e
|
feat(iceberg): Upgrade Iceberg ingestion source to pyiceberg 0.4.0 (#8357)
Co-authored-by: cccs-Dustin <96579982+cccs-Dustin@users.noreply.github.com>
Co-authored-by: Fokko Driesprong <fokko@apache.org>
Co-authored-by: Andrew Sikowitz <andrew.sikowitz@acryl.io>
|
2023-08-31 13:01:05 -04:00 |
|