3904 Commits

Author SHA1 Message Date
Harshal Sheth
ef3a8148ec
fix(ingest): bump sqlglot + add some debug info to tests (#9867) 2024-02-21 13:07:59 -08:00
Harshal Sheth
b15b352a00
fix(ingest): better logging line attribution (#9876) 2024-02-21 11:37:57 -08:00
Harshal Sheth
f13ae77966
feat(ingest): add escape hatch methods to SqlParsingAggregator (#9860) 2024-02-21 11:33:05 -08:00
Andrew Jones
66871cb81d
fix(ingest/redash): Limit size of RedashSourceReport (#9873) 2024-02-20 17:48:43 -08:00
Jay Feldman
cda34b50fc
fix(ingest/looker): update for Looker query API breaking change (#9865) 2024-02-15 16:08:01 -08:00
Tony Ouyang
ae1806fefa
feat(ingest/dynamoDB): flatten struct fields (#9852)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-02-15 13:40:03 -08:00
Harshal Sheth
29ca570f29
feat(ingest): clean up reporting methods (#9848) 2024-02-15 02:28:05 -05:00
Harshal Sheth
045c76a0e4
feat(ingest): reporting logging tweaks (#9835) 2024-02-14 11:06:03 -08:00
Chris Collins
8f89ec7f67
fix(forms) Prevent schema field prompts from being required (#9831) 2024-02-14 10:01:00 -05:00
Tamas Nemeth
89018e26fd
fix(ingest/profiling): ignore limit/offset when counting table row count in profiling (#9635) 2024-02-12 16:06:29 -08:00
Dimitri
709c596867
feat(openapi): allow Bearer token (#9669)
Co-authored-by: Dimitri GRISARD <dgrisard-externe@bedrockstreaming.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-11 17:21:38 -05:00
Harshal Sheth
71c966bb13
fix(cli): fix quickstart command with pydantic v2 (#9806) 2024-02-10 13:15:48 -05:00
Harshal Sheth
5793467e29
feat(quickstart): remove container_name from compose files (#9809) 2024-02-09 20:45:30 -05:00
sleeperdeep
7d73c41989
feat(ingest/oracle): support changing data dictionary (ALL_ or DBA_) (#8873)
Co-authored-by: sleeperdeep <--global>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-09 18:56:52 -05:00
Harshal Sheth
9d79e0877a
feat(cli): make docker compose project name configurable (#9808) 2024-02-09 18:27:29 -05:00
Harshal Sheth
24da7a573b
test(ingest): use pytest-random-order for unit tests (#9753) 2024-02-09 18:20:05 -05:00
Sergio Gómez Villamor
93a7afbf0f
feat(ingest/glossary): handle ownership type in business glossary connector (#9805) 2024-02-09 16:30:51 -05:00
Harshal Sheth
0d780e5f8f
feat(ingest): sql parsing aggregator (#9786) 2024-02-09 16:27:45 -05:00
Harshal Sheth
f8f1af2735
feat(ingest/dbt): speed up test result only ingestion (#9791) 2024-02-08 23:17:32 +01:00
Aseem Bansal
45511644e7
feat(ingest/slack): source to get user info from slack (#9776) 2024-02-08 14:05:26 +05:30
Harshal Sheth
a3ef587f54
feat(ingest/glossary): support pydantic v2 in business-glossary source (#9763) 2024-02-05 13:12:49 -08:00
Tamas Nemeth
3bfc1e46a7
fix(ingest/fivetran): Fixing issue when connector user is empty (#9774) 2024-02-05 11:51:57 -08:00
skrydal
bf1ce96ae6
feat(cli): Add support for custom ownership types to dataproduct CLI (#9762)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-02-05 08:29:14 -08:00
cburroughs
3b898dbae9
fix(ingest/snowflake): stop pinning transitive spacy dependency (#9768) 2024-02-05 08:28:24 -08:00
Dimitri
1d514cb0d4
docs(ingesti/elastcsearch): add description fields (#9693)
Co-authored-by: Dimitri GRISARD <dgrisard-externe@bedrockstreaming.com>
2024-02-05 17:37:56 +05:30
Andrea Scarpino
f743d3c044
feat(ingest/metabase): Allow to configure a different url for links (#9727) 2024-02-05 17:36:50 +05:30
Aseem Bansal
fd34e41614
feat(ci): check for packages, change location of lint (#9759) 2024-02-03 13:57:13 +05:30
cburroughs
eb8017d6eb
feat(ingestion/feast): loosen feast dependency (#9769) 2024-02-02 14:47:26 -08:00
cburroughs
b4d70dd13f
chore(ingest/feast): drop redundant typeguard constraint (#9770) 2024-02-02 14:46:54 -08:00
Harshal Sheth
0e418b527e
fix(ingest): upgrade pytest-docker (#9765) 2024-02-01 16:33:15 -08:00
sid-acryl
533130408a
feat(ingestion/redshift): collapse lineage to permanent table (#9704)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: treff7es <treff7es@gmail.com>
2024-02-01 12:47:09 -08:00
sid-acryl
874c683f2a
fix(ingest/transformer): generate ownership aspect from handle_end_of_stream (#9720) 2024-01-31 14:25:08 -08:00
sid-acryl
ad2df22d78
feat(ingestion/dbt): multiple node owner separated by comma (#9740)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
2024-01-31 16:38:26 +01:00
Aseem Bansal
3f9490d901
feat(cli): option to init via username password, add lint for smoke-test (#9675)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-31 14:42:40 +05:30
Aseem Bansal
aa98f4897a
feat(cli): add sibling helper CLI command (#9744) 2024-01-30 17:54:09 +05:30
Aseem Bansal
8559ebae20
feat(ingest/okta): option to only ingest users from filtered groups (#9738) 2024-01-30 12:49:07 +05:30
Ellie O'Neil
d1604b39cc
feat(ingestion/tableau) Ingest tags from datasource (#9730)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-29 17:17:07 -08:00
Shirshanka Das
1d06d38b68
feat(platform): add support for via nodes (#9733) 2024-01-29 16:03:27 -08:00
Harshal Sheth
1498c36875
chore(cli): drop support for python 3.7 (#9731) 2024-01-29 10:50:47 -08:00
Tamas Nemeth
5735eb3a55
fix(ingest/test): Fixing breaking change in moto 5.0 library (#9736) 2024-01-29 19:42:30 +05:30
Tamas Nemeth
90c88082b1
fix(ingest/s3): Not sorting schema fields to keep original order (#9349) 2024-01-29 14:14:34 +01:00
Harshal Sheth
2bb4b73f98
fix(ingest/metabase): add missing sql parser dep (#9725) 2024-01-26 23:03:16 +01:00
Harshal Sheth
5adb799f13
fix(cli): fix example data contract yaml + update airflow codecov (#9707) 2024-01-26 23:02:52 +01:00
Dmytro Kulyk
fc27ab2fb5
fix(ingest/glue): Profiling breaks for non-partitioned tables due to absent Table.PartitionKeys (#9591) 2024-01-26 10:54:06 -08:00
tom
f7f0b14f37
fix(ingestion/metabase): Fetch Dashboards through Collections (#9631)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-25 17:51:41 -08:00
Shubham Jagtap
f83a2fab44
fix(ingestion/bigquery): Table-view-snapshot Lineage Bug fix (#9579)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-01-25 18:48:41 +05:30
Andrew Sikowitz
53c7790f9a
feat(ingest/metabase): Use new sql parser; reduce error reporting levels (#9714) 2024-01-25 10:36:59 +01:00
Harshal Sheth
9d8e2b9067
feat(ingest/tableau): map trino_jdbc platform type (#9708) 2024-01-24 14:38:25 -08:00
Harshal Sheth
9b051e38d6
feat(ingest/dbt): support aws config without region (#9650)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2024-01-24 14:29:41 -08:00
Dimitri
7ae88d97ab
docs(openapi): improve description fields (#9690) 2024-01-24 12:29:28 +05:30