sid-acryl
4e35016696
fix(ingest/lookml): support view inheritance for fields ( #11148 )
2024-08-21 12:32:46 -04:00
Mayuri Nehate
9568a4254d
feat: separate great-expectations action package ( #11096 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-21 12:13:36 -04:00
sid-acryl
6b3c06ae8c
fix(ingestion/lookml): drop hive. from CLL ( #11210 )
2024-08-21 14:56:37 +05:30
sid-acryl
627c5abfd6
feat(ingestion/bigquery): Add ability to filter GCP project ingestion based on project labels ( #11169 )
...
Co-authored-by: Alice Naghshineh <alice.naghshineh@nytimes.com>
Co-authored-by: Alice Naghshineh <45885699+anaghshineh@users.noreply.github.com>
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-08-20 14:42:00 -04:00
skrydal
b46a9632cb
fix(tests): Bump databricks-sdk dependency to >=0.30.0 ( #11209 )
2024-08-20 15:07:30 +01:00
skrydal
8f7642b910
fix(ingestion/tableau): Tableau field type parsing ( #11202 )
2024-08-20 13:24:16 +02:00
Harshal Sheth
bb8cf97ea3
feat(ingest/dbt): skip CLL on sources with skip_sources_in_lineage ( #11195 )
2024-08-19 15:38:27 -07:00
sid-acryl
cb33c0fef7
feat(ingestion/lookml): support looker -- if comments ( #11113 )
2024-08-16 15:27:59 -04:00
sagar-salvi-apptware
608c5cfc33
fix(ingestion/transformer): extend dataset_to_data_product_urns_pattern to support containers ( #11124 )
2024-08-16 17:18:35 +05:30
skrydal
11890e5445
feat(ingest): allow custom SF API version ( #11145 )
2024-08-16 10:46:42 +02:00
RyanHolstien
3b895d9062
feat(docs): update docs for new release ( #11164 )
2024-08-15 15:59:22 -05:00
Harshal Sheth
897173f270
feat(dbt): support prefer_sql_parser_lineage with sources enabled ( #11168 )
2024-08-13 13:54:50 -07:00
Tamas Nemeth
5e9188ca2c
fix(ingest/databricks): Updating code to work with Databricks sdk 0.30 ( #11158 )
2024-08-13 16:57:31 +02:00
sid-acryl
b1f16f9b11
fix(ingestion/lookml): fix for sql parsing error ( #11079 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-09 15:06:42 -07:00
Harshal Sheth
17868cb069
feat(ingest): various logging improvements ( #11126 )
2024-08-09 14:48:53 -07:00
Mayuri Nehate
78336c9f58
fix(ingest/bigquery): use small batch size if use_tables_list_query_v2 is set ( #11121 )
2024-08-08 20:48:51 -07:00
Harshal Sheth
840b15083a
fix(sql-parser): prevent bad urns from alter table lineage ( #11092 )
2024-08-08 14:05:55 -07:00
AndreasHegerNuritas
a4a887c866
fix(ingest/redshift): replace r'\n' with '\n' to avoid token error redshift serverless… ( #11111 )
2024-08-08 08:38:16 -07:00
Harshal Sheth
d6e46b9bcf
fix(ingest): downgrade column type mapping warning to info ( #11115 )
2024-08-07 14:57:05 -07:00
Harshal Sheth
a25df8e6a0
fix(snowflake): avoid reporting warnings/info for sys tables ( #11114 )
2024-08-07 14:04:18 -07:00
Harshal Sheth
edb0f19f1b
fix(ingest/tableau): prevent empty site content urls ( #11057 )
...
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-08-07 13:50:08 -07:00
sid-acryl
8bea5d2a3d
feat(ingest/lookml): CLL support for sql set in sql_table_name attribute of lookml view ( #11069 )
2024-08-06 21:03:14 -07:00
sid-acryl
2755cf3559
fix(ingest/powerbi): fix broken lineage between chart and dataset ( #11080 )
2024-08-06 21:02:21 -07:00
Harshal Sheth
832093ad75
feat(ingest): tweak stale entity removal messaging ( #11064 )
2024-08-06 14:00:03 -07:00
Felix Lüdin
9619553e2d
fix(ingest): use correct native data type in all SQLAlchemy sources by compiling data type using dialect ( #10898 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-06 12:52:20 -07:00
Tamas Nemeth
41fbae5afd
fix(ingest/mode): Regexp in mode name matcher didn't allow underscore ( #11098 )
2024-08-05 22:03:21 +02:00
Pinaki Bhattacharjee
210b31135c
chore(vulnerability): Overly permissive regex range ( #11061 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-03 08:09:40 -05:00
Tamas Nemeth
6704d44470
doc(ingest): Update capabilities ( #11072 )
2024-08-02 20:58:20 -07:00
Harshal Sheth
50139431be
fix(ingest): set lastObserved in sdk when unset ( #11071 )
2024-08-02 15:48:10 -07:00
Aseem Bansal
f2e461eb63
feat(ingest/mode): add option to exclude restricted ( #11081 )
2024-08-02 21:01:46 +05:30
Harshal Sheth
f78b6c08fb
fix(py): remove dep on types-pkg_resources ( #11076 )
2024-08-02 17:27:54 +05:30
sid-acryl
d5eda0de7e
doc(ingestion/tableau): doc update for derived permission ( #11054 )
...
Co-authored-by: Pedro Silva <pedro.cls93@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 10:26:47 -07:00
Felix Lüdin
66ecfae5e4
feat(cli): add aspects parameter to DataHubGraph.get_entity_semityped ( #11009 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 13:49:32 +05:30
Pedro Silva
1e6065ea84
fix(ci): Fix lint issue in datahub_ingestion_run_summary_provider.py ( #11063 )
2024-08-01 09:11:01 +01:00
Harshal Sheth
89933fee1e
feat(ingest/dbt-cloud): update metadata_endpoint inference ( #11041 )
2024-07-31 14:16:18 -07:00
Harshal Sheth
e83550ba35
feat(ingest/tableau): add retry on timeout ( #10995 )
2024-07-31 12:20:48 -07:00
sid-acryl
dffdef2eaa
fix(ingestion/powerbi): fix issue with broken report lineage ( #10910 )
2024-07-31 11:40:09 -07:00
sid-acryl
0667470b9e
fix(ingestion/lookml): emit dummy sql condition for lookml custom condition tag ( #11008 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-31 11:39:06 -07:00
Pedro Silva
e14dc9159c
feat(cli): Trim report of dataHubExecutionRequestResult to max GMS size ( #11051 )
2024-07-31 17:45:29 +00:00
sid-acryl
4512209785
fix(ingestion/lookml): enable stack-trace in lookml logs ( #10971 )
2024-07-31 09:36:25 -07:00
Harshal Sheth
4b9844da1b
feat(ingest/dbt): add experimental prefer_sql_parser_lineage flag ( #11039 )
2024-07-31 09:23:02 -07:00
Harshal Sheth
e75118942b
fix(ingest): improve sql error reporting calls ( #11025 )
2024-07-31 18:07:38 +02:00
Pedro Silva
1955c05d78
feat(cli): Add run-id option to put sub-command ( #11023 )
...
Adds an option to assign run-id to a given put command execution.
This is useful when transformers do not exist for a given ingestion payload, we can follow up with custom metadata and assign it to an ingestion pipeline.
2024-07-31 12:29:00 +00:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container ( #11013 )
2024-07-30 15:17:04 +05:30
Hyejin Yoon
a6eb1f47c2
docs: standardize terminology to DataHub Cloud ( #11003 )
2024-07-30 09:52:51 +09:00
sagar-salvi-apptware
a09575fb6f
fix(ingestion/glue): Add support for missing config options for profiling in Glue ( #10858 )
2024-07-29 16:04:07 +05:30
Andrew Sikowitz
bc75f7a1b1
fix(graphql/upsertIngestionSource): Validate cron schedule; parse error in CLI ( #11011 )
2024-07-26 12:06:01 -07:00
Pedro Silva
1f7c92bb99
feat(docs): Document __DATAHUB_TO_FILE_ directive ( #10968 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-26 11:20:21 -07:00
Harshal Sheth
f816a14a98
fix(ingest): fix graph config loading ( #11002 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-07-26 11:15:46 -07:00
Harshal Sheth
82412e7148
fix(ingest/looker): downgrade missing chart type log level ( #10996 )
2024-07-26 11:07:00 +02:00
