Aseem Bansal
f2e461eb63
feat(ingest/mode): add option to exclude restricted ( #11081 )
2024-08-02 21:01:46 +05:30
Harshal Sheth
f78b6c08fb
fix(py): remove dep on types-pkg_resources ( #11076 )
2024-08-02 17:27:54 +05:30
sid-acryl
d5eda0de7e
doc(ingestion/tableau): doc update for derived permission ( #11054 )
...
Co-authored-by: Pedro Silva <pedro.cls93@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 10:26:47 -07:00
Felix Lüdin
66ecfae5e4
feat(cli): add aspects parameter to DataHubGraph.get_entity_semityped ( #11009 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 13:49:32 +05:30
Pedro Silva
1e6065ea84
fix(ci): Fix lint issue in datahub_ingestion_run_summary_provider.py ( #11063 )
2024-08-01 09:11:01 +01:00
Harshal Sheth
89933fee1e
feat(ingest/dbt-cloud): update metadata_endpoint inference ( #11041 )
2024-07-31 14:16:18 -07:00
Harshal Sheth
e83550ba35
feat(ingest/tableau): add retry on timeout ( #10995 )
2024-07-31 12:20:48 -07:00
sid-acryl
dffdef2eaa
fix(ingestion/powerbi): fix issue with broken report lineage ( #10910 )
2024-07-31 11:40:09 -07:00
sid-acryl
0667470b9e
fix(ingestion/lookml): emit dummy sql condition for lookml custom condition tag ( #11008 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-31 11:39:06 -07:00
Pedro Silva
e14dc9159c
feat(cli): Trim report of dataHubExecutionRequestResult to max GMS size ( #11051 )
2024-07-31 17:45:29 +00:00
sid-acryl
4512209785
fix(ingestion/lookml): enable stack-trace in lookml logs ( #10971 )
2024-07-31 09:36:25 -07:00
Harshal Sheth
4b9844da1b
feat(ingest/dbt): add experimental prefer_sql_parser_lineage flag ( #11039 )
2024-07-31 09:23:02 -07:00
Harshal Sheth
e75118942b
fix(ingest): improve sql error reporting calls ( #11025 )
2024-07-31 18:07:38 +02:00
Pedro Silva
1955c05d78
feat(cli): Add run-id option to put sub-command ( #11023 )
...
Adds an option to assign run-id to a given put command execution.
This is useful when transformers do not exist for a given ingestion payload, we can follow up with custom metadata and assign it to an ingestion pipeline.
2024-07-31 12:29:00 +00:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container ( #11013 )
2024-07-30 15:17:04 +05:30
Hyejin Yoon
a6eb1f47c2
docs: standardize terminology to DataHub Cloud ( #11003 )
2024-07-30 09:52:51 +09:00
sagar-salvi-apptware
a09575fb6f
fix(ingestion/glue): Add support for missing config options for profiling in Glue ( #10858 )
2024-07-29 16:04:07 +05:30
Andrew Sikowitz
bc75f7a1b1
fix(graphql/upsertIngestionSource): Validate cron schedule; parse error in CLI ( #11011 )
2024-07-26 12:06:01 -07:00
Pedro Silva
1f7c92bb99
feat(docs): Document __DATAHUB_TO_FILE_ directive ( #10968 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-26 11:20:21 -07:00
Harshal Sheth
f816a14a98
fix(ingest): fix graph config loading ( #11002 )
...
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-07-26 11:15:46 -07:00
Harshal Sheth
82412e7148
fix(ingest/looker): downgrade missing chart type log level ( #10996 )
2024-07-26 11:07:00 +02:00
Harshal Sheth
304fc4ebc2
feat(ingest): improve ingest deploy command ( #10944 )
2024-07-25 19:38:21 -07:00
Harshal Sheth
8c3bfd996d
feat(ingest/bigquery): improve handling of information schema in sql parser ( #10985 )
2024-07-25 17:58:16 -07:00
sid-acryl
b173f605b8
fix(ingest/looker): support platform instance for dashboards & charts ( #10771 )
2024-07-25 17:55:39 -07:00
Tamas Nemeth
71d1cdbe3b
fix(ingest/s3): Fixing container creation when there is no folder in path ( #10993 )
2024-07-25 23:38:10 +02:00
Pedro Silva
dd732d0d46
feat(cli): Make consistent use of DataHubGraphClientConfig ( #10466 )
...
Deprecates get_url_and_token() in favor of a more complete option: load_graph_config() that returns a full DatahubClientConfig.
This change was then propagated across previous usages of get_url_and_token so that connections to DataHub server from the client respect the full breadth of configuration specified by DatahubClientConfig.
I.e: You can now specify disable_ssl_verification: true in your ~/.datahubenv file so that all cli functions to the server work when ssl certification is disabled.
Fixes #9705
2024-07-25 19:06:14 +00:00
Harshal Sheth
5a2fc3c58e
feat(ingest): add check server-config command ( #10990 )
2024-07-25 10:46:38 -07:00
Harshal Sheth
1fa7998ed3
feat(ingest): support domains in meta -> "datahub" section ( #10967 )
2024-07-25 09:31:19 -07:00
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin ( #10881 )
...
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
Andrew Sikowitz
56bb4c8111
fix(ingest/graph): Update get_results_by_filter graphql query ( #10991 )
2024-07-24 19:12:04 -07:00
Davi Arnaut
6fe5692d67
feat(ingest/cli): init does not actually support environment variables ( #10989 )
2024-07-24 19:04:15 -07:00
Andrew Sikowitz
fde71d4500
feat(ingest/graph): Add get_results_by_filter to DataHubGraph ( #10987 )
2024-07-24 17:49:41 -07:00
Tamas Nemeth
8d874ad1e4
fix(ingest/test): Fix for mssql integration tests ( #10978 )
2024-07-24 16:41:25 +05:30
Tristan Heisler
c5dae7448b
fix(ingest/sagemaker): resolve incorrect variable assignment for SageMaker API call ( #10965 )
2024-07-23 14:27:52 +02:00
Harshal Sheth
a0905180f2
feat(ingest/looker): include dashboard urns in browse v2 ( #10955 )
2024-07-22 15:26:37 -07:00
Aseem Bansal
9f570a7521
feat(datajob/flow): add environment filter using info aspects ( #10814 )
2024-07-22 16:03:48 +05:30
Tamas Nemeth
20574cf1c6
feat(ingest/athena): Add option for Athena partitioned profiling ( #10723 )
2024-07-20 00:00:40 +02:00
Chris Collins
30e9cfdce0
fix(connections) Harden adding /gms to connections in backend ( #10942 )
2024-07-19 10:47:24 -04:00
Tamas Nemeth
4fe5f280b3
fix(ingest/setup): feast and abs source setup ( #10951 )
2024-07-19 19:00:43 +05:30
Tamas Nemeth
91e8001739
fix(ingest/bigquery): Adding missing BigQuery types ( #10950 )
2024-07-19 18:39:13 +05:30
sid-acryl
c30f4c7fb5
doc(ingest/looker): fix doc for sql parsing documentation ( #10883 )
...
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-19 18:09:37 +05:30
Tamas Nemeth
65ef8585bc
fix(ingest/abs): split abs utils into multiple files ( #10945 )
2024-07-19 15:39:23 +05:30
sagar-salvi-apptware
348d449d8a
fix(ingest/Glue): column upstream lineage between S3 and Glue ( #10895 )
2024-07-19 14:39:19 +05:30
Harshal Sheth
3733a408fd
chore(airflow): add python 3.11 w/ Airflow 2.9 to CI ( #10941 )
2024-07-19 10:03:12 +05:30
Harshal Sheth
90f0743f2e
fix(ingest/lookml): add view load failures to cache ( #10923 )
2024-07-17 12:17:46 -07:00
Harshal Sheth
7f3da47e90
fix(ingest/snowflake): fix test connection ( #10927 )
2024-07-17 11:57:58 -07:00
Harshal Sheth
5f796219d3
fix(ingest): fix docs build ( #10926 )
2024-07-17 11:25:15 -07:00
Harshal Sheth
bccfd8f0a5
feat(ingest/snowflake): integrate snowflake-queries into main source ( #10905 )
2024-07-17 10:22:14 -07:00
Harshal Sheth
79e1e2eb58
feat(ingest): report extractor failures more loudly ( #10908 )
2024-07-17 10:21:35 -07:00
sagar-salvi-apptware
ec788df328
fix(ingest/bigquery): handle quota exceeded for project.list requests ( #10912 )
2024-07-17 17:17:52 +02:00
