11753 Commits

Author SHA1 Message Date
Raj Tekal
7fc6556da6
(chore): Linting fix (#11015) 2024-07-31 11:47:58 -05:00
sid-acryl
4512209785
fix(ingestion/lookml): enable stack-trace in lookml logs (#10971) 2024-07-31 09:36:25 -07:00
Harshal Sheth
4b9844da1b
feat(ingest/dbt): add experimental prefer_sql_parser_lineage flag (#11039) 2024-07-31 09:23:02 -07:00
Harshal Sheth
233330480c
fix(airflow): fix CI setup (#11031) 2024-07-31 18:08:54 +02:00
Harshal Sheth
e75118942b
fix(ingest): improve sql error reporting calls (#11025) 2024-07-31 18:07:38 +02:00
Pedro Silva
1955c05d78
feat(cli): Add run-id option to put sub-command (#11023)
Adds an option to assign run-id to a given put command execution. 
This is useful when transformers do not exist for a given ingestion payload, we can follow up with custom metadata and assign it to an ingestion pipeline.
2024-07-31 12:29:00 +00:00
Ellie O'Neil
f73149a059
docs(airflow): example query to get datajobs for a dataflow (#11034) 2024-07-31 17:01:09 +05:30
Aseem Bansal
27e1130586
fix(lint): apply spotless (#11050) 2024-07-31 15:48:52 +05:30
Hyejin Yoon
a3c7ededba
docs: fix typo (#11046) 2024-07-31 09:37:41 +09:00
Felix Lüdin
76f1b236a1
feat(restore-indices): add additional step to also clear system metadata service (#10662)
Co-authored-by: John Joyce <john@acryl.io>
2024-07-30 17:15:38 -07:00
Hyejin Yoon
bcde06d498
feat: add cloud main page (#11017)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2024-07-31 09:13:16 +09:00
Hyejin Yoon
32247dac9f
docs: fix learning center color scheme & typo (#11043) 2024-07-31 09:09:02 +09:00
Shirshanka Das
a734d69a6e
fix(ci): smoke test lint failures (#11044) 2024-07-30 16:33:00 -07:00
Shirshanka Das
7d4b645225
fix(models): chart schema fields mapping, add dataHubAction entity, t… (#11040) 2024-07-30 23:04:20 +00:00
Sam Black
d6be56f9d9
feat(propagation): Add Documentation Propagation Settings (#11038) 2024-07-30 15:50:19 -07:00
John Joyce
6f09b96b1d
feat(models): Introducing Dataset Partitions Aspect (#10997)
Co-authored-by: John Joyce <john@Johns-MBP.lan>
Co-authored-by: John Joyce <john@ip-192-168-1-200.us-west-2.compute.internal>
2024-07-30 15:24:18 -07:00
Ellie O'Neil
9321e94247
docs(custom properties): Remove duplicate from sidebar (#11033) 2024-07-30 11:35:48 -07:00
Sam Black
c2470f1d9b
feat(propagation): Add models for Action feature settings (#11029) 2024-07-30 10:49:14 -07:00
Shirshanka Das
43e3cd9602
feat(propagation): Add graphql API (#11030)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-07-30 09:45:57 -07:00
Jay
7faaf1bb40
docs(slack) troubleshoot docs (#11014) 2024-07-30 12:20:17 -04:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container (#11013) 2024-07-30 15:17:04 +05:30
Hyejin Yoon
a6eb1f47c2
docs: standardize terminology to DataHub Cloud (#11003) 2024-07-30 09:52:51 +09:00
Shirshanka Das
1c4c85813f
feat(propagation): Add models for schema field docs, tags, terms (#2959) (#11016)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-07-29 12:16:14 -07:00
sagar-salvi-apptware
a09575fb6f
fix(ingestion/glue): Add support for missing config options for profiling in Glue (#10858) 2024-07-29 16:04:07 +05:30
amit-apptware
d85da39a86
feat(assertion-v2): changed Validation tab to Quality and created new Governance tab (#10935) 2024-07-26 17:24:23 -04:00
Harshal Sheth
fdbcb684ac
feat(ece): support custom ownership type urns in ECE generation (#10999) 2024-07-26 14:02:25 -07:00
Andrew Sikowitz
bc75f7a1b1
fix(graphql/upsertIngestionSource): Validate cron schedule; parse error in CLI (#11011) 2024-07-26 12:06:01 -07:00
Pedro Silva
1f7c92bb99
feat(docs): Document __DATAHUB_TO_FILE_ directive (#10968)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-26 11:20:21 -07:00
Harshal Sheth
f816a14a98
fix(ingest): fix graph config loading (#11002)
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-07-26 11:15:46 -07:00
Andrew Sikowitz
0274c70292
fix(ui/ingest): Support invalid cron jobs (#10998) 2024-07-26 11:10:13 -07:00
Tamas Nemeth
01b3461d99
fix(protobuf/build): Fix protobuf check jar script (#11006) 2024-07-26 12:50:34 +01:00
Aseem Bansal
236043b9f5
doc(acryl-cloud): release docs for 0.3.4.x (#10984)
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2024-07-26 15:23:34 +05:30
Harshal Sheth
82412e7148
fix(ingest/looker): downgrade missing chart type log level (#10996) 2024-07-26 11:07:00 +02:00
ksrinath
1717a300bc
fix(backend): allow excluding soft-deleted entities in relationship-queries; exclude soft-deleted members of groups (#10920)
- allow excluding soft-deleted entities in relationship-queries
- exclude soft-deleted members of groups
2024-07-26 13:59:56 +05:30
Harshal Sheth
304fc4ebc2
feat(ingest): improve ingest deploy command (#10944) 2024-07-25 19:38:21 -07:00
Harshal Sheth
8c3bfd996d
feat(ingest/bigquery): improve handling of information schema in sql parser (#10985) 2024-07-25 17:58:16 -07:00
sid-acryl
b173f605b8
fix(ingest/looker): support platform instance for dashboards & charts (#10771) 2024-07-25 17:55:39 -07:00
Tamas Nemeth
71d1cdbe3b
fix(ingest/s3): Fixing container creation when there is no folder in path (#10993) 2024-07-25 23:38:10 +02:00
Pedro Silva
dd732d0d46
feat(cli): Make consistent use of DataHubGraphClientConfig (#10466)
Deprecates get_url_and_token() in favor of a more complete option: load_graph_config() that returns a full DatahubClientConfig.
This change was then propagated across previous usages of get_url_and_token so that connections to DataHub server from the client respect the full breadth of configuration specified by DatahubClientConfig.

I.e: You can now specify disable_ssl_verification: true in your ~/.datahubenv file so that all cli functions to the server work when ssl certification is disabled.

Fixes #9705
2024-07-25 19:06:14 +00:00
Harshal Sheth
5a2fc3c58e
feat(ingest): add check server-config command (#10990) 2024-07-25 10:46:38 -07:00
Harshal Sheth
1fa7998ed3
feat(ingest): support domains in meta -> "datahub" section (#10967) 2024-07-25 09:31:19 -07:00
Tamas Nemeth
f4fb89e799
feat(ingest/spark): Promote beta plugin (#10881)
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
2024-07-25 14:46:32 +02:00
Andrew Sikowitz
56bb4c8111
fix(ingest/graph): Update get_results_by_filter graphql query (#10991) 2024-07-24 19:12:04 -07:00
Davi Arnaut
6fe5692d67
feat(ingest/cli): init does not actually support environment variables (#10989) 2024-07-24 19:04:15 -07:00
Andrew Sikowitz
fde71d4500
feat(ingest/graph): Add get_results_by_filter to DataHubGraph (#10987) 2024-07-24 17:49:41 -07:00
Andrew Sikowitz
66f8930164
fix(ui): Remove ant less imports (#10988) 2024-07-24 17:35:42 -07:00
Kevin Chun
725df58893
bugfix: use anyOf instead of allOf when creating references in openapi v3 spec (#10986) 2024-07-24 14:51:10 -07:00
Chris Collins
959d3517ec
fix(structuredProps) casing bug in StructuredPropertiesValidator (#10982) 2024-07-24 22:00:26 +05:30
Jay
4921967e43
fix(entity-service) exist check correctly extracts status (#10973) 2024-07-24 11:11:45 -04:00
Tamas Nemeth
8d874ad1e4
fix(ingest/test): Fix for mssql integration tests (#10978) 2024-07-24 16:41:25 +05:30