12076 Commits

Author SHA1 Message Date
Pinaki Bhattacharjee
a8ef7b68c8
chore(vulnerability): Log Injection (#11090) 2024-08-03 08:00:16 -05:00
Tamas Nemeth
6704d44470
doc(ingest): Update capabilities (#11072) 2024-08-02 20:58:20 -07:00
Harshal Sheth
50139431be
fix(ingest): set lastObserved in sdk when unset (#11071) 2024-08-02 15:48:10 -07:00
Aseem Bansal
f2e461eb63
feat(ingest/mode): add option to exclude restricted (#11081) 2024-08-02 21:01:46 +05:30
Harshal Sheth
f78b6c08fb
fix(py): remove dep on types-pkg_resources (#11076) 2024-08-02 17:27:54 +05:30
sid-acryl
d5eda0de7e
doc(ingestion/tableau): doc update for derived permission (#11054)
Co-authored-by: Pedro Silva <pedro.cls93@gmail.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 10:26:47 -07:00
Harshal Sheth
2369032077
docs(airflow): update min version for plugin v2 (#11065) 2024-08-01 10:05:49 -07:00
Felix Lüdin
66ecfae5e4
feat(cli): add aspects parameter to DataHubGraph.get_entity_semityped (#11009)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-08-01 13:49:32 +05:30
david-leifker
c83907fdbc
feat(search-test): update search tests from #10408 (#11056) 2024-08-01 13:48:30 +05:30
Jonny Dixon
e9a0e2715c
docs(ingest): update developing-a-transformer.md (#11019) 2024-08-01 13:48:17 +05:30
Pedro Silva
1e6065ea84
fix(ci): Fix lint issue in datahub_ingestion_run_summary_provider.py (#11063) 2024-08-01 09:11:01 +01:00
Matt Exchange
2ab43f393e
build: Reduce size of datahub-frontend-react image by 50-ish% (#10878)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 21:19:33 -05:00
Harshal Sheth
89933fee1e
feat(ingest/dbt-cloud): update metadata_endpoint inference (#11041) 2024-07-31 14:16:18 -07:00
david-leifker
b13d990f07
chore(ci): revert update deprecated github actions (#10977) (#11062) 2024-07-31 15:30:30 -05:00
Renan F. Lima
2336207a2a
fix(ingest): fix oracle cronjob ingestion (#11001)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 15:06:19 -05:00
jaegwon.seo
fc7b6853b9
change generate kafka connect properties from env (#10545)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2024-07-31 15:05:55 -05:00
Harshal Sheth
e83550ba35
feat(ingest/tableau): add retry on timeout (#10995) 2024-07-31 12:20:48 -07:00
sid-acryl
dffdef2eaa
fix(ingestion/powerbi): fix issue with broken report lineage (#10910) 2024-07-31 11:40:09 -07:00
sid-acryl
0667470b9e
fix(ingestion/lookml): emit dummy sql condition for lookml custom condition tag (#11008)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2024-07-31 11:39:06 -07:00
Pedro Silva
e14dc9159c
feat(cli): Trim report of dataHubExecutionRequestResult to max GMS size (#11051) 2024-07-31 17:45:29 +00:00
david-leifker
edc8fd409d
chore(ingestion-base): bump base image packages (#11053) 2024-07-31 12:39:07 -05:00
Steffen Grohsschmiedt
52c50f029a
Fix ALB configuration example (#10981) 2024-07-31 11:58:56 -05:00
Aseem Bansal
347ac1aeb7
chore(ci): update deprecated github actions (#10977) 2024-07-31 11:49:39 -05:00
Raj Tekal
7fc6556da6
(chore): Linting fix (#11015) 2024-07-31 11:47:58 -05:00
sid-acryl
4512209785
fix(ingestion/lookml): enable stack-trace in lookml logs (#10971) 2024-07-31 09:36:25 -07:00
Harshal Sheth
4b9844da1b
feat(ingest/dbt): add experimental prefer_sql_parser_lineage flag (#11039) 2024-07-31 09:23:02 -07:00
Harshal Sheth
233330480c
fix(airflow): fix CI setup (#11031) 2024-07-31 18:08:54 +02:00
Harshal Sheth
e75118942b
fix(ingest): improve sql error reporting calls (#11025) 2024-07-31 18:07:38 +02:00
Pedro Silva
1955c05d78
feat(cli): Add run-id option to put sub-command (#11023)
Adds an option to assign run-id to a given put command execution. 
This is useful when transformers do not exist for a given ingestion payload, we can follow up with custom metadata and assign it to an ingestion pipeline.
2024-07-31 12:29:00 +00:00
Ellie O'Neil
f73149a059
docs(airflow): example query to get datajobs for a dataflow (#11034) 2024-07-31 17:01:09 +05:30
Aseem Bansal
27e1130586
fix(lint): apply spotless (#11050) 2024-07-31 15:48:52 +05:30
Hyejin Yoon
a3c7ededba
docs: fix typo (#11046) 2024-07-31 09:37:41 +09:00
Felix Lüdin
76f1b236a1
feat(restore-indices): add additional step to also clear system metadata service (#10662)
Co-authored-by: John Joyce <john@acryl.io>
2024-07-30 17:15:38 -07:00
Hyejin Yoon
bcde06d498
feat: add cloud main page (#11017)
Co-authored-by: Jay <159848059+jayacryl@users.noreply.github.com>
2024-07-31 09:13:16 +09:00
Hyejin Yoon
32247dac9f
docs: fix learning center color scheme & typo (#11043) 2024-07-31 09:09:02 +09:00
Shirshanka Das
a734d69a6e
fix(ci): smoke test lint failures (#11044) 2024-07-30 16:33:00 -07:00
Shirshanka Das
7d4b645225
fix(models): chart schema fields mapping, add dataHubAction entity, t… (#11040) 2024-07-30 23:04:20 +00:00
Sam Black
d6be56f9d9
feat(propagation): Add Documentation Propagation Settings (#11038) 2024-07-30 15:50:19 -07:00
John Joyce
6f09b96b1d
feat(models): Introducing Dataset Partitions Aspect (#10997)
Co-authored-by: John Joyce <john@Johns-MBP.lan>
Co-authored-by: John Joyce <john@ip-192-168-1-200.us-west-2.compute.internal>
2024-07-30 15:24:18 -07:00
Ellie O'Neil
9321e94247
docs(custom properties): Remove duplicate from sidebar (#11033) 2024-07-30 11:35:48 -07:00
Sam Black
c2470f1d9b
feat(propagation): Add models for Action feature settings (#11029) 2024-07-30 10:49:14 -07:00
Shirshanka Das
43e3cd9602
feat(propagation): Add graphql API (#11030)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-07-30 09:45:57 -07:00
Jay
7faaf1bb40
docs(slack) troubleshoot docs (#11014) 2024-07-30 12:20:17 -04:00
sagar-salvi-apptware
da72ba2113
fix(ingestion/transformer): replace the externalUrl container (#11013) 2024-07-30 15:17:04 +05:30
Hyejin Yoon
a6eb1f47c2
docs: standardize terminology to DataHub Cloud (#11003) 2024-07-30 09:52:51 +09:00
Shirshanka Das
1c4c85813f
feat(propagation): Add models for schema field docs, tags, terms (#2959) (#11016)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2024-07-29 12:16:14 -07:00
sagar-salvi-apptware
a09575fb6f
fix(ingestion/glue): Add support for missing config options for profiling in Glue (#10858) 2024-07-29 16:04:07 +05:30
amit-apptware
d85da39a86
feat(assertion-v2): changed Validation tab to Quality and created new Governance tab (#10935) 2024-07-26 17:24:23 -04:00
Harshal Sheth
fdbcb684ac
feat(ece): support custom ownership type urns in ECE generation (#10999) 2024-07-26 14:02:25 -07:00
Andrew Sikowitz
bc75f7a1b1
fix(graphql/upsertIngestionSource): Validate cron schedule; parse error in CLI (#11011) 2024-07-26 12:06:01 -07:00