12076 Commits

Author SHA1 Message Date
dependabot[bot]
1ab495c23f
chore(deps): bump http-cache-semantics from 4.1.0 to 4.1.1 in /datahub-web-react (#7231)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-03 18:51:47 +05:30
david-leifker
d557fd65ff
fix(elasticsearch): fix orphan index clean up pattern, consistent top… (#7242) 2023-02-03 07:09:19 -06:00
Harshal Sheth
d2bcdc301a
feat(cli): improve docker quickstart (#7184) 2023-02-03 17:46:03 +05:30
Peter Szalai
0a43d250d0
fix(dev.sh): Add context to kafka-setup build (#7234) 2023-02-03 17:45:42 +05:30
Aseem Bansal
aa4c6fcc05
chore(log/docs): improve error log, docs (#7239) 2023-02-03 17:43:53 +05:30
Jeff Merrick
44e8df9780
docs(website): fix feature availability dark mode styles (#7233) 2023-02-03 14:44:44 +05:30
John Joyce
3d1d5fac7c
refactor(docs): Minor language updates for kafka source doc header (#7237) 2023-02-03 14:42:45 +05:30
dependabot[bot]
04918b7fc6
chore(deps): bump http-cache-semantics from 4.1.0 to 4.1.1 in /docs-website (#7230)
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-02-02 15:32:35 -08:00
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges (#7159) 2023-02-02 15:30:49 -08:00
Aditya Radhakrishnan
bd17dde7b0
fix(ingest-idp): emit empty GroupMembership when there are no groups (#7196)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 11:56:40 -08:00
Chris Collins
8ef25e3980
fix(siblings) Fix editing of schema fields for siblings with unequal schemas (#7199) 2023-02-02 14:55:41 -05:00
Teppo Naakka
ba7b9d068e
fix(ingest): redshift # build late binding view lineage when sql written in upper case (#7223) 2023-02-02 20:53:30 +01:00
Pedro Silva
4732694780
fix(gms): Corrects MCP generation in async mode (#7214)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 11:45:44 -08:00
Harshal Sheth
2cfd82203a
fix(ingest/tableau): implement workbook_page_size parameter (#7216)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 11:43:16 -08:00
Harshal Sheth
23730e0e9c
fix(cli/delete): skip references prompt if deleting an aspect (#7220) 2023-02-02 11:42:27 -08:00
vojtechneradatos
481551a326
fix(ui): typo 'Documenataion' (#7227) 2023-02-02 11:41:13 -08:00
Mayuri Nehate
67cb358395
docs(ingest/lineage): clarify name field in entity config for file based lineage (#7225) 2023-02-02 11:33:34 -08:00
Pedro Silva
050f0c4f84
fix(gms): Fixes delete references for single relationship aspects (#7211)
Deleting Container references were broken. This PR fixes that.

Root cause is #5248 which changed the MCP change type to DELETE for cases where an aspect after getting the reference removed was no longer valid. We do not support DELETE operations for MCPs.

The solution is then to execute EntityService#deleteAspect rather than emit a sync MCP.

A regression test was made to prevent this from happening again.

Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 19:05:03 +00:00
John Joyce
c150ef04d6
feat(ui): Supporting display of columns and storage count in previews (#7198) 2023-02-02 09:38:06 -08:00
Daniel Messias
0d67e188ef
feat(glue): Use table name as human-readable name for Glue ingestion (#7213)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-02 18:04:35 +01:00
Aseem Bansal
8df66ecaff
fix(ci): trivy code scanning fix (#7232) 2023-02-02 21:50:24 +05:30
Chris Collins
68566c42d7
fix(ui) Increase the number of assertions that we query for in tab (#7215) 2023-02-02 10:40:32 -05:00
Harshal Sheth
e3af6168d3
fix(ingest): upgrade feast to avoid build issues (#7218) 2023-02-02 15:24:28 +01:00
Dmitry Bryazgin
1a1f2906db
feat(ingest): Add custom properties to the ldap ingestion (#7125)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-02-01 16:37:14 -08:00
Harshal Sheth
5d7246b151
ci(): fix datahub-upgrade quickstart regression (#7217)
Co-authored-by: John Joyce <john@acryl.io>
2023-02-01 15:30:18 -08:00
Mayuri Nehate
7ca132ce62
feat(mlModel): mark downstream jobs as ml model downstreams lineage (#7205) 2023-02-01 15:16:11 -08:00
Aseem Bansal
b8b2e48f29
fix(test): missing variables in test causing error in logs (#7210) 2023-02-01 15:15:42 -08:00
John Joyce
ef57a92b48
fix(versioning): Ensure that CLI version is always dot-delimited even in minor release versions (#7200) 2023-02-01 13:37:11 -08:00
Iaroslav Frolikov
a2e0c60eeb
fix(ingest/bigquery): quoting for APPROX_COUNT_DISTINCT in BigQuery (#7207) 2023-02-01 22:06:17 +01:00
Peter Szalai
951364b9f2
fix(bootstrapdata): update timestamp to be in the last 1 year (#7206) 2023-02-01 18:07:43 +05:30
Aseem Bansal
a28a8f9bd4
docs(managed datahub): release notes for v0.1.73 (#7194) 2023-02-01 15:42:01 +05:30
Aseem Bansal
21869adb83
chore(sample): add status removed aspect for sample data (#7203) 2023-02-01 15:07:15 +05:30
mohdsiddique
90a1da3b25
fix(test): spark-lineage # build task as dependency of integrationTest (#7189)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Pedro Silva <pedro@acryl.io>
2023-01-31 19:50:00 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
mohdsiddique
e34c2ce517
docs(ingestion): powerbi # Add permission for DAX and mashup expressions (#7195)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2023-01-31 14:04:36 -08:00
Jan Hicken
6c44fae85e
chore(deps): bump Netty from 4.1.85.Final to 4.1.86.Final (#7191) 2023-01-31 14:11:26 -06:00
Tamas Nemeth
0697fbcf81
fix(ingest/vertica): Fixing missing container properties (#7197) 2023-01-31 19:52:55 +01:00
Harshal Sheth
ed360e95c4
fix(ingest/tableau): show warning about token expiry for PATs (#7187) 2023-01-31 10:49:22 -08:00
Patrick Franco Braz
8ee9fa1930
feat(ingest): bigquery - extracts lineage metadata from catalog api (#7137) 2023-01-31 15:02:30 +01:00
Aseem Bansal
36afdec394
fix(log): logging timestamp in ISO8601 format instead of time (#7188) 2023-01-31 15:06:17 +05:30
Harshal Sheth
db1a0f13f3
fix(ingest): fix issue in glue tests (#7185) 2023-01-30 21:51:21 -08:00
Harshal Sheth
670342ab64
feat(ingest): switch dbt to use auto_stale_entity_removal (#7160) 2023-01-30 19:59:20 -08:00
Mayuri Nehate
efaf092f5b
fix(ingest/GX): fix snowflake urn generated from connection string (#7173)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-30 16:23:42 -08:00
Chris Collins
9978b74cef
fix(docs): Fix broken links in ingestion docs (#7183) 2023-01-30 16:19:31 -08:00
Peter Szalai
8a2230aea4
fix(quickstart): adding back kafka-setup (#7181)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-01-31 00:34:36 +01:00
Harshal Sheth
7e869cd1d6
feat(): add a linter for github actions workflows (#7178)
Co-authored-by: John Joyce <john@acryl.io>
2023-01-30 13:13:41 -08:00
Harshal Sheth
b4114c6499
test(ingest/delta-lake): fix spurious directory creation (#7179) 2023-01-30 13:12:18 -08:00
Maggie Hays
97e9b924af
docs(townhall): Update Townhall History doc (#7180) 2023-01-30 11:53:04 -08:00
Harshal Sheth
7ace79c153
fix(ingest): switch various sources to auto_stale_entity_removal helper (#7158) 2023-01-30 11:45:12 -08:00
John Joyce
727050a8f3
refactor(ui ingest): Allow enabling / disabling ingestion schedule easily (#7162) 2023-01-30 11:39:27 -08:00