12076 Commits

Author SHA1 Message Date
Aseem Bansal
c5059a3d53
doc(release): managed datahub v0.2.4 release notes (#7679) 2023-03-24 13:16:01 +05:30
Aseem Bansal
1324231e70
chore(ci): add coverage code for python (#7681) 2023-03-24 07:10:45 +00:00
Hyejin Yoon
918718e7d0
feat(docs-website): add docs on creating users and groups (#7574)
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-24 11:52:12 +09:00
Indy Prentice
2099c42213
test(elasticsearch): Add unit test for timestamp-based lineage feature (#7661)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-03-23 19:41:38 -07:00
Harshal Sheth
39bc8a3e93
fix(cli): allow usage without kafka (#7677) 2023-03-24 02:36:56 +00:00
Hyejin Yoon
864ac2da9f
docs: add guides on deleting entities (#7636)
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-0-10.us-west-2.compute.internal>
v0.10.1
2023-03-24 08:49:34 +09:00
Andrew Sikowitz
589d354a57
perf(ingest): Increase default rest sink parallelism (#7675) 2023-03-23 19:43:20 -04:00
Shirshanka Das
3d81539c7e
fix(ingest): json-schema - nullability handling (#7667) 2023-03-23 23:07:30 +00:00
david-leifker
90ecdb5417
fix(lineage): add cache key truncation for search lineage key (#7671) 2023-03-23 17:52:16 -05:00
Mayuri Nehate
4ec34fc73b
feat(ingest/bigquery): emit create operation event for view (#7656) 2023-03-23 11:04:41 -07:00
Aditya Radhakrishnan
660d477457
fix(lineage): change default lineage time window to All Time (#7662) 2023-03-23 10:47:47 -07:00
Harshal Sheth
cf40aecb84
fix(cli/delete): include aspect name in dry-run message (#7664) 2023-03-22 22:25:33 -07:00
Harshal Sheth
3b519924e8
fix(cli): protect against timeseries get_aspects (#7665) 2023-03-22 22:04:11 -07:00
Shirshanka Das
f872ca9cba
feat(cli): add user and group commands to create users and groups (#7595)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-22 18:44:01 -07:00
rtol5
1938b843cf
fix(ingest/mode): prevent null last_saved_at values from breaking runs (#7630) 2023-03-22 16:12:12 -07:00
Harshal Sheth
d9231addd2
feat(docs-website): add vercel preview environment (#7644) 2023-03-22 12:28:52 -07:00
Andrew Sikowitz
95f99198af
fix(ingest/bigquery): Pass whether view is materialized; pass last_altered correctly (#7660) 2023-03-22 13:40:57 -04:00
Harshal Sheth
2722ad54d4
feat(cli): build and upload Python wheels in CI (#7537) 2023-03-22 21:31:32 +05:30
John Joyce
7fe0171754
refactor(lineage): Refactor getAndUpdatePaths inside of ESGraphQueryDao (#7556)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-03-21 21:50:14 -05:00
John Joyce
4da49fb1b4
refactor(ui): Make Navigating DataHub UI easier, fix duplicate tracking, duplicate networks calls, + misc optimizations (#7592)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-03-21 18:36:21 -07:00
John Joyce
bd76183b00
fix(ui): Address regression in column usage stats + add unit test (#7645)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-03-21 18:27:58 -07:00
John Joyce
ce33db74fd
refactor(ui): Loading schema dynamically for dataset profile (#7558)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-03-21 18:27:31 -07:00
david-leifker
1b15dd484f
lint(test): remove unused imports, other test fixes (#7659) 2023-03-21 16:53:04 -05:00
RyanHolstien
8963e53bbd
fix(revert): remove unnecessary class check (#7658) 2023-03-21 12:53:39 -05:00
david-leifker
faf0ac1572
fix(search): missing model updates and tests (#7617)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 12:18:51 -05:00
John Joyce
9ec86a5cc0
fix(ui): Fix download to CSV flow using Scroll across entities api (#7629) 2023-03-21 10:05:58 -07:00
siladitya
4336252cb7
fix(datahub-upgrade): custom timeseries aspect index creation issue. (#7622)
Co-authored-by: si-chakraborty <si.chakraborty@adevinta.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-21 09:36:06 -07:00
mohdsiddique
6d6d59141e
feat(ingestion): powerbi # uniquly identify the multiple instance of same platform (#7632)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 09:27:29 -07:00
mohdsiddique
7efac2215d
feat(ingestion): powerbi # support platform instance (#7583)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-03-21 09:07:31 -07:00
John Joyce
c075e0e77b
refactor(ui): Fix scrolling behavior for compact entity profile (#7599) 2023-03-21 08:51:22 -07:00
Shirshanka Das
fc9ad49821
fix(platform): Ensure time based lineage handles noop changes (#7657)
Co-authored-by: aditya-radhakrishnan <aditya@acryl.io>
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2023-03-21 10:43:56 -05:00
Shirshanka Das
7f5744200b
fix(impactAnalysis): fix filtering for lightning mode search (#1225) (#7652)
Co-authored-by: RyanHolstien <RyanHolstien@users.noreply.github.com>
2023-03-21 10:00:16 -05:00
david-leifker
697e8e2647
fix(misc): misc fixes (#7633) 2023-03-21 19:42:50 +05:30
Shirshanka Das
3e39b955f6
fix(docker): fix image name for datahub-ingestion-slim (#7653) 2023-03-20 22:13:26 -07:00
John Joyce
2978cdb409
fix(entity registry): Fix patching aspects onto existing Config based entity (#7624) 2023-03-20 21:14:09 -07:00
Harshal Sheth
482431bcf4
fix(ingest/superset): support superset v2 (#7588)
Co-authored-by: John Joyce <john@acryl.io>
2023-03-20 19:49:32 -07:00
Harshal Sheth
d54ff061a4
fix(ingest): remove get_platform_instance_id from stateful ingestion (#7572)
Co-authored-by: Tamas Nemeth <treff7es@gmail.com>
2023-03-20 17:35:10 -07:00
Harshal Sheth
cbd8e14b78
feat(ingest): add auto_materialize_referenced_tags helper (#7626) 2023-03-20 16:34:22 -07:00
david-leifker
a27f82cae2
fix(search): tags with colons exercises search with urns, must follow… (#7602) 2023-03-20 18:07:25 -05:00
david-leifker
0a9dc73402
build(docker): metadata-ingestion images build and add slim version (#7412) 2023-03-20 18:06:35 -05:00
Aditya Radhakrishnan
0ff7bea043
fix(smoke-test): fix native user and access token tests (#7628) 2023-03-20 16:04:42 -05:00
alex-magno
6ab606b748
fix(ingest/dbt): introduce lowercase column urn option (#7418)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-20 10:37:19 -07:00
mohdsiddique
fc8757d25e
feat(ingestion): powerbi # Amazon Redshift lineage support (#7562)
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-03-20 10:24:34 -07:00
Hyejin Yoon
5aed03a5e2
docs(): fix typo and image (#7635)
Co-authored-by: Hyejin Yoon <yoonhyejin@Hyejins-MacBook-Pro.local>
2023-03-20 09:04:41 -07:00
jx2lee
51521b7c43
docs(): fix image in development (#7637)
Co-authored-by: jj.lee <jj.lee@coinone.com>
2023-03-20 09:03:03 -07:00
Hyejin Yoon
b526dc1ab6
docs: reformat use case guide toc & api comparison table (#7621)
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-172-30-1-77.us-west-2.compute.internal>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-0-10.us-west-2.compute.internal>
2023-03-18 13:00:41 -07:00
Shirshanka Das
104c9811f5
fix(ingest/docs): improve matcher to include types with spaces in them (#7631) 2023-03-18 12:59:43 -07:00
Hyejin Yoon
eff45e50da
docs: add CLI installiation guide via poetry (#7619)
Co-authored-by: Hyejin Yoon <yoonhyejin@ip-192-168-2-15.us-west-2.compute.internal>
2023-03-17 18:51:00 -07:00
Indy Prentice
44a8536ef6
fix(elasticsearch): make indexNameMapping in IndexConventionImpl threadsafe (#7565)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
2023-03-17 11:28:32 -05:00
Harshal Sheth
14ecba1e62
fix(docker): fix gradle quickstart version parsing (#7614) 2023-03-17 12:10:05 -04:00