Harshal Sheth
eb87db9813
fix(ingest): proper null skip logic in serialization ( #5749 )
2022-08-29 16:34:58 -07:00
Chris Collins
cf03a0799f
feat(ingestion-ui) Add ability to rollback ingestion runs from the UI - FE only ( #5740 )
2022-08-29 16:11:59 -07:00
Aditya Radhakrishnan
89238408b9
fix(search): validate entities exist before returning search results in EntityClient ( #5751 )
2022-08-29 13:40:02 -07:00
Chris Collins
0d35b53b41
feat(ingestion-ui) Add ability to set debug_mode on UI ingestion sources ( #5762 )
2022-08-29 13:39:14 -07:00
Chris Collins
33754d41f5
feat(ingestion) Add ability to rollback ingestion from UI - BE PR ( #5739 )
2022-08-29 13:09:15 -07:00
mohdsiddique
2b4f9400ca
fix(GMS): fix no such classes directory file:///etc/datahub/plugins/auth/resources ( #5743 )
2022-08-29 12:08:18 -07:00
Aseem Bansal
67a68b9705
feat(restore-indices): add multithreading and add aspectName, urn filter ( #5712 )
...
* feat(upgrade): improve logging to get idea of progress
* division by zero check
* division by zero fix
* wip
* temp work
* feat(datahub-upgrade): add multi-threading and aspect filter
* revert change on local
* fix bugs
* add back batchDelayMs
* remove redundant format
* report stats finally, shutdown executor
* Add time metrics
* clarify logging
* improve logging
2022-08-29 11:43:39 -05:00
Tamas Nemeth
7e15947a37
fix(doc): presto-on-hive - Removing new lines from docs to fix doc generation ( #5755 )
2022-08-29 13:42:07 +02:00
Harshal Sheth
ee43262f7c
chore(ingest): add vulture config and remove dead code ( #5745 )
2022-08-28 23:41:15 -07:00
John Joyce
ea9b5f8e21
fix(ui): Improve Error Messaging on the UI ( #5752 )
2022-08-28 20:08:25 -07:00
Shirshanka Das
06d29df967
feat(model): add chartUsageStatistics to the chart entity ( #5753 )
2022-08-27 18:14:28 -07:00
Harshal Sheth
d5547d0fb3
chore(ingest): update mixpanel api endpoint ( #5750 )
2022-08-27 18:02:53 -07:00
Mayuri Nehate
a6369d355b
feat(ingest): snowflake - improvements to snowflake-beta connector ( #5736 )
2022-08-27 16:25:50 -07:00
Ravindra Lanka
b23195d3df
Fix sqllineage parser to handle special tokens with a hyphens in the table and column names. ( #5748 )
2022-08-26 18:11:00 -07:00
Maggie Hays
59f8c9b4fe
docs(site redesign): Overhaul Docs Site ( #5731 )
...
* adding new wip docs
* update to docs-website
* update to get started link
* lint cleanup
* lint cleanup
2022-08-26 16:29:01 -05:00
John Joyce
10672c3464
fix(bootstrap): Remove malformed test in bootstrap.json ( #5747 )
2022-08-26 11:19:48 -07:00
Harshal Sheth
fa0fd7b830
fix(ingest): tweak mongodb schema inference to fix test ( #5744 )
2022-08-26 11:15:16 -07:00
Mugdha Hardikar
e448bb8832
feat(ingest): mysql - support multiple database in single recipe ( #5684 )
2022-08-26 19:47:49 +02:00
Shirshanka Das
fe52df6bab
fix(docs): fixes issue with auto-generated ingestion doc ( #5733 )
2022-08-26 09:31:53 -07:00
liyuhui666
08f5a44df0
feat(elasticsearch): Add nested type display ( #5524 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-08-26 09:07:03 -07:00
Shirshanka Das
ed1ceca9a7
fix(ingest): looker - soft-deleted charts should re-emerge on re-discovery ( #5732 )
2022-08-26 08:18:01 -07:00
Aseem Bansal
83d15dd86e
feat(ingest): file - allow filter by aspect and get stats ( #5738 )
2022-08-26 18:54:26 +05:30
Tamas Nemeth
a251625d04
fix(ingest): bigquery - Not setting ge config schema when profiling with temp table ( #5737 )
2022-08-26 13:32:44 +02:00
Shirshanka Das
c979349c65
fix(deps): remove tdigest dependency and associated code ( #5729 )
2022-08-25 17:08:38 -07:00
David Haglund
b830247727
fix(superset): do not crash when display_uri is not set ( #5711 )
2022-08-24 23:26:02 -07:00
Aseem Bansal
3da9941521
feat(ingest): round reported time to 2 decimal places ( #5721 )
2022-08-24 23:08:33 -07:00
Ankit keshari
e8f521ef07
fix(): Worked on the scroll to top of the page after pagination change ( #5714 )
2022-08-24 15:20:52 -07:00
Harshal Sheth
d7bdfc2b86
fix(ingest): redshift-usage: check full table names with AllowDenyPattern ( #5702 )
...
* fix(ingest): redshift-usage: check full table/schema names with AllowDenyPattern
* schema pattern does not take dot syntax
* update redshift filter test
2022-08-24 14:33:18 -07:00
mohdsiddique
7d532b8886
fix(ingestion): ingest tables from dba_tables in oracle source ( #5592 )
...
* inspector object wrapper for oracle inspector
* WIP
* before golden file creation
* fix(ingestion): ingest tables from dba_tables in oracle source
* code review comments
* address review comments
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-24 09:48:08 -07:00
mohdsiddique
cfaf7a0c20
fix(quickstart): fix for No such classes directory file:///etc/datahub/plugins/auth/resources ( #5720 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-24 09:26:13 -07:00
Gabe Lyons
d9b2a45c5f
feat(looker): index looker charts and dashboards by business term ( #5649 )
2022-08-24 08:01:56 -07:00
Shirshanka Das
d549ff323b
feat(ingest): remove nulls during serialization ( #5719 )
2022-08-24 08:00:56 -07:00
dependabot[bot]
12a1bd20de
build(deps): bump nbconvert in /docker/datahub-ingestion ( #5716 )
...
Bumps [nbconvert](https://github.com/jupyter/nbconvert ) from 6.5.0 to 6.5.1.
- [Release notes](https://github.com/jupyter/nbconvert/releases )
- [Commits](https://github.com/jupyter/nbconvert/compare/6.5...6.5.1 )
---
updated-dependencies:
- dependency-name: nbconvert
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-23 21:46:45 -07:00
Ravindra Lanka
2a56d2c276
fix(ci): ingest - fix nifi integration tests ( #5718 )
2022-08-23 21:46:01 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests ( #5704 )
2022-08-23 16:25:18 -07:00
Ankit keshari
1287cddc45
fix(): fix the alignment of all data in domain list ( #5713 )
2022-08-23 15:09:45 -07:00
Peter Szalai
150a36e236
feat(ingest): presto-on-hive - Add mode option to presto-on-hive source ( #5659 )
2022-08-23 23:18:27 +02:00
Ankit keshari
c2fbd75d2a
feat(ingestion-ui) Add ingestion form for Postgres ( #5671 )
2022-08-23 17:03:16 -04:00
Shirshanka Das
505cefef13
feat(ingest): better reporting for file source, friendlier stats names ( #5710 )
2022-08-23 10:21:24 -07:00
John Joyce
5974721697
fix(ui): Long overdue - Fix red error screens during OIDC login, logout exception scenarios ( #5708 )
2022-08-23 09:54:34 -07:00
Harshal Sheth
fcdb8a2226
fix(ingest): mongodb - add pymongo srv extra ( #5701 )
2022-08-22 23:42:09 -07:00
Tamas Nemeth
c66c263ceb
fix(airflow): Stable tag order in DataFlow/DataJobs ( #5696 )
2022-08-22 23:40:53 -07:00
Harshal Sheth
1b626c7652
docs(ingest): add info about datahub auth tokens with airflow ( #5703 )
2022-08-22 23:39:40 -07:00
Remi
b3022b15ca
feat(ingestion): dbt - add github_info config ( #5648 )
2022-08-22 23:38:28 -07:00
Harshal Sheth
679cd290fb
feat(ingest): dbt - add enable_owner_extraction option ( #5707 )
2022-08-22 23:36:51 -07:00
Shirshanka Das
b2383acdd0
fix(ingest): refactor sync-async config, thread-safety for sink reporting ( #5705 )
2022-08-22 18:55:30 -07:00
Pedro Silva
12eb2c6240
feat(kafka) Adds SASL SSL support in kafka setup docker image ( #5697 )
2022-08-22 16:01:10 -07:00
Aditya Radhakrishnan
4e2bfdd236
fix(ingest): emit status aspect for entities ingested from okta and azure_ad ( #5700 )
2022-08-22 13:28:35 -07:00
Chris Collins
9511715476
fix(ui) Refresh executions on Ingestion page when they are visible ( #5698 )
2022-08-22 14:12:44 -04:00
Tamas Nemeth
ae577ddff2
Fixing boolean type in json schema ( #5695 )
2022-08-22 11:35:19 +02:00
