11753 Commits

Author SHA1 Message Date
Aditya Radhakrishnan
f9556c59f3
docs(schema-history): update schema history docs (#5894) 2022-09-09 14:17:47 -07:00
Chris Collins
c4ac09d192
feat(ingestion-ui) Sort ingestion sources by last execution time (#5807) 2022-09-09 14:14:33 -07:00
Patrick Marx
de547a9af9
fix(frontend): forward Host header as X-Forwarded-Host (#5816) 2022-09-09 14:13:30 -07:00
Harshal Sheth
954397a078
fix(ingest): remove dbt disable_dbt_node_creation and load_schema options (#5877) 2022-09-09 14:07:55 -07:00
Marcin Szymański
57996049fb
fix(ingest): sql - add missing trino types (#5870)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-09 14:07:00 -07:00
Shirshanka Das
5074035c4d
feat(ingest): looker - improve defaults for usage extraction (#5893)
Co-authored-by: Ravindra Lanka <rslanka@gmail.com>
2022-09-09 13:35:49 -07:00
Shirshanka Das
056add128d
fix(ingest): datahub-api - move instantiation to the right config class (#5878) 2022-09-09 13:34:21 -07:00
Chris Collins
5303ecbd8e
feat(ui) Add entity search input to shared folder (#5876) 2022-09-09 14:29:23 -04:00
Chris Collins
3fb4fc35f7
feat(schema) Add search filter to Schema tab (#5845) 2022-09-09 14:28:53 -04:00
Shirshanka Das
5a0154f3fe
fix(ci): fix jar release action dependencies (#5884) 2022-09-09 10:16:09 -07:00
Peter Szalai
980e1819b3
fix(dev-docker): set right context for frontend dev build (#5885) 2022-09-09 09:57:39 -05:00
Shirshanka Das
083ab9bc0e
feat(jars): better jar versioning for datahub-client, spark-lineage and protobuf (#5883) 2022-09-08 23:36:15 -07:00
Shirshanka Das
fe30f54689
feat(datahub-protobuf): add support for shadow jar, publish (#5882) 2022-09-08 22:10:36 -07:00
Pedro Silva
e7b33c595b
feat(cli): make docker compose quiet (#5869) 2022-09-08 14:55:03 -07:00
Harshal Sheth
da46dcdc22
refactor(ingest): add ALL_ENV_TYPES constant (#5866) 2022-09-08 14:07:22 -07:00
Harshal Sheth
6063484714
fix(ingest): avrogen handling for missing fields with default values (#5844) 2022-09-08 14:05:28 -07:00
Harshal Sheth
2115d5bf1d
fix(ingest): remove dbt delete_tests_as_datasets option (#5865)
This option was added for backwards compat and can be dropped now.
2022-09-08 11:22:25 -07:00
Harshal Sheth
39fa9321c1
feat(ingest): support reading config file from stdin (#5847) 2022-09-08 11:04:20 -07:00
Pedro Silva
12f462e82b
fix(docker): Bumps JRE 11 to latest (#5875) 2022-09-08 12:44:28 -05:00
Harshal Sheth
eb57bebf48
fix(ingest): include urns in rest sink failure logs (#5848) 2022-09-08 10:29:40 -07:00
Ankit keshari
5a5af68210
Scroll issue on Glossary related entity page (#5804) 2022-09-08 12:30:13 -04:00
Pedro Silva
7d0f5435c8
feat(docker): Update Dockerfiles to use java 11 runtime (#5853) 2022-09-08 17:39:23 +05:30
Aseem Bansal
5339ce9459
docs(notifications): slack notification docs (#5871) 2022-09-08 17:24:35 +05:30
Gabe Lyons
f411487eb3
fix(domains): adding 10,000+ text when domain list caps out elastic count capacity (#5838) 2022-09-08 16:39:04 +05:30
Pedro Silva
102754f138
feat(smoke-tests) Make smoke tests use standalone consumers (#5856) 2022-09-08 16:34:11 +05:30
Shirshanka Das
b9068ffd2e
fix(m1): preflight works with brew postgres@14 (#5868) 2022-09-08 15:02:30 +05:30
Aseem Bansal
444b878174
feat(ci): tweak auto-label globs (#5849) 2022-09-08 14:41:12 +05:30
Shirshanka Das
d911b15da5
docs(ingest): improve doc gen, docs for snowflake, looker (#5867) 2022-09-08 00:38:10 -07:00
Harshal Sheth
6f09f1025e
ci(ingest): test with python 3.10 (#5863) 2022-09-07 17:08:49 -07:00
Harshal Sheth
1e8a1038d8
chore(ingest): remove outdated GE compatibility hack (#5862) 2022-09-07 17:06:02 -07:00
Gabe Lyons
86979e43ca
improving perf of filter query (#5858) 2022-09-07 16:39:33 -07:00
Tamas Nemeth
f9917ea5fb
Fixing sharded regexp pattern config (#5861) 2022-09-07 15:36:37 -07:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix (#5634) 2022-09-07 13:32:38 -07:00
Parham Ghazanfari
5a0774548d
fix(patch-entity-registry): Remove exception for entities with key aspects. (#5831)
* fix(patch-entity-registry): Remove exception for entities with key aspects.

* test(patch-entity-registry): Fix failing unit test for entities with key aspect

* test(patch-entity-registry): Fix checkstyle for PatchEntityRegistryTest.java

* fix(patch-entity-registry): Remove duplicate semicolon.

Co-authored-by: Parham Ghazanfari <pghazanfari53@yahoo.com>
2022-09-07 14:32:46 -05:00
Shirshanka Das
2fea3d26df
fix(ingest): reporting should work with timestamps (#5860) 2022-09-07 21:09:08 +02:00
Chris Collins
494f38ea60
fix(graphql) Fix null pointer exception when fetching entity aspects via graphql (#5857) 2022-09-07 14:25:17 -04:00
Pedro Silva
42a847c8d1
feat(docker) Adds Sasl support to base ingestion image (#5855)
* feat(docker) Adds Sasl support to base ingestion image

* Add oracle changes
2022-09-07 22:21:06 +05:30
Harshal Sheth
abddc01877
fix(ingest): fix doc generation import ordering issue with postgres (#5846)
Relying on the correct import directly, rather than going through
SQLAlchemy's import wrapper (in their dialect.py) allows us to bypass
this strange error in doc generation.
2022-09-07 21:44:33 +05:30
Harshal Sheth
13e411e796
chore(smoke): add additional logs in smoke test (#5842)
Will help debug flakes like this one: https://github.com/datahub-project/datahub/runs/8213344841?check_suite_focus=true
2022-09-07 09:56:13 +05:30
Harshal Sheth
08622f25ef
feat(ingest): add utility for converting MCEs to MCPs (#5812) 2022-09-06 15:25:48 -07:00
Gabe Lyons
29a6f91b61
refactor(ui); update input display for dashboards (#5841) 2022-09-06 14:52:58 -07:00
Aseem Bansal
055dd27015
feat(ci): auto label PRs (#5839) 2022-09-06 14:46:34 -07:00
mohdsiddique
2f65e2f226
feat(transformers): Add semantics & transform_aspect support in transformers (#5514)
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2022-09-06 14:44:14 -07:00
Pedro Silva
9434afc78a
feat(hooks): Add toggle for enabling/disabling platform event hook (#5840) 2022-09-06 14:53:58 -05:00
Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 (#5827)
* fix(standalone-consumers) Removes Solr from spring boot application config

* Adds standalone consumer option to datahub quickstart cli

* Rename files

* Make dockerize platform agnostic & change docker compose utility to work with M1

* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers

* Fix identation

* Use master code

* Adds ARM image publishing for consumers

* Fix linter

* Fix lint
2022-09-06 13:55:31 -05:00
Peter Szalai
aa146db611
feat(monitoring): enable JMX and OTEL for frontend pods (#5834) 2022-09-06 17:14:53 +05:30
Shirshanka Das
f4eea5dfd5
fix(ingest): profiling - memory usage reduction (#5830) 2022-09-05 23:37:19 -07:00
Mayuri Nehate
a8c1397e5e
feat(ingest): tableau - improve lineage, workbooks query, fix pagination (#5756) 2022-09-05 23:19:22 -07:00
Harshal Sheth
7e16ce0126
feat(ingest): looker - add test connection (#5768)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-09-05 21:11:34 -07:00
Harshal Sheth
bee27e8468
fix(ingest): use AwsConnectionConfig instead of AwsSourceConfig (#5813) 2022-09-05 21:10:33 -07:00