642 Commits

Author SHA1 Message Date
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version (#5145) 2022-06-10 09:05:24 +05:30
Dexter Lee
d31c00939c
fix(docker): Fix mysql setup bug (#5071) 2022-06-02 10:01:36 +02:00
Mert Tunç
ff04919042
fix(mysql-setup-job): add mysql default port override support (#5036) 2022-06-01 11:46:53 -07:00
RyanHolstien
2a2fd05345
feat: telemetry improvements (#5029) 2022-05-27 17:04:45 -07:00
RyanHolstien
cbda3f5f29
feat(release): update CLI version (#4962)
* feat(release): update CLI version

* add typscript
2022-05-19 18:13:13 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 (#4960) 2022-05-19 22:55:56 +05:30
RyanHolstien
bb341f740c
fix(env): provide default for unset telemetry variable (#4937) 2022-05-18 14:01:37 +05:30
RyanHolstien
c3cfaf8e3c
feat(telemetry): add server side telemetry (#4925)
Co-authored-by: Kevin Hu <kevinhuwest@gmail.com>
2022-05-17 11:37:45 -07:00
chen4119
3c32ac7916
fix(kafka-setup): Check if keystore/truststore location env variables are set (#4924)
* OIDC discovery URL will not have none as auth method

* Fix code style

* fix compilation error

* add keystore/truststore type env variables

* check keystore/truststore location is set

Co-authored-by: Dexter Lee <dexter@acryl.io>
2022-05-16 13:51:19 -07:00
chen4119
a0e7262b00
fix(kafka-setup): Add ssl.keystore.type and ssl.truststore.type (#4923) 2022-05-16 10:22:55 -07:00
John Joyce
d96ddec843
refactor(actions): Migrate to use new datahub-actions container (#4903) 2022-05-13 12:11:56 +05:30
RyanHolstien
72eff249ad
chore(deps): play - upgrade for CVEs (#4891) 2022-05-10 16:15:53 -07:00
RyanHolstien
9422578e41
Revert "chore(deps): upgrade play to remove CVEs (#4864)" (#4868)
This reverts commit 84a026b1263ab91cd4010d905129a279523f413e.
2022-05-06 15:08:35 -07:00
RyanHolstien
d70df06c21
chore(jetty): upgrade jetty to 9.4.46 for CVE (#4857) 2022-05-06 14:18:20 -07:00
RyanHolstien
84a026b126
chore(deps): upgrade play to remove CVEs (#4864) 2022-05-06 13:42:03 -07:00
RyanHolstien
ad7a92a098
Revert "chore(deps): upgrade play dependencies to remove CVE vulnerabilities (#4820)" (#4861)
This reverts commit fa4abeade750c487504976e13c7aad2789b9e49e.
2022-05-06 10:18:30 -07:00
RyanHolstien
fa4abeade7
chore(deps): upgrade play dependencies to remove CVE vulnerabilities (#4820) 2022-05-06 08:05:19 -07:00
RyanHolstien
f1151cb478
Revert "fix(jetty): upgrade jetty dependency for CVE (#4838)" (#4844)
This reverts commit 1697bd0641bac248a72ed289bbbcf17c20b2f5a4.
2022-05-05 20:01:50 -07:00
RyanHolstien
1697bd0641
fix(jetty): upgrade jetty dependency for CVE (#4838) 2022-05-05 18:01:02 -07:00
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 (#4829) 2022-05-05 12:57:06 +02:00
Eddie (Xiao Di) Li
01a5b13a7a
feat(Cassandra): Add Cassandra implementation of EntityService (#3286) 2022-04-25 17:29:24 -07:00
John Joyce
87c5ad385c
Fix iss #4683 (#4697) 2022-04-19 15:22:49 -07:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion (#4581) 2022-04-05 15:33:13 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency (#4536) 2022-04-04 14:57:34 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project (#4557)
* Update links for github-related links to use datahub-project:
  - https://github.com
  - https://img.shields.io/github/...
  - https://raw.githubusercontent.com/...
* Also replace references for github repo linkedin/datahub with
  datahub-project/datahub.
2022-04-04 14:39:30 -05:00
zhoxie-cisco
14df3cf165
perf(docker): datahub-gms - add jetty configuration xml (#4435)
* Add jetty cofig xml to change requestHeaderSize.

* Add jetty config in docker-compose.dev.yml

Co-authored-by: zhoxie-cisco <xiezhongjie1109@gmail.com>
2022-03-30 10:10:47 -07:00
Aseem Bansal
294227e398
doc: update docker docs for mentioning Python CLI (#4521) 2022-03-29 20:48:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Shirshanka Das
f18f453200
moving to dockerhub for actions container (#4497) 2022-03-24 22:24:07 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link (#4446) 2022-03-18 14:12:19 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default (#4358)
* Changes rollback behaviour to apply soft deletes by default

Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.

Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.

To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.

* Adds restli specs

* Fixes deleteAspect endpoint & adds support for nested transactions

* Enable regression test & fix docker-compose for local development

* Add generated quickstart

* Fix quickstart generation script

* Adds missing var env to docker-compose-without-neo4j

* Sets status removed=true when ingesting resources

* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands

* Makes elastic search consistent

* Update tests with new behaviour

* apply review comments

* apply review comment

* Forces Elastic search to add documents with status removed false when ingesting

* Reset gradle properties to default

* Fix tests
2022-03-15 12:05:52 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups (#4367) (#4368)
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
John Joyce
c713b60810
fix(oidc): Update group membership each login (and make group extraction disabled by default) (#4380) 2022-03-11 08:49:31 -08:00
Aseem Bansal
8c7f63e4f7
feat: change quickstart to use head tag for actions (#4357) 2022-03-09 10:29:10 -08:00
Aseem Bansal
e6a2615c08
feat(quickstart): restart actions pod in case of failures (#4342) 2022-03-08 11:55:21 -08:00
John Joyce
787a7e6dcd
fix(quickstart): Pin actions pod + add volume mount for datahub-frontend (#4318) 2022-03-04 14:05:14 -08:00
John Joyce
acf6eaaf1c
refactor(ui): Simplify process of adding user.props (w/ docs) (#4296) 2022-03-03 19:22:35 -08:00
Fabiano V. Santos
c95715448c
fix(docker): use exec form to start container main process (#4245) 2022-03-01 21:49:43 -08:00
buggythepirate
a439e1d4b7
fix(docs): airflow - update instructions for running locally (#4259) 2022-02-28 17:36:29 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals (#4186) 2022-02-25 16:33:59 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval(#3914) (#3956)
* feat(search): supporting chinese glossaryterm full text retrieval(#3914)

* refactor(search): modify mainTokenizer to appropriate position(#3914)

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00
Dexter Lee
0e5811fd68
fix(mae-consumer-docker): Fix condition for skipping elasticsearch check (#4052) 2022-02-03 18:58:04 -08:00
Ky-Anh Huynh
ef659570f4
fix(docker): docker-compose now persists kafka broker data (#4031) 2022-02-01 16:35:43 -08:00
Hoang-Vu Le
a9ece422a6
fix(docs): update gms link (#3927) 2022-01-30 23:29:09 -08:00
Tamas Nemeth
111d6d3520
fix(docker): alpine based multi-platform docker build for kafka-setup (#3991) 2022-01-28 16:25:57 -08:00
John Joyce
35ebca77ee
quickstart: Adding UI ingestion to quickstart YAML (#3994) 2022-01-27 10:47:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) (#3975) 2022-01-27 10:33:12 -08:00
Swaroop Jagadish
90b7b9dddd
fix(ci): moving defaults back to head now that docker builds are green (#3993) 2022-01-27 09:48:01 -08:00
Swaroop Jagadish
4b7f2b7d1a
fix(docker): datahub-gms - build in native, copy to target (#3992) 2022-01-27 09:22:41 -08:00
John Joyce
9366a47f88
fix(quickstart): Assign correct mysql-setup container for M1 and remove "head" default version. (#3987)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-26 18:15:54 -08:00