Aseem Bansal
32349bf405
chore: update default cli for managed ingestion ( #4581 )
2022-04-05 15:33:13 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency ( #4536 )
2022-04-04 14:57:34 -07:00
David Haglund
df9e07fda2
fix: replace direct and indirect references to linkedin with datahub-project ( #4557 )
...
* Update links for github-related links to use datahub-project:
- https://github.com
- https://img.shields.io/github/ ...
- https://raw.githubusercontent.com/ ...
* Also replace references for github repo linkedin/datahub with
datahub-project/datahub.
2022-04-04 14:39:30 -05:00
zhoxie-cisco
14df3cf165
perf(docker): datahub-gms - add jetty configuration xml ( #4435 )
...
* Add jetty cofig xml to change requestHeaderSize.
* Add jetty config in docker-compose.dev.yml
Co-authored-by: zhoxie-cisco <xiezhongjie1109@gmail.com>
2022-03-30 10:10:47 -07:00
Aseem Bansal
294227e398
doc: update docker docs for mentioning Python CLI ( #4521 )
2022-03-29 20:48:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Shirshanka Das
f18f453200
moving to dockerhub for actions container ( #4497 )
2022-03-24 22:24:07 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
cccs-eric
cb9b99f0ba
fix(ingest) Azure AD: support nested groups ( #4367 ) ( #4368 )
...
LGTM - Thanks!
2022-03-14 08:59:04 -07:00
John Joyce
c713b60810
fix(oidc): Update group membership each login (and make group extraction disabled by default) ( #4380 )
2022-03-11 08:49:31 -08:00
Aseem Bansal
8c7f63e4f7
feat: change quickstart to use head tag for actions ( #4357 )
2022-03-09 10:29:10 -08:00
Aseem Bansal
e6a2615c08
feat(quickstart): restart actions pod in case of failures ( #4342 )
2022-03-08 11:55:21 -08:00
John Joyce
787a7e6dcd
fix(quickstart): Pin actions pod + add volume mount for datahub-frontend ( #4318 )
2022-03-04 14:05:14 -08:00
John Joyce
acf6eaaf1c
refactor(ui): Simplify process of adding user.props (w/ docs) ( #4296 )
2022-03-03 19:22:35 -08:00
Fabiano V. Santos
c95715448c
fix(docker): use exec form to start container main process ( #4245 )
2022-03-01 21:49:43 -08:00
buggythepirate
a439e1d4b7
fix(docs): airflow - update instructions for running locally ( #4259 )
2022-02-28 17:36:29 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals ( #4186 )
2022-02-25 16:33:59 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval( #3914 ) ( #3956 )
...
* feat(search): supporting chinese glossaryterm full text retrieval(#3914 )
* refactor(search): modify mainTokenizer to appropriate position(#3914 )
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00
Dexter Lee
0e5811fd68
fix(mae-consumer-docker): Fix condition for skipping elasticsearch check ( #4052 )
2022-02-03 18:58:04 -08:00
Ky-Anh Huynh
ef659570f4
fix(docker): docker-compose now persists kafka broker data ( #4031 )
2022-02-01 16:35:43 -08:00
Hoang-Vu Le
a9ece422a6
fix(docs): update gms link ( #3927 )
2022-01-30 23:29:09 -08:00
Tamas Nemeth
111d6d3520
fix(docker): alpine based multi-platform docker build for kafka-setup ( #3991 )
2022-01-28 16:25:57 -08:00
John Joyce
35ebca77ee
quickstart: Adding UI ingestion to quickstart YAML ( #3994 )
2022-01-27 10:47:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Swaroop Jagadish
90b7b9dddd
fix(ci): moving defaults back to head now that docker builds are green ( #3993 )
2022-01-27 09:48:01 -08:00
Swaroop Jagadish
4b7f2b7d1a
fix(docker): datahub-gms - build in native, copy to target ( #3992 )
2022-01-27 09:22:41 -08:00
John Joyce
9366a47f88
fix(quickstart): Assign correct mysql-setup container for M1 and remove "head" default version. ( #3987 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-26 18:15:54 -08:00
John Joyce
aeabeec133
fix(quickstart): Pin Quickstart version to v0.8.23. ( #3983 )
2022-01-26 11:36:26 -08:00
RyanHolstien
288445e7b8
Bugfix/increase socket timeout ( #3982 )
2022-01-26 10:25:20 -08:00
Dexter Lee
f047036bbb
fix(docker): datahub-gms - upgrade base image to fix vulnerabilities ( #3962 )
2022-01-25 14:46:15 -08:00
Arun Vasudevan
6990cc5af6
feat(docker): add Snappy Lib and JKS File to mae, gms, mce images ( #3898 )
2022-01-21 07:57:54 -08:00
Harshal Sheth
0171735ae0
feat(build): include correct version in metadata-ingestion docker image ( #3857 )
2022-01-10 15:38:19 -08:00
Michael A. Schlosser
56ede88d0a
Fix path to elastic definition in dev docker compose ( #3808 )
2022-01-03 07:01:22 -08:00
Sergio Gómez Villamor
c59c63e90d
feat: enables dbt metadata files to be loaded from URIs ( #3739 )
2021-12-15 09:11:39 -08:00
John Joyce
5c0a49d09a
fix(CI): regenerate Docker Quickstart ( #3741 )
2021-12-14 12:25:14 -08:00
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )" ( #3740 )
2021-12-14 10:49:03 -08:00
nsbala-tw
89f6c47d51
fix(elastic): Fix for log4j CVE-2021-44228 vulnerability ( #3733 )
...
Co-authored-by: balabarath <bagopila@gmail.com>
2021-12-13 23:35:10 -08:00
Aseem Bansal
a4ac79db48
feat(perf-test): changes for perf testing ( #3728 )
2021-12-13 23:07:57 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )
2021-12-13 12:37:59 -08:00
Dexter Lee
d4d621800b
fix(docker): fix issues with base64 not working on some platforms ( #3723 )
2021-12-13 09:39:48 -08:00
Aseem Bansal
cb37d87a9b
docs(airflow): add some troubleshooting for error ( #3687 )
2021-12-09 09:56:37 -08:00
Aseem Bansal
cb299161f3
fix(docker): fix for local docker compose for M1 ( #3689 )
2021-12-08 16:17:26 -08:00
Dexter Lee
0576b76eb3
fix(elasticsearch): Use auth tokens to authorize curl requests in dockerize ( #3596 )
2021-12-07 17:50:08 -08:00
Aseem Bansal
b3ef5ee489
docs(scheduling): re-arrange docs related to scheduling, lineage, CLI ( #3669 )
2021-12-07 10:09:59 -08:00
bartlomiejolma
790363fea1
docs: correct title of postgres gms ( #3650 )
...
Co-authored-by: bartlomiej.olma.kitopi <bartlomiej.olma@kitopi.com>
2021-12-01 11:18:22 -08:00
Swaroop Jagadish
50122cbd98
fix(docs): small fixes to docs and docker images for custom metadata … ( #3640 )
2021-11-30 00:12:17 -08:00
Enrico Minack
66328ee23f
feat(quickstart): simplify docker generate and compare script ( #3434 )
2021-11-29 23:57:47 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks ( #3630 )
2021-11-28 21:06:27 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! ( #3598 )
2021-11-22 16:33:14 -08:00
