Pedro Silva
20138a32e5
fix(standalone-consumers): Exclude Solr from spring boot application config & make them run on M1 ( #5827 )
...
* fix(standalone-consumers) Removes Solr from spring boot application config
* Adds standalone consumer option to datahub quickstart cli
* Rename files
* Make dockerize platform agnostic & change docker compose utility to work with M1
* Fix MAE/MCE dockerfiles for arm & make smoke tests use standalone consumers
* Fix identation
* Use master code
* Adds ARM image publishing for consumers
* Fix linter
* Fix lint
2022-09-06 13:55:31 -05:00
Peter Szalai
aa146db611
feat(monitoring): enable JMX and OTEL for frontend pods ( #5834 )
2022-09-06 17:14:53 +05:30
Harshal Sheth
13f20ad2c3
fix(docker): add missing port mappings for non-neo4j quickstart ( #5799 )
...
* fix(docker): add missing port mappings for non-neo4j quickstart
* undo cassandra
2022-09-05 15:32:19 +05:30
mohdsiddique
2b4f9400ca
fix(GMS): fix no such classes directory file:///etc/datahub/plugins/auth/resources ( #5743 )
2022-08-29 12:08:18 -07:00
mohdsiddique
cfaf7a0c20
fix(quickstart): fix for No such classes directory file:///etc/datahub/plugins/auth/resources ( #5720 )
...
Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
2022-08-24 09:26:13 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests ( #5704 )
2022-08-23 16:25:18 -07:00
Gabe Lyons
f06b8eb4e8
(chore): upgrading ingestion to 0.8.42 ( #5562 )
2022-08-04 17:06:16 +05:30
John Joyce
4e0da5de29
fix(docker): Fixing dev docker and quickstart ( #5550 )
2022-08-02 15:02:01 -07:00
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms ( #4999 )
2022-08-01 09:47:08 -07:00
Aseem Bansal
252992f15e
fix(ci): intermittent failure in github actions ( #5452 )
2022-07-25 23:02:02 -07:00
Shirshanka Das
941770f3bc
feat(cli): quickstart - experimental support for backup restore ( #5418 )
2022-07-24 23:52:25 -07:00
Aseem Bansal
acb9879eb4
feat(cli,build): remove deprecated variables GMS_HOST/_PORT ( #5451 )
2022-07-20 20:54:43 +05:30
Shirshanka Das
024797df0d
feat(quickstart): moving to official confluent images for m1 ( #5416 )
2022-07-17 18:59:09 -07:00
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 ( #5409 )
2022-07-15 21:32:32 +05:30
Navin Sharma
f3e5afdba9
feat(quickstart): Adding env variables and cli options for customizing mapped ports in quickstart ( #5353 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-07-11 22:33:24 -07:00
Aseem Bansal
40452b3cc1
fix(docs,quickstart): release related changes for 0.8.40 ( #5299 )
2022-06-30 17:21:12 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion ( #5208 )
2022-06-23 15:22:40 +05:30
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version ( #5145 )
2022-06-10 09:05:24 +05:30
Dexter Lee
d31c00939c
fix(docker): Fix mysql setup bug ( #5071 )
2022-06-02 10:01:36 +02:00
RyanHolstien
2a2fd05345
feat: telemetry improvements ( #5029 )
2022-05-27 17:04:45 -07:00
RyanHolstien
cbda3f5f29
feat(release): update CLI version ( #4962 )
...
* feat(release): update CLI version
* add typscript
2022-05-19 18:13:13 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 ( #4960 )
2022-05-19 22:55:56 +05:30
RyanHolstien
bb341f740c
fix(env): provide default for unset telemetry variable ( #4937 )
2022-05-18 14:01:37 +05:30
RyanHolstien
c3cfaf8e3c
feat(telemetry): add server side telemetry ( #4925 )
...
Co-authored-by: Kevin Hu <kevinhuwest@gmail.com>
2022-05-17 11:37:45 -07:00
John Joyce
d96ddec843
refactor(actions): Migrate to use new datahub-actions container ( #4903 )
2022-05-13 12:11:56 +05:30
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 ( #4829 )
2022-05-05 12:57:06 +02:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion ( #4581 )
2022-04-05 15:33:13 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Shirshanka Das
f18f453200
moving to dockerhub for actions container ( #4497 )
2022-03-24 22:24:07 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Aseem Bansal
8c7f63e4f7
feat: change quickstart to use head tag for actions ( #4357 )
2022-03-09 10:29:10 -08:00
Aseem Bansal
e6a2615c08
feat(quickstart): restart actions pod in case of failures ( #4342 )
2022-03-08 11:55:21 -08:00
John Joyce
787a7e6dcd
fix(quickstart): Pin actions pod + add volume mount for datahub-frontend ( #4318 )
2022-03-04 14:05:14 -08:00
John Joyce
acf6eaaf1c
refactor(ui): Simplify process of adding user.props (w/ docs) ( #4296 )
2022-03-03 19:22:35 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals ( #4186 )
2022-02-25 16:33:59 -08:00
Ky-Anh Huynh
ef659570f4
fix(docker): docker-compose now persists kafka broker data ( #4031 )
2022-02-01 16:35:43 -08:00
John Joyce
35ebca77ee
quickstart: Adding UI ingestion to quickstart YAML ( #3994 )
2022-01-27 10:47:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Swaroop Jagadish
90b7b9dddd
fix(ci): moving defaults back to head now that docker builds are green ( #3993 )
2022-01-27 09:48:01 -08:00
John Joyce
9366a47f88
fix(quickstart): Assign correct mysql-setup container for M1 and remove "head" default version. ( #3987 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-26 18:15:54 -08:00
John Joyce
aeabeec133
fix(quickstart): Pin Quickstart version to v0.8.23. ( #3983 )
2022-01-26 11:36:26 -08:00
Sergio Gómez Villamor
c59c63e90d
feat: enables dbt metadata files to be loaded from URIs ( #3739 )
2021-12-15 09:11:39 -08:00
John Joyce
5c0a49d09a
fix(CI): regenerate Docker Quickstart ( #3741 )
2021-12-14 12:25:14 -08:00
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )" ( #3740 )
2021-12-14 10:49:03 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative ( #3578 )
2021-12-13 12:37:59 -08:00
Swaroop Jagadish
50122cbd98
fix(docs): small fixes to docs and docker images for custom metadata … ( #3640 )
2021-11-30 00:12:17 -08:00
Enrico Minack
66328ee23f
feat(quickstart): simplify docker generate and compare script ( #3434 )
2021-11-29 23:57:47 -08:00
Tamas Nemeth
d41c5eba35
feat(docker): add multiplatform docker support for arm64 (m1) ( #3537 )
2021-11-09 11:50:06 -08:00
John Joyce
664bbd3ec6
fix(mysql-setup): update default mysql collation to utf8mb4_bin ( #3459 )
2021-10-26 11:23:11 -07:00
Dexter Lee
07b74b652e
fix(docker): fix volume mounts ( #3341 )
2021-10-08 15:46:18 -07:00
