45 Commits

Author SHA1 Message Date
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
david-leifker
9277101a5f
config(quickstart): enable auto-reindex for quickstart (#6983) 2023-01-09 17:58:29 -06:00
mohdsiddique
f2a83f3074
feat(gms): Pluggable Authentication & Authorization Framework (#6634) 2022-12-06 10:22:41 -08:00
Peter Szalai
f77117a9e0
fix(envs): remove DATASET_ENABLE_SCSI stale env var (#6546) 2022-11-24 21:34:53 +05:30
syedzoherer
5010e0cf69
Added I AM auth for Opensearch (#6370)
* Added I AM auth for Opensearch

* Code refactor and removed default Region for AWS cred.

* Added missing opensearch region exception

* Update RestHighLevelClientFactory.java

* Fixed stylecheck

* Update RestHighLevelClientFactory.java

* Update RestHighLevelClientFactory.java

Co-authored-by: syed.javed <syed.javed@precisely.com>
2022-11-22 10:49:28 -06:00
david-leifker
33fd876421
feat(elasticsearch): Updates to elasticsearch configuration, dao, and tests (#6269) 2022-11-15 18:03:11 -08:00
Shirshanka Das
48b46971b8
feat(ingest): remove hardcoded env variable default for cli version (#6075) 2022-10-02 16:46:34 -07:00
John Joyce
d15518f0d9
fix(browse): Fixing browse path to remove requirement for simple name suffix (#5634) 2022-09-07 13:32:38 -07:00
Chris Collins
d64cca5c6b
feat(retention) Enable retention and set max versions for executionRequests (#5704) 2022-08-23 16:25:18 -07:00
Gabe Lyons
f06b8eb4e8
(chore): upgrading ingestion to 0.8.42 (#5562) 2022-08-04 17:06:16 +05:30
John Joyce
4e0da5de29
fix(docker): Fixing dev docker and quickstart (#5550) 2022-08-02 15:02:01 -07:00
Salih Can
0ded02544c
fix(analytics-tab) - fix analytics tab config variable for gms (#5529) 2022-08-02 17:05:04 +05:30
mohdsiddique
c31e380489
feat(apache-ranger): Apache Ranger Authorizer support in datahub-gms (#4999) 2022-08-01 09:47:08 -07:00
Aseem Bansal
36f3ab3fa3
feat(quickstart,docs): updates for v0.8.41 (#5409) 2022-07-15 21:32:32 +05:30
Aseem Bansal
40452b3cc1
fix(docs,quickstart): release related changes for 0.8.40 (#5299) 2022-06-30 17:21:12 +05:30
Aseem Bansal
1adcc994f3
feat(ingest): remove need for sink block in UI based ingestion (#5208) 2022-06-23 15:22:40 +05:30
John Joyce
e2f1da00ff
refactor(configs): Simplify Kafka Topic name configurations + docs (#5198) 2022-06-17 12:15:51 -07:00
John Joyce
c4650356fa
Chore: Bump Default UI Ingestion Version (#5145) 2022-06-10 09:05:24 +05:30
RyanHolstien
cbda3f5f29
feat(release): update CLI version (#4962)
* feat(release): update CLI version

* add typscript
2022-05-19 18:13:13 -07:00
RyanHolstien
8fbc61577c
feat: updates for 0.8.35 (#4960) 2022-05-19 22:55:56 +05:30
Aseem Bansal
58fbf9fc89
feat: updates for 0.8.34 (#4829) 2022-05-05 12:57:06 +02:00
Aseem Bansal
32349bf405
chore: update default cli for managed ingestion (#4581) 2022-04-05 15:33:13 -07:00
John Joyce
95d6bcd1a0
exposing kafka consumer concurrency (#4536) 2022-04-04 14:57:34 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events (#4477) 2022-03-29 18:32:04 -07:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals (#4186) 2022-02-25 16:33:59 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval(#3914) (#3956)
* feat(search): supporting chinese glossaryterm full text retrieval(#3914)

* refactor(search): modify mainTokenizer to appropriate position(#3914)

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) (#3975) 2022-01-27 10:33:12 -08:00
Gabe Lyons
3fd3313544
Revert "feat(graph): Make Dgraph a proper Neo4j alternative (#3578)" (#3740) 2021-12-14 10:49:03 -08:00
Enrico Minack
a6deaabfcf
feat(graph): Make Dgraph a proper Neo4j alternative (#3578) 2021-12-13 12:37:59 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! (#3598) 2021-11-22 16:33:14 -08:00
Dexter Lee
8747fbe43c
feat(perf): Add perf testing and monitoring framework (#3195) 2021-09-07 23:06:15 -07:00
John Joyce
ccb09a6966
feat(access control): Fine-Grained Access Control M1 (#3182) 2021-09-02 19:05:13 -07:00
John Joyce
2c5edd88ab
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) (#3131) 2021-08-20 10:58:07 -07:00
John Joyce
7074d9c627
fix(quickstart): Bumping Default Memory for GMS and Frontend (#3009) 2021-08-02 23:58:33 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
Dexter Lee
e640f5ed03
fix(docker): modernize docker images and fix vulnerabilities (#2746) 2021-06-23 13:55:14 -07:00
John Joyce
5a4d194bad
feat(docker): reduce quickstart footprint (#2744) 2021-06-23 12:59:49 -07:00
Gabe Lyons
3f5e371851
feat(graph): support using elasticsearch as graph backend. (#2726) 2021-06-22 16:08:54 -07:00
John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS (#2690) 2021-06-15 08:44:15 -07:00
G-nther
634dde5cfb
fix(analytics): use seperate env variable for tracking topic in MAE-Consumer (#2545) 2021-05-12 17:53:40 -07:00
Fredrik Sannholm
4591667e05
feat(elasticsearch): Elasticsearch simple auth over https support (#2303) 2021-03-27 20:21:10 -07:00
Thomas Larsson
7043138797
feat(gms): add elasticsearch SSL support (#2189)
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-03-08 10:38:04 -08:00
Rickard Cardell
4db9914432
feat: neo4j https support (#2101) (#2144)
* feat: neo4j https support (#2101)

    Ability to specify http as well as https URI schemes in the 'NEO4J_HOST' variable.
2021-02-26 21:28:22 -08:00
Jyoti Wadhwani
70ddb09d29
feat: enable SCSI for datasets (#1986)
* enable SCSI for datasets

* Update scsi-onboarding-guide.md
2020-11-11 13:04:20 -08:00
John Plaisted
b8e18b0b5d
refactor(docker): make docker files easier to use during development. (#1777)
* Make docker files easier to use during development.

During development it quite nice to have docker work with locally built code. This allows you to launch all services very quickly, with your changes, and optionally with debugging support.

Changes made to docker files:
- Removed all redundant docker-compose files. We now have 1 giant file, and smaller files to use as overrides.
- Remove redundant README files that provided little information.
- Rename docker/<dir> to match the service name in the docker-compose file for clarity.
- Move environment variables to .env files. We only provide dev / the default environment for quickstart.
- Add debug options to docker files using multistage build to build minimal images with the idea that built files will be mounted instead.
- Add a docker/dev.sh script + compose file to easily use the dev override images (separate tag; images never published; uses debug docker files; mounts binaries to image).
- Added docs/docker documentation for this.
2020-08-06 16:38:53 -07:00