yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-07-04 07:34:44 +00:00
Code Issues Packages Projects Releases Wiki Activity
11,753 Commits 186 Branches 118 Tags
Commit Graph

642 Commits

Author SHA1 Message Date
John Joyce
16cada2055
fix(Ember App): Allow ember build (disabled by default) (#2348) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-04-06 16:10:50 -07:00
Harshal Sheth
6e762ce3bc
fix(docker): remove restart: always from docker-compose for consistency (#2338) 2021-04-05 12:45:24 -07:00
shakti-garg
3fb71acf71
feat(es-setup): add logic in elasticsearch setup to compare-and-update index if already exists (#2312) 
* 2310 | add logic in es-setup script to compare-and-update index if already exists
 2021-04-03 11:17:16 -07:00
Harshal Sheth
478d232d2f
build: remove deprecated ember app from build (#2328) 2021-04-01 12:16:47 -07:00
Dexter Lee
9d1e24fd0b
fix(docker): Fix issue in gms start.sh (#2318) 
Co-authored-by: bernardino <ricardo.bernardino@gmail.com>
 2021-03-31 09:25:30 -07:00
bernardino
9a947948f0
feat(Kubernetes): Add JMX exporter containers to all DataHub components (#2251) 
Co-authored-by: Ricardo Bernardino <ricardo.bernardino@definedcrowd.com>
 2021-03-30 22:03:27 -07:00
Dexter Lee
d158da7820
feat(docker): Add dockerfile for initializing an existing mysql server (#2298) 2021-03-27 20:26:00 -07:00
Fredrik Sannholm
4591667e05
feat(elasticsearch): Elasticsearch simple auth over https support (#2303) 2021-03-27 20:21:10 -07:00
Harshal Sheth
07f4cb1199
feat: datahub check local-docker (#2295) 2021-03-26 10:03:51 -07:00
Dexter Lee
0f035782fd
feat(docker): Add healthchecks to datahub docker images (#2288) 2021-03-23 15:15:16 -07:00
Harshal Sheth
f216e1836d
fix: remain as root until final datahub-frontend build stage (#2283) 2021-03-23 00:17:36 -07:00
Harshal Sheth
fec39c682a
fix(docker): use local datahub-frontend in dev.sh (#2268) 2021-03-19 15:55:04 -07:00
John Plaisted
5e91014e00
feat(search) BREAKING Support ElasticSearch 7, drop ES5 (#2263) 
Merges in changes from our ES7 branch, and drops support for ES5.

This is a breaking change due to the upgrade, we have a ES5 branch at the commit before this.
 2021-03-18 19:16:44 -07:00
John Joyce
7c5d8cb719
feat(react): Adding shadow and deeper linear gradient (#2255) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-03-18 15:40:24 -07:00
John Joyce
728a742528
refactor(react): React as the default UI (#2252) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-03-18 09:55:05 -07:00
Fredrik Sannholm
da6b3d111d
feat(datajob): Backend implementation (#2197) 2021-03-13 08:00:44 -08:00
Dexter Lee
8d731b577e
fix(docker): start issue when there are multiple kafka brokers in bootstrap config (#2231) 2021-03-12 11:26:49 -08:00
Harshal Sheth
7d02313a2a
fix(ingest): use python extras in docker image (#2226) 2021-03-11 16:30:38 -08:00
Harshal Sheth
6a8fca59f1
feat(ingest): use plugin system based on Python extras (#2224) 2021-03-11 13:41:05 -08:00
John Joyce
08616cc610
feat(react): SSO support simple OIDC authentication (#2190) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-03-11 13:38:35 -08:00
Dexter Lee
e659f749f2
Added images to es/kafka-setup (#2223) 2021-03-11 12:55:03 -08:00
Dexter Lee
b02039c3da
feat(ci): Add SHA based tagging before pushing to docker registries (#2204) 2021-03-10 10:33:27 -08:00
Gabe Lyons
11e0cd66d4
feat(tag): adding search for tags in gms layer (#2203) 2021-03-10 00:02:58 -08:00
Thomas Larsson
5d6cf95f39
feat(mae-consumer): enable mae-consumer to use ssl when communicating with elasticsearch (#2202) 
Fixes: #2129

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
 2021-03-09 22:42:04 -08:00
Thomas Larsson
7043138797
feat(gms): add elasticsearch SSL support (#2189) 
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
 2021-03-08 10:38:04 -08:00
Harshal Sheth
20bf794ec4
docs: hosted documentation website (#2174) 2021-03-05 00:12:12 -08:00
Harshal Sheth
410b823be9
build(ingest): use multi-stage docker build for datahub-ingestion (#2159) 2021-03-02 14:51:59 -08:00
Harshal Sheth
dced25fef7
feat(ingest): switch quickstart to Python ingestion (#2158) 2021-03-02 11:48:26 -08:00
Harshal Sheth
9e73794022
ci(ingest): setup docker container for metadata ingestion (#2150) 2021-03-01 17:36:38 -08:00
Rickard Cardell
4db9914432
feat: neo4j https support (#2101) (#2144) 
* feat: neo4j https support (#2101)

    Ability to specify http as well as https URI schemes in the 'NEO4J_HOST' variable.
 2021-02-26 21:28:22 -08:00
Thomas Larsson
8fe9520ddc
feat(datahub-dao): enable services to access gms over https (#2133) 
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
 2021-02-25 14:26:23 -08:00
Dexter Lee
e7c3fd867b
refactor(docker-dev): set up elasticsearch using local mapping on docker-compose.dev (#2137) 
Co-authored-by: Dexter Lee <dexter@acryl.io>
 2021-02-24 16:00:16 -08:00
John Joyce
1aede64465
bug(docker react): Fix react docker image build (#2118) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-02-17 23:11:32 -08:00
RyanHolstien
ea86ade29b
feat: ML Model Backend Implementation (#1896) 
Co-authored-by: RyanHolstien <rholstien@expediagroup.com>
 2021-02-17 13:28:13 -08:00
John Joyce
715fb7d7f7
bug(docker): Removing datahub-gms-graphql-service from default docker-compose.yml file (#2111) 2021-02-16 21:47:38 -08:00
John Joyce
11f030b118 Adding Github Action to publish Docker image 2021-02-15 17:40:41 -08:00
John Joyce
ef04205a73 Serving React App via Docker 2021-02-15 17:40:41 -08:00
John Joyce
e3ac44cfd4 Fixes 2021-02-15 17:40:41 -08:00
John Joyce
8ef5e2a545 Deploy React via Docker 2021-02-15 17:40:41 -08:00
Arun Vasudevan
84e952e138
feat (graphql): Datahub GMS Graphql Api Application for Querying Dataset (#2071) 2021-02-01 11:51:15 -08:00
Satyaprakash Bommaraju
782e29ce53
Fix for Kafka-UI Connectivity Error with Kafka-Rest Proxy (#2053) 
Fixes error when acessing http://localhost:18000 where the Kafka-UI was unable to connect to Rest Proxy
 2021-01-12 10:30:47 -08:00
Mars Lan
36b79a3ef3
build(docker): add script to clean up docker environment (#2013) 
Co-authored-by: Mars Lan <mars@trayminder.com>
 2020-12-17 13:52:31 -08:00
John Plaisted
838f964114
feat: add elasticsearch sanity integration tests (#2028) 
These tests verify that, given an index settings and mappings, data can be written to the index, and read from it with a query_all query. These are very simple sanity tests.

We can, and should, write more complex tests that specific to each index in the future.
 2020-12-02 20:49:34 -08:00
John Plaisted
5f9d967451
fix: ingestion docker image (#2027) 
The environment was not set correctly, so it could not fire kafka events. It (mce-cli) always worked when running outside of docker.

I also added a dev ingestion docker image / script which may be much faster if you've already built locally.

Tested:
1. Cleaned docker volumes and started datahub. Verified it is empty.
2. Built with gradle.
3. Ran ./docker/ingestion/ingestion-dev.sh. Verified data shows in DataHub.
4. Ran step 1 again.
5. Ran ./docker/ingestion/ingestion.sh. Verified data shows in DataHub.
 2020-12-02 17:40:12 -08:00
Nagarjuna Kanamarlapudi
a1e7e26e08
Fix dataset index creation issue (#2022) 2020-11-30 18:33:06 -08:00
Kerem Sahin
4d8320e4a0
feat(dashboard): Dashboards backend implementation (#1884) 2020-11-23 09:25:58 -08:00
Nagarjuna Kanamarlapudi
5d083143db
feat(dataset): Enable search of datasets by field names (#2001) 
* feat(dataset): Enable search of datasets by field names
 2020-11-20 12:01:07 -08:00
Jyoti Wadhwani
70ddb09d29
feat: enable SCSI for datasets (#1986) 
* enable SCSI for datasets

* Update scsi-onboarding-guide.md
 2020-11-11 13:04:20 -08:00
Kerem Sahin
b989f9d16a
Upgrade neo4j to 4.0 (#1960) 2020-10-26 05:31:00 -07:00
Mars Lan
93805e7f1a
build(docker): use community version of ES & Kibana in quickstart (#1929) 
Fixes #1928
 2020-10-07 21:21:08 -07:00