yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-10-31 10:49:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,856 Commits 400 Branches 129 Tags
Commit Graph

133 Commits

Author SHA1 Message Date
Dexter Lee
0f035782fd
feat(docker): Add healthchecks to datahub docker images (#2288) 2021-03-23 15:15:16 -07:00
Harshal Sheth
f216e1836d
fix: remain as root until final datahub-frontend build stage (#2283) 2021-03-23 00:17:36 -07:00
Harshal Sheth
fec39c682a
fix(docker): use local datahub-frontend in dev.sh (#2268) 2021-03-19 15:55:04 -07:00
John Plaisted
5e91014e00
feat(search) BREAKING Support ElasticSearch 7, drop ES5 (#2263) 
Merges in changes from our ES7 branch, and drops support for ES5.

This is a breaking change due to the upgrade, we have a ES5 branch at the commit before this.
 2021-03-18 19:16:44 -07:00
John Joyce
7c5d8cb719
feat(react): Adding shadow and deeper linear gradient (#2255) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-03-18 15:40:24 -07:00
John Joyce
728a742528
refactor(react): React as the default UI (#2252) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-03-18 09:55:05 -07:00
Fredrik Sannholm
da6b3d111d
feat(datajob): Backend implementation (#2197) 2021-03-13 08:00:44 -08:00
Dexter Lee
8d731b577e
fix(docker): start issue when there are multiple kafka brokers in bootstrap config (#2231) 2021-03-12 11:26:49 -08:00
Harshal Sheth
7d02313a2a
fix(ingest): use python extras in docker image (#2226) 2021-03-11 16:30:38 -08:00
Harshal Sheth
6a8fca59f1
feat(ingest): use plugin system based on Python extras (#2224) 2021-03-11 13:41:05 -08:00
John Joyce
08616cc610
feat(react): SSO support simple OIDC authentication (#2190) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-03-11 13:38:35 -08:00
Dexter Lee
e659f749f2
Added images to es/kafka-setup (#2223) 2021-03-11 12:55:03 -08:00
Dexter Lee
b02039c3da
feat(ci): Add SHA based tagging before pushing to docker registries (#2204) 2021-03-10 10:33:27 -08:00
Gabe Lyons
11e0cd66d4
feat(tag): adding search for tags in gms layer (#2203) 2021-03-10 00:02:58 -08:00
Thomas Larsson
5d6cf95f39
feat(mae-consumer): enable mae-consumer to use ssl when communicating with elasticsearch (#2202) 
Fixes: #2129

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
 2021-03-09 22:42:04 -08:00
Thomas Larsson
7043138797
feat(gms): add elasticsearch SSL support (#2189) 
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
 2021-03-08 10:38:04 -08:00
Harshal Sheth
20bf794ec4
docs: hosted documentation website (#2174) 2021-03-05 00:12:12 -08:00
Harshal Sheth
410b823be9
build(ingest): use multi-stage docker build for datahub-ingestion (#2159) 2021-03-02 14:51:59 -08:00
Harshal Sheth
dced25fef7
feat(ingest): switch quickstart to Python ingestion (#2158) 2021-03-02 11:48:26 -08:00
Harshal Sheth
9e73794022
ci(ingest): setup docker container for metadata ingestion (#2150) 2021-03-01 17:36:38 -08:00
Rickard Cardell
4db9914432
feat: neo4j https support (#2101) (#2144) 
* feat: neo4j https support (#2101)

    Ability to specify http as well as https URI schemes in the 'NEO4J_HOST' variable.
 2021-02-26 21:28:22 -08:00
Thomas Larsson
8fe9520ddc
feat(datahub-dao): enable services to access gms over https (#2133) 
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
 2021-02-25 14:26:23 -08:00
Dexter Lee
e7c3fd867b
refactor(docker-dev): set up elasticsearch using local mapping on docker-compose.dev (#2137) 
Co-authored-by: Dexter Lee <dexter@acryl.io>
 2021-02-24 16:00:16 -08:00
John Joyce
1aede64465
bug(docker react): Fix react docker image build (#2118) 
Co-authored-by: John Joyce <john@acryl.io>
 2021-02-17 23:11:32 -08:00
RyanHolstien
ea86ade29b
feat: ML Model Backend Implementation (#1896) 
Co-authored-by: RyanHolstien <rholstien@expediagroup.com>
 2021-02-17 13:28:13 -08:00
John Joyce
715fb7d7f7
bug(docker): Removing datahub-gms-graphql-service from default docker-compose.yml file (#2111) 2021-02-16 21:47:38 -08:00
John Joyce
11f030b118 Adding Github Action to publish Docker image 2021-02-15 17:40:41 -08:00
John Joyce
ef04205a73 Serving React App via Docker 2021-02-15 17:40:41 -08:00
John Joyce
e3ac44cfd4 Fixes 2021-02-15 17:40:41 -08:00
John Joyce
8ef5e2a545 Deploy React via Docker 2021-02-15 17:40:41 -08:00
Arun Vasudevan
84e952e138
feat (graphql): Datahub GMS Graphql Api Application for Querying Dataset (#2071) 2021-02-01 11:51:15 -08:00
Satyaprakash Bommaraju
782e29ce53
Fix for Kafka-UI Connectivity Error with Kafka-Rest Proxy (#2053) 
Fixes error when acessing http://localhost:18000 where the Kafka-UI was unable to connect to Rest Proxy
 2021-01-12 10:30:47 -08:00
Mars Lan
36b79a3ef3
build(docker): add script to clean up docker environment (#2013) 
Co-authored-by: Mars Lan <mars@trayminder.com>
 2020-12-17 13:52:31 -08:00
John Plaisted
838f964114
feat: add elasticsearch sanity integration tests (#2028) 
These tests verify that, given an index settings and mappings, data can be written to the index, and read from it with a query_all query. These are very simple sanity tests.

We can, and should, write more complex tests that specific to each index in the future.
 2020-12-02 20:49:34 -08:00
John Plaisted
5f9d967451
fix: ingestion docker image (#2027) 
The environment was not set correctly, so it could not fire kafka events. It (mce-cli) always worked when running outside of docker.

I also added a dev ingestion docker image / script which may be much faster if you've already built locally.

Tested:
1. Cleaned docker volumes and started datahub. Verified it is empty.
2. Built with gradle.
3. Ran ./docker/ingestion/ingestion-dev.sh. Verified data shows in DataHub.
4. Ran step 1 again.
5. Ran ./docker/ingestion/ingestion.sh. Verified data shows in DataHub.
 2020-12-02 17:40:12 -08:00
Nagarjuna Kanamarlapudi
a1e7e26e08
Fix dataset index creation issue (#2022) 2020-11-30 18:33:06 -08:00
Kerem Sahin
4d8320e4a0
feat(dashboard): Dashboards backend implementation (#1884) 2020-11-23 09:25:58 -08:00
Nagarjuna Kanamarlapudi
5d083143db
feat(dataset): Enable search of datasets by field names (#2001) 
* feat(dataset): Enable search of datasets by field names
 2020-11-20 12:01:07 -08:00
Jyoti Wadhwani
70ddb09d29
feat: enable SCSI for datasets (#1986) 
* enable SCSI for datasets

* Update scsi-onboarding-guide.md
 2020-11-11 13:04:20 -08:00
Kerem Sahin
b989f9d16a
Upgrade neo4j to 4.0 (#1960) 2020-10-26 05:31:00 -07:00
Mars Lan
93805e7f1a
build(docker): use community version of ES & Kibana in quickstart (#1929) 
Fixes #1928
 2020-10-07 21:21:08 -07:00
Fredrik Sannholm
125ae288f1
docker: Run as non-root user in docker (#1914) 2020-10-06 04:35:38 -07:00
Mars Lan
a13ca65e02
Update README.md 2020-09-30 06:20:14 -07:00
Grant Nicholas
9bcf273661
fix(docker): update mae and mce consumer images to include glibc compat layer. allows the consumer jobs to deal with snappy compressed kafka topics when running on alpine linux (#1899) 2020-09-28 15:30:56 -07:00
John Plaisted
821bce7d69
feat: Port mce-cli to Java. (#1871) 
Port mce-cli to Java.

Also moved off the avro format event file to json instead. Much nicer to use :)
 2020-09-25 14:05:29 -07:00
Fredrik Sannholm
d50b9c01b4
fix (docker): Fix install of Chrome in frontend Dockerimage (#1889) 
* fix (docker): Fix install of Chrome in frontend Dockerimage

Retry installing Chrome after dependencies have been installed

* fix (docker): Install Chrome with apt-get

Install Chrome and dependencies at the same time, using apt-get
 2020-09-22 12:02:37 -07:00
Kerem Sahin
ece9b82f7a
Update README.md 2020-08-19 21:39:46 -07:00
Kerem Sahin
21a5c9e607
Update README.md 2020-08-19 21:38:03 -07:00
na zhang
97424509d1
add description field for dataset index mapping (#1791) 2020-08-09 17:35:17 -07:00
Mars Lan
aa0a62e991
Update README.md 2020-08-08 04:58:55 -07:00