168 Commits

Author SHA1 Message Date
John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS (#2690) 2021-06-15 08:44:15 -07:00
John Joyce
7591c8994a
feat(datahub cli): DataHub CLI Quickstart (#2689) 2021-06-14 17:15:24 -07:00
Harshal Sheth
2123c8b6d7
fix(ingest): exclude mssql-odbc from "all" extra (#2660) 2021-06-07 14:00:35 -07:00
Harshal Sheth
051fa253d1
fix(docker): use debug tag in local dev images (#2658) 2021-06-04 18:12:26 -07:00
Harshal Sheth
e73c6525e9
revert: "fix(docker): pin containers to golden hash for release (#2654)" (#2659)
This reverts commit a483933eab6d072ba6d2a414e378eee1e80dbdc6 and moves
us back to using HEAD in quickstart on the master branch.
2021-06-04 18:11:36 -07:00
Harshal Sheth
a483933eab
fix(docker): pin containers to golden hash for release (#2654) 2021-06-04 12:46:57 -07:00
John Joyce
cc3caa998b
fix(datahub-upgrade): fixing mis-spelled schema registry url (#2652) 2021-06-04 11:05:13 -07:00
Harshal Sheth
9e79272a5f
fix: use head tag by default in quickstart (#2650) 2021-06-04 09:52:10 -07:00
Dexter Lee
d5934f70bb
fix(nocode): Fix docker image tag for run_upgrade script (#2648) 2021-06-03 21:42:23 -07:00
John Joyce
c98446c9a5
fix(datahub-upgrade): remove debug flag (#2640) 2021-06-03 16:26:20 -07:00
John Joyce
81c9fc30aa
feat(datahub-upgrade): Use the "head" image tag. (#2641) 2021-06-03 16:25:17 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling (#2629)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
G-nther
634dde5cfb
fix(analytics): use seperate env variable for tracking topic in MAE-Consumer (#2545) 2021-05-12 17:53:40 -07:00
Dexter Lee
b4cf74bcb4
fix(analytics): add support for AWS ES (#2539) 2021-05-12 10:54:18 -07:00
John Joyce
29832e5385
feat(Product Analytics): Introducing In-App Analytics Beta (#2499)
Co-authored-by: Harshal Sheth <harshal@acryl.io>
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-05-11 15:41:42 -07:00
shakti-garg
8ed14a62e2
feat(business_glossary): add new entity business term and its relationship with dataset and its fields (#2228)
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-10 13:20:23 -07:00
Harshal Sheth
201ffd4979
test: add smoke test (#2464) 2021-04-29 23:27:03 -07:00
Dexter Lee
6554f15e67
fix(docker): Nuke ingestion containers when calling docker/nuke.sh (#2459) 2021-04-26 16:29:25 -07:00
Gabe Lyons
851e00ba9f
feat(lineage): implement support for datasets, charts and dashboards downstream lineage fetching in a generic way (#2397)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Brian <brianwebtek@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2021-04-23 00:18:39 -07:00
Dexter Lee
c1c587d164
fix(kafka-setup): Fix start script for kafka setup (#2421) 2021-04-19 15:39:38 -07:00
Dexter Lee
1b3a1459e3
fix(kafka-setup): Add the correct context to the git workflow for pushing kafka-setup image (#2414) 2021-04-16 17:51:43 -07:00
G-nther
177161a850
feat(kafka-setup): add option for SSL and topic partition config via environment (#2398) 2021-04-16 09:40:39 -07:00
Dexter Lee
f018dd6f3e
fix: Fix env variable setup for kafka, mysql-setup docker containers (#2402) 2021-04-14 19:07:50 -07:00
Dexter Lee
7c54004b93
feat(mysql-setup): Add the ability to specify database name for mysql-setup (#2385) 2021-04-13 08:03:50 -07:00
Dexter Lee
fa015c5aaa
fix(kafka-topic-convention): Fix DAOs that do not refer to TopicConvention (#2387) 2021-04-13 07:58:31 -07:00
Dexter Lee
1fc532d831
feat(index): Add index naming convention for elasticsearch (#2386) 2021-04-13 07:56:31 -07:00
John Joyce
16cada2055
fix(Ember App): Allow ember build (disabled by default) (#2348)
Co-authored-by: John Joyce <john@acryl.io>
2021-04-06 16:10:50 -07:00
Harshal Sheth
6e762ce3bc
fix(docker): remove restart: always from docker-compose for consistency (#2338) 2021-04-05 12:45:24 -07:00
shakti-garg
3fb71acf71
feat(es-setup): add logic in elasticsearch setup to compare-and-update index if already exists (#2312)
* 2310 | add logic in es-setup script to compare-and-update index if already exists
2021-04-03 11:17:16 -07:00
Harshal Sheth
478d232d2f
build: remove deprecated ember app from build (#2328) 2021-04-01 12:16:47 -07:00
Dexter Lee
9d1e24fd0b
fix(docker): Fix issue in gms start.sh (#2318)
Co-authored-by: bernardino <ricardo.bernardino@gmail.com>
2021-03-31 09:25:30 -07:00
bernardino
9a947948f0
feat(Kubernetes): Add JMX exporter containers to all DataHub components (#2251)
Co-authored-by: Ricardo Bernardino <ricardo.bernardino@definedcrowd.com>
2021-03-30 22:03:27 -07:00
Dexter Lee
d158da7820
feat(docker): Add dockerfile for initializing an existing mysql server (#2298) 2021-03-27 20:26:00 -07:00
Fredrik Sannholm
4591667e05
feat(elasticsearch): Elasticsearch simple auth over https support (#2303) 2021-03-27 20:21:10 -07:00
Harshal Sheth
07f4cb1199
feat: datahub check local-docker (#2295) 2021-03-26 10:03:51 -07:00
Dexter Lee
0f035782fd
feat(docker): Add healthchecks to datahub docker images (#2288) 2021-03-23 15:15:16 -07:00
Harshal Sheth
f216e1836d
fix: remain as root until final datahub-frontend build stage (#2283) 2021-03-23 00:17:36 -07:00
Harshal Sheth
fec39c682a
fix(docker): use local datahub-frontend in dev.sh (#2268) 2021-03-19 15:55:04 -07:00
John Plaisted
5e91014e00
feat(search) BREAKING Support ElasticSearch 7, drop ES5 (#2263)
Merges in changes from our ES7 branch, and drops support for ES5.

This is a breaking change due to the upgrade, we have a ES5 branch at the commit before this.
2021-03-18 19:16:44 -07:00
John Joyce
7c5d8cb719
feat(react): Adding shadow and deeper linear gradient (#2255)
Co-authored-by: John Joyce <john@acryl.io>
2021-03-18 15:40:24 -07:00
John Joyce
728a742528
refactor(react): React as the default UI (#2252)
Co-authored-by: John Joyce <john@acryl.io>
2021-03-18 09:55:05 -07:00
Fredrik Sannholm
da6b3d111d
feat(datajob): Backend implementation (#2197) 2021-03-13 08:00:44 -08:00
Dexter Lee
8d731b577e
fix(docker): start issue when there are multiple kafka brokers in bootstrap config (#2231) 2021-03-12 11:26:49 -08:00
Harshal Sheth
7d02313a2a
fix(ingest): use python extras in docker image (#2226) 2021-03-11 16:30:38 -08:00
Harshal Sheth
6a8fca59f1
feat(ingest): use plugin system based on Python extras (#2224) 2021-03-11 13:41:05 -08:00
John Joyce
08616cc610
feat(react): SSO support simple OIDC authentication (#2190)
Co-authored-by: John Joyce <john@acryl.io>
2021-03-11 13:38:35 -08:00
Dexter Lee
e659f749f2
Added images to es/kafka-setup (#2223) 2021-03-11 12:55:03 -08:00
Dexter Lee
b02039c3da
feat(ci): Add SHA based tagging before pushing to docker registries (#2204) 2021-03-10 10:33:27 -08:00
Gabe Lyons
11e0cd66d4
feat(tag): adding search for tags in gms layer (#2203) 2021-03-10 00:02:58 -08:00
Thomas Larsson
5d6cf95f39
feat(mae-consumer): enable mae-consumer to use ssl when communicating with elasticsearch (#2202)
Fixes: #2129

Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-03-09 22:42:04 -08:00