John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS ( #2690 )
2021-06-15 08:44:15 -07:00
Rickard Cardell
2cb06188ce
Fix 2592 neo4j connection options ( #2632 )
2021-06-11 09:55:30 -07:00
Kevin Hu
ebdaa0e359
feat(ingest): Feast ingestion integration ( #2605 )
...
* Add feast testing setup
* Init Feast test script
* Add feast to dependencies
* Update feast descriptors
* Sort integrations
* Working feast pytest
* Clean up feast docker-compose file
* Expand Feast tests
* Setup feast classes
* Add continuous and bytes data to feature types
* Update field type mapping
* Add PDLs
* Add MLFeatureSetUrn.java
* Comment out feast setup
* Add snapshot file and update inits
* Init Feast golden files generation
* Clean up Feast ingest
* Feast testing comments
* Yield Feature snapshots
* Fix Feature URN naming
* Update feast MCE
* Update Feature URN prefix
* Add MLEntity
* Update golden files with entities
* Specify feast sources
* Add feast source configs
* Working feast docker ingestion
* List entities and features before adding tables
* Add featureset names
* Remove unused
* Rename feast image
* Update README
* Add env to feast URNs
* Fix URN naming
* Remove redundant URN names
* Fix enum backcompatibility
* Move feast testing to docker
* Move URN generators to mce_builder
* Add source for features
* Switch TypeClass -> enum_type
* Rename source -> sourceDataset
* Add local Feast ingest image builds
* Rename Entity -> MLPrimaryKey
* Restore features and keys for each featureset
* Do not json encode source configs
* Remove old source properties from feature sets
* Regenerate golden file
* Fix race condition with Feast tests
* Exclude unknown source
* Update feature datatype enum
* Update README and fix typos
* Fix Entity typo
* Fix path to local docker image
* Specify feast config and version
* Fix feast env variables
* PR fixes
* Refactor feast ingest constants
* Make feature sources optional for back-compatibility
* Remove unused GCP files
* adding docker publish workflow
* Simplify name+namespace in PrimaryKeys
* adding docker publish workflow
* debug
* final attempt
* final final attempt
* final final final commit
* Switch to published ingestion image
* Update name and namespace in java files
* Rename FeatureSet -> FeatureTable
* Regenerate codegen
* Fix initial generation errors
* Update snapshot jsons
* Regenerated schemas
* Fix URN formats
* Revise builds
* Clean up feast URN builders
* Fix naming typos
* Fix Feature Set -> Feature Table
* Fix comments
* PR fixes
* All you need is Urn
* Regenerate snapshots and update validation
* Add UNKNOWN data type
* URNs for source types
* Add note on docker requirement
* Fix typo
* Reorder aspect unions
* Refactor feast ingest functions
* Update snapshot jsons
* Rebuild
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-09 15:07:04 -07:00
Dexter Lee
9c030d8325
fix(NoCode): Update snapshot json to latest ( #2655 )
2021-06-07 11:52:52 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling ( #2629 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
Brian
aa8ba1b8e9
feat(dataflow): update dataflow to have datajobs in new tab ( #2579 )
2021-05-18 21:25:42 -07:00
Dexter Lee
b4cf74bcb4
fix(analytics): add support for AWS ES ( #2539 )
2021-05-12 10:54:18 -07:00
shubham garg
95782b1acf
feat(graphql): add graphql types for business glossary ( #2485 )
...
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-11 17:29:00 -07:00
John Joyce
29832e5385
feat(Product Analytics): Introducing In-App Analytics Beta ( #2499 )
...
Co-authored-by: Harshal Sheth <harshal@acryl.io>
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-05-11 15:41:42 -07:00
shakti-garg
8ed14a62e2
feat(business_glossary): add new entity business term and its relationship with dataset and its fields ( #2228 )
...
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-10 13:20:23 -07:00
Dexter Lee
b4457afe30
feat(search): Add search for field level description and tags ( #2491 )
2021-05-05 14:04:02 -07:00
Gabe Lyons
f7b855a087
fix(lineage): fixing batch requests ( #2477 )
2021-04-29 23:11:58 -07:00
Gabe Lyons
1c0dd32730
fix(lineage): Fix issue where large lineage fetches trigger 414 URI too long ( #2462 )
2021-04-28 11:36:28 -07:00
Dexter Lee
55712f5918
feat(search): Support search terms that are dataset platform names ( #2442 )
2021-04-26 16:16:54 -07:00
Gabe Lyons
851e00ba9f
feat(lineage): implement support for datasets, charts and dashboards downstream lineage fetching in a generic way ( #2397 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Brian <brianwebtek@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2021-04-23 00:18:39 -07:00
Gabe Lyons
c7b49de67b
feat(ingest): adding superset ingestion source ( #2425 )
2021-04-22 00:11:54 -07:00
Fredrik Sannholm
e88a671959
Fix(search): fix datajob and dataflow search mappings ( #2418 )
2021-04-21 12:04:20 -07:00
Harshal Sheth
2fee45d127
feat: add s3 data platform and logo ( #2424 )
2021-04-20 16:40:51 -07:00
Gabe Lyons
a9f4f3797a
fix(tags): check description existence on tags ( #2399 )
2021-04-14 13:20:51 -07:00
Dexter Lee
fa015c5aaa
fix(kafka-topic-convention): Fix DAOs that do not refer to TopicConvention ( #2387 )
2021-04-13 07:58:31 -07:00
Dexter Lee
1fc532d831
feat(index): Add index naming convention for elasticsearch ( #2386 )
2021-04-13 07:56:31 -07:00
Dexter Lee
1c6f1d7a86
fix(elasticsearch): Fix inconsistencies between documents and elasticsearch mappings ( #2356 )
2021-04-07 14:59:43 -07:00
shakti-garg
3fb71acf71
feat(es-setup): add logic in elasticsearch setup to compare-and-update index if already exists ( #2312 )
...
* 2310 | add logic in es-setup script to compare-and-update index if already exists
2021-04-03 11:17:16 -07:00
Fredrik Sannholm
b02c7a345c
fix(tags): Support creating tags with MCE ( #2320 )
2021-03-31 11:16:12 -07:00
Fredrik Sannholm
4591667e05
feat(elasticsearch): Elasticsearch simple auth over https support ( #2303 )
2021-03-27 20:21:10 -07:00
Dexter Lee
7e03ea62ca
feat(healthcheck): Add Healthcheck servlet for GMS ( #2291 )
2021-03-23 20:23:55 -07:00
Dexter Lee
259e6af494
feat(search-by-field): Add the ability to search for field names ( #2286 )
2021-03-23 15:18:32 -07:00
Dexter Lee
0f035782fd
feat(docker): Add healthchecks to datahub docker images ( #2288 )
2021-03-23 15:15:16 -07:00
Pedro Silva
f0d093f4ab
feat(react): add druid logo ( #2264 )
2021-03-19 08:29:52 -07:00
John Plaisted
5e91014e00
feat(search) BREAKING Support ElasticSearch 7, drop ES5 ( #2263 )
...
Merges in changes from our ES7 branch, and drops support for ES5.
This is a breaking change due to the upgrade, we have a ES5 branch at the commit before this.
2021-03-18 19:16:44 -07:00
Gabe Lyons
7106753a4d
feat(tags): improving elastic search templates for tags ( #2254 )
2021-03-18 15:04:24 -07:00
Gabe Lyons
039fe597f7
feat(tags): editing tags from react client on datasets, schemas, charts & dashboards ( #2248 )
2021-03-18 11:52:14 -07:00
John Joyce
c819289b53
feat(react): Adding big query logo ( #2245 )
...
Co-authored-by: John Joyce <john@acryl.io>
2021-03-17 20:34:37 -07:00
Dexter Lee
c362cc4388
feat(tags): Enable search for datasets by tags ( #2240 )
2021-03-15 22:37:06 -07:00
Gabe Lyons
d895202d52
fix(dataflow): fixing browse dao access ( #2237 )
2021-03-15 11:25:32 -07:00
Arun Vasudevan
7750c6120a
feat: MLmodel Graphql Query ( #2166 )
2021-03-13 08:34:48 -08:00
Fredrik Sannholm
da6b3d111d
feat(datajob): Backend implementation ( #2197 )
2021-03-13 08:00:44 -08:00
Gabe Lyons
11e0cd66d4
feat(tag): adding search for tags in gms layer ( #2203 )
2021-03-10 00:02:58 -08:00
Harshal Sheth
d220647094
feat: add date and time types to SQL model ( #2201 )
2021-03-09 23:07:20 -08:00
Thomas Larsson
5d6cf95f39
feat(mae-consumer): enable mae-consumer to use ssl when communicating with elasticsearch ( #2202 )
...
Fixes : #2129
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-03-09 22:42:04 -08:00
Harshal Sheth
c7771a3d71
feat(docs): automatically populate sidebar with RFCs ( #2191 )
2021-03-08 15:39:49 -08:00
Thomas Larsson
7043138797
feat(gms): add elasticsearch SSL support ( #2189 )
...
Co-authored-by: thomas.larsson <thomas.larsson@klarna.com>
2021-03-08 10:38:04 -08:00
Gabe Lyons
adfe60e97a
feat(tags): adding support for read/write of tags in gms & read-only in react datahub-frontend. ( #2164 )
2021-03-07 11:26:47 -08:00
John Joyce
c479191eab
feat(React): Impl browse UI for Dashboards and Charts ( #2167 )
...
Co-authored-by: John Joyce <john@acryl.io>
2021-03-04 23:24:49 -08:00
John Joyce
e575add1fb
feat(DataPlatform Logos): Adding server driven logos ( #2165 )
...
Co-authored-by: John Joyce <john@acryl.io>
2021-03-04 23:16:13 -08:00
Harshal Sheth
e066991f54
fix(ingest): bigquery source and dataset naming fixes ( #2161 )
2021-03-03 19:49:46 -08:00
Rickard Cardell
3252e92a16
feat: neo4j Bolt TLS support ( #2100 ) ( #2145 )
...
* Bumping version of neo4j-java-driver to include encryption support that came in 4.0.1.
2021-03-01 12:55:46 -08:00
Dexter Lee
cda1ce4589
feat(dashboards): Add browse end point for charts and dashboards ( #2143 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-02-28 10:53:02 -08:00
John Joyce
4dcea8c1d3
feat(gms): Add optional data platform display name ( #2148 )
...
Co-authored-by: John Joyce <john@acryl.io>
2021-02-26 21:22:18 -08:00
John Joyce
4f8d8b31ac
feat: Introducing optional DataPlatform logo url ( #2127 )
...
Co-authored-by: John Joyce <john@acryl.io>
2021-02-19 19:51:49 -08:00
