Dexter Lee
2df9d4fed6
feat: add support for AWS glue schema registry ( #3083 )
2021-08-11 21:40:37 -07:00
John Joyce
8c9c696cdd
feat(ingest): Adding an Okta Integration to extract Users, Groups, Group Membership ( #3043 )
2021-08-11 18:49:16 -07:00
rslanka
8844240328
feat: Adding support for nested schemas in ingestion and visualization ( #3079 )
2021-08-11 15:47:18 -07:00
Gabe Lyons
a06c4caf4b
chore: upgrading gma to 0.2.80 ( #3070 )
2021-08-10 13:29:11 -07:00
John Joyce
383bde18f5
chore(frontend): Remove unused files 1/4 ( #3014 )
2021-08-09 09:48:05 -07:00
John Joyce
7cb49aaddc
docs: Add Exact match search CURL example. ( #3053 )
2021-08-06 11:26:44 -07:00
John Joyce
916b374a0e
docs: Add tags GMS API documentation ( #3052 )
2021-08-06 10:16:34 -07:00
John Joyce
b1b55e19fe
fix(frontend): Fix exception casting in EntityClient ( #3036 )
2021-08-05 20:07:13 -07:00
John Joyce
4649ca7f39
fix(gms): Validate unrecognized model fields. ( #3034 )
2021-08-04 22:23:16 -07:00
Gabe Lyons
8c4a1414fc
fix(gms): handling partial system metadata in gms ( #3030 )
2021-08-04 12:26:29 -07:00
John Joyce
2aae2fd601
fix(gms): Adding Rest.li Write-Time Model Validation ( #2999 )
2021-08-03 09:54:13 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect ( #2983 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
Dexter Lee
15c0c4dfb3
fix(browse): Fix browse pagination and multi-browse path issue ( #2984 )
2021-07-30 10:48:32 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest ( #2960 )
2021-07-29 20:04:40 -07:00
Gabe Lyons
d9d03c9bd9
feat(ml-model): adding ml models and ml model groups ( #2961 )
2021-07-28 20:39:05 -07:00
Dexter Lee
e2d1acae9d
fix(elasticsearch-setup): fix elasticsearch setup for aws ( #2974 )
2021-07-28 13:55:15 -07:00
Kevin Hu
43e61d9628
feat(models): remove versions from metrics and hyperparams ( #2938 )
2021-07-22 22:18:45 -07:00
Kevin Hu
6dbc59940a
feat(ingest): refactor mlModel grouping and add browsepaths ( #2929 )
2021-07-22 13:33:15 -07:00
Kevin Hu
736249f0c7
feat(ingest): extract SageMaker metrics, hyperparameters, and external URLs ( #2910 )
2021-07-21 21:30:07 -07:00
Kevin Hu
6abd5e191a
feat(ingest): lineage for SageMaker model endpoints and groups ( #2894 )
2021-07-19 11:30:43 -07:00
Lal Rishav
ae014bf2e1
fix(glossary):default browse path for glossary term ( #2788 )
2021-07-16 09:15:24 -07:00
Kevin Hu
44ed2f3684
feat(ingest): extract lineage between SageMaker jobs and models ( #2868 )
2021-07-15 18:56:13 -07:00
Kevin Hu
a2106ca9e8
feat(ingest): SageMaker jobs and models ( #2830 )
2021-07-08 16:16:16 -07:00
Dexter Lee
acb638cb65
fix(analytics): Fix SSL issue with analytics on frontend ( #2840 )
2021-07-08 15:11:40 -07:00
Harshal Sheth
2f921d15e8
fix(ingest): avoid setting timestamps unless source system provides it ( #2843 )
2021-07-08 12:11:06 -07:00
Dexter Lee
8f0f322279
feat(backup): Add restore indices and restore backup tasks ( #2779 )
2021-06-30 16:49:02 -07:00
Kevin Hu
4da76726d3
feat(ingest): SageMaker feature store ingestion ( #2758 )
2021-06-29 19:43:31 -07:00
Kevin Hu
7083de9b4f
fix(ingest): use correct platform for MongoDB ingestion ( #2783 )
2021-06-29 10:16:58 -07:00
John Joyce
942196e3c1
feat(logs): add thresholding, misc cleanup ( #2773 )
2021-06-25 11:51:59 -07:00
John Joyce
09cbc548a4
feat(logs): improve logging in GMS and datahub-frontend ( #2761 )
2021-06-25 10:56:45 -07:00
Dexter Lee
3caa09d21a
fix(docker): Fix dependency vulnerability ( #2763 )
2021-06-24 23:00:55 -07:00
Harshal Sheth
19b2a42a00
feat: usage stats (part 2) ( #2762 )
...
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-06-24 19:44:59 -07:00
Harshal Sheth
937f02c6bc
feat: usage stats (part 1) ( #2750 )
...
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-06-24 17:11:00 -07:00
Gabe Lyons
938dbc8871
Revert "fix(gms): add rest.li validation in gms ( #2745 )" ( #2754 )
...
This reverts commit f0b4adc0e498ad5e549221494334befc1964b1dc.
2021-06-23 23:27:47 -07:00
John Joyce
7615ddbf2b
fix(gms): make get return entity type ( #2739 )
2021-06-23 16:20:04 -07:00
John Joyce
f0b4adc0e4
fix(gms): add rest.li validation in gms ( #2745 )
2021-06-23 13:48:11 -07:00
Gabe Lyons
3f5e371851
feat(graph): support using elasticsearch as graph backend. ( #2726 )
2021-06-22 16:08:54 -07:00
Kevin Hu
a89094da5b
feat(ingest): add support for Glue ETL jobs ( #2687 )
2021-06-22 11:33:22 -07:00
John Joyce
550a9deab0
fix(noCode): Improving efficiency of EntityService "listLatestAspects" API ( #2711 )
2021-06-17 19:52:50 -07:00
Gabe Lyons
0750332714
fix(editable descriptions): adding indexing for editable descriptions ( #2710 )
2021-06-17 10:55:26 -07:00
Harshal Sheth
26dcece8ec
fix(ingest): use looker data platform ( #2708 )
2021-06-16 16:58:13 -07:00
Brian
a5f9b8dfe9
feat(entities): add markdown description update/viewer feature in dataset, datajob, dataflow, chart and dashboard, update ui/ux ( #2707 )
2021-06-16 15:48:27 -07:00
Gabe Lyons
523c3bf1d4
feat(aspects): support fetching of versioned aspects ( #2677 )
2021-06-16 10:03:21 -07:00
John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS ( #2690 )
2021-06-15 08:44:15 -07:00
Rickard Cardell
2cb06188ce
Fix 2592 neo4j connection options ( #2632 )
2021-06-11 09:55:30 -07:00
Kevin Hu
ebdaa0e359
feat(ingest): Feast ingestion integration ( #2605 )
...
* Add feast testing setup
* Init Feast test script
* Add feast to dependencies
* Update feast descriptors
* Sort integrations
* Working feast pytest
* Clean up feast docker-compose file
* Expand Feast tests
* Setup feast classes
* Add continuous and bytes data to feature types
* Update field type mapping
* Add PDLs
* Add MLFeatureSetUrn.java
* Comment out feast setup
* Add snapshot file and update inits
* Init Feast golden files generation
* Clean up Feast ingest
* Feast testing comments
* Yield Feature snapshots
* Fix Feature URN naming
* Update feast MCE
* Update Feature URN prefix
* Add MLEntity
* Update golden files with entities
* Specify feast sources
* Add feast source configs
* Working feast docker ingestion
* List entities and features before adding tables
* Add featureset names
* Remove unused
* Rename feast image
* Update README
* Add env to feast URNs
* Fix URN naming
* Remove redundant URN names
* Fix enum backcompatibility
* Move feast testing to docker
* Move URN generators to mce_builder
* Add source for features
* Switch TypeClass -> enum_type
* Rename source -> sourceDataset
* Add local Feast ingest image builds
* Rename Entity -> MLPrimaryKey
* Restore features and keys for each featureset
* Do not json encode source configs
* Remove old source properties from feature sets
* Regenerate golden file
* Fix race condition with Feast tests
* Exclude unknown source
* Update feature datatype enum
* Update README and fix typos
* Fix Entity typo
* Fix path to local docker image
* Specify feast config and version
* Fix feast env variables
* PR fixes
* Refactor feast ingest constants
* Make feature sources optional for back-compatibility
* Remove unused GCP files
* adding docker publish workflow
* Simplify name+namespace in PrimaryKeys
* adding docker publish workflow
* debug
* final attempt
* final final attempt
* final final final commit
* Switch to published ingestion image
* Update name and namespace in java files
* Rename FeatureSet -> FeatureTable
* Regenerate codegen
* Fix initial generation errors
* Update snapshot jsons
* Regenerated schemas
* Fix URN formats
* Revise builds
* Clean up feast URN builders
* Fix naming typos
* Fix Feature Set -> Feature Table
* Fix comments
* PR fixes
* All you need is Urn
* Regenerate snapshots and update validation
* Add UNKNOWN data type
* URNs for source types
* Add note on docker requirement
* Fix typo
* Reorder aspect unions
* Refactor feast ingest functions
* Update snapshot jsons
* Rebuild
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-09 15:07:04 -07:00
Dexter Lee
9c030d8325
fix(NoCode): Update snapshot json to latest ( #2655 )
2021-06-07 11:52:52 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling ( #2629 )
...
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
Brian
aa8ba1b8e9
feat(dataflow): update dataflow to have datajobs in new tab ( #2579 )
2021-05-18 21:25:42 -07:00
Dexter Lee
b4cf74bcb4
fix(analytics): add support for AWS ES ( #2539 )
2021-05-12 10:54:18 -07:00
