92 Commits

Author SHA1 Message Date
Arun Vasudevan
9d1de5fbf6
feat(platform): add AWS MSK iam Auth Jar to platform components (#3872) 2022-01-12 21:49:34 -08:00
Dexter Lee
2b54475c16
feat(api): Add git-based server version to the UI and config endpoint (#3866)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-11 15:00:57 -08:00
RyanHolstien
34c27f076b
feat(removeGMA): remove all dependencies on gma libraries (#3835) 2022-01-05 17:32:31 -08:00
Dexter Lee
9d04aa1255
feat(mae/mcl): Make ingestAspect produce both MCLs and MAEs (#3737) 2022-01-04 18:24:30 -08:00
Ravindra Lanka
4b81ad6262
feat(Stateful Ingestion): 1/3 Stateful ingestion server changes (#3749) 2021-12-15 10:32:58 -08:00
Aseem Bansal
a4ac79db48
feat(perf-test): changes for perf testing (#3728) 2021-12-13 23:07:57 -08:00
John Joyce
3bac7f7c43
fix(deletes): Fixing system metadata index deletes (#3693) 2021-12-08 14:03:24 -08:00
Dexter Lee
4a672c2dc5
fix(kafka): Add back changes to centralize kafka config (#3675) 2021-12-06 22:31:48 -08:00
Dexter Lee
999e9e5b49
fix(search): Improve search and recs performance (#3660) 2021-12-03 18:13:11 -08:00
Shirshanka Das
842c05980b
feat(metadata-service): support for custom model extensions without forks (#3630) 2021-11-28 21:06:27 -08:00
John Joyce
5886e63e5c
doc(components): Adding DataHub components overview (#3606) 2021-11-24 12:41:07 -08:00
John Joyce
f49666a230
feat(auth): Metadata Service Authentication! (#3598) 2021-11-22 16:33:14 -08:00
Dexter Lee
09f3b812f3
Revert "feat(git-version): Encode the latest release included in the build (#3535)" (#3539)
This reverts commit e01be7bb3d760c03883c9f18700b99b82375bb6f.
2021-11-09 11:07:13 -08:00
Dexter Lee
e01be7bb3d
feat(git-version): Encode the latest release included in the build (#3535) 2021-11-09 08:56:27 -08:00
Gabe Lyons
b87efa43b5
feat(deletes): support deletion of non-snapshot aspects (#3518)
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-11-08 16:22:24 -08:00
John Joyce
a92ab66a3a
refactor(nocode): Final part of No-Code cleanup (#3477) 2021-10-31 22:06:36 -07:00
John Joyce
2f03ad854b
feat(recommendations): Recommendations infra P1 (#3455) 2021-10-26 21:23:08 -07:00
Gabe Lyons
a74ce1961d
fix(deletes): ensure hard deletion removes lineage (#3423) 2021-10-19 22:10:07 -07:00
John Joyce
8ef273423c
feat(metadata-service): Introducing EntityClient interface to avoid unnecessary HTTP calls. (#3421) 2021-10-19 15:53:48 -07:00
Gabe Lyons
377c501735
fix(graph service): fix case where certain mcps can incorrectly delete graph edges (#3418) 2021-10-18 22:52:10 -07:00
John Joyce
61bd7fd080
feat(search): support Boolean OR Filters in Rest.li APIs (#3344) 2021-10-14 12:34:29 -07:00
John Joyce
ed01b59a00
feat(users & groups): User & Groups Management GraphQL APIs + UI (#3318) 2021-10-07 16:14:35 -07:00
Dexter Lee
d0548408b4
feat(search): redesign search page - left filter pane (#3337) 2021-10-07 11:41:29 -07:00
Enrico Minack
0a25d7acea
refactor(dao/utils): Move general createRelationshipFilter from Neo4jUtil to QueryUtils (#3010) 2021-09-16 17:13:01 -07:00
rslanka
c418bc845c
feat(Analytics): Support for Timeseries Aggregated Statistics (#3207)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-09-14 18:35:10 -07:00
Dexter Lee
8747fbe43c
feat(perf): Add perf testing and monitoring framework (#3195) 2021-09-07 23:06:15 -07:00
John Joyce
ccb09a6966
feat(access control): Fine-Grained Access Control M1 (#3182) 2021-09-02 19:05:13 -07:00
Dexter Lee
a6402f685c
fix(kafka): Change consumer id of mae/mce processor (#3135) 2021-08-21 13:36:30 -07:00
John Joyce
2c5edd88ab
feat(graphql): migrating GraphQL API to metadata-service (nee GMS) (#3131) 2021-08-20 10:58:07 -07:00
John Joyce
798e57bc24
refactor: remove unused gms code, frontend endpoints part 2/4 (#3015)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Dexter Lee <dexter@acryl.io>
2021-08-17 13:57:01 -07:00
Dexter Lee
872215dc7d
fix(upgrade): Fix MAE consumer and upgrade's dependency issue (#3096) 2021-08-13 10:12:57 -07:00
Dexter Lee
2df9d4fed6
feat: add support for AWS glue schema registry (#3083) 2021-08-11 21:40:37 -07:00
John Joyce
383bde18f5
chore(frontend): Remove unused files 1/4 (#3014) 2021-08-09 09:48:05 -07:00
John Joyce
352a0abf8d
Introducing TimeSeries Aspects + Dataset Profile (Stats) Aspect (#2983)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: Ravindra Lanka <rlanka@acryl.io>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-07-30 17:41:03 -07:00
Gabe Lyons
aa253f5b3b
feat(deletes): add run commands (list, show, rollback) to datahub ingest (#2960) 2021-07-29 20:04:40 -07:00
Dexter Lee
8df8ff96bc
fix(usage-stats): Add usage stats factory to mae processor config (#2803) 2021-06-29 23:03:31 -07:00
John Joyce
09cbc548a4
feat(logs): improve logging in GMS and datahub-frontend (#2761) 2021-06-25 10:56:45 -07:00
Harshal Sheth
937f02c6bc
feat: usage stats (part 1) (#2750)
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-06-24 17:11:00 -07:00
Gabe Lyons
3f5e371851
feat(graph): support using elasticsearch as graph backend. (#2726) 2021-06-22 16:08:54 -07:00
Dexter Lee
f3f562fe08
fix(NoCode): Fix product analytics (#2697) 2021-06-15 09:42:16 -07:00
John Joyce
cc95916201
feat(gms): Merge MAE, MCE consumers into GMS (#2690) 2021-06-15 08:44:15 -07:00
John Joyce
97e9660037
feat: No Code Metadata Modeling (#2629)
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2021-06-03 13:24:33 -07:00
G-nther
634dde5cfb
fix(analytics): use seperate env variable for tracking topic in MAE-Consumer (#2545) 2021-05-12 17:53:40 -07:00
John Joyce
29832e5385
feat(Product Analytics): Introducing In-App Analytics Beta (#2499)
Co-authored-by: Harshal Sheth <harshal@acryl.io>
Co-authored-by: Dexter Lee <dexter@acryl.io>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2021-05-11 15:41:42 -07:00
shakti-garg
8ed14a62e2
feat(business_glossary): add new entity business term and its relationship with dataset and its fields (#2228)
Co-authored-by: shubham.garg <shubham.garg@thoughtworks.com>
2021-05-10 13:20:23 -07:00
Fredrik Sannholm
e88a671959
Fix(search): fix datajob and dataflow search mappings (#2418) 2021-04-21 12:04:20 -07:00
Dexter Lee
1fc532d831
feat(index): Add index naming convention for elasticsearch (#2386) 2021-04-13 07:56:31 -07:00
shakti-garg
15ed5bb067
feat(kafka-config): add variable KAFKA_CONSUMER_GROUP_ID to override group id value for kafka consumer (#2297) 2021-03-27 20:24:36 -07:00
John Plaisted
5e91014e00
feat(search) BREAKING Support ElasticSearch 7, drop ES5 (#2263)
Merges in changes from our ES7 branch, and drops support for ES5.

This is a breaking change due to the upgrade, we have a ES5 branch at the commit before this.
2021-03-18 19:16:44 -07:00
Dexter Lee
8d731b577e
fix(docker): start issue when there are multiple kafka brokers in bootstrap config (#2231) 2021-03-12 11:26:49 -08:00