97 Commits

Author SHA1 Message Date
david-leifker
824df5a6a3
feat(build): gradle 8, jdk17, neo4j 5 (#9458) 2023-12-15 13:28:33 -06:00
RyanHolstien
6a16935728
fix(operations): fix get index sizes integer wrap (#9450) 2023-12-15 11:23:04 -06:00
Aseem Bansal
e14474176f
feat(lint): add spotless for java lint (#9373) 2023-12-06 11:02:42 +05:30
david-leifker
f70d8a45b5
chore(security): version adjustments for security vulns (#9243) 2023-11-14 19:00:22 -06:00
david-leifker
279fdd50d7
fix(security): fix for zookeeper CVE-2023-44981 (#9190) 2023-11-06 19:51:20 -06:00
John Joyce
94fa514700
feat(systemMetadata): Adding a lastRunId field system metadata (#8672)
Co-authored-by: Aseem Bansal <asmbansal2@gmail.com>
Co-authored-by: Indy Prentice <iprentic@users.noreply.github.com>
2023-09-06 14:51:03 -03:00
Harshal Sheth
1282e5bf93
feat(systemMetadata): add pipeline names to system metadata (#8684) 2023-08-30 13:19:28 -07:00
Chris Collins
b6141f5fff
feat(java/ui) Add search suggestions to our search experience (#8710) 2023-08-24 18:02:22 -04:00
Chris Collins
a4cb81cc43
fix(java) Use alias for name search sorting and fix missing mappings (#8648) 2023-08-23 19:30:14 -04:00
Indy Prentice
a884cf3f90
feat(elasticsearch): optimization to reindex instead of deleteByQuery (#8352) 2023-07-12 17:12:23 +05:30
skrydal
cfa864e418
feat(auth): Fine grained ownership policies (#7499)
Co-authored-by: davidlacedonia <davidlacedonia@gmail.com>
Co-authored-by: John Joyce <john@acryl.io>
2023-07-03 09:44:22 -07:00
Indy Prentice
6b8c4c83bc
feat(elasticsearch): Add rest.li endpoint that does truncation cleanup of a timeseries index (#8277)
Co-authored-by: Indy Prentice <indy@Indys-MacBook-Pro.local>
Co-authored-by: Indy Prentice <indy@ip-172-16-225-44.us-west-2.compute.internal>
2023-06-28 17:06:51 -05:00
Chris Collins
a36b9ed04f
fix(ingestion) Fixes producing MAE events with browsePathsV2 aspect (#8304) 2023-06-27 14:38:51 +05:30
Indy Prentice
3a0b2ed0e9
feat(elasticsearch): Add endpoint for getting the size of timeseries indices (#8265)
enabling auto-merge as flaky tests succeeded on the first run
2023-06-21 16:47:13 +00:00
Pedro Silva
ea92b86e6a
feat(custom ownership): Adds Custom ownership types as a top level entity (#8045)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-05-26 17:54:09 +01:00
Aseem Bansal
f70cb05d3f
fix(ci): add missing updates to restli-spec (#8106) 2023-05-23 15:08:41 +05:30
Shubham Jagtap
8cc6606e68
feat(ingestion/kafka): add description in dataset properties (#7974)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
Co-authored-by: MohdSiddiqueBagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: mohdsiddique <mohdsiddiquebagwan@gmail.com>
2023-05-17 11:03:08 -07:00
Shirshanka Das
b3c790aab6
feat: Add support for Data Products (#8039)
Co-authored-by: Chris Collins <chriscollins3456@gmail.com>
2023-05-17 07:17:25 +00:00
Andrew Sikowitz
7ba2d13087
refactor(ingest): Make get_workunits() return MetadataWorkUnits (#8051)
- Deprecates UsageAggregationClass, /usageStats?action=batchIngest, UsageStatsWorkUnit
- Removes parsing of UsageAggregationClass in file source, all sinks, and WorkUnitRecordExtractor
2023-05-17 00:01:57 -04:00
John Joyce
73a12379ae
refactor(platform): Refactoring ES Utils, adding EXISTS condition support to Filter Criterion (#7832) 2023-04-20 09:42:07 -07:00
John Joyce
b46822399c
feat(timeseries): Support sorting timeseries aspects by non-timestampMillis field + fix operations resolver (#7840) 2023-04-18 09:10:04 -07:00
david-leifker
72198f98c0
feat(search): searchAcrossEntities/Lineage improvements (#7550)
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2023-03-12 18:18:51 -07:00
RyanHolstien
4e250cbd51
feat(elasticsearch): support searchAfter (#7235) 2023-02-22 19:03:14 -06:00
John Joyce
92cd2b2c1b
fix(lineage): Fix Upstream + Downstream Count in presence of Soft-Deleted / Non-Existent references (#7374) 2023-02-20 14:00:14 -08:00
RyanHolstien
31ee8aacec
fix(search): support searchFlags for GraphQL (#7346)
Co-authored-by: david-leifker <114954101+david-leifker@users.noreply.github.com>
2023-02-16 13:26:21 -06:00
Aditya Radhakrishnan
c13e7e09f8
feat(lineage): add time filtering for lineage edges (#7159) 2023-02-02 15:30:49 -08:00
Dmitry Bryazgin
1a1f2906db
feat(ingest): Add custom properties to the ldap ingestion (#7125)
Co-authored-by: Harshal Sheth <hsheth2@gmail.com>
2023-02-01 16:37:14 -08:00
david-leifker
39920bb00f
feat(elasticsearch): Elasticsearch improvements (#6894) 2023-01-31 18:44:37 -06:00
Chris Collins
f559dcc282
feat(lineage) Adds ability to edit lineage manually from the UI (#6816) 2022-12-20 10:54:08 -05:00
John Joyce
bbcec3b226
refactor(ui): Adding caching for users, groups, and roles (#6673) 2022-12-08 09:23:15 -08:00
John Joyce
d1b12243bb
feat(models): Adding 'created', 'lastModified' timestamp to Dataset, Container, Dashboard, Chart (#6527) 2022-11-28 18:18:34 -08:00
mohdsiddique
fbb1b7271c
feat(ingestion): business-glossary - Add values and relatedTerms support (#6148)
* WIP

* updated snapshot

* merge

* while creating BusinessGlossaryConfig object, the version field always get set to None

* WIP

* lint fix

* remove field

* doc update

* rename the fields

* review comments

* lintFix

* Fix the business glossary example link

* small fixes to examples and docs

* some small tweaks to the model annotations

Co-authored-by: MohdSiddique Bagwan <mohdsiddique.bagwan@gslab.com>
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
Co-authored-by: Gabe Lyons <itsgabelyons@gmail.com>
2022-11-01 15:17:30 -07:00
Chris Collins
cd1331fffe
feat(lineage) Add column-level impact analysis feature (#6272) 2022-10-26 16:43:39 -04:00
Gabe Lyons
228c10de43
fix(adv search): two advanced search fixes (#6252)
* two advanced search fixes

* another approach

* adding unit tests

* fixing checkstyle issue
2022-10-26 11:31:38 -07:00
Gabe Lyons
ce90310dd0
feat(advanced-search): Complete Advanced Search: backend changes & tying UI together (#6068)
* stashing progress

* adding remove option

* more progress

* editing

* further in

* additional rendering improvements

* stashing adv search progress

* stashing more progress

* propagating not filters back to UI

* more frontend progress

* more filters working

* getting ready for data platform selector

* add platform select functionality

* locking out switching btwn advanced and standard filters

* final polish

* remove unneeded code

* added unit and cypress tests

* resolutions after merge

* adding documentation

* cleaning up & refactoring

* removing console.log

* minor ui fix & removing unneeded code

* fixing lineage search

* fixing lints

* fix display of degree

* fixing test

* fixing lint

* responding to comments

* fixing tests

* fix smoke tests

* fixing cypress

* fixing cypress test

* responding to comments
2022-10-04 10:20:04 -07:00
RyanHolstien
bfb903cfb8
feat(ingest): add async option to ingest proposal endpoint (#6097)
* feat(ingest): add async option to ingest proposal endpoint

* small tweak to validate before write to K, also keep existing path for timeseries aspects

* avoid double convert

Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-10-03 19:56:19 -05:00
Aseem Bansal
79575b2815
feat(retention): change default policy, add API to apply retention (#6088) 2022-09-30 16:11:39 +05:30
Ravindra Lanka
386719f15a
feat(platform): timeseries - Server & Client side changes to support timeseries aspect deletion & rollback. (#4756) 2022-09-11 11:27:46 -07:00
Aseem Bansal
b643b34d30
feat(restore-indices): add endpoint for restore indices, add basic check for graph (#5805) 2022-09-02 15:24:40 +05:30
Aditya Radhakrishnan
73cd2f995d
feat(roles): add roles feature to DataHub (#5767) 2022-08-30 18:31:34 -07:00
Gabe Lyons
d9b2a45c5f
feat(looker): index looker charts and dashboards by business term (#5649) 2022-08-24 08:01:56 -07:00
John Joyce
be22455ebb
feat(ui): Adding slack handle to corp group info (#5645) 2022-08-15 14:35:57 -07:00
Gabe Lyons
c41f92c8d0
feat(model): Add optional message field to auditstamp (#5611)
* adding messge to audit stamp

* Update AuditStamp.pdl

* Update AuditStamp.pdl
2022-08-11 13:48:49 -07:00
Mayuri Nehate
2c48329810
feat(model): dashboard usage model, is_null condition added (#5397) 2022-07-15 15:37:06 +05:30
Felix Lüdin
a0303448ba
feat(dashboards): add datasets field to DashboardInfo aspect (#5188)
Co-authored-by: John Joyce <john@acryl.io>
2022-07-14 09:54:02 -07:00
Chris Collins
68fb0d8f06
feat(schema) Show last observed timestamp in the schema tab (#5348) 2022-07-07 12:31:01 -07:00
Gabe Lyons
9e58cd6ff1
fix(Siblings): Have sibling hook use entity client (#5279)
* fixing dbt platform issues

* have sibling hook use entity client over entity service

* switching search service as well

* lint

* more lint

* more specific exceptions
2022-06-29 10:02:45 -07:00
Chris Collins
2841f32b8e
feat(lineage) Update Lineage tab and Impact Analysis feature (#5121) 2022-06-21 07:30:40 -07:00
Dexter Lee
92f81189eb
feat(model): Add optional context field to tag/term association (#5085) 2022-06-06 08:46:32 -07:00
Aseem Bansal
2dd826626d
feat(model): new chart types (#5017) 2022-06-01 18:14:36 +05:30