David Haglund
cd6a712896
fix(doc): Change to forward slash-separated strings, as in the example ( #4528 )
2022-03-30 09:10:23 -07:00
John Joyce
c69310522b
feat(metadata service): Introducing Platform Events ( #4477 )
2022-03-29 18:32:04 -07:00
Dexter Lee
df69e76289
feat(policy): Add domain based and view based policies ( #4516 )
...
* Add domain based policy and view based policy
* Add new files
* Fix issue
* Fix comment on markdown
* Fix to John's comments
* Update policies.md
* Remove comments
* Fix to John's comments
* Fix policy details page
* Add back notebook privileges
* Fix graphql
Co-authored-by: John Joyce <john@acryl.io>
2022-03-29 12:02:22 -07:00
Kevin Neville
d8e6f890a9
fix: Replace old repository link with new link ( #4446 )
2022-03-18 14:12:19 -07:00
Pedro Silva
e8f6c4cabd
feat(cli) Changes rollback behaviour to apply soft deletes by default ( #4358 )
...
* Changes rollback behaviour to apply soft deletes by default
Summary:
Addresses feature request: Flag in delete command to only delete aspects touched by an ingestion run; add flag to nuke everything by modifying the default behaviour of a rollback operation which will not by default delete an entity if a keyAspect is being rolled-back.
Instead the key aspect is kept and a StatusAspect is upserted with removed=true, effectively making a soft delete.
Another PR will follow to perform garbage collection on these soft deleted entities.
To keep old behaviour, a new parameter to the cli ingest rollback endpoint: --hard-delete was added.
* Adds restli specs
* Fixes deleteAspect endpoint & adds support for nested transactions
* Enable regression test & fix docker-compose for local development
* Add generated quickstart
* Fix quickstart generation script
* Adds missing var env to docker-compose-without-neo4j
* Sets status removed=true when ingesting resources
* Adds soft deletes for ElasticSearch + soft delete flags across ingestion sub-commands
* Makes elastic search consistent
* Update tests with new behaviour
* apply review comments
* apply review comment
* Forces Elastic search to add documents with status removed false when ingesting
* Reset gradle properties to default
* Fix tests
2022-03-15 12:05:52 -07:00
Dexter Lee
ab0b5162af
fix(lineage): Move lineage registry to entity-registry module ( #4412 )
...
* Move lineage registry
* Fix test
2022-03-15 11:59:59 -07:00
Dexter Lee
a12c9d2a30
Add flag to enable cache ( #4335 )
2022-03-14 16:40:10 -07:00
John Joyce
a453ebf02d
feat(autocomplete): Show recent searches + improved autocomplete ( #4400 )
2022-03-14 14:07:49 -07:00
John Joyce
ecd263b0d2
feat(*): Support setting owner type when assigning ownership ( #4354 )
2022-03-14 11:14:32 -07:00
Aseem Bansal
4bcc2b3d12
feat(ingestion): improve logging, docs for bigquery, snowflake, redshift ( #4344 )
2022-03-14 08:50:29 -07:00
Dexter Lee
fab9c23aa5
fix(removed): Make sure removed entities do not appear on recommendations ( #4353 )
2022-03-10 18:45:08 -08:00
John Joyce
870407b8f9
fix(ui): Supporting unknown data platform type ( #4361 )
2022-03-09 20:06:02 -08:00
Dexter Lee
18dd5b6c13
feat(Impact Analysis): Support impact analysis to check all downstreams of given entity ( #4322 )
2022-03-04 16:10:25 -08:00
John Joyce
902929293d
fix(ui) Misc UI fixes & styling improvements. ( #4311 )
2022-03-04 12:19:37 -08:00
mayurinehate
92b0e1c7c7
feat(tableau): emit workbook as container entity in tableau source, some minor fixes in tableau source ( #4261 )
2022-03-04 11:52:04 -08:00
John Joyce
9f1c5a8f75
feat(assertions): Adding Assertions Entity & Great Expectations BETA ( #4305 )
2022-03-04 11:51:31 -08:00
Aseem Bansal
9a9a5c3084
fix: revert changes to OpenApi casing ( #4291 )
2022-03-04 10:35:44 -08:00
John Joyce
e64e71ee72
docs(readmes): Update module READMEs to reflect the current state of the world ( #4294 )
2022-03-03 14:20:35 -08:00
Sergio Gómez Villamor
a2a939d406
feat(model): adds PRE in the FabricType enum ( #4226 )
2022-03-01 16:45:41 -08:00
mohdsiddique
e2f8db7926
feat: powerbi - add new source ( #4201 )
2022-02-28 17:37:22 -08:00
Aseem Bansal
ec86e71edc
chore(managed ingestion): add variables for default val, update vals ( #4186 )
2022-02-25 16:33:59 -08:00
Ravindra Lanka
1ac20ee764
feat(platform): add timeline api for dataset entity ( #4252 )
2022-02-24 19:40:55 -08:00
HuYueeer
3a0fe44344
feat(search): supporting chinese glossaryterm full text retrieval( #3914 ) ( #3956 )
...
* feat(search): supporting chinese glossaryterm full text retrieval(#3914 )
* refactor(search): modify mainTokenizer to appropriate position(#3914 )
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-24 17:11:43 -08:00
Ravindra Lanka
232f7c5b21
feat(model): Column level lineage model ( #4248 )
...
co-authored-by: ksrinath <k.srinath@gmail.com>
2022-02-24 14:36:19 -08:00
Alexander Chashnikov
c2065bd7fe
feat(ingest): clickhouse - add initial support ( #4057 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-02-21 07:36:08 -08:00
Dexter Lee
db8c215c0b
feat(analytics): Improve analytics page by adding more charts regarding metadata ingested ( #4176 )
2022-02-18 09:38:17 -08:00
John Joyce
93befda8cf
feat(groups): Adding editable group properties in the backend ( #4166 )
2022-02-17 22:47:59 -08:00
RyanHolstien
dc40998d62
bugfix(logging): reduce log noise from authentication chain ( #4173 )
2022-02-17 15:26:09 -08:00
RyanHolstien
f37bdad78e
bug(seedData): adds a key to the root user seed data and fixes corner case check for missing key aspects ( #4162 )
...
Co-authored-by: Ryan Holstien <ryan@acryl.io>
2022-02-16 14:23:20 -08:00
Amanda Ng
d17f2bf014
feat(ui): Host platform images on datahub-web-react ( #4118 )
...
* feat(react-images): host platform images on datahub-web-react
* feat(react-images): update data_platforms logoUrl
* feat(react-images): add explanation for CopyWebpackPlugin
Co-authored-by: Amanda Ng <amanda.ng@grabtaxi.com>
2022-02-16 11:28:06 -08:00
Aseem Bansal
68c840824f
chore(cli): update default cli version pinned in the UI based ingestion ( #4150 )
2022-02-15 14:43:18 -08:00
RyanHolstien
a251d589ed
Feature/oss/update to v2 endpoints ( #4128 )
2022-02-15 14:37:05 -08:00
Dexter Lee
ae6f5a8dfa
Fix logging ( #4136 )
2022-02-14 13:52:21 -08:00
John Joyce
f2f5443d04
feat(Tags/Terms): Backend support for tag & term mutations ( #4096 )
2022-02-11 07:00:46 -08:00
John Joyce
0f56bc5d48
Adding extra properties to corp user editable info ( #4097 )
2022-02-09 08:58:40 -08:00
Dexter Lee
beab5ac977
fix(analytics): fix NPE in aggregate api ( #4095 )
2022-02-08 23:23:18 -08:00
John Joyce
8002fd8eb6
feat(deprecation): Entity Deprecation Backend ( #4073 )
2022-02-08 15:28:32 -08:00
John Joyce
2a9a076fc1
feat(ingest): Adding Tableau Source Connector [BETA] ( #4063 )
2022-02-08 14:26:44 -08:00
Dexter Lee
0e5811fd68
fix(mae-consumer-docker): Fix condition for skipping elasticsearch check ( #4052 )
2022-02-03 18:58:04 -08:00
Gabe Lyons
94b6cb9ae9
feat(users): adding user graphql mutation ( #4033 )
2022-02-02 16:46:10 -08:00
John Joyce
7fef9a514a
feat(containers): Backend for Asset Containers (as demo'd in townhall) ( #4019 )
2022-02-01 11:07:34 -08:00
Lal Rishav
ff367c0410
feat(ui): business glossary - add tabular schema and move to new UI components ( #3813 )
2022-01-31 11:21:06 -08:00
Aditya Radhakrishnan
b5ff558f03
feat(model) - Update FabricType enum to represent more fabrics ( #3997 )
...
Co-authored-by: Shirshanka Das <shirshanka@apache.org>
2022-01-30 18:19:03 -06:00
Swaroop Jagadish
9a9f448ebf
feat(ingest): platform-instance - changes to support platform instances in sources ( #3996 )
2022-01-27 15:31:25 -08:00
John Joyce
282851eeed
feat(domains): Adding backend for Asset Domains (p1) ( #3952 )
2022-01-27 13:07:11 -08:00
John Joyce
35ebca77ee
quickstart: Adding UI ingestion to quickstart YAML ( #3994 )
2022-01-27 10:47:11 -08:00
John Joyce
271784c9c1
feat(ui): UI-based ingestion (as featured in Dec Townhall) ( #3975 )
2022-01-27 10:33:12 -08:00
Swaroop Jagadish
a491407074
feat(platform): elasticsearch - change default bulk index request batch to 1000 ( #3957 )
2022-01-24 00:10:16 -08:00
Gabe Lyons
bd38923224
feat(platform): auth - propagate expired token exceptions to end user ( #3894 )
2022-01-17 15:37:52 -08:00
senni0418
80c46f24ac
refactor(search): refactor NUM_RETRIES in esindexbuilder to be configurable ( #3870 )
2022-01-17 15:35:59 -08:00
