874 Commits

Author SHA1 Message Date
Vivek Ratnavel Subramanian
e6343a79d7
Fix #2555: PUT APIs should only allow admin and owners to update a resource in secure env (#2608) 2022-02-04 12:39:08 -08:00
Sriharsha Chintalapani
09476bf4b1
Fix #2189: 'Matches' doesn't show up for every search results (#2605) 2022-02-03 20:08:48 -08:00
Sriharsha Chintalapani
be975848c6
Fix #2202: search give no results for pipelines (#2606) 2022-02-03 20:08:36 -08:00
Sriharsha Chintalapani
a0d40eb65e
Fix #2069: Not all tag filters displayed (#2607) 2022-02-03 20:08:25 -08:00
Vivek Ratnavel Subramanian
07ac87b5c2
Fix #2434: All services must have owner (#2520) 2022-02-02 10:11:12 -08:00
Vivek Ratnavel Subramanian
53d70975c4
Fix #2507: Getting 401 unauthorised error for retrieve permissions API (#2526) 2022-02-01 13:25:09 -08:00
Pere Miquel Brull
b82854c56e
Fix #2479 - Check migration at server start (#2489)
* Validate migrations on start

* Output to logs

* Validate Flyway Migrations at Catalog start

* Add flyway validation test config

* Sonarcloud try stream

* Revert migration validation
2022-02-01 08:31:34 +01:00
Robert Pack
67a1c23482
Fix #2348: Harmonize request titles in json schemas 2022-01-31 16:29:56 -08:00
Matt
324a8a8d99
Add GET API for allowable operations (#2494)
- Amend PolicyEvaluator to support getAllowedOperations()
- Set up REST API for v1/config/permissions
- Integrate the above with DefaultAuthorizer
2022-01-30 12:53:17 -08:00
Matt
9fdda91f12
Fix description for User.NationalId tag (#2497) 2022-01-30 06:45:29 -08:00
Alberto Miorin
0169e51ea8
Update CatalogGenericExceptionMapper.java (#2313) 2022-01-28 18:46:08 +01:00
Vivek Ratnavel Subramanian
52ec2e3ad1
Fix #2478: Update the auth header to Authorization Bearer for JWT token (#2483)
* Fix #2478: Update the auth header to Authorization Bearer for JWT token
2022-01-27 23:58:54 -08:00
Suresh Srinivas
2c6f6cb908
Fixes #2484 Move some of the repeated POST tests to base test class (#2485) 2022-01-27 20:34:46 -08:00
Suresh Srinivas
10a94b265c
Fixes #2480 - Clean up create methods in entity resources tests (#2481) 2022-01-27 16:29:43 -08:00
Vivek Ratnavel Subramanian
aaf1dbede1
Fix #2464: PipelineRepository throws NPE when description is updated (#2465)
* Fix #2464: PipelineRepository throws NPE when description is updated
2022-01-26 21:45:31 -08:00
Sriharsha Chintalapani
c529465c60
Issue #2466: Slack: support description change events at column level (#2467) 2022-01-26 21:11:15 -08:00
Akash Jain
20309cde64
fix:cherry pick from 0.8.0 and miscellaneous fixes (#2445)
* updating ingestion-core version to 0.8.0

* updating ingestion version to 0.8.0

* fixing file copy path

* update docker images to point to 0.8.0

* set up new release version

* reset ingestion version to 0.9.0.dev0

* reset ingestion-core version to 0.9.0
2022-01-26 14:00:27 +05:30
Sriharsha Chintalapani
76f1db95b9
Fix #2439: Slack Event publisher do not throw errors when an event unpublished , fix bug for entity created events (#2440) 2022-01-25 20:47:40 -08:00
Vivek Ratnavel Subramanian
b18762cfc6
Fix #1941: Pipeline tasks description is not getting updated (#2431)
* Fix #1941: Pipeline tasks description is not getting updated
2022-01-25 18:56:37 -08:00
Pere Miquel Brull
548a82aa22
[issue-2384] - Entity version return body (#2428) 2022-01-25 11:18:24 -08:00
parthp2107
3988d63ea5
updated json schema documentation (#2401) 2022-01-25 08:49:15 -08:00
Alberto Miorin
4aa8f9b8e2
Fix #2414: AirflowPipeline is storing the service in the entity_relationship and in the json column of airflow_pipeline_entity (#2415) 2022-01-25 11:56:32 +01:00
Matt
c092b03171
Add RBAC for UpdateLineage MetadataOperation (#2406) 2022-01-25 02:11:37 -08:00
Sriharsha Chintalapani
b47f49e418
Fix #2403: Add support for deleted entities to be published into Slack Events (#2404)
* Fix #2403: Add support for deleted entities to be published into Slack Events

* Fix #2403: Add support for deleted entities to be published into Slack Events
2022-01-25 14:39:12 +05:30
Vivek Ratnavel Subramanian
47b9afa8c4
Fix #1877: Editing services description does not save (#2397)
* Fix #1877: Editing services description does not save
2022-01-25 00:15:59 -08:00
Alberto Miorin
7a6e9a8060
Fix #2377: Need versions support for deleted entities (#2380) 2022-01-24 19:26:32 +05:30
Sriharsha Chintalapani
429735f503
Fix #2368: Support soft deleted entities update in ElasticSearch (#2369) 2022-01-23 23:03:30 -08:00
Suresh Srinivas
8bb50d1a24
Fixes #2364 Use terms entityType and entityName consistently (#2365) 2022-01-23 15:23:19 -08:00
Suresh Srinivas
eeecde3524
Fixes #2361 - Move DELETE related and DELETE + PUT tests to common class (#2362) 2022-01-23 11:48:53 -08:00
Suresh Srinivas
6e7cf40a33
Fixes #1142 - Add entityDeleted event for DELETE APIs (#2360) 2022-01-23 10:39:47 -08:00
parthp2107
a784bc217d
added periods to json schema descriptions (#2334) 2022-01-22 22:25:15 -08:00
Sriharsha Chintalapani
e5fdf77d8e
Fix #2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353: Add API to AirflowPipelines filter based on service (#2357)
* Fix #2340: Ingestion pipeline deployment refactor - update ingestion

* Fix #2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353: Add API to AirflowPipelines filter based on service

* Fix #2355: Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353: Add API to AirflowPipelines filter based on service
2022-01-22 21:12:25 -08:00
Matt
8e5a9c1f0e
Set Access Control Rule default priority to 25000 (#2346) 2022-01-22 02:14:56 -08:00
Matt
319fde9207
Throw error if multiple rules within policy have same operation (#2344) 2022-01-22 01:09:51 -08:00
Sriharsha Chintalapani
10e71a7e09
Fix #2340: Ingestion pipeline deployment refactor (#2341)
* Fix #2340: Ingestion pipeline deployment refactor
2022-01-21 22:06:14 -08:00
Matt
845b62d48d
Add Access Control Policy for DataConsumer role (#2328) 2022-01-21 00:26:06 -08:00
Matt
2a80caa8fe
Add logic to initialize relationships from seed data during application startup (#2307)
* Add logic to initialize relationships from seed data during application startup

* Remove ingestion related code for access control policies

* Move PolicyEvaluator init to PolicyResource
2022-01-20 22:18:03 -08:00
Sriharsha Chintalapani
7312aff270 Fix #2320: Fix DB migration scripts to upgrade to 0.8 from 0.7 2022-01-20 15:08:03 -08:00
Alberto Miorin
b6fee6cb1c
Fix #2209: Path error: bootstrap_storage.sh not able to find main class (#2319) 2022-01-20 21:28:26 +01:00
Matt
065d051dc1
GET /v1/roles?:roleId?fields=users should return users (#2308) 2022-01-20 08:10:10 -08:00
Matt
89d029355d
Associate Policy with Role (#2257)
* Associate Policy with Role

- When a new Role is created, automatically create an Access Control Policy with empty set of Rules
- Create  relationship: Policy --applied_to--> Role
- Modify RoleResource REST APIs to return policy

* Attempt fix
2022-01-20 00:46:01 -08:00
Shreshtha Misra
97c6ae9272
Fix issue #2037- Use lombok Slf4j annotation to initialize logger (#2282)
* Fix #2037-add lombok
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-01-19 12:36:48 -08:00
Matt
f70755f0cc
Make PolicyEvaluator a Singleton (#2281)
- Make PolicyEvaluator a Singleton
- Add functionality to refreshRules when new Access Control Policy is stored
- Remove poor-Matt's time based synchronization logic from DefaultAuthorizer and EntityResourceTest
- Delete old PolicyEvaluatorTest, since it is redundant with existing *ResourceTest
2022-01-19 08:49:01 -08:00
Alberto Miorin
26405e27f5
Fix #2220: 2nd follow-up PR: Support for getting deleted entities in GET and LIST operations (#2221)
* Remove addAllRelationships, rename addAllRelationshipsAfterCreation to beforeDeletion, tests owns in User and Team, test location in Table.

* Add an entity to the team of the User deleted

* Add decorator to Entity to simplify the code. Add more tests to Table.

* Add methods about owner to the decorator.

* Fix getTable creating a EntityReference without type. Migrate authorization to decorator, migrate prepare to the decorator. Remove `populate*` methods. Migrate getOwner to the decorator.

* 1st commit to get rid of the multiple getService that were incompatible with Include.

* 2nd commit

* 3rd commit

* 4th commit. All getService are using the decorator.

* Remove all getService of EntityUtil.

* Get rid of Entity.getEntityInterface that was clashing with <T> Entity.getEntityInterface

* Replace the import star.

* Rename parameter entity to field.

* Improve the log of get[Relationship] and remove dead code.

* Better documentation for EntityHandler.

* Merge `h` and `r` and rename it to `helper`

* Make snekeythrows more precise.
2022-01-19 07:53:19 +01:00
Sriharsha Chintalapani
0d3ded0742
Data Profiler Integration (#2235)
* Fix 2234: Data profiler integration
2022-01-18 20:25:43 -08:00
Pere Miquel Brull
a9c840778a
[issue-2116] - Add target property to MlModel (#2134)
* Add target property to MlModel

* Use pull_request_target for forks

* Simplify str

* Update ingestion-core setup

* Bump ingestion-core version

* Update install
2022-01-18 16:27:35 +01:00
Matt
7181141803
Initialize roles and policies with seed data (#2236)
- Set up initial roles and policies seed data
- Extend EntityRepository to support initSeedData()
2022-01-17 00:31:12 -08:00
Matt
276128e8b0
Add MetadataOperations RBAC support for PATCH APIs (#2128)
* Add RBAC for PATCH APIs

* Expand scope to all resources except a few (Policy, User, Role, Team, resources that doesn't support PATCH)

* Fix code smells
2022-01-16 09:24:26 -08:00
Alberto Miorin
4fedb5fd9b
Fix #2199: Follow-up of PR: Support for getting deleted entities in GET and LIST operations (#2206)
* Improve tests for deleted entities, fix User->Teams->OwnsEntities

* Improve doc for recursive deletion and improve UsageRepository

* Remove listAfter and listBerfore without Include. Add Include.NON_DELETED to the resources without deletion like Bots, Metrics, and Reports. Improve UserRepository.

* Add method to add all relationships for the get deleted entity test. Adapt the test for the entity User.

* Add soft deletion to Webhook. Implement Include for Webhook.

* Improve existing test to include a check for owner.

* Fix populateService of Table

* Fix Team setFields.
2022-01-14 12:19:19 -08:00
Suresh Srinivas
5a8e2ee31f
Issue2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key (#2195)
* Add support for webhook secret key

* Fixes #2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key

* Fixes #2194 - Added support for upgrading existing metadata to move dateTime attributes to timestamp
2022-01-13 12:08:42 -08:00