844 Commits

Author SHA1 Message Date
Ayush Shah
568845b65c
Power BI connector (#3019)
* Power BI Dashboard and Tiles added

* Added Powerbi dependency

* Modified Powerbi debug logs

* Bump up _version.py

* Modified Power BI - added failure status, resolved comments
2022-03-01 10:09:35 +05:30
Sriharsha Chintalapani
42de51086b
Fix #3023: Keep ElasticSearch version to 7.13 (#3024) 2022-02-28 19:45:37 -08:00
Suresh Srinivas
658d91347b
Fixes #3007 - Clean up Sonar flagged issues (#3008) 2022-02-28 19:17:19 -08:00
Suresh Srinivas
4c256e2845
Fixes #3021 - Restore a soft-deleted container entity along with the children (#3022) 2022-02-28 18:42:25 -08:00
Sriharsha Chintalapani
97245a5b9f
Fix #2807: Merge openmetadata.yaml and openmetadata-server.yaml (#2808)
Co-authored-by: darth-coder00 <aashit@getcollate.io>
2022-02-28 19:04:39 +05:30
Vivek Ratnavel Subramanian
68d09a85cd
Fix #2834: Merge the change events 'delete' and 'add' as 'update' for Activity Feed (#3006) 2022-02-27 12:01:35 -08:00
Vivek Ratnavel Subramanian
105f2dd6cd
Fix #2996: ChangeEventHandler throws NPE at times (#2998)
* Fix #2996: ChangeEventHandler throws NPE at times

* Address review comments
2022-02-26 08:30:28 -08:00
Suresh Srinivas
bf57719c06
Fixes #2962 - Clean up fields parameter choices in GET APIs (#2963) 2022-02-25 22:13:30 -08:00
Sriharsha Chintalapani
fa62a1e4e9
Fix #2991: Add ES support for glossary (#2993) 2022-02-25 20:53:53 -08:00
Pere Miquel Brull
990608522a
Fix #2981 - Update Profile to match TableProfile (#2982) 2022-02-25 09:26:30 -08:00
Pere Miquel Brull
4d928bab80
Fix #2965 - Additional Properties set to False (#2976) 2022-02-24 08:38:56 -08:00
Vivek Ratnavel Subramanian
09933a12ae
Fix #2966: JWT filter should compare times in UTC to check the validity (#2971) 2022-02-24 00:57:04 -08:00
Matt
8e998678cf
Assign default roles from Teams to User (#2947) 2022-02-24 00:47:14 -08:00
Sriharsha Chintalapani
724989e097
Fix #2873: DataQuality test specifications and APIs (#2906)
* Fix #2873: DataQuality test specifications and APIs
2022-02-23 23:13:36 -08:00
Suresh Srinivas
7ea9e448d0
Fixes #2942 - Fix bugs reported by Sonar issue on release 0.9 (#2943) 2022-02-23 20:40:25 -08:00
Matt
a1257bdcc9
Support returning teams for GET /roles (#2958) 2022-02-23 19:29:20 -08:00
Vivek Ratnavel Subramanian
906f5c5352
Fix #2865: Thread should have its own message and posts should only be the replies (#2944) 2022-02-23 14:50:00 -08:00
Matt
c1a1447c4b
Refactor EntityReference list population with id list for a given entity type (#2956) 2022-02-23 14:35:30 -08:00
Sriharsha Chintalapani
aac0cbfbe9
Fix #2953: NoopAuthorizer should create a anonymous user (#2940) 2022-02-22 23:50:56 -08:00
Suresh Srinivas
fd30229f4c
Fixes #2899 - Not getting proper relation between parent and child glossary-terms (#2941) 2022-02-22 23:45:02 -08:00
Ayush Shah
e373483947
Fix #2927: Removed ColumnDataTypeDisplay check with ColumnDataType (#2928) 2022-02-22 12:44:08 -08:00
Vivek Ratnavel Subramanian
d0e6a3f11f
Fix #2867: Add support for GET /feed/{id}/posts (#2892) 2022-02-21 14:24:41 -08:00
Matt
0791c8c266
Extend team to support defaultRoles (#2885)
* Extend team to support defaultRoles

* Add support for team defaultRoles change description

* Add tests
2022-02-20 21:21:08 -08:00
Matt
9e4d8d709d
Support swapping default roles (#2868)
* Support swapping default roles

Pseudocode:

```
A. patchRole(role1, default=True):
B.   set role1.default = True
     for all users:
       add role1 to user.roles
C.   for role in roles if role != role1:
       set role.default = False
       for all users:
         delete role from user.roles
```

This ensures that changeDescription for the role(s) and user(s) are updated accordingly.

Potential optimization:
Adding role1 and removing role from user.roles could be considered/implemented as one change.
However, increases code complexity.

* Set DataConsumer as default role

* Fix tests

* Fix code smell
2022-02-20 11:27:32 -08:00
Matt
5419366a43
Fix access control rule userRoleAttr to point to roleName (#2644) 2022-02-20 10:38:25 -08:00
Pere Miquel Brull
e55579aaa8
Fix #2845 - Init Profiler Workflow (#2862)
* Fix list typing

* Add sqlite service

* Add sqlite service

* Add sqlite service

* Refactor validation into class

* Refactor validation into class

* Prepare table simple profiler

* Add note

* test ORM conversion

* Prepare workflow config utilities

* Prepare workflow skeleton

* Use new core Validation

* Refactor workflow config parsing

* Add comment

* Simplify workflow validations

* Fix table metric check

* Add init for convenience, otherwise interpreter cries when trying to __call__ the get result

* Fix table metric check

* Format

* Format

* Fix table list and metrics init

* Prepare profiler workflow integration tests

* Bump version

* Fix pycharm imports

* format
2022-02-20 17:55:12 +01:00
Vivek Ratnavel Subramanian
28807f8c0a
Fix #2837: Add a Feed Count API with entityLink filter support (#2860) 2022-02-19 11:11:09 -08:00
Matt
f0804816ab
Add support for default role (#2631) (#2676)
- Add default field to role
- Amend GET /roles to query default roles
- Assign default role to new users being created
2022-02-19 11:02:21 -08:00
Sriharsha Chintalapani
a8990b97f7
Handle description and tag updates (#2856) 2022-02-18 17:52:13 -08:00
Sriharsha Chintalapani
647712c397
Fix #2843: Ignore ordinalPosition when comparing the columns, carry forward description, tags when a column is changed (#2844) 2022-02-17 23:52:40 -08:00
Suresh Srinivas
aa64b8c990
Fixes #2841 - Upgrade maven dependencies for release 0.9 (#2842) 2022-02-17 23:37:50 -08:00
Sriharsha Chintalapani
42dc42174f
Fix #2569: Custom Pipeline Service defenition (#2824)
* Fix #2569: Custom Pipeline Service defenition

* Fix #2569: Custom Pipeline Service defenition

* Adding UI support to show all services available from enum

Co-authored-by: darth-coder00 <aashit@getcollate.io>
2022-02-18 11:45:09 +05:30
Vivek Ratnavel Subramanian
b285d5b505
Fix #2719: Change Events should create a new thread against the data entity (#2814) 2022-02-17 11:54:40 -08:00
Suresh Srinivas
c2b3f4a1d9
Fixes #2806 - Webhook changes using PUT API does not reflect updated data as well as version change in list API (#2829) 2022-02-17 09:42:18 -08:00
Sriharsha Chintalapani
165f5bb0e9
Fix #2819: Kafka connector security settings along with all configs to be retrieved (#2823)
* Fix #2811: Log level option for running metadata

* Fix #2819: Kafka connector security settings along with all configs to be retrieved

* Fix #2819: Kafka connector security settings along with all configs to be retrieved
2022-02-17 15:17:43 +05:30
Alberto Miorin
b3b5f44c23
Fix #1876: Allow dots in entity names (#2700)
Add getter and setter for `name` into EntityInterface

Refactor code in utility method.

Rename the escape method.

Fix webhook.

Fix pipeline tests

Fix airflowPipeline tests

Fix role, team, and user tests

Replace . with _DOT_ to keep compatibility with the past and avoid a migration.

Remove the Python code that was replacing the . with _DOT_.

Restore "no dots" for services and implement the JSON Schema rule.

** Entites escaping dots
1. AirflowPipeline
2. Chart
3. Dashboard
4. Database
5. Location
6. Metrics
7. MlModel
8. Pipeline
9. Table
10. Topic

** Entities rejecting dots
1. Database Service
2. Dashboard Service
3. Messaging Service
4. Pipeline Service
5. Storage Service

** Entities accepting dots
1. Bots
2. Policy
3. Report
4. Role
5. Team
6. User
7. Webhook

** Fields escaping dots
1. Column
2. Task

Add escape for Column and TableConstraints

Add escape to Task

Remove the Python code. It will be added in a follow-up PR.

Fix Pipeline entity tests
2022-02-17 08:21:53 +01:00
Mayur Singal
419448a28f
Issue 2727: Added Databricks Connector (#2745)
* Issue #2727: Added Databricks Connector

* optional db and licence info

* make core_bump_version_dev

* host_port fix

* fixed service_type

* change package to sqlalchemy-databricks

* Update databaseService.json

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 11:22:13 +05:30
Hendry Suwanda
3b9142886a
Fix #790 Make assertResponse & assertResponseContains shorter on all … (#2821) 2022-02-16 21:28:36 -08:00
Suresh Srinivas
ab0a4f5e36
Fixes #2667 Intermittent failures on WebhookResourceTest (#2822) 2022-02-16 21:27:24 -08:00
Sriharsha Chintalapani
50799227e4
Fix #2817: Remove indexing of Glossary as another Elasticsearch index (#2818) 2022-02-16 20:10:26 -08:00
codingwithabhi
088dba3a1f
azuresql-config-added (#2711)
* azuresql-config-added

* rebased-with-main

* tables-ingestion-added

* duplicate-files-removed

* Update azuresql.py

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 09:23:07 +05:30
Suresh Srinivas
65527ee191
Fixes #2815 - Less verbose code for adding and finding relationships (#2816) 2022-02-16 19:31:43 -08:00
Suresh Srinivas
4eee1e93cb
Fixes #2812 - Add support for querying glossary term filtered by glossary or parent term (#2813) 2022-02-16 19:31:13 -08:00
Suresh Srinivas
bc3032ea42
Fixes #2799 - Rename Glossary JSON schema title fields (#2804) 2022-02-16 09:54:11 -08:00
Suresh Srinivas
ac59a092ea
Fixes #2779 Change the webhook state names (#2782) 2022-02-16 08:59:37 -08:00
codingwithabhi
9011b27bf6
table-filter-added (#2770)
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-16 19:26:40 +05:30
Suresh Srinivas
983d534da0
Issue2775 - Add support for reviewers and related terms to Glossary (#2776)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues

* Fixes #2775 Add support for reviewers and related terms to Glossary
2022-02-15 23:11:51 -08:00
Mayur Singal
5e4cd516bf
issue #2712: Added SingleStore Connector (#2747) 2022-02-15 21:11:46 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API (#2761)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues
2022-02-15 20:54:46 -08:00
Matt
5261c2bad8
Define Relationship in json-schema (#2756)
* Move Relationship type to json-schema

* Replace Relationship with EntityRelationshipType (backward compatible)

* Add documentation about entity relationship
2022-02-14 21:16:21 -08:00