3072 Commits

Author SHA1 Message Date
darth-coder00
5ecf980ab0
Fix: #2521 - Ad owner support for all services and database (#2858) 2022-02-19 16:59:39 +05:30
Sachin Chaurasiya
df58ecf1d4
Fix #2778 UI : Add Queries tab for table details page. (#2793)
* Fix #2778 UI : Add Queries tab for table details page.

* minor change

* Changing Table Queries text to Queries.

* Addressing comments

* Adding last run by user detail

* Minor UI Changes

* Removed icon

* Changing Query card style.

* Changing Icons
2022-02-19 13:45:51 +05:30
Sachin Chaurasiya
3eab339c0e
Fix #2835, #2836 Lineage entities overlap and Descriptions in Lineage view do not have formatting. (#2840)
* Fix #2835, #2836 Lineage entities overlap and Descriptions in Lineage view do not have formatting.

* Minor change

* Changing nodeWidth
2022-02-19 13:45:21 +05:30
Sachin Chaurasiya
9fc3f8979f
Generating Typescript Types from Json Schema. (#2851) 2022-02-19 13:45:05 +05:30
Sriharsha Chintalapani
a8990b97f7
Handle description and tag updates (#2856) 2022-02-18 17:52:13 -08:00
Sriharsha Chintalapani
647712c397
Fix #2843: Ignore ordinalPosition when comparing the columns, carry forward description, tags when a column is changed (#2844) 0.8.1-release 2022-02-17 23:52:40 -08:00
Suresh Srinivas
aa64b8c990
Fixes #2841 - Upgrade maven dependencies for release 0.9 (#2842) 2022-02-17 23:37:50 -08:00
Ayush Shah
959d441661
Glossary Entity Added - Ingestion fix (#2794)
* Added Glossary

* Modified Glossary: Mixin and suffix

* Glossary Mixin Methods

* Sample Data and Mixin for Glossary

* Modified comments

* Glossary Mixin Updated

* Added Glossary import

* Import issues fixed, removed upper limit for jinja2 as it conflicted

* Removed Glossary Import
2022-02-18 12:50:55 +05:30
Pere Miquel Brull
f304d290b4
Fix #2751 - Init ORM Profiler (#2831)
* ORM Profiler skeleton

* Fix table name within service

* Add license

* Prepare custom types

* Fix converter

* Compute stddev only on numeric

* Prepare smart registries

* Update tests

* Update results retrieval

* Fix composed metrics result

* Format

* Add missing type

* Add _label decorator

* clean readme

* clean readme

* Filter types when profiler runs not allowed metric types

* Fix null ratio

* Add proper type

* RuleMetric skeleton

* Prepare table metrics

* Update simple profiler

* Format

* Define test expression grammar and node visiting

* Unify metric registry

* Prepare validation core

* Add grammar lib

* Add safe get

* Format

* Allow decimals in grammar

* Test validation conversion

* Fix validation conversion and test

* Rename to row_number

* Update READMEs

* Format

* Row number naming

* Fix rename
2022-02-18 07:48:38 +01:00
Sriharsha Chintalapani
42dc42174f
Fix #2569: Custom Pipeline Service defenition (#2824)
* Fix #2569: Custom Pipeline Service defenition

* Fix #2569: Custom Pipeline Service defenition

* Adding UI support to show all services available from enum

Co-authored-by: darth-coder00 <aashit@getcollate.io>
2022-02-18 11:45:09 +05:30
darth-coder00
78ee32f585
Added entity selection changes to webhook (#2777)
* Implemented Listing, Add and Delete Webhook functionalities

* Implementing Edit Webhook and minor changes

* Minor updates

* Minor changes for generate button

* Addressing comments

* Addressing comment

* Added entity selection changes to webhook

* Addressing change requests

* Minor changes

* Removed unnecessary file

* Update openmetadata-ui/src/main/resources/ui/src/components/common/webhook-data-card/WebhookDataCard.tsx

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>

* Addressing change requests

* Schema to Typescript interfaces for webhook

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-02-18 11:12:04 +05:30
Sriharsha Chintalapani
891ff465a0
Fix #2838: Fix airflow example DAG to import airflow libs (#2839) 2022-02-18 10:47:07 +05:30
Vivek Ratnavel Subramanian
b285d5b505
Fix #2719: Change Events should create a new thread against the data entity (#2814) 2022-02-17 11:54:40 -08:00
Sriharsha Chintalapani
162068e273
Fix #2811: Log level option for running metadata (#2820)
* Fix #2811: Log level option for running metadata

* Fix #2819: Kafka connector security settings along with all configs to be retrieved
2022-02-17 10:10:22 -08:00
Igor Kramer
316e02cdfd
FIX #2802: Skip partitions and add datatypes (#2803)
* ISSUE-2802: Skip partitions and add datatypes

* ISSUE-2802: formatting changes
2022-02-17 10:09:09 -08:00
Suresh Srinivas
c2b3f4a1d9
Fixes #2806 - Webhook changes using PUT API does not reflect updated data as well as version change in list API (#2829) 2022-02-17 09:42:18 -08:00
Shailesh Parmar
d9963e0792
Added test suits for multiple file (#2796) 2022-02-17 22:11:56 +05:30
Ayush Shah
c79f1f286d
Added Users to TableQueries (#2826)
* Added Users to TableQueries

* User EntityReference

* User EntityReference modification
2022-02-17 20:46:14 +05:30
kshinde2512
a9446e0209
Added negative tests and added some assertions (#2825)
Co-authored-by: kushal <kushalshinde2512@gmail.com>
2022-02-17 17:51:46 +05:30
Sriharsha Chintalapani
165f5bb0e9
Fix #2819: Kafka connector security settings along with all configs to be retrieved (#2823)
* Fix #2811: Log level option for running metadata

* Fix #2819: Kafka connector security settings along with all configs to be retrieved

* Fix #2819: Kafka connector security settings along with all configs to be retrieved
2022-02-17 15:17:43 +05:30
Alberto Miorin
b3b5f44c23
Fix #1876: Allow dots in entity names (#2700)
Add getter and setter for `name` into EntityInterface

Refactor code in utility method.

Rename the escape method.

Fix webhook.

Fix pipeline tests

Fix airflowPipeline tests

Fix role, team, and user tests

Replace . with _DOT_ to keep compatibility with the past and avoid a migration.

Remove the Python code that was replacing the . with _DOT_.

Restore "no dots" for services and implement the JSON Schema rule.

** Entites escaping dots
1. AirflowPipeline
2. Chart
3. Dashboard
4. Database
5. Location
6. Metrics
7. MlModel
8. Pipeline
9. Table
10. Topic

** Entities rejecting dots
1. Database Service
2. Dashboard Service
3. Messaging Service
4. Pipeline Service
5. Storage Service

** Entities accepting dots
1. Bots
2. Policy
3. Report
4. Role
5. Team
6. User
7. Webhook

** Fields escaping dots
1. Column
2. Task

Add escape for Column and TableConstraints

Add escape to Task

Remove the Python code. It will be added in a follow-up PR.

Fix Pipeline entity tests
2022-02-17 08:21:53 +01:00
Mayur Singal
419448a28f
Issue 2727: Added Databricks Connector (#2745)
* Issue #2727: Added Databricks Connector

* optional db and licence info

* make core_bump_version_dev

* host_port fix

* fixed service_type

* change package to sqlalchemy-databricks

* Update databaseService.json

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 11:22:13 +05:30
Hendry Suwanda
3b9142886a
Fix #790 Make assertResponse & assertResponseContains shorter on all … (#2821) 2022-02-16 21:28:36 -08:00
Suresh Srinivas
ab0a4f5e36
Fixes #2667 Intermittent failures on WebhookResourceTest (#2822) 2022-02-16 21:27:24 -08:00
Mayur Singal
dfebc85c4e
fix #2790: fixed usage ingestion issue (#2805) 2022-02-17 10:46:23 +05:30
Sachin Chaurasiya
8555966f61
Fix: Lineage Value is not changing on fqn change. (#2795) 2022-02-17 10:14:27 +05:30
Sriharsha Chintalapani
50799227e4
Fix #2817: Remove indexing of Glossary as another Elasticsearch index (#2818) 2022-02-16 20:10:26 -08:00
codingwithabhi
088dba3a1f
azuresql-config-added (#2711)
* azuresql-config-added

* rebased-with-main

* tables-ingestion-added

* duplicate-files-removed

* Update azuresql.py

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 09:23:07 +05:30
Suresh Srinivas
65527ee191
Fixes #2815 - Less verbose code for adding and finding relationships (#2816) 2022-02-16 19:31:43 -08:00
Suresh Srinivas
4eee1e93cb
Fixes #2812 - Add support for querying glossary term filtered by glossary or parent term (#2813) 2022-02-16 19:31:13 -08:00
Suresh Srinivas
bc3032ea42
Fixes #2799 - Rename Glossary JSON schema title fields (#2804) 2022-02-16 09:54:11 -08:00
Sachin Chaurasiya
20594dd607
Fix #2784 UI : Remove Tags API call from entities details page. (#2786) 2022-02-16 23:14:31 +05:30
Suresh Srinivas
ac59a092ea
Fixes #2779 Change the webhook state names (#2782) 2022-02-16 08:59:37 -08:00
codingwithabhi
9011b27bf6
table-filter-added (#2770)
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-16 19:26:40 +05:30
Suresh Srinivas
983d534da0
Issue2775 - Add support for reviewers and related terms to Glossary (#2776)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues

* Fixes #2775 Add support for reviewers and related terms to Glossary
2022-02-15 23:11:51 -08:00
Pere Miquel Brull
1ddd2453e2
Prep feature task issue template (#2781) 2022-02-16 08:06:18 +01:00
Suresh Srinivas
f1740e5ec4
Create feature_task.md
Template for creating issues that capture a task from a larger feature
2022-02-15 21:59:56 -08:00
Suresh Srinivas
e4cbcd8788
Create feature_task 2022-02-15 21:57:57 -08:00
Ayush Shah
4aee82bfd8
Fix for #2597 - added check with column type mapping (#2598)
* Fix for #2597 - added check with column type mapping

* Optimized Column Type Parsing

* Optimized Column Type Parsing

* SQL Source Bigquery Policy Tags check added
2022-02-16 11:05:12 +05:30
codingwithabhi
f1c62a70b7
service-type-added (#2769) 2022-02-16 10:56:40 +05:30
Sriharsha Chintalapani
0ccba07059
Minor Fix: elastic search mappings (#2772) 2022-02-16 10:44:11 +05:30
Mayur Singal
78f5b51e63
fix #2663: added table queries put request (#2768) 2022-02-15 21:12:38 -08:00
Mayur Singal
5e4cd516bf
issue #2712: Added SingleStore Connector (#2747) 2022-02-15 21:11:46 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API (#2761)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues
2022-02-15 20:54:46 -08:00
darth-coder00
56a45faf1c
Implemented Listing, Add, Update and Delete Webhook functionalities (#2714)
* Implemented Listing, Add and Delete Webhook functionalities

* Implementing Edit Webhook and minor changes

* Minor updates

* Minor changes for generate button

* Addressing comments

* Addressing comment
2022-02-16 01:16:24 +05:30
Mayur Singal
44cca4d020
fix #2663: added table queries in sample data (#2763) 2022-02-15 15:45:58 +05:30
Sachin Chaurasiya
3f5c8b8d95
Fix #2568 Show database/entity_name in Lineage Node Label. (#2744)
* Fix #2568 Show database/entity_name in Lineage Node Label.

* Changing `/` to `.` as separator.
2022-02-15 12:21:20 +05:30
Matt
5261c2bad8
Define Relationship in json-schema (#2756)
* Move Relationship type to json-schema

* Replace Relationship with EntityRelationshipType (backward compatible)

* Add documentation about entity relationship
2022-02-14 21:16:21 -08:00
darth-coder00
036a7dcd9d
Added new Unit tests (#2754) 2022-02-15 10:26:49 +05:30
darth-coder00
4c67a8d3d2
Fix: #2694 removed entity api calls for recently viewed data (#2755) 2022-02-15 07:50:04 +05:30