1215 Commits

Author SHA1 Message Date
Vivek Ratnavel Subramanian
e6bb85fae8
Fix #5764 Backend: Add support for filter by task status (#5899) 2022-07-06 22:56:24 -07:00
Pere Miquel Brull
f8e3d634c2
Validate rest and update schema (#5873) 2022-07-06 11:27:20 +02:00
Teddy
3a7c11424b
Fixes #3133 -- Adding Additional Column Tests (#5867)
* Added additional table + test coverage

* Added logic for front end input fields

* Added comment for median metric

* skipping `Update owner and check description` cypress test

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-07-06 10:12:29 +02:00
Parth Panchal
686e715341
added config to publish to maven repository in catalog pom.xml (#5870)
* added config to publish to maven repository in catalog pom.xml

* addressing java checkstyle

* empty-commit

* signing commit

* signing commit test

* signing commit test with different key

* moving plugins
2022-07-06 13:06:49 +05:30
Suresh Srinivas
e7f57d90c3
Fixes #5245 Entity tag is not getting removed, even after glossary term is deleted (#5838) 2022-07-05 07:49:37 -07:00
Suresh Srinivas
cf2b336abd
Fixes #5558 Add support for enumerating Operations and Resources for authoring policies (#5561) 2022-07-04 10:07:47 -07:00
Suresh Srinivas
98deaf1776
Refactor code to consolidate common code to EntityRepository and cleanup unused code (#5824) 2022-07-01 14:54:01 -07:00
truemanD
1808b1a056
Defined a constant instead of duplicating string literal #1982 (#5819) 2022-07-01 09:53:59 -07:00
eitsupi
8007024721
fix typo (#5818) 2022-07-01 16:14:27 +02:00
Mayur Singal
dc497d298b
Fix #5768: Clickhouse Client Connection Fix (#5771) 2022-06-30 12:14:27 +02:00
Vivek Ratnavel Subramanian
2b0aeaf0eb
Fix #5704 Backend: Remove usage from activity feed (#5759) 2022-06-30 02:15:21 -07:00
Sriharsha Chintalapani
f3f45bc174
Fix #5761: Delete is not working at database and service level (#5762)
* Fix #5761: Delete is not working at database and service level

* Fix failing test
2022-06-30 01:56:44 -07:00
Vivek Ratnavel Subramanian
e826c98acf
Fix migration script for migrations to 0.11 (#5773) 2022-06-30 00:38:24 -07:00
Pere Miquel Brull
f7a10fe5a6
Fix #5754 - Clean pipeline service connection & minor fixes (#5766)
* Update airflow

* Remove prefect

* Remove prefect
2022-06-30 09:33:45 +02:00
mohitdeuex
17bfa5f2d2
Remove log and add debug option (#5750)
* [Backend] Disable logging to console

* [Backend][removeLogs]] Added logback.xml to disable logs for TablesInitializer , added -debug for controlling Console logs

* [Backend][removeLogs]] Printing User.json
2022-06-30 10:31:47 +05:30
Vivek Ratnavel Subramanian
df704fb566
Fix #5739 Activity feed bug for tables with similar name (#5760) 2022-06-29 16:27:43 -07:00
mohitdeuex
c4bac17b83
[Backend][taskNotifications]] Modfied for webscoket only transport and added logs (#5730) 2022-06-29 10:50:54 -07:00
Vivek Ratnavel Subramanian
1d7e212e2f
Reassigning a Task throws an error (#5721) 2022-06-29 23:11:39 +05:30
Sriharsha Chintalapani
03ccd89c80
Fix #5752: search highlighter is not working for tables (#5753) 2022-06-29 23:03:54 +05:30
Pere Miquel Brull
e3223f6a20
Simplify bigquery usage (#5728) 2022-06-29 13:58:41 +02:00
mohitdeuex
962e61daee
[Backend] Disable logging to console (#5709) 2022-06-28 23:51:45 +05:30
mohitdeuex
3132b6f28c
[Backend][Task notification] (#5717)
* [Backend][WebSocket] Add taskNotifications #5638[WIP for team assigned a task]

* [Backend][WebSocket] Reformat sources

* Update catalog-rest-service/src/main/java/org/openmetadata/catalog/socket/WebSocketManager.java

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>

* [Backend][WebSocket] Task Notification to all Users when added to a team

* [Backend][WebSocket] Remove Commented part

* [Backend][TaskNotification] reformat source

* [Backend][taskNotifications]] Allow multiple connections for one user

* [Backend][taskNotifications]] reformat

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-06-28 23:51:16 +05:30
Vivek Ratnavel Subramanian
9414012c38
Add support for closing task with comment (#5684) 2022-06-28 10:05:22 -07:00
Pere Miquel Brull
89a026b022
Fix #5688 - MlFlow deployment fails from UI (#5691)
* Fix mlflow from UI

* format
2022-06-28 14:58:38 +02:00
mohitdeuex
7f25b82408
[Backend][TaskNotification] Update the Group Id for to org.open-metadata (#5663) 2022-06-28 11:10:07 +05:30
Sriharsha Chintalapani
f9817e9a49
Fix #5656: Connection config visible in mlmodel service for non-admin user (#5657) 2022-06-27 07:59:44 -07:00
Mayur Singal
71bf32e438
Fix #5562: Handle Analysis Date for Usage (#5582)
Fix #5562: Handle Analysis Date for Usage (#5582)
2022-06-27 15:16:12 +02:00
mohitdeuex
2b9852234b
[Backend][WebSocket] Add taskNotifications #5638[WIP for team assigne… (#5639)
* [Backend][WebSocket] Add taskNotifications #5638[WIP for team assigned a task]

* [Backend][WebSocket] Reformat sources

* Update catalog-rest-service/src/main/java/org/openmetadata/catalog/socket/WebSocketManager.java

Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>

* [Backend][WebSocket] Task Notification to all Users when added to a team

* [Backend][WebSocket] Remove Commented part

* [Backend][TaskNotification] reformat source

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-06-27 16:40:31 +05:30
Milan Bariya
338d1efe40
FIX 5419: Glue pipeline connector not working (#5467)
FIX 5419: Glue pipeline connector not working (#5467)
2022-06-27 11:38:41 +02:00
Sriharsha Chintalapani
8528c51b9c
Fix #5516: Refactor elasticsearch indexes to be same as entity specifications (#5573)
* Fix #5516: Refactor elasticsearch indexes to be same as entity specifications

Co-authored-by: darth-coder00 <aashit@getcollate.io>
Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-06-27 01:19:27 -07:00
Pere Miquel Brull
816f8d49eb
Use source when creating and updating indexes (#5597) 2022-06-26 12:18:14 -07:00
Sriharsha Chintalapani
ad0c6dad88
Fix #5613: Add fernet encryption and remove connection details for non admin users (#5614)
* Fix #5613: Add fernet encryption and remove connection details for non-admin users
2022-06-24 16:44:37 -07:00
Teddy
7431c1c226
[Issue-5188] Implement User Query for Sampler and Profiler (#5578)
* Added custom query sample for sample data ingestion

* Added logic to run table profiling against user's query

* Added tests for user query logic in profiler and sampler

* Added user profiling to tableProfile + fixed format

* staging commit

* Added logic to add profileQuery to table entity

* Added limit to sample rows
2022-06-24 14:46:34 +02:00
Vivek Ratnavel Subramanian
249710558e
Fix #5606 Backend: Add a reply to the task when task is closed (#5607) 2022-06-23 22:47:02 -07:00
Vivek Ratnavel Subramanian
3298c2c0e3
Fix schema errors (#5605) 2022-06-23 22:46:02 -07:00
Vivek Ratnavel Subramanian
9403b146fa
Fix #5508 Backend: Add API support to resolve a task related to tags (#5595) 2022-06-23 10:30:18 -07:00
Sriharsha Chintalapani
ce49247011
Fix #5590: Add bootstrap command to instantiate ingestion-bot user with JWTToken (#5591) 2022-06-23 18:05:30 +05:30
Vivek Ratnavel Subramanian
296f580304
Fix #4679 Backend: Support assigning a task to user/team and resolving the task (#5501) 2022-06-22 16:17:29 -07:00
Pere Miquel Brull
685b7bede8
Revert "Added pipeline metadata to the edge lines (#5552)" (#5571)
This reverts commit d717f8cc17d949620935a89d5fa94b141502ab07.
2022-06-22 11:42:48 +05:30
Pere Miquel Brull
0ecc9f0da6
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
Fix #5459 - Remove sql-metadata in favor of sqllineage (#5494)
2022-06-21 18:02:50 +02:00
Onkar Ravgan
d717f8cc17
Added pipeline metadata to the edge lines (#5552)
Added pipeline metadata to the edge lines (#5552)
2022-06-21 17:22:37 +02:00
Pere Miquel Brull
a14de6eee1
Fix #5367 - MlFlow connector & MLServices (#5446)
Fix #5367 - MlFlow connector & MLServices (#5446)
2022-06-21 14:54:36 +02:00
Teddy
c151a34c70
[ISSUE-4659] Add Additional GE Tests to the Profiler (#5506)
* Added table tests 'column count to be between' and 'column name to be in set'

* Added 'column values to be in set' test

* Fixed wrong filed name when invoking TestCaseResult

* Added col min and col max to be between

* Fix formatting

* Fix test after adding column name list to table profile

* Added 'column values sum between' test

* Added 'table column name to exist' test

* Fixed JSON description white space + spelling mistake
2022-06-20 08:54:42 +02:00
Onkar Ravgan
21dac15176
Added Mode Connector (#5475)
* rebase with main

* Added lineage for mode

* added lineagerunner and enum constants

* added host port

* refactored mode according to new dashboard topology

* checkstyle fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-19 23:59:38 +05:30
Abhishek Pandey
196b023643
airflow-test-connection-fixed (#5502)
* airflow-test-connection-fixed

* airbyte-test-connection-added
2022-06-17 23:08:18 +05:30
Sriharsha Chintalapani
80abd72217
Fix #5498: Column comparator should ignore case (#5499) 2022-06-17 10:18:43 -07:00
Mayur Singal
430d32a9c6
Fix #5090: Added Local TableType (#5450)
Fix #5090: Added Local TableType (#5450)
2022-06-15 10:41:48 +02:00
Abhishek Pandey
e8975aac01
datalake-csv-files-ingestion-added (#5343)
datalake-csv-files-ingestion-added (#5343)
2022-06-15 08:57:21 +02:00
mohitdeuex
be18feb928
[Backend] Websocket implementation added (#5440)
* [Backend] Websocket implementation added

* [Backend] Websocket implementation added [google formatter fix]

* [backend] Updated Reiew Comments

* [backend] Updated CheckStyle
2022-06-15 10:14:47 +05:30
Teddy
28336b0a43
Fix #3575 Data Quality - Partitioned Tables (#5441)
Co-authored-by: Teddy Crepineau <teddycrepineau@Teddys-MacBook-Pro.local>
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
2022-06-14 12:37:44 -07:00