3870 Commits

Author SHA1 Message Date
Pere Miquel Brull
2238bc2466
Do not push ingestion dir (#7008) 2022-08-29 14:20:32 +02:00
Mayur Singal
58d27811d0
Bigquery Mark Paertitioned Tables (#7007) 2022-08-29 14:15:59 +02:00
Shailesh Parmar
3b67cc824d
Data qaulity add test's workflow (#6957)
* initial setup for data quality form

* added stepper and form component

* added select/add test suite step form

* added form for table test and cron step

* added data quality table test form flow

* bug fix for profiler

* added column test form

* render right panel information dynamically

* updated test as per new changes

* updated data test id

* Fixed ingestionPipeline

* Fixed pytest + python format

* miner fix, added sql editor

* removed filter for duplicate test check

* miner fix

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-08-29 17:26:59 +05:30
Chirag Madlani
cc0449e506
feat(ui): update global settings page with new roles and policy (#7002)
* feat(ui): update global settings page with new roles and policy

* Modify the permission util and remove access prop from create bot and user page

* Fix typo

* Fix console errors

* fix unit tests

* Add getEntityPermission to provider

* Remove admin and auth disable check from global setting

* Add check for edit description.

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-08-29 16:35:42 +05:30
Pere Miquel Brull
15c83e3f2d
Docs - Update images and clean files (#7005)
* Update image links

* Remove external YAMLs
2022-08-29 08:59:41 +02:00
Aniket Katkar
1b084fd956
Fix #6791 : Table styling on Settings page made consistent to that on entity page (#6938)
* Fix #6791 : Replaced react-table with antd table component

* Updated unit tests

* Fixed failing cypress tests

* Refactored code, removed code smells.

* Fixed code smells
2022-08-29 11:51:16 +05:30
Nahuel
3f491a8578
Fix#6027: Improve logging in ingestion library (#6931)
* Improve logging in ingestion library

* Some extra fixes in logging
2022-08-29 08:06:29 +02:00
Abhishek Pandey
fde53809eb
added-query-log-parser-in-postgres (#6750)
added-query-log-parser-in-postgres (#6750)
2022-08-29 06:48:29 +02:00
Nahuel
4c6f0c7bda
Fix#6027: Fix logging in metadata package modules except ingestion and orm_profiler (#6970)
* Fix logging in metadata package modules except ingestion and orm_profiler

* Reduce log level to _get_columns_with_constraints method
2022-08-29 06:46:06 +02:00
Sachin Chaurasiya
1081254f7b
Fix (#6971) UI : Add Permission Provider (#6972)
* Fix (#6971)  UI : Add Permission Provider

* Fix description unit test

* Fix unit tests

* Addressing review comments

* Add checkPermission util

* Add permission for protected route

* Clean up

* Fix rule condition validation issue
2022-08-27 16:05:57 +05:30
Chirag Madlani
5cefe1bfbb
refactor(ui): mock matchMedia globally for unit tests (#6985)
* refactor(ui): mock matchMedia globally for unit tests

* remove unused tests
2022-08-27 16:00:38 +05:30
Teddy
bcdb8891f8
Fixed datatype bug (#6987) 2022-08-27 15:56:08 +05:30
Chirag Madlani
9abf63f476
fix(ui): service page ui updates (#6927)
* fix(ui): service page ui updates
tag page left panel height issue

* update layout for settings page

* ignore long URL lint errors

* update tests

* fix cypress tests

* fix cypress failing

* fix cypress tests failure
2022-08-27 13:11:35 +05:30
Sriharsha Chintalapani
f9a3f9988e
Fix #6936: testPlatforms is required field in testSuite and createTes… (#6944)
* Fix #6936: testPlatforms is required field in testSuite and createTestSuite schema

* Fix #6936: testPlatforms is required field in testSuite and createTestSuite schema

* Fix #6936: testPlatforms is required field in testSuite and createTestSuite schema

* Fix #6936: testPlatforms is required field in testSuite and createTestSuite schema

* Fix #6936: testPlatforms is required field in testSuite and createTestSuite schema

* fixed glossary test

* Fixed sample data ingestion

* Add filters for testCaseResultSuccess
testCaseResultFailed, testCaseResultAborted

* Fix #6936: fix testcase listing

* Fix #6936: fix java style

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2022-08-27 13:01:24 +05:30
Sachin Chaurasiya
6c62433931
Fix UI | cmd + click does not work as expected on the Explore page #6976 (#6983) 2022-08-27 11:57:04 +05:30
Aniket Katkar
5168c8afb0
Ui improvements and fixes (#6966)
* Ui improvements and fixes

* Fixed failing unit tests
2022-08-27 07:20:48 +05:30
Pere Miquel Brull
2a3a6141ef
Docs - Markdown Migration (#6980) 2022-08-26 17:57:09 -07:00
Suresh Srinivas
c2a70bd545
Fixes #6978 Helper function for building ChangeDescription (#6979)
* Fixing test failures

* Fixes #6978  Helper function for building ChangeDescription
2022-08-26 14:07:15 -07:00
Pere Miquel Brull
6cebf37b6c
Fix #6906 - Add Nifi connector (#6956)
* Add Nifi connector

* Mock token

* Format

* pass verify param
2022-08-26 21:50:01 +02:00
Sachin Chaurasiya
240c479f7d
Fix #5140 E2E Testing for Roles and Policies Page (#6962)
* Fix #5140 E2E Testing for Roles and Policies Page

* Minor change

* Fix failing unit tests
2022-08-27 00:47:44 +05:30
Aniket Katkar
2926055b92
Fixed loader not showing while fetching query data (#6968)
* Fixed loader not showing while fetchig query data

* Used antd components for grid styling

* unit test mocks correction

* unit test fail fix
2022-08-27 00:20:03 +05:30
Teddy
1234b6f220
Fixes #5313 by adding logic to skip non OM on testSuite workflow (#6969) 2022-08-26 18:53:32 +02:00
Sachin Chaurasiya
bddf5d849d
Remove unused code for botlist (#6964) 2022-08-26 19:56:13 +05:30
Pere Miquel Brull
4472e3b2ad
Dashboards based on markdown (#6963) 2022-08-26 14:46:21 +02:00
Sachin Chaurasiya
e13381f3f2
UI : Roles and Policy Changes (#6923)
* UI : Roles and Policy Changes

* Add unit tests for add role page

* Add unit tests for roled details page

* Add unit test for rolelist page

* Add unit test for role list page

* Add action button for rule

* Add support for delete action on policy rule

* Modify the addattribute modal

* Add support for search on add attribute modal

* Improve modal title styling

* Minor change

* handle role users and teams update

* Fix teams remove issue on policy

* Add unit tests for the add attribute modal

* Add data-testids for fields

* Fix typo

* Add unit tests for add policy and rule form

* Add unit tests for add and edit role

* Change data-tests ids

* Add roles ad policies support on teams details page

* Fix unit tests

* Change data-testid for rule card manage button

* Minor fix

* Remove old rolesAPI file
2022-08-26 18:03:46 +05:30
Onkar Ravgan
13d433b0d7
Add Owner for DBT (#6872)
* Added owner field in DataModel

* Added user in backend

* review comments addressed

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-08-26 16:22:27 +05:30
Shailesh Parmar
87f8bcc4fa
Fixed issue: UI: Glossary details page improvements#6834" (#6879)
* Fixed issue: UI: Glossary details page improvements#6834"

* added data-testid

* fixed input box re-render issue

* fixed failing cypress for glossary

* addressing comments

* fixed failing cypress

* updated glossary test and cypress

* fixed glossary test
2022-08-26 16:08:02 +05:30
Milan Bariya
0ad7e0af1b
Fix: Add Configure Metadata Ingestion image for mlmodel (#6958) 2022-08-26 14:23:09 +05:30
Aniket Katkar
1c6d2f2649
Fix #6893 : Ui improvements and bug fixes 2 (#6935)
* Fix #6893 : Ui improvements and bug fixes

* Fixed failing unit tests

* Fixed failing cypress tests

* glossary page left panel styling changes
2022-08-26 14:14:22 +05:30
Aniket Katkar
6a85b34e3c
Fix #6893 : UI improvements and bug fixes 1 (#6934)
* Fix #6893 : UI improvements and bug fixes

* Fixed failing unit tests

* worked on comments to make common styling for left panel
2022-08-26 14:14:08 +05:30
Milan Bariya
c0e91033e0
Fix: Mode and Mlflow doc added (#6925)
* Fix: Mode and Mlflow doc added

* Fix: Change based on comments
2022-08-26 09:00:34 +02:00
Mayur Singal
6c1f84dcd7
Use Table FQN instead of Name for usage status (#6952)
* Use Table FQN instead of Name for status

* Update log with fqn instead of name
2022-08-26 08:58:30 +02:00
Nahuel
bdbbca0efe
Fix#6027: Improve logging in OpenMetadata Airflow APIs (#6920)
Fix#6027: Improve logging in OpenMetadata Airflow APIs (#6920)
2022-08-26 07:29:38 +02:00
Teddy
075a0196cf
Fixed #6762 DB2 test connection (#6928)
* Fixed DB2 test connection

* Fixed query

* Fixed function
2022-08-26 07:14:17 +02:00
Suresh Srinivas
a8732c8e89
Fixes #6844 Ingestion causes Custom Property values to disappear (#6912) 2022-08-25 14:04:18 -07:00
Sachin Chaurasiya
ff1d2c251a
Fix #6932 UI | Full Table name is not displayed on the Table Home Page (#6933) 2022-08-26 00:36:53 +05:30
Shailesh Parmar
ef5de94a8f
added data-quality tab and filters for test, with basic table (#6869)
* added data-quality tab and filters for test, with basic table

* added pass fail status with icon

* added test summary component

* render the chart for column test

* revers the time stamp

* fix right side data render layout

* added legend and colors

* added filter by time

* updated style and move filter to chart level

* updated column profiler route

* added table dashboard

* updated test result summary on profiler tab

* fixed failing unit test

* added loader
2022-08-25 22:21:30 +05:30
NiharDoshi99
4c7fd03b5a
Configured ODBC drivers (#6924) 2022-08-25 08:19:20 -07:00
mohitdeuex
c8ab6fa59b
[Backend][Settings] Settings through UI (#6514) 2022-08-25 06:37:44 -07:00
Vj-L
8bf34fcdc1
Fix/airflow dag issue (#6759)
* Added the correct path for dags volume

* Updated the dags volume path

* Removed the library from the Dockerfile of ingestion

* Removed the libmxl2 library from Docker file

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-25 18:49:46 +05:30
Chirag Madlani
48e72143c7
fix(ui): show owner name if they belongs to team owned (#6904)
* fix(ui): show current user as owner if part of team

* remove unused import

* fix layout issues

* fix tests

* fix cy tests
2022-08-25 16:23:25 +05:30
Sachin Chaurasiya
c5ebfdc7e1
Fix(#5914) glossary & glossaryTerm displayName (#6922)
* Fix(#5914) glossary & glossaryTerm displayName

* Minor change to show glossary displayname in the tree
2022-08-25 16:19:29 +05:30
Vivek Ratnavel Subramanian
f23357ba68
Update slack chat to redirect to a URL (#6909) 2022-08-25 15:25:11 +05:30
Nahuel
7863f040d1
Fix#6027: Improve logging in ORM profiler (#6919)
* Improve logging in ORM profiler

* Fix failing test

* Updated logging in test_suite module to match company's format

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-08-25 11:19:31 +02:00
Teddy
ce578e73d4
Fixes #5831 by implenting testSuite workflow logic (#6911)
* Added database filter in workflow

* Removed association between profiler and data quality

* fixed tests with removed association

* Fixed sonar code smells and bugs

* Updated profiler workflow to:
- support only running profiler (removed test run)
- support column inclusion and exclusion
- added back support for partitioned table and sample

* moved status to workflow

* Fixed tests

* removed test logic from profiler sink

* Added logic to return sample from workflow sample value

* Added profiler examples

* Updated documentation for profiler

* Fixed code smells

* commited changed to profiler

* initial commit of the revamp workflow

* Fixed python formating

* cleaned up profiler submodule by removing test related files and functions

* Added airflow DAG logic for testSuite workflow

* Fixed code smells + added airflow ingestion tests + fixed comments
2022-08-25 10:01:28 +02:00
Mayur Singal
6980541152
Added Metadata Ingestion Configs in Docs (#6918) 2022-08-25 09:05:56 +02:00
Pere Miquel Brull
75dcbe612a
Validate service sink ack (#6895)
* Validate service sink ack

* naming
2022-08-25 08:41:22 +02:00
Chirag Madlani
04bcc99098
refactor(ui): remove unused code (#6853)
* refactor(ui): remove unused code

* fix redirect issue

* remove and update files

* fix tests
Add bot details page
Fix edit webhook

* fix cypress failing
2022-08-24 23:49:50 +05:30
Aniket Katkar
9cd9ed4a1a
Improvement(UI) #6556 : Made tag and glossary names clickable (#6882)
* Improvement #6556 : Made tag and glossary names in entity tables and other places clickable which now on click will redirect to the respective tag or glossary details page

* Changes made for failing cypress tests

* - Added functionality to redirect to specific tag category
- Merged 2 tooltips of tags into one which show both name and description
- Removed edit icon showing for links in entity summary details

* Updated unit tests
2022-08-24 20:01:22 +05:30
Pere Miquel Brull
667c837ae0
Fix #5566 - Add Pipeline Service host IP endpoint (#6898)
Fix #5566 - Add Pipeline Service host IP endpoint (#6898)
2022-08-24 16:27:31 +02:00