3981 Commits

Author SHA1 Message Date
Vj-L
8bf34fcdc1
Fix/airflow dag issue (#6759)
* Added the correct path for dags volume

* Updated the dags volume path

* Removed the library from the Dockerfile of ingestion

* Removed the libmxl2 library from Docker file

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-25 18:49:46 +05:30
Chirag Madlani
48e72143c7
fix(ui): show owner name if they belongs to team owned (#6904)
* fix(ui): show current user as owner if part of team

* remove unused import

* fix layout issues

* fix tests

* fix cy tests
2022-08-25 16:23:25 +05:30
Sachin Chaurasiya
c5ebfdc7e1
Fix(#5914) glossary & glossaryTerm displayName (#6922)
* Fix(#5914) glossary & glossaryTerm displayName

* Minor change to show glossary displayname in the tree
2022-08-25 16:19:29 +05:30
Vivek Ratnavel Subramanian
f23357ba68
Update slack chat to redirect to a URL (#6909) 2022-08-25 15:25:11 +05:30
Nahuel
7863f040d1
Fix#6027: Improve logging in ORM profiler (#6919)
* Improve logging in ORM profiler

* Fix failing test

* Updated logging in test_suite module to match company's format

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-08-25 11:19:31 +02:00
Teddy
ce578e73d4
Fixes #5831 by implenting testSuite workflow logic (#6911)
* Added database filter in workflow

* Removed association between profiler and data quality

* fixed tests with removed association

* Fixed sonar code smells and bugs

* Updated profiler workflow to:
- support only running profiler (removed test run)
- support column inclusion and exclusion
- added back support for partitioned table and sample

* moved status to workflow

* Fixed tests

* removed test logic from profiler sink

* Added logic to return sample from workflow sample value

* Added profiler examples

* Updated documentation for profiler

* Fixed code smells

* commited changed to profiler

* initial commit of the revamp workflow

* Fixed python formating

* cleaned up profiler submodule by removing test related files and functions

* Added airflow DAG logic for testSuite workflow

* Fixed code smells + added airflow ingestion tests + fixed comments
2022-08-25 10:01:28 +02:00
Mayur Singal
6980541152
Added Metadata Ingestion Configs in Docs (#6918) 2022-08-25 09:05:56 +02:00
Pere Miquel Brull
75dcbe612a
Validate service sink ack (#6895)
* Validate service sink ack

* naming
2022-08-25 08:41:22 +02:00
Chirag Madlani
04bcc99098
refactor(ui): remove unused code (#6853)
* refactor(ui): remove unused code

* fix redirect issue

* remove and update files

* fix tests
Add bot details page
Fix edit webhook

* fix cypress failing
2022-08-24 23:49:50 +05:30
Aniket Katkar
9cd9ed4a1a
Improvement(UI) #6556 : Made tag and glossary names clickable (#6882)
* Improvement #6556 : Made tag and glossary names in entity tables and other places clickable which now on click will redirect to the respective tag or glossary details page

* Changes made for failing cypress tests

* - Added functionality to redirect to specific tag category
- Merged 2 tooltips of tags into one which show both name and description
- Removed edit icon showing for links in entity summary details

* Updated unit tests
2022-08-24 20:01:22 +05:30
Pere Miquel Brull
667c837ae0
Fix #5566 - Add Pipeline Service host IP endpoint (#6898)
Fix #5566 - Add Pipeline Service host IP endpoint (#6898)
2022-08-24 16:27:31 +02:00
Sachin Chaurasiya
8cec6a6d08
Feat(#6902) UI - Add condition support for policy rules (#6903)
*  Feat(#6902) UI - Add condition support for policy rules

* Addressing review comment

* Fix roles update issue on policy page
2022-08-24 19:18:33 +05:30
NiharDoshi99
f0f0476396
Added http & https scheme options in Hive connector (#6899)
* Added other scheme options in Hive connector

* Added other scheme options in Hive connector
2022-08-24 18:30:30 +05:30
Mayur Singal
404cc67911
WIP - Fix #6744: allow more than one metadata ingestion workflow (#6831)
* Fix #6744: allow more than one metadata ingestion workflow

* Rename to markDeletedTablesFromFilterOnly

* ui support for new field markDeletedTablesFromFilterOnly

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-08-24 14:21:52 +02:00
Ayush Shah
322f6445e1
Antlr entitylink split fix (#6901)
* Modified Antlr Split Listeners

* Modified EntityLink.g4

* Fix Grammar split
2022-08-24 14:05:21 +02:00
Akash Jain
e987cb878e
feat: Prepare metadata docker cli with 0.11.5 release (#6900) 2022-08-24 16:43:14 +05:30
Pere Miquel Brull
b2cf8993a2
Docs - Lineage (#6883)
* Update lineage

* Update roadmap

* Add Mode to the list

* Add lineage information
2022-08-24 07:34:06 +02:00
Akash Jain
3a46917cb2
feat: Added documentation for #6772 (#6846) 2022-08-24 10:17:58 +05:30
Mayur Singal
17349e4e30
Fix #6856: Added Troubleshooting docs for Okta SSO (#6885)
* Fix #6856: Added Troubleshooting docs for Okta SSO

* rename to service_application_client_id
2022-08-24 09:20:42 +05:30
Suresh Srinivas
895a6e5551
Fixes #6860 Add policy support for policies based on resource ownership hierachy (#6861)
* WIP

* Fixes #6728 API to get detailed permissions for any user

* Fixes #6860 Add policy support for policies based on resource ownership hierachy

* Check if inheritedRoles is null

* Revert "Check if inheritedRoles is null"

This reverts commit 3dee922d5937c1f4ac9a298d1156e7adf15083a6.

* Initialize SubjectCache in NoOpAuthorizer

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-08-23 20:44:11 -07:00
Suresh Srinivas
605871db2e
Fixes #6851 Backend : Roles patch API is not working for policies (#6890) 2022-08-23 15:31:42 -07:00
Suresh Srinivas
ca39b9f603
Fixes #6886 Add API for validating expressions in Rule conditions (#6887) 2022-08-23 13:53:16 -07:00
Teddy
afd12cff04
added testResultValue to testCaseResult (#6881) 2022-08-23 18:32:15 +02:00
Chirag Madlani
e52b843548
fix(ui): masked password fields for nested object (#6880) 2022-08-23 21:01:00 +05:30
Sachin Chaurasiya
d942c55e34
Feat(#3031) Support policy authoring through UI (outside of role page) (#6863)
*  Feat(#3031) Support policy authoring through UI (outside of role page)

* Change remove text to remove icon

* - [x] Add confirmation for removing items from the roles and policies details page

* Change rules styling according to the mocks

* Make Access category protected!

* Changed condition from normal text to code

* Create rule form component

* Fix spacing

* Add support for "Add and Edit" rule for policy

* Add helper text for Add "roles" and "policy" page
2022-08-23 20:11:10 +05:30
Cristian Calugaru
9c8ee19497
fixed minor typo (#6877) 2022-08-23 19:29:26 +05:30
Shailesh Parmar
beea4519e0
added cypress test for custom properties (#6878) 2022-08-23 19:21:06 +05:30
Chirag Madlani
3975e2d31e
fix(ui): update helper text for webhook and slack (#6865)
* fix(ui): update helper text for webhook and slack

* move to constant
2022-08-23 18:48:54 +05:30
Nahuel
6db7eba16b
Fix table repository bug (#6871) 2022-08-23 15:13:11 +02:00
Milan Bariya
994b769d25
Databricks Connection - User & Password clean (#6866)
* Databricks Connection - User & Password clean

* Fix: Python checkstyle failed

* Fix: update the migration scripts
2022-08-23 14:36:58 +02:00
Pere Miquel Brull
ceb9601c67
Docs - Credentials, links and Roadmap (#6870)
* Managing credentials

* GCS creds info

* Links and roadmap update

* Add lineage in the menu
2022-08-23 11:53:40 +02:00
Aniket Katkar
95b2ac276e
Fix #6314 : Added placeholder when no entity found whiled searching in lineage editor (#6867) 2022-08-23 14:07:38 +05:30
Mayur Singal
f32572c949
Fix #6862: Improve Superset dict handling (#6864) 2022-08-23 10:07:09 +02:00
Ayush Shah
3d125d9372
Fixes Okta default scope (#6847) 2022-08-23 13:04:12 +05:30
Onkar Ravgan
8d56cb99b7
Optimize usage queries (#6837)
* Snowflake usage query optimized

* Added docs for snowflake query

* Updated docs

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-08-23 12:54:34 +05:30
Pere Miquel Brull
a975d5177d
WIP - Fix #6582 - Validate Airflow REST versions on health endpoint (#6836)
WIP - Fix #6582 - Validate Airflow REST versions on health endpoint (#6836)
2022-08-23 08:59:44 +02:00
Pere Miquel Brull
102ea93e83
Check if table exists in datamodel rest (#6859) 2022-08-23 07:39:23 +02:00
Sachin Chaurasiya
097d4ba313
Feat : Add New roles and policy UI - Part 4 (#6848)
*  Feat : Add New roles and policy UI - Part 4

* Change form title font size

* Remove empty componet to table fallback no data

* Add remove option for roles and policies detail page
2022-08-22 21:47:44 +05:30
Sriharsha Chintalapani
821d70eae4
Fix #6782: Separate TableProfile and ColumnProfile api calls (#6783)
* Fix #6571: Add EntityLink for the testCase to ID columns

* Fix #6571: Add EntityLink for the testCase to ID columns

* Fix #6782: Separate TableProfile and ColumnProfile api calls

* Fix #6782: Separate TableProfile and ColumnProfile api calls - fix tests

* Fix #6782: Separate TableProfile and ColumnProfile api calls - fix tests

* Fix setFields

* Fix tests

* Update pipeline status endpoint

* updated ui side as per new schema for profiler tab

* updated profiler details with new API

* Fix Profiler tests and validation errors (#6827)

* add profilerSample field in TableProfile

* add profilerSample field in TableProfile

* get columnProfile with field profile

* get columnProfile with field profile

* Fixed sample data and python tests

* fixed date range filter change issue

* handled empty profiler case

* Added column level test case and results

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-08-22 21:31:24 +05:30
Nahuel
86e20dad2d
Add troubleshooting section to Datalake (#6842) 2022-08-22 16:47:43 +02:00
Aniket Katkar
f686f606ca
Improvement #6656 : Edited the text in sample data tab when no data is available (#6843)
* Improvement #6656 : Edited the text in sample data tab when no data is available

* Used antd Empty component to show for no data
2022-08-22 19:57:13 +05:30
Ayush Shah
383f4497cc
Update Entity Reference parameter fields (#6841) 2022-08-22 19:37:24 +05:30
Aniket Katkar
51bf63551e
Fixed progress bar not showing for ingestion deployment (#6849) 2022-08-22 19:14:15 +05:30
Aniket Katkar
803f890da0
Added icons for dagster and fivetran service connections. (#6845) 2022-08-22 18:52:28 +05:30
Aniket Katkar
dd85280a32
Fix #6780 : fixed the error occuring when dataTypeDisplay value is not present (#6840) 2022-08-22 16:52:46 +05:30
Ayush Shah
f8e8d2f7ab
Modfied github workflow, fix antrl4 not found (#6839) 2022-08-22 15:56:43 +05:30
Nahuel
4e176fbc66
Fix#5917: Implementation of temp secret for testing connection (#6832)
* Implementation of temp secret for testing connection

* Fix tests
2022-08-22 08:43:23 +02:00
Pere Miquel Brull
75a80d237b
Docs - Add all the YAML info and some other fixes (#6830)
Docs - Add all the YAML info and some other fixes (#6830)
2022-08-19 20:04:32 +02:00
Sachin Chaurasiya
33ca751b58
Feat : Add New roles and policy UI - Part 3 (#6826)
*  Feat : Add New roles and policy UI - Part 3

* Change rules styling

* Add delete action for policy details page

* Change background of the add forms
2022-08-19 22:31:48 +05:30
Nahuel
8691022d0f
AWS SSM secrets manager implementation on ingestion (#6805)
* Implementation of AWS SSM as secrets manager

* Remove dead code

* Minor fixes

* Allow using default credentials in AWS client

* Fixed py style

* Fixed tests imports

* Minor changes

* Add patch to failing test

* Fix how we were storing dbtConfigSource

* Address PR comments
2022-08-19 16:15:40 +02:00