7748 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
8578aee04f
Search refactor (#13397)
* Refactor Search

* Refactor Search

* Fix propgation bugs

* Fix propgation bugs

* Fix glossary term search

* Fix glossary term search

* Only issue search requests if the client is configured properly

* Only issue search requests if the client is configured properly

* Fix glossary index

* add documentation for sharded tables (#13361)

* Cost analysis agg (#13408)

* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes

* feat: __init__.py files creation

* feat: updated workflow import classes in code and doc

* feat: moved kpi runner from runner to processor folder

* fix: skip failure on list entities

* feat: deleted unused files

* feat: updated status reporter

* feat: ran linting

* feat: fix test error with typing and fqn

* feat: updated test dependencies

* feat: ran linting

* feat: move execution order up

* feat: updated cost analysis report to align with new workflow

* feat: fix entity already exists for pipeline entity status

* feat: ran python linting

* feat: move skip_on_failure to method

* feat: added unusedReport to DI

* feat: added aggregated unused report

* feat: ran linting

* feat: reverted compose file changes

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>

* Add Java 17 support (#12895)

* Add Java 17 support

* Change Test HTTP client provider

* Create Tests HTTP Client once

* Create Tests HTTP Client once

* fix(CI): Update CI to use jdk 17 and dockerfiles as well

---------

Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>

* Refactor Search

* Refactor Search

* Fix propgation bugs

* Fix propgation bugs

* Fix glossary term search

* Fix glossary term search

* Only issue search requests if the client is configured properly

* Only issue search requests if the client is configured properly

* Fix glossary index

* Merge main

* fix style

* deleted field propagation

* Fix style

* close the test client

* Changing to jersey connector

* Fix Authentication Exception headers

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-10-03 14:56:53 -07:00
Shailesh Parmar
efa0802995
ui: UI to use Tier TAG displayName if provided #12899 (#13105)
* ui: UI to use Tier TAG displayName if provided #12899

* updated tier label with displayName
2023-10-04 01:26:14 +05:30
karanh37
b5aff6bbc3
fix: encode search query text (#13420) 2023-10-03 19:52:19 +05:30
Sachin Chaurasiya
0ecc3fc136
chore(ui): change baseUrl in ts config (#13403)
* chore(ui): change baseUrl in ts config

* udpate references

* fix rest/* path

* fix tests paths to relative

* chore(ui): update reference

* fix unit tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-10-03 16:01:13 +05:30
Sriharsha Chintalapani
03ca972887
Add Java 17 support (#12895)
* Add Java 17 support

* Change Test HTTP client provider

* Create Tests HTTP Client once

* Create Tests HTTP Client once

* fix(CI): Update CI to use jdk 17 and dockerfiles as well

---------

Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-10-03 01:35:50 -07:00
Teddy
9ef3ff7a58
Cost analysis agg (#13408)
* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes

* feat: __init__.py files creation

* feat: updated workflow import classes in code and doc

* feat: moved kpi runner from runner to processor folder

* fix: skip failure on list entities

* feat: deleted unused files

* feat: updated status reporter

* feat: ran linting

* feat: fix test error with typing and fqn

* feat: updated test dependencies

* feat: ran linting

* feat: move execution order up

* feat: updated cost analysis report to align with new workflow

* feat: fix entity already exists for pipeline entity status

* feat: ran python linting

* feat: move skip_on_failure to method

* feat: added unusedReport to DI

* feat: added aggregated unused report

* feat: ran linting

* feat: reverted compose file changes

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-10-03 09:27:18 +02:00
Ayush Shah
744e5279bc
add documentation for sharded tables (#13361) 2023-10-03 12:49:05 +05:30
Onkar Ravgan
bc491be5ad
Fixed dbt optional files for local config (#13242) 2023-10-03 12:44:06 +05:30
Ayush Shah
462b2f9445
Fix Latest Pylint 3.0.0 issues (#13413)
* Fix Latest Pylint issues

* add compatible bound to pylint version
2023-10-03 07:43:09 +02:00
Pere Miquel Brull
b5596a4640
Batch PII tagging (#13385)
* Batch PII tagging

* Batch PII tagging

* Fix tests

* Fix tests
2023-10-02 14:44:41 +02:00
Pere Miquel Brull
5acf837e23
Fix #12870 - Troubleshoot Debian/CentOS Airflow apis installation (#13292) 2023-10-02 14:44:28 +02:00
Ashish Gupta
16a4033645
fix(ui): revamp teams page added supported subscription webhooks (#13296)
* revamp teams page added supported subscription webhook

* minor changes

* minor changes

* changes teams header page layout and subscription

* minor changes

* fix cypress and addressed comments

* fix cypress for teams hierarchy (#13352)

* fix sonar errors and users not showing in teams having space

* code smell and bugs fixes

* fix teams page cypress

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-10-02 18:12:23 +05:30
Ashish Gupta
e879d512d3
fix(ui): initial load tab details in container page (#13399)
* fix intial load tab details in container page

* fix update displayName tests

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-10-02 16:26:01 +05:30
Pere Miquel Brull
d915254fac
Prepare Storage Connector for ADLS & Docs (#13376)
* Prepare Storage Connector for ADLS & Docs

* Format

* Fix test
2023-10-02 12:15:09 +02:00
Teddy
6ca71ae323
Issue 12679 - Handle Entity Object Instantiation Error + Refactor Workflow (#13384)
* feat: updated DI workflow to inherit from BaseWorkflow + split processor and producer classes

* feat: __init__.py files creation

* feat: updated workflow import classes in code and doc

* feat: moved kpi runner from runner to processor folder

* fix: skip failure on list entities

* feat: deleted unused files

* feat: updated status reporter

* feat: ran linting

* feat: fix test error with typing and fqn

* feat: updated test dependencies

* feat: ran linting

* feat: move execution order up

* feat: updated cost analysis report to align with new workflow

* feat: fix entity already exists for pipeline entity status

* feat: ran python linting

* feat: move skip_on_failure to method

* feat: ran linting

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-10-02 12:05:30 +02:00
karanh37
41f56d62af
fix: add more button in feeds widget (#13341)
* fix: add more button in feeds widget

* fix: add feed filter

* fix: add localisation

* fix: add filter dropdown in feeds widget

* fix: missing localisation

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-10-02 15:14:39 +05:30
Chirag Madlani
241c838c64
fix(test): cypress skipped tests (#13360)
* fix(test): cypress skipped tests

* limit cypress tests to changed one

* fix service search

* enable cypress tests

* enable tier and owner spec

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-10-02 12:06:10 +05:30
Sriharsha Chintalapani
11f1df437b
Fix SettingsCache initialization (#13395)
* Fix SettingsCache initialization

* Fix SettingsCache initialization

* Fix SettingsCache initialization
2023-10-01 15:47:25 -07:00
Teddy
66d3fbb75d
feat: added german translation for OM (#13386) 2023-10-01 22:33:12 +05:30
Suresh Srinivas
2e2f9a1edb
Separate initialization of Repository and Resources (#13389)
* Separate initialization of Repository and Resources

* Change that speeds up the test. Still WIP

* Rebasing the branch with main

* Revert back previous changes and use Repositories from registry for migration

* Fixing test failures

* Code cleanup

* Fix test failures
2023-09-30 22:13:16 -07:00
Aniket Katkar
79558ab1a6
added quick links in how to guide homepage (#13390) 2023-09-29 21:10:55 -07:00
Sriharsha Chintalapani
762824665a
Fix #12655: Customizable Landing Page - Add Personas, DocStore to support KnowledgePanels and Pages (#13229)
* Fix #12655: Customizable Landing Page - Add Personas

* Add Knowledge Panels

* Add Doc Store to store KnowledgePanels and Pages

* Add Doc Store to store KnowledgePanels and Pages schemas

* Fix tests

* Add Multiple Persona support for a user

* add more elaborate tests for docstore

* Fix Page and KnowledgePanel required fields

* Fix Page and KnowledgePanel required fields

* Fix Page and KnowledgePanel required fields

* Fix build
2023-09-29 19:13:56 -07:00
Sriharsha Chintalapani
3a7f7486d0
Add indexes to name column for efficient ORDER BY name queries (#13383) 2023-09-29 14:19:49 +02:00
Onkar Ravgan
855790924e
Cost Analysis - Data Insights Reports and Aggregation (#13379)
* Added reports and indexes

* Clean code

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-09-29 11:50:43 +02:00
Teddy
162b181b4f
fix: pass metadata object to interface (#13339) 2023-09-29 08:02:02 +02:00
Teddy
96c083dbcd
Fix typo in test case listing query (#13357)
* fix: postgres query typo

* empty commit to run ci
2023-09-28 14:52:20 +02:00
07Himank
6a6e799ee6
missed adding supports search in pipelineService (#13366) 2023-09-28 17:20:22 +05:30
Shilpa Vernekar
351c20e23a
Added overview docs to activate the section links (#13353) 2023-09-28 15:13:23 +05:30
Sriharsha Chintalapani
6e5ad3f44c
Fix #13342: The activity feed does not reflect changes to the objects that the user is subscribed to (#13359) 2023-09-28 13:37:53 +05:30
Cristian Calugaru
5d8457b597
Fixes ISSUE-10587: global manifest option for storage services (#12017)
* global manifest option for storage services

* added a no metadata config source option for global manifest s3 services option

* merge fixes

* more merge fixes.

* black stuff

* test fixes

* formatting

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-09-28 07:55:40 +02:00
Keagan O'Donoghue
f2f3cfbb26
[Docs] - Add context for windows authentication from linux (#13356) 2023-09-28 09:42:50 +05:30
Suresh Srinivas
314efe918d
Fixes part 1 of 13255 - list filtering for services and data products (#13358) 2023-09-27 14:07:29 -07:00
Mayur Singal
1dee004dee
Fix snowflake test connection (#13354)
* Fix: Flaky Test Connection for Snowflake

* optimize code

* pyformat
2023-09-27 10:56:20 -07:00
07Himank
74e29a9f16
Generic search changes. (#13326)
* working on new search changes

* working on new search changes

* working

* working

* owner propogation done

* working on propogation

* done

* change in storageservice index

* Merge conflict fix

* Draft changes

* working on making updates generic

* added code to opensearchClientImp

* renamed suppportsSearchIndex to supportsSearch

* checkstyle

* added generic code for deleted as well

* fix tests

* fix all tests

* addressing comments

* fixed test case failure

* Fix lifecycle validation error name typo

* fix realted domain propogation

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-27 10:48:33 -07:00
Artiom Darie
7d2f8dc2bb
Fixes issue-11740: Added support for the om service to connect to AWS RDS using IAM roles (#11913)
* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Changed intial implementation accordingly. Added better flexibility for different auth prodvider impl

* ISSUE-11740: Clean up unnecessary classes

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Clean up unnecessary properties

* ISSUE-11740: Code formatting

* ISSUE-11740: Added support for the om service to connect to AWS RDS using IAM roles

* ISSUE-11740: Moved docs to 1.2 version

---------

Co-authored-by: artiom.darie <artiom.darie@adswizz.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-09-27 09:59:24 -07:00
Sriharsha Chintalapani
4d9570c627
Fix #13347: AdminPrincipals username with dot in it is not created wi… (#13348)
* Fix #13347: AdminPrincipals username with dot in it is not created with quoteFQN

* Fix #13347: AdminPrincipals username with dot in it is not created with quoteFQN

* Fix #13347: AdminPrincipals username with dot in it is not created with quoteFQN

* Fix test with new exception msg being thrown

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-09-27 15:59:24 +02:00
Pere Miquel Brull
2c3ff8dc08
Prep v1.1.7 migrations to address test cases & suites (#13345)
* Prep v1.1.7 migrations to address test cases

* get or create executable suite

* Format

* Fix tests

* Add postgres
2023-09-27 11:49:21 +02:00
Ayush Shah
d8ef497b9e
Fixes 13350: Trino Secrets masking (#13351) 2023-09-27 14:28:05 +05:30
karanh37
16f6b73d08
Part 2 of 3090: add glossary term approval workflow (#13324)
* feat: initial commit for glossary approval workflow

* fix: workflow scenario

* fix: add localization

* fix: add filters

* test: add cypress tests

* fix: show badge in header

* fix: hide glossary sidebar for glossary terms page

* fix: review comments

* fix: code smell

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-09-27 12:17:51 +05:30
Akash Jain
8a81f80837
fix(CI): Cypress Workflow timeout-minutes to 120 (#13340) 2023-09-26 19:07:47 +05:30
Aniket Katkar
c6d8f90f81
fixed custom attribute settings page for search index (#13335) 2023-09-26 19:06:43 +05:30
Aniket Katkar
82b06b1a79
chore(ui): search index details and version cypress (#13287)
* Added cypress for search index version page
Added cypress checks for domains on version pages

* Added cypress for search index details page with different roles

* worked on comments

* fixed comment
2023-09-26 17:46:28 +05:30
Pere Miquel Brull
9900764961
Pipeline Service Client - Handle unexpected status response (#13314)
* airflow install docs

* Pipeline Service Client - Handle unexpected response
2023-09-26 12:58:39 +02:00
Pere Miquel Brull
a4b9a2d2cb
Fix #13023 - Fix ingestionPipeline list parameters (#13289)
* Fix ingestionPipeline list parameters

* Fix test

* support filters from ui

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-09-26 10:57:14 +02:00
vanshika18
6f92c3be1f
fix #11882 upgrade MLflow to 2.x (#13299) 2023-09-26 11:04:15 +05:30
Mayur Singal
3769a9d105
Fix: Bigquery Table Tag not assigned (#13325) 2023-09-26 08:56:05 +05:30
Suresh Srinivas
dc5de12668
13188 (#13331)
* WIP

* Fixes #13188 Non-admin user can't add term on glossary after policy assigned
2023-09-25 12:09:25 -07:00
Sriharsha Chintalapani
106db87eec
Update EnumBackwardCompatibilityTest.java (#13328) 2023-09-25 09:53:40 -07:00
Chirag Madlani
226de71a26
fix(ui): contraint icon for table (#13322) 2023-09-25 09:31:01 -07:00
Ashish Gupta
8b37b92ffd
supported cypress for stored procedure and data models (#13312)
* supported cypress for stored procedure and data models

* fix failing cypress

* remove data model cypress
2023-09-25 21:53:03 +05:30