32 Commits

Author SHA1 Message Date
sonika-shah
cce22a1b5c
Improve count/feed api performance for 1.5 (#17576) 2024-08-23 11:20:34 -07:00
sonika-shah
266920197f
Implement full text index on taskAssigneesIds column in both mysql and postgresql (#17520)
* Implement full text index on taskAssigneesIds column in both mysql and postgresql

* move migrations in 1.5
2024-08-21 12:18:50 -07:00
Onkar Ravgan
f2f8f49cfc
update test def name len (#17522) 2024-08-21 09:27:07 -07:00
mohitdeuex
30a3f32b0f Change Query for Postgres 2024-08-21 17:07:45 +05:30
Mohit Yadav
9309cf94c1
Add Api Service, Collection and Endpoint in reindex app (#17527)
* Add Api Service and Collection and Endpoint

* Keep SearchIndexing as false by Default
2024-08-21 16:26:50 +05:30
Pere Miquel Brull
f7aab6b7a4
MINOR - Fix list API for automation workflows (#17494)
* MINOR - Fix list API for automation workflows

* MINOR - Fix list API for automation workflows
2024-08-20 12:40:21 +02:00
Onkar Ravgan
2a8ee41c38
Fix entity_ext owner update query (#17493) 2024-08-19 16:01:07 -07:00
sonika-shah
424a03f49c
add index on extension_index table (#17496) 2024-08-19 15:18:53 -07:00
Imri Paran
7508848376
fix(dq): data types for unique columns (#17431)
1. remove json and array from supported data types of unique column test.
2. migrations.
3. tests.
2024-08-19 14:28:42 +02:00
Mohit Yadav
6e80d3f405
Fix Migrations (#17364) 2024-08-09 20:58:44 +05:30
Ayush Shah
ab1e400990
Minor: Remove 'owner' field from JSON in various entities (#17290)
* Remove owner field from json in various entities

* Add Psql migrations for owner

* Modify operator type for query

* chore: Update table_entity JSON structure to include dataModel owners
2024-08-05 07:58:07 -07:00
Teddy
1349f165b3
[GEN-1069] - Fix dbt issues in ingestion (#17247)
* fix: dbt errors when creating test case

* fix: use fqn builder
2024-08-02 12:29:48 +02:00
Pere Miquel Brull
b56f1d08a8
MINOR - remove owner and service field from ingestion pipeline (#17270)
* MINOR - remove owner and service field from ingestion pipeline

* MINOR - remove owner and service field from ingestion pipeline
2024-08-02 06:49:02 +02:00
Mohit Yadav
f07daae196
[RbacDomain] RBAC with Domain Restrictions (#16586)
* Add domain field to entity jsons

* add subdomains ui

* Add Domain To create Request

* Typo fix

* commit progress

* allow multiple domains

* - add userDomains and teamDomains

* - Restrict Api Access

* allow multiple domain support

* - Add Listing Restricition
- Add Search Restrictions

* - Field Fix

* - Inherit Team Domains

* remove glossary filter from ui

* - Fix Tag and User Filter

* - Id -> FQN in create

* - Missing domain on indexes

* add domain in creation of team, user and glossary

* fix merge conflicts

* fix feedbacks

* fix tests

* add domain playwright

* minor changes

* fix domain fetching calls

* Add Thread Listing with EntityDomain

* Fixes for Team Join

* Mkae list mutable

* Add missing import

* Fix Team Test

* User Test case fix

* Fix User Domain

* Minor bug fixes related to sub domains

* Fix data retaining in add sub domain modal after closing

* fix NavBar unit test

* Make Domain Access Work Via Policies

* Fix errors introduced after conflict resolutions

* update render function in SubDomainsTable.component.tsx to accept an array of owners instead of a single owner

* fix java checkstyle

* fix py-test

* format

* Fix the domain e2e owner field type

* Fix Failing Tests

* fixed pytest list index

* update userDomains and teamDomains to domains

* Entity Domain to Domain for thread and changeEvent

* FIx fields

* @Ovveride

* FIx

* Remove Duplicate Field

* Remove Duplicate Field

* Fix Failing Test

* fix domain related changes

* fix subdomains loader

* Fix Owners Order

* Enforce Domain Permissions

* fix domain cleanup

* Fix Test

* rever owner change

---------

Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
2024-08-02 10:16:14 +05:30
Siddhant
0ca3d7afb8
Fetch templates for collate and oss. (#17254)
* fetch template for oss and collate.

* migrations.
2024-08-01 11:01:36 +02:00
Mayur Singal
ef67474310
Data Insights Refactor (#16532)
---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Pablo Takara <pjt1991@gmail.com>
Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-07-30 17:38:43 +05:30
Sriharsha Chintalapani
fe107aa3cb
Issue #17012: Multi User/Team Ownership (#17013)
* Add multiple owners

* Multi Ownership

* Issue #17012: Multi User/Team Ownership

* Issue #17012: Multi User/Team Ownership

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 1

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 2

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 3

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 4

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 5

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 6

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 7

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 8

* Add Migrations for Owner Thread

* update ingestion for multi owner

* fix pytests

* fixed checkstyle

* Add Alert Name to Publishers (#17108)

* Add Alert Name to Publishers

* Fix Test

* Add Bound to Setuptools (#17105)

* Minor: fixed testSummaryGraph issue (#17115)

* feat: updated multi pipeline ui as per new mock (#17106)

* feat: updated multi pipeline ui as per new mock

* translation sync

* fixed failing unit test

* fixed playwright test

* fixed viewService click issue

* sorted pipeline based on test case length

* Added domo federated dataset support (#17061)

* fix usernames (#17122)

* Doc: Updated Doris & Redshift Docs (#17123)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* Fix #12677: Added Synapse Connector - docs and side docs (#17041)

* Fix #17098: Fixed case sensitive partition column name in Bigquery (#17104)

* Fixed case sensitive partiion col name bigquery

* update test

* #13876: change placement of comment and close button in task approval workflow (#17044)

* change placment of comment and close button in task approval workflow

* minor change

* playwright test for the close and comment function

* supported ref in activityFeedEditor

* fix playwright test

* added playwright test for data steward

* fix the test for the data streward user

* fix the close button not showing if task has no suggestions and icon fixes

* fix sonar issue

* change glossary and add suggestion button to dropdown button

* fix the glossary failure due to button change

* icon change for add tag and description

* fix glossary cypress failure due to button chnages

* changes as per comments

* MINOR: docs links fix (#17125)

* alation link fix

* dbt yaml config source link fix

* bigquery doc fix

* Explore tree feedbacks (#17078)

* fix explore design

* update switcher icon

* show menu when search query exists

* fix selection of active service

* fix type error

* fix tests

* fix tests

* fix tests

* MINOR: Databricks view TableType fix (#17124)

* Minor: fixed AUT test (#17128)

* Fix #16692: Override Lineage Support for View & Dashboard Lineage (#17064)

* #17065: fix the tags not rendering in selector after selection in edit tags task (#17107)

* fix the tags not rendering in selector after selection in edit tags taks

* added playwright test

* minor changes

* minor fix

* fix the tags not updating in edit and accept tag

* fix explore type changes for collate (#17131)

* MINOR: changed log level to debug (#17126)

* changed log level to debug

* fixed type

* changed type to optional

* Get feed and count data of soft deleted user (#17135)

* Doc: Adding OIDC Docs (#17139)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* Doc: Updating Profiler Workflow Docs URL (#17140)

Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>

* fix playwright and cypress (#17138)

* Minor: fixed edit modal issue for sql test case (#17132)

* Minor: fixed edit modal issue for sql test case

* fixed test

* Minor: Added whats new content for 1.4.6 release (#17148)

* MINOR [GEN-799]: add option to disable manual trigger using scheduleType (#17031)

* fix: raise for triggering system app

* added scheduleType ScheduledOrManual

* minor: remove "service" field from required properties in createAPIEndpoint schema (#17147)

* initial commit multi ownership

* update glossary and other entities

* update owners

* fix version pages

* fix tests

* Update entity_extension to move owner to array (#17200)

* fix tests

* fix api page errors

* fix owner label design

* locales

* fix owners in elastic search source

* fix types

* fix tests

* fix tests

* Updated CustomMetric owner to entityReferenceList. (#17211)

* Fix owners field in search mappings

* fix search aggregates

* fix inherited label

* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 9

* Fix QUeries

* Fix Mysql Queries

* Typo

* fix tests

* fix tests

* fix tests

* fix advanced search constants

* fix service ingestion tests

* fix tests

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: k.nakagaki <141020064+nakaken-churadata@users.noreply.github.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: harshsoni2024 <64592571+harshsoni2024@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
2024-07-30 08:06:39 +02:00
Mohit Yadav
c6e7938e47
[Issue-16343]Activity Feed Improvements (#17086)
* Add entityRef in Thread_entity

* fix testCase breadcrumb, profile pic and supported entity reference

* fix sonar

* fix feed reseting on deleting comments

---------

Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2024-07-28 05:25:06 -07:00
Teddy
1ed279039b
fix: typo in DQ migration filter (#17183) 2024-07-26 06:19:50 +00:00
Imri Paran
b41a505795
MINOR [GEN-799]: add option to disable manual trigger using scheduleType (#17031)
* fix: raise for triggering system app

* added scheduleType ScheduledOrManual
2024-07-23 17:42:26 +02:00
Mohit Yadav
7c80c07eab
Move Migration to 1.4.6 (#17095) 2024-07-19 12:16:53 +05:30
Mohit Yadav
b1620e682a
Fix Users Issue due to capital names (#16828)
* Fix Users Issue due to capital names

* Fixed Tests

* No lowercasing name

* Revert

* toLowerCase

* fix email casing from UI side on basic auth

* compare lowercase email only from the loggedInUser

* address comments

* Updated LowerCase UserName on updates

* revert ui changes

* Migrate Name and Email

* cypress failure

* fix glossary test

* fix activity feed test

* Compare by Lowercasing Email and username

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Chira Madlani <chirag@getcollate.io>
Co-authored-by: karanh37 <karanh37@gmail.com>
2024-07-19 11:39:09 +05:30
Pere Miquel Brull
82228a1098
MINOR - Clean automations_workflow (#17005) 2024-07-18 12:03:22 +02:00
Antoine Balliet
e67ba6b14c
feat: BigQuery ingestion allow specify projectId and fix primary key constrains retrieval (#16956) 2024-07-17 11:21:17 +05:30
Sachin Chaurasiya
6e99fe7bda
fix(#15683): backend validation error for the following property types (#16881)
* fix(#15683): backend validation error for the following property types

* feat: Update supported date and datetime formats

* test: add e2e playwright test for custom properties

* chore: remove cypress test for custom properties

* Add date, dateTime, time backend support for custom property

* fix: update custom property display names in AddCustomProperty component

* feat: Update supported date and time formats

* chore: Update supported date and time formats

* feat: Update date and time formats in CustomProperty

* test: add playwright test

* Update supported date and time formats

* feat: Add tests for custom properties in Playwright in 2 parts

* Update supported date and time formats

* Update supported date and time formats

* chore: Update date format to uppercase in PropertyValue component

* feat: Add support for custom date format in PropertyValue component

* Update supported date and time formats

* test: add playwright test for time, dateTime, timeInterval and date properties

* Update supported time formats

* chore: Add focus to time and date pickers before filling values

* chore: Add focus to time and date pickers before filling values

* Remove date, dateTime, time from type_entity

---------

Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-07-15 11:37:38 +05:30
Pere Miquel Brull
27f4d9799e
REL #460-CL - Metadata Actions Create Permissions (#16955)
* REL #460-CL - Metadata Actions Create Permissions

* format
2024-07-09 11:13:57 +02:00
Pere Miquel Brull
97a733b704
FIX #16231 - Ingestion Pipeline w/ Bot Assignment (#16941)
* FIX #16231 - Ingestion Pipeline w/ Bot Assignment

* format
2024-07-08 11:19:16 +02:00
Sriharsha Chintalapani
74573ee4fa
Issue #10933: New Entity: API Services (#16878)
* API Service Schemas

* Create API Service Schemas

* Create API Service Schemas

* Add API Collection APIs

* Add API Endpoint APIs

* Fix #10933: New Entity: API Services

* Fix Postgres schema creation for API entities

* domain ref

* fix RESTConnection.json

* Fix openAPI reserved keyword

* fix ref

* Fix for Java Heap Space Issue

* fix APISchema spec

* fix APISchema spec

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2024-07-05 06:35:32 -07:00
IceS2
927bf56738
Moved Delta Migrations to schemaChanges.sql (#16789) 2024-06-28 15:40:41 +00:00
IceS2
f0049853ec
FIXES 14885: Initial deltalake implementation for s3 (#16665)
* Initial deltalake implementation for s3

* Fix styles

* Fix test_amundsen

* Fix UnitTests

* Fix Checkstyle

* Fix integration tests due to datalake client refactor

* Fix unit tests

* Fix tests

* Fix Integration DeltaLake Storage test

* Skip delta storage integration test for python 3.8

* DeltaLake JSONSchema changes migrations

* Update import name

* Add some comments based on sonarcloud suggestions

* Update DeltaLake documentation

* Resolve some comments
2024-06-20 12:08:21 +05:30
Teddy
ff00175fb1
MINOR - Data Quality Preparatory Work (#16523)
* chore: added min/max bound and dynamic support flag

* chore: added migration for dynamic attribute

* style: fix pythin checkstyle
2024-06-10 11:03:55 +02:00
Imri Paran
a4c516d2c7
Fixes 16305: Added Test Case for Matching Enum (#16362)
* Added Test Case for Matching Enum

1. Implemented the test case using the `matchEnum` parameter.
2. Added integration tests.
3. Added migrations.

* fix tests

* fixed tests

* format

* fixed tests

* clear search cache before running ingestion

* format

* changed scopt of aws fixture

* moved migrations to 1.5.0
2024-05-28 09:30:30 +02:00