27 Commits

Author SHA1 Message Date
Mayur Singal
fd5f63fb58
Fix MSSQL connection with pyodbc scheme (#11304)
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-04-27 07:25:10 +02:00
Nahuel
2624a34933
Bug: Missing migration script after #10486 (#11297)
* Bug: Missing migration script after #10486

* Minor change

* Address PR comments
2023-04-26 15:32:02 +00:00
Pere Miquel Brull
7405ac748a
Fix dynamodb migration (#11285) 2023-04-26 09:13:39 +02:00
Mayur Singal
d0781dcc07
Remove partition fields from Bigquery (#11195)
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-23 06:38:17 +02:00
Mayur Singal
da2f03ca50
Salesforce docs & remove unnecessary fields (#11207) 2023-04-22 18:32:32 +02:00
Mayur Singal
e494cdfb65
Ingestion Docs: Superset, Snowflake, Bigquery, Azure SQL (#11180)
* Snowflake, Bigquery & Azuresql docs with superset migrations

* Superset Docs

* Auto PII is not a part of ingestion

* bigquery docs

* Azure SQL Docs

* Snowflake Docs

* Superset Docs

* Url to URL

* replace hr with ---
2023-04-21 18:23:45 +05:30
Mohit Yadav
971dcd2c5e
Remove Votes from migration (#11183) 2023-04-21 15:51:21 +05:30
Pere Miquel Brull
1cabfc99ca
Fix migrations (#11083) 2023-04-17 10:53:25 +02:00
Onkar Ravgan
bc6ce22a2b
Added oneof selection for tableau auth types (#11049)
* Added tableau oneof fields

* Fixed pytests

* fixed field in test

* Handle tableau auth converter

* Fixed java tests and imports

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-14 13:49:36 +05:30
Pere Miquel Brull
4da9aa4984
Add location migration queries (#11030)
* Add location migration queries

* add missing mode

* Added impala auth modes

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2023-04-13 18:05:44 +02:00
Mohit Yadav
08ecf69978
Fix Failing migrations (#11031)
* Fix Failing migrations

* fix migration for event Subscription

* delete relationships
2023-04-13 09:21:16 +05:30
Pere Miquel Brull
b5cb1d464a
Deprecate location and old storage service (#11004)
* Deprecate location and old storage service

* Format

* Fix test

* Refactor

* Clean location

* Rename object store to storage

* Rename object store to storage

* Rename object store to storage

* Format

* Format

* Refactor object store for storage

* Refactor object store for storage

* Rename object store to storage

* Fix test

* Fix test

* Format

* chore(ui): change Objectstore to  Storage

* Fixes

* Fix test

* Remove storage service from Glue cypress

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-04-12 11:44:46 +02:00
Deepa Rao
147b7c551e
Fixes #10854 - Create/Update Chart Not working as Expected (#10991) 2023-04-11 06:28:01 -07:00
Pere Miquel Brull
ac9979070a
[WIP] - Fixes #10725 - Fix extension in ingestion pipeline and delete statuses api (#10866)
* Fix extension in ingestion pipeline and delete statuses api

* Add tests for ingestion pipeline status

* Format
2023-04-06 19:12:18 +00:00
NiharDoshi99
325480fb2e
added migration scripts for druid and postgres docs update (#10920)
* added migration scripts for druid and postgres docs update

* postgres docs update
2023-04-04 22:45:19 +05:30
Nahuel
bea38d7200
Fix#10584: Add Data Model as an entity (#10636)
* Add Data Model as entity

* Add sample_data + update dashboard resource and repository with data models

* Fix Java style

* Addess PR comments

* Update bootstrap/sql/com.mysql.cj.jdbc.Driver/v009__create_db_connection_info.sql

* Pylint error

* Address PR comments

* Address PR comments

* Address PR comments

* Minor change

* Fix error in sample_data

* Fix failing test

* Add missing resource and event sub descriptors
2023-03-28 15:07:38 +00:00
Mohit Yadav
06498bc011
Update alerts api (#10265)
* Refactored Alerts Api

* missing semicolon

* fixed Test Cases

* missing files

* Randomly run webhook in tests

* - update EventResource to ChangeEventResource

* - remove trigger config

* - missing ResourceDescriptors.json entity entry

* remove alertAction

* fix typos

* fix typos

* updated ui as per new alert API

* updated delete functionality and cypress

* fixed failing cypress test

* review comments

* Revert "- update EventResource to ChangeEventResource"

This reverts commit 90290cebd6c9572c021af3bde75eaf63c289b749.

* ChangeEventList -> EventList

* Change SQL Query

* add Subscription Status Builder

* fix java style

* update name back to EventSubscription

* Fixed Tests

* Fix import

* missing .

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-21 10:12:49 +05:30
Mohit Yadav
2e48ef0107
Personal Access Token Feature (#10555)
* Personal Access Token Feature

* migration swap

* Remove postgres

* remove unnecessary enum

* review comments updated

* Add back setting JWTTokenExpiry when generating a JWTAuthMechanism

* added test around Personal Access Token

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-03-17 16:22:41 +05:30
Nahuel
6b2babadde
Fix: remove 'audience' field from OM metadata service security config (#10624)
* Fix: remove 'audience' field from OM metadata service security config

* Remove extra space

* Update bootstrap/sql/com.mysql.cj.jdbc.Driver/v009__create_db_connection_info.sql

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

* Update bootstrap/sql/org.postgresql.Driver/v009__create_db_connection_info.sql

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-03-16 14:11:44 +01:00
Mohit Yadav
b982d3fe2b
Query as entity (#10449)
* added query as an entity

* changed name of the variables and methods

* Added Resource Descriptors

* testcase bug fix

* addressing comments

* added script for table query migration

* added script for table query migration postgresql

* bug fix

* db change for script test

* added current timestamp

* change db config from postgresql to mysql

* added extension to use fucntion gen_random_uuid()

* solving maven ci

* added queryUsage and change is migration script

* addressing comments

* addressing comments

* added queryUsage relation and testcase

* added api to insert queries in bulk

* .

* fix a test case which was failing due to latest changes

* Ingestion Changes for Query as Entity

* move query changes to latest sqls

* added tags and owner

* update PR for Query as Entity

* update type

* fixed pagination

* fix path param

* fix TestCases

* add validation criteria

* removed exisitng query apis

* checkstyle fix

* remove vote from put

* remove vote from put

* Query As Entity Ingestion Changes

* Remove unused func

* update Review Comments

* update Review Comments

* remove previous changes for Query and Update Tests

* moved Checksum to Query Util Class

* update python api

* fix python checkstyle

* Fixed Tests

* Fix pytest

* remove space changes

* remove space changes

* Fixed put_addFollowerDeleteEntity_200

* Fix usage ingestion

* Update Python SDK and tests

* pylint fix

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-03-15 20:55:30 -07:00
Pere Miquel Brull
81dec813a0
Don't store the OM connection in the Ingestion Pipeline or Workflow (#10448)
* Do not store OM connection

* Migration to remove the server connection

* Update tests

* Add workflow masking and secrets manager

* Fix failing test

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-03-09 17:32:40 +01:00
Pere Miquel Brull
477a5223eb
Fix #10401 - Add Automations Workflow Resource & PUT service test connection result (#10437)
Fix #10401 - Add Automations Workflow Resource & PUT service test connection result (#10437)
2023-03-06 14:44:16 +01:00
Pere Miquel Brull
1e3652d35e
Fix #10382 - Test Connection Definitions, Results and Resource (#10383)
* Prep the skeleton

* Add DAO and tables

* Add Test Connection Definition Resource

* Format

* Add ResourceDescriptors & missing props

* Simplify APIs to scope for GET and LIST
2023-03-05 10:17:08 +01:00
Cristian Calugaru
3f61c3e05d
Issue 9064 - New Object Store Service and Container models (#10283)
* First cut of the store service model

* Second cut of the store service model

* reverted accidental rename of property

* Third version for the object container schema definition.

* final draft version for container and object store service related entities

* final first draft of api's and entities for the object store service and container

* formatting

* removed test file

* formatting

* test fixes

* formatting

* more fixed tests

* fixed tests, addressed PR comments

* added type for object store connections

* addressed PR comments

* formatting

* renamed objectstoreservice to service in schemas. Changed type to fullyQualifiedEntityName in createContainer schema
2023-02-24 16:34:08 -08:00
Mayur Singal
0fafbf70ba
Support postgres multiple DB ingestion for user with no access (#10207) 2023-02-23 15:42:40 +05:30
Ayush Shah
785142d86a
Add policy tags from Bigquery (#10189) 2023-02-20 19:13:45 +00:00
Suresh Srinivas
57093e583a
Fixes #10212 User email address should be unique (#10214) 2023-02-15 21:04:23 -08:00