* fix: made databricks httpPath required and added a migration file for the same
* fix: added sql migration in postDataMigration file and fix databricks tests
* fix: added httpPath in test_source_connection.py and test_source_parsing.py files
* fix: added httpPath in test_databricks_lineage.py
* fix: table name in postgres migration
* percona server for postgresql support
The only meaningful difference is version string in percona server for postgresql. So commit propose universal and safe way to detect server version by integer string, not complicated parsing of unformatted string.
* updated tests with get_server_version_num
commented outdated tests
---------
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
* fix(bigquery): unquote and convert any escaped characters to their actual representations
* test: bigquery description with multiple line
---------
Co-authored-by: Imri Paran <imri.paran@gmail.com>
* fixes arrayDataType must be not null, adding db name to queries as it fails
* Fix Pydantic Issue
* Partial: Add Unity Catalog Topology Test
* Fix lint
* Fix Tests, Fix UnityCatalog Array Column issue
* Fix Tests
* Address comments, add logger to the exception
* Add multiple owners
* Multi Ownership
* Issue #17012: Multi User/Team Ownership
* Issue #17012: Multi User/Team Ownership
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 1
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 2
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 3
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 4
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 5
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 6
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 7
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 8
* Add Migrations for Owner Thread
* update ingestion for multi owner
* fix pytests
* fixed checkstyle
* Add Alert Name to Publishers (#17108)
* Add Alert Name to Publishers
* Fix Test
* Add Bound to Setuptools (#17105)
* Minor: fixed testSummaryGraph issue (#17115)
* feat: updated multi pipeline ui as per new mock (#17106)
* feat: updated multi pipeline ui as per new mock
* translation sync
* fixed failing unit test
* fixed playwright test
* fixed viewService click issue
* sorted pipeline based on test case length
* Added domo federated dataset support (#17061)
* fix usernames (#17122)
* Doc: Updated Doris & Redshift Docs (#17123)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
* Fix#12677: Added Synapse Connector - docs and side docs (#17041)
* Fix#17098: Fixed case sensitive partition column name in Bigquery (#17104)
* Fixed case sensitive partiion col name bigquery
* update test
* #13876: change placement of comment and close button in task approval workflow (#17044)
* change placment of comment and close button in task approval workflow
* minor change
* playwright test for the close and comment function
* supported ref in activityFeedEditor
* fix playwright test
* added playwright test for data steward
* fix the test for the data streward user
* fix the close button not showing if task has no suggestions and icon fixes
* fix sonar issue
* change glossary and add suggestion button to dropdown button
* fix the glossary failure due to button change
* icon change for add tag and description
* fix glossary cypress failure due to button chnages
* changes as per comments
* MINOR: docs links fix (#17125)
* alation link fix
* dbt yaml config source link fix
* bigquery doc fix
* Explore tree feedbacks (#17078)
* fix explore design
* update switcher icon
* show menu when search query exists
* fix selection of active service
* fix type error
* fix tests
* fix tests
* fix tests
* MINOR: Databricks view TableType fix (#17124)
* Minor: fixed AUT test (#17128)
* Fix#16692: Override Lineage Support for View & Dashboard Lineage (#17064)
* #17065: fix the tags not rendering in selector after selection in edit tags task (#17107)
* fix the tags not rendering in selector after selection in edit tags taks
* added playwright test
* minor changes
* minor fix
* fix the tags not updating in edit and accept tag
* fix explore type changes for collate (#17131)
* MINOR: changed log level to debug (#17126)
* changed log level to debug
* fixed type
* changed type to optional
* Get feed and count data of soft deleted user (#17135)
* Doc: Adding OIDC Docs (#17139)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
* Doc: Updating Profiler Workflow Docs URL (#17140)
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
* fix playwright and cypress (#17138)
* Minor: fixed edit modal issue for sql test case (#17132)
* Minor: fixed edit modal issue for sql test case
* fixed test
* Minor: Added whats new content for 1.4.6 release (#17148)
* MINOR [GEN-799]: add option to disable manual trigger using scheduleType (#17031)
* fix: raise for triggering system app
* added scheduleType ScheduledOrManual
* minor: remove "service" field from required properties in createAPIEndpoint schema (#17147)
* initial commit multi ownership
* update glossary and other entities
* update owners
* fix version pages
* fix tests
* Update entity_extension to move owner to array (#17200)
* fix tests
* fix api page errors
* fix owner label design
* locales
* fix owners in elastic search source
* fix types
* fix tests
* fix tests
* Updated CustomMetric owner to entityReferenceList. (#17211)
* Fix owners field in search mappings
* fix search aggregates
* fix inherited label
* Issue #17012: Multi User/Team Ownership - Fix Tests - Part 9
* Fix QUeries
* Fix Mysql Queries
* Typo
* fix tests
* fix tests
* fix tests
* fix advanced search constants
* fix service ingestion tests
* fix tests
---------
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: k.nakagaki <141020064+nakaken-churadata@users.noreply.github.com>
Co-authored-by: Prajwal214 <167504578+Prajwal214@users.noreply.github.com>
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
Co-authored-by: harshsoni2024 <64592571+harshsoni2024@users.noreply.github.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: Imri Paran <imri.paran@gmail.com>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Siddhant <86899184+Siddhanttimeline@users.noreply.github.com>
* get table ddl for athena tables
* changes in method to get all table ddls
* external table/container lineage for athena
* column lineage for external table lineage
* unittest for athena
* pyformat changes
* add external table lineage unit test
* fix unittest with pydantic v2 changes
* fix unittest formating
* fix code smell
* Implement Initial MultiThread suggestion
* Update all the ingestion sources to use the new ContextManager
* Fix missing wraps on decorator
* Fix Unittests
* Fix linters
* Fix linters
* Fix BigQuery UnitTests
* Add UnitTests to the newly created code
* Fix unittest
* change the threads from table to schemas
* Update README.md
* Small change suggested by Sonar
* Slight change to test a different way to multithread over tables
* Debug changes
* More multithread tests
* Remove uneeded wait time
* Testing
* refactor code based on removal of time.sleep
* Fix wrong paste
* Improve ExecutionTimeContextManager
* Fix missing .get() and unit tests
* Fix conflicting changes
* Update Multithread logic with the incremental extraction
* Fix linters
* Fix unittest
* Remove commented code
* Fix Unittests
* Fix checkstyle
* Change default to threads = 1
* feat(connector): add BigTable
* bigtable work
1. docstrings
2. tests
3. created a Row BaseModel
4. implemented a ClassConverter
* docs moved to separate PR
* format files
* minor cosmetic
- removed TODO
- changed headers' year to 2024 for new files
- fixed typos
* format
* formatting and comments
1. added missing docstrings.
2. abstracted the _find_instance method.
3. aliased the IDs used in the BigTable connection
* added comment regarding private key
* added comments regarding column families
* enclose get_schema_name_list in `try/except/else`
* format
* streamlined get_schema_name_list to include all logic in the try block
* linting: fix python linting
* fix: get column types from parquet schema for parquet files
* style: python linting
* fix: remove displayType check in test as variation depending on OS
* Create the iceberg connection schema
* Link the IcebergConnection configuration with the forms on the UI
* Add the pyiceberg dependency on the ingestion package
* Create the get_connection and test_connection functions
* First iteration on the iceberg ingestion logic
* Add A more comprehensive implementation of the Iceberg Source
* Add UnitTests
* Update icebergConnection definition
* Update the iceberg souce code based on new schema
* Updated icebergConnecgtion schema for simplicity and to be able to configure Converters
* Updated setup dependencies to be more flexible
* Updated get_owner_ref logic
* Fix formatting
* Changed the icebergConnection json schema structure to enable the ClassConverters
* Add the IcebergCatalog and IcebergFileSystem ClassConverters
* Refactor the code to take into account the new jsonSchema structure
* Fix formatting
* Add Documentation for the Iceberg Connector
* Fix Menu order for Iceberg
* ui: add Iceberg service icon and constant
* Fix DynamoDb Catalog issue due to how PyIceberg instantes it
* Changed uri title to URI
* Fix ClassConverter for Iceberg
* Fix GetSecretValue for password types
* Fix formatting
* Fix formatting
* Add Iceberg Connector Images for the docs
* Add pylint disable for Hacky super() call
* Add Iceberg.md for the UI docs
* Fix pylint complaint
* Fix pylint complaint
* Fix UnitTests
* fix type error and unit tests
* update pipeline type checks
* Fix Sonar Cloud complaints
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
