Nahuel
df909703eb
Fix#6615: Fix failing test still in CI ( #7725 )
...
* Fix failing test still some tests are failing
* Fix bug in service entity repository
* Fix all tests except Ingestion Pipeline integration tests
* Fix Ingestion Pipeline integration tests
* Fix failing Python tests
2022-09-26 20:39:42 +02:00
Milan Bariya
1c78e835d9
Fix: Error initializing ingest: ‘RedshiftSource’ object has no attribute ‘dbt_manifest’ ( #7723 )
2022-09-26 19:42:22 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler ( #7506 )
2022-09-26 19:41:40 +05:30
Nahuel
e49ad000ee
Fix#6615: Configure a bot account and provider service or jwtAuthToken from the UI ( #7637 )
...
* Update JSON schemas
* Update create and update endpoint and remove /generateToken endpoint
* Add AuthMechanism and Token Expiry Field on the Add bot page
* Remove unwanted tests
* Add logic to show authMechanism based on auth provider
* Add authConfig to bots details page
* Backend implementation with secret manager
* Fix invalid date issue
* Add support for update bot token details
* Add logic for SSO auth
* Add fields for google sso auth client
* Add Edit Option.
* Updated ingestion CLI and secret manager issues
* Updated tests with errors
* Removed unused method
* Removed test files
* Fix broken JSON schema
* Fix typescript error
* Pass the bot permissions from the bot details page
* Minor errors related to the secret manager
* Restore Airflow configuration for retrocompability
* Add support for all SsoServiceType client config
* Fix Unit test
* Update tests
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-09-26 18:26:24 +05:30
NiharDoshi99
d9f3ab23d7
Fixed: SampleData Teams and teamTypes ( #7682 )
2022-09-26 18:22:41 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions ( #7653 )
...
* Added control for DBT descriptions
* Fixed tests
* Added UI changes
* fixed maven ci tests
* Java formatting changes
* ui review fixes
* Fixed pytests
* Fixed python integration tests
* fixed airflow tests
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30
Mayur Singal
2df214a381
Revamp filter patterns ( #7662 )
2022-09-26 12:23:32 +05:30
Teddy
c6fcad2c1d
Fixes #7478 -- Added Hive syntax for RAND and PERCENTILE functions ( #7685 )
...
* Added Hive syntax for RAND and PERCENTILE functions
* Added logic to handle missing context attributes in post_process of the topology
* Removed commit to wrong brancg
2022-09-23 15:48:09 -07:00
Teddy
bdf85d0eae
Added logic to handle missing attributes from the context ( #7696 )
2022-09-23 15:47:53 -07:00
mohitdeuex
cceff48f0d
Default token ( #7695 )
2022-09-23 20:03:54 +05:30
NiharDoshi99
8adcf2ee3d
Fixed: Dagster to work with its API ( #7579 )
2022-09-23 17:46:40 +05:30
Teddy
f2bf5194bb
Fixes #7623 -- Added logic to encode and decode entityLink ( #7670 )
...
* Encode entityLink string when processing request
* Added logic to decode column type from entityLink
* mvn code formating
* Extracted unquote step into its own function
2022-09-23 09:42:33 +02:00
Ayush Shah
e430e5a1c6
Fix Bigquery ADC project id overriding ( #7666 )
2022-09-23 09:48:12 +05:30
Teddy
c34281251f
Fixes #7509 - implement import path migration script ( #7515 )
...
* Added script to migarte import
* Added tests
* Updated doc to include info about import migration
* renamed test resource files
2022-09-22 14:43:25 +02:00
Milan Bariya
d1a3fa4928
Fix: Remove min duration limit ( #7627 )
2022-09-22 18:10:17 +05:30
Ayush Shah
517e9a4aac
Remove unused imports ( #7657 )
2022-09-22 16:42:10 +05:30
Mayur Singal
680a186209
Added Exception Handling for Bigquery Tags & Fix py-test CI ( #7649 )
2022-09-22 14:08:04 +05:30
Sriharsha Chintalapani
f6af18986b
Fix #7619 : Follow-up fix to ingestion to index parents ( #7645 )
2022-09-21 21:02:36 -07:00
Sriharsha Chintalapani
adaa8e7493
Fix #6917 : startTs & endTs filters providing paginated data ( #7617 )
...
* Fix #6917 : startTs & endTs filters providing paginated data
* Updated ui side changes
* Fixed OM tests end to end test
* Fix #6917 : startTs & endTs filters providing paginated data
* Fix #6917 : startTs & endTs filters providing paginated data
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-09-21 13:33:47 -07:00
Sriharsha Chintalapani
0dd177ac2c
Fix #7619 : Teams hierarchy is not working as expected in Signup and Add User pages ( #7621 )
2022-09-20 22:53:03 -07:00
Onkar Ravgan
254b0b64d1
Tableau lineage using Graphql ( #7603 )
...
* Added graphql query
* Added tableau lineage with graphql
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-21 11:14:32 +05:30
Mayur Singal
a439161d8b
#7316 : Bump sqllineage version to 1.3.6 ( #7598 )
...
Co-authored-by: Mayur <mayur@Mayurs-MacBook-Pro.local>
2022-09-21 10:14:47 +05:30
Mayur Singal
947cb4e99e
Fix #7316 : Fix Hive View error for older version ( #7592 )
2022-09-21 07:50:17 +05:30
Abhishek Pandey
d40be7a9aa
postgres-sql-query-updated ( #7421 )
2022-09-21 07:04:06 +05:30
Nahuel
301433e0d0
Airflow container can not be restarted ( #7615 )
2022-09-20 14:37:39 -07:00
Nahuel
3e4d4c5ee6
Fix DOCKER_URL_ROOT value for docker.py ( #7600 )
2022-09-20 17:16:22 +02:00
Pere Miquel Brull
1578fa7f1b
Fix #7121 - Support Spark metastore DB connection ( #7520 )
...
* Fix #7121 - Support Spark metastore DB connection
* appname
* Update docs
* test validation
* Address PR comments
Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-09-20 16:47:57 +02:00
Ayush Shah
c522fa1de2
Add Specific Projectid support feature ( #7591 )
2022-09-20 17:36:10 +05:30
Onkar Ravgan
5f2d7c5dfc
Added ingesting teams from DBT ( #7576 )
...
* Added ingesting teams from DBT
* Added warnings
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-20 16:14:00 +05:30
Teddy
bdfdc50a5a
Fixes #7422 - Implement FROM table SAMPLE ... for Snowflake sampling ( #7555 )
...
* Updated sampling for snowflake
* Fixed python style
2022-09-20 08:55:39 +02:00
Teddy
e22036cc09
Fixes #7504 Added migration steps to delete profiler pipeline from entity relationship ( #7511 )
...
* Added migration steps to delete profiler pipeline from entity relationship
* Added migration to remove rows from entity_relationship with profiler pipelines
* Fixed sample data TestDefinition name after renaming testDefinition
* Added user_tokens table to v005
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2022-09-20 08:14:29 +02:00
Sriharsha Chintalapani
9b35547fa5
Fix #7562 : Fix search suggest for soft-deleted entities ( #7563 )
2022-09-19 17:22:23 -07:00
Nahuel
2a6c6134f4
Fix#7272: Improve logging when initializing workflow from CLI ( #7522 )
...
* Improve logging when initializing workflow from CLI
* Fix broken tests
2022-09-19 08:00:00 -07:00
Onkar Ravgan
e6de43b081
Added miising dictionaries ( #7545 )
...
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-19 18:00:14 +05:30
Akash Jain
fc8312c5fb
feat: Refactor openmetadata/ingestion docker image ( #7456 )
...
* centralize openmetadata/ingestion docker image
* update volume mappings; fix ingestion tag!
* fix PR comments
* fix cypress mysql tests!
2022-09-19 09:20:54 +05:30
Cristian Calugaru
a326d3bcc0
lib upgrades ( #7536 )
...
* lib upgrades
* black reformatting
* downgraded datamode-core-generator to 0.13.0 and pydantic to 1.9.0
2022-09-18 16:51:49 -07:00
Pere Miquel Brull
6700f169ab
Fix #7165 - Handle SSL certificates on ometa client ( #7502 )
...
Fix #7165 - Handle SSL certificates on ometa client (#7502 )
2022-09-16 09:39:27 +02:00
Mayur Singal
02f0945bb6
Fix #7159 : Fixed nested column issue in bigquery ( #7492 )
2022-09-16 07:05:35 +02:00
Teddy
1ba6e284fe
Fixes #7118 by cleaning up test names ( #7494 )
...
* Cleaned up tests names and add registry name tests
* Updated documentation for test types supported by OM
2022-09-16 07:04:56 +02:00
Teddy
25d1789195
Fixes #7500 Added logic to fetch compose file from release ( #7501 )
...
* Added logic to fetch compose file from release
* Used client version utility
2022-09-15 19:32:30 +02:00
Teddy
3fdbe6ecfb
Added logic to report column level metric computation failure for profiler ( #7465 )
2022-09-15 17:39:29 +02:00
Milan Bariya
8502bf8e49
Fix: DBT root config error handled ( #7446 )
...
* Fix: DBT root config error handled
* Fix: DBT root config error handled
* Fix: Py-test
* Fix: Change based on comments
2022-09-15 18:26:05 +05:30
Nahuel
86ebb2025f
Fix#7407: Add custom source connections for different service types ( #7419 )
...
* Fix #4639 : Custom Service Schema
* Add custom source as service for different connections type
* Minor typo fix
* Add new service connections to UI
* Fix minor error
* Rename field config to connectionOptions
* Remove sourcePythonClass default value
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-09-15 10:53:27 +02:00
NiharDoshi99
5eb45948bd
Fixed: PostGIS geometry type ( #7382 )
...
Fixed: PostGIS geometry type (#7382 )
2022-09-15 10:35:15 +02:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469 : Refactor OpenMetadata code modules ( #7474 )
2022-09-14 23:14:02 -07:00
Milan Bariya
591517a487
Fix: Align pre-commit isort ( #7380 )
2022-09-14 15:10:06 +02:00
Teddy
0bb83f138b
Fixed table filter pattern for bigquery service ( #7416 )
2022-09-14 15:00:45 +02:00
Mayur Singal
95b570178a
Fixed Logging Error for airflow lineage backend ( #7438 )
...
* Fixed Loggin Error
* pyformat
2022-09-14 06:33:09 +02:00
Teddy
d171e2f100
Removed typing_extension dependency ( #7406 )
2022-09-13 15:10:11 +02:00
Teddy
71679137a0
Fixes #6009 - Adds SQA MetaData object instance per DB ( #7388 )
...
* Added SQA MetaData object instance per DB to allow same schema/table name across multiple db
* Update ingestion/src/metadata/orm_profiler/orm/converter.py
updated type hint
2022-09-12 18:05:36 +02:00
