1489 Commits

Author SHA1 Message Date
Teddy
c34281251f
Fixes #7509 - implement import path migration script (#7515)
* Added script to migarte import

* Added tests

* Updated doc to include info about import migration

* renamed test resource files
2022-09-22 14:43:25 +02:00
Milan Bariya
d1a3fa4928
Fix: Remove min duration limit (#7627) 2022-09-22 18:10:17 +05:30
Ayush Shah
517e9a4aac
Remove unused imports (#7657) 2022-09-22 16:42:10 +05:30
Mayur Singal
680a186209
Added Exception Handling for Bigquery Tags & Fix py-test CI (#7649) 2022-09-22 14:08:04 +05:30
Sriharsha Chintalapani
f6af18986b
Fix #7619: Follow-up fix to ingestion to index parents (#7645) 2022-09-21 21:02:36 -07:00
Sriharsha Chintalapani
adaa8e7493
Fix #6917: startTs & endTs filters providing paginated data (#7617)
* Fix #6917: startTs & endTs filters providing paginated data

* Updated ui side changes

* Fixed OM tests end to end test

* Fix #6917: startTs & endTs filters providing paginated data

* Fix #6917: startTs & endTs filters providing paginated data

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-09-21 13:33:47 -07:00
Sriharsha Chintalapani
0dd177ac2c
Fix #7619: Teams hierarchy is not working as expected in Signup and Add User pages (#7621) 2022-09-20 22:53:03 -07:00
Onkar Ravgan
254b0b64d1
Tableau lineage using Graphql (#7603)
* Added graphql query

* Added tableau lineage with graphql

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-21 11:14:32 +05:30
Mayur Singal
a439161d8b
#7316: Bump sqllineage version to 1.3.6 (#7598)
Co-authored-by: Mayur <mayur@Mayurs-MacBook-Pro.local>
2022-09-21 10:14:47 +05:30
Mayur Singal
947cb4e99e
Fix #7316: Fix Hive View error for older version (#7592) 2022-09-21 07:50:17 +05:30
Abhishek Pandey
d40be7a9aa
postgres-sql-query-updated (#7421) 2022-09-21 07:04:06 +05:30
Nahuel
301433e0d0
Airflow container can not be restarted (#7615) 2022-09-20 14:37:39 -07:00
Nahuel
3e4d4c5ee6
Fix DOCKER_URL_ROOT value for docker.py (#7600) 2022-09-20 17:16:22 +02:00
Pere Miquel Brull
1578fa7f1b
Fix #7121 - Support Spark metastore DB connection (#7520)
* Fix #7121 - Support Spark metastore DB connection

* appname

* Update docs

* test validation

* Address PR comments

Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-09-20 16:47:57 +02:00
Ayush Shah
c522fa1de2
Add Specific Projectid support feature (#7591) 2022-09-20 17:36:10 +05:30
Onkar Ravgan
5f2d7c5dfc
Added ingesting teams from DBT (#7576)
* Added ingesting teams from DBT

* Added warnings

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-20 16:14:00 +05:30
Teddy
bdfdc50a5a
Fixes #7422 - Implement FROM table SAMPLE ... for Snowflake sampling (#7555)
* Updated sampling for snowflake

* Fixed python style
2022-09-20 08:55:39 +02:00
Teddy
e22036cc09
Fixes #7504 Added migration steps to delete profiler pipeline from entity relationship (#7511)
* Added migration steps to delete profiler pipeline from entity relationship

* Added migration to remove rows from entity_relationship with profiler pipelines

* Fixed sample data TestDefinition name after renaming testDefinition

* Added user_tokens table to v005

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2022-09-20 08:14:29 +02:00
Sriharsha Chintalapani
9b35547fa5
Fix #7562: Fix search suggest for soft-deleted entities (#7563) 2022-09-19 17:22:23 -07:00
Nahuel
2a6c6134f4
Fix#7272: Improve logging when initializing workflow from CLI (#7522)
* Improve logging when initializing workflow from CLI

* Fix broken tests
2022-09-19 08:00:00 -07:00
Onkar Ravgan
e6de43b081
Added miising dictionaries (#7545)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-19 18:00:14 +05:30
Akash Jain
fc8312c5fb
feat: Refactor openmetadata/ingestion docker image (#7456)
* centralize openmetadata/ingestion docker image

* update volume mappings; fix ingestion tag!

* fix PR comments

* fix cypress mysql tests!
2022-09-19 09:20:54 +05:30
Cristian Calugaru
a326d3bcc0
lib upgrades (#7536)
* lib upgrades

* black reformatting

* downgraded datamode-core-generator to 0.13.0 and pydantic to 1.9.0
2022-09-18 16:51:49 -07:00
Pere Miquel Brull
6700f169ab
Fix #7165 - Handle SSL certificates on ometa client (#7502)
Fix #7165 - Handle SSL certificates on ometa client (#7502)
2022-09-16 09:39:27 +02:00
Mayur Singal
02f0945bb6
Fix #7159: Fixed nested column issue in bigquery (#7492) 2022-09-16 07:05:35 +02:00
Teddy
1ba6e284fe
Fixes #7118 by cleaning up test names (#7494)
* Cleaned up tests names and add registry name tests

* Updated documentation for test types supported by OM
2022-09-16 07:04:56 +02:00
Teddy
25d1789195
Fixes #7500 Added logic to fetch compose file from release (#7501)
* Added logic to fetch compose file from release

* Used client version utility
2022-09-15 19:32:30 +02:00
Teddy
3fdbe6ecfb
Added logic to report column level metric computation failure for profiler (#7465) 2022-09-15 17:39:29 +02:00
Milan Bariya
8502bf8e49
Fix: DBT root config error handled (#7446)
* Fix: DBT root config error handled

* Fix: DBT root config error handled

* Fix: Py-test

* Fix: Change based on comments
2022-09-15 18:26:05 +05:30
Nahuel
86ebb2025f
Fix#7407: Add custom source connections for different service types (#7419)
* Fix #4639: Custom Service Schema

* Add custom source as service for different connections type

* Minor typo fix

* Add new service connections to UI

* Fix minor error

* Rename field config to connectionOptions

* Remove sourcePythonClass default value

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2022-09-15 10:53:27 +02:00
NiharDoshi99
5eb45948bd
Fixed: PostGIS geometry type (#7382)
Fixed: PostGIS geometry type (#7382)
2022-09-15 10:35:15 +02:00
Sriharsha Chintalapani
656b50dd3a
Fix #7469: Refactor OpenMetadata code modules (#7474) 2022-09-14 23:14:02 -07:00
Milan Bariya
591517a487
Fix: Align pre-commit isort (#7380) 2022-09-14 15:10:06 +02:00
Teddy
0bb83f138b
Fixed table filter pattern for bigquery service (#7416) 2022-09-14 15:00:45 +02:00
Mayur Singal
95b570178a
Fixed Logging Error for airflow lineage backend (#7438)
* Fixed Loggin Error

* pyformat
2022-09-14 06:33:09 +02:00
Teddy
d171e2f100
Removed typing_extension dependency (#7406) 2022-09-13 15:10:11 +02:00
Teddy
71679137a0
Fixes #6009 - Adds SQA MetaData object instance per DB (#7388)
* Added SQA MetaData object instance per DB to allow same schema/table name across multiple db

* Update ingestion/src/metadata/orm_profiler/orm/converter.py

updated type hint
2022-09-12 18:05:36 +02:00
Teddy
0677b5258f
Fixes #7299 by updating GE submodule to new test API (#7332)
* Update GE logic to the new test API

* Cleaned up part of the code from
update to TestSuiteMixin

* Added + fixed tests

* Deleted unused files for GE tests

* fixed python tests
2022-09-11 20:07:19 -07:00
Akash Jain
f2fc45ea41
feat: prepare-for-next-release-0-13-0 (#7348) 2022-09-09 01:25:41 +05:30
Onkar Ravgan
5aabf76b49
PowerBi urls fixed (#7295)
* PowerBi urls fixed

* added constants

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-08 10:30:32 +05:30
Teddy
45c457280b
Fix Amundsen migration & added logic for table entity owners (#7288)
* Fixed minor bugs with Amundsen ingestion and added logic to add table entity owners

* Updated version requirement for amundsen doc

* Fixed python style
2022-09-07 09:20:06 +02:00
Nahuel
b829a2cbf3
Fix: Improvements on secret manager implementation (#7282)
* Change local secret manager by noop

* Update openmetadata-secure-test.yaml
2022-09-07 09:18:59 +02:00
Pere Miquel Brull
82a5348fb3
Improve mlflow error handling (#7262)
* Improve mlflow error handling

* Improve mlflow error handling

* Update rest plugin docs

* Revert "Update rest plugin docs"

This reverts commit 08d56741efba04980fbfeb67d723d7bcdba27994.
2022-09-06 15:24:52 -07:00
Pere Miquel Brull
659d72841e
Improve Nifi error handling (#7275) 2022-09-06 15:24:12 -07:00
Teddy
488a4898e8
Profiler close session after metric computation (#7269)
* Added logic to close session after metric computation

* used context manager to manage session
2022-09-06 22:16:28 +02:00
Sriharsha Chintalapani
d29a230726
Fix #7104: Add support for get resource permission by FQN (#7270) 2022-09-06 12:30:52 -07:00
Onkar Ravgan
a5737cd040
Changed chart filter status (#7265)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-06 08:04:18 -07:00
Onkar Ravgan
9be3df4a1e
Integrated DBT tests (#7122)
* Integrated DBT tests

* Fixed py tests

* Review comments addressed

* Changed test suite name default value

* Added fixes

* update ui changes for new field

* send data along with api

* update name

* fixes for UI

* fixes for UI

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-09-05 22:25:31 +05:30
Pere Miquel Brull
e08bd1b1d2
Add exception handling (#7217) 2022-09-05 18:50:22 +02:00
Teddy
22eca3a6f6
Fixes #7215 -- no bind for param (#7226)
* Fix no bind for params

* Update ingestion/src/metadata/orm_profiler/orm/functions/median.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-09-05 15:53:31 +02:00