yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-10 01:58:24 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 710 Branches 152 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Nahuel
593ca3a4a0
Fix bot creation and edition logic (#7796) 
* Fix bot creation and edition logic

* Fix minor error creating user

* Fix failing test

* Minor fixes

* Add missing tests for new flows

* Fix put_failIfBotHasARelationshipToAnotherUser test

* Changes after manual testing

* Move where auth_provider is retrieved in the secret manager
 2022-10-01 11:25:56 +02:00
Teddy
595e5c1b89
Added checks to see if DAG can reach OM (#7794) 2022-09-30 17:57:03 +02:00
Milan Bariya
d2adde53c6
Add: Add metadata restore CLI (#7596) 
* Add: Add metadata restore CLI

* Fix: Query execution error

* Fix: Query execution error

* Fix: Change based on comments

* Update ingestion/src/metadata/cli/restore.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-09-30 18:32:16 +05:30
Vj-L
e473d2caa4
Fixed clean function in docker.py (#7806) 
* Fixed clean function in docker.py

* Fixed clean function in docker.py

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-09-30 14:14:09 +05:30
Vj-L
489d506e3a
Removed the volume for Database (#7798) 
* Removed the volume for Database

* Removed the volume for Database

* Added named volume

* Added named volume

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-09-29 21:44:12 +05:30
Vj-L
6cfd16925a
Added default volumes (#7741) 
* Added default volumes

* Ran make py_format for formatting

* Added sample data in mount directories

* Updated as per the comments

* Done changes for --ingest_sample_data flag

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
 2022-09-29 14:53:55 +05:30
Sriharsha Chintalapani
612c083612
Fix Doc links (#7734) 
* Fix Broken links

* Fix symlink

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2022-09-28 14:05:51 -07:00
Teddy
962866a30e
Fixes #7280 - Implements support for BYTEA DType (#7749) 
* Added support for postgres bytea data type

* Added BYTEA support for profiler and converts bytes to hex on results read
 2022-09-28 13:28:35 +02:00
Mayur Singal
24daae88e9
Add flag use fqn for filter patterns (#7755) 2022-09-28 16:41:22 +05:30
Milan Bariya
f6ef053196
Fix: 'GCSCredentialsPath' object has no attribute 'projectId' (#7731) 
Fix: 'GCSCredentialsPath' object has no attribute 'projectId' (#7731)
 2022-09-28 11:59:54 +02:00
Ayush Shah
8138628d26
Fix WorkflowConfig api (#7754) 2022-09-27 09:23:20 -07:00
Teddy
7f81c28e58
Fix minor issues with dbt test results ingestion (#7744) 
* - Added support for test ingestion without `dbt docs generate` run
- removed millisecond from timestamp
- changed test result failure to 0

* Removed unused methods
 2022-09-27 17:04:23 +02:00
Onkar Ravgan
dc74089f0e
Fixed pipeline FQN bug (#7740) 
* Fixed pipeline FQN

* fixed messaging service

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-27 14:23:59 +05:30
Onkar Ravgan
8afbbb8642
Ingest DBT tags (#7726) 
* added tags

* Added dbt tags ingestion

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-27 11:12:53 +05:30
Nahuel
df909703eb
Fix#6615: Fix failing test still in CI (#7725) 
* Fix failing test still some tests are failing

* Fix bug in service entity repository

* Fix all tests except Ingestion Pipeline integration tests

* Fix Ingestion Pipeline integration tests

* Fix failing Python tests
 2022-09-26 20:39:42 +02:00
Milan Bariya
1c78e835d9
Fix: Error initializing ingest: ‘RedshiftSource’ object has no attribute ‘dbt_manifest’ (#7723) 2022-09-26 19:42:22 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler (#7506) 2022-09-26 19:41:40 +05:30
Nahuel
e49ad000ee
Fix#6615: Configure a bot account and provider service or jwtAuthToken from the UI (#7637) 
* Update JSON schemas

* Update create and update endpoint and remove /generateToken endpoint

* Add AuthMechanism and Token Expiry Field on the Add bot page

* Remove unwanted tests

* Add logic to show authMechanism based on auth provider

* Add authConfig to bots details page

* Backend implementation with secret manager

* Fix invalid date issue

* Add support for update bot token details

* Add logic for SSO auth

* Add fields for google sso auth client

* Add Edit Option.

* Updated ingestion CLI and secret manager issues

* Updated tests with errors

* Removed unused method

* Removed test files

* Fix broken JSON schema

* Fix typescript error

* Pass the bot permissions from the bot details page

* Minor errors related to the secret manager

* Restore Airflow configuration for retrocompability

* Add support for all SsoServiceType client config

* Fix Unit test

* Update tests

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2022-09-26 18:26:24 +05:30
NiharDoshi99
d9f3ab23d7
Fixed: SampleData Teams and teamTypes (#7682) 2022-09-26 18:22:41 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions (#7653) 
* Added control for DBT descriptions

* Fixed tests

* Added UI changes

* fixed maven ci tests

* Java formatting changes

* ui review fixes

* Fixed pytests

* Fixed python integration tests

* fixed airflow tests

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-26 16:19:47 +05:30
Mayur Singal
2df214a381
Revamp filter patterns (#7662) 2022-09-26 12:23:32 +05:30
Teddy
c6fcad2c1d
Fixes #7478 -- Added Hive syntax for RAND and PERCENTILE functions (#7685) 
* Added Hive syntax for RAND and PERCENTILE functions

* Added logic to handle missing context attributes in post_process of the topology

* Removed commit to wrong brancg
 2022-09-23 15:48:09 -07:00
Teddy
bdf85d0eae
Added logic to handle missing attributes from the context (#7696) 2022-09-23 15:47:53 -07:00
mohitdeuex
cceff48f0d
Default token (#7695) 2022-09-23 20:03:54 +05:30
NiharDoshi99
8adcf2ee3d
Fixed: Dagster to work with its API (#7579) 2022-09-23 17:46:40 +05:30
Teddy
f2bf5194bb
Fixes #7623 -- Added logic to encode and decode entityLink (#7670) 
* Encode entityLink string when processing request

* Added logic to decode column type from entityLink

* mvn code formating

* Extracted unquote step into its own function
 2022-09-23 09:42:33 +02:00
Ayush Shah
e430e5a1c6
Fix Bigquery ADC project id overriding (#7666) 2022-09-23 09:48:12 +05:30
Teddy
c34281251f
Fixes #7509 - implement import path migration script (#7515) 
* Added script to migarte import

* Added tests

* Updated doc to include info about import migration

* renamed test resource files
 2022-09-22 14:43:25 +02:00
Milan Bariya
d1a3fa4928
Fix: Remove min duration limit (#7627) 2022-09-22 18:10:17 +05:30
Ayush Shah
517e9a4aac
Remove unused imports (#7657) 2022-09-22 16:42:10 +05:30
Mayur Singal
680a186209
Added Exception Handling for Bigquery Tags & Fix py-test CI (#7649) 2022-09-22 14:08:04 +05:30
Sriharsha Chintalapani
f6af18986b
Fix #7619: Follow-up fix to ingestion to index parents (#7645) 2022-09-21 21:02:36 -07:00
Sriharsha Chintalapani
adaa8e7493
Fix #6917: startTs & endTs filters providing paginated data (#7617) 
* Fix #6917: startTs & endTs filters providing paginated data

* Updated ui side changes

* Fixed OM tests end to end test

* Fix #6917: startTs & endTs filters providing paginated data

* Fix #6917: startTs & endTs filters providing paginated data

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
 2022-09-21 13:33:47 -07:00
Sriharsha Chintalapani
0dd177ac2c
Fix #7619: Teams hierarchy is not working as expected in Signup and Add User pages (#7621) 2022-09-20 22:53:03 -07:00
Onkar Ravgan
254b0b64d1
Tableau lineage using Graphql (#7603) 
* Added graphql query

* Added tableau lineage with graphql

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-21 11:14:32 +05:30
Mayur Singal
a439161d8b
#7316: Bump sqllineage version to 1.3.6 (#7598) 
Co-authored-by: Mayur <mayur@Mayurs-MacBook-Pro.local>
 2022-09-21 10:14:47 +05:30
Mayur Singal
947cb4e99e
Fix #7316: Fix Hive View error for older version (#7592) 2022-09-21 07:50:17 +05:30
Abhishek Pandey
d40be7a9aa
postgres-sql-query-updated (#7421) 2022-09-21 07:04:06 +05:30
Nahuel
301433e0d0
Airflow container can not be restarted (#7615) 2022-09-20 14:37:39 -07:00
Nahuel
3e4d4c5ee6
Fix DOCKER_URL_ROOT value for docker.py (#7600) 2022-09-20 17:16:22 +02:00
Pere Miquel Brull
1578fa7f1b
Fix #7121 - Support Spark metastore DB connection (#7520) 
* Fix #7121 - Support Spark metastore DB connection

* appname

* Update docs

* test validation

* Address PR comments

Co-authored-by: Nahuel <nahuel@getcollate.io>
 2022-09-20 16:47:57 +02:00
Ayush Shah
c522fa1de2
Add Specific Projectid support feature (#7591) 2022-09-20 17:36:10 +05:30
Onkar Ravgan
5f2d7c5dfc
Added ingesting teams from DBT (#7576) 
* Added ingesting teams from DBT

* Added warnings

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-20 16:14:00 +05:30
Teddy
bdfdc50a5a
Fixes #7422 - Implement FROM table SAMPLE ... for Snowflake sampling (#7555) 
* Updated sampling for snowflake

* Fixed python style
 2022-09-20 08:55:39 +02:00
Teddy
e22036cc09
Fixes #7504 Added migration steps to delete profiler pipeline from entity relationship (#7511) 
* Added migration steps to delete profiler pipeline from entity relationship

* Added migration to remove rows from entity_relationship with profiler pipelines

* Fixed sample data TestDefinition name after renaming testDefinition

* Added user_tokens table to v005

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
 2022-09-20 08:14:29 +02:00
Sriharsha Chintalapani
9b35547fa5
Fix #7562: Fix search suggest for soft-deleted entities (#7563) 2022-09-19 17:22:23 -07:00
Nahuel
2a6c6134f4
Fix#7272: Improve logging when initializing workflow from CLI (#7522) 
* Improve logging when initializing workflow from CLI

* Fix broken tests
 2022-09-19 08:00:00 -07:00
Onkar Ravgan
e6de43b081
Added miising dictionaries (#7545) 
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
 2022-09-19 18:00:14 +05:30
Akash Jain
fc8312c5fb
feat: Refactor openmetadata/ingestion docker image (#7456) 
* centralize openmetadata/ingestion docker image

* update volume mappings; fix ingestion tag!

* fix PR comments

* fix cypress mysql tests!
 2022-09-19 09:20:54 +05:30
Cristian Calugaru
a326d3bcc0
lib upgrades (#7536) 
* lib upgrades

* black reformatting

* downgraded datamode-core-generator to 0.13.0 and pydantic to 1.9.0
 2022-09-18 16:51:49 -07:00