yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-05 15:48:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 706 Branches 151 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
Pere Miquel Brull
2ec8b42e96
Get service connection info if not set (#9981) 2023-01-29 10:42:17 +01:00
Pere Miquel Brull
02c1f9ac94
Update view definition from Vertica dialect (#9980) 2023-01-29 13:28:43 +05:30
Pere Miquel Brull
47d814d059
Fix typo (#9969) 2023-01-28 18:39:59 +01:00
Pere Miquel Brull
d5c6c0212b
Fix e2e lineage count (#9964) 
* Add vertica to the list

* test profiler

* Fix tests

* Fix tests

* Fix e2e lineage count
 2023-01-27 15:33:03 +01:00
Nahuel
da1f911581
Doc: Add missing source config types in connectors config examples (#9955) 2023-01-27 15:30:48 +01:00
Pere Miquel Brull
f6d59f599e
Pin SQLAlchemy lower than 2 (#9952) 2023-01-27 15:26:30 +01:00
Pere Miquel Brull
192c992e21
Fix e2e tests when computing rows (#9958) 
* Add vertica to the list

* test profiler

* Fix tests

* Fix tests
 2023-01-27 12:55:57 +01:00
Noe Alejandro Perez Dominguez
d8674bd7f8
Deduplicate stl_querytext rows, fixes #8867 (#9870) 
* Deduplicate stl_querytext rows, fixes #8867

* Update queries.py

Filter down result-set by joining with queries

* Reduce line character length
 2023-01-27 10:36:49 +01:00
Pere Miquel Brull
4d474ab063
Add vertica e2e and fix checks (#9947) 
* Add vertica e2e and fix checks

* Add missing task_id param
 2023-01-27 10:22:12 +01:00
Nahuel
19f034eec4
Doc: Add Kafka troubleshooting section (#9941) 2023-01-26 18:52:06 +01:00
Mayur Singal
3f9364d8a4
Fix #9923: Fix usage for tables with same name (#9925) 
* Fix #9923: Fix usage for tables with same name

* Fix #9923: Fix usage for tables with same name

* Update ingestion/src/metadata/ingestion/bulksink/metadata_usage.py

Co-authored-by: Nahuel <nahuel@getcollate.io>
 2023-01-26 15:53:41 +00:00
Pere Miquel Brull
4650a453e1
Prepare Vertica Lineage and Usage (#9906) 
* Prepare Vertica Lineage and Usage

* Simplify db usage

* Linting

* Revert postgres changes

* Revert postgres changes

* Add vertica flags
 2023-01-26 14:34:33 +01:00
Pere Miquel Brull
c368116697
Add dbt cloud URL as an input parameter (#9911) 
* Add dbt cloud URL as an input parameter

* support dbt cloud url from UI

* Flag dbtCloudUrl as required

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
 2023-01-26 09:36:03 +01:00
Nahuel
1de45aa2fb
Consider subprocess coverage in E2E CLI tests (#9935) 2023-01-26 07:55:54 +01:00
Abhishek Pandey
933e195ef6
salesforce-test-added (#9890) 
* salesforce-test-added

* license-headers-added
 2023-01-25 21:24:21 +05:30
Milan Bariya
49d48e0546
Update: Trino, Presto Logic and Doc (#9859) 
* Update: Trino, Presto Logic and Doc

* Update: Trino, Presto Logic and Doc

* Update permissions in Doc

* Update openmetadata-docs/content/connectors/database/trino/index.md

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>

Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
 2023-01-25 19:20:06 +05:30
Mayur Singal
dd82fad5c4
Fix sample data re-ingestion for upgrade test (#9905) 2023-01-25 17:44:18 +05:30
Nahuel
5608c2fde0
Add E2E CLI tests coverage to Sonar (#9908) 2023-01-25 11:51:25 +01:00
Milan Bariya
176111aa27
Added databricks in lineage model (#9887) 2023-01-25 16:06:48 +05:30
Mayur Singal
74d2132883
Supserset Connection Changes Doc (#9893) 2023-01-25 11:06:00 +05:30
Mayur Singal
b3f9e3ba97
Update snowflake Requirement Docs (#9900) 2023-01-25 11:05:14 +05:30
Pere Miquel Brull
bce8574f98
Dashboards and charts use the ID as name (#9810) 
* Update dashboard names

* Fix: metabase lineage

Co-authored-by: Nihar Doshi <nihardoshi16@gmail.com>
 2023-01-24 21:50:35 +05:30
Nahuel
fbc32bc873
Fix: MSSQL and DBT Redshift CLI E2E failing (#9899) 2023-01-24 16:04:42 +00:00
Nahuel
4274a145eb
Fix: change how CLI E2E are run (#9894) 2023-01-24 13:18:56 +00:00
NiharDoshi99
33090c149e
Fix: superset dummy credentials update (#9883) 2023-01-24 07:55:16 +00:00
Mayur Singal
d0191da8ec
Fix domo pipeline test connection (#9863) 2023-01-24 12:23:47 +05:30
Ayush Shah
d15d96ef1a
Fix Mapper Parser issue (#9865) 2023-01-24 11:21:50 +05:30
Pere Miquel Brull
f2fb0521c2
Update airflow loggers and rename ometa loggers (#9868) 
* Update airflow loggers and rename ometa loggers

* ANSI print to logger

* Remove colored logging from tests

* Merge ometa_logger into the one used in loggers class

* linting

* linting

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
 2023-01-23 16:28:17 +01:00
Teddy
871cd0414e
Fix Partition for tables with profile sample + added mssql e2e tests (#9862) 
* fix: partition for sampled data

* fix: added MSSQL E2E cli test

* fix: added secerets varibale to action file

* fix: python checkstyle
 2023-01-23 14:16:44 +01:00
Mayur Singal
5145dced25
Datalake parquet files fix (#9860) 2023-01-23 17:44:34 +05:30
Nahuel
93057e476f
Fix: Superset encryption and decryption not working as expected (#9827) 
* Fix superset sample data

* Update ingestion/examples/superset_data/service.json

* Update ingestion/examples/superset_data/service.json

* fix: pytest error (#9824)

* fix: pytest error

* fix: linting

* increased verbosity

* empty commit to re-run tests

* print registry and test definition set

* renamed columnValuesToBeUnique fqn

* removed print statements + verbosity

* Docs Using a Custom Ingestion Image in helm (#9835)

* Docs Using a Custom Ingestion Image in helm

* Update openmetadata-docs/content/deployment/kubernetes/index.md

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Update openmetadata-docs/content/deployment/kubernetes/index.md

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Update openmetadata-docs/content/deployment/kubernetes/index.md

* Update index.md

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* fix(ui): ui changes for #9695 (#9770)

* Fix #9695: Teams show up in lower case

* changed owner advanced search filter field from name to display name

* fixed minor quick filter bug

* fixed failing cypress tests

* fixed failing unit tests

* Fixed failing cypress tests

* added comments in unit tests for better understanding of changes

* fixed failing cypress tests for advanced search

* improved logic for showing advanced search options

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>

* Added powerbi docs for new field (#9836)

* Fix#9460: Avoid reuse inspector to get view definition (#9821)

* Avoid reuse inspector to get view definition

* Update openmetadata-sqllineage version

* Feat: Update GH action for E2E tests (#9839)

* Update E2E CI tests GH action

* Address PR comments

* Add converter for services when encypting or decrypting services objects

* Update E2E CI tests GH action

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
 2023-01-20 21:32:38 +00:00
Pere Miquel Brull
16a1b2c8be
Vertica comments, dbs, profiler and docs (#9845) 
* Vertica comments, dbs, profiler and docs

* Revert metabase changes

* Format

* Fix median
 2023-01-20 20:36:03 +01:00
Teddy
7d0eeeb802
Fix datetime fn mysql (#9825) 
* fix: mysql datetime function

* empty commit to re-run tests
 2023-01-20 14:33:55 +00:00
Nahuel
254ee9a186
Fix#9460: Avoid reuse inspector to get view definition (#9821) 
* Avoid reuse inspector to get view definition

* Update openmetadata-sqllineage version
 2023-01-20 13:54:41 +00:00
Teddy
dcf220f867
fix: pytest error (#9824) 
* fix: pytest error

* fix: linting

* increased verbosity

* empty commit to re-run tests

* print registry and test definition set

* renamed columnValuesToBeUnique fqn

* removed print statements + verbosity
 2023-01-20 10:45:11 +01:00
Mayur Singal
939adf887b
Fix #8973: Superset fetch metadata from DB (#9645) 
* Docs #8973: Superset with SSO docs

* Superset support for mysql & postgres db

* remove unwanted field from yaml

* Fix pylint

* Fix superset tests

* Fix sample data connection

* ci fix & review comments

* cypress & defualt provider fix
 2023-01-19 16:39:43 +01:00
Nahuel
ddff6e2875
Fix: Replace sqllineage with openmetadata-sqllineage (#9800) 
* Replace sqllineage with openmetadata-sqllineage

* Fix checkstyle and failing test

* Move logic to retrieve dialect of a service type into a class

* Improve py-check message when it fails

* Updated mapper

* Update code after merge
 2023-01-19 14:56:29 +01:00
Teddy
fd4d39ac05
fix: max value for column between (#9820) 2023-01-19 12:13:35 +00:00
Ayush Shah
14100d089f
Modify Charts (#9814) 2023-01-19 12:03:21 +00:00
Pere Miquel Brull
c6cf9ae764
Fix region name (#9811) 2023-01-19 12:49:18 +01:00
Nahuel
04dae8bc75
Revert "Fix #8884 & #9460 - View lineage happens in the lineage workflow (#9796)" (#9817) 
This reverts commit e88fe2f559989dbb1c34662abcdc35f235adc8c4.
 2023-01-19 11:56:21 +01:00
Pere Miquel Brull
b0058bdb65
Fix #9707 - Install instantclient and enable thick mode (#9761) 
* Install instantclient

* Prep instant client

* Update docs

* Amend comments
 2023-01-19 08:08:56 +01:00
Mayur Singal
f58765b7cc
Fix #6577: Optimize metadata reads (#9759) 2023-01-19 06:29:14 +00:00
Pere Miquel Brull
e88fe2f559
Fix #8884 & #9460 - View lineage happens in the lineage workflow (#9796) 
* View lineage happens in the lineage workflow

* Format

* Remove table views from context

* lint
 2023-01-18 18:32:40 +01:00
Ayush Shah
02147b6502
Fix: Quicksight Dashboard and chart Metadata Ingestion (#9786) 
* Fix Quicksight json schema and errors

* Fix Quicksight lineage

* add pagination

* Generalize Pagination

* Fix Pylints

* update max results

* fix tests

* Add Pydantic Models for QuickSight resp

* Add fqn builder

* Fix Py lInt

* Fix Tests
 2023-01-18 20:37:41 +05:30
NiharDoshi99
f2649041f2
Fix: atlas test connection (#9791) 
* Fix: atlas test connection

* Fix: docs changes

* Fix: docs changes

* Fix: python checkstyle

* Fix: python test
 2023-01-18 20:16:07 +05:30
Milan Bariya
7f111584b8
Deprecate OMetaDatabaseAndTable (#9760) 
* Deprecate OMetaDatabaseAndTable

* Change Based On Comments

* Change Based On Comments

* Fix Pytest

* Fix Pytest
 2023-01-18 14:29:32 +01:00
Onkar Ravgan
043f1e0601
Dbt e2e test (#9767) 
* Added base files

* dbt e2e tests

* Added tag condition based on UI feedback

* Added owner and lineage tests

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2023-01-18 14:29:16 +01:00
Abhishek Pandey
6d7acdc140
Issue 9542 - Replace the default name for MySQL db (#9687) 
* database-field-added-for-custom-database-name

* database-field-added-for-custom-database-name

* database field description-added

* databaseName-field-updated-in-connection-json

* database-name-field-updated-in-salesforce

* databaseName-description-updated

* database-name-logic-updated-in-common-db-source
 2023-01-18 14:28:40 +01:00
Onkar Ravgan
08a4d33c5f
Powerbi pagination fix (#9784) 
* Fixed powerbi pagination logic

* Added yaml changes
 2023-01-18 17:17:13 +05:30