Suman Maharana
11b0a9c376
Fixes: mircostrategy test connection ( #18889 )
2024-12-03 17:13:15 +01:00
Suman Maharana
e582cb4d9c
Minor: Fix dbt source file issue ( #18903 )
2024-12-03 21:42:11 +05:30
Imri Paran
7ae886e8f9
chore(importer): better error message for missing plugins ( #18878 )
...
Before:
"Generic ImportError message"
After:
Error initializing metadata: You might be missing the plugin [bigquery]. Try:
pip install "openmetadata-ingestion[bigquery]==1.6.0"
2024-12-03 14:41:47 +00:00
Mayur Singal
7c6f5e67dd
MINOR: Snowflake Support Alter Table Swap Lineage ( #18887 )
2024-12-03 16:23:58 +05:30
Imri Paran
416ba2c9cb
chore(data-quality): improve messaging for COUNT strategy failure ( #18884 )
2024-12-03 09:44:20 +00:00
harshsoni2024
1140578b05
GEN-2157: Snowflake increased cost issue ( #18825 )
...
* exit from active connection while query lineage process
* save rows resuslt/fetchall imple.
* use serverside cursor
2024-12-03 15:02:00 +05:30
Pere Miquel Brull
7aacfe032c
MINOR - FQN encoding in ometa_api, TestSuite pipeline creation & serialization of test case results ( #18877 )
...
* DOCS - Update ES config
* MINOR - Add missing FQN encoding & force types
* MINOR - Add missing FQN encoding & force types
* format
* fix tests
2024-12-02 17:17:21 +01:00
Mayur Singal
9b9509f4b9
MINOR: Mysql Lineage Support Main ( #18780 )
...
* MINOR: Mysql Lineage Support Main
* fix test
* fix test
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-29 20:48:42 +05:30
Teddy
ac2f6d7132
MINOR - Fix sqa table reference ( #18839 )
...
* fix: sqa table reference
* style: ran python linting
* fix: added raw dataset to query runner
* fix: get table and schema name from orm object
* fix: get table level config for table tests
2024-11-28 18:49:11 +01:00
mgorsk1
da176767a8
feat: add dbt freshness check test ( #18730 )
...
* add dbt freshness check
* docs
* run linting
* add test case param definition
* fix test case param definition
* add config for dbt http, fix linting
* refactor (only create freshness test definition when user executed one)
* fix dbt files class
* fix dbt files class 2
* fix dbt objects class
* fix linting
* fix pylint
* fix linting once and for all
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-28 18:30:11 +01:00
harshsoni2024
cb33f274fc
Connector: rename microstrategy connector ( #18604 )
2024-11-28 18:50:42 +05:30
Pere Miquel Brull
f99ed517bc
FIX - TestSuite source to get the right interface based on the service type ( #18838 )
2024-11-28 14:08:11 +01:00
Suman Maharana
9a21e77e15
Added dbt cloud multi projects and jobs filter ( #18801 )
...
* Added dbt cloud multi project and jobs filter
* added tests
* change to array type
* updated yaml config
* added migrations
2024-11-28 16:10:34 +05:30
Pere Miquel Brull
460d20a856
MINOR - Fix clean_uri and add before pagination ( #18826 )
...
* print
* MINOR - Fix clean_uri and add before pagination
* MINOR - Fix clean_uri and add before pagination
2024-11-28 09:35:41 +01:00
Akash Verma
609620e54f
fixes : #12891 : "Added more test connection cases for Airflow ingestion" ( #18769 )
2024-11-28 13:02:04 +05:30
Imri Paran
cd74d8f55a
MINOR: ref(data-quality): modularized test case validator import ( #18716 )
...
* ref(data-quality): modularized test case validator import
- removed test_suite_factory
- implemented TestCaseImporter
- removed SQAValidatorBuilder and PandasValidatorBuilder in favor of a SourceType enum
- removed the orm table creation from test suite source
* format
* IValidatorBuilder -> ValidatorBuilder
* use the table from the sampler in the test suite interface
* linting
* fixed the profiler with similar solution
* removed unused inheritance
* removed unneeded super().__init__()
* removed all instances of orm_table
* fixed tests
* add reportExplicitAny=false
* fixed tests
2024-11-27 16:25:12 +01:00
Mayur Singal
9985286cdb
MINOR: Fix snowflake test connection on - in db name ( #18817 )
2024-11-27 18:38:46 +05:30
Mayur Singal
a316de67af
MINOR: Databricks LocationPath Update Fix ( #18815 )
2024-11-27 18:38:26 +05:30
Teddy
58699063db
MINOR -- Fix DQ Partition Issue ( #18641 )
...
* fix: renamed `random_sample` to `get_dataset` and change dunder method access for SQA Table object
* fix: removed handle_partition decorator
* fix: fixed DQ partition issue + moved to `tablesample` method
* style: ran python linting
* style: fix python format check issues
* feat: added postgres tablesample
* style: ran python linting
* fix: sampling delta
* fix: merge conflicts
* fix: resolved conflicts
* style: ran python linting
* fix: patch orm call in test case
* fix: mock build_table_orm call in tests
* fix: test case failures and errors
* fix: removed unused import
* fix: patch typo
* fix: trino table schema retrieval
* fix: remove tuple context manager for 3.8 test support
2024-11-27 08:50:54 +01:00
Imri Paran
c5171139c3
chore: added data diff to base requirements ( #18789 )
2024-11-26 17:28:22 +00:00
Imri Paran
2e9efe5b82
MINOR: fix: use importer as module ( #18793 )
...
* fix: use importer as module
to allow monkeypatching in collate
* Update i_validator_builder.py
2024-11-26 16:42:18 +01:00
Imri Paran
3e7808ba78
fixed either annotation ( #18778 )
...
* fixed either annotation
* added back Entity
* using `typing_extensions.Annotated` for compatibility with python3.8
* removed bound T for Either
2024-11-26 16:40:32 +01:00
Keshav Mohta
10a7f4ea6c
Fixes #15543 : Implemented ElasticSearch Index Template Ingestion ( #18686 )
2024-11-26 14:42:43 +05:30
Imri Paran
d1b8b9a966
handle import error in param_setter_factory.py ( #18745 )
2024-11-26 07:21:38 +01:00
Suman Maharana
fe5778361c
Minor: fix dbt ingest failed runs ( #18779 )
...
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-11-26 11:38:31 +05:30
Suman Maharana
f40138a56e
Minor: Fix Powerbi refresh token on expire ( #18774 )
...
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-11-25 23:19:30 +05:30
Imri Paran
d6470b7800
MINOR: fix(data-diff): get added columns ( #18694 )
...
* fix(data-diff): get added columns
- use both columns to calculate schema diff
* fix tests
2024-11-25 15:53:50 +01:00
Imri Paran
c164aff561
MINOR: add reportExplicitAny = false for basedpyright ( #18777 )
2024-11-25 14:38:04 +00:00
Mayur Singal
4b9e214078
MINOR: Fix StackTraceError validation error - Superset ( #18740 )
2024-11-25 15:01:59 +05:30
Imri Paran
ee7d043035
[GEN-2109] feat(mongo): added ssl support ( #18731 )
...
* feat(mongo): added ssl support
Added SSL support for MongoDB using the SSL manager.
Attached a video demo.
- [Example repository for setting up mongodb with SSL](https://github.com/sushi30/mongodb-docker-ssl-example )
- [MongoDB TLS documentation](https://www.mongodb.com/docs/manual/tutorial/configure-ssl/ )
* fixed test_doris.py
2024-11-22 08:54:13 -08:00
Suman Maharana
0a374e3872
Minor: Fix Athena location path ( #18750 )
2024-11-22 22:05:05 +05:30
Suman Maharana
b220bdb891
Fix: mstr removed dependency issues ( #18732 )
...
* Fix: mstr removed dependency issues
* fix session still active error
* py_format
* fix tests
* Addressed Comments
* Addressed Comments
* addressed comments
* Addressed comments
* Add constants
* Fix pytests
2024-11-22 21:19:21 +05:30
Keshav Mohta
10bd051039
Fix #18441 : kafka connect password as secret value ( #18742 )
2024-11-22 19:07:08 +05:30
Ayush Shah
17ffdf9850
fix: modify fqn to allow quotes with dots ( #18719 )
2024-11-22 09:33:50 +05:30
Pere Miquel Brull
61021be98a
TEST - Add autoClassification for e2e ( #18722 )
2024-11-21 15:07:04 +01:00
Pere Miquel Brull
2ea442030c
MINOR - Fix import ( #18721 )
2024-11-21 13:12:38 +01:00
Imri Paran
0169aad418
[GEN-970] feat(data-quality): support multiple runtime parameter types ( #18588 )
...
* feat(data-quality): support multiple runtime parameter types
- changed the runtime parameters setter factory to return sets
- add the runtime parameters based on the name of the runtime of the runtime parameter
**NOTE** requires changes on collate side
* empty set for default case
2024-11-21 08:07:33 +01:00
Pere Miquel Brull
6623ab17dc
MINOR - Fallback for testsuite imports ( #18710 )
2024-11-20 17:31:48 +01:00
IceS2
35ce7d7602
MINOR: Update Glossary Term tests ( #18698 )
...
* Update Glossary Term tests
* Remove unused code
* Fix test
2024-11-20 15:24:53 +01:00
Akash Verma
43bbee9075
fix #18278 "Pipeline ingested from Airflow are now not limited to 100" ( #18689 )
2024-11-19 18:47:55 +05:30
Pere Miquel Brull
c68a45e7d8
Create new Auto Classification Workflow ( #18610 )
2024-11-19 08:10:45 +01:00
Ayush Shah
6f1df37ba1
Fixes GEN-1260: Add Validators while creating table to escape special characters ( #18456 )
2024-11-18 15:02:57 +05:30
Sriharsha Chintalapani
88c8fb48f3
Add Edit glossary terms, Edit Tier , Edit Tags as separate permissions ( #18331 )
...
* Add EditGlossaryTerms Permission
* Fix #18330 : Add EDIT_GLOSSARY_TERM permission and enforce EDIT_TIER permisson
* add edit glossary term permission check in UI
* revert EDIT_GLOSSARY_TERMS operation
* Add EDIT_GLOSSARY_TERMS to common operations
* Add EDIT_TIER to common operations
* add default empty array for tags field, as patch calls can run into issues
* Fix tests
* Fix tests
* added glossary terms
* fix conflicts
* fix permission check for data model
* Add EditGlossaryTerms to DataConsumerPolicy
* Add EditGlossaryTerms,EditTier to DataConsumerPolicy
* fix tests
* Fix migrations for EditTier,EditGlossaryTerms
* add edit tier permission to data consumer
* Fix tests
* fix pytests
* missing test_dbt.py
---------
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Karan Hotchandani <33024356+karanh37@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-11-15 10:50:15 -08:00
Suman Maharana
a218bbf5cb
Minor: Fix Mysql cli Update table count ( #18582 )
2024-11-15 14:27:02 +05:30
mgorsk1
3d2dfeb583
feat: use native trino client authentication classes ( #16196 )
...
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-11-15 12:54:42 +05:30
Imri Paran
bde6ee4125
MINOR: Data diff sample fix ( #18632 )
...
* fix(data-diff): sampling configuration
handle the sampling condition separately for the 2 tables allowing to apply sampling on columns with mismatching cases
* format
2024-11-15 08:22:13 +01:00
Mayur Singal
75d417d267
MINOR: Fix user search - exclude bots ( #18645 )
2024-11-14 21:25:21 +05:30
Akash Verma
fa30be0589
fix #17726 Databricks schema name with hyphen issue ( #18598 )
2024-11-14 20:02:20 +05:30
Keshav Mohta
968f892b48
Fix #16110 - Add support to ingest tags airflow ( #18626 )
2024-11-14 17:09:00 +05:30
harshsoni2024
cd3fcb5d22
MINOR: quicksight e2e fix ( #18629 )
2024-11-14 16:31:11 +05:30
