Pere Miquel Brull
42320d73c9
MINOR - Add APIs to Ref Map ( #19019 )
...
* MINOR - Add APIs to Ref Map
* MINOR - Add APIs to Ref Map
* MINOR - Add APIs to Ref Map
* format
2024-12-12 10:41:16 +01:00
github-actions
e6d975add2
chore(release): Prepare Branch for 1.6.2
2024-12-12 05:51:36 +00:00
github-actions
f22442054a
chore(release): Prepare Branch for 1.6.1
2024-12-10 16:13:05 +00:00
github-actions
6c080a3174
chore(release): Prepare Branch for 1.6.0
2024-12-10 09:56:45 +05:30
Suman Maharana
85c7f6d22e
Minor: Fix kafkaconnect test connection ( #18965 )
2024-12-09 16:52:35 +05:30
Imri Paran
16875853a0
test(data-dff): fix flaky test ( #18898 )
...
use 99.5 CI for data diff sampling
2024-12-06 18:55:27 +05:30
Imri Paran
e30571cf4e
[GEN-2187] fix(data-diff): added MD5 handling for bigquery ( #18904 )
...
* fix(data-diff): added nd5 handling for bigquery
- added MD5 handling for bigquery
- use URL instead of Engine because it requires less steps and less prone to failure
* added e2e test for data diff with sampling in bigquery
2024-12-06 14:21:33 +01:00
Teddy
610322ffed
MINOR - MSSQL timestamp type profiler fix ( #18935 )
...
* fix: mssql timestamp processing
* fix: min/max test type on datetime column
* style: fix python format
2024-12-06 08:03:42 +01:00
LeoLuo123
b5750cbee1
Fixes 18300: Get last completed job run ( #18891 )
...
* Get last completed job run
* formatting
---------
Co-authored-by: 😺 Leo Luo <leo.luo@mavenclinic.com>
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2024-12-05 14:53:26 +01:00
Teddy
03bd8e9dc4
FEAT: added TABLESAMPLE for MSSQL ( #18926 )
...
* feat: added TABLESAMPLE for sqlserver
* fix: class name
* test: added test to generated sample query
2024-12-05 14:17:39 +01:00
Suman Maharana
113fae6be0
Fix: dbt manifest parsing issue ( #18930 )
2024-12-05 13:06:25 +05:30
harshsoni2024
c941569a9e
filter empty columns, better msg ( #18932 )
2024-12-05 13:05:58 +05:30
Ayush Shah
8664c8df75
Fixes GEN-2199: Allow Fivetran filtering of pipelines using name instead of id ( #18929 )
2024-12-05 10:55:11 +05:30
Mayur Singal
8ac80e6807
MINOR: Tableau Capture SQL in Lineage ( #18925 )
2024-12-05 09:55:21 +05:30
Mayur Singal
6326ae3cb2
MINOR: DB2 Support License ( #18928 )
2024-12-05 09:54:58 +05:30
Ayush Shah
81b68682aa
Fixes GEN-2198: Snowflake unencrypted key support, connection error on storing bytes ( #18927 )
2024-12-05 07:55:44 +05:30
Mayur Singal
6d21dd12a4
MINOR: Snowflake UDF Lineage Support - main ( #18886 )
2024-12-05 00:19:40 +05:30
Mayur Singal
e44ca06173
MINOR: Add Try/Except to store procedure yielding ( #18883 )
2024-12-04 21:36:53 +05:30
Teddy
a615f49ab2
MINOR: fix table/schema name ( #18899 )
...
* fix: fix table/schema name
* fix: minor profiler and dbt issues
* style: ran python linting
---------
Co-authored-by: Imri Paran <imri.paran@gmail.com>
2024-12-04 10:12:38 +01:00
Pere Miquel Brull
613fd331e0
MINOR - Clean up configs & add auto classification docs ( #18907 )
...
* MINOR - Clean up configs & add auto classification docs
* deprecation notice
2024-12-04 09:32:25 +01:00
Suman Maharana
11b0a9c376
Fixes: mircostrategy test connection ( #18889 )
2024-12-03 17:13:15 +01:00
Suman Maharana
e582cb4d9c
Minor: Fix dbt source file issue ( #18903 )
2024-12-03 21:42:11 +05:30
Imri Paran
7ae886e8f9
chore(importer): better error message for missing plugins ( #18878 )
...
Before:
"Generic ImportError message"
After:
Error initializing metadata: You might be missing the plugin [bigquery]. Try:
pip install "openmetadata-ingestion[bigquery]==1.6.0"
2024-12-03 14:41:47 +00:00
Mayur Singal
7c6f5e67dd
MINOR: Snowflake Support Alter Table Swap Lineage ( #18887 )
2024-12-03 16:23:58 +05:30
Imri Paran
416ba2c9cb
chore(data-quality): improve messaging for COUNT strategy failure ( #18884 )
2024-12-03 09:44:20 +00:00
harshsoni2024
1140578b05
GEN-2157: Snowflake increased cost issue ( #18825 )
...
* exit from active connection while query lineage process
* save rows resuslt/fetchall imple.
* use serverside cursor
2024-12-03 15:02:00 +05:30
Pere Miquel Brull
7aacfe032c
MINOR - FQN encoding in ometa_api, TestSuite pipeline creation & serialization of test case results ( #18877 )
...
* DOCS - Update ES config
* MINOR - Add missing FQN encoding & force types
* MINOR - Add missing FQN encoding & force types
* format
* fix tests
2024-12-02 17:17:21 +01:00
Mayur Singal
9b9509f4b9
MINOR: Mysql Lineage Support Main ( #18780 )
...
* MINOR: Mysql Lineage Support Main
* fix test
* fix test
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-29 20:48:42 +05:30
Teddy
ac2f6d7132
MINOR - Fix sqa table reference ( #18839 )
...
* fix: sqa table reference
* style: ran python linting
* fix: added raw dataset to query runner
* fix: get table and schema name from orm object
* fix: get table level config for table tests
2024-11-28 18:49:11 +01:00
mgorsk1
da176767a8
feat: add dbt freshness check test ( #18730 )
...
* add dbt freshness check
* docs
* run linting
* add test case param definition
* fix test case param definition
* add config for dbt http, fix linting
* refactor (only create freshness test definition when user executed one)
* fix dbt files class
* fix dbt files class 2
* fix dbt objects class
* fix linting
* fix pylint
* fix linting once and for all
---------
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2024-11-28 18:30:11 +01:00
harshsoni2024
cb33f274fc
Connector: rename microstrategy connector ( #18604 )
2024-11-28 18:50:42 +05:30
Pere Miquel Brull
f99ed517bc
FIX - TestSuite source to get the right interface based on the service type ( #18838 )
2024-11-28 14:08:11 +01:00
Suman Maharana
9a21e77e15
Added dbt cloud multi projects and jobs filter ( #18801 )
...
* Added dbt cloud multi project and jobs filter
* added tests
* change to array type
* updated yaml config
* added migrations
2024-11-28 16:10:34 +05:30
Pere Miquel Brull
460d20a856
MINOR - Fix clean_uri and add before pagination ( #18826 )
...
* print
* MINOR - Fix clean_uri and add before pagination
* MINOR - Fix clean_uri and add before pagination
2024-11-28 09:35:41 +01:00
Akash Verma
609620e54f
fixes : #12891 : "Added more test connection cases for Airflow ingestion" ( #18769 )
2024-11-28 13:02:04 +05:30
Imri Paran
cd74d8f55a
MINOR: ref(data-quality): modularized test case validator import ( #18716 )
...
* ref(data-quality): modularized test case validator import
- removed test_suite_factory
- implemented TestCaseImporter
- removed SQAValidatorBuilder and PandasValidatorBuilder in favor of a SourceType enum
- removed the orm table creation from test suite source
* format
* IValidatorBuilder -> ValidatorBuilder
* use the table from the sampler in the test suite interface
* linting
* fixed the profiler with similar solution
* removed unused inheritance
* removed unneeded super().__init__()
* removed all instances of orm_table
* fixed tests
* add reportExplicitAny=false
* fixed tests
2024-11-27 16:25:12 +01:00
Mayur Singal
9985286cdb
MINOR: Fix snowflake test connection on - in db name ( #18817 )
2024-11-27 18:38:46 +05:30
Mayur Singal
a316de67af
MINOR: Databricks LocationPath Update Fix ( #18815 )
2024-11-27 18:38:26 +05:30
Teddy
58699063db
MINOR -- Fix DQ Partition Issue ( #18641 )
...
* fix: renamed `random_sample` to `get_dataset` and change dunder method access for SQA Table object
* fix: removed handle_partition decorator
* fix: fixed DQ partition issue + moved to `tablesample` method
* style: ran python linting
* style: fix python format check issues
* feat: added postgres tablesample
* style: ran python linting
* fix: sampling delta
* fix: merge conflicts
* fix: resolved conflicts
* style: ran python linting
* fix: patch orm call in test case
* fix: mock build_table_orm call in tests
* fix: test case failures and errors
* fix: removed unused import
* fix: patch typo
* fix: trino table schema retrieval
* fix: remove tuple context manager for 3.8 test support
2024-11-27 08:50:54 +01:00
Imri Paran
c5171139c3
chore: added data diff to base requirements ( #18789 )
2024-11-26 17:28:22 +00:00
Imri Paran
2e9efe5b82
MINOR: fix: use importer as module ( #18793 )
...
* fix: use importer as module
to allow monkeypatching in collate
* Update i_validator_builder.py
2024-11-26 16:42:18 +01:00
Imri Paran
3e7808ba78
fixed either annotation ( #18778 )
...
* fixed either annotation
* added back Entity
* using `typing_extensions.Annotated` for compatibility with python3.8
* removed bound T for Either
2024-11-26 16:40:32 +01:00
Keshav Mohta
10a7f4ea6c
Fixes #15543 : Implemented ElasticSearch Index Template Ingestion ( #18686 )
2024-11-26 14:42:43 +05:30
Imri Paran
d1b8b9a966
handle import error in param_setter_factory.py ( #18745 )
2024-11-26 07:21:38 +01:00
Suman Maharana
fe5778361c
Minor: fix dbt ingest failed runs ( #18779 )
...
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-11-26 11:38:31 +05:30
Suman Maharana
f40138a56e
Minor: Fix Powerbi refresh token on expire ( #18774 )
...
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-11-25 23:19:30 +05:30
Imri Paran
d6470b7800
MINOR: fix(data-diff): get added columns ( #18694 )
...
* fix(data-diff): get added columns
- use both columns to calculate schema diff
* fix tests
2024-11-25 15:53:50 +01:00
Imri Paran
c164aff561
MINOR: add reportExplicitAny = false for basedpyright ( #18777 )
2024-11-25 14:38:04 +00:00
Mayur Singal
4b9e214078
MINOR: Fix StackTraceError validation error - Superset ( #18740 )
2024-11-25 15:01:59 +05:30
Imri Paran
ee7d043035
[GEN-2109] feat(mongo): added ssl support ( #18731 )
...
* feat(mongo): added ssl support
Added SSL support for MongoDB using the SSL manager.
Attached a video demo.
- [Example repository for setting up mongodb with SSL](https://github.com/sushi30/mongodb-docker-ssl-example )
- [MongoDB TLS documentation](https://www.mongodb.com/docs/manual/tutorial/configure-ssl/ )
* fixed test_doris.py
2024-11-22 08:54:13 -08:00
