Onkar Ravgan
eafa6b8772
Added domo federated dataset support ( #17061 )
2024-07-22 11:17:28 +05:30
Ayush Shah
3df3e6ef71
Add Bound to Setuptools ( #17105 )
2024-07-22 00:38:07 +05:30
Ayush Shah
5be5a05390
Fixes #17051 : Dynamic import for Profiler Interface ( #17073 )
2024-07-19 17:33:19 +05:30
Imri Paran
d59b83f9d1
MINOR[GEN-978]: Fix empty test suites ( #16975 )
...
* tests: refactor
refactor tests and consolidate common functionality in integrations.conftest
this enables writing tests more concisely.
demonstrated with postgres and mssql.
will migrate more
* format
* removed helpers
* changed scope of fictures
* changed scope of fixtures
* added profiler test for mssql
* fixed import in data_quality test
* json safe serialization
* format
* set MARS_Connection
* fix(data-quality): empty test suite
do not raise for empty test suite
* format
* dont need to check length in _get_test_cases_from_test_suite
* fix
* added warning if no test cases are found
2024-07-19 12:12:34 +02:00
Ayush Shah
4c657de5d8
Fixes #16501 : Optimize Rows Sample Type Snowflake ( #17055 )
2024-07-19 15:38:39 +05:30
IceS2
d145341026
MINOR: Fix Oracle E2E Tests ( #17084 )
...
* Fix Oracle E2E Tests
* Fix Checkstyle
* Add link to issue in the reason
2024-07-19 10:32:22 +02:00
IceS2
aa3d54aede
Fix Vertica E2E Counts ( #17071 )
2024-07-18 14:54:15 +02:00
IceS2
14e475cefe
MINOR: Add PyRight TypeCheck to our Python Project ( #17060 )
...
* Add PyRight TypeCheck to our Python Project
* Change pyright for basedpyright
* Fix PyRight
2024-07-18 11:52:56 +02:00
harshsoni2024
a117b0224d
MINOR: query log path as dir/file ( #17048 )
...
* fetch query log path as dir/file
* add test for multiple files log fetch
* non-csv log file test
2024-07-17 15:23:41 +05:30
mgorsk1
173076b55e
🎉 Init ( #16903 )
...
Signed-off-by: mgorsk1 <gorskimariusz13@gmail.com>
2024-07-17 08:12:48 +00:00
Imri Paran
0fee79b200
MINOR: fix sample data issue with Pydantic v2 and refactor python integration tests ( #16943 )
...
* tests: refactor
refactor tests and consolidate common functionality in integrations.conftest
this enables writing tests more concisely.
demonstrated with postgres and mssql.
will migrate more
* format
* removed helpers
* changed scope of fictures
* changed scope of fixtures
* added profiler test for mssql
* fixed import in data_quality test
* json safe serialization
* format
* set MARS_Connection
* use SerializableTableData instead of TableData
* deleted file test_postgres.py
* fixed tests
* added more test cases
* format
* changed name test_models.py
* removed the logic for serializing table data
* wip
* changed mapping in common type map
* changed mapping in common type map
* reverted TableData imports
* reverted TableData imports
* reverted TableData imports
2024-07-17 08:11:34 +02:00
Antoine Balliet
e67ba6b14c
feat: BigQuery ingestion allow specify projectId and fix primary key constrains retrieval ( #16956 )
2024-07-17 11:21:17 +05:30
harshsoni2024
52dc5b551e
MINOR: fix column name in databricks ingestion fail ( #17019 )
...
* add backticks in column_name
* add test for column name with .
2024-07-17 10:25:12 +05:30
Teddy
3bcfdfe014
MINOR - enable dynamic assertion dl ( #17008 )
...
* fix: refactor runtime param setter + add dynamic assertion support for datalake
* chore: add missing test dependencies
* fix: centralize objecxt constructor in interface
* fix: remove abstract decorator in interface
2024-07-16 11:01:43 +02:00
IceS2
f845663317
Update test_cli_metabase.py ( #17026 )
2024-07-16 10:05:27 +02:00
Antoine Balliet
aeea2df86e
feat: allow specify schemaRegistryTopicSuffixName ( #17027 )
...
* feat: allow specify schemaRegistryTopicSuffixName
* chore: use default value
* add comment
* fix doc
2024-07-15 17:35:01 +02:00
Ayush Shah
eeda6d24ae
Fixes #16697 : Modify the Query to avoid Numeric Data Overflow ( #16920 )
2024-07-12 17:23:53 +05:30
Pere Miquel Brull
2aef457785
FIX #16481 - Truncate ingestion pipeline status ( #16997 )
...
* FIX #16481 - Truncate ingestion pipeline status
* FIX #16481 - Truncate ingestion pipeline status
* FIX #16481 - Truncate ingestion pipeline status
2024-07-12 09:44:21 +02:00
harshsoni2024
d5af2ba6b6
sample data for open metadata user & table apis ( #16981 )
2024-07-12 10:32:21 +05:30
Imri Paran
98d0e10783
chore: timedelta to string ( #16985 )
...
implemented utils.time_utils..timedelta_to_string
2024-07-11 14:23:07 +02:00
Mayur Singal
4eadcfdc5d
Fix #16590 : Allow only team groups to be owner ( #16995 )
2024-07-11 14:17:13 +05:30
Onkar Ravgan
c3cc1a5e5b
Added owner to tableau datamodel ( #16986 )
2024-07-11 10:21:37 +05:30
Matt Chamberlin
d757aa9d77
Fixes 16652: add GCS storage service ( #16917 )
...
* FEAT-16652: add GCS storage service
* reformat
* update connection tests
* fix tests
* relax google-cloud-storage version constraint
* fix GCP config in tests
---------
Co-authored-by: Matthew Chamberlin <mchamberlin@ginkgobioworks.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2024-07-10 14:03:28 +02:00
Imri Paran
0740b01624
MINOR: log context when failing to yield table ( #16977 )
...
* chore: log context when failing to yield table
* changed error to db/schema/table
2024-07-10 14:02:49 +02:00
harshsoni2024
0caa8a8018
API service sample data ( #16971 )
...
* add sample data for api service
* pylint fix
* correct service connection json
* fix sample data
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-07-09 22:06:47 -07:00
Teddy
2ad53a3634
fix: mapper return type ( #16964 )
2024-07-09 18:08:03 +02:00
Mayur Singal
cbc8eb4650
MINOR: Fix snowflake test failure due to sqlparse upgrade ( #16970 )
2024-07-09 18:07:24 +02:00
Teddy
c8870a0f1c
fix: compute overall and regex count in the same query ( #16962 )
2024-07-09 14:05:13 +02:00
Teddy
c361305902
MINOR - fix sample data ingestion ( #16949 )
...
* fix: sample data ingestion
* style: ran python linting
2024-07-09 10:18:55 +02:00
Ayush Shah
421d191bae
Fixes 16562: Modify HiveCompiler to compile column names properly ( #16954 )
...
* Modify HiveCompiler to compile column names properly
2024-07-09 12:59:23 +05:30
Onkar Ravgan
49876b9cd6
fixed e2e for mysql and quicksight ( #16959 )
2024-07-08 20:50:02 +05:30
harshsoni2024
9012c738e0
MINOR: Redshift view lineage error ( #16947 )
...
* fix create view query in view lineage
* fix view_defs for normal view and late binding view
2024-07-08 18:45:37 +05:30
Mayur Singal
afafb4af92
MINOR: Add support for s3 unstructured files ( #16936 )
2024-07-08 15:24:39 +05:30
Imri Paran
da6da45373
MINOR: fix bigquery profiler ( #16933 )
...
* fix: bigquery profiler
cast creation_time from __TABLES__ to datetime
* format
* removed comment
* format
2024-07-05 10:21:43 +00:00
Imri Paran
43f46196a4
tests: postgres container ( #16924 )
...
added track_commit_timestamp=on so we can track table updates in tests
https://www.postgresql.org/docs/current/runtime-config-replication.html#GUC-TRACK-COMMIT-TIMESTAMP
2024-07-05 11:34:56 +02:00
Onkar Ravgan
3596b551ed
Fixed dashboarddatamodel fqn from context ( #16866 )
2024-07-05 08:32:13 +02:00
Imri Paran
d08af1f86d
MINOR: Fix data diff with threshold ( #16926 )
...
* fix: table-diff
passed threshold and diff count in wrong order. test was not covering this due to how the parameters were configured.
2024-07-05 07:51:24 +02:00
Pere Miquel Brull
7e98ece3e5
MINOR - Pydantic V2 warnings and better exception msg ( #16916 )
2024-07-04 14:54:41 +02:00
Onkar Ravgan
80efc7075f
Fix #15163 : Added SAP ERP Connector
2024-07-04 10:57:46 +05:30
Imri Paran
9b5ce3560c
MINOR: Pydantic equal assert util ( #16918 )
...
* tests: pydantic object assertion
added util for comparing pydantic objects
* fixed test_data_diff.py
2024-07-04 09:59:46 +05:30
Matt Chamberlin
6456512fbd
Fixes 16582: support SASL_SSL kafka auth for OpenLineage pipeline connector ( #16597 )
...
* support SASL_SSL kafka auth for OpenLineage pipeline connector
* update documentation
* use existing saslMechanismType schema
---------
Co-authored-by: Matthew Chamberlin <mchamberlin@ginkgobioworks.com>
2024-07-03 16:47:28 +02:00
Onkar Ravgan
00d74d1776
Fix #15721 : Added Override flag to force update of Description, Tags and Owner from Source System ( #16815 )
2024-07-03 11:48:06 +05:30
chiller
a1b41dae06
Fix #16899 : Iterate over all results collected from response ( #16900 )
2024-07-03 08:15:20 +02:00
harshsoni2024
da37626794
superset lineage fix ( #16820 )
...
* fix column list for lineage in db connection
* fix for column yield in datamodel
* superset add test for datamodel of db
2024-07-03 10:55:47 +05:30
Mayur Singal
10b480ee15
MINOR: Fix QlikCloud App Pagination & Test Connection ( #16885 )
2024-07-02 18:49:47 +05:30
Trs
72cb0090fd
Add warning log for missing DBT test case results in node ( #16808 )
2024-07-02 13:11:18 +00:00
Imri Paran
2c9aeebcb8
MINOR: add column diff for table diff test case ( #16809 )
...
* feat(table-diff): added column validation
added column validation for table diff that will be carried out before running the row level diff. If a diff for the column exists, it will short circuit the test and report.
* fixed unit tests
* format
* - resolve column types more robustly
- changed test result metric to include "rows" or "columns"
2024-07-02 10:36:03 +00:00
Imri Paran
404b40ad53
Fix #16700 : Fail ingestion gracefully when column is not compatible with test type ( #16806 )
...
* fix(data-quality): incompatible columns
gracefully fail when a column of incompatible type is submitted for a test case
* format
* added condition to handle only colum test cases
* fixed tests
* format
2024-07-02 09:56:35 +02:00
Imri Paran
2f0a8efceb
MINOR: added table diff sample results ( #16844 )
...
* chore(sample-data): table diff
added table diff results sample
* format
2024-07-01 15:28:14 +00:00
Chirag Madlani
6c1a12a95f
chore: Update main branch for 1.5.0 Release ( #16860 )
2024-07-01 16:46:16 +05:30
