Onkar Ravgan
2ee015e426
Add array supp for json schema parser ( #18255 )
2024-10-15 07:30:16 +05:30
Suman Maharana
dd08bc9ffd
GEN-895: Added Glue Pipeline Lineage ( #18063 )
2024-10-14 13:08:17 +05:30
Suman Maharana
142a506120
Fixed dbt Manifest and Run results parsing ( #18234 )
2024-10-14 13:07:22 +05:30
Imri Paran
3c7f995677
MINOR: fix(looker): exclude version
...
https://github.com/looker-open-source/sdk-codegen/issues/1518
2024-10-11 18:47:43 +00:00
Suman Maharana
69b34684b5
Fixed mysql E2E ( #18229 )
2024-10-11 10:49:03 +00:00
Imri Paran
d0ca05efbf
MINOR: add data quality tests ( #18193 )
...
* test: add dq tests
* wip
* fixed test_all_definition_exists
2024-10-11 12:07:58 +05:30
Imri Paran
bff50664b9
fix(data-quality): table diff url ( #18221 )
...
fixed url for table diff when using service connection
2024-10-11 01:07:29 +05:30
Pere Miquel Brull
f9e99f49e4
TEST - Add ES pagination with multiple filters ( #18162 )
...
* add filtering test
* adding test to paginate with filters
2024-10-10 17:14:22 +02:00
Imri Paran
68e71cb3dc
GEN-970: Refactor redshift system metrics to support freshness test ( #17981 )
...
* ref(profiler): redshift system metrics
- moved redshift system metrics to the redshift source module
- use Timestamp in data quality
- added plugin feature to test utils
* use timezone.utc
* format
* reverted unintended snowflake changes
* fixed import test_system_metrics.py
* revert
* fixed import in tests
2024-10-10 08:32:07 +02:00
IceS2
02d9494e7f
MINOR: Update DB2 dependencies to fix issue about not having ibm-db installed ( #18192 )
...
* Update DB2 dependencies to fix issue about not having ibm-db installed
* Fix checkstyle
2024-10-09 18:39:29 +02:00
devanshGarg-lumiq
fcd34afab5
Fix Redshift profiler for external tables in Redshift Spectrum ( #18182 )
2024-10-09 12:58:57 +02:00
Mayur Singal
e21843b752
Fix #18177 : Fix Hive Metastore connection issue ( #18178 )
2024-10-09 11:34:41 +02:00
Prajwal214
bbd159b947
Minor: Updated pyiceberg version to 0.5.1 ( #18155 )
...
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-10-08 14:55:57 +05:30
Sachin Chaurasiya
457f3d919a
GEN-1322: API Entity - Remove Beta ( #17967 )
...
* GEN-1322: API Entity - Remove Beta
* minor: add doc for the metadata pipeline
* api service refactor
* api service refactor backend changes
* add apiconnection in test service connection
* pytest fix
* fix java file formatting
* Fix casing of REST in ApiServiceRest.spec.ts
* Refactor REST to Rest in API classes
* minor change
* minor change
* minor change
* fix cashing for API to Api
* add playwright test for api service ingestion
* fix: playwright test
---------
Co-authored-by: harshsoni2024 <harshsoni2024@gmail.com>
2024-10-08 14:39:55 +05:30
harshsoni2024
421ad601e9
GEN-1552: Postgres stored procedures support ( #18083 )
2024-10-07 14:28:03 +05:30
Ethan
49fceb4674
Fixes #18104 : change parse_obj and assertEquals which was deprecated ( #18105 )
...
* change deprecationwarning
* fix format python
* fix replace module
* change : java function name
2024-10-07 09:02:41 +02:00
Imri Paran
71720ebc51
fix(table-diff): support cross database ( #18085 )
...
fixed table diff url to include database in all cases
2024-10-04 15:31:17 +02:00
harshsoni2024
1cd97fdac8
get primitive datatype in case of array, struct ( #18102 )
2024-10-04 18:49:50 +05:30
Suman Maharana
d9b15ef6cb
Minor: Resolve protected namespace warning ( #18109 )
2024-10-04 13:01:41 +05:30
Akash Jain
2436337969
fix: PostgreSQL installation in Ingestion Docker ( #18114 )
2024-10-04 11:31:01 +05:30
Mayur Singal
f69db851b8
Fix #18070 : Add support for glue database descriptions ( #18094 )
2024-10-03 21:53:39 -07:00
IceS2
a05eba91a5
MINOR: Fix Ingestion Dockerfile Compatibility by changing IF syntax ( #18098 )
...
* Fix Ingestion Dockerfile Compatibility by changing IF syntax
* Increased shell compatibility by using only one '='
2024-10-04 02:52:48 +05:30
Mayur Singal
088282b0c1
MINOR: MSTR URI Fix ( #18095 )
2024-10-03 17:10:23 +02:00
Onkar Ravgan
23c6f1a6c1
AlationSink conn improvements ( #18091 )
2024-10-03 16:20:35 +05:30
Suman Maharana
bc6f4824ea
Added DBT tests with versionless and fixed v7 parsing ( #18028 )
2024-09-27 19:53:27 +05:30
IceS2
c9d37f6afc
Fix missing cast to str ( #18016 )
2024-09-27 16:03:45 +02:00
harshsoni2024
9442cac1a5
allow powerbi datamodel children in col.lineage ( #18030 )
2024-09-27 19:28:59 +05:30
Teddy
8dc6b7d282
MINOR - Fix General Profiler Bugs ( #17995 )
...
* fix import issue
* fix: better handle None values in profiler processing
* fix: profiler errors
* chore: fix comment
* style: fix python linting failure
* fix: null byte error with the database client
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-27 14:36:30 +02:00
sam-mccarty-mavenclinic
0dd3e97170
Fix 17911: Looker parsing improvements for liquid templating and view/model aliasing ( #17912 )
...
* Looker parsing improvements for liquid templating and view/model aliasing
* add python-liquid dependency to looker plugin requirements
* move to static method with 'openmetadata' context and add rendering tests
* remove backtick stripping
---------
Co-authored-by: Imri Paran <imri.paran@gmail.com>
2024-09-27 13:55:15 +02:00
Mayur Singal
e373fddbde
MINOR: MSTR connector import fix ( #18025 )
2024-09-27 16:57:09 +05:30
Pere Miquel Brull
d26449576a
GEN-1234 - Clean up suggestions when a user is deleted ( #17988 )
...
* GEN-1234 - Clean up suggestions when a user is deleted
* add method
* add method
* fix postgres query
2024-09-26 16:22:36 +02:00
Imri Paran
25284e0232
MINOR: fix snowflake system metrics ( #17989 )
...
* fix snowflake system metrics
* format
* add link to logs and commit
fixed the dq cli test
* reverted bad formatting
* fixed models.py
* removed version pinning for data diff in tests
2024-09-26 11:55:17 +00:00
Suman Maharana
37b6dc8290
Add Sigma Dashboard Connector ( #17855 )
...
* Add Sigma Dashboard Connector
* changed to id instead of name in dashboard entity
* Address Comments
* addressed comments
* Added Docs
* yaml file changes
* fix ui changes
2024-09-26 16:29:35 +05:30
Suman Maharana
d2bce8adf4
Minor: fix lineage & queries in dbt ( #17999 )
2024-09-26 10:50:24 +05:30
IceS2
d36f01abf6
Fix tearDown by using the proper file loader ( #17994 )
2024-09-25 17:37:56 +02:00
Suman Maharana
b3bfa6433e
Fix Manifest is not parsed correctly on dbt versionless ( #17975 )
2024-09-24 23:39:17 +05:30
Imri Paran
64f8571a77
pin testcontainers by minor version ( #17938 )
2024-09-24 09:18:36 +02:00
Aldwyn Cabarrubias
b9f881f2fa
Change time format for the created_at of the DBT cloud pipeline status ( #17916 )
...
Co-authored-by: Suman Maharana <sumanmaharana786@gmail.com>
2024-09-23 14:50:48 +05:30
Teddy
b222de66fe
Minor fix pylint version ( #17944 )
...
* fix import issue
* fix: fix pylint version
* style:ran python linting
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-20 18:50:28 +02:00
Pere Miquel Brull
4cccaae446
GEN-996 - Allow PII Processor without storing Sample Data ( #17927 )
...
* GEN-996 - Allow PII Processor without storing Sample Data
* fix import
* fix import
2024-09-20 16:05:29 +02:00
Ayush Shah
8087f48e15
Fixes #17869 : Add validations in place for salesforce connection ( #17870 )
2024-09-20 16:33:38 +05:30
Pere Miquel Brull
1e56c76c0e
FIX #17896 - Python lineage SDK to work with Uuid & FQN models ( #17928 )
2024-09-20 10:37:41 +02:00
Imri Paran
d09bca26f6
MINOR: fix mssql integration test ( #17923 )
...
* change tag for sql server due to https://github.com/microsoft/mssql-docker/issues/441 (or some similar issue)
* use 2022-latest
* fixed mssql tests
* format
* used new columns
* use the custom sql server
2024-09-20 08:52:40 +02:00
Imri Paran
21af02d8d5
Fix 17903: fix(data-quality): snowflake data diff ( #17907 )
...
* fix(data-quality): snowflake data diff
- fixed schema in snowflake URL for data diff
- added e2e for snowflake data quality
* reverted unintended change
2024-09-19 17:55:48 +02:00
Mayur Singal
1be238266a
MINOR: Apply multi threading in View Lineage Processing ( #17922 )
2024-09-19 15:06:38 +02:00
Imri Paran
760b8eb742
fix(ingestion): deltalake ( #17910 )
...
add pin for deltalake<0.20 to avoid ad35eda798 (diff-f81b8b91e9721dc0a3235b6674a57c0700153b92b59f3988d357950a9c8c4760R1142-R1144)
2024-09-19 08:25:19 +02:00
Teddy
7df05c3e57
Minor python test failure ( #17904 )
...
* fix import issue
* chore: add raise from status on ingestion step in tests
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2024-09-18 17:41:05 +02:00
Teddy
33c50efdbf
GEN-1192 - Move Test Case to its Own Resource ( #17862 )
...
* feat: indexed test case results
* feat: added indexation logic for test case results
* style: ran java linting
* fix: IDE warnigns
* chore: added test case results migration
* style: ran java linting
* fix: postgres migration column json ref
* empty commit to trigger queued
* chore: extracted test case results to its own resource
* chore: fix failing tests
* chore: move testCaseResult state from testSuite and testCase to dynamic field fetched from test case results search index
* chore: clean up test case repository
* style: ran java linting
* chore: removed testCaseResultSummary and testCaseResult state from db
* fix: test failures
* chore: fix index mapping type for result value
* chore: fix test failure
2024-09-18 11:58:59 +02:00
Pere Miquel Brull
f6fdd86d5c
Docs - Ingestion License ( #17893 )
2024-09-17 08:58:53 -07:00
Pere Miquel Brull
6a1cd0ef8b
GEN-1493 - Fix paginate_es in opensearch ( #17858 )
...
* GEN-1493 - Fix opensearch pagination
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
* GEN-1494 - Add CI for py-tests with Postgres and Opensearch
2024-09-17 14:21:10 +02:00
