Ayush Shah
3d4a3cbb95
add mysql e2e changes ( #13145 )
2023-09-12 11:55:19 +05:30
Mayur Singal
2e3e50f0cb
Add used by field in query entity ( #13096 )
2023-09-11 17:30:34 +05:30
Pere Miquel Brull
66a89ffe61
Fix e2e profiler status ( #13127 )
2023-09-10 18:46:28 +02:00
Mayur Singal
4e633877b3
Fix ElasticSearch Test Connection & Deploy ( #13061 )
2023-09-08 12:40:48 +05:30
Mayur Singal
ba09f874df
Fix usage count issue ( #13109 )
2023-09-08 10:36:29 +05:30
Onkar Ravgan
d8e78a32d8
Added Life Cycle fields, API and ingestion integration ( #13014 )
...
* Added initial code
* temp commit
* Added snowflake changes
* Added postgres migration
* removed non req changes
* review comments one
* Added ometa tests
* lint fix
* fix lint naming
* fixed merge changes
2023-09-06 12:37:55 +02:00
Pere Miquel Brull
de7e06d024
Update structure for PII processing ( #13079 )
...
* Update structure for PII processing
* Fix tests
* Fix tests
* Lint
* Remove typo
2023-09-06 11:30:46 +02:00
Pere Miquel Brull
a9b13de893
Move workflows back into src ( #13100 )
...
* Move workflows back into src
* Fix test
2023-09-06 11:30:33 +02:00
Teddy
c52af7eba0
fix: added upsert logic back for system metrics ( #13092 )
2023-09-06 08:12:38 +02:00
Onkar Ravgan
9af14a5a1c
fixed either in lineage req ( #13088 )
2023-09-05 18:18:16 +05:30
Mayur Singal
011eaf8ad5
Fix #13001 : Fix query not populating to all tables ( #13004 )
2023-09-05 14:16:37 +05:30
Onkar Ravgan
a3ca8b6e66
Added project filter pattern to dashboard entity ( #12925 )
2023-09-05 11:01:28 +05:30
Ayush Shah
dc8e59eba8
Fix E2E - dashboards ( #13082 )
2023-09-04 23:25:31 +05:30
vanshika18
db592a157e
fix #12518 support get column lineage in spline ( #13030 )
2023-09-04 17:16:04 +05:30
Pere Miquel Brull
a3bfd4e696
Part of #11968 - Restructure Profiler Workflow and PII Processor ( #13059 )
...
* Structure PII
* Restructure Profiler Workflow
* Update signature for abc
* remove profiler sink
* Fix tests
* Fix lint
* Fix test
* Fix test
2023-09-04 11:02:57 +02:00
Mayur Singal
029786d773
Fix #9207 : Add source in lineage details ( #13046 )
2023-09-04 11:05:56 +05:30
Onkar Ravgan
d24155e173
rmv fqn field tableau ( #13064 )
2023-09-02 12:00:33 +02:00
Teddy
0ef085cfc2
fix: summary for logical test suite ( #13005 )
...
* fix: summary for logical test suite + DI aggregation on OS
* fix: added logic to attached test case result summary to logical test suite
* fix: test case timestamp in ingestion to milliseconds
* fix: updated entityExtensionTimeSeries DAO to dataQualityDataTimeSeries DAO
* fix: revert aggregation changes
2023-09-01 18:01:59 +02:00
Teddy
ab3042e8ee
Issue 12297 bis -- Delete Insert logic in the DI workflow ( #13058 )
...
* fix: updated ingestion to delete existing data for the ingestion day
* fix: added delete endpoint for the report data
* fix: added migration to delete duplicate data + added tables creation & data deltion logic in a transaction
* fix: made deletion SQL engine aware
* fix: added ES deletion logic back while we work on DI event publisher
2023-09-01 18:01:20 +02:00
gauthk6
ba2201f4ea
draft: implementation of lightdash connector. ( #12957 )
...
* Fixes a bug while patching the description of a TestCase
* Update docker-compose.yml
* Update docker-compose.yml
* Ran pre-commit checks and linter
* Added some clarifying points and fixed some grammatical errors in the documentation for installation instructions.
* revert changes made to docs
* implementation of lightdash connector.
* ui: add icon for lightdash service
* chore: update lightdash image
* chore: update the icon
* Cleaned up code (took out debug statements, etc.). Still TODO: yield_dashboard_lineage_details() not being called just yet.
* fix: ran linting
* added null checks
* Delete openmetadata-server.md
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-08-31 17:28:07 +02:00
Pere Miquel Brull
1188831cd5
Fix e2e for tableau, metabase and powerbi ( #13050 )
...
* Fix e2e
* Fix e2e
2023-08-31 15:45:41 +02:00
Pere Miquel Brull
a5667bb585
Fix import ( #13044 )
2023-08-31 08:30:18 +02:00
Pere Miquel Brull
6c0e9f5061
Part of #7272 - Centralize Workflows, Status, and Exception Management ( #13029 )
...
* Prep changes
* Prep changes
* prep changes
* Update imports
* Format
* Prep delete
* Prep delete
* Fix sink
* Prep test
* Commit
* passing either
* passing either
* Prep Either
* Metadata source with Either
* Update status
* Merge remote-tracking branch 'upstream/main' into issue-7272
* Format
* Linting
* Linting
* Linting
* Linting
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Comments
2023-08-30 15:49:42 +02:00
vanshika18
3cc15e6d0b
Fixed #8418 added new connector couchbase ( #12836 )
2023-08-29 11:16:32 +05:30
Ayush Shah
407900e5b4
Fix e2e according to latest changes ( #13018 )
2023-08-29 10:23:23 +05:30
Ayush Shah
300347fdd3
Fix mysql e2e ( #13010 )
2023-08-28 23:14:22 +05:30
Teddy
101cd0ebac
Issue 8930 - Update profiler timestamp from seconds to milliseconds ( #12948 )
2023-08-25 08:47:16 +02:00
Sriharsha Chintalapani
19b5c946a7
Fix #12167 : Support for Stored Procedures as another entity under Database Schema ( #12999 )
...
* Add Stored Procedure Entity
* Stored Procedure repository
* Stored Procedure repository
* Fix #12998 : Support for Stored Procedures as another entity under Database Schema
* Fix #12998 : Support for Stored Procedures as another entity under Database Schema
2023-08-25 08:14:30 +02:00
vanshika18
496abf0392
Fixed #12445 support lineage for clickhouse materialized views ( #12938 )
2023-08-24 17:48:44 +05:30
vanshika18
52153dba98
fixed #10691 support multiDatabase, usage & lineage support for Azure SQL ( #12982 )
2023-08-24 17:47:41 +05:30
Ayush Shah
4464df81ff
Add include views to profiler ( #12974 )
2023-08-23 17:30:44 +05:30
Ayush Shah
1e8ea26bbd
Refactor converter, unique count, add registry ( #12939 )
2023-08-23 11:43:12 +05:30
Mayur Singal
817b9853df
Oracle add filter for lineage query ( #12945 )
2023-08-22 09:46:37 +02:00
Mayur Singal
f6d5c7413f
Fix #6700 : Add support for table properties: file format for datalake ( #12920 )
...
* Fix #6700 : Add support for table properties: file format for datalake & storage
* pylint fix
* resolve review comments
2023-08-22 09:46:22 +02:00
Ayush Shah
f6fc2e3b0c
Fix Oracle case issue ( #12944 )
2023-08-21 16:33:20 +05:30
Pere Miquel Brull
2f3a50e95f
Fix #8885 - Misleading 404 logs & suffix cleanup ( #12916 )
...
* Fix #8885 - Misleading 404 debug logs
* Clean get_suffix complexity
* Prepare airflow config
* Add bootstrap comment
* Revert "Add bootstrap comment"
This reverts commit cc053513df6e25bcc5e742786adb91339461fdd2.
* Revert "Prepare airflow config"
This reverts commit f57645fe953e17d6153652daa1f42c14b97c942d.
* add removed method
* Add icons for docs
* Add missing routes
2023-08-21 11:35:36 +02:00
Ayush Shah
316b1e3f5b
Fix Impersonation issue ( #12933 )
2023-08-21 14:52:15 +05:30
Suresh Srinivas
28b5e00c0c
Clean up documentation typos and grammar issues ( #12930 )
2023-08-20 20:08:30 -07:00
Yu Ishikawa
6b6d4bba76
Support to impersonate a service account in the Bigquery source ( #10127 )
2023-08-20 19:20:02 +05:30
Teddy
bfa0cc7598
fix: python tests failure after PR #12865 ( #12927 )
...
* fix: python tests failure after https://github.com/open-metadata/OpenMetadata/pull/12865
* fix: test in ometa_table_api
* fix: skip is None test temporarly
2023-08-18 18:11:47 +02:00
Pere Miquel Brull
191754ff20
Set Test Suite FQN ( #12890 )
...
* Set Test Suite FQN
* quoteName
* quoteFqn is false for TestSuites
* Fix tests
2023-08-18 18:56:26 +05:30
Mayur Singal
2f7a2193e0
Fix #12302 : Add ElasticSearch Ingestion Source ( #12892 )
2023-08-18 15:10:31 +05:30
Onkar Ravgan
5b47fd4acf
Added source url to entities ( #12901 )
...
* Added source url to entites
* added support to create and update sourceUrl
* fixed pytests
---------
Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-08-18 10:17:38 +02:00
Ayush Shah
f9e3e1801f
Add External Table type support bq ( #12889 )
2023-08-18 13:45:14 +05:30
Onkar Ravgan
795294c87f
Added dbt multiple project support for s3, azure, gcs datalake sources ( #12856 )
...
* Added dbt multiple proj support
* added reader
* common method to group by dir
* added return type
2023-08-17 11:19:20 +02:00
Teddy
751c96e437
Fixes Issue #12297 - Added upsert logic for DI ( #12466 )
...
* fix: enforce DB upsert on DI ingestion
* fix: ran python linting
* feat: fix conflict and added BindFQN while removing hash
* feat: update aggregation from day to minute
* feat: ran python linting
2023-08-17 08:07:44 +02:00
vanshika18
d6e4169faf
Fixed #11519 Support Usage queries contain \n characters ( #12676 )
2023-08-17 11:21:12 +05:30
Onkar Ravgan
3114ef9b5c
Add support for JWT auth in Trino ( #12823 )
...
* Added jwt field in trino
* fixed postgres migration
* fixed pytests
2023-08-17 07:22:58 +02:00
Supan Shah
73bb5da6bf
ISSUE-12820: Sagemaket Metadata Success ( #12843 )
2023-08-16 13:02:55 -07:00
Pere Miquel Brull
a183fc67e2
Fix ADLS parquet reads ( #12840 )
...
* Fix ADLS parquet reads
* Generalize service methods
* Fix tests
2023-08-14 19:57:06 -07:00
