Ayush Shah
407900e5b4
Fix e2e according to latest changes ( #13018 )
2023-08-29 10:23:23 +05:30
Ayush Shah
300347fdd3
Fix mysql e2e ( #13010 )
2023-08-28 23:14:22 +05:30
Teddy
101cd0ebac
Issue 8930 - Update profiler timestamp from seconds to milliseconds ( #12948 )
2023-08-25 08:47:16 +02:00
Sriharsha Chintalapani
19b5c946a7
Fix #12167 : Support for Stored Procedures as another entity under Database Schema ( #12999 )
...
* Add Stored Procedure Entity
* Stored Procedure repository
* Stored Procedure repository
* Fix #12998 : Support for Stored Procedures as another entity under Database Schema
* Fix #12998 : Support for Stored Procedures as another entity under Database Schema
2023-08-25 08:14:30 +02:00
vanshika18
496abf0392
Fixed #12445 support lineage for clickhouse materialized views ( #12938 )
2023-08-24 17:48:44 +05:30
vanshika18
52153dba98
fixed #10691 support multiDatabase, usage & lineage support for Azure SQL ( #12982 )
2023-08-24 17:47:41 +05:30
Ayush Shah
4464df81ff
Add include views to profiler ( #12974 )
2023-08-23 17:30:44 +05:30
Ayush Shah
1e8ea26bbd
Refactor converter, unique count, add registry ( #12939 )
2023-08-23 11:43:12 +05:30
Mayur Singal
817b9853df
Oracle add filter for lineage query ( #12945 )
2023-08-22 09:46:37 +02:00
Mayur Singal
f6d5c7413f
Fix #6700 : Add support for table properties: file format for datalake ( #12920 )
...
* Fix #6700 : Add support for table properties: file format for datalake & storage
* pylint fix
* resolve review comments
2023-08-22 09:46:22 +02:00
Ayush Shah
f6fc2e3b0c
Fix Oracle case issue ( #12944 )
2023-08-21 16:33:20 +05:30
Pere Miquel Brull
2f3a50e95f
Fix #8885 - Misleading 404 logs & suffix cleanup ( #12916 )
...
* Fix #8885 - Misleading 404 debug logs
* Clean get_suffix complexity
* Prepare airflow config
* Add bootstrap comment
* Revert "Add bootstrap comment"
This reverts commit cc053513df6e25bcc5e742786adb91339461fdd2.
* Revert "Prepare airflow config"
This reverts commit f57645fe953e17d6153652daa1f42c14b97c942d.
* add removed method
* Add icons for docs
* Add missing routes
2023-08-21 11:35:36 +02:00
Ayush Shah
316b1e3f5b
Fix Impersonation issue ( #12933 )
2023-08-21 14:52:15 +05:30
Suresh Srinivas
28b5e00c0c
Clean up documentation typos and grammar issues ( #12930 )
2023-08-20 20:08:30 -07:00
Yu Ishikawa
6b6d4bba76
Support to impersonate a service account in the Bigquery source ( #10127 )
2023-08-20 19:20:02 +05:30
Teddy
bfa0cc7598
fix: python tests failure after PR #12865 ( #12927 )
...
* fix: python tests failure after https://github.com/open-metadata/OpenMetadata/pull/12865
* fix: test in ometa_table_api
* fix: skip is None test temporarly
2023-08-18 18:11:47 +02:00
Pere Miquel Brull
191754ff20
Set Test Suite FQN ( #12890 )
...
* Set Test Suite FQN
* quoteName
* quoteFqn is false for TestSuites
* Fix tests
2023-08-18 18:56:26 +05:30
Mayur Singal
2f7a2193e0
Fix #12302 : Add ElasticSearch Ingestion Source ( #12892 )
2023-08-18 15:10:31 +05:30
Onkar Ravgan
5b47fd4acf
Added source url to entities ( #12901 )
...
* Added source url to entites
* added support to create and update sourceUrl
* fixed pytests
---------
Co-authored-by: 07Himank <himank07mehta@gmail.com>
2023-08-18 10:17:38 +02:00
Ayush Shah
f9e3e1801f
Add External Table type support bq ( #12889 )
2023-08-18 13:45:14 +05:30
Onkar Ravgan
795294c87f
Added dbt multiple project support for s3, azure, gcs datalake sources ( #12856 )
...
* Added dbt multiple proj support
* added reader
* common method to group by dir
* added return type
2023-08-17 11:19:20 +02:00
Teddy
751c96e437
Fixes Issue #12297 - Added upsert logic for DI ( #12466 )
...
* fix: enforce DB upsert on DI ingestion
* fix: ran python linting
* feat: fix conflict and added BindFQN while removing hash
* feat: update aggregation from day to minute
* feat: ran python linting
2023-08-17 08:07:44 +02:00
vanshika18
d6e4169faf
Fixed #11519 Support Usage queries contain \n characters ( #12676 )
2023-08-17 11:21:12 +05:30
Onkar Ravgan
3114ef9b5c
Add support for JWT auth in Trino ( #12823 )
...
* Added jwt field in trino
* fixed postgres migration
* fixed pytests
2023-08-17 07:22:58 +02:00
Supan Shah
73bb5da6bf
ISSUE-12820: Sagemaket Metadata Success ( #12843 )
2023-08-16 13:02:55 -07:00
Pere Miquel Brull
a183fc67e2
Fix ADLS parquet reads ( #12840 )
...
* Fix ADLS parquet reads
* Generalize service methods
* Fix tests
2023-08-14 19:57:06 -07:00
Ayush Shah
1e2d93a604
Fix #12479 : MariaDB Mysql Time Col profiler issues + fix e2e tests ( #12868 )
2023-08-14 17:28:09 +05:30
Teddy
8e4388c35e
Issue 11345 ( #12859 )
...
* feat: added serviceName dimension to entity report
* feat: fix python test
2023-08-14 08:05:14 +02:00
Ayush Shah
5ea4de646c
Fix Postgres Profiler for incompatible versions ( #12795 )
2023-08-11 15:32:43 +05:30
Mayur Singal
a17ac7bcbb
Fix: pyodbc type not supported for -150 ( #12851 )
2023-08-11 15:32:19 +05:30
Ayush Shah
8776069940
Fix Qliksense import ( #12849 )
2023-08-11 12:28:05 +05:30
Sriharsha Chintalapani
7aaf654f01
Fix #12779 : Add support for SearchIndexes for ElasticSearch and OpenSearch ( #12782 )
...
* Fix #12779 : Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix #12779 : Add support for SearchIndexes for ElasticSearch and OpenSearch
* Fix #12779 : Add support for SearchIndexes for ElasticSearch and OpenSearch
* Rebase fixes with main
* Add Sample Data
* lint fix
* remove unused import
* Fix service count test
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-08-10 16:47:37 -07:00
Pere Miquel Brull
d8e288626c
Storage connection naming, ADLS service and namespace packaging ( #12810 )
...
* Update storage connection naming
* Update storage services and remove typing of generic service
* Remove inits for namespace package
* Add test connection
* Revert "Remove inits for namespace package"
This reverts commit 89f1ae9ea8a633593776f51caf2586d2110d4636.
* Add enum
* Remove init to allow namespace packaging in some modules
* Remove init to allow namespace packaging in some modules
* Move examples and fix test
* Format
* Linting
2023-08-10 07:32:58 +02:00
Pere Miquel Brull
97c982b12a
Fix #12798 - Update Snowflake GetTables test query ( #12804 )
2023-08-10 07:30:34 +02:00
Pere Miquel Brull
e97d4befb1
Fix #12770 - Cleanup DL structure & Readers & Python 3.8 ( #12776 )
2023-08-09 16:07:16 +05:30
Sriharsha Chintalapani
d4ed941371
Fix #12783 : Metadata Ingestion is dropping constraints just to add them again afterwards ( #12784 )
2023-08-08 13:51:10 +05:30
Pere Miquel Brull
a82c2f001c
Fix #9704 - Add inline TNS string ( #12711 )
...
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-08-07 11:04:13 +02:00
Pere Miquel Brull
6f89ca089d
Log the query in restore if there are any exceptions ( #12761 )
2023-08-07 11:03:47 +02:00
Mayur Singal
ed7f74c7b2
Improve exception handling for superset ( #12753 )
...
* Improve exception handling for supersert
* Update ingestion/src/metadata/ingestion/source/dashboard/superset/api_source.py
2023-08-04 11:31:40 +02:00
Mayur Singal
2f3b965f1c
Fix snowflake connection when no database passed ( #12746 )
2023-08-04 11:31:19 +02:00
Onkar Ravgan
146d8a5166
avro record dtype fix ( #12750 )
2023-08-04 14:27:29 +05:30
Akash Jain
fd0b1b9fed
fix: Align Docker Base Image to use airflow 2.5.3 ( #12737 )
2023-08-04 12:08:58 +05:30
Pere Miquel Brull
10f2567fe9
Fixes #12555 - Fix DL test suite ( #12727 )
...
* Fix DL test suite
* Fix linting
2023-08-03 11:48:22 +02:00
Matias Puerta
e203ece20c
[CHORE] Reduce docker image size by removing pip cache ( #12708 )
...
* [CHORE] Reduce docker image size by removing pip cache
* [CHORE] Reduce image size for ingestion/operators as well
* [CHORE] Reduce image size for CI
2023-08-02 14:36:27 +02:00
Mayur Singal
819bb27ee0
Fix airflow not ingesting pipelines ( #12683 )
2023-08-01 13:00:02 +05:30
Mayur Singal
5f07c6281a
Clickhouse: Make https protocol as permanent field ( #12303 )
2023-07-31 19:26:03 +05:30
Mayur Singal
8f6e5eed31
Automated Lineage by Query for Python SDK & CLI ( #12672 )
2023-07-31 19:25:41 +05:30
Ayush Shah
2e259a9899
Python Dependency Conflict fixes ( #12667 )
...
* Fixes Dependency conflict
* add fix to dep
2023-07-31 14:44:25 +02:00
Onkar Ravgan
795498c54a
Fixed athena import and lineage/usage validation ( #12663 )
...
* Athena fixes
* fixed to lower version
2023-07-31 12:37:48 +02:00
Mayur Singal
dacd13f6d0
Fix #11778 : Add support for hive metastore ingestion ( #12599 )
2023-07-31 15:56:02 +05:30
