Pere Miquel Brull
a82c2f001c
Fix #9704 - Add inline TNS string ( #12711 )
...
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-08-07 11:04:13 +02:00
Pere Miquel Brull
6f89ca089d
Log the query in restore if there are any exceptions ( #12761 )
2023-08-07 11:03:47 +02:00
Mayur Singal
ed7f74c7b2
Improve exception handling for superset ( #12753 )
...
* Improve exception handling for supersert
* Update ingestion/src/metadata/ingestion/source/dashboard/superset/api_source.py
2023-08-04 11:31:40 +02:00
Mayur Singal
2f3b965f1c
Fix snowflake connection when no database passed ( #12746 )
2023-08-04 11:31:19 +02:00
Onkar Ravgan
146d8a5166
avro record dtype fix ( #12750 )
2023-08-04 14:27:29 +05:30
Akash Jain
fd0b1b9fed
fix: Align Docker Base Image to use airflow 2.5.3 ( #12737 )
2023-08-04 12:08:58 +05:30
Pere Miquel Brull
10f2567fe9
Fixes #12555 - Fix DL test suite ( #12727 )
...
* Fix DL test suite
* Fix linting
2023-08-03 11:48:22 +02:00
Matias Puerta
e203ece20c
[CHORE] Reduce docker image size by removing pip cache ( #12708 )
...
* [CHORE] Reduce docker image size by removing pip cache
* [CHORE] Reduce image size for ingestion/operators as well
* [CHORE] Reduce image size for CI
2023-08-02 14:36:27 +02:00
Mayur Singal
819bb27ee0
Fix airflow not ingesting pipelines ( #12683 )
2023-08-01 13:00:02 +05:30
Mayur Singal
5f07c6281a
Clickhouse: Make https protocol as permanent field ( #12303 )
2023-07-31 19:26:03 +05:30
Mayur Singal
8f6e5eed31
Automated Lineage by Query for Python SDK & CLI ( #12672 )
2023-07-31 19:25:41 +05:30
Ayush Shah
2e259a9899
Python Dependency Conflict fixes ( #12667 )
...
* Fixes Dependency conflict
* add fix to dep
2023-07-31 14:44:25 +02:00
Onkar Ravgan
795498c54a
Fixed athena import and lineage/usage validation ( #12663 )
...
* Athena fixes
* fixed to lower version
2023-07-31 12:37:48 +02:00
Mayur Singal
dacd13f6d0
Fix #11778 : Add support for hive metastore ingestion ( #12599 )
2023-07-31 15:56:02 +05:30
Ayush Shah
e39918ffc3
Add fix for snowflake transient tables ( #12662 )
2023-07-31 15:07:05 +05:30
Onkar Ravgan
bf44c7996a
fixed nested records avro ( #12633 )
...
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-07-31 11:54:29 +05:30
Ayush Shah
b1308b76d5
oid ambiguitious error or not exists fixed ( #12619 )
2023-07-31 10:47:45 +05:30
vanshika18
a0dd821bd1
Support SingleStore metadata ingestion (JSON type fields) ( #12623 )
...
* Support SingleStore metadata ingestion (JSON type fields)
* Removing Collate Keyword all datatypes
---------
Co-authored-by: Vanshika Kabra <vanshikakabra@Vanshikas-MacBook-Pro.local>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-07-29 12:27:05 -07:00
Onkar Ravgan
bad506b5d9
Backup CLI case sensitivity fix for postgres sql ( #12588 )
2023-07-28 11:27:19 +05:30
vanshika18
02ec8b0161
Support Azure Datalake Test Connection fixes ( #12579 )
...
* Support Azure Datalake Test Connection fixes
* Rename function name and remove unwanted argument
---------
Co-authored-by: Vanshika Kabra <vanshikakabra@Vanshikas-MacBook-Pro.local>
2023-07-27 23:25:25 +05:30
vanshika18
3111f91a06
Support delete temporary credentials files of Google Cloud ( #12590 )
...
Co-authored-by: Vanshika Kabra <vanshikakabra@Vanshikas-MacBook-Pro.local>
2023-07-27 23:24:55 +05:30
Mayur Singal
c6de61f6bc
Add Lineage Parsing timeout and filtering condition ( #12560 )
2023-07-27 12:28:53 +05:30
Anuj359
1417621ddc
security-scan fix ( #12585 )
2023-07-27 11:41:25 +05:30
Pere Miquel Brull
6773541d15
[1.1.1] - Bump size for FQN ( #12092 )
...
* Bump size for FQN
* Bump table entityName size
* Bump table entityName size
* Fix table resource tests
* Remove pattern from fqn
* Remove pattern from fqn
* Remove pattern from fqn
* Generalize get_by_name in ometa client
* Generalize get_by_name in ometa client
* Format
* Fix test suite
* Remove limit from FQN max size
* Remove limit from FQN max size
* Add sample data
* Update lint names
* Add more sample data
* Bump column name size
* 1024 max FQN length
* 1024 max FQN length
* 1024 max FQN length
* Bump FQN
2023-07-26 12:36:42 -07:00
Sriharsha Chintalapani
67b68a70c9
Fix #7712 : Align AuthProvider values in the JSON schema definition ( #11508 )
...
* Fix #7712 : Align AuthProvider values in the JSON schema definition
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Handle new providers
* Lint
* Fix #7712 : Align AuthProvider values in the JSON schema definition
* Handle new providers
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Fix ingestion bot initialization, create jwt token if there is no authMechanism pre-configured
* Lint
* fix rebase
* Fix test
* Fix test
* Fix Usage of Auth Provider in User Resource
* remove unused function
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-07-26 11:34:58 -07:00
Onkar Ravgan
0f8ebf4afe
Fixed Tableau-Bigquery lineage issue ( #12570 )
2023-07-26 16:07:48 +05:30
Onkar Ravgan
30cdc840ab
Added excp msg ( #12561 )
2023-07-26 16:07:34 +05:30
Ayush Shah
307dcbf629
Add DateTimeRange support in postgres ( #12583 )
2023-07-26 14:31:48 +05:30
vanshika18
72e4d0070f
Support MSSLQ handle multiple databases with pyodbc connection ( #12526 )
2023-07-26 10:43:24 +05:30
Shailesh Parmar
19c3c016a1
ui: Display createdDateTime and sizeInByte profile metrics #12196 ( #12568 )
...
* ui: Display createdDateTime and sizeInByte profile metrics #12196
* Modify Sample Data
* updated profile matrix as per date object
---------
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-07-25 23:02:19 +05:30
Ayush Shah
6c21da0d7b
Fixes 12224: Can't ingest binary sample data ( #12564 )
2023-07-25 12:33:26 +05:30
Anuj359
22e87df5af
Fixing/security scan ( #12562 )
...
* Updating Dockerfile with multistage
* Updating reviewed changes
* Docker Development changes
* Docker workflow changes
* Arguments update
* Script path update
* Arguments update
* Resolving the reviewed suggestions
* Updating omd api version for security scan
2023-07-24 11:52:45 +05:30
Onkar Ravgan
94166aeb84
fixed mssql comments ( #12546 )
2023-07-24 11:03:11 +05:30
Ayush Shah
30946ab0e9
Fix Cast and Col checks - Clickhouse ( #12556 )
...
* Fix Cast and Col checks
* fix lint
2023-07-22 12:53:24 +05:30
Ayush Shah
246bf15476
Add Clickhouse profiler fix ( #12531 )
2023-07-21 10:19:56 +05:30
mgorsk1
cd347299d7
Fixes 12439: Remove braces from approx_percentile method (Trino/Presto) in profiler ( #12440 )
...
* 🐛 Remove braces from approx_percentile method (Trino/Presto)
* 👌 Updating code due to code review changes.
2023-07-20 20:20:24 +05:30
vanshika18
c1c61c16df
fix #2936 : Support Usage connector for Trino ( #12483 )
2023-07-20 19:51:17 +05:30
Ayush Shah
ab1ec50c2c
Fixes Mssql Ntext, text and Image ( #12490 )
2023-07-20 13:34:35 +05:30
Mayur Singal
fee567d714
Fix #12301 : Fix vertica col comments for projections with the same name ( #12504 )
2023-07-20 13:18:18 +05:30
Onkar Ravgan
3e7e71d10a
Fixed bkp after fqnhash ( #12510 )
2023-07-20 12:00:06 +05:30
Mayur Singal
0c6435ae9b
Fix #2957 : Add support for qlik sense enterprise connector ( #12450 )
2023-07-19 21:08:05 +05:30
Ayush Shah
940ab3d183
Fix Dependency issue - mssql ( #12499 )
2023-07-19 07:27:38 +00:00
Onkar Ravgan
ceef44205b
added complex desc ( #12478 )
2023-07-19 12:01:12 +05:30
Mayur Singal
e79067d69a
Airflow add task type during ingestion ( #12310 )
2023-07-19 00:30:48 +05:30
vanshika18
b699acd900
Support Snowflake Database or Schema when has . in the name ( #12349 )
2023-07-18 21:12:12 +05:30
Onkar Ravgan
a3e11ac59c
disabled pymmsql dependancy ( #12481 )
2023-07-18 19:07:19 +05:30
Ayush Shah
27a0c9e802
Fix Docker Import ( #12455 )
2023-07-17 12:50:11 +05:30
Pere Miquel Brull
44d9f62bba
Fix explore cache name ( #12441 )
2023-07-14 14:12:11 +02:00
Teddy
838ff73a4e
add sample data for table profile ( #12422 )
2023-07-14 09:13:22 +02:00
Teddy
42a426226e
Fixes Issue #11803 #12103 - Add BigQuery Struct Support ( #12435 )
...
* ref: implemented interface for profiler components + removed struct logic
* ref: ran python linting
* ref: added UML diagram to readme.md
* ref: empty commit for labeler check
* ref: remove multiple context manager for 3.7 3.8 compatibility
* ref: remove
* fix: mapper logic for BQ struct types
* feat: added BQ support for structs
* feat: clean code smell + handle null self.col.table value
* feat: ran python linting
* feat: updated test for profiler handler + disabled flaky test
* Update ingestion/tests/unit/profiler/pandas/test_sample.py
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
---------
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-07-14 09:12:46 +02:00
