Igor Kramer
316e02cdfd
FIX #2802 : Skip partitions and add datatypes ( #2803 )
...
* ISSUE-2802: Skip partitions and add datatypes
* ISSUE-2802: formatting changes
2022-02-17 10:09:09 -08:00
Ayush Shah
c79f1f286d
Added Users to TableQueries ( #2826 )
...
* Added Users to TableQueries
* User EntityReference
* User EntityReference modification
2022-02-17 20:46:14 +05:30
Sriharsha Chintalapani
165f5bb0e9
Fix #2819 : Kafka connector security settings along with all configs to be retrieved ( #2823 )
...
* Fix #2811 : Log level option for running metadata
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
2022-02-17 15:17:43 +05:30
Mayur Singal
419448a28f
Issue 2727: Added Databricks Connector ( #2745 )
...
* Issue #2727 : Added Databricks Connector
* optional db and licence info
* make core_bump_version_dev
* host_port fix
* fixed service_type
* change package to sqlalchemy-databricks
* Update databaseService.json
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 11:22:13 +05:30
Mayur Singal
dfebc85c4e
fix #2790 : fixed usage ingestion issue ( #2805 )
2022-02-17 10:46:23 +05:30
Sriharsha Chintalapani
50799227e4
Fix #2817 : Remove indexing of Glossary as another Elasticsearch index ( #2818 )
2022-02-16 20:10:26 -08:00
codingwithabhi
088dba3a1f
azuresql-config-added ( #2711 )
...
* azuresql-config-added
* rebased-with-main
* tables-ingestion-added
* duplicate-files-removed
* Update azuresql.py
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-17 09:23:07 +05:30
codingwithabhi
9011b27bf6
table-filter-added ( #2770 )
...
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-16 19:26:40 +05:30
Ayush Shah
4aee82bfd8
Fix for #2597 - added check with column type mapping ( #2598 )
...
* Fix for #2597 - added check with column type mapping
* Optimized Column Type Parsing
* Optimized Column Type Parsing
* SQL Source Bigquery Policy Tags check added
2022-02-16 11:05:12 +05:30
codingwithabhi
f1c62a70b7
service-type-added ( #2769 )
2022-02-16 10:56:40 +05:30
Sriharsha Chintalapani
0ccba07059
Minor Fix: elastic search mappings ( #2772 )
2022-02-16 10:44:11 +05:30
Mayur Singal
78f5b51e63
fix #2663 : added table queries put request ( #2768 )
2022-02-15 21:12:38 -08:00
Mayur Singal
5e4cd516bf
issue #2712 : Added SingleStore Connector ( #2747 )
2022-02-15 21:11:46 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API ( #2761 )
...
* Fixes #2760 - Add entities for Glossary and initial API
* Fixing merge issues
2022-02-15 20:54:46 -08:00
Mayur Singal
44cca4d020
fix #2663 : added table queries in sample data ( #2763 )
2022-02-15 15:45:58 +05:30
Pere Miquel Brull
76f4ccd590
Fix #2735 - Simplify Airflow properties extraction ( #2749 )
...
* Simplify lineage properties extraction
* Add network name
* Format
2022-02-14 16:53:42 +01:00
Sriharsha Chintalapani
562d6b39ef
Fix #2704 : Add suggestions API to query users and teams like autocomplete ( #2742 )
2022-02-14 07:47:07 -08:00
Pere Miquel Brull
1b2ea54d4f
Fix #2316 - Append Tasks & Add Status in Airflow ( #2738 )
...
* Add license
* Add date to timestamp helper
* Prepare pipeline status operation
* Update and clean tasks from client
* Update tasks from client
* Check if pipeline is empty
* Keep all current pipeline info
* Append and clean tasks
* format
* Add status information
* Test pipelineStatus update
* Update task on clear
* Log status on callback
* Update lineage and status docs
* Update lineage docs
* Format
* Logic to handle DAG status
* Lint and format
* Update lineage tests
2022-02-13 17:51:25 +01:00
Mayur Singal
06ed718235
Fix #2715 : Added clickhouse datatypes ( #2732 )
2022-02-12 10:03:03 -08:00
Ayush Shah
f189c760bc
Ordinal Position modified ( #2733 )
2022-02-12 10:02:47 -08:00
codingwithabhi
b51c0d92b1
added-named-parameter ( #2680 )
...
* added-named-parameter
* metadata-config-fix-and-connector-tested
2022-02-11 07:53:46 -08:00
Igor Kramer
6891cd1e62
ISSUE-2716 Skip lineage and empty charts ( #2717 )
2022-02-11 10:06:31 +05:30
Mayur Singal
88afb17ee8
issue #2611 : added clickhouse connector ( #2679 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-10 08:32:01 -08:00
Igor Kramer
713375175d
ISSUE #2706 : Fix tableau ingestion bugs ( #2707 )
...
* ISSUE-2706: Fix tableau ingestion bugs
2022-02-10 08:23:53 -08:00
Mayur Singal
c64f3fef34
Fix #2678 : Fixed vertica import errors and invalid dataTypeDisplay ( #2709 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-10 07:22:29 -08:00
Mayur Singal
4abede9f9d
Fix #2585 : dataprofile module perform check on first object only ( #2671 )
...
* Fix #2585 : dataprofile module perform checks on first object only
* py format
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-09 11:29:12 +05:30
Ayush Shah
4f5f63b226
Issue-2672: Added support for personal access token name and secret and upgraded tableau version ( #2682 )
2022-02-08 23:02:56 +05:30
codingwithabhi
a4f3999904
Bigquery-Usage-ADC ( #2662 )
...
* creds-code-added
* creds-logic-updated
* implemented-close()-method
* temp-files-error-fix
* removed-ad-hoc-tag-implementations-from-ometa_api
2022-02-08 17:59:56 +05:30
Ayush Shah
18d963c3d8
Issue-969: Superset Lineage Implemented ( #2659 )
2022-02-07 16:16:38 -08:00
codingwithabhi
66c3f43bbb
Fix #2537 : Ingestion Connector - DynamoDB
2022-02-07 10:52:11 -08:00
Mayur Singal
2d25da149d
Fix #2626 : add db2 connector ( #2661 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-07 10:49:59 -08:00
Ayush Shah
0e62db641d
Added check for policy tags ( #2655 )
2022-02-07 10:49:32 -08:00
Mayur Singal
b4ebf5ce87
Fix #2591 : added get_view_definition for vertica ( #2650 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-07 19:19:44 +05:30
Ayush Shah
7013b070d2
Minor Data Type Display modification ( #2654 )
...
Characters modified from unicode for e.g. < to <
2022-02-07 18:07:08 +05:30
codingwithabhi
888e225544
Snowflake ingestion fix ( #2622 )
...
* creds-removed
* fixed-ingestion-fail-and-variant-type-error
2022-02-07 10:17:21 +05:30
Pere Miquel Brull
08a46814e6
Fix #2625 : Use pytest 7.0.0 ( #2640 )
2022-02-06 14:41:56 -08:00
Pere Miquel Brull
7aceab41a2
Fix #2412 - Airflow Lineage Docs ( #2618 )
2022-02-06 12:51:05 -08:00
Sriharsha Chintalapani
ceeefb40be
Fix #2524 : Ingestion: DBT model parsing fails with column ( #2525 ) ( #2639 )
2022-02-06 12:49:57 -08:00
Teddy
b5ddada930
Fix #1526 : Added OMetaTag mixin
2022-02-06 12:42:13 -08:00
Ayush Shah
21491559de
Fix #2587 : Bigquery ADC and Policy Tag implementation
2022-02-06 10:36:10 -08:00
Mayur Singal
e1d7d644b3
Fix #323 : fixes in table_usage.py ( #2576 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-06 10:34:56 -08:00
Pere Miquel Brull
c2ad7f6373
Fix #2317 : Override Pipeline tasks from client
2022-02-06 10:17:08 -08:00
Vivek Ratnavel Subramanian
e6343a79d7
Fix #2555 : PUT APIs should only allow admin and owners to update a resource in secure env ( #2608 )
2022-02-04 12:39:08 -08:00
Mayur Singal
6128fa30dc
Fix #2620 : pk_columns & unique_columns fixed ( #2621 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 12:38:12 -08:00
Mayur Singal
5a6e7d743e
ISSUE-545: Added tests for QueryProcessor ( #2510 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 08:20:20 -08:00
Mayur Singal
bc13e343a1
issue-2572: added comments for vertica columns ( #2596 )
...
* issue-2572: added comments for vertica columns
* moved sql queries to sql_queries.py
* fixed sonar bug and sql query
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 15:43:27 +05:30
SeungwanJo
9a0ffc08e4
add ingestion hive col_comment ( #2594 )
2022-02-04 15:43:14 +05:30
Ayush Shah
513a113187
Sample Teams ingestion fixed ( #2554 )
...
* Sample Teams ingestion fixed
* Error Handling in creating teams and fixed secretstr
* modified sample_data for teams
2022-02-03 13:58:59 +05:30
Pere Miquel Brull
9887e0773e
Fix #2516 - User Profile & Amundsen Source ( #2546 )
2022-02-01 13:55:26 -08:00
Ayush Shah
763f125861
Bigquery Os unlink issue resolved ( #2544 )
...
* Bigquery Os unlink issue resolved
* Bigquery code modified
2022-02-01 23:33:08 +05:30