2916 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
0ccba07059
Minor Fix: elastic search mappings (#2772) 2022-02-16 10:44:11 +05:30
Mayur Singal
78f5b51e63
fix #2663: added table queries put request (#2768) 2022-02-15 21:12:38 -08:00
Mayur Singal
5e4cd516bf
issue #2712: Added SingleStore Connector (#2747) 2022-02-15 21:11:46 -08:00
Suresh Srinivas
28ba1a3c04
Fixes #2760 - Add entities for Glossary and initial API (#2761)
* Fixes #2760 - Add entities for Glossary and initial API

* Fixing merge issues
2022-02-15 20:54:46 -08:00
Mayur Singal
44cca4d020
fix #2663: added table queries in sample data (#2763) 2022-02-15 15:45:58 +05:30
Pere Miquel Brull
76f4ccd590
Fix #2735 - Simplify Airflow properties extraction (#2749)
* Simplify lineage properties extraction

* Add network name

* Format
2022-02-14 16:53:42 +01:00
Sriharsha Chintalapani
562d6b39ef
Fix #2704: Add suggestions API to query users and teams like autocomplete (#2742) 2022-02-14 07:47:07 -08:00
Pere Miquel Brull
1b2ea54d4f
Fix #2316 - Append Tasks & Add Status in Airflow (#2738)
* Add license

* Add date to timestamp helper

* Prepare pipeline status operation

* Update and clean tasks from client

* Update tasks from client

* Check if pipeline is empty

* Keep all current pipeline info

* Append and clean tasks

* format

* Add status information

* Test pipelineStatus update

* Update task on clear

* Log status on callback

* Update lineage and status docs

* Update lineage docs

* Format

* Logic to handle DAG status

* Lint and format

* Update lineage tests
2022-02-13 17:51:25 +01:00
Mayur Singal
06ed718235
Fix #2715: Added clickhouse datatypes (#2732) 2022-02-12 10:03:03 -08:00
Ayush Shah
f189c760bc
Ordinal Position modified (#2733) 2022-02-12 10:02:47 -08:00
codingwithabhi
b51c0d92b1
added-named-parameter (#2680)
* added-named-parameter

* metadata-config-fix-and-connector-tested
2022-02-11 07:53:46 -08:00
Igor Kramer
6891cd1e62
ISSUE-2716 Skip lineage and empty charts (#2717) 2022-02-11 10:06:31 +05:30
Mayur Singal
88afb17ee8
issue #2611: added clickhouse connector (#2679)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-10 08:32:01 -08:00
Igor Kramer
713375175d
ISSUE #2706: Fix tableau ingestion bugs (#2707)
* ISSUE-2706: Fix tableau ingestion bugs
2022-02-10 08:23:53 -08:00
Mayur Singal
c64f3fef34
Fix #2678: Fixed vertica import errors and invalid dataTypeDisplay (#2709)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-10 07:22:29 -08:00
Mayur Singal
4abede9f9d
Fix #2585: dataprofile module perform check on first object only (#2671)
* Fix #2585: dataprofile module perform checks on first object only

* py format

Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-09 11:29:12 +05:30
Ayush Shah
4f5f63b226
Issue-2672: Added support for personal access token name and secret and upgraded tableau version (#2682) 2022-02-08 23:02:56 +05:30
codingwithabhi
a4f3999904
Bigquery-Usage-ADC (#2662)
* creds-code-added

* creds-logic-updated

* implemented-close()-method

* temp-files-error-fix

* removed-ad-hoc-tag-implementations-from-ometa_api
2022-02-08 17:59:56 +05:30
Ayush Shah
18d963c3d8
Issue-969: Superset Lineage Implemented (#2659) 2022-02-07 16:16:38 -08:00
codingwithabhi
66c3f43bbb
Fix #2537: Ingestion Connector - DynamoDB 2022-02-07 10:52:11 -08:00
Mayur Singal
2d25da149d
Fix #2626: add db2 connector (#2661)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-07 10:49:59 -08:00
Ayush Shah
0e62db641d
Added check for policy tags (#2655) 2022-02-07 10:49:32 -08:00
Mayur Singal
b4ebf5ce87
Fix #2591: added get_view_definition for vertica (#2650)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-07 19:19:44 +05:30
Ayush Shah
7013b070d2
Minor Data Type Display modification (#2654)
Characters modified from unicode for e.g. &lt; to <
2022-02-07 18:07:08 +05:30
codingwithabhi
888e225544
Snowflake ingestion fix (#2622)
* creds-removed

* fixed-ingestion-fail-and-variant-type-error
2022-02-07 10:17:21 +05:30
Pere Miquel Brull
08a46814e6
Fix #2625: Use pytest 7.0.0 (#2640) 2022-02-06 14:41:56 -08:00
Pere Miquel Brull
7aceab41a2
Fix #2412 - Airflow Lineage Docs (#2618) 2022-02-06 12:51:05 -08:00
Sriharsha Chintalapani
ceeefb40be
Fix #2524: Ingestion: DBT model parsing fails with column (#2525) (#2639) 2022-02-06 12:49:57 -08:00
Teddy
b5ddada930
Fix #1526: Added OMetaTag mixin 2022-02-06 12:42:13 -08:00
Ayush Shah
21491559de
Fix #2587: Bigquery ADC and Policy Tag implementation 2022-02-06 10:36:10 -08:00
Mayur Singal
e1d7d644b3
Fix #323: fixes in table_usage.py (#2576)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-06 10:34:56 -08:00
Pere Miquel Brull
c2ad7f6373
Fix #2317: Override Pipeline tasks from client 2022-02-06 10:17:08 -08:00
Vivek Ratnavel Subramanian
e6343a79d7
Fix #2555: PUT APIs should only allow admin and owners to update a resource in secure env (#2608) 2022-02-04 12:39:08 -08:00
Mayur Singal
6128fa30dc
Fix #2620: pk_columns & unique_columns fixed (#2621)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 12:38:12 -08:00
Mayur Singal
5a6e7d743e
ISSUE-545: Added tests for QueryProcessor (#2510)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 08:20:20 -08:00
Mayur Singal
bc13e343a1
issue-2572: added comments for vertica columns (#2596)
* issue-2572: added comments for vertica columns

* moved sql queries to sql_queries.py

* fixed sonar bug and sql query

Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 15:43:27 +05:30
SeungwanJo
9a0ffc08e4
add ingestion hive col_comment (#2594) 2022-02-04 15:43:14 +05:30
Ayush Shah
513a113187
Sample Teams ingestion fixed (#2554)
* Sample Teams ingestion fixed

* Error Handling in creating teams and fixed secretstr

* modified sample_data for teams
2022-02-03 13:58:59 +05:30
Pere Miquel Brull
9887e0773e
Fix #2516 - User Profile & Amundsen Source (#2546) 2022-02-01 13:55:26 -08:00
Ayush Shah
763f125861
Bigquery Os unlink issue resolved (#2544)
* Bigquery Os unlink issue resolved

* Bigquery code modified
2022-02-01 23:33:08 +05:30
Robert Pack
67a1c23482
Fix #2348: Harmonize request titles in json schemas 2022-01-31 16:29:56 -08:00
Ayush Shah
73d848ac3b
Docker Typeerror fixed (#2504) 2022-01-31 12:30:12 +05:30
Pere Miquel Brull
6ea6f0c43d
Fix #2383 - Multiple validation workflows (#2500)
* Clean duplicated validation

* Move black dep to dev

* Fix black version for ingestion core

* Validate core generated in the same workflow
2022-01-30 12:26:41 -08:00
Pere Miquel Brull
d10639958c
Fix black version 21.12b0 (#2499) 2022-01-30 06:54:11 -08:00
Sriharsha Chintalapani
f6ac393007
Issue #2492: Improve messaging on docker command (#2493)
* Issue #2492: Improve messaging on docker command

* Issue #2492: Improve messaging on docker command
2022-01-29 09:47:21 +05:30
Vivek Ratnavel Subramanian
52ec2e3ad1
Fix #2478: Update the auth header to Authorization Bearer for JWT token (#2483)
* Fix #2478: Update the auth header to Authorization Bearer for JWT token
2022-01-27 23:58:54 -08:00
Teddy
4f3e330dd8
Issue 997-01 (#2476)
* Fix linting

* Fixed pyformat errors

* Address comments from PR review

* Added back phony in makefile

* Added back comment
2022-01-27 18:45:45 -08:00
Ayush Shah
3a6217a7e9
Fixed data profiling and raw data type issue (#2474)
* Fixed data profiling and raw data type issue

* Update metadata_rest.py

* Update sql_source.py
2022-01-27 18:59:35 +05:30
Mayur Singal
a8bdf844dd
make black (#2475)
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-01-27 18:58:30 +05:30
Sriharsha Chintalapani
c36ae72ccd
Issue #2462: Fix profiler group_by query (#2463) 2022-01-27 14:26:32 +05:30