Mayur Singal
c64f3fef34
Fix #2678 : Fixed vertica import errors and invalid dataTypeDisplay ( #2709 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-10 07:22:29 -08:00
Mayur Singal
4abede9f9d
Fix #2585 : dataprofile module perform check on first object only ( #2671 )
...
* Fix #2585 : dataprofile module perform checks on first object only
* py format
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-09 11:29:12 +05:30
Ayush Shah
4f5f63b226
Issue-2672: Added support for personal access token name and secret and upgraded tableau version ( #2682 )
2022-02-08 23:02:56 +05:30
codingwithabhi
a4f3999904
Bigquery-Usage-ADC ( #2662 )
...
* creds-code-added
* creds-logic-updated
* implemented-close()-method
* temp-files-error-fix
* removed-ad-hoc-tag-implementations-from-ometa_api
2022-02-08 17:59:56 +05:30
Ayush Shah
18d963c3d8
Issue-969: Superset Lineage Implemented ( #2659 )
2022-02-07 16:16:38 -08:00
codingwithabhi
66c3f43bbb
Fix #2537 : Ingestion Connector - DynamoDB
2022-02-07 10:52:11 -08:00
Mayur Singal
2d25da149d
Fix #2626 : add db2 connector ( #2661 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-07 10:49:59 -08:00
Ayush Shah
0e62db641d
Added check for policy tags ( #2655 )
2022-02-07 10:49:32 -08:00
Mayur Singal
b4ebf5ce87
Fix #2591 : added get_view_definition for vertica ( #2650 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-07 19:19:44 +05:30
Ayush Shah
7013b070d2
Minor Data Type Display modification ( #2654 )
...
Characters modified from unicode for e.g. < to <
2022-02-07 18:07:08 +05:30
codingwithabhi
888e225544
Snowflake ingestion fix ( #2622 )
...
* creds-removed
* fixed-ingestion-fail-and-variant-type-error
2022-02-07 10:17:21 +05:30
Pere Miquel Brull
08a46814e6
Fix #2625 : Use pytest 7.0.0 ( #2640 )
2022-02-06 14:41:56 -08:00
Pere Miquel Brull
7aceab41a2
Fix #2412 - Airflow Lineage Docs ( #2618 )
2022-02-06 12:51:05 -08:00
Sriharsha Chintalapani
ceeefb40be
Fix #2524 : Ingestion: DBT model parsing fails with column ( #2525 ) ( #2639 )
2022-02-06 12:49:57 -08:00
Teddy
b5ddada930
Fix #1526 : Added OMetaTag mixin
2022-02-06 12:42:13 -08:00
Ayush Shah
21491559de
Fix #2587 : Bigquery ADC and Policy Tag implementation
2022-02-06 10:36:10 -08:00
Mayur Singal
e1d7d644b3
Fix #323 : fixes in table_usage.py ( #2576 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-02-06 10:34:56 -08:00
Pere Miquel Brull
c2ad7f6373
Fix #2317 : Override Pipeline tasks from client
2022-02-06 10:17:08 -08:00
Vivek Ratnavel Subramanian
e6343a79d7
Fix #2555 : PUT APIs should only allow admin and owners to update a resource in secure env ( #2608 )
2022-02-04 12:39:08 -08:00
Mayur Singal
6128fa30dc
Fix #2620 : pk_columns & unique_columns fixed ( #2621 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 12:38:12 -08:00
Mayur Singal
5a6e7d743e
ISSUE-545: Added tests for QueryProcessor ( #2510 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 08:20:20 -08:00
Mayur Singal
bc13e343a1
issue-2572: added comments for vertica columns ( #2596 )
...
* issue-2572: added comments for vertica columns
* moved sql queries to sql_queries.py
* fixed sonar bug and sql query
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-02-04 15:43:27 +05:30
SeungwanJo
9a0ffc08e4
add ingestion hive col_comment ( #2594 )
2022-02-04 15:43:14 +05:30
Ayush Shah
513a113187
Sample Teams ingestion fixed ( #2554 )
...
* Sample Teams ingestion fixed
* Error Handling in creating teams and fixed secretstr
* modified sample_data for teams
2022-02-03 13:58:59 +05:30
Pere Miquel Brull
9887e0773e
Fix #2516 - User Profile & Amundsen Source ( #2546 )
2022-02-01 13:55:26 -08:00
Ayush Shah
763f125861
Bigquery Os unlink issue resolved ( #2544 )
...
* Bigquery Os unlink issue resolved
* Bigquery code modified
2022-02-01 23:33:08 +05:30
Robert Pack
67a1c23482
Fix #2348 : Harmonize request titles in json schemas
2022-01-31 16:29:56 -08:00
Ayush Shah
73d848ac3b
Docker Typeerror fixed ( #2504 )
2022-01-31 12:30:12 +05:30
Pere Miquel Brull
6ea6f0c43d
Fix #2383 - Multiple validation workflows ( #2500 )
...
* Clean duplicated validation
* Move black dep to dev
* Fix black version for ingestion core
* Validate core generated in the same workflow
2022-01-30 12:26:41 -08:00
Pere Miquel Brull
d10639958c
Fix black version 21.12b0 ( #2499 )
2022-01-30 06:54:11 -08:00
Sriharsha Chintalapani
f6ac393007
Issue #2492 : Improve messaging on docker command ( #2493 )
...
* Issue #2492 : Improve messaging on docker command
* Issue #2492 : Improve messaging on docker command
2022-01-29 09:47:21 +05:30
Vivek Ratnavel Subramanian
52ec2e3ad1
Fix #2478 : Update the auth header to Authorization Bearer for JWT token ( #2483 )
...
* Fix #2478 : Update the auth header to Authorization Bearer for JWT token
2022-01-27 23:58:54 -08:00
Teddy
4f3e330dd8
Issue 997-01 ( #2476 )
...
* Fix linting
* Fixed pyformat errors
* Address comments from PR review
* Added back phony in makefile
* Added back comment
2022-01-27 18:45:45 -08:00
Ayush Shah
3a6217a7e9
Fixed data profiling and raw data type issue ( #2474 )
...
* Fixed data profiling and raw data type issue
* Update metadata_rest.py
* Update sql_source.py
2022-01-27 18:59:35 +05:30
Mayur Singal
a8bdf844dd
make black ( #2475 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-01-27 18:58:30 +05:30
Sriharsha Chintalapani
c36ae72ccd
Issue #2462 : Fix profiler group_by query ( #2463 )
2022-01-27 14:26:32 +05:30
Sriharsha Chintalapani
4cd5c2bea2
Issue #2457 : remove logging utils ( #2458 )
2022-01-26 10:26:17 -08:00
Ayush Shah
02f3678f2a
Fixed Mysql profiler + removed additional dependency for profiler ( #2447 )
...
* Fixed Mysql profiler + removed additional dependency for profiler
* Update sql_source.py
* Update sql_source.py
* Update setup.py
2022-01-26 16:45:28 +05:30
Akash Jain
20309cde64
fix:cherry pick from 0.8.0 and miscellaneous fixes ( #2445 )
...
* updating ingestion-core version to 0.8.0
* updating ingestion version to 0.8.0
* fixing file copy path
* update docker images to point to 0.8.0
* set up new release version
* reset ingestion version to 0.9.0.dev0
* reset ingestion-core version to 0.9.0
2022-01-26 14:00:27 +05:30
Mayur Singal
cfca795edf
ISSUE-2422: Handled None datatype ( #2423 )
...
Co-authored-by: Mayur SIngal <mayursingal@Mayurs-MacBook-Pro.local>
2022-01-25 08:42:37 -08:00
Sriharsha Chintalapani
0e736012a9
Fix #1843 : Add Delta Lake Connector ( #1844 )
...
* Fix #1843 : Add Delta Lake Connector
* Fix #1843 : Add Delta Lake Connector
2022-01-25 14:35:44 +05:30
Ayush Shah
917ccd7147
Bigquery and Helpers fix - Ingestion ( #2408 )
...
* Bigquery Ingestion fix - error handling and keyerror
* Update helpers.py and column_type_parser
* Update helpers.py
2022-01-25 14:30:09 +05:30
Pere Miquel Brull
ce5df0eb88
Use path str properly ( #2405 )
2022-01-25 08:55:44 +01:00
Ayush Shah
b4d63bd951
Fix: Typo in setting up pyarrow dependency ( #2398 )
2022-01-25 11:58:10 +05:30
Ayush Shah
b689c2d632
Multiple fixes - Looker, Ingestion fix, pyarrow dependency ( #2385 )
...
* Added pyarrow dependency
* Fix #2378
* Fix Looker
* Fix Looker, secretstr to str
2022-01-24 12:29:54 -08:00
Pere Miquel Brull
05c8d1ebb6
Fix #2153 - Lineage date parsing ( #2387 )
...
* Check for start_date
* Fix date keys and remove repr
* Add date management tests
2022-01-24 12:29:16 -08:00
Pere Miquel Brull
6a8fc9e0fb
import on call ( #2382 )
2022-01-24 12:29:03 -08:00
Pere Miquel Brull
b39b698eb7
Fix #2345 - Make bump & unify ( #2359 )
...
* Add installing instructions
* Unify makefile and automate bump version setup
* Update submake call
* Mark targets as phony
* Add help to recipes
* Update core publish
* Do not trigger install from echo
* Run make from root
* Prepare py_format from isort and black
* Run py_format
* Check black and isort formatting
* Update comment msg
2022-01-23 09:47:06 -08:00
Ayush Shah
6f5a4eafe7
Bigquery support for env without passing any config ( #2160 )
...
* Bigquery support for env without passing any config
* Bigquery File formatted
2022-01-22 22:25:48 -08:00
Sriharsha Chintalapani
e5fdf77d8e
Fix #2355 : Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353 : Add API to AirflowPipelines filter based on service ( #2357 )
...
* Fix #2340 : Ingestion pipeline deployment refactor - update ingestion
* Fix #2355 : Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353 : Add API to AirflowPipelines filter based on service
* Fix #2355 : Upgrade scripts, handle entity_extension updatedAt and dbservice jdbc field , Fix #2353 : Add API to AirflowPipelines filter based on service
2022-01-22 21:12:25 -08:00