Mayur Singal
cd6b28df1a
Fix #3066 : Superset Auth Fixed ( #3156 )
2022-03-04 12:02:51 -08:00
codingwithabhi
ad341e8259
fix ISSUE-3137: updated-redash-library-and-function ( #3157 )
2022-03-04 12:02:08 -08:00
Ayush Shah
0d1fa67116
Added fix for strptime expecting string ( #3154 )
2022-03-04 23:36:52 +05:30
Pere Miquel Brull
4116233697
Fix #3105 - ColumnValuesToMatchRegex & other fixes ( #3149 )
...
Fix #3105 - ColumnValuesToMatchRegex & other fixes (#3149 )
2022-03-04 18:11:49 +01:00
Pere Miquel Brull
bd7b91b448
Fix #3112 - col profile safety & sample data ( #3142 )
...
Fix #3112 - col profile safety & sample data (#3142 )
2022-03-04 13:14:11 +01:00
codingwithabhi
40d3f5e239
column-issue-fixed ( #3138 )
...
* column-issue-fixed
* column-type-lookup-optimized
2022-03-04 17:01:10 +05:30
Snyk bot
834bb8e483
fix: ingestion/tests/integration/source/mlflow/Dockerfile to reduce vulnerabilities ( #3134 )
...
The following vulnerabilities are fixed with an upgrade:
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1290331
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1298721
- https://snyk.io/vuln/SNYK-DEBIAN11-AOM-1300249
- https://snyk.io/vuln/SNYK-DEBIAN11-UNZIP-2396444
- https://snyk.io/vuln/SNYK-DEBIAN11-UNZIP-2396445
2022-03-04 08:34:24 +01:00
Snyk bot
8132b91c30
fix: ingestion/tests/integration/lineage/airflow/requirements.txt to reduce vulnerabilities ( #3130 )
...
The following vulnerabilities are fixed by pinning transitive dependencies:
- https://snyk.io/vuln/SNYK-PYTHON-APACHEAIRFLOW-2413442
- https://snyk.io/vuln/SNYK-PYTHON-APACHEAIRFLOW-2414089
- https://snyk.io/vuln/SNYK-PYTHON-WTFORMS-40581
2022-03-04 07:49:58 +01:00
Pere Miquel Brull
e96ac838ff
Fix #3084 - Implement missing tests ( #3117 )
...
Fix #3084 - Implement missing tests
2022-03-04 06:59:47 +01:00
codingwithabhi
37457dc668
table-name-fail-fix- ( #3114 )
2022-03-03 13:44:34 -08:00
Ayush Shah
84fd717c57
Sql_alchemy_helper Engine fix ( #3116 )
...
* Added connect_args and options for creation of engine
* Added connect_args to profiler engine
* Error fixed on database_common profiler - isinstance error type or tuple of types
2022-03-03 23:39:06 +05:30
Ayush Shah
c3cc685663
Excluded db2 from all plugins as it was creating issues with docker image creation ( #3097 )
2022-03-03 14:55:40 +05:30
Mayur Singal
3f144a7370
fix #3077 : Fixed validation error in ldap ( #3079 )
...
* fix #3077 : fixed validation error
* removed print
* changes returntype to OMetaUserProfile
2022-03-03 11:11:07 +05:30
Pere Miquel Brull
71207de362
Fix #2875 - Profiler API Sink ( #3011 )
...
Fix #2875 - Profiler API Sink
2022-03-02 16:46:28 +01:00
Sriharsha Chintalapani
0b789788da
Fix #3051 : Glossary-term suggest api has fqdn same as name ( #3052 )
2022-03-01 11:19:43 -08:00
Mayur Singal
98ddf5fba3
Fix #3041 : Handled AttributeError ( #3042 )
2022-03-01 08:48:09 -08:00
Mayur Singal
c59a5e882d
fix #3035 : handled none entity ( #3036 )
2022-03-01 08:06:16 -08:00
Alberto Miorin
fe5618c8f1
Fix #3037 : metadata --version doesn't work ( #3038 )
2022-03-01 12:19:36 +01:00
Sriharsha Chintalapani
15d0440599
Fix #1220 : catch and log any errors during the es index ( #1220 )
2022-03-01 12:27:50 +05:30
codingwithabhi
06d9329ae3
Atlas connector ( #2855 )
...
* Fix #1161 : Add Atlas Connector
* Atlast Decimal type handled
* Atlas col_data_type handled
* Atlas columns exception handling implemented
* atlas-services-added-into-single-file
* import-updated
* authentication-fix
* atlas-connector-services-added
* code-smell-removed
* code-smell-removed
* code-smell-removed
* file-exist-check-added
* updated-mapping-json-logic
* pr-comment-changes-completed
* atlas-linegae-added
* atlas-linegae-added
* pr-changes-done
* code-formatted
* bug-resolved
* topic-bug-resolved
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-03-01 11:50:14 +05:30
Ayush Shah
568845b65c
Power BI connector ( #3019 )
...
* Power BI Dashboard and Tiles added
* Added Powerbi dependency
* Modified Powerbi debug logs
* Bump up _version.py
* Modified Power BI - added failure status, resolved comments
2022-03-01 10:09:35 +05:30
Mayur Singal
c49af971a7
Fix #2984 : added azure sso auth ( #3002 )
2022-02-28 11:44:28 -08:00
Pere Miquel Brull
00552f6d36
Fix #3012 - Dependency breaking Airflow Container ( #3015 )
...
Fix #3012 - Dependency breaking Airflow Container
2022-02-28 17:11:18 +01:00
codingwithabhi
83c9b75a5a
Metabase lineage ( #3003 )
...
* metabase-lineage
* metabase-lineage-completed
2022-02-26 14:56:09 -08:00
Ayush Shah
412d61a875
Fix Okta Authentication and Validation - Ingestion ( #2955 )
2022-02-26 08:19:36 -08:00
Mayur Singal
e79be68bea
Fix #2937 : added clickhouse usage connector ( #2987 )
2022-02-26 08:18:49 -08:00
Mayur Singal
b211435bac
Fix #2946 : Presto Ingestion issues fix ( #2986 )
...
* Fix #2946 : Presto Ingestion issues fix
* added col lenght
* removed print
* removed comment
* removed mysql import
2022-02-26 12:12:49 +05:30
Sriharsha Chintalapani
fa62a1e4e9
Fix #2991 : Add ES support for glossary ( #2993 )
2022-02-25 20:53:53 -08:00
Pere Miquel Brull
990608522a
Fix #2981 - Update Profile to match TableProfile ( #2982 )
2022-02-25 09:26:30 -08:00
Pere Miquel Brull
4d928bab80
Fix #2965 - Additional Properties set to False ( #2976 )
2022-02-24 08:38:56 -08:00
Mayur Singal
df98931ed4
fix #2809 : Auto populate View Lineage to Tables ( #2977 )
2022-02-24 08:28:40 -08:00
Mayur Singal
6a2180e975
Fix #2539 : redshift lineage mapping ( #2828 )
...
* py_format
* Fixed code smells
* used util method to ingest lineage
* removed sample sql query
2022-02-24 13:20:09 +05:30
Pere Miquel Brull
a4b383fa83
Fix #2897 - Profiler CLI ( #2967 )
...
Fix #2897 - Profiler CLI
2022-02-24 08:03:50 +01:00
codingwithabhi
2ef2edbf17
Bigquery lineage mapping ( #2849 )
...
* lineage-boilerplate-code-added
* bigquery-lineage-completed
* lineage-code-optimised
* code-cleaned
* code-smell-fixed
* code-refined
* added-database-name-in-fqdn
* code-smell-removed
* exception-handled
* removed-print-statement
* formatted-setup.py
* added-sqllineage-version
* included-valid-type-none
* debug-added-in-logger
* lineage-logic-updated
* updated-lineage-params
* global-config-variables-removed
* return-type-updated-in-entity
* updated-conditionin-from-entity
* imported-sqllineage-inside-method
* code-smell-removed
* code-formatted
2022-02-24 11:59:00 +05:30
Pere Miquel Brull
1fb0e7c489
Fix #2878 & #2877 - Implement Metrics and Validate Composed Metrics ( #2926 )
...
Fix #2878 & #2877 - Implement Metrics and Validate Composed Metrics
2022-02-24 07:08:39 +01:00
Mayur Singal
4739aaa096
Fix #2905 : Added MSSQL Usage Connector ( #2948 )
...
* Fix #2509 : added mssql usage connector
* removed comment
* removed unused variables
* fixed code smell
* renamed sql variable
2022-02-24 01:01:03 +05:30
Ayush Shah
fab36fe1b2
fix 2918: Added Error Handling in policy tags ( #2933 )
2022-02-24 00:56:14 +05:30
Mayur Singal
f9182a6244
Fix #2901 : fixed error message ( #2917 )
...
* Fix #2901 : fixed error message
* moved error message to helper.py
* replaced error to http
2022-02-23 00:20:36 +05:30
Pere Miquel Brull
1224d20a36
Fix #2894 - Profiler Processor & Metrics ( #2900 )
...
Fix #2894 - Profiler Processor & Metrics (#2900 )
2022-02-22 08:09:02 +01:00
Pere Miquel Brull
1656ca460c
Check for empty payload ( #2903 )
2022-02-21 14:19:27 -08:00
Mayur Singal
1e556d2ac1
fix #2869 : snowflake-usage processor fixed ( #2896 )
2022-02-21 09:05:24 -08:00
Pere Miquel Brull
e55579aaa8
Fix #2845 - Init Profiler Workflow ( #2862 )
...
* Fix list typing
* Add sqlite service
* Add sqlite service
* Add sqlite service
* Refactor validation into class
* Refactor validation into class
* Prepare table simple profiler
* Add note
* test ORM conversion
* Prepare workflow config utilities
* Prepare workflow skeleton
* Use new core Validation
* Refactor workflow config parsing
* Add comment
* Simplify workflow validations
* Fix table metric check
* Add init for convenience, otherwise interpreter cries when trying to __call__ the get result
* Fix table metric check
* Format
* Format
* Fix table list and metrics init
* Prepare profiler workflow integration tests
* Bump version
* Fix pycharm imports
* format
2022-02-20 17:55:12 +01:00
Ayush Shah
d2c64007cb
Table Constraints Added - Ingestion ( #2854 )
2022-02-19 09:16:15 -08:00
Ayush Shah
0e34028d05
Tableau Lineage Implementation ( #2850 )
...
* Tableau Lineage Implementation
* Handling Code Smell
2022-02-19 09:15:35 -08:00
Ayush Shah
959d441661
Glossary Entity Added - Ingestion fix ( #2794 )
...
* Added Glossary
* Modified Glossary: Mixin and suffix
* Glossary Mixin Methods
* Sample Data and Mixin for Glossary
* Modified comments
* Glossary Mixin Updated
* Added Glossary import
* Import issues fixed, removed upper limit for jinja2 as it conflicted
* Removed Glossary Import
2022-02-18 12:50:55 +05:30
Pere Miquel Brull
f304d290b4
Fix #2751 - Init ORM Profiler ( #2831 )
...
* ORM Profiler skeleton
* Fix table name within service
* Add license
* Prepare custom types
* Fix converter
* Compute stddev only on numeric
* Prepare smart registries
* Update tests
* Update results retrieval
* Fix composed metrics result
* Format
* Add missing type
* Add _label decorator
* clean readme
* clean readme
* Filter types when profiler runs not allowed metric types
* Fix null ratio
* Add proper type
* RuleMetric skeleton
* Prepare table metrics
* Update simple profiler
* Format
* Define test expression grammar and node visiting
* Unify metric registry
* Prepare validation core
* Add grammar lib
* Add safe get
* Format
* Allow decimals in grammar
* Test validation conversion
* Fix validation conversion and test
* Rename to row_number
* Update READMEs
* Format
* Row number naming
* Fix rename
2022-02-18 07:48:38 +01:00
Sriharsha Chintalapani
891ff465a0
Fix #2838 : Fix airflow example DAG to import airflow libs ( #2839 )
2022-02-18 10:47:07 +05:30
Igor Kramer
316e02cdfd
FIX #2802 : Skip partitions and add datatypes ( #2803 )
...
* ISSUE-2802: Skip partitions and add datatypes
* ISSUE-2802: formatting changes
2022-02-17 10:09:09 -08:00
Ayush Shah
c79f1f286d
Added Users to TableQueries ( #2826 )
...
* Added Users to TableQueries
* User EntityReference
* User EntityReference modification
2022-02-17 20:46:14 +05:30
Sriharsha Chintalapani
165f5bb0e9
Fix #2819 : Kafka connector security settings along with all configs to be retrieved ( #2823 )
...
* Fix #2811 : Log level option for running metadata
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
* Fix #2819 : Kafka connector security settings along with all configs to be retrieved
2022-02-17 15:17:43 +05:30
