2916 Commits

Author SHA1 Message Date
Vj-L
011651f078
"Updated the tags with latest tag" (#5962)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-07-08 16:43:39 +05:30
Mayur Singal
8662333a86
Fix #5877: Renamed Database to DatabaseSchema for Oracle Connection (#5889)
* Fix #5877: Renamed Database to DatabaseSchema for Oracle Connection

* Removed Pass
2022-07-08 09:04:11 +05:30
Pere Miquel Brull
a6dd100be4
Fix metadata es DAG (#5933) 2022-07-07 12:15:09 -07:00
Onkar Ravgan
ba725b81e7
Dbt Fixes and removed urllib from DBT and ometa (#5928)
* Adding default values

* removed urllib and dbt fixes

* removed urllib and dbt fixes

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-07-07 17:02:32 +02:00
Teddy
48f6553fb3
Fixes #5866 -- Implement Support for Median Metric (#5887)
* Added additional table + test coverage

* Added logic for front end input fields

* Added comment for median metric

* skipping `Update owner and check description` cypress test

* Added support to run window metrics for the profiler

* Fix except code smell

* moved median metric to windown folder

* Fix pyformat

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-07-07 06:58:42 +02:00
Abhishek Pandey
f3a6a405b6
issue-5757: s3-prefix-fix-added (#5876)
* issue-5757: s3-prefix-fix-added

* updated-f-string-in-prefix
2022-07-06 16:36:34 +02:00
Pere Miquel Brull
f8e3d634c2
Validate rest and update schema (#5873) 2022-07-06 11:27:20 +02:00
Teddy
3a7c11424b
Fixes #3133 -- Adding Additional Column Tests (#5867)
* Added additional table + test coverage

* Added logic for front end input fields

* Added comment for median metric

* skipping `Update owner and check description` cypress test

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-07-06 10:12:29 +02:00
Mayur Singal
c731fef797
Fix #2895: Added Foreign Key support (#5856) 2022-07-06 08:17:10 +02:00
Rabi Narayan Sahoo
f606d4d636
[Fix] Removed volume instructions from dockerfile. (#5851)
Co-authored-by: Rabi Narayan Sahoo <106670146+Robby30ies@users.noreply.github.com>
2022-07-05 18:12:56 +05:30
Onkar Ravgan
380fdf18cd
usage fixes (#5805)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-30 18:03:01 +02:00
Onkar Ravgan
69bb25e5e5
usage condition fix (#5802)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-30 06:16:53 -07:00
Teddy
861a5ecf59
Fixes #5800 profiler workflow for engine with catalog + modulo for Presto (#5801) 2022-06-30 14:58:30 +02:00
Pere Miquel Brull
9ca7a75e2d
Add col lineage in sample usage (#5790) 2022-06-30 12:16:06 +02:00
Mayur Singal
dc497d298b
Fix #5768: Clickhouse Client Connection Fix (#5771) 2022-06-30 12:14:27 +02:00
Teddy
0cb036de08
Fixes #5787 -- Add new tests to GE integration submodule (#5788)
* Added table tests to great expectations submodule

* Added new tests to GE submodule
2022-06-30 11:59:55 +02:00
Mayur Singal
04c8e49edd
Fix #5777: Added Exception handling for usage source (#5778) 2022-06-30 14:51:25 +05:30
Pere Miquel Brull
f7a10fe5a6
Fix #5754 - Clean pipeline service connection & minor fixes (#5766)
* Update airflow

* Remove prefect

* Remove prefect
2022-06-30 09:33:45 +02:00
Mayur Singal
5066b1e740
Airbyte Minor Fix (#5758) 2022-06-30 08:21:08 +05:30
Pere Miquel Brull
286fe5bdd7
lineage fixes (#5749) 2022-06-29 17:59:50 +02:00
Mayur Singal
d7cf1289d4
Yaml Fixes (#5733) 2022-06-29 15:25:14 +02:00
Mayur Singal
884780a83b
Glue Table & Column Comment Fix (#5740) 2022-06-29 15:24:51 +02:00
Teddy
2f29c5fe93
Fixes #5742 where profiler modulo has unescaped character (#5743)
* Fixed athena modulo function

* fixed modulo function for MySQL and escaped perc char in base modulo function

* Removed compilation logic for MSSQL

* fixed python formating

* Added modulo and random logic for oracle

* Fixed py format
2022-06-29 14:38:44 +02:00
Pere Miquel Brull
e3223f6a20
Simplify bigquery usage (#5728) 2022-06-29 13:58:41 +02:00
Mayur Singal
81047c4d18
Fix #5702: Airbyte Pipeline Status Fix (#5726) 2022-06-29 10:33:25 +02:00
Teddy
11dc2e4918
Fixed typo in clickhouse SQL definition (#5725) 2022-06-29 09:29:10 +02:00
Onkar Ravgan
04a6acc02f
Bigquery pydantic error fix and Mode edge case fixes (#5710)
* bigquery pydantic error fix and mode edge case fixes

* Fix Usage Issues

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-06-29 12:13:28 +05:30
Mayur Singal
dc5dfae3b8
Added Include Tags in Ingestion UI (#5694)
* Added Include Tags in Ingestion UI

* Fix ConfigureIngestionProps

* Test Fix

* Fix Cypress
2022-06-29 11:38:50 +05:30
Teddy
e026d625d6
Fixes #5713 where profileSample default to 100 (#5714)
* Fix random sample modulo and rand for postgres

* Remove sampleProfile default and return declarative meta when no sample profile is passed

* fixed py_format

* isolated random sample partition logic into its own methid
2022-06-28 19:27:55 +02:00
Pere Miquel Brull
aab7544778
Fix MSSQL modulo (#5707) 2022-06-28 15:53:16 +02:00
Pere Miquel Brull
89a026b022
Fix #5688 - MlFlow deployment fails from UI (#5691)
* Fix mlflow from UI

* format
2022-06-28 14:58:38 +02:00
Mayur Singal
4473280e63
Airbyte Status Improvments (#5701) 2022-06-28 14:32:37 +02:00
Mayur Singal
71bf32e438
Fix #5562: Handle Analysis Date for Usage (#5582)
Fix #5562: Handle Analysis Date for Usage (#5582)
2022-06-27 15:16:12 +02:00
Mayur Singal
369f8643d1
Fix #5619: Fix Multiple Source Column Level Lineage (#5620) 2022-06-27 16:38:46 +05:30
Milan Bariya
338d1efe40
FIX 5419: Glue pipeline connector not working (#5467)
FIX 5419: Glue pipeline connector not working (#5467)
2022-06-27 11:38:41 +02:00
Sriharsha Chintalapani
8528c51b9c
Fix #5516: Refactor elasticsearch indexes to be same as entity specifications (#5573)
* Fix #5516: Refactor elasticsearch indexes to be same as entity specifications

Co-authored-by: darth-coder00 <aashit@getcollate.io>
Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-06-27 01:19:27 -07:00
Mayur Singal
e640db3192
Fix #5525: Fixed Bigquery Comment Issue (#5616) 2022-06-26 12:17:33 -07:00
Teddy
9380b93a18
Fixed clickhouse bugs in profiler (#5624) 2022-06-26 12:17:01 -07:00
Pere Miquel Brull
b950f0fd06
Add mappings for table ES index ingestion (#5635) 2022-06-25 11:41:51 +02:00
Onkar Ravgan
932d1adfe5
added custom oidc to airflow provider (#5598)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-24 20:42:19 -07:00
Milan Bariya
95bca61719
FIX Mssql ingestion Fail (#5627) 2022-06-24 20:41:35 -07:00
Sriharsha Chintalapani
710e782f33
Fix #5455: Ingestion from a kafka topic fails when sample data is enabled (#5536)
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-06-24 20:39:41 -07:00
Sriharsha Chintalapani
ad0c6dad88
Fix #5613: Add fernet encryption and remove connection details for non admin users (#5614)
* Fix #5613: Add fernet encryption and remove connection details for non-admin users
2022-06-24 16:44:37 -07:00
Pere Miquel Brull
bb4ac68ee3
Add backend connection for airflow dag extraction 2022-06-24 20:01:50 +02:00
Teddy
7431c1c226
[Issue-5188] Implement User Query for Sampler and Profiler (#5578)
* Added custom query sample for sample data ingestion

* Added logic to run table profiling against user's query

* Added tests for user query logic in profiler and sampler

* Added user profiling to tableProfile + fixed format

* staging commit

* Added logic to add profileQuery to table entity

* Added limit to sample rows
2022-06-24 14:46:34 +02:00
Pere Miquel Brull
0144a1d46a
Fix #5423 & #3412 - Looker Lineage and Usage (#5581)
Fix #5423 & #3412 - Looker Lineage and Usage (#5581)
2022-06-23 13:01:40 +02:00
Pere Miquel Brull
7fa47c31d8
Fix #5565 - Handle missing column in usage fqn match (#5575)
* add try

* Add some exception handling

* fix date and split
2022-06-23 13:01:27 +02:00
Abhishek Pandey
a913cf46db
table-type-fixed-added (#5549)
* table-type-fixed-added

* optimised-column-type
2022-06-23 11:13:22 +05:30
Onkar Ravgan
2b25c299e5
Using context for charts (#5576)
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-06-22 10:45:28 +02:00
Pere Miquel Brull
685b7bede8
Revert "Added pipeline metadata to the edge lines (#5552)" (#5571)
This reverts commit d717f8cc17d949620935a89d5fa94b141502ab07.
2022-06-22 11:42:48 +05:30