Pere Miquel Brull
0963eac48e
Fix #9182 - Airflow Lineage Operator & Airflow lineage state ( #9206 )
2022-12-10 19:54:41 +01:00
Ayush Shah
231b28fc87
Fix 7278: add test connection ( #9196 )
...
* Add Test Connection to Profiler
* remove Code Lint
* Fix AttributeError
* Fix Pytest
* Fix Bigquery Partition tests
* Fix Lint
2022-12-10 17:16:28 +01:00
Teddy
4a5cb870ec
Fixes #9192 - Update ES response for DI ( #9221 )
...
* staging commit
* updated terms to french
* fix(dataInsight): updated ES response to get entityType and total non tiered entities
* fix(dataInsight): removed fields=*
* fix(dataInsight): Added entity migration
* cleaned up branch
2022-12-09 18:53:17 -08:00
Pere Miquel Brull
b1565b8337
Fix #9181 - Handle failed callback status without workflow ( #9193 )
...
* Handle failed status without workflow
* Add log
2022-12-09 10:42:24 +01:00
Milan Bariya
6f12c971e1
Add: function to get different catalogs ( #9179 )
...
* Add: function to get different catalogs
* Change Based on comments
* Change Based on comments
* Change Based on comments
2022-12-08 15:42:58 +05:30
NiharDoshi99
96e77af8a4
Fix : #1308 Docs and Atlas Connector Improvement ( #9072 )
...
* Fix: docs changes
* Fix: changes as per comment
* Fix: atlas connector
* Fix: as per comments
* Fix: as per comments
2022-12-08 12:14:15 +05:30
Teddy
ac77f33b08
Fixes #7447 -- Add freshness metrics to profiler ( #9159 )
...
* refactor(profiler): integrated getter func.
Removed metric getter function from their own file.
Added metric getter to their own interface classs.
created dispatch by value methdo to dispatch metric getter func.
* feature(profiler): added systemProfiler schema
* feat(profiler): workflow fresh. & snflk impl.
* feat(profiler): freshness endpoint for put and get
* feat(profiler): added system met. for redshift
* feat(profiler): freshness met. for bigquery
* fix(profiler): keyword not found in func
* feat(profiler): Added sample data for freshness
* fix(profiler): fetch previous day for BQ
* fix(profiler): sonar + data fetching logic
* fix: typo in SystemMetric Class
* fix: linting
* fix: extracted out EntityList class into models.py
2022-12-07 14:33:30 +01:00
Sriharsha Chintalapani
25449001ca
Fix #9040 : Remove fields such as tableQueries, tableProfile, tests, sample data as part of table fields ( #9041 )
2022-12-06 21:07:04 -08:00
Suresh Srinivas
16d97d6f96
Fix typos in JSON schemas and follow standard naming conventions ( #9183 )
2022-12-06 20:50:34 -08:00
Teddy
f86186d5b0
Fixed time field type for profiler ( #9177 )
2022-12-06 18:30:48 +01:00
07Himank
b5b29c93f5
Track new primary key ( #9145 )
2022-12-06 09:13:07 +05:30
Mayur Singal
81cbf93df5
Fix #9139 : Fix shcema filter being added twice to status ( #9148 )
2022-12-05 15:05:55 +00:00
Ayush Shah
2efa720f59
Fix E2E: new envs ( #9143 )
2022-12-05 19:15:12 +05:30
Pere Miquel Brull
58f3c01470
Fix #7056 - Automatic lineage from ML Model to ML Feature Data Source ( #9113 )
2022-12-05 16:43:03 +05:30
NiharDoshi99
e0a3f3481b
Fix: aggregate type ( #9138 )
2022-12-05 14:50:37 +05:30
Sriharsha Chintalapani
14d82ee7b2
Fix #6463 : Add support for default suggestions for suggestion API ( #9090 )
2022-12-02 10:31:37 -08:00
Pere Miquel Brull
1b3ff505c2
Fix #8858 - Add chart description and add lineage flexibility ( #9124 )
...
Fix #8858 - Add chart description and add lineage flexibility (#9124 )
2022-12-02 16:22:09 +01:00
Onkar Ravgan
23468fb868
Fixed Broken docs links ( #9125 )
2022-12-02 15:42:06 +01:00
NiharDoshi99
ead5ce7227
Fix: dagster keyerror solved ( #9099 )
2022-12-01 18:43:11 +05:30
Pere Miquel Brull
7d2eab332d
Lineage Backend example and fix ( #9095 )
2022-12-01 13:09:36 +01:00
Milan Bariya
2f9f169de9
Fix: Safer default Mark Deleted Tables ( #9065 )
...
* Fix: Safer default Mark Deleted Tables
* Fix: Change Based On Comments
* Fix: Change Based On Comments
* Add: Migration Files
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-12-01 16:26:43 +05:30
Nahuel
00375341f7
Fix#7690: Use ES to build Tables FQN when processing Lineage ( #9079 )
...
* Use ES to build Tables FQN when processing Lineage
* Fix pylent check
* Fix test failing
* Remove warning when calling ES with empty query
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-12-01 09:56:42 +01:00
Nahuel
76773e69de
Fix#6203: Refactor LineageRunner use ( #9073 )
...
* Refactor LineageRunner use
* Address PR comments
* Address pylint errors
* Fix failing test
2022-11-30 16:02:21 +01:00
Ayush Shah
2b2eadf611
Fix Credentials sent via env ( #9071 )
...
* Fix Credentials sent via env
* add new env var
* fix lint
* Add Comment
2022-11-30 15:37:24 +01:00
Abhishek Pandey
e8edf70374
removed-whitespace-from-postgres-and-redshift ( #8927 )
2022-11-30 13:16:24 +05:30
Pere Miquel Brull
6a3ce624b7
Fix #9008 - Add Airflow callback, introduce Workflow Status Mixin and remove retries ( #9049 )
...
Fix #9008 - Add Airflow callback, introduce Workflow Status Mixin and remove retries (#9049 )
2022-11-30 08:30:45 +01:00
Sriharsha Chintalapani
125fefcf6d
Fix logging metadata webhook event ( #9067 )
2022-11-29 20:57:43 -08:00
NiharDoshi99
34aacb20d6
Fix: atlas connector ( #9034 )
2022-11-29 23:55:05 +05:30
Teddy
3cad959e44
Fixes #6760 -- Implements REGEX for regex test ( #9033 )
...
feat(testCase): impelemented regex logic for test suite
2022-11-29 13:00:28 +01:00
Ayush Shah
293de4a894
E2E for Bigquery ( #9007 )
2022-11-29 16:22:08 +05:30
Ayush Shah
87b478dcf3
Fix 9026 - Remove Click Dependency ( #9030 )
2022-11-29 11:02:46 +01:00
Ayush Shah
89d89b13cb
Fix BQ ingestion ( #9015 )
2022-11-25 12:51:24 +00:00
Pere Miquel Brull
eccbb087d3
Add table query test ( #9000 )
...
* Add table query test
* Add table query test
2022-11-25 06:56:12 +01:00
Teddy
afca46d45b
Added limit for number of entities fetch because of gateway time out + handled exception when fetching user details ( #8999 )
2022-11-24 16:10:14 +01:00
Sriharsha Chintalapani
95f0f4d9e1
Fix column name indexes ( #8990 )
2022-11-23 19:08:44 -08:00
Sriharsha Chintalapani
285e7dc1e7
Fix arg parsing ( #8989 )
...
* Fix arg parsing
* fixed checkstyle python
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2022-11-23 14:50:44 -08:00
Teddy
8789bdb847
Ometa mixin for ingestion pipeline ( #8931 )
...
* Added sleep between data processing ingestion and KPI processing
* Added ometa mixin for ingestion pipeline and test suite
2022-11-23 09:46:56 +00:00
Teddy
b8d99fc275
increase size of es results when checking for existing data ( #8966 )
2022-11-23 09:44:24 +00:00
Ayush Shah
9d25781481
Add DL profiler fix ( #8957 )
2022-11-22 18:15:06 +00:00
Ashish Gupta
36f27e947d
UI : Mask the JWT token in Metadata service ( #8842 )
...
* Mask the Jwt token in Metadata service
* minor fix
* fix the icon alignment in Add Ingestion button
* disable the test connection for metadata service OpenMetadata type
* change the css name
* fix unit test issue
* Fix Auth Provider
* Fix add ingestion dropdown icon alignment
* Fix formatting
* Do not encryt JWT auth mechanism with secrets manager
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2022-11-22 14:17:40 +00:00
Ayush Shah
91536044e7
Fix Grpcio failure ( #8938 )
2022-11-22 13:54:53 +00:00
Pere Miquel Brull
d6f255b61c
Add ingestion workflow reporter ( #8943 )
...
* Add ingestion workflow reporter
2022-11-22 12:11:32 +00:00
Nahuel
5151db4ae0
Fix bug in secrets manager with SSO configuration ( #8932 )
...
* Fix bug in secrets manager with SSO configuration
* Remove comment from imports
* Sort imports
* Add missing decrypt when updating
* Add minor change
2022-11-21 22:37:20 +01:00
Pere Miquel Brull
83ef3315c3
Fix query log parser ( #8920 )
2022-11-21 12:55:55 +00:00
Milan Bariya
27997b2f77
Fix: Revert Athena tests and types change ( #8909 )
2022-11-21 12:35:23 +01:00
Abhishek Pandey
4427fe487f
added-exception-handling-in-redash-dashboard-url-creation ( #8763 )
...
* added-exception-handling-in-redash-dashboard-url-creation
* code-reformatted
* exception-error-msg-updated
* error-msg-updated-in-redash
* error-msg-updated-in-redash
* error-msg-length-reduced
* code-formatted
* main-rebases
2022-11-21 16:53:55 +05:30
Onkar Ravgan
5aa44e1cf0
Fix #8778 and #8494 : Tableau Parser issue and API docs ( #8875 )
...
* Tmp fixed parser and added doc for API
* fixed pycheckstyle
* Addressed review comments
2022-11-21 12:50:25 +05:30
Teddy
89348b8622
Added sleep between data processing ingestion and KPI processing ( #8876 )
2022-11-21 07:28:15 +01:00
Milan Bariya
bc215515d8
Fix: ignored query with om-version and dbt ( #8851 )
...
* Fix: ignored query with om-version and dbt
* Change based on comments
2022-11-18 14:22:11 +01:00
Vj-L
2c055641be
Added host volumes for Database service ( #8722 )
...
* Added host volumes for Database service
* Formated the python file
* Done changes according to the comments on PR
* Changes done as per the comments on Draft PR
* Fix PyLint
* Changes done as per the comments on Draft PR
* Updated the path of volume for Database
* Added cleanup state in workflows
* Added cleanup state in workflows
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-18 14:05:33 +01:00
