Onkar Ravgan
b56b67bf67
Fixed overwriting data for service entites ( #14135 )
2023-11-28 08:49:29 +01:00
karanh37
853a83f8b9
fix: allow config update for external app ( #14034 )
...
* fix: allow config update for external app
* Prep config
* Add configs
* fix: call configure app on saving of configurations
* fix: add autocomplete widget for json schema forms
* ORganize configuration handling
* Allow config
* Format
* Fix test
* Prep migrations for allowConfiguration
* TODO
* Add pg migrations
* fix: add allowConfiguration support
* Autotagger
* Update install flow
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-11-27 16:55:33 -08:00
Onkar Ravgan
ebb2317cf0
Fix 14040: Part 1 Remove get_by_name calls from topology ( #14098 )
...
* Changed for database
* Added changes for dashboard_service
* Changed for messaging service
* Changed for mlmodel service
* Changed for pipeline service
* Changed for search service
* Changed for objectstore service
* fixed wrong import
* fixed lint
* fixes
* fixed pytests
* fixed domo db pytest
* Fixed review comments
2023-11-27 16:15:47 +05:30
Mayur Singal
aa00802f6d
Fix #14100 : mssql fix usage query, make table name lowercase ( #14101 )
2023-11-27 09:37:37 +01:00
VolkovGeoPhy
c95de19a09
great-expectations~=0.18.0 ( #14056 )
2023-11-23 12:33:07 +01:00
Mayur Singal
4bce6a9aaf
Athena: Add support for work groups in usage & lineage ( #14072 )
2023-11-23 11:13:35 +05:30
Teddy
131eea32f8
Add Custom metrics sample data ( #14069 )
...
* feat: add sample data for custom metrics
* feat: update project.scripts to `metadata`
2023-11-22 11:57:19 +01:00
Pere Miquel Brull
c7e758eccc
Fix pyproject - TypeError: 'list' object is not a mapping ( #14064 )
...
* Fix pyproject - TypeError: 'list' object is not a mapping
* Add dynamic optional-dependencies
* Add dynamic optional-dependencies
* Bump datamodel
* Bump datamodel
2023-11-22 08:38:47 +01:00
Pere Miquel Brull
caaf0e7a1d
Fix #12436 - Migrate to pyproject.toml ( #14025 )
...
* test
* Use pyproject.toml
* Fix pylint
* makefile
* makefile
* Fix pylint
* isort
* pyproject
* Airflow apis pyproject
* Remove ingestion core
* isort
* Fix makefile help
2023-11-22 07:10:37 +01:00
Onkar Ravgan
335aa86fcc
fixed athena e2e ( #14041 )
2023-11-20 21:20:32 +05:30
Onkar Ravgan
b781c66206
Fixed tableau e2e counts due to new sample data in the instance ( #14039 )
...
* fixed tableau e2e new
* rmv hive test
2023-11-20 19:54:06 +05:30
Mayur Singal
9f14ef7fab
Fix #13954 : Fix ParseException for older version of databricks ( #14015 )
2023-11-20 13:14:40 +05:30
Teddy
c7ac28f2c2
Fixes #11357 - Implement profiler custom metric processing ( #14021 )
...
* feat: add backend support for custom metrics
* feat: fix python test
* feat: support custom metrics computation
* feat: updated tests for custom metrics
* feat: added dl support for min max of datetime
* feat: added is safe query check for query sampler
* feat: added support for custom metric computation in dl
* feat: added explicit addProper for pydantic model import fo Extra
* feat: added custom metric to returned obj
* feat: wrapped trino import in __init__
* feat: fix python linting
* feat: fix typing in 3.8
2023-11-17 17:51:39 +01:00
Onkar Ravgan
9f1f830775
Convert query duration to milliseconds for usage ( #14011 )
...
* fixed athena query duration
* change second to millisecond from ui side
* added cypress support
* converted duration to millis
* supported milli second duration and change cypress
* minor change
---------
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2023-11-17 19:59:47 +05:30
Teddy
f3da919329
Feat: Backend Support for Custom Metrics ( #13965 )
...
* feat: add backend support for custom metrics
* feat: fix python test
2023-11-17 19:16:35 +05:30
Pere Miquel Brull
a8a1fd26b1
Snowflake SP don't filter by warehouse ( #14018 )
2023-11-17 14:18:15 +01:00
Pere Miquel Brull
f847c1cf10
Fix #14012 - Snowflake procedure with empty definition ( #14014 )
...
* Fix #14012 - Snowflake procedure with empty definition
* Add debugs
2023-11-17 11:29:27 +01:00
Pere Miquel Brull
6fb3f12675
App Resource - Add /configure endpoint & WAII app definition ( #13983 )
...
* App Configuration
* TODO
* Configure App with OM server info
* Remove init
* Rename configs
* Remove extra source
2023-11-17 09:28:11 +01:00
Mohit Yadav
3f8a931e39
Bump Pom Version to 1.3.0-SNAPSHOT ( #14008 )
...
* Bump Pom Version to 1.3.0-SNAPSHOT
* chore: Fix Makefile recipe
* fix: Prepare Main Branch for Next Feature Release
* fix: Syntax issue
---------
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-11-17 11:33:47 +05:30
Suresh Srinivas
5f34bd02d3
Fixes #13595 Consolidate changes by a user in a single session to a single change ( #13617 )
...
* getChangeDescription to use entity and update type to decide previous version
* Fixes #13595 - Consolidate changes by a user in a single session to a single change
2023-11-16 18:14:27 -08:00
Teddy
a1a1d9f4d1
fix: GX integration ts ms ( #13984 )
2023-11-15 16:11:52 +01:00
Mohit Yadav
10d8ec84fe
Logs added for Search Indexing and Stats issue fixed ( #13956 )
...
* Logs added for Search Indexing and Stats issue fixed
* Fix uninstall error
* Add error handling
* fix lint
* Push Job Level Exception on top
* disable flaky tests
* Fix Logs not visible in Search
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-11-13 23:39:56 +05:30
Pere Miquel Brull
8c6777f820
Fix #12406 - Ingestion image with python 3.10 ( #13949 )
2023-11-13 15:08:06 +05:30
Onkar Ravgan
a1b967b857
Nifi wrong password fix ( #13950 )
2023-11-13 14:48:07 +05:30
Mayur Singal
b34111ea00
ElasticSearch: Fix ES connection ( #13919 )
2023-11-13 14:10:11 +05:30
Pere Miquel Brull
c742835766
Auto Tagger Application - Preparing the Ingestion Framework ( #13862 )
...
* Prepare the skeleton for generic app registration
* Prepare the skeleton for generic app registration
* Handle app runner
* Prepare the skeleton for generic app registration
* Prepare the skeleton for generic app registration
* Allow deployment
* Fix PII APP
* Fix lint
* Fix PII APP
* Fix PII APP
* Prepare config-based external apps
* Prepare config-based external apps
* Fix lint
* Prepare config-based external apps
* Fix DI errors
* Amend comments
2023-11-13 08:58:38 +01:00
Mayur Singal
367bac9064
Fix #13787 : Add support for ES data types ( #13916 )
...
* Fix #13787 : Add support for ES data types
* fixed tests
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2023-11-10 20:14:42 +05:30
Pere Miquel Brull
ae969aa4f3
Fix #13660 - Metadata Backup Memory Exhaustion ( #13935 )
2023-11-10 12:21:48 +01:00
Onkar Ravgan
b7e7625071
Convert dbt test result timestamps to millis ( #13903 )
...
* Fixed dbt test res time to millis
* added postgres migration
2023-11-10 16:15:16 +05:30
Mayur Singal
71a67d6bbe
Fix ES search during lineage ingestion ( #13932 )
2023-11-10 15:50:37 +05:30
Pere Miquel Brull
0eacc829a4
Fix #13794 - Add domain support to the Python SDK ( #13931 )
2023-11-10 11:00:06 +01:00
Pere Miquel Brull
7c06116b53
Add deprecation warnings ( #13927 )
2023-11-10 15:17:07 +05:30
Pere Miquel Brull
8891a9a410
Fix #13906 - Fix add_mlmodel_lineage description field ( #13920 )
2023-11-10 15:16:09 +05:30
Pere Miquel Brull
b250cd8808
Fix #13699 - Add separator for Storage Container manifest ( #13924 )
...
* Fix #13699 - Add separator for Storage Container manifest
* Fix #13906 - Fix add_mlmodel_lineage description field
* Add separator
* Add separator
2023-11-10 10:44:47 +01:00
Mayur Singal
4b625f7ba5
Move pandas top level import ( #13926 )
2023-11-10 14:15:14 +05:30
Hung Duong
575a4a0ebc
put correct dataset only ( #13369 )
...
* put correct dataset only
* update code
---------
Co-authored-by: hung.duong <hung.duong@be.com.vn>
Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2023-11-09 10:30:43 -08:00
Mayur Singal
4c19bb5a1d
Add support for external profiler workflow ( #13887 )
...
* Add support for external profiler workflow
* pylint
* resolve comments
* resolve comments
* pyformat
* fix code smell
2023-11-09 18:50:47 +05:30
Mayur Singal
a8145a82fa
Fix #13603 : Configurable Sample Data Rows for Profiler ( #13807 )
...
* Fix #13603 : Configurable Sample Data Rows
* Fix #13603 : Configurable Sample Data Rows for Profiler
* fix table config
* support configurable overwriting of sample data
* add support for schema and database profiler configuration
* chore(ui): put sampleDataStorageConfig under advanced config
* fix tests
* py format
* chore(ui): add sampleDataCount in table profiler config
* fix tests
* pylint & tests
* feat(ui): add profiler settings tab in database and database schema page
* chore(ui): show different inputs for profile sample type
* schema changes to make default storange config null
* add unit test
* schema changes to fix api
* update profiler setting schema
* move profiler settings to manage button
* sync locals
* fix(ui): unit tests
* fix tests
* py format
* fix lint
* minor improvements
* chore(ui): update profiler settings schema
* resolve review comments
* pytest
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-11-09 18:49:42 +05:30
Teddy
7f151ca5f7
fix: remove RESULT_SCAN dep. ( #13904 )
2023-11-09 08:13:59 +01:00
Onkar Ravgan
bdfc9226d5
Added cost analysis producer in DI ( #13872 )
2023-11-08 12:04:48 +05:30
Suresh Srinivas
a89e317a2b
Fixes #13863 - Show inherited relationships of an entity ( #13864 )
...
* Fixes #13863 - Show inherited relationships of an entity
* Test failure fixes
* Commenting out invalid python test
2023-11-07 09:11:06 -08:00
Ayush Shah
ec6184d2da
Fix Trino Dialect Import issue ( #13869 )
2023-11-07 12:10:59 +05:30
Ayush Shah
29b7f3aa33
Fixes 13688: Trino Profiler Bugs ( #13853 )
2023-11-06 17:14:04 +05:30
Onkar Ravgan
c7834e74cc
fixed avro recursive record ( #13856 )
2023-11-06 16:27:06 +05:30
Onkar Ravgan
9d58b56a1c
Added stored procedures sample data ( #13838 )
...
* Added stored proc sample data
* Added sp lineage
2023-11-03 14:05:02 +01:00
Teddy
d025e217d6
fix: catch not Either type in workflow and return explicit error message ( #13796 )
2023-11-02 13:02:26 +01:00
Ayush Shah
0a04ce85bb
Add Multilingual Support in EntityLink ( #13826 )
2023-11-02 14:35:22 +05:30
Mayur Singal
feed873782
Add support for partitioned table support for Athena ( #13812 )
2023-11-01 17:13:28 +05:30
Pere Miquel Brull
7dd3874224
MSTR fix either ( #13788 )
2023-10-31 15:56:04 +05:30
Teddy
ba0d1153cd
Fix databricks lineage with unity catalog ( #13786 )
2023-10-31 15:55:04 +05:30
