NiharDoshi99
8d925c46a5
#13696 : add support for dot in schema name to fetch tables ( #14246 )
2023-12-08 12:04:28 +05:30
Mayur Singal
389ae79d3c
#14115 : Separate Unity Catalog From Databricks ( #14138 )
2023-12-04 11:22:46 +05:30
Onkar Ravgan
ebb2317cf0
Fix 14040: Part 1 Remove get_by_name calls from topology ( #14098 )
...
* Changed for database
* Added changes for dashboard_service
* Changed for messaging service
* Changed for mlmodel service
* Changed for pipeline service
* Changed for search service
* Changed for objectstore service
* fixed wrong import
* fixed lint
* fixes
* fixed pytests
* fixed domo db pytest
* Fixed review comments
2023-11-27 16:15:47 +05:30
Mayur Singal
9f14ef7fab
Fix #13954 : Fix ParseException for older version of databricks ( #14015 )
2023-11-20 13:14:40 +05:30
Ayush Shah
bfb361dc85
Fix Bigquery lineage Pytests ( #13695 )
2023-10-25 11:15:41 +05:30
Ayush Shah
57cb72c26f
Fix Checkstyle ( #13683 )
2023-10-23 15:51:40 +05:30
Iaroslav Frolikov
420da29841
Fixes #13607 : BigQuery lineage ingestion fails when using GcpCredentialsPath authentication config ( #13608 )
2023-10-23 15:42:06 +05:30
Pere Miquel Brull
660bf01a5b
Fix Stored Procedures Lineage for multi-db processes ( #13655 )
2023-10-20 09:14:08 +02:00
Teddy
1cbdfb3ae7
Fixes #12601 - column filter for profiler workflow ( #13535 )
...
* fix: sample data ingestion to match entity profiler column setting
* fix: python linting
* fix: updated fn call
* fix: added logic to handle json filed in datalake connector
* fix: handle NA values in parsing
* fix: reverted sampler changes from #13338
* fix: reverted metric changes from #13338
* fix: added datalake profiler ingestion test
* fix: python linting
* fix: removed normalization of json blob in NoSQL db
2023-10-12 14:51:38 +02:00
Ayush Shah
08d7ee6d55
Fixes #13052 : Datalake Nested Columns Sample Data ingestion ( #13338 )
2023-10-08 20:08:51 +05:30
Mayur Singal
0090286924
Fix Bigquery Test connection for multiproject ( #13380 )
...
Co-authored-by: Ayush Shah <ayush@getcollate.io>
2023-10-05 14:50:42 +05:30
Pere Miquel Brull
0282574bdd
Create ometa client once and pass it around & improve pycln config ( #13310 )
...
* Create ometa client once and pass it around & improve pycln config
* Fix
* Fix
* Fix tests
* Fix maven ci
* Fix tests
* Fix tests
* Fix tests
* Format
* Fix DI
2023-10-04 09:14:03 +02:00
Ayush Shah
04760177f6
Fixes 13321: Fix Test Connection timeout ( #13323 )
2023-09-25 15:17:38 +05:30
Pere Miquel Brull
18a4513ccc
Fix #13237 - Rename to instanceDomain and test DomoDashboard charts ( #13247 )
...
* Rename sandboxDomain to instanceDomain
* Test Get Charts in DomoDashboard
* Fix schemas
* Fix test
* Fix test
* Rename to Auto Tag PII
* Fix query test
* Fix query test
* Fix query test
2023-09-19 14:14:04 +02:00
Ayush Shah
5fea08cd33
Datalake: Add manifest file support, fix profiler metrics, add array and json column type support ( #13017 )
2023-09-13 15:15:49 +05:30
Pere Miquel Brull
f0995cbddc
Part of #12998 - Prep Stored Procedures Skeleton for Snowflake ( #13121 )
...
* Prep Stored Procedures Skeleton for Snowflake
* Update pylint and add migrations
* Fix test
* Reuse source url computation
2023-09-12 14:25:42 +02:00
Pere Miquel Brull
6c0e9f5061
Part of #7272 - Centralize Workflows, Status, and Exception Management ( #13029 )
...
* Prep changes
* Prep changes
* prep changes
* Update imports
* Format
* Prep delete
* Prep delete
* Fix sink
* Prep test
* Commit
* passing either
* passing either
* Prep Either
* Metadata source with Either
* Update status
* Merge remote-tracking branch 'upstream/main' into issue-7272
* Format
* Linting
* Linting
* Linting
* Linting
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Comments
2023-08-30 15:49:42 +02:00
vanshika18
3cc15e6d0b
Fixed #8418 added new connector couchbase ( #12836 )
2023-08-29 11:16:32 +05:30
Ayush Shah
5ea4de646c
Fix Postgres Profiler for incompatible versions ( #12795 )
2023-08-11 15:32:43 +05:30
Pere Miquel Brull
e97d4befb1
Fix #12770 - Cleanup DL structure & Readers & Python 3.8 ( #12776 )
2023-08-09 16:07:16 +05:30
Ayush Shah
ab1ec50c2c
Fixes Mssql Ntext, text and Image ( #12490 )
2023-07-20 13:34:35 +05:30
Mayur Singal
c3cec54be9
Fix for #11807 Part 2: Add SourceUrl for table entity ( #12013 )
...
* Fix #11807 Part 2: Add SourceUrl for table entity
* address review comments: centralize sourceurl
* remove qlick
* pytest fix
* fix typo
2023-06-20 11:46:45 +02:00
Onkar Ravgan
f07c421264
Removed Empty Description Assignment to entities and added database name logic to tableau ( #12031 )
2023-06-19 19:19:42 +05:30
Ayush Shah
f80eaf3a26
Fixes 11068: mysql & postgres iam auth ( #11937 )
2023-06-16 13:18:12 +05:30
Onkar Ravgan
d08c928801
Added project property to dashboards ( #11986 )
...
* Added projects to dashboards
* Added powerbi proj
* merge conflicts after source url
* fixed mongo pytest
2023-06-15 21:23:43 +05:30
Mayur Singal
7fa963eec3
Fix #1076 : Add mongodb support ( #11943 )
2023-06-15 11:14:22 +05:30
Mayur Singal
b57bbf833f
Fix #11572 : Glue Support Partition Columns & Use Pydantic Models ( #11776 )
2023-05-31 12:03:34 +00:00
Ayush Shah
ad7258e7be
Fixes 10949: return Chunks for file formats & Centralize logic for different auth configs ( #11639 )
...
* Centralize Auth and File formats datalake
2023-05-19 18:54:28 +05:30
Mayur Singal
e4997c3749
Fix #11571 : Support custom database name for glue ( #11631 )
2023-05-18 14:16:56 +05:30
Onkar Ravgan
3d9d4416b7
Fixed incompatible column name for Postgres version 11.6 ( #11536 )
...
* postgres col name on version
* Added dependancy
* Added paranthesis validation
* review comments and tests
2023-05-15 11:48:03 +05:30
Mayur Singal
da2f03ca50
Salesforce docs & remove unnecessary fields ( #11207 )
2023-04-22 18:32:32 +02:00
Pere Miquel Brull
b5cb1d464a
Deprecate location and old storage service ( #11004 )
...
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-04-12 11:44:46 +02:00
Ayush Shah
9d11029ec8
Fixes 10351: Fixes Metrics Computation, Samping, test suites and partioning ( #10603 )
...
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-04-11 20:58:31 +05:30
Mayur Singal
3d345f9b37
Fix #10273 : Parse nested json for datalake ( #10956 )
2023-04-10 14:58:02 +05:30
Mayur Singal
752163ac71
Fix #10814 : Improve parsing logic for union fields in topic ( #10836 )
2023-04-01 11:10:05 +05:30
Mayur Singal
bbce9c5aa4
Fix #10489 : Handle unknown data types & store raw data type ( #10563 )
2023-03-23 11:41:29 +05:30
Nahuel
07d6028149
Fix: remove avro-python3 deprecated dependency ( #10602 )
2023-03-15 14:15:57 +00:00
Sriharsha Chintalapani
b33587041d
Fix #5153 : Add referred columns for foreign key constraint and sort_key, dist_key support ( #10433 )
...
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-03-15 18:55:51 +05:30
Onkar Ravgan
4d11db4220
Added doc in avro array and tests ( #10473 )
2023-03-08 20:16:50 +05:30
Suresh Srinivas
afad0a4769
Fixes #10123 - Change entityReference in createRequests to fullyQualifiedName ( #10124 )
...
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-02-13 13:38:55 +05:30
Mayur Singal
392107bc4a
Datalake Avro & Json Lines Support ( #10129 )
2023-02-08 17:31:25 +00:00
Abhishek Pandey
933e195ef6
salesforce-test-added ( #9890 )
...
* salesforce-test-added
* license-headers-added
2023-01-25 21:24:21 +05:30
Abhishek Pandey
86a57293ef
databricks-test-added ( #9749 )
...
* databricks-test-added
* databricks-test-added
2023-01-18 08:45:46 +01:00
NiharDoshi99
27c68fb208
test case for DomoDatabase ( #9630 )
...
* test case for domo-database
* test case for domo-database
* Fix: pytest
2023-01-06 12:02:01 +01:00
Pere Miquel Brull
7f21a7bced
Fix #8088 - Restructure source connections & clients ( #9545 )
2023-01-02 13:52:27 +01:00
Pere Miquel Brull
a4521fd664
Fix #6562 - Sources have their own package ( #9521 )
...
Fix #6562 - Sources have their own package (#9521 )
2022-12-27 15:00:22 +01:00
Abhishek Pandey
73b370b5e2
schema-filter-added-in-datalake-for-bucket ( #8516 )
...
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-11-08 10:57:16 +05:30
Ayush Shah
2d7d89754c
Remove Click and Add ArgParse ( #8182 )
2022-10-31 18:12:26 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler ( #7506 )
2022-09-26 19:41:40 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions ( #7653 )
...
* Added control for DBT descriptions
* Fixed tests
* Added UI changes
* fixed maven ci tests
* Java formatting changes
* ui review fixes
* Fixed pytests
* Fixed python integration tests
* fixed airflow tests
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30
