Ayush Shah
5fea08cd33
Datalake: Add manifest file support, fix profiler metrics, add array and json column type support ( #13017 )
2023-09-13 15:15:49 +05:30
Pere Miquel Brull
f0995cbddc
Part of #12998 - Prep Stored Procedures Skeleton for Snowflake ( #13121 )
...
* Prep Stored Procedures Skeleton for Snowflake
* Update pylint and add migrations
* Fix test
* Reuse source url computation
2023-09-12 14:25:42 +02:00
Pere Miquel Brull
6c0e9f5061
Part of #7272 - Centralize Workflows, Status, and Exception Management ( #13029 )
...
* Prep changes
* Prep changes
* prep changes
* Update imports
* Format
* Prep delete
* Prep delete
* Fix sink
* Prep test
* Commit
* passing either
* passing either
* Prep Either
* Metadata source with Either
* Update status
* Merge remote-tracking branch 'upstream/main' into issue-7272
* Format
* Linting
* Linting
* Linting
* Linting
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Comments
2023-08-30 15:49:42 +02:00
vanshika18
3cc15e6d0b
Fixed #8418 added new connector couchbase ( #12836 )
2023-08-29 11:16:32 +05:30
Ayush Shah
5ea4de646c
Fix Postgres Profiler for incompatible versions ( #12795 )
2023-08-11 15:32:43 +05:30
Pere Miquel Brull
e97d4befb1
Fix #12770 - Cleanup DL structure & Readers & Python 3.8 ( #12776 )
2023-08-09 16:07:16 +05:30
Ayush Shah
ab1ec50c2c
Fixes Mssql Ntext, text and Image ( #12490 )
2023-07-20 13:34:35 +05:30
Mayur Singal
c3cec54be9
Fix for #11807 Part 2: Add SourceUrl for table entity ( #12013 )
...
* Fix #11807 Part 2: Add SourceUrl for table entity
* address review comments: centralize sourceurl
* remove qlick
* pytest fix
* fix typo
2023-06-20 11:46:45 +02:00
Onkar Ravgan
f07c421264
Removed Empty Description Assignment to entities and added database name logic to tableau ( #12031 )
2023-06-19 19:19:42 +05:30
Ayush Shah
f80eaf3a26
Fixes 11068: mysql & postgres iam auth ( #11937 )
2023-06-16 13:18:12 +05:30
Onkar Ravgan
d08c928801
Added project property to dashboards ( #11986 )
...
* Added projects to dashboards
* Added powerbi proj
* merge conflicts after source url
* fixed mongo pytest
2023-06-15 21:23:43 +05:30
Mayur Singal
7fa963eec3
Fix #1076 : Add mongodb support ( #11943 )
2023-06-15 11:14:22 +05:30
Mayur Singal
b57bbf833f
Fix #11572 : Glue Support Partition Columns & Use Pydantic Models ( #11776 )
2023-05-31 12:03:34 +00:00
Ayush Shah
ad7258e7be
Fixes 10949: return Chunks for file formats & Centralize logic for different auth configs ( #11639 )
...
* Centralize Auth and File formats datalake
2023-05-19 18:54:28 +05:30
Mayur Singal
e4997c3749
Fix #11571 : Support custom database name for glue ( #11631 )
2023-05-18 14:16:56 +05:30
Onkar Ravgan
3d9d4416b7
Fixed incompatible column name for Postgres version 11.6 ( #11536 )
...
* postgres col name on version
* Added dependancy
* Added paranthesis validation
* review comments and tests
2023-05-15 11:48:03 +05:30
Mayur Singal
da2f03ca50
Salesforce docs & remove unnecessary fields ( #11207 )
2023-04-22 18:32:32 +02:00
Pere Miquel Brull
b5cb1d464a
Deprecate location and old storage service ( #11004 )
...
* Deprecate location and old storage service
* Format
* Fix test
* Refactor
* Clean location
* Rename object store to storage
* Rename object store to storage
* Rename object store to storage
* Format
* Format
* Refactor object store for storage
* Refactor object store for storage
* Rename object store to storage
* Fix test
* Fix test
* Format
* chore(ui): change Objectstore to Storage
* Fixes
* Fix test
* Remove storage service from Glue cypress
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-04-12 11:44:46 +02:00
Ayush Shah
9d11029ec8
Fixes 10351: Fixes Metrics Computation, Samping, test suites and partioning ( #10603 )
...
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-04-11 20:58:31 +05:30
Mayur Singal
3d345f9b37
Fix #10273 : Parse nested json for datalake ( #10956 )
2023-04-10 14:58:02 +05:30
Mayur Singal
752163ac71
Fix #10814 : Improve parsing logic for union fields in topic ( #10836 )
2023-04-01 11:10:05 +05:30
Mayur Singal
bbce9c5aa4
Fix #10489 : Handle unknown data types & store raw data type ( #10563 )
2023-03-23 11:41:29 +05:30
Nahuel
07d6028149
Fix: remove avro-python3 deprecated dependency ( #10602 )
2023-03-15 14:15:57 +00:00
Sriharsha Chintalapani
b33587041d
Fix #5153 : Add referred columns for foreign key constraint and sort_key, dist_key support ( #10433 )
...
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-03-15 18:55:51 +05:30
Onkar Ravgan
4d11db4220
Added doc in avro array and tests ( #10473 )
2023-03-08 20:16:50 +05:30
Suresh Srinivas
afad0a4769
Fixes #10123 - Change entityReference in createRequests to fullyQualifiedName ( #10124 )
...
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-02-13 13:38:55 +05:30
Mayur Singal
392107bc4a
Datalake Avro & Json Lines Support ( #10129 )
2023-02-08 17:31:25 +00:00
Abhishek Pandey
933e195ef6
salesforce-test-added ( #9890 )
...
* salesforce-test-added
* license-headers-added
2023-01-25 21:24:21 +05:30
Abhishek Pandey
86a57293ef
databricks-test-added ( #9749 )
...
* databricks-test-added
* databricks-test-added
2023-01-18 08:45:46 +01:00
NiharDoshi99
27c68fb208
test case for DomoDatabase ( #9630 )
...
* test case for domo-database
* test case for domo-database
* Fix: pytest
2023-01-06 12:02:01 +01:00
Pere Miquel Brull
7f21a7bced
Fix #8088 - Restructure source connections & clients ( #9545 )
2023-01-02 13:52:27 +01:00
Pere Miquel Brull
a4521fd664
Fix #6562 - Sources have their own package ( #9521 )
...
Fix #6562 - Sources have their own package (#9521 )
2022-12-27 15:00:22 +01:00
Abhishek Pandey
73b370b5e2
schema-filter-added-in-datalake-for-bucket ( #8516 )
...
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-11-08 10:57:16 +05:30
Ayush Shah
2d7d89754c
Remove Click and Add ArgParse ( #8182 )
2022-10-31 18:12:26 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler ( #7506 )
2022-09-26 19:41:40 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions ( #7653 )
...
* Added control for DBT descriptions
* Fixed tests
* Added UI changes
* fixed maven ci tests
* Java formatting changes
* ui review fixes
* Fixed pytests
* Fixed python integration tests
* fixed airflow tests
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30
Pere Miquel Brull
1578fa7f1b
Fix #7121 - Support Spark metastore DB connection ( #7520 )
...
* Fix #7121 - Support Spark metastore DB connection
* appname
* Update docs
* test validation
* Address PR comments
Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-09-20 16:47:57 +02:00
NiharDoshi99
5eb45948bd
Fixed: PostGIS geometry type ( #7382 )
...
Fixed: PostGIS geometry type (#7382 )
2022-09-15 10:35:15 +02:00
Mayur Singal
791245c0e8
Redshift Mark Partitioned Tables ( #7063 )
2022-08-30 18:40:51 +02:00
Mayur Singal
5a3fcafb3b
Snowflake Mark Partitioned Tables ( #7021 )
...
Snowflake Mark Partitioned Tables (#7021 )
2022-08-30 14:35:09 +02:00
Onkar Ravgan
7fdab21a72
Glue Topology Refactor ( #6231 )
...
* rebase with main
* refactored glue for topology
* added glue unit tests
* resolved review comments
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-07-28 15:04:43 +02:00
Pere Miquel Brull
7560635114
Fix #6280 - Bump DeltaLake version, tests and docs ( #6307 )
...
Fix #6280 - Bump DeltaLake version, tests and docs (#6307 )
2022-07-24 18:49:15 +02:00
