Pere Miquel Brull
f2fb0521c2
Update airflow loggers and rename ometa loggers ( #9868 )
...
* Update airflow loggers and rename ometa loggers
* ANSI print to logger
* Remove colored logging from tests
* Merge ometa_logger into the one used in loggers class
* linting
* linting
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-01-23 16:28:17 +01:00
Ayush Shah
14100d089f
Modify Charts ( #9814 )
2023-01-19 12:03:21 +00:00
Ayush Shah
02147b6502
Fix: Quicksight Dashboard and chart Metadata Ingestion ( #9786 )
...
* Fix Quicksight json schema and errors
* Fix Quicksight lineage
* add pagination
* Generalize Pagination
* Fix Pylints
* update max results
* fix tests
* Add Pydantic Models for QuickSight resp
* Add fqn builder
* Fix Py lInt
* Fix Tests
2023-01-18 20:37:41 +05:30
NiharDoshi99
f2649041f2
Fix: atlas test connection ( #9791 )
...
* Fix: atlas test connection
* Fix: docs changes
* Fix: docs changes
* Fix: python checkstyle
* Fix: python test
2023-01-18 20:16:07 +05:30
Abhishek Pandey
86a57293ef
databricks-test-added ( #9749 )
...
* databricks-test-added
* databricks-test-added
2023-01-18 08:45:46 +01:00
Suresh Srinivas
ac157a8f0b
Fixes #9618 Allow apostrophe in entity names ( #9642 )
...
* Fixes #9618 Allow apostrophe in entity names
* Add support for space in entity names (with exception) and column names
* Add regex checks to entity names, table column names to allow only required characters
* fix: allowed characters in entityName
* Add all the allowed special characters in the entity name in tests
* Allow '&', '/', ':' only for the table
* Override basic entityName by defining entity specific entityName for Python code gen
* fix: dagster migration + json schema path
* fix: python style check
* Fix test failure
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-01-17 11:34:29 -08:00
NiharDoshi99
2954f17832
Fix: Domo dashboard issue ( #9743 )
...
* Fix: Domo dashboard issue
* Fix: added execption handling
* Fix: changed as per comment
2023-01-17 21:27:15 +05:30
NiharDoshi99
029dbe892e
Fix: added test case for atlas ( #9678 )
...
* Fix: added test case for atlas
* Fix: resolved conflict
* Fix: changing back neo4j to old version
* Fix: changing back neo4j to old version
* Fix: changes as per comment
* Fix: changes as per comment
* Fix: python checkstyle
2023-01-13 16:07:29 +05:30
NiharDoshi99
27c68fb208
test case for DomoDatabase ( #9630 )
...
* test case for domo-database
* test case for domo-database
* Fix: pytest
2023-01-06 12:02:01 +01:00
Steve Russo
3a3f248edd
Issue 5592: Add Databricks Pipeline Connector ( #9554 )
...
* feat: update databricks_client
* feat: create pipelineconnection & connection
* test: add unit test
* feat: add examples file
* fix: remove unused imports
* style: fix python style
* fix: code review adjustments
* fix: remove unneeded schema ref
* fix: format requirements
* fix: change context calls
* test: add pipeline_status test
* format: pylint format change
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-01-05 14:14:12 +01:00
Pere Miquel Brull
7f21a7bced
Fix #8088 - Restructure source connections & clients ( #9545 )
2023-01-02 13:52:27 +01:00
Pere Miquel Brull
a4521fd664
Fix #6562 - Sources have their own package ( #9521 )
...
Fix #6562 - Sources have their own package (#9521 )
2022-12-27 15:00:22 +01:00
NiharDoshi99
3190ac2516
Fix: making token as optional field ( #9314 )
2022-12-16 14:17:47 +00:00
NiharDoshi99
4ed088f55e
WIP: Fixed amundsen ingestion ( #8544 )
2022-11-09 14:21:44 +05:30
michizhou
da06d183db
feat: add QuickSight connector ( #8442 )
2022-11-08 19:54:49 +05:30
Abhishek Pandey
73b370b5e2
schema-filter-added-in-datalake-for-bucket ( #8516 )
...
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2022-11-08 10:57:16 +05:30
NiharDoshi99
1c1f8660f2
Fixed: dagster to connect to cloud ( #8387 )
...
* Fixed: dagster to connect to cloud
* Fixed: changed test_cases
* Fixed: lineage between the assets and jobs
* Changes as per comments
* Fix python checkstyle
* Fix as per comments
* Fix added migration scripts
* minor fixes
2022-11-03 18:19:50 +01:00
Ayush Shah
2d7d89754c
Remove Click and Add ArgParse ( #8182 )
2022-10-31 18:12:26 +05:30
Pere Miquel Brull
6d404ccdc1
Domo Pipeline - Use pipeline ID with display name ( #8374 )
...
* Use pipeline ID with display name
* handle id
* lint
* update test for ID
2022-10-26 21:22:26 +02:00
NiharDoshi99
84a89d7181
Added DOMO Pipeline ( #8133 )
2022-10-18 17:52:28 +05:30
NiharDoshi99
0e44f7d35d
Fixed: Intergrated DOMO Connector APIs ( #7989 )
2022-10-13 10:55:48 +05:30
Ayush Shah
56c71c4101
Fix Ingestion Time Partitioned Tables on Profiler ( #7506 )
2022-09-26 19:41:40 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions ( #7653 )
...
* Added control for DBT descriptions
* Fixed tests
* Added UI changes
* fixed maven ci tests
* Java formatting changes
* ui review fixes
* Fixed pytests
* Fixed python integration tests
* fixed airflow tests
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30
NiharDoshi99
8adcf2ee3d
Fixed: Dagster to work with its API ( #7579 )
2022-09-23 17:46:40 +05:30
Pere Miquel Brull
1578fa7f1b
Fix #7121 - Support Spark metastore DB connection ( #7520 )
...
* Fix #7121 - Support Spark metastore DB connection
* appname
* Update docs
* test validation
* Address PR comments
Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-09-20 16:47:57 +02:00
NiharDoshi99
5eb45948bd
Fixed: PostGIS geometry type ( #7382 )
...
Fixed: PostGIS geometry type (#7382 )
2022-09-15 10:35:15 +02:00
Mayur Singal
791245c0e8
Redshift Mark Partitioned Tables ( #7063 )
2022-08-30 18:40:51 +02:00
Mayur Singal
5a3fcafb3b
Snowflake Mark Partitioned Tables ( #7021 )
...
Snowflake Mark Partitioned Tables (#7021 )
2022-08-30 14:35:09 +02:00
Pere Miquel Brull
6cebf37b6c
Fix #6906 - Add Nifi connector ( #6956 )
...
* Add Nifi connector
* Mock token
* Format
* pass verify param
2022-08-26 21:50:01 +02:00
Abhishek Pandey
a6a7662517
dagster-connector-added ( #6513 )
...
* dagster-connector-added
* code-formatted
* dagster-comments-removed
* dagster-comments-removed
* dagster-unittest-added
* code-formatted-pr-comments-resolved
* improved-code-quality
* increased-py-test-time-out
* improved-dagster-tests
* improved-dagster-tests
* reverted-pytests-timeout
* dagster-pytest-improved
* added-schema-in-omdcore
* updated-schema-in-omd-core
* ui-schema-updated-omd-core
* updated-dagster-schema
* dagter-schema-test-updated
2022-08-13 15:18:14 +05:30
Sriharsha Chintalapani
1a42428e42
Add time series extention ( #6416 )
...
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-04 07:22:47 -07:00
Onkar Ravgan
7fdab21a72
Glue Topology Refactor ( #6231 )
...
* rebase with main
* refactored glue for topology
* added glue unit tests
* resolved review comments
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-07-28 15:04:43 +02:00
Mayur Singal
c6efe8c142
Fix #6158 : Fivetran Connector Added ( #6329 )
...
* Fivetran Connector Added
* Fivetran unit test added
* Fixed Unit Tests
* Added Fivetran Docs & Added Fivetran in Pipeline Listing
2022-07-27 20:50:56 +05:30
Pere Miquel Brull
7560635114
Fix #6280 - Bump DeltaLake version, tests and docs ( #6307 )
...
Fix #6280 - Bump DeltaLake version, tests and docs (#6307 )
2022-07-24 18:49:15 +02:00
Mayur Singal
75ccc803ad
Fix #5410 : Topology for Pipeline Services ( #6085 )
...
Fix #5410 : Topology for Pipeline Services (#6085 )
2022-07-22 13:59:14 +02:00
Pere Miquel Brull
02fece727b
Fix #5307 - Define a better topology for Ingestion Sources ( #5366 )
...
Fix #5307 - Define a better topology for Ingestion Sources (#5366 )
2022-06-13 12:17:54 +02:00
