Onkar Ravgan
5197682921
Fixed dagster bugs and Added Pydantic Models ( #12048 )
2023-06-22 10:59:09 +05:30
Mayur Singal
c3cec54be9
Fix for #11807 Part 2: Add SourceUrl for table entity ( #12013 )
...
* Fix #11807 Part 2: Add SourceUrl for table entity
* address review comments: centralize sourceurl
* remove qlick
* pytest fix
* fix typo
2023-06-20 11:46:45 +02:00
Onkar Ravgan
f07c421264
Removed Empty Description Assignment to entities and added database name logic to tableau ( #12031 )
2023-06-19 19:19:42 +05:30
Mayur Singal
82a0222257
SourceUrl changes for dashboard, pipeline & chart entities ( #11991 )
2023-06-15 14:44:48 +05:30
Onkar Ravgan
caabe89f9c
Centralize tags ingestion logic ( #11880 )
2023-06-09 10:45:53 +05:30
Mayur Singal
e9992a52a8
Fix #1604 : Add Spline Pipeline Connector ( #11562 )
...
* Fix #1604 : Add Spline Connector
* Add tests & grammer validation
* Spline UI Changes & Docs
* fix pipeline workflow doc
* chore: use common field for dbService name
* chore: use const for beta services
* chore: add service icon
* Update ingestion/src/metadata/ingestion/source/pipeline/spline/metadata.py
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2023-05-19 14:46:32 +05:30
Onkar Ravgan
cff403a05a
Validate if tags are created before attaching them to CreateRequest ( #11554 )
...
* Added tags validation
* typo fixed
2023-05-11 16:04:55 +00:00
Mayur Singal
9f2b10f6e2
Fix #10858 : Fix dashbaord & pipeline url ( #10957 )
2023-04-10 09:48:49 +00:00
Nahuel
dd225d1463
Fix: Clean Source and SourceStatus inheritance ( #10687 )
...
* Fix: clean source and sourcestatus inheritance
* Remove auth parameters from mysql.yaml
* Fix failing test
* Fix pylint checks
* Add missing docstrings
2023-03-21 12:57:48 +01:00
Milan Bariya
a51da74f86
Databricks Pileline code improve & Test connection update & Databricks issue solved ( #10590 )
...
* Databricks Pileline code imporove
* Change based on comments
* Change based on comments
2023-03-15 20:19:12 +05:30
Teddy
7ec667808c
Fixes #10498 - Add support for nifi client certificate auth. ( #10499 )
...
* feat: Added nifi support for client cert auth
* feat: fix code linting
* feat: addressed comments for nifi connections
* feat: fixed linting
2023-03-10 11:09:40 +01:00
Suresh Srinivas
4c6d184ef5
Fixes #10480 Glossary rename results in rename of Classification with… ( #10486 )
...
* Fixes #10480 Glossary rename results in rename of Classification with the same name
* Rename TagSource Tag to Classification
2023-03-09 00:30:36 -08:00
Suresh Srinivas
afad0a4769
Fixes #10123 - Change entityReference in createRequests to fullyQualifiedName ( #10124 )
...
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-02-13 13:38:55 +05:30
Pere Miquel Brull
f2fb0521c2
Update airflow loggers and rename ometa loggers ( #9868 )
...
* Update airflow loggers and rename ometa loggers
* ANSI print to logger
* Remove colored logging from tests
* Merge ometa_logger into the one used in loggers class
* linting
* linting
Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-01-23 16:28:17 +01:00
Suresh Srinivas
ac157a8f0b
Fixes #9618 Allow apostrophe in entity names ( #9642 )
...
* Fixes #9618 Allow apostrophe in entity names
* Add support for space in entity names (with exception) and column names
* Add regex checks to entity names, table column names to allow only required characters
* fix: allowed characters in entityName
* Add all the allowed special characters in the entity name in tests
* Allow '&', '/', ':' only for the table
* Override basic entityName by defining entity specific entityName for Python code gen
* fix: dagster migration + json schema path
* fix: python style check
* Fix test failure
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-01-17 11:34:29 -08:00
Steve Russo
3a3f248edd
Issue 5592: Add Databricks Pipeline Connector ( #9554 )
...
* feat: update databricks_client
* feat: create pipelineconnection & connection
* test: add unit test
* feat: add examples file
* fix: remove unused imports
* style: fix python style
* fix: code review adjustments
* fix: remove unneeded schema ref
* fix: format requirements
* fix: change context calls
* test: add pipeline_status test
* format: pylint format change
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-01-05 14:14:12 +01:00
Pere Miquel Brull
7f21a7bced
Fix #8088 - Restructure source connections & clients ( #9545 )
2023-01-02 13:52:27 +01:00
Pere Miquel Brull
a4521fd664
Fix #6562 - Sources have their own package ( #9521 )
...
Fix #6562 - Sources have their own package (#9521 )
2022-12-27 15:00:22 +01:00
NiharDoshi99
3190ac2516
Fix: making token as optional field ( #9314 )
2022-12-16 14:17:47 +00:00
NiharDoshi99
1c1f8660f2
Fixed: dagster to connect to cloud ( #8387 )
...
* Fixed: dagster to connect to cloud
* Fixed: changed test_cases
* Fixed: lineage between the assets and jobs
* Changes as per comments
* Fix python checkstyle
* Fix as per comments
* Fix added migration scripts
* minor fixes
2022-11-03 18:19:50 +01:00
Pere Miquel Brull
6d404ccdc1
Domo Pipeline - Use pipeline ID with display name ( #8374 )
...
* Use pipeline ID with display name
* handle id
* lint
* update test for ID
2022-10-26 21:22:26 +02:00
NiharDoshi99
84a89d7181
Added DOMO Pipeline ( #8133 )
2022-10-18 17:52:28 +05:30
Onkar Ravgan
35efd49256
Added control for DBT descriptions ( #7653 )
...
* Added control for DBT descriptions
* Fixed tests
* Added UI changes
* fixed maven ci tests
* Java formatting changes
* ui review fixes
* Fixed pytests
* Fixed python integration tests
* fixed airflow tests
Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-09-26 16:19:47 +05:30
NiharDoshi99
8adcf2ee3d
Fixed: Dagster to work with its API ( #7579 )
2022-09-23 17:46:40 +05:30
Pere Miquel Brull
6cebf37b6c
Fix #6906 - Add Nifi connector ( #6956 )
...
* Add Nifi connector
* Mock token
* Format
* pass verify param
2022-08-26 21:50:01 +02:00
Abhishek Pandey
a6a7662517
dagster-connector-added ( #6513 )
...
* dagster-connector-added
* code-formatted
* dagster-comments-removed
* dagster-comments-removed
* dagster-unittest-added
* code-formatted-pr-comments-resolved
* improved-code-quality
* increased-py-test-time-out
* improved-dagster-tests
* improved-dagster-tests
* reverted-pytests-timeout
* dagster-pytest-improved
* added-schema-in-omdcore
* updated-schema-in-omd-core
* ui-schema-updated-omd-core
* updated-dagster-schema
* dagter-schema-test-updated
2022-08-13 15:18:14 +05:30
Sriharsha Chintalapani
1a42428e42
Add time series extention ( #6416 )
...
Co-authored-by: Vivek Ratnavel Subramanian <vivekratnavel90@gmail.com>
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-04 07:22:47 -07:00
Mayur Singal
c6efe8c142
Fix #6158 : Fivetran Connector Added ( #6329 )
...
* Fivetran Connector Added
* Fivetran unit test added
* Fixed Unit Tests
* Added Fivetran Docs & Added Fivetran in Pipeline Listing
2022-07-27 20:50:56 +05:30
Pere Miquel Brull
7560635114
Fix #6280 - Bump DeltaLake version, tests and docs ( #6307 )
...
Fix #6280 - Bump DeltaLake version, tests and docs (#6307 )
2022-07-24 18:49:15 +02:00
Mayur Singal
75ccc803ad
Fix #5410 : Topology for Pipeline Services ( #6085 )
...
Fix #5410 : Topology for Pipeline Services (#6085 )
2022-07-22 13:59:14 +02:00
