Onkar Ravgan
80fff72949
Fix #14794 : Refactored and cleaned owner processing in sources ( #14817 )
...
* refactor owner processing
* Add exception handling and fix pytest
* review comments addressed
* looker tests
* fixed pycheckstyle
2024-01-25 06:46:22 +01:00
Pere Miquel Brull
337796d612
MINOR - Fix SP topology context & Looker usage context ( #14816 )
...
* MINOR - Fix SP topology context & Looker usage context
* MINOR - Fix SP topology context & Looker usage context
* Fix tests
2024-01-23 07:02:39 +01:00
Pere Miquel Brull
b84ce33b80
#11799 - Fix Airfow ownership & add pipeline tasks ( #14510 )
...
* Fix airflow owner and add tasks
* Add pipeline tasks ownership
* MINOR - Fix py CI
* Add pipeline tasks ownership
* Add pipeline tasks ownership
* MINOR - Fix py CI
* MINOR - Fix py CI
* Add pipeline tasks ownership
* patch team
* patch team
* Format
2023-12-28 10:25:00 -08:00
Pere Miquel Brull
a83a5ba3a3
MINOR - Skip delta tests for 3.11 ( #14398 )
...
* MINOR - Bump delta for 3.11
* Update flags
* MINOR - Bump delta for 3.11
* Update tests regex
* Update version
* Deprecations
* Format
* Version
* Try delta spark
* Skip delta tests for 3.11
* Update ingestion/tests/unit/topology/pipeline/test_airflow.py
2023-12-18 17:01:57 +01:00
Lucas Garcia
fe06b5cbb2
#14235 : adding dialect based on connection type to LineageParser ( #14249 )
...
* Fix #14235 : adding dialect based on connection type to LineageParser
* Fix: formating changes
* Update ingestion/src/metadata/ingestion/source/dashboard/metabase/metadata.py
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
* style: fix indentation errors
* Fix pytest
---------
Co-authored-by: LucasGarcia07 <lucas.junqueira@hurb.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-12-08 19:49:59 +05:30
Onkar Ravgan
ebb2317cf0
Fix 14040: Part 1 Remove get_by_name calls from topology ( #14098 )
...
* Changed for database
* Added changes for dashboard_service
* Changed for messaging service
* Changed for mlmodel service
* Changed for pipeline service
* Changed for search service
* Changed for objectstore service
* fixed wrong import
* fixed lint
* fixes
* fixed pytests
* fixed domo db pytest
* Fixed review comments
2023-11-27 16:15:47 +05:30
Mohit Yadav
10d8ec84fe
Logs added for Search Indexing and Stats issue fixed ( #13956 )
...
* Logs added for Search Indexing and Stats issue fixed
* Fix uninstall error
* Add error handling
* fix lint
* Push Job Level Exception on top
* disable flaky tests
* Fix Logs not visible in Search
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-11-13 23:39:56 +05:30
Pere Miquel Brull
0282574bdd
Create ometa client once and pass it around & improve pycln config ( #13310 )
...
* Create ometa client once and pass it around & improve pycln config
* Fix
* Fix
* Fix tests
* Fix maven ci
* Fix tests
* Fix tests
* Fix tests
* Format
* Fix DI
2023-10-04 09:14:03 +02:00
Pere Miquel Brull
18a4513ccc
Fix #13237 - Rename to instanceDomain and test DomoDashboard charts ( #13247 )
...
* Rename sandboxDomain to instanceDomain
* Test Get Charts in DomoDashboard
* Fix schemas
* Fix test
* Fix test
* Rename to Auto Tag PII
* Fix query test
* Fix query test
* Fix query test
2023-09-19 14:14:04 +02:00
Onkar Ravgan
a3ca8b6e66
Added project filter pattern to dashboard entity ( #12925 )
2023-09-05 11:01:28 +05:30
Mayur Singal
029786d773
Fix #9207 : Add source in lineage details ( #13046 )
2023-09-04 11:05:56 +05:30
Pere Miquel Brull
6c0e9f5061
Part of #7272 - Centralize Workflows, Status, and Exception Management ( #13029 )
...
* Prep changes
* Prep changes
* prep changes
* Update imports
* Format
* Prep delete
* Prep delete
* Fix sink
* Prep test
* Commit
* passing either
* passing either
* Prep Either
* Metadata source with Either
* Update status
* Merge remote-tracking branch 'upstream/main' into issue-7272
* Format
* Linting
* Linting
* Linting
* Linting
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Fix tests
* Comments
2023-08-30 15:49:42 +02:00
Pere Miquel Brull
e97d4befb1
Fix #12770 - Cleanup DL structure & Readers & Python 3.8 ( #12776 )
2023-08-09 16:07:16 +05:30
Ayush Shah
ab1ec50c2c
Fixes Mssql Ntext, text and Image ( #12490 )
2023-07-20 13:34:35 +05:30
Mayur Singal
0c6435ae9b
Fix #2957 : Add support for qlik sense enterprise connector ( #12450 )
2023-07-19 21:08:05 +05:30
vanshika18
9174cea1ab
Add support for Superset datamodels ( #12183 )
2023-07-13 14:10:37 +05:30
Pere Miquel Brull
b59ff24531
Fix looker view parser ( #12254 )
2023-07-03 07:25:08 +02:00
Pere Miquel Brull
1ecf5607c7
Looker - Fix file extension and blob import ( #12232 )
...
* Fix file extension and blob import
* Fix file extension and blob import
2023-06-29 16:14:17 +02:00
Pere Miquel Brull
97e08ee25c
Fix #12106 - Fix looker chart sourceUrl & Array datatype handling ( #12113 )
...
* Fix looker chart url
* Handle array datatype
* Handle array datatype
2023-06-25 08:18:36 -07:00
Onkar Ravgan
f07c421264
Removed Empty Description Assignment to entities and added database name logic to tableau ( #12031 )
2023-06-19 19:19:42 +05:30
Ayush Shah
f80eaf3a26
Fixes 11068: mysql & postgres iam auth ( #11937 )
2023-06-16 13:18:12 +05:30
Mayur Singal
82a0222257
SourceUrl changes for dashboard, pipeline & chart entities ( #11991 )
2023-06-15 14:44:48 +05:30
Mayur Singal
05dc42bdb8
Fix #11808 : Handle lineage for single db sources in superset ( #11933 )
2023-06-09 12:43:06 +05:30
Pere Miquel Brull
fdeea71671
Fix Looker explore git link & Add BitBucket reader ( #11837 )
...
* Add looker test connection step
* Add looker test connection step
* Update Credentials
* Fix explore link and add bitbucket reader
* Format
* Fix test
* Fix spline linting
* Fix import
2023-06-02 07:19:32 +02:00
Milan Bariya
7cbe48971d
fix: Redash lineage issue ( #11098 )
...
* fix: Redash lineage issue
* change based on comments
* change based on comments
* change based on comments
2023-04-18 21:22:17 +05:30
Mayur Singal
857ddeab1e
Ingestion: Metabase Unit Tests ( #11080 )
2023-04-18 09:08:17 +05:30
Onkar Ravgan
b82abd5047
Fixed tableau url ( #11071 )
...
* Fixed tableau url
* review comments and tests
* changes to remove host-port addition from the UI for dashboard and chart urls
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2023-04-17 11:20:11 +02:00
Onkar Ravgan
bc6ce22a2b
Added oneof selection for tableau auth types ( #11049 )
...
* Added tableau oneof fields
* Fixed pytests
* fixed field in test
* Handle tableau auth converter
* Fixed java tests and imports
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-04-14 13:49:36 +05:30
Ayush Shah
9d11029ec8
Fixes 10351: Fixes Metrics Computation, Samping, test suites and partioning ( #10603 )
...
Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-04-11 20:58:31 +05:30
Deepa Rao
147b7c551e
Fixes #10854 - Create/Update Chart Not working as Expected ( #10991 )
2023-04-11 06:28:01 -07:00
Pere Miquel Brull
09b283818d
Rel to #10927 - Looker DataModel ( #10945 )
...
* Organise calls
* Prepare skeleton
* Add looker model handling
* Parse files as sql
* Handle labels
* Linting
* Format
* Fix version
* Also check the API for explore lineage
2023-04-11 08:44:00 +02:00
Mayur Singal
9f2b10f6e2
Fix #10858 : Fix dashbaord & pipeline url ( #10957 )
2023-04-10 09:48:49 +00:00
Nahuel
62b88b0404
Fix#10584: Add lineage for Tableau data models ( #10923 )
...
* Refactor Tableau ingestion
* Add lineage from DB -> DataModel -> Dashboard
* Address PR comments
* Address PR comments
2023-04-06 07:28:41 +02:00
Onkar Ravgan
5d6e18dc28
Fix 10642: Mark delete entities and tags toggle ( #10695 )
...
* Added mark delete logic
* Final test and optimization
* After merge fixes
* Added include tags for dash pipelines dbt
* added docs and fixed test
* Fixed py tests
* Added UI changes for following newly added fields:
- markDeletedDashboards
- markDeletedMlModels
- markDeletedPipelines
- markDeletedTopics
- includeTags
* Fixed failing unit tests
* updated json files of localization for other languages
* Improved localization changes
* added localization changes for other languages
* Updated mark deleted desc
* updated the ingestion fields descriptions in the ingestion form for UI
* automated localization changes for other languages
* updated descriptions for includeTags field for dbtPipeline and databaseServiceMetadataPipeline json
* fixed issue where includeTags field was being sent in the dbtConfigSource
* Added flow to input taxonomy while adding BigQuery service.
---------
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2023-03-29 12:41:44 +05:30
NiharDoshi99
4fe713a875
fix: chart url ( #10605 )
...
* fix: chart url
* fix: chart url
* changes as per comment
* added test and pydantic for chart url
* changed as per comment
* changed as per comment
* fix python test
* changes as per comment
* fix python test
2023-03-20 06:38:44 +01:00
Ayush Shah
7e4ba4567b
Fix Quicksight URL ( #10592 )
2023-03-15 08:05:38 +00:00
NiharDoshi99
9b0b06fe25
Added flag for overriding owners ( #10425 )
...
* added flag for overriding owners
* docs update
* adding owners in patch call
* adding owners in patch call
* fix: python test case
* changes as per comment
* changes as per comment
* ui changes
2023-03-10 15:01:56 +05:30
Suresh Srinivas
afad0a4769
Fixes #10123 - Change entityReference in createRequests to fullyQualifiedName ( #10124 )
...
* Change entityReference to entity name or fullyQualifiedName
* Change backend code and tests to use FQN
* UI change for using fqns instead of EntityReference
* Ingestion framework changes for using fqns instead of EntityReference
* Fix test failures
* Fixed python tests and sample data new
* fix: minor ui changes for fqn
* Fixed python integration tests
* Fixed superset tests
* fix UI tests
* fix type issue
* fix cypress
* fix name for testcase
---------
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-02-13 13:38:55 +05:30
Mayur Singal
0bea02c202
Superset Unit Tests ( #10078 )
2023-02-09 19:45:24 +05:30
NiharDoshi99
012f96a7a2
Domo issue ( #10080 )
...
* Domo issue
* added pydantic models and changes as per comment
* Fix: added ownership details
* fixed pytest
2023-02-07 17:16:26 +05:30
Pere Miquel Brull
f0f3f0be6a
Add looker unit tests ( #9691 )
...
* Add looker tests
* Empty-Commit
* Install GE for tests
* Fix usage details python name
* Add missing test requirement
2023-02-01 09:20:26 +00:00
Pere Miquel Brull
bce8574f98
Dashboards and charts use the ID as name ( #9810 )
...
* Update dashboard names
* Fix: metabase lineage
Co-authored-by: Nihar Doshi <nihardoshi16@gmail.com>
2023-01-24 21:50:35 +05:30
Ayush Shah
14100d089f
Modify Charts ( #9814 )
2023-01-19 12:03:21 +00:00
Ayush Shah
02147b6502
Fix: Quicksight Dashboard and chart Metadata Ingestion ( #9786 )
...
* Fix Quicksight json schema and errors
* Fix Quicksight lineage
* add pagination
* Generalize Pagination
* Fix Pylints
* update max results
* fix tests
* Add Pydantic Models for QuickSight resp
* Add fqn builder
* Fix Py lInt
* Fix Tests
2023-01-18 20:37:41 +05:30
NiharDoshi99
2954f17832
Fix: Domo dashboard issue ( #9743 )
...
* Fix: Domo dashboard issue
* Fix: added execption handling
* Fix: changed as per comment
2023-01-17 21:27:15 +05:30
Pere Miquel Brull
7f21a7bced
Fix #8088 - Restructure source connections & clients ( #9545 )
2023-01-02 13:52:27 +01:00
Pere Miquel Brull
a4521fd664
Fix #6562 - Sources have their own package ( #9521 )
...
Fix #6562 - Sources have their own package (#9521 )
2022-12-27 15:00:22 +01:00
michizhou
da06d183db
feat: add QuickSight connector ( #8442 )
2022-11-08 19:54:49 +05:30
NiharDoshi99
84a89d7181
Added DOMO Pipeline ( #8133 )
2022-10-18 17:52:28 +05:30
NiharDoshi99
0e44f7d35d
Fixed: Intergrated DOMO Connector APIs ( #7989 )
2022-10-13 10:55:48 +05:30
