7194 Commits

Author SHA1 Message Date
Pere Miquel Brull
db292eaa0b
Prepare exit handler & Add missing arg to test connection (#10519)
* Prepare exit handler

* clean envs
2023-03-13 10:50:10 +01:00
NiharDoshi99
113fcc2956
added process owner (#10539)
* added process owner

* python checkstyle

* changes as per comment
2023-03-13 14:39:02 +05:30
Shailesh Parmar
e916c85399
ui: Add UI Graph for Histogram #10365 (#10493)
* added quartile metrics chart for column profiler

* translation key sync

* added histogram graph

* sync - translation file

* added histogram comoponent and unit test for the same

* addressing comments

* addressing comment

* renaming date variable to graphDate
2023-03-13 06:56:20 +00:00
Onkar Ravgan
30e5d696a1
Fixed dbt e2e filter test (#10536) 2023-03-13 12:05:52 +05:30
Milan Bariya
178bc8ecc0
Fix: Databricks complex column type issue (#10469)
* Fix: Databricks complex column type issue

* Fix: Failed to fetch view definition

* Change based on comments

* Change based on comments

* Change based on comments
2023-03-13 10:09:16 +05:30
Sachin Chaurasiya
5d2f0bfaaf
fix(#10500): When the tier is removed all tags are also removed. (#10513)
* fix(#10500): When the tier is removed all tags are also removed.

* chore: warp TagsViewer component with AntD Space component

* test: add cypress test

* update test

* test: fix test for feed message check
2023-03-12 19:18:56 +05:30
Ashish Gupta
385a2e87d2
UI: Fix the icon on lineage Node (#10528)
* Fix the icon on lineage Node

* added pipeline icon

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-11 23:32:37 +05:30
Shailesh Parmar
203d41c88e
fix: Make column name a selection box only for tableRowInsertedCountToBeBetween test (#10527) 2023-03-11 20:23:34 +05:30
Shailesh Parmar
0a2f7ec599
fix: Make column name a selection box for tableRowInsertedCountToBeBetween test #10284 (#10520)
* fix: Make column name a selection box for `tableRowInsertedCountToBeBetween` test #10284

* sync-translation file

* added unit test for changes
2023-03-11 08:23:26 +00:00
Sachin Chaurasiya
b6a951f361
chore(ui): change user page search variable name to userSearchTerm (#10517)
* chore(ui): change user page search variable name to `userSearchTerm`

* address comments
2023-03-10 15:19:50 +00:00
Teddy
7ec667808c
Fixes #10498 - Add support for nifi client certificate auth. (#10499)
* feat: Added nifi support for client cert auth

* feat: fix code linting

* feat: addressed comments for nifi connections

* feat: fixed linting
2023-03-10 11:09:40 +01:00
Nahuel
b94927b3ea
Bug: fix flaky timeout test (#10509) 2023-03-10 10:55:56 +01:00
NiharDoshi99
34bf175ca1
adding quotes around alias (#10506) 2023-03-10 15:18:58 +05:30
NiharDoshi99
9b0b06fe25
Added flag for overriding owners (#10425)
* added flag for overriding owners

* docs update

* adding owners in patch call

* adding owners in patch call

* fix: python test case

* changes as per comment

* changes as per comment

* ui changes
2023-03-10 15:01:56 +05:30
Ashish Gupta
4ec185ff22
UI : Added Delete toggle and restore Testsuite functionality (#10479)
* Added Delete toggle and restore testsuite functionality

* Added cypress and address comments

* fix cypress and redirect to detailsPage

* missing localization for other languages

* Worked on Cypress comments

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-10 14:30:53 +05:30
Chirag Madlani
d82635e9c6
fix(ui): update recent runs instead whole page (#10501) 2023-03-10 08:28:14 +00:00
Teddy
cea10e8301
fix: handle None owner (#10497) 2023-03-10 08:12:14 +00:00
Sachin Chaurasiya
dccc139aad
feat(ui)#10271:UI - Object Storage Service Part-2 (#10419)
* feat(ui)#10271:UI - Object Storage Service

* chore: add objectStoreService in permission resource enum

* chore: add support for connection config form for object store service

* chore: add support for service connection details schema for object service

* chore: change objectStores to objectstores

* chore: add object stores in global settings

* chore: update objectstore locals

* chore: change objectStoreServices to objectstoreServices

* chore: add support for page header for object stores

* chore: fetch containers for object store service

* chore: fix connection config is not showing up for object store service

* chore: update getLinkForFqn for object store service

* fix: add object store service in delete widget modal

* chore: add object store service logo

* chore: update object store service label

* chore: fix routing of object store service

* test: add unit test for object store service

* fix: missing tags column header

* test: add unit test for global setting left panel

* test: update global setting left panel test

* chore: update svg to take the current color

* address comments

* feat(ui)#10271:UI - Object Storage Service Part-2

* chore: add support for container children

* chore: add support for data model component

* chore: add support for adding/updating description

* fix: read serviceType directly from entity

* chore: add support for follow and unFollow container

* chore: add support for update/remove owner and tier

* chore: add support for updating/removing tags of container

* fix: version is not updating in real time

* chore: add support for restoring the container

* chore: add support for lineage

* chore: add support for custom properties

* chore: add support for CRUD for custom attributes

* chore: add support for container nth level in breadcrumb

* fix: unit test

* chore: locale update

* chore: add support for updating data models

* chore: add object store service icon

* address previous PR comments

* test: add unit test

* chore: fix label issue

* chore: remove duplicate codes

* chore: add beta tag for object store service

* fix: tags source issue

* address comments
2023-03-10 07:55:24 +00:00
Milan Bariya
bc4abc44ed
Add steps in test_connection function (#10408)
* Add steps in test_connection funstion

* Add steps in test_connection funstion

* Add steps in test_connection funstion

* Fix: Pylint issue

* Status response changefor statuscode 200

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-10 10:02:26 +05:30
Pere Miquel Brull
81dec813a0
Don't store the OM connection in the Ingestion Pipeline or Workflow (#10448)
* Do not store OM connection

* Migration to remove the server connection

* Update tests

* Add workflow masking and secrets manager

* Fix failing test

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-03-09 17:32:40 +01:00
Sriharsha Chintalapani
d9e4fbdebb
Fix #10454: Improve Search Relevancy, by adding functional scoring an… (#10455)
* Fix #10454: Improve Search Relevancy, by adding functional scoring and add ngram analyzer; Fix #10452: Enable Table and Column search by BOTH name and displayName

* fix stylecheck

* Undo changes in table example names

* remove ngram from teams & users

* Fix topic tags

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf (#10430)

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Added top level parsing and unit tests

* fix(ui): show schemaText and fields both

* fix no data placeholder for fields & schema text

* addressing comments

* fixed py checkstyle

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* revert common_broker_source changes

* revert common_broker_source changes

* remove changes to user & team indexes

* fix team index

* fix glossary & tag index

* Fix to TopicIndex

* fix advance search pre-requisites cypress failure

* fix group advance search cy failures

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-09 21:37:08 +05:30
Teddy
f27266628d
update histogram sample data (#10495) 2023-03-09 15:19:57 +01:00
NiharDoshi99
ddbc0311e8
fix: mark table deleted dependencies (#10476) 2023-03-09 09:15:05 +00:00
Suresh Srinivas
4c6d184ef5
Fixes #10480 Glossary rename results in rename of Classification with… (#10486)
* Fixes #10480 Glossary rename results in rename of Classification with the same name

* Rename TagSource Tag to Classification
2023-03-09 00:30:36 -08:00
Sachin Chaurasiya
9910d0bc11
chore(ui): disable console logs for tests (#10488)
* chore(ui): disable console logs for tests

* address comment
2023-03-09 08:27:23 +00:00
Nahuel
ed884cf79a
Bug: Update sqllineage-openmetadata + add timeout for parsing queries (#10474)
* Update sqllineage-openmetadata version + add timeout

* Pyimpala fix colnames, comments and dialect sql compilation (#10470)

* Fix col names and comments for impala hive

* Fix cols, comments and impala sql compilation

* Handle hive types

* Format

* Added doc in avro array and tests (#10473)

* Fixed: Add job definition id field for dbt cloud in UI #10269 (#10472)

* fixed Add job definition id field for dbt cloud in UI #10269

* sync-localization file

* fixed failing unit test and add unit test for the changes

* Address PR comments

* Update tests

* Pylint clean

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-08 20:49:02 +01:00
Teddy
56f7ac2c2c
Fix few profiler bugs (#10465)
* fix: handle overflow in profiler + fix minor bug from new metrics

* fix: flaky test from profiler

* fix: fix code smell
2023-03-08 18:01:25 +01:00
Shailesh Parmar
325d10384f
fix: TestCase expansion to see the results not intuitive #10186 (#10475)
* fixed TestCase expansion to see the results not intuitive #10186

* missing translation key
2023-03-08 16:50:44 +00:00
Shailesh Parmar
23ad25b129
Fixed: Add job definition id field for dbt cloud in UI #10269 (#10472)
* fixed Add job definition id field for dbt cloud in UI #10269

* sync-localization file

* fixed failing unit test and add unit test for the changes
2023-03-08 15:56:37 +00:00
Onkar Ravgan
4d11db4220
Added doc in avro array and tests (#10473) 2023-03-08 20:16:50 +05:30
Pere Miquel Brull
a05e56feba
Pyimpala fix colnames, comments and dialect sql compilation (#10470)
* Fix col names and comments for impala hive

* Fix cols, comments and impala sql compilation

* Handle hive types

* Format
2023-03-08 14:13:06 +01:00
Mayur Singal
c199f13ed0
Fix #10402: Add support for AssumeRole for AWS (#10417) 2023-03-08 15:43:33 +05:30
NiharDoshi99
d41878ec90
fix: spacy model (#10467) 2023-03-08 15:19:35 +05:30
Onkar Ravgan
d4fafa3168
Downgraded conf-kafka lib (#10466) 2023-03-08 14:22:38 +05:30
Onkar Ravgan
ca623d0693
dbt performance improvement (#10366)
* dbt performance improvement

* reduced es calls

* Added unit tests
2023-03-08 06:37:34 +01:00
Sriharsha Chintalapani
b42f457d88
Fix error code if else in webhooks (#10386) 2023-03-07 12:58:19 -08:00
Pere Miquel Brull
63e285ef8f
Fix mysql (#10456) 2023-03-07 12:57:44 -08:00
Pere Miquel Brull
6845f8581e
Update CONTRIBUTING.md (#10464) 2023-03-07 12:57:17 -08:00
Sriharsha Chintalapani
fe73948b55
Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf (#10430)
* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Added top level parsing and unit tests

* fix(ui): show schemaText and fields both

* fix no data placeholder for fields & schema text

* addressing comments

* fixed py checkstyle

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-07 15:40:04 +01:00
Ashish Gupta
f867ff10e7
Fix the scroll on service Page (#10447) 2023-03-07 09:56:53 +00:00
Shailesh Parmar
f3174efc22
fixed bigquery and postgres cypress test (#10450) 2023-03-07 13:00:17 +05:30
Chirag Madlani
724a10a82f
fix(ui): right panel for lineage mode (#9999)
* fix(ui): right panel for lineage mode

* address comments

* fix unit tests failing

* update

* address comments

* improve ui

* added skeleton

* address comments

* address feedbacks
2023-03-07 11:05:31 +05:30
Shailesh Parmar
a6048228f4
Localization refactor part3 (#10442)
* ui: refactor localization file

* addressing comments

* fixed failing unit test

* ui: refactoring localization part 2

* miner fix

* fixing cypress and miner localization changes

* Localization refactor part 3

* updated sync-i18n commond for empty key sync, and removed empty key-value from other language

* sync fr-fr and zh-cn file

* updated script to not include empty empty localization key

* added refresh after language change and i18n script to lintstagedrc file
2023-03-06 17:51:20 +00:00
Sriharsha Chintalapani
de10cd254b
New docker structure (#10438)
* Adding the different docker-compose file openmetadata and ingestion

* Added two different env files for mysql and postgres

* Updated the docker file path

* Updated the path of docker folder structure

* Fix docker

* Updating the PR with necessary changes required

---------

Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2023-03-06 08:58:53 -08:00
Nahuel
f2e1a87b5a
Fix#10377: service connection not overwritten as expected (#10445) 2023-03-06 16:32:10 +01:00
Schlameel
fb7b12842b
#9544: Added patch owner to Python SDK. Includes tests. (#10403)
Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-06 14:32:58 +00:00
Teddy
8bc0472fae
Handle null window metric (#10440)
* fix: handle null window metrics

* fix: remove else from try/except pattern
2023-03-06 14:09:02 +00:00
Nahuel
ef1812a09d
Fix: Stop displaying authorization values in debug logs (#10443) 2023-03-06 14:56:29 +01:00
Ashish Gupta
cc8168ca9d
UI : Increase tag input size and added tooltip on options (#10397)
* Increase tag input size and added tooltip on options

* Increase width for glossary and shift icon to icon props

* fix cypress issue

* change cypress for selecting tag
2023-03-06 19:21:21 +05:30
Pere Miquel Brull
050da1e2d1
Add service type to container (#10441) 2023-03-06 14:44:30 +01:00