7010 Commits

Author SHA1 Message Date
karanh37
ca3b4a47a7
feat: lineage pagination (#10368)
* feat: initial commit for lineage pagination

* fix: optimize the entitylineage component

removing all props that were passed from datasetdetails

* fix: remove code from details pages

* fix: update styling of load more node

* fix: update lineage DS

* fix: pagination issue

* fix: add search functionality for paginated nodes

* test: add unit tests for lineage component

* fix: lint errors

* test: fix lineage tests

* fix: review comments

* fix: node loading state
2023-03-14 20:56:08 +05:30
Suresh Srinivas
ef97e04318
Fixes #10559 Remove individual resources & operations when All is specified in a policy rule (#10560) 2023-03-14 06:12:31 -07:00
Shailesh Parmar
c1033b2362
fix: Some Column Attributes aren't being displayed, even if populated (#10549)
* fixed issue Some Column Attributes aren't being displayed, even if populated #10451

* translation sync

* fixed tags cypress

* updated width of entity details page table
2023-03-14 17:40:58 +05:30
Teddy
2f4a92a17b
fix: exclude owner from page view traffic in DI (#10574)
* fix: exclude owner from page view traffic in DI

* fix: uncomment KPI creation in setup
2023-03-14 11:45:46 +00:00
Ashish Gupta
202a6a2388
Fix cypress for tags (#10569) 2023-03-14 16:43:10 +05:30
Chirag Madlani
8a5b54aebb
feat(ui): support debug option for dbt config (#10538)
* feat(ui): support debug option for dbt config

* fix tests and address comments
2023-03-14 16:37:23 +05:30
NiharDoshi99
83a1858434
fix druid ingestion (#10553)
* fix druid ingestion

* changes as per comment

* changes as per comment
2023-03-14 14:47:00 +05:30
Nahuel
ffdd911785
Bug: TypeError when dashboards field is not present in a workspace response (#10568) 2023-03-14 08:58:53 +00:00
Shailesh Parmar
f8ce1a6b75
fixed: Column profile graph by ingestion is not showing the values #10462 (#10557) 2023-03-14 07:06:51 +00:00
Shailesh Parmar
8412ed7545
fixed mydata flaky cypress test (#10540)
* fixed mydata flaky cypress test

* fixed glossary cypress

* fixed tags cypress
2023-03-14 10:33:51 +05:30
Mohit Yadav
26efcb1197
Add Indexing Mapping Language in Reindexing (#10537) 2023-03-14 10:28:56 +05:30
Ashish Gupta
801f53bad1
UI : Fix the Explore breaking issue when ES is down (#10546)
* Fix the Explore breaking issue when ES is down

* Shown Errorplaceholder for ES
2023-03-13 23:21:48 +05:30
Ashish Gupta
c0fe8ec871
UI : Added tags at schema Level (#10471)
* Added tags at schema Level

* Add task handling for Database Schema

* added cypress and unit test

* Changes as per comments

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-03-13 16:54:35 +00:00
Ayush Shah
0f9c2c2164
Add Labels on DatabaseSchema Level (#10547) 2023-03-13 14:13:51 +00:00
Sachin Chaurasiya
60d5285059
chore(ui): remove react-copy-to-clipboard and add custom hook for copy text (#10534)
* chore(ui): remove react-copy-to-clipboard and add custom hook for copy text

* test: add unit test

* test: update test imports

* test: improve the copy to clipboard button component test
2023-03-13 12:01:03 +00:00
Teddy
d03b06daf6
feat: Added logic to handle MERGE statement for bigquery (#10522) 2023-03-13 11:34:40 +01:00
Pere Miquel Brull
db292eaa0b
Prepare exit handler & Add missing arg to test connection (#10519)
* Prepare exit handler

* clean envs
2023-03-13 10:50:10 +01:00
NiharDoshi99
113fcc2956
added process owner (#10539)
* added process owner

* python checkstyle

* changes as per comment
2023-03-13 14:39:02 +05:30
Shailesh Parmar
e916c85399
ui: Add UI Graph for Histogram #10365 (#10493)
* added quartile metrics chart for column profiler

* translation key sync

* added histogram graph

* sync - translation file

* added histogram comoponent and unit test for the same

* addressing comments

* addressing comment

* renaming date variable to graphDate
2023-03-13 06:56:20 +00:00
Onkar Ravgan
30e5d696a1
Fixed dbt e2e filter test (#10536) 2023-03-13 12:05:52 +05:30
Milan Bariya
178bc8ecc0
Fix: Databricks complex column type issue (#10469)
* Fix: Databricks complex column type issue

* Fix: Failed to fetch view definition

* Change based on comments

* Change based on comments

* Change based on comments
2023-03-13 10:09:16 +05:30
Sachin Chaurasiya
5d2f0bfaaf
fix(#10500): When the tier is removed all tags are also removed. (#10513)
* fix(#10500): When the tier is removed all tags are also removed.

* chore: warp TagsViewer component with AntD Space component

* test: add cypress test

* update test

* test: fix test for feed message check
2023-03-12 19:18:56 +05:30
Ashish Gupta
385a2e87d2
UI: Fix the icon on lineage Node (#10528)
* Fix the icon on lineage Node

* added pipeline icon

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-11 23:32:37 +05:30
Shailesh Parmar
203d41c88e
fix: Make column name a selection box only for tableRowInsertedCountToBeBetween test (#10527) 2023-03-11 20:23:34 +05:30
Shailesh Parmar
0a2f7ec599
fix: Make column name a selection box for tableRowInsertedCountToBeBetween test #10284 (#10520)
* fix: Make column name a selection box for `tableRowInsertedCountToBeBetween` test #10284

* sync-translation file

* added unit test for changes
2023-03-11 08:23:26 +00:00
Sachin Chaurasiya
b6a951f361
chore(ui): change user page search variable name to userSearchTerm (#10517)
* chore(ui): change user page search variable name to `userSearchTerm`

* address comments
2023-03-10 15:19:50 +00:00
Teddy
7ec667808c
Fixes #10498 - Add support for nifi client certificate auth. (#10499)
* feat: Added nifi support for client cert auth

* feat: fix code linting

* feat: addressed comments for nifi connections

* feat: fixed linting
2023-03-10 11:09:40 +01:00
Nahuel
b94927b3ea
Bug: fix flaky timeout test (#10509) 2023-03-10 10:55:56 +01:00
NiharDoshi99
34bf175ca1
adding quotes around alias (#10506) 2023-03-10 15:18:58 +05:30
NiharDoshi99
9b0b06fe25
Added flag for overriding owners (#10425)
* added flag for overriding owners

* docs update

* adding owners in patch call

* adding owners in patch call

* fix: python test case

* changes as per comment

* changes as per comment

* ui changes
2023-03-10 15:01:56 +05:30
Ashish Gupta
4ec185ff22
UI : Added Delete toggle and restore Testsuite functionality (#10479)
* Added Delete toggle and restore testsuite functionality

* Added cypress and address comments

* fix cypress and redirect to detailsPage

* missing localization for other languages

* Worked on Cypress comments

---------

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-10 14:30:53 +05:30
Chirag Madlani
d82635e9c6
fix(ui): update recent runs instead whole page (#10501) 2023-03-10 08:28:14 +00:00
Teddy
cea10e8301
fix: handle None owner (#10497) 2023-03-10 08:12:14 +00:00
Sachin Chaurasiya
dccc139aad
feat(ui)#10271:UI - Object Storage Service Part-2 (#10419)
* feat(ui)#10271:UI - Object Storage Service

* chore: add objectStoreService in permission resource enum

* chore: add support for connection config form for object store service

* chore: add support for service connection details schema for object service

* chore: change objectStores to objectstores

* chore: add object stores in global settings

* chore: update objectstore locals

* chore: change objectStoreServices to objectstoreServices

* chore: add support for page header for object stores

* chore: fetch containers for object store service

* chore: fix connection config is not showing up for object store service

* chore: update getLinkForFqn for object store service

* fix: add object store service in delete widget modal

* chore: add object store service logo

* chore: update object store service label

* chore: fix routing of object store service

* test: add unit test for object store service

* fix: missing tags column header

* test: add unit test for global setting left panel

* test: update global setting left panel test

* chore: update svg to take the current color

* address comments

* feat(ui)#10271:UI - Object Storage Service Part-2

* chore: add support for container children

* chore: add support for data model component

* chore: add support for adding/updating description

* fix: read serviceType directly from entity

* chore: add support for follow and unFollow container

* chore: add support for update/remove owner and tier

* chore: add support for updating/removing tags of container

* fix: version is not updating in real time

* chore: add support for restoring the container

* chore: add support for lineage

* chore: add support for custom properties

* chore: add support for CRUD for custom attributes

* chore: add support for container nth level in breadcrumb

* fix: unit test

* chore: locale update

* chore: add support for updating data models

* chore: add object store service icon

* address previous PR comments

* test: add unit test

* chore: fix label issue

* chore: remove duplicate codes

* chore: add beta tag for object store service

* fix: tags source issue

* address comments
2023-03-10 07:55:24 +00:00
Milan Bariya
bc4abc44ed
Add steps in test_connection function (#10408)
* Add steps in test_connection funstion

* Add steps in test_connection funstion

* Add steps in test_connection funstion

* Fix: Pylint issue

* Status response changefor statuscode 200

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-10 10:02:26 +05:30
Pere Miquel Brull
81dec813a0
Don't store the OM connection in the Ingestion Pipeline or Workflow (#10448)
* Do not store OM connection

* Migration to remove the server connection

* Update tests

* Add workflow masking and secrets manager

* Fix failing test

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-03-09 17:32:40 +01:00
Sriharsha Chintalapani
d9e4fbdebb
Fix #10454: Improve Search Relevancy, by adding functional scoring an… (#10455)
* Fix #10454: Improve Search Relevancy, by adding functional scoring and add ngram analyzer; Fix #10452: Enable Table and Column search by BOTH name and displayName

* fix stylecheck

* Undo changes in table example names

* remove ngram from teams & users

* Fix topic tags

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf (#10430)

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Added top level parsing and unit tests

* fix(ui): show schemaText and fields both

* fix no data placeholder for fields & schema text

* addressing comments

* fixed py checkstyle

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* revert common_broker_source changes

* revert common_broker_source changes

* remove changes to user & team indexes

* fix team index

* fix glossary & tag index

* Fix to TopicIndex

* fix advance search pre-requisites cypress failure

* fix group advance search cy failures

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-09 21:37:08 +05:30
Teddy
f27266628d
update histogram sample data (#10495) 2023-03-09 15:19:57 +01:00
NiharDoshi99
ddbc0311e8
fix: mark table deleted dependencies (#10476) 2023-03-09 09:15:05 +00:00
Suresh Srinivas
4c6d184ef5
Fixes #10480 Glossary rename results in rename of Classification with… (#10486)
* Fixes #10480 Glossary rename results in rename of Classification with the same name

* Rename TagSource Tag to Classification
2023-03-09 00:30:36 -08:00
Sachin Chaurasiya
9910d0bc11
chore(ui): disable console logs for tests (#10488)
* chore(ui): disable console logs for tests

* address comment
2023-03-09 08:27:23 +00:00
Nahuel
ed884cf79a
Bug: Update sqllineage-openmetadata + add timeout for parsing queries (#10474)
* Update sqllineage-openmetadata version + add timeout

* Pyimpala fix colnames, comments and dialect sql compilation (#10470)

* Fix col names and comments for impala hive

* Fix cols, comments and impala sql compilation

* Handle hive types

* Format

* Added doc in avro array and tests (#10473)

* Fixed: Add job definition id field for dbt cloud in UI #10269 (#10472)

* fixed Add job definition id field for dbt cloud in UI #10269

* sync-localization file

* fixed failing unit test and add unit test for the changes

* Address PR comments

* Update tests

* Pylint clean

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2023-03-08 20:49:02 +01:00
Teddy
56f7ac2c2c
Fix few profiler bugs (#10465)
* fix: handle overflow in profiler + fix minor bug from new metrics

* fix: flaky test from profiler

* fix: fix code smell
2023-03-08 18:01:25 +01:00
Shailesh Parmar
325d10384f
fix: TestCase expansion to see the results not intuitive #10186 (#10475)
* fixed TestCase expansion to see the results not intuitive #10186

* missing translation key
2023-03-08 16:50:44 +00:00
Shailesh Parmar
23ad25b129
Fixed: Add job definition id field for dbt cloud in UI #10269 (#10472)
* fixed Add job definition id field for dbt cloud in UI #10269

* sync-localization file

* fixed failing unit test and add unit test for the changes
2023-03-08 15:56:37 +00:00
Onkar Ravgan
4d11db4220
Added doc in avro array and tests (#10473) 2023-03-08 20:16:50 +05:30
Pere Miquel Brull
a05e56feba
Pyimpala fix colnames, comments and dialect sql compilation (#10470)
* Fix col names and comments for impala hive

* Fix cols, comments and impala sql compilation

* Handle hive types

* Format
2023-03-08 14:13:06 +01:00
Mayur Singal
c199f13ed0
Fix #10402: Add support for AssumeRole for AWS (#10417) 2023-03-08 15:43:33 +05:30
NiharDoshi99
d41878ec90
fix: spacy model (#10467) 2023-03-08 15:19:35 +05:30
Onkar Ravgan
d4fafa3168
Downgraded conf-kafka lib (#10466) 2023-03-08 14:22:38 +05:30