7194 Commits

Author SHA1 Message Date
Mayur Singal
18c8eb318e
Databricks Support Table Constraints (#12138)
* Databricks Support Table Constraints

* pylint fix

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-06-26 07:01:53 +02:00
Pere Miquel Brull
e13a5de5ae
Fix #12083 - Backoff retry when polling for pipeline service client status (#12105)
* Fix #12083

* Fix #12083

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-06-26 06:52:21 +02:00
Mayur Singal
7d1b123efe
Fix atlas lineage custom db name issue (#12108)
* Fix atlas lineage custom db name issue

* Fix test
2023-06-25 19:16:00 -07:00
Sriharsha Chintalapani
0e6d8e1ea0
Docs: add proxy_pass setting for nginx (#12035) 2023-06-25 19:15:20 -07:00
Teddy
efec8a1019
fix: hash name of test suite + append (#12125)
* fix: hash name of test suite + append

* fix: ran java linting

---------

Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2023-06-25 19:14:34 -07:00
Anuj359
a243b78dd8
Global k8s values docs (#12089)
* Create manual.yml

* Fixing Typo

* Removing manual test github action file

* Testing IP runner

* Updating the k8s-values for docs

* Delete ip-test-runner.yml
2023-06-25 10:49:21 -07:00
Esmaeil Chitgar
c8b3efa205
Remove duplicated line in OpenMetadata-service pom.xml (#12134)
Remove duplicated line in OpenMetadata-service pom.xml.<sonar.tests>${project.basedir}/src/test/java</sonar.tests>
2023-06-25 10:36:15 -07:00
Onkar Ravgan
3a9d8a9a45
powerbi loop bug fix (#12120) 2023-06-25 18:20:59 +02:00
Shailesh Parmar
64e4bffcc2
ui: worked on DQ feedback part 2 (#12140)
* ui: worked on DQ feedback part 2

* addressed the review comments
2023-06-25 21:41:15 +05:30
Pere Miquel Brull
d0bc44127e
Set logger level for ingestion-base (#12137)
* Set logger level for ingestion-base

* Set logger level for ingestion-base
2023-06-25 08:20:46 -07:00
Pere Miquel Brull
97e08ee25c
Fix #12106 - Fix looker chart sourceUrl & Array datatype handling (#12113)
* Fix looker chart url

* Handle array datatype

* Handle array datatype
2023-06-25 08:18:36 -07:00
Aniket Katkar
67ffa1cce3
fix(UI): reverted the ES config step for 'Data Insights Pipeline' (#12121)
* Reverted the ES config step for Data Insights pipeline

* es sink fixes for ingestion

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-06-24 18:15:51 +05:30
karanh37
9fcaaaf2c6
fix: address feedbacks of explore lineage (#12123)
* fix: feedbacks

* fix: color feedbacks

* fix: query page resizable panel update

* fix: task feed card feedbacks

* fix: unit tests

* fix: spacing issue

* address comments

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-06-24 17:24:40 +05:30
Ashish Gupta
c35d326933
fix(ui): ui improvement for tags and placeholder icon (#12119)
* ui improvement for tags and placeholder icon

* change add and permission icon

* fix unit tests
show open tasks on feedwidget

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-06-24 15:17:01 +05:30
Ashish Gupta
c71757cbff
feat(ui) #11344: supported mutually exclusive updating functionality to classification from ui (#12118)
* supported  mutually exclusive updating functionality to classification from ui

* fix cypress issue

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-06-24 08:16:12 +00:00
Aniket Katkar
5f349193a7
refactor(UI): version page changes (#11947)
* Fixed version page bugs for table, container, dataModel
Updated version page details with newly implemented data

* updated the comment position to explain the added key prop

* Refactored code for version pages to eliminate repetitions

* localization changes for other languages

* Version page changes for glossary and glossary terms

* Fixed glossary version page bugs

* changes to add custom property tab in version pages

* bug fixes and improvements in existing version pages

* fixed failing unit tests

* code improvements for version pages

* Fixed code smells and redirection link

* added changes to include column constraints into version page

* Added changes to show version changes for name and display names

* addressed comments for table scroll value

* changes to remove TabsPane component with items

* Fixed version pages to match revised layouts

* Made changes for newly added glossary tags section on version pages

* removed task actions showing on version pages

* fixed failing unit test

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-06-24 11:32:17 +05:30
Sachin Chaurasiya
9f148031f5
fix(ui): tour page (#12122)
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-06-23 22:03:26 -07:00
Shailesh Parmar
9c2d21d496
cypress: fixed failing cypress tests of main (#12126)
* cypress: fixed failing cypress test in main

* fixed delete and restore not working in other than table assets
2023-06-23 16:12:05 +00:00
Chirag Madlani
881a63e5b4
fix(ui): update details on task resolve (#12117) 2023-06-23 18:50:35 +05:30
Shailesh Parmar
1116d98703
ui: data quality feedback part 1 (#12116)
* ui: worked on feedbacks of data-quality ui revamp, part-1

* translation sync

* fixed alignment issue

* fixed failing unit test, and updated data quality tab name to profiler and data quality
2023-06-23 17:47:00 +05:30
karanh37
5e2866dd1b
feat: show all entities related to user (#12112)
* feat: show all entities related to user

* fix: layout issues

* fix: review comments
2023-06-23 15:22:26 +05:30
Ashish Gupta
eeec58bced
fix(ui): supported hierarchy in table tags for term and tags (#12099)
* supported hierarachy in table tags for term and tags

* remove unwanted code

* fix cypress issue
2023-06-23 14:52:19 +05:30
Onkar Ravgan
d9d3f6895b
Fix 6874: Added Support for lineage from dbt ephemeral nodes (#12101)
* fixed dbt ephemeral nodes lin

* fixed dbt tests
2023-06-23 10:01:22 +02:00
Mayur Singal
258a2e33e2
Fix #12078: Add clientSessionKeepAlive Field for snowflake (#12107) 2023-06-23 10:00:53 +02:00
Pere Miquel Brull
b5c4d5a9d3
Fix #10175 - Add Oracle lineage and usage (#12090)
* Add Oracle lineage and usage

* Add docs

* Add examples
2023-06-23 06:52:34 +02:00
Teddy
6f33465b7c
fix: move service retrival to workflow (#12109) 2023-06-23 06:40:32 +02:00
Shailesh Parmar
525180c0e2
revamp(ui): data quality revamp (#12086)
* chore(ui): revamp table details page
Re-design table details header with schema tab

* misc fixes for ui and tests

* update

* fix edit description

* chore(ui): update the app left panel icons

* chore(ui): update left panel icon stroke color

* fix: explore page layout change

* fix: highlight issues

* updated right panel for explore page

* fix: explore layout changes

* separate out header component

* added activity feed tab

* fix: highlight issue

* fix: highlight card for explore page

* support all widget
fix spacing issue

* fix: show reactions

* fix: update reactions for tasks tab

* fix: make use of appstate to avoid repetitive calls

* fix activity feed layout

* fix: landing page and explore feedbacks

* fix: missing localization

* update activityFeedProvider with drawer

* fix description v1 component icons

* fix: update styles

* minor fix on icons and entity table

* Revamp Tag UI for TableDetailPage

* fix: update css

* Remove color in TagV1 component and minor file improvement

* added frequantly joint table basic structure

* fix: update kpi chart styles

* supported request tags in table detail page

* fix request description redirect issue

* fix: update styles for my data page

* added scroll to frequently joint table

* removing unnaccessary code

* fix: explore page feedbacks

* fix: explore feedbacks

* fixed signup page issue

* chore(ui): only apply the text transform on heading

* chore(ui): update table header styling

* chore(ui): update table text color and border radius

* fix: explore quick filters

* update header for topic and dashboard

* chore: update table body styling

* supported glossary term hierarchy

* updating spacing for all the page

* chore(ui): update descriptionV1 component styling

* chore: update add-chat viewbox

* fix: left sidebar console errors

* update all the entity headers

* chore: update table name to name

* update description component

* clear console errors

* revamp entity topbar manage area

* fix: entity popover similar to explore card

* updated navbar as per new UI mock

* fix: feedbacks

* updated announcement style as per mock

* fix: explore feedbacks

* implemented single box shadow wherever its needed and worked on feedback

* worked on feedbacks

* update feed tab on activityFeedTab component

* updated glossary card, no owner icon

* fix glossary hierarchy issue of repeating same glossary

* fix: update resizable panel pages

* updated navbar, align profiler picture in navbar with other element

* fix: remove page layout component

* fix: add missing layout in rule pages

* fix: jest tests

* fix: jest tests

* replace old activity feed component with new one

* fix: jest unit tests

* initial DQ page setup

* translation sync

* fix: unit tests

* supported subtab route for entities pages

* fix: feedbacks

* fix: update tasks pages

* supported api for activity feeds for entity

* added tabs component in entity table component

* worked on test-suite tab

* added quality page path in left bar

* added action button for test suite

* updated redirect path for data-quality

* revert to old re-direction for add-test suite

* update activity feed task tab

* hide action for activity feed tab

* fix: task action issue on descriptionV1

* supported new ui for data modal detail page

* fix: feedbacks

* fix: add missing localization

* fix: breadcrumbs

* data quality feedbacks

* fix: feedbacks

* fix: add missing localization

* fix: feedbacks

* supported activity feed in container and tags of all entities

* update task relates changes

* remove inline css for entity tag component

* feat: update blue as primary color

* feat: update svgs to use new primary color

* updated DQ page with feedback, and add quality page flow change

* translation-sync

* fix assignee for tasks

* updated api data for test suite pipeline creation

* fix: primary color changes

* fix: feedbacks

* fix count issues

* fix scrolling issue for activity feed

* address feedbacks

* combine open task with heading buttons

* data quality changes

* fix close with comment

* removed delete functionality

* clear CLI error, and changes as per JSON schema

* update scroll issue on details page

* added new badge, and api integration

* chore: update data quality tab page styling

* cleanup

* fix settings page scroll issue

* fix scroll issue on service page

* chore: update summary cards

* update graph color

* DQ test case test as per mock

* support edit and suggest

* integrated API for status update

* translation sync

* fix cypress tests

* integrated API call for test summary

* mydata and following page change in user profile page

* fix tag cypress tests

* updated success % via api data for test suite

* fix user component unit test

* integrated API for test summary

* updated data quality tab as per new mock

* revert commented code fir testcaseForm.tsx

* fix cypress tests

* change user page activity feed with new ui

* chore: fix console errors related to activity feed tab component

* chore: update setting button style

* chore: fix spacing

* added pipeline tab

* chore: update the colum profiler table

* fix: test indicator styling

* fetch test suite details

* fix: lineage redesign

* fix: missing localization

* chore: add support for showing single column profile in page itself

* chore: add column dropdown for column profiler

* fix cypress for entity tags add and remove

* supported more parameter in entity dashboard header

* chore: add default tab for data quality

* removed unneccessary code, and updated testsuite details page with new style

* fixed DQ test

* translation sync

* fix cypress

* added functionality to link test case with logical test suite

* chore: remove fixed right from status column in column profile tab

* fix: purple color issues

* added remove test suite functionality

* fix the count issue in user profile page and breaking of task page

* chore: delete unused files

* fix: feedbacks

* fix: feedbacks

* chore(ui): add data type in column dropdown

* added testcase form for testsuite form.

* ui improvements

* updated pipeline tab in entity details page

* fix cypress for owner and tier

* change announcement card color and deleted old assest to it

* remove old activity feed files

* fix unit test

* fixed add test case flow, added dynamic name of test case

* fix various cypress

* fix cypress failues

* integrated search experiacne for testCases

* feedback part 1

* chore: update column detail

* feedback part 2

* feedback part 3

* chore: show graph on test case right panel

* chore: add back option to column profile

* feedback part 4

* remove star around search for test suite

* removed old component of test suite, and updated code

* clean CLI

* fixed failing test, hide operation graph for not supported service type

* fixed failing unit test

* fixed graph count issue.

* updated ES test case response as per new update

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Ashish Gupta <ashish@getcollate.io>
2023-06-23 10:07:31 +05:30
Shailesh Parmar
3ef5568ac0
fixed: Dashboard services UI error #12003 (#12098)
* fixed: Dashboard services UI error #12003

* fetch count for data modal tab
2023-06-23 09:32:53 +05:30
MihirR123
0ceb856aeb
Fix sonar issues for static variable names (#12111)
Co-authored-by: Mihir Rao <mihir@MacBook-Pro-76.local>
2023-06-22 20:32:49 -07:00
karanh37
35ed33af5f
feat(ui): lineage - allow pipelines to be added for table to topic and vice versa (#12088)
* fix: show columns button should only be visible for too many columns

* fix: allow pipeline edge for topic

* fix: lineage feedbacks

* fix: lineage feedbacks

* fix: review comments
2023-06-22 22:59:36 +05:30
Chirag Madlani
d01eddc175
fix ui feedbacks (#12071)
* fix ui feedbacks

* clean unwanted code

* update beta tags

* fix unit tests

* fix unit tests

* fix unit tests

* fix bugs and address comments
2023-06-22 22:59:22 +05:30
Teddy
712dcf8587
fix: added field to testCase entity to list all Test Suites (#12093)
* fix: added  field to testCase entity to list all the linked test suites (executable and logical)

* fix: resolved conflicts from main

* fix: removed unecessary comment
2023-06-22 18:00:19 +02:00
Sachin Chaurasiya
b72cd03926
chore(ui): allow parenthesis in entity name (#12097)
* chore(ui): allow parenthesis in entity name

* fix: unit test
2023-06-22 20:27:49 +05:30
Pere Miquel Brull
152270f459
[Docs] - Update Roadmap 1.0.0 dir (#12104) 2023-06-22 16:04:51 +02:00
07Himank
3e3bd79f89
added search for test case index (#12100)
* added search test case index

* checkstyle
2023-06-22 19:14:32 +05:30
Pere Miquel Brull
75030c909d
Update roadmap date (#12102) 2023-06-22 15:41:52 +02:00
07Himank
9355c0677d
Open search elastic search client task (#11879)
* Added diffrent clients for elasticSearch and openSearch and did the interface implementation

* removed some comments and some changes

* Add Elastic Search Test Container

* upgarded es version

* added test cases for elastic search

* added test case for, when tag is deleted cehck its relationships also get deleted

* changed package of open,elastic to openSearch and elasticSearch

* added support for skip search test case if index is not present of that entity

* Refactor bunch of files

* unnecessary semicolon

* refactor test case indexing

* fix checkstyle

* checkstyle

* added hardcoded configs and changed package name

* fixed no response from hits

* stopped elasticsearch container and some fixes

* closed elasticsearch container

* revert

* closed client after used in test

* style

* edit es config in junit

* checking if using already es version release memory for maven ci

* revert docker file changes

* remove es container for testing the ci

* commented out all test cases for elasticsearch

* fix

* creating elastic search with reusable enabled

* trying to fix ci error

* start container only if it is not running

* revert docker changes and done changes for elastic search container

* changed var name of sort_order for es

* lower the version of es client

* fixes

* all latest version of es including docker

* Use Single sort order

* Fix Keyword issue

* Immediate refresh policy for entity created

* increase sleep time

* disable test

* added reindexing logic in run_local_docker.sh

* enabled test case

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2023-06-22 16:55:05 +05:30
Sachin Chaurasiya
a095323a17
chore(ui): update json form advanced config styling (#12045) 2023-06-22 15:22:28 +05:30
Onkar Ravgan
23b153991b
fixed mysqlclient dep (#12087) 2023-06-22 15:18:39 +05:30
Sachin Chaurasiya
c60d8b5899
fix(ui): airflow cypress test (#12084)
* fix(ui): airflow cypress test

* remove highlighting check for airflow service
2023-06-22 15:11:45 +05:30
mohitdeuex
a9a830a93a Fix failine reindexing issue 2023-06-22 14:26:46 +05:30
Ayush Shah
cb6e42941a
Fix 12025: Clickhouse NaN issue (#12079) 2023-06-22 12:51:56 +05:30
Aniket Katkar
159b5f131f
fix#11003: added show deleted switch for required pages (#12073)
* Added show deleted switch in the required pages

* fixed entity details page bug for soft deleted entities

* replaced tailwind styling and added data-testids

* fixed failing cypress tests
2023-06-22 11:22:39 +05:30
Ashish Gupta
10ba297961
fix(ui):supported separate tags for glossary and tags (#12068)
* supported separate tags for glossary and tags

* fix cypress issue

* fix cypress issue
2023-06-22 11:22:03 +05:30
Onkar Ravgan
5197682921
Fixed dagster bugs and Added Pydantic Models (#12048) 2023-06-22 10:59:09 +05:30
Onkar Ravgan
78d7faf04a
Added Azure Blob Storage to dbt config (#11839) 2023-06-22 10:58:38 +05:30
Pere Miquel Brull
3b8e5e69fd
Fix #12056 - Clean verbose debug logs (#12060)
* Clean verbose debug logs

* Format

* Remove unnecessary test

* remove verbosity
2023-06-22 06:54:09 +02:00
Pere Miquel Brull
520d5e2657
Add Pipeline Service Status Job to publish to Prometheus (#12046)
* Add Pipeline Service Status Job to publish to Prometheus

* Add Pipeline Service Status Job to publish to Prometheus

* Add config for health check interval
2023-06-22 06:53:56 +02:00
Teddy
1e86b6533c
Fixes #11743 - Remove SQLParse dependency for System Metrics (#12072)
* fix: removed sqlparse dependency for system metrics

* fix: update sample query

* fix: move system test os retrieval to `.get()`

* fix: move os.environ to `get`
2023-06-22 06:51:24 +02:00
Teddy
6e92dc6938
Fixes #12069 - Test Case Summary for testSuite endpoint return 0 (#12076) 2023-06-21 20:53:18 +02:00