3870 Commits

Author SHA1 Message Date
Chirag Madlani
11eddedf03
feat(ui): create bot support on settings page (#6711)
* feat(ui): create bot support on settings page

* support create bot & list bots

* fix failing tests

* skiping cypress for now as it need to be updated as per new ui change

* fix tests
address comments

* fix tests

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-13 18:51:02 +05:30
Abhishek Pandey
a6a7662517
dagster-connector-added (#6513)
* dagster-connector-added

* code-formatted

* dagster-comments-removed

* dagster-comments-removed

* dagster-unittest-added

* code-formatted-pr-comments-resolved

* improved-code-quality

* increased-py-test-time-out

* improved-dagster-tests

* improved-dagster-tests

* reverted-pytests-timeout

* dagster-pytest-improved

* added-schema-in-omdcore

* updated-schema-in-omd-core

* ui-schema-updated-omd-core

* updated-dagster-schema

* dagter-schema-test-updated
2022-08-13 15:18:14 +05:30
Nahuel
80ca224c39
Fix: Avoid store sensitive info in events repository using custom annotation (#6666)
* Avoid store sensitive infomation in created event when a Secrets Manager is configured

* Refactor code to start using custom annotations in the json schma deffinition

* Remove unused config object

* Add removed comment

* Add separated entity comparision for events in EntityResourceTest

* Add missing mask property in service connection schemas

* Update openmetadata-core pom.xml

* Missing import in openmetadata-core pom.xml
2022-08-12 15:56:37 -07:00
Parth Panchal
99453279c0
Sonar cloud findings fix (#6709)
* Sonar cloud findings fix

* Sonar cloud findings fix

* Sonar cloud findings fix

* Sonar cloud findings fix
2022-08-12 22:15:57 +05:30
Shailesh Parmar
a17fc68dd4
Fix issue: Logs not getting displayed in UI for Lineage Workflow #6707 (#6708) 2022-08-12 17:02:39 +05:30
Pere Miquel Brull
99f0c96df4
Fix #6278 - Lineage workflow + Usage workflow (#6568)
* Fixing conflicts

* Fixing Conflicts

* Fix snowflake

* Prepare snowflake and redshift

* snowflake use a single query

* Add bigquery

* Add clickhouse

* format

* Add query log lineage source

* Add filters to core

* Prepare mssql usage

* Update schemas

* Add example workflows

* Prepare lineage deployment

* Remove lineage

* Use filters

* Prep lineage DAG

* Prepare Lineage Ingestion

* Test lineage workflow

* format

* Comments

* fixed tests

* Revert "fixed tests"

This reverts commit 0e846c7c4806098e4adf7c071d133d1df68aedf5.

* fixed get connection method

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-08-12 13:24:58 +05:30
Teddy
58a8020abb
Fixed metadata filters added to profiler (#6698) 2022-08-12 12:08:41 +05:30
Nahuel
1f37501269
Fix#6360: Airflow 2.3.3 None schedule validation (#6688)
* Fix: Airflow 2.3.3 None schedule validation

* Add test
2022-08-12 08:33:00 +02:00
Parth Panchal
e451a9ca5f
Fixed#5400: Added Kafka Event Publisher (#6697)
* Fixed#5400: Added Kafka Event Publisher

* Fixed#5400: Added Kafka Event Publisher

* Fixed#5400: Added Kafka Event Publisher

* Fixed#5400: Added Kafka Event Publisher

* Fixed#5400: Added Kafka Event Publisher

* Fixed#5400: Added Kafka Event Publisher
2022-08-11 20:27:15 +05:30
Vj-L
3728fa635b
Added docker-compose file for postgressql (#6695)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-11 12:12:14 +05:30
Chirag Madlani
448c4b85ed
feat(ui): support slack Webhook integration on settings (#6677)
* feat(ui): support slack webhook integration on settings

* revert enum related changes

* update webhook listing with icon & list

* add glossary & tag links

* fix cypress tests

* fix cypress tests

* fix failing tests
2022-08-11 10:57:39 +05:30
Aniket Katkar
d77ab76cab
Fixed the issue for two loaders shown after reloading the page. (#6693) 2022-08-11 06:32:53 +05:30
Shailesh Parmar
27483c6756
fixed isue 6690 profiler setting modal slider showing undefined when there is no value (#6691) 2022-08-11 00:03:34 +05:30
Nahuel
66e0527a90
Fix: Profiler DAG takes loggerLevel from ingestion pipeline (#6685) 2022-08-10 17:02:16 +02:00
Sachin Chaurasiya
18d204d883
Feat : Add New roles and policy UI - Part 1 (#6651)
*  Feat : Add New roles and policy UI

* Add rules column

* Remove rules column

* Add roles detail page

* Add policy details page

* Fix table columns width

* Add roles column to policies table

* Minor change

* Addressing review comments

* Add support for add role
2022-08-10 20:28:19 +05:30
Shailesh Parmar
455c2d039e
(Feat) UI: Add Profiler Tab as per new mock (#6627)
* add initial setup and added profiler tab

* added unit test for tableprofiler component

* added more coverage for table profiler component

* added get and put request and functionality for profiler setting

* added unit test for new components

* miner fix

* added data-testid for profiler settings component

* changed input box to slider for profile sample

* updated setting model design

* replaced select with treeSelect

* added unit test for setting modal

* fixing flaky cypress related to resizeObserver loop limit

* fixed failed unit test and added selected sample profiler text

* addressing comments
2022-08-10 14:46:50 +05:30
Aniket Katkar
9eff5f1ed3
Improvement(UI): Optimised the API calls on homepage. (#6675)
* Removed unnecessary API calls on homepage for fetching different entity counts and replaced it with one util api

Removed unused API functions

Fixed failing unit tests caused by above changes

* Used async await pattern for API call function

* Rename MyAssetStats.Interface.ts to MyAssetStats.interface.ts
2022-08-10 09:26:42 +05:30
Suresh Srinivas
cbcc00bc78
Fixes #6659 Backend : Add support for roles and teams in policy (#6676) 2022-08-09 14:25:27 -07:00
Nahuel
e321008cd0
Snyk report uploaded as HTML files (#6674) 2022-08-09 21:54:08 +02:00
Onkar Ravgan
af33cc0a31
Fixed Tableau ingestion issue (#6671)
* Fixed Tableau ingestion issue

* revmoved doc string

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-08-09 23:55:32 +05:30
Akash Jain
ea2d5b8d60
Added on premise k8s documentation (#6670) 2022-08-09 10:39:08 -07:00
Nahuel
65517beb62
Fix#5919: Implementation of migration process when a Secrets Manager is configured (#6584)
* Implementation of migration process when a Secrets Manager is configured

* Update conf/openmetadata.yaml

* Address PR comments

* Minor change in SQL statment in CollectionDAO

* Address Sonar security hotspot issue
2022-08-09 16:11:57 +02:00
Vj-L
e4aa443b65
Added new workflow for postgres package (#6646)
Co-authored-by: “Vijay” <“vijay.l@deuexsolutions.com”>
2022-08-09 19:17:13 +05:30
Abhishek Pandey
4c98742e4f
datalake-doc-added (#6672) 2022-08-09 19:10:38 +05:30
Sriharsha Chintalapani
60fe344aaf
Fix #6657: Change PathParam ID type in Resources from String to UUID (#6658) 2022-08-09 05:57:39 -07:00
Aniket Katkar
ec41f7be15
Feat(UI): Added announcement filter option for activity feeds. (#6669)
* Added announcement filter option in thread filter dropdown for activity feeds

* Added alt props for icons and minor improvement in dropdownlist
2022-08-09 18:19:17 +05:30
Sachin Chaurasiya
fa98e05ee3
Fix #6667 Make UI Changes to adopt new permission API response structure (#6668)
* Fix #6667 Make UI Changes to adopt new permission API response structure

* Fix unit test

* Addressing review comment
2022-08-09 17:53:17 +05:30
Milan Bariya
c38ab8c8aa
Support for AWS-delegated credentials for Elasticsearch (#6644)
* Support for AWS-delegated credentials for Elasticsearch

* FIX: Based on comments

* FIX: Based on comments

* FIX: Based on comments
2022-08-09 12:36:16 +05:30
Nahuel
cf2cb6d531
Fix#6517: Add clusterName property to the application config yaml (#6610)
* Add cluster name in the app configuration and start using it to create secrets id

* Update secret manager client in openmetadata for using default auth provider

* Add missing property in test config file
2022-08-09 09:00:43 +02:00
dependabot[bot]
c9c99d6506
Bump url-parse in /openmetadata-ui/src/main/resources/ui (#6660)
Bumps [url-parse](https://github.com/unshiftio/url-parse) from 1.5.3 to 1.5.10.
- [Release notes](https://github.com/unshiftio/url-parse/releases)
- [Commits](https://github.com/unshiftio/url-parse/compare/1.5.3...1.5.10)

---
updated-dependencies:
- dependency-name: url-parse
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-09 11:33:07 +05:30
Sachin Chaurasiya
a9c010b03d
Fix #6635 UI : Announcement improvements (#6647)
* Fix #6635 UI : Announcement improvements

* Add unit test

* Fix unit test

* Fix announcement banner is not showing up!
2022-08-09 11:29:04 +05:30
Abhishek Pandey
77ad1b1c87
close-connection-after-each-batch-using-with (#6641) 2022-08-09 11:15:56 +05:30
Parth Panchal
555962dfd3
Added announcement channel (#6604)
* Added announcement channel

* Added announcement channel

* Addressing comments
2022-08-09 10:43:08 +05:30
dependabot[bot]
9012bf7f06
Bump minimist in /openmetadata-ui/src/main/resources/ui (#6460)
Bumps [minimist](https://github.com/substack/minimist) from 1.2.5 to 1.2.6.
- [Release notes](https://github.com/substack/minimist/releases)
- [Commits](https://github.com/substack/minimist/compare/1.2.5...1.2.6)

---
updated-dependencies:
- dependency-name: minimist
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-08-09 10:28:06 +05:30
Suresh Srinivas
e820c60c8d
6631 (#6632)
* Fixes #6554 Add support for team of type Group

* Fixes #6631 Add support for new permissions API

* Rework the code to fix test failures
2022-08-08 15:25:44 -07:00
Nahuel
986480af7c
Fix DatabaseServiceType enum in JSON schema definition (#6642) 2022-08-08 21:57:59 +02:00
Abhishek Pandey
a08201e383
multiple-database-service-names-added-in-dashboard (#6591)
* multiple-database-service-names-added-in-dashboard

* code-formatted

* code-smell-removed

* code-formatted

* improved-dbserviceName-handling-in-dashboard

* fix checks failing

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-08-08 22:21:28 +05:30
Sriharsha Chintalapani
d18d1c548e
Fix readme images (#6629)
Co-authored-by: Sriharsha Chintalapani <harsha@Sriharshas-MacBook-Air.local>
2022-08-08 08:51:38 -07:00
Mayur Singal
997486f1bb
Fix #6540: Added Exception handling in metadata_rest (#6650)
* Added Exception handling in metadata_rest

* Added HTTPException
2022-08-08 20:25:31 +05:30
Chirag Madlani
49bc322824
major(ui): update package version for security (bump axios & moment) (#6468)
* fix(ui): update package version for security

* update axios package to 22

* fix type issues

* fix type errors

* fix tests

* address comments

* fix tests

* fix failing tests

* fix type error

* skip tests for now

* fixing count bug

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-08-08 18:29:05 +05:30
Sachin Chaurasiya
e34721d343
Fix #6637 UI : Change Manage Button UI According to the mock (#6640)
* Fix #6637UI : Change Manage Button UI According to the mock

* Update styling and icons

* Addressing review comment
2022-08-08 14:41:24 +05:30
Ayush Shah
9fc230734a
Fix Broken Link - Pull request template (#6639) 2022-08-08 12:07:30 +05:30
Ayush Shah
a6db2e8a84
Fix for profiler: modified filter patterns and added error handling (#6608) 2022-08-08 10:43:17 +05:30
Sriharsha Chintalapani
a65998c7bc
Fix readme images (#6628)
Co-authored-by: Sriharsha Chintalapani <harsha@Sriharshas-MacBook-Air.local>
2022-08-07 11:16:14 -07:00
Ramesh
38ca3ce4e3
6623:High Level Design documentation has starting paragraph has a typo (#6625)
Signed-off-by: Ramesh Mani <ramesh.mani@gmail.com>
2022-08-07 00:27:06 -07:00
Suresh Srinivas
f8edbafccf
Sonar flagged issues clean up (#6622) 2022-08-06 12:50:23 -07:00
Suresh Srinivas
a6ecef3464
Fixes #6613 - Change tests to send minimum owner information (#6614)
* Fixes #6613 - Change tests to send minimum owner information

* Fixing test failures
2022-08-06 12:20:33 -07:00
Sachin Chaurasiya
4bd295ff6e
Feat : UI Add support for editing post messages (#6619)
*  Feat : UI Add support for editing post messages

* Support key binding

* Add unit test

* Disable Save button if message is empty

* Add unit test

* Add unit test for manage button

* Add unit test

* Minor change

* Add constant for invalid start time

* Fix cypress test

* Fix Cypress test

* Fix  Edit and validate owner test
2022-08-06 23:30:47 +05:30
Vivek Ratnavel Subramanian
e9d566e497
Fix #6587 Backend: Announcement start and end time should not clash with another announcement (#6618) 2022-08-06 21:45:56 +05:30
Sachin Chaurasiya
92ea12dd29
Fix #5837 user profile pic should be displayed wherever we are showing the username (#6580)
* Fix #5837  user profile pic should be displayed wherever we are showing the username

* Fix unit test

* Addressing review comment

* Fix explore card description.

* Fix unit test

* revert css change

* Fix unit test

* Fix unit test

* Addressing review comment
2022-08-06 14:23:48 +05:30