49 Commits

Author SHA1 Message Date
Sriharsha Chintalapani
cf3d4314dd
Fix #1607 Operational metrics for OpenMetadata system observability (#4386)
Co-authored-by: Akash-Jain <Akash.J@deuexsolutions.com>
2022-05-27 15:39:13 +05:30
Nahuel
628296d294
Fix #2725: Add IngestionPipeline Task logs (#5152) 2022-05-26 10:08:56 -07:00
Suresh Srinivas
c939360d1b
Upgrade dependencies (#5079) 2022-05-20 15:05:10 -07:00
Suresh Srinivas
0ba22c1d2f
Fixes #4977 Add APIs for adding custom fields to an existing entity (#4978) 2022-05-16 15:26:20 -07:00
Sriharsha Chintalapani
06b062c1f4
Fix #4983: Fix build issues for rpm and mvn test (#4985) 2022-05-16 14:40:50 -07:00
Suresh Srinivas
6ce528d70a
Fixes #4921 Add support for type system (#4922) 2022-05-14 10:57:19 -07:00
Suresh Srinivas
9138b85913
Fixes #4720 Upgrade dependency version of OpenMetadata for 0.10.1 (#4721) 2022-05-05 14:11:45 -07:00
mosiac1
c6e8181fa9
Add postgres support (#3952)
* Add postgres support

* Add testing for postgresql databases

Split surefire tests into: unit-tests, postgres-integration-tests, mysql-integration-tests
Integration tests get db information from system properties
All tests ending in ResourceTests.java are integration tests, all other are unit tests
Move to using testscointainers, remove embeded mysql

* Fix some tests

* Fix webhook and table tests

* Fix random name generation in tests, remove parallelism

* Fix style

* Add headers, fix config files

* Apply formatting

* Fix tag ussage query for postgres

* Replace references to mysql with generic database

* Fix postgres migration file

* Fix postgres migration script
2022-04-27 10:58:44 -07:00
Akash Jain
55e1be9ca4
feat: Prepare 0.11.0-snapshot version changes (#4505)
* updated version to 0.11.0-SNAPSHOT

* updated version to 0.11.0.dev* for ingestion

* docker version updates for metadata docker cli

* OM Server Env Variables from #4197 #4261 #4473
2022-04-27 00:41:17 +05:30
Vivek Ratnavel Subramanian
d6914c4922
Fix #4090: Backend: Capture Activity Feed for Hard Delete Operation (#4343)
* Fix #4090: Backend: Capture Activity Feed for Hard Delete Operation

* Address review comments and fix a bunch of issues

* Fix UT failures

* Fix UT failures
2022-04-22 15:14:16 -07:00
Akash Jain
540f5ca3b5
Fix: Prepare 0.10.0 snapshot (#4190)
* update pom versions to 0.10.0-SNAPSHOT

* fix version to latest release 0.9.1

* fix ingestion core version to 0.10.0
2022-04-19 17:40:42 +05:30
Suresh Srinivas
9f2ca9944f
Update the dependencies for 0.10 release (#4176) 2022-04-18 11:41:23 -07:00
Sriharsha Chintalapani
06cc35d048
Fix #4082: Do not start slack event publisher if there is no config (#4083) 2022-04-12 17:25:23 -07:00
Alberto Miorin
4a66d1c6f5
Use antlr4 for FQN instead of regex. (#4066) 2022-04-12 11:40:00 -07:00
Snyk bot
3c2ded2974
fix: catalog-rest-service/pom.xml & pom.xml to reduce vulnerabilities (#3544) 2022-03-21 10:13:49 -07:00
Akash Jain
211a8a55e8
feat: Prepare 0.9.1-SNAPSHOT (#3297)
* prepare snapshot version for 0.9.1

* prepare dev version for ingestion 0.9.1

* prepare dev version for ingestion-core 0.9.1

* prepare Docker CI workflows for 0.9.1
2022-03-09 12:08:42 +05:30
Suresh Srinivas
79589e31ad
Fixes #3125 Upgrade dependencies to address security vulnerabilities (#3132) 2022-03-03 20:06:04 -08:00
Vivek Ratnavel Subramanian
68d09a85cd
Fix #2834: Merge the change events 'delete' and 'add' as 'update' for Activity Feed (#3006) 2022-02-27 12:01:35 -08:00
Suresh Srinivas
aa64b8c990
Fixes #2841 - Upgrade maven dependencies for release 0.9 (#2842) 2022-02-17 23:37:50 -08:00
Alberto Miorin
0e73de4658
See #2486. Implement encryption at rest (#2488)
* See #2486. Add fernet Java library to encrypt DatabaseService.DatabaseConnection.password

* Add support for rotation.

* Add support for CLI to rotate the key.

* The fernet key can be null. No encryption will be done.

* Add FernetConfiguration

* Add env variable for Fernet.

* Convert base64 to base64url

* Decrypt (admin or bot) or nullify tokens for all methods including ListVersions and GetVersion

* Fix test with owner USER to handle null in DatabaseConnection
2022-02-08 09:50:39 +01:00
Sriharsha Chintalapani
546c92d9a6
Fix #2530: CVE-2021-22569 com.google.protobuf:protobuf-java, Fix #2529: CVE-2017-18640 snakeyaml: Billion laughs attack via alias feature (#2642) 2022-02-06 14:42:14 -08:00
Akash Jain
20309cde64
fix:cherry pick from 0.8.0 and miscellaneous fixes (#2445)
* updating ingestion-core version to 0.8.0

* updating ingestion version to 0.8.0

* fixing file copy path

* update docker images to point to 0.8.0

* set up new release version

* reset ingestion version to 0.9.0.dev0

* reset ingestion-core version to 0.9.0
2022-01-26 14:00:27 +05:30
Matt
ed797dc335
Remove unused Guice (#2120) 2022-01-09 21:03:50 -08:00
Suresh Srinivas
36d518fa2d
Fixes #2010 - Upgrade dependencies for version 0.8 (#2026) 2022-01-04 09:21:48 -08:00
Pere Miquel Brull
256c25934b
[issue - 1894] - Run sonar during install (#1918)
* Run sonar during install

* Add exclusions

* Remove exclusions

* Remove activation

* Update CI for PR and Push

* Activate profile

* debug environment

* debug environment

* debug environment

* Add SCA to active profiles

* Remove profile from CI

* Activate SCA by default

* Use mvn install

* Update PR source branch
2021-12-30 08:31:25 -08:00
Matt
b8d7e2bd11
Implement PolicyEvaluator for #1940 (#1939)
- Add security.policyevaluator module with PolicyEvaluator based on jeasy-rules
- Add MetadataOperation type
- Change accessControl/rule schema to support ABAC based on 3 attributes - entityTag, entityType, userRole
- Update CatalogAuthorizer interface to have hasPermissions function for MetadataOperation
2021-12-29 11:36:18 -08:00
Sriharsha Chintalapani
bb847bc004
Revert "Use defaults of google java format action (#1845)" (#1912)
This reverts commit 782209ead58f4cd82882872e9f8f40779d8b6e54.
2021-12-23 19:22:47 -08:00
Suresh Srinivas
5892595b1f
Fixes #1900 - Initial implementation of webhook API (#1905)
Co-authored-by: Suresh Srinivas <sureshsrinivas@Suresh-Collate.local>
2021-12-23 11:26:00 -08:00
Alberto Miorin
782209ead5
Use defaults of google java format action (#1845)
* Use defaults of google java format action

* Fix the first Java file

* Add lint-staged

* Remove husky
2021-12-21 17:51:18 +01:00
Sriharsha Chintalapani
7111267669
Update version to 0.8 and ingestion to 0.6 (#1859) 2021-12-20 22:02:59 -08:00
Matt
f4c3947fc5
Add googleformatter to auto-format Java classes (#1705) 2021-12-16 16:13:50 +01:00
Alberto Miorin
ad4f492929
Fix #1402: Swagger.json has an old version (#1609) 2021-12-07 21:35:40 +01:00
darth-coder00
2ba99faa7d
Fix: Moved mvn copy-plugin from pom of catalog-rest-service to pom of openmetadata-ui (#1367) 2021-11-24 19:31:39 +05:30
Sriharsha Chintalapani
a180adc39c
Fix #1299: Move UI module into its own maven module (#1351)
* Fix #1299: Move UI module into its own maven module

* Fix #1299: fix indentation in selenium tests

* Fix #1299: fix indentation in selenium tests

* Fix #1299: fix indentation in selenium tests

* Fix: Updated json2ts command script

* Removed ignored file for bundle analyzer

* Updated gitignore

* Cleaning up the gitignore

Co-authored-by: darth-coder00 <aashit@getcollate.io>
2021-11-24 13:18:54 +05:30
Suresh Srinivas
0415983120
Fixes #1234 Upgrade project dependencies to the latest versions (#1235)
* Fixes #1234 Upgrade project dependencies to the latest versions

* Add libssl to github maven workflow

Co-authored-by: sureshms <suresh@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2021-11-17 11:24:19 -08:00
parthp2107
052ba5bad5
frequently joined columns fix (#1209)
* frequently joined columns fix

* addressing reviewdog finding

* removing ingestion switch code

* adding retry for failing tests

* removing failed test repeats

* changing joined table tests
2021-11-17 14:47:05 +05:30
Sriharsha Chintalapani
9dee0e4e5c
update version to 0.7.0-SNAPSHOT (#1196) 2021-11-15 19:03:32 -08:00
Sriharsha Chintalapani
58460f3f2b
Fix #1034: workflow/bot operations API (#1053)
* [WIP] workflow/bot operations API

* workflow/bot operations API

* workflow/bot operations API- Fix tests

* workflow/bot operations API- Fix styling issues

* workflow/bot operations API- Fix styling issues

* workflow/bot operations API- Add list runs api

* workflow/bot operations API - Fix styling issues; address reviews

* workflow/bot operations API - Fix styling issues; address reviews

* workflow/bot operations API - Fix styling issues; address reviews
2021-11-09 20:56:45 -08:00
sureshms
1f8b7a99c6 Remove jdbi2 dependency 2021-10-22 13:30:40 -07:00
sureshms
aec36fe664 Table entity migrated to jdbi3 2021-10-22 13:30:38 -07:00
parthp2107
27838b11cb
added selenium tests (#882)
* added selenium tests

* logout test fix

* addressing javastyle check error

* addressig checkstyle error

* addressing py-checkstyle findings

* addressing py-checkstyle findings

* reverting pom.xml url change

* addressing comments

* addressing comments
2021-10-22 12:10:55 +05:30
Sriharsha Chintalapani
4c647a3887
Set version to 0.6.0-SNAPSHOT (#764) 2021-10-14 07:47:00 -07:00
Sriharsha Chintalapani
4af4a66bee
Set version to 0.5.0-SNAPSHOT (#500) 2021-09-15 22:26:26 -07:00
Suresh Srinivas
dc7e05dd74 Ingestion: Add Confluent Kafka topic and schema connector 2021-08-21 13:16:40 -07:00
Sanket Shah
7a8612f987
Updating readme (#209)
* Updating readme

* updating text
2021-08-17 00:22:25 +05:30
Suresh Srinivas
7f8d6620ee
update swagger contact (#199)
Co-authored-by: Suresh Srinivas <srini3005@gmail.com>
2021-08-16 19:13:08 +05:30
Suresh Srinivas
e5a1ff6d17 Update version to 0.4.0-SNAPSHOT 2021-08-13 01:26:27 -07:00
sureshms
5ca728e8f8 Improve API documentation 2021-08-02 14:21:59 -07:00
sureshms
8ce7c879e8 OpenMetadata snapshot release 0.3 2021-08-01 14:27:44 -07:00