2511 Commits

Author SHA1 Message Date
Suresh Srinivas
5a8e2ee31f
Issue2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key (#2195)
* Add support for webhook secret key

* Fixes #2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key

* Fixes #2194 - Added support for upgrading existing metadata to move dateTime attributes to timestamp
2022-01-13 12:08:42 -08:00
Alberto Miorin
e0423ac16a
Fix #2036: Support for getting deleted entities in GET and LIST operations (#2126)
* Create the first failing test.

* Find deleted location.

* Support getService for a deleted location

* Add getByName for Location

* Add test for list

* Add list of Location

* Refactor getService

* Replace the Java Enum with a JSON type

* Fix null pointer exception in getService when the relationship is recovered while the entity is still deleted.

* Simplify the logic using Include.ALL. Implemented Table.

* Add test for Table deleted and Location non-deleted

* Fix small comment

* Implement add Follower delete Entity.

* Add chart and check container

* Add dashboard

* Add database

* Add mlmodel

* Add pipeline

* Add policy

* Add dashboard

* Add databaseService

* Add messaginservice

* Add pipelineService

* Add storageService

* Add role

* Add team

* Add topic

* Add ingestion

* Fix getFollowers NPE

* Disable Webhook tests for Include

* Disable User tests for Include

* Instead of passing Include.ALL, we pass the flag based on the deleted state of entity.

* 1st clean up of 'deleted = false'

* 2nd clean up of 'deleted = false'

* Delete useless return statement.

* Remove duplicated code

* Remove duplicated code in tests

* Remove duplicated code in EntityDAO

* Fix UserDAO and remove duplicated code in EntityRepository and EntityDAO

* Remove Include.NON_DELETED when possible.

* Rebase and fix the formatting
2022-01-13 18:35:31 +01:00
parthp2107
8e19756764
added test for multiple tags (#2196)
* added tests for multiple tags

* minor changes

* addressing style-check
2022-01-13 20:44:34 +05:30
darth-coder00
b29fdd3ccc
Enhanced Tour feature (#2082)
* Enhanced Tour feature

* Fix: #2182 - Tour steps getting skipped

* Fix: #2180 - Stat links deactivated on browser back from Tour route

* Addressing comments

* Addressing comments

* Adding license
2022-01-13 20:43:07 +05:30
darth-coder00
ad362a31fd
Fixed Search filter issues (#2197) 2022-01-13 19:43:32 +05:30
codingwithabhi
5714c4122b
Move sql queries (#2183)
* sql-queries-moved-separate-file

* sql-queries-moved-separate-file

* redshift-and-neo4j-queries-added

* redshift-and-neo4j-queries-added

* neo4j-query-imported

* code-formatted

Co-authored-by: = <=>
2022-01-13 14:16:54 +05:30
Akash Jain
00ccd612ee
fix: Ingestion Core CI to Publish PyPi packages (#2187)
* Remove gitignore on _versions.py

CI commits and pushes the new version in _versions.py and since the folder is marked under gitignore, CI fails to commit and push changes to the branch.

* bump version to 0.8.0.dev0 as already published
2022-01-13 12:40:47 +05:30
Sriharsha Chintalapani
c4d7c76198
Event publishers to ElasticSearch and Slack (#2118)
* ElasticSearch & Slack Event publishers

* Fix #2165: Support for deleted entities in ElasticSearch
2022-01-12 16:35:27 -08:00
Sriharsha Chintalapani
f9a58b418a
DefaultAuthorizer should update the existing users and make them admin/bot based on config (#2173) 2022-01-11 23:37:13 -08:00
Suresh Srinivas
a2b98db7f2
Fixes #2068 Tag duplication (#2170)
* Restore deleted entity on PATCH requests

* Add support for deleting edge in lineage

* Fixes #2068 Tag duplication
2022-01-11 17:59:22 -08:00
Matt
f323afe0cd
Support role ingestion from sample data (#2167) 2022-01-11 16:51:18 -08:00
Sriharsha Chintalapani
80cc907224
Fix #2168: Fix bootstrap_storage to parse env variables in the server config (#2169)
* Fix #2168: Fix bootstrap_storage to parse env variables in the server config
2022-01-11 16:47:11 -08:00
Suresh Srinivas
4fc9db8847
Issue2147 - Add support for deleting edge in lineage (#2164)
* Restore deleted entity on PATCH requests

* Add support for deleting edge in lineage
2022-01-11 13:45:39 -08:00
Sriharsha Chintalapani
7b24e31973
Fix #2143: Allow environment variables to be substituted in OpenMetadata config (#2146)
* Fix #2143: Allow environment variables to be substituted in OpenMetadata config
2022-01-11 10:13:49 -08:00
darth-coder00
5fa0994354
Updated Typescript interfaces from schema (#2157) 2022-01-11 21:21:31 +05:30
darth-coder00
adb63cc982
Fix: Feeds UI adjustments and existing name restriction (#2154) 2022-01-11 18:54:59 +05:30
parthp2107
cf2381482d
added selenium tests for tags with space (#2129)
* added selenium tests for tags with space

* addressing style check

* addressing comments

* using config for url

* minor changes

* minor changes

* changes for new service page

* empty commit, testing workflow

* minor changes

* addressing style-check
2022-01-11 17:45:28 +05:30
parthp2107
2cb490c294
added test for service with space as name (#2150) 2022-01-11 16:43:42 +05:30
darth-coder00
cbb0b837c0
Fix: Misc issues for adding Tags, Teams and Service (#2149)
* Fix: Misc issues for adding Tags, Teams and Service

* Addressing comments
2022-01-11 15:06:46 +05:30
Ayush Shah
f379b35279
Reflection Cache Implementation (#2016)
* Reflection Cache for Bigquery and Redshift

* Overrided few sqlalchemy packages

* Added Geography Support

* Reformatted files

* DBT models error handling implemented

* Geography type added as a custom sqlalchemy datatype

* GEOGRAPHY and VARIANT added as custom sql types

* Implemented file formatting using black

* Implemented file formatting using black
2022-01-11 14:58:03 +05:30
Sriharsha Chintalapani
cf6f438531
Fix #1994: Add support for marking dataset entities as deleted (#2141)
* Fix #1994: Add support for marking dataset entities as deleted

* Fix #1994: Add support for marking dataset entities as deleted

* Fix #1994: Add support for marking dataset entities as deleted
2022-01-11 11:42:53 +05:30
Pere Miquel Brull
bc05e4945d
update name (#2138) 2022-01-10 08:56:12 -08:00
darth-coder00
464181f074
Fix: Flashy Popover, uneven UI for Tags, Teams and Services page (#2132) 2022-01-10 18:09:05 +05:30
Pere Miquel Brull
d3b6c7cf27
[issue-1973] - Python API from Sklearn to MlModel (#2119)
* Move staticmethods to utils

* Use functions from utils

* Convert sklearn to MlModel

* merge main
2022-01-10 09:36:08 +01:00
Pere Miquel Brull
178315d68a
[issue-2112] - Add helper to get EntityReference in OMeta API (#2114)
* Use entity list from mixin

* Add entity reference helper

* Add tests for retrieving the entity reference

* Add missing space

* Fix shadowing

* Use get entity ref

* Use get entity ref
2022-01-10 09:07:39 +01:00
parthp2107
783cbb46de
added test for tag duplication (#2096)
* added test for tag dublication

* minor changes

* java style-check changes

* minor fixing in tests

* test fixes

* minor change
2022-01-10 11:25:33 +05:30
Matt
321a0e811b
Integrate DefaultAuthorizer with PolicyEvaluator (#2017) 2022-01-09 21:04:10 -08:00
Matt
ed797dc335
Remove unused Guice (#2120) 2022-01-09 21:03:50 -08:00
Pere Miquel Brull
9194b8e4ba
[issue-2108] - Fix PR base and add repo slug (#2109)
* Fix PR base and add repo slug

* Add SCM revision
2022-01-08 13:13:24 +01:00
Pere Miquel Brull
74e9038b92
[issue-997] - More pylint fixes (#2107)
* Update naming and disable false positives

* Rename for naming convention

* Fix linting issues

* Moved pylint to pylintrc

* Moved pylint to pylintrc

* Rename CI

* Check sonar properties

* Fix pull_request_target checkout
2022-01-07 19:50:53 +01:00
Teddy
dbcc5e9dd2
ISSUE-1048: Add Version Mixin (#2018)
* Added entity version mixins logics to ometa API

* remove logging in line 385 used for testing

* Fixed black error + ran isort

* remove extra underscore in

* Added integration tests for OpenMetadata versions methods

* Fixed linting errors in versionMixin.py
2022-01-07 10:37:56 +01:00
Pere Miquel Brull
48ebcffbd0
[issue-1976] - Ingestion SonarCloud (#2085)
* Update path

* Prepare sonar properties

* Prepare coverage recipes

* Add coverage

* Simplify pytest

* Organise integration tests

* Update path

* Use setup instead of reqs

* Update recipes

* Fix PR event to target

* Update event_name

* Prepare sonar

* Run tests & sonar

* Use sonarcloud host

* Fix compose

* Use ingestion token
2022-01-07 10:28:38 +01:00
Alberto Miorin
c8de136cca
First part of #2091: Python code in branch main is always formatted correctly (#2093) 2022-01-07 06:17:48 +01:00
Alberto Miorin
dd813a28f0
Fix #2088, fix #2089: Java checkstyle must run always AND Better naming for Github Actions Job names (#2090) 2022-01-07 05:04:29 +01:00
Alberto Miorin
34a9d31240
Fix #2052: Revert the reverted pre-commit (#2053) 2022-01-07 03:53:21 +01:00
darth-coder00
dee7cd7717
Fix: Max width layout alignment for Teams, Tags and Services page (#2083) 2022-01-06 22:17:25 +05:30
darth-coder00
b866d8a73a
Fix: Search bar is searching in last active tab (#2081)
* Fix: Search bar is searching in last active tab

* Fix: Missing Sample data tab changes
2022-01-06 20:23:19 +05:30
Pere Miquel Brull
eb01c55676
Update naming (#2080) 2022-01-06 14:42:50 +01:00
Pere Miquel Brull
94ecb1e030
Map ports to localhost (#2078) 2022-01-06 14:32:31 +01:00
darth-coder00
d7a01df552
Fix: Blank space being added as recent search team (#2071)
* Fix: Blank space being added as recent search team

* Fix: missing java check-styles
2022-01-06 18:41:34 +05:30
Pere Miquel Brull
d91f6bcb11
[issue-1992] - Allow Delete + PUT (#1993)
* Select entity deleted or not

* Allow to PUT back a deleted Entity

* Update interface to get deleted flag

* Add delete + put test

* Rename to isDeleted

* Rename to DeletedOrExists

* Update delete_put test

* format

* Remove delete put test from interface

* Add mlmodel delete put test

* Add mlmodel delete put test

* Use minor version change for recover deleted

* Prepare delete put test

* Add recover soft delete relationships

* Fix recover for Entities with services

* Fix recover for Entities with services

* Add delete put tests

* Add delete put tests

* Format and sonar
2022-01-06 12:38:09 +01:00
Shailesh Parmar
a3ccb1183d
change sample-data tab position (#2073) 2022-01-06 17:08:01 +05:30
Alberto Miorin
c0a0c04306
Fix #2058: Reformat a few Java files left for good (#2072) 2022-01-06 11:27:19 +01:00
Alberto Miorin
51c1228b2a
Fix #2064: Use pull_request_target in java checkstyle (#2070) 2022-01-06 11:13:54 +01:00
parthp2107
293ae7626f
added test for incorrect filter count (#2046) 2022-01-06 11:54:56 +05:30
darth-coder00
9befb8aa34
Fixed misc UI issues #1972, #1744 and other misc issues (#2011)
* Fixed misc UI issues #1972, #1744 and other misc issues

* Addressing comments

* UI: Centered layout changes

* Layout fixes

* Addressing comments

* Post merge fixes

* Selenium test and minor UI fix
2022-01-06 11:42:35 +05:30
Alberto Miorin
57b0da7acc
Fix #2060: java-checkstyle is not working anymore (#2061) 2022-01-05 20:10:37 -08:00
Alberto Miorin
34d8664693
Fix #2038: Fix Java style tooling support for good (#2051) 2022-01-05 20:18:28 +01:00
Yasar Shaikh
c88d5cff84
fix(#2054) : Replaced replace() with replace (#2056) 2022-01-05 10:57:18 -08:00
Suresh Srinivas
fb78944633
Merge v003 and v004 versions of bootstramp sql for 0.8 release (#2055) 2022-01-05 10:36:17 -08:00