5395 Commits

Author SHA1 Message Date
Sachin Chaurasiya
7b20a62118
Fix: #1781 Automatically created admins don't get profile and displayName updated when using Google SSO. (#2283)
* Fix: #1781 Automatically created admins don't get profile and displayName updated when using Google SSO.

* adding code to update the state through action.

* Adding methods to observable
2022-01-19 17:55:24 +05:30
Sachin Chaurasiya
963c533003
Fix : Fixing Misc UI issue. (#2275)
* Fix : Fixed Misc UI issue.

* Removing tabs icon from all detail pages
2022-01-19 13:32:43 +05:30
Sriharsha Chintalapani
0a3ba3ddfd
Fix 2276: fix elastic search indexing (#2278) 2022-01-18 23:30:36 -08:00
Alberto Miorin
26405e27f5
Fix #2220: 2nd follow-up PR: Support for getting deleted entities in GET and LIST operations (#2221)
* Remove addAllRelationships, rename addAllRelationshipsAfterCreation to beforeDeletion, tests owns in User and Team, test location in Table.

* Add an entity to the team of the User deleted

* Add decorator to Entity to simplify the code. Add more tests to Table.

* Add methods about owner to the decorator.

* Fix getTable creating a EntityReference without type. Migrate authorization to decorator, migrate prepare to the decorator. Remove `populate*` methods. Migrate getOwner to the decorator.

* 1st commit to get rid of the multiple getService that were incompatible with Include.

* 2nd commit

* 3rd commit

* 4th commit. All getService are using the decorator.

* Remove all getService of EntityUtil.

* Get rid of Entity.getEntityInterface that was clashing with <T> Entity.getEntityInterface

* Replace the import star.

* Rename parameter entity to field.

* Improve the log of get[Relationship] and remove dead code.

* Better documentation for EntityHandler.

* Merge `h` and `r` and rename it to `helper`

* Make snekeythrows more precise.
2022-01-19 07:53:19 +01:00
Akash Jain
14c7ae4af5
Run ingestion-core publish on version bump (#2273)
Ability to run ingestion-core publish on version bump as well.
2022-01-19 11:39:02 +05:30
Sriharsha Chintalapani
0d3ded0742
Data Profiler Integration (#2235)
* Fix 2234: Data profiler integration
2022-01-18 20:25:43 -08:00
Sachin Chaurasiya
7a33a3a23b
Fixed #2255 Search in user-list is case sensitive. (#2261)
* Fixed #2255 Search in user-list is case sensitive.

* Addressing review comment
2022-01-18 21:15:28 +05:30
Pere Miquel Brull
a9c840778a
[issue-2116] - Add target property to MlModel (#2134)
* Add target property to MlModel

* Use pull_request_target for forks

* Simplify str

* Update ingestion-core setup

* Bump ingestion-core version

* Update install
2022-01-18 16:27:35 +01:00
Sachin Chaurasiya
d4e66ecd7c
Fixed #2238 #2241 Lineage: In view mode, the main node is not highlighted and Two nodes for same table in lineage. (#2258)
* Fixed #2238 Lineage: In view mode, the main node is not highlighted.

* Fixed #2241 Two nodes for same table in lineage
2022-01-18 20:43:37 +05:30
parthp2107
91cb1fafa7
added selenium tests for filter-count, owner-name and tour (#2264) 2022-01-18 20:10:25 +05:30
Shailesh Parmar
a41d9f6905
fixed issue-2044: Tags drop-down menu is getting overlapped by another elements. (#2265) 2022-01-18 20:07:01 +05:30
parthp2107
7720a821df
added tests for name checks (#2250) 2022-01-18 10:57:25 +05:30
Shailesh Parmar
a0eb8b112c
Fix: issue-2179 Left panel disappears after clicking 'Clear all' button (#2249)
* Fix: issue-2179 Left panel disappears after clicking 'Clear all' button

* fixed flikiness in side penal
2022-01-18 10:14:46 +05:30
Pere Miquel Brull
de3b3e4abc
[issue-2239] - Update core publish to push (#2240)
* Update core publish to push

* Rename jobs to be py explicit

* Upload to testpypi
2022-01-17 10:29:55 -08:00
Sachin Chaurasiya
6be3ddb7e2
Fix : UI Bug Fixes #2246 #2248 (#2251) 2022-01-17 23:15:19 +05:30
Akash Jain
6350cbb68b
CI for py-ingestion-core comment workflow (#2252)
Part 1 of the py-ingestion-publish CI revamp. This will comment on PR's opened with schema changes and let the Pull requestor notify of version bump to publish dev package in test.pypi.org. See #2239  and #2240 for reference.
2022-01-17 20:35:45 +05:30
Matt
7181141803
Initialize roles and policies with seed data (#2236)
- Set up initial roles and policies seed data
- Extend EntityRepository to support initSeedData()
2022-01-17 00:31:12 -08:00
Sachin Chaurasiya
1f8c28dde1
Generating Typescript interfaces from Json schema. (#2244) 2022-01-17 13:35:56 +05:30
Sachin Chaurasiya
099ddbbce9
Fix: Fixed #2102 #2103 (#2243) 2022-01-17 12:46:06 +05:30
Shailesh Parmar
94cd991462
Fix: issue-2151 Clicking links in column description open the edit panel and then navigates to the link (#2237) 2022-01-17 12:42:36 +05:30
Sriharsha Chintalapani
b4983764e5
Fix 2232: Presto - connection formatting issues when username/password configured (#2233)
* Fix 2232: Presto - connection formatting issues when username/password configured

* Fix 2232: Presto - connection formatting issues when username/password configured
2022-01-17 11:03:17 +05:30
Matt
276128e8b0
Add MetadataOperations RBAC support for PATCH APIs (#2128)
* Add RBAC for PATCH APIs

* Expand scope to all resources except a few (Policy, User, Role, Team, resources that doesn't support PATCH)

* Fix code smells
2022-01-16 09:24:26 -08:00
Pere Miquel Brull
ebda556adc
[issue-2223] - Lineage Callback for any operator (#2225)
* Fix logging

* Reorganise lineage

* Add callback

* Add metadata config

* Fix type smell
2022-01-15 18:57:48 +01:00
Pere Miquel Brull
2728041d0f
[issue-2213] - Airflow lineage refactor (#2218)
* Fix ometa logging

* Refactor airflow lineage

* Refactor airflow lineage

* Add airflow lineage integration tests

* Fix circular dependency
2022-01-14 13:00:33 -08:00
Alberto Miorin
4fedb5fd9b
Fix #2199: Follow-up of PR: Support for getting deleted entities in GET and LIST operations (#2206)
* Improve tests for deleted entities, fix User->Teams->OwnsEntities

* Improve doc for recursive deletion and improve UsageRepository

* Remove listAfter and listBerfore without Include. Add Include.NON_DELETED to the resources without deletion like Bots, Metrics, and Reports. Improve UserRepository.

* Add method to add all relationships for the get deleted entity test. Adapt the test for the entity User.

* Add soft deletion to Webhook. Implement Include for Webhook.

* Improve existing test to include a check for owner.

* Fix populateService of Table

* Fix Team setFields.
2022-01-14 12:19:19 -08:00
Shailesh Parmar
9a55d4efb5
Fix: issue 2098, 2099 & 2192: Resolve text overflow issue (#2216) 2022-01-14 19:46:42 +05:30
Sachin Chaurasiya
60a28ffef6
Fix: Fixing UI Bugs #2203 #2204 #2205 #2191 #2097 (#2214)
* Fix: Fixing UI Bugs  #2203 #2204 #2205 #2191

* Fixing #2097
2022-01-14 19:10:27 +05:30
Shailesh Parmar
9f5a37f51f
Fix: issue-2178 The 'matches' when searched for any keyword doesn't show appropriate count. (#2212) 2022-01-14 17:44:19 +05:30
Sachin Chaurasiya
3babfd9a61
Fixed : Add bots tab to group users with isBot set to true. (#2210) 2022-01-14 16:44:56 +05:30
Sachin Chaurasiya
5ac9acd983
UI: Adding Support for Manual lineage (#1974)
* UI: Adding Support for Manual lineage

* Minor fix

* Adding validation

* Adding editMode handler

* Adding micro iteraction

* Minor Fixes

* Adding support to clear selected entity

* Removed unwanted props

* Removed editable argument from getLineageData Function.

* Removed EntityLineage Drawer

* Removed unwanted codes

* Adding customControls

* Adding toggler for view/edit mode

* minor fix

* Adding sidebar for entities in editmode

* Adding state for reactflow instance

* Adding support for drag and drop

* Minor fixes to avoid flickerness

* adding iseditmode params to getlineage data helper

* fixing icon styling

* Adding state to hold newAdded nodes

* Fixed sidebar styling

* Adding searchbar for custom node

* Adding support for entity suggestions and selected entity state.

* Adding database name in suggestion for table entity.

* Adding arrow head type to new edge

* Adding addlineage api

* Adding support for real time changes

* Style : making some style changes to controls and widgets.

* Adding support for deleting lineage edges.

* Adding background image for graph.

* Adding support for removing new selected entity.

* Adding micro interaction for add new edge operation.

* Adding micro interacton for delete operation.

* Renamed component and added License.

* Disabling cancel button while deleting edge

* Addressing review comments

* Adding checks for already existing entity  node.

* Fixed new node handler position

* Reseting state when entity is alredy present.

* Changed delete icon for nodes.
2022-01-14 16:30:46 +05:30
Shailesh Parmar
9cb6f3c200
Login page revamp (#2207)
* rewamp login page

* added carousal for login

* addressing comments
2022-01-14 15:40:12 +05:30
Sachin Chaurasiya
a6548bf669
Fixed : UI: rename "dataset" in URL to "table" (#2208) 2022-01-14 14:05:36 +05:30
darth-coder00
afcf725491
Fixed Users stat click and owner name inconsistency (#2200) 2022-01-14 11:47:00 +05:30
Akash Jain
105d8c1b67
Feat: docker cmd improvements (#1895)
* revamped docker commands

* update metadata docker commands in comments

* Added Docker Compose Check

* code refactored to docker.py

* fix py-checkstyle lints

* Adding clean functionality; refactor code

* pylint checkstyle fixes

* version string revised
2022-01-13 20:39:46 -08:00
Suresh Srinivas
5a8e2ee31f
Issue2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key (#2195)
* Add support for webhook secret key

* Fixes #2194 - Change dateTime field to unix epoch timestamp milliseconds and add support for webhook secret key

* Fixes #2194 - Added support for upgrading existing metadata to move dateTime attributes to timestamp
2022-01-13 12:08:42 -08:00
Alberto Miorin
e0423ac16a
Fix #2036: Support for getting deleted entities in GET and LIST operations (#2126)
* Create the first failing test.

* Find deleted location.

* Support getService for a deleted location

* Add getByName for Location

* Add test for list

* Add list of Location

* Refactor getService

* Replace the Java Enum with a JSON type

* Fix null pointer exception in getService when the relationship is recovered while the entity is still deleted.

* Simplify the logic using Include.ALL. Implemented Table.

* Add test for Table deleted and Location non-deleted

* Fix small comment

* Implement add Follower delete Entity.

* Add chart and check container

* Add dashboard

* Add database

* Add mlmodel

* Add pipeline

* Add policy

* Add dashboard

* Add databaseService

* Add messaginservice

* Add pipelineService

* Add storageService

* Add role

* Add team

* Add topic

* Add ingestion

* Fix getFollowers NPE

* Disable Webhook tests for Include

* Disable User tests for Include

* Instead of passing Include.ALL, we pass the flag based on the deleted state of entity.

* 1st clean up of 'deleted = false'

* 2nd clean up of 'deleted = false'

* Delete useless return statement.

* Remove duplicated code

* Remove duplicated code in tests

* Remove duplicated code in EntityDAO

* Fix UserDAO and remove duplicated code in EntityRepository and EntityDAO

* Remove Include.NON_DELETED when possible.

* Rebase and fix the formatting
2022-01-13 18:35:31 +01:00
parthp2107
8e19756764
added test for multiple tags (#2196)
* added tests for multiple tags

* minor changes

* addressing style-check
2022-01-13 20:44:34 +05:30
darth-coder00
b29fdd3ccc
Enhanced Tour feature (#2082)
* Enhanced Tour feature

* Fix: #2182 - Tour steps getting skipped

* Fix: #2180 - Stat links deactivated on browser back from Tour route

* Addressing comments

* Addressing comments

* Adding license
2022-01-13 20:43:07 +05:30
darth-coder00
ad362a31fd
Fixed Search filter issues (#2197) 2022-01-13 19:43:32 +05:30
codingwithabhi
5714c4122b
Move sql queries (#2183)
* sql-queries-moved-separate-file

* sql-queries-moved-separate-file

* redshift-and-neo4j-queries-added

* redshift-and-neo4j-queries-added

* neo4j-query-imported

* code-formatted

Co-authored-by: = <=>
2022-01-13 14:16:54 +05:30
Akash Jain
00ccd612ee
fix: Ingestion Core CI to Publish PyPi packages (#2187)
* Remove gitignore on _versions.py

CI commits and pushes the new version in _versions.py and since the folder is marked under gitignore, CI fails to commit and push changes to the branch.

* bump version to 0.8.0.dev0 as already published
2022-01-13 12:40:47 +05:30
Sriharsha Chintalapani
c4d7c76198
Event publishers to ElasticSearch and Slack (#2118)
* ElasticSearch & Slack Event publishers

* Fix #2165: Support for deleted entities in ElasticSearch
2022-01-12 16:35:27 -08:00
Sriharsha Chintalapani
f9a58b418a
DefaultAuthorizer should update the existing users and make them admin/bot based on config (#2173) 2022-01-11 23:37:13 -08:00
Suresh Srinivas
a2b98db7f2
Fixes #2068 Tag duplication (#2170)
* Restore deleted entity on PATCH requests

* Add support for deleting edge in lineage

* Fixes #2068 Tag duplication
2022-01-11 17:59:22 -08:00
Matt
f323afe0cd
Support role ingestion from sample data (#2167) 2022-01-11 16:51:18 -08:00
Sriharsha Chintalapani
80cc907224
Fix #2168: Fix bootstrap_storage to parse env variables in the server config (#2169)
* Fix #2168: Fix bootstrap_storage to parse env variables in the server config
2022-01-11 16:47:11 -08:00
Suresh Srinivas
4fc9db8847
Issue2147 - Add support for deleting edge in lineage (#2164)
* Restore deleted entity on PATCH requests

* Add support for deleting edge in lineage
2022-01-11 13:45:39 -08:00
Sriharsha Chintalapani
7b24e31973
Fix #2143: Allow environment variables to be substituted in OpenMetadata config (#2146)
* Fix #2143: Allow environment variables to be substituted in OpenMetadata config
2022-01-11 10:13:49 -08:00
darth-coder00
5fa0994354
Updated Typescript interfaces from schema (#2157) 2022-01-11 21:21:31 +05:30
darth-coder00
adb63cc982
Fix: Feeds UI adjustments and existing name restriction (#2154) 2022-01-11 18:54:59 +05:30