2200 Commits

Author SHA1 Message Date
Shivam Shrey
0babaa52e0
ISSUE-7848: Fix variable names as per naming convention (#8228)
* ISSUE-7848: Rename local variables to match regular expression for camel case

* ISSUE-7848: Refactor package name as per naming convention
2022-10-26 05:54:40 -07:00
Rohit Agarwal
31d5835387
Fixed Issue#8342 (#8365) 2022-10-26 05:47:42 -07:00
mosiac1
ad7e4a2341
UI (#6189) | Refactor Explore and ExplorePage, add Logical Query Builder (#8140)
* Add logical query builder and Explore page refactor

* Add file headers

* Change search aggreagation keys

* Move query builder utils, remove comments

* Add comments

* Rename AdvancesSearch.constants.ts

* Add review changes

* Handle deleted elements correctly in Explore

The `deleted` field needs special handling because `showDeleted === false` should return only documents where `deleted` is false, but `showDeleted === true` should return documents regardless of their `deleted` field.

* Fix facet filter issue

Issue was the following: the user set a facet filter on `aggregationKey` and `value`. Then user changes the query builder so that in the new result there is no bucket in `aggregationKey` with `value`. The facet filter would still be used, but not visible to the user and not removable.

* Fix facetFilter tests

* Move isFilterObject type guard

* Use antd tabs for Explore component

* fix cypress failure

* miner fix in cypress

* fix typo

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-10-26 03:47:49 -07:00
Teddy
83b048c07c
Fixes #8206 -- Implement data insight refinement for entity report data (#8351)
* added data insight module to refine and ingest data

* Added json schema for data insight workflow

* Added mixin for data insight

* Added tests for data insight workflow and methods

* Fixed python style

* Fixed python linting

* Fixed unit test

* Added data insight worflow + workflow logging

* Fix python style

* Renamed analytic -> data_insight + added test to make + fixed style

* Fixed java style

* Fixed code smells + python style

* Ignore ES linting for now

* Fixed comments from review

* fix python formatting

* Fixe PipelineType attribute for data insight
2022-10-26 11:18:08 +02:00
Suresh Srinivas
e9ebb4dd75
Fixes #8343 Differentiate create from update in PUT operations (#8344) 2022-10-25 04:14:44 -07:00
Suresh Srinivas
f12b09687d
Fixes #8326 Add roles to system bots during initialization and use po… (#8327)
* Fixes #8326 Add roles to system bots during initialization and use policy based authorization for bots

* Remove var usage and instead use specific types for variables

* Fix bot can't create entities
2022-10-24 17:53:11 -07:00
Suresh Srinivas
82b81572ac
Update javadoc version (#8329) 2022-10-23 22:07:58 -07:00
Mahesh Pai R
0a1c701c76
Corrected null checks (#8320) 2022-10-23 05:43:37 -07:00
Suresh Srinivas
f668a58668
Fixes #8394 Use Awaitility pollInterval instead of iteration loop (#8325) 2022-10-23 01:40:38 -07:00
ssandy83
e6f686e857
ISSUE-1987: Replace thread.sleep with awaitility library (#8305)
* ISSUE-1987: Replace thread.sleep with awaitility library

* ISSUE-1987: Replace thread.sleep with awaitility library

* ISSUE-1987: increase polling period to 100ms

Co-authored-by: ssundaresha2 <sandeep_sundaresha@intuit.com>
2022-10-22 07:22:32 -07:00
Suresh Srinivas
0d75eb9ff2
Fixes #8313 Deprecate botPrincipals from open metadata configuration (#8314) 2022-10-21 20:49:41 -07:00
Finn McClusky
3f7c8dc2e2
FIX 8196: Remove the create-ingestion-bot and update-ingestion-bot from bootstrap_storage.sh (#8202)
* ISSUE-8196: removed create-ingestion-bot, update-ingestion-bot options and unused functions from table initializer

* java checkstyle fix

Co-authored-by: Finn McClusky <finn.mcclusky@gmail.com>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2022-10-21 22:41:02 +05:30
Suresh Srinivas
229b56e7b3
Fixes #8236 - Initialize bots from JSON data files (#8304) 2022-10-21 08:38:52 -07:00
Pere Miquel Brull
339f123f92
Fix #7477 - Paginate Airflow logs (#8145)
* Paginate last dag logs

* clean logic

* Prep pagination

* Prep pagination

* Format

* Update docker/local-metadata/docker-compose.yml

Co-authored-by: Nahuel <nahuel@getcollate.io>

* UI : Add pagination support for airflow logs

* Addressing review comments

Co-authored-by: Nahuel <nahuel@getcollate.io>
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2022-10-21 17:32:56 +05:30
Sriharsha Chintalapani
1ef189540f
Revert "Fix ISSUE-3790: Remove unnecessary public modifiers (#8268)" (#8295)
This reverts commit 24f3ae763eaecc707d56fc62bea59b792eb7ad8b.
2022-10-20 10:04:35 -07:00
Shivam Shrey
24f3ae763e
Fix ISSUE-3790: Remove unnecessary public modifiers (#8268) 2022-10-20 08:58:52 -07:00
Teddy
342e4a24da
Fixes #8154 - Add collect endpoint for web analytic events (#8193)
* Initial implementation of report endpoint

* Modified model files

* Added migration

* Added tests for analytics/report endpoint

* Finalized implementation of the reports endpoint

* Fixed maven test failure

* Fixed java style

* Added policy for reportDefinition

* Fixed minor typos in code

* Added database migration for web analytic event type

* Added logic for collect endpoint

* Added JSON Schema for collect endpoint

* Added index on table columns + added resource description for web event entities

* Fixed policy tests

* Updated add web analytic function to return the body of the request + updated test

* Added referer URL to PageView event

* Changed collection name to align with API endpoint

* updated initSeed method to initializeEntity

* cleaned up PR by removing unused filed from branch

* Fixed requested changes from review

* Clean up names

* Fixed comma in SQL statement
2022-10-20 16:38:54 +02:00
Teddy
816111a671
Fixes #8121 -- Report endpoint for data insight (#8122)
* Initial implementation of report endpoint

* Modified model files

* Added migration

* Added tests for analytics/report endpoint

* Finalized implementation of the reports endpoint

* Fixed maven test failure

* Fixed java style

* Added policy for reportDefinition

* Fixed minor typos in code

* Renamed classes from AnalyticReport to ReportDefinition

* Java style formatting

* Update add report results to return request body

* Refactor report endpoint to simplify it and remove dependency on entity resource.

* Removed import *

* Fixed java style

* fixed typos in code

* Fix import path
2022-10-20 16:37:09 +02:00
Mohit Yadav
36bd428616
Fixes issue with Table name containing excluded endpoints (#8289)
* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name

* Endpoint should be more specific, causes issue in case we have enitities containing login, config etc in name
2022-10-20 17:50:21 +05:30
Pere Miquel Brull
ee658bfb1f
Revert "Fixes #8236 - Initialize bots from JSON data files (#8237)" (#8281)
This reverts commit 9facb03cafce52735ef2b615d75205486985fc55.
2022-10-20 11:08:47 +02:00
Suresh Srinivas
9facb03caf
Fixes #8236 - Initialize bots from JSON data files (#8237) 2022-10-19 16:21:57 -07:00
Mohit Yadav
90ff4ac1ed
[BOT] User Cache for accessing Jwt For Bot (#8267)
* [BOT] User Cache for accessing Jwt For Bot

* [BOT] Review comments addressed
2022-10-20 00:00:43 +05:30
Suresh Srinivas
d4e463a789
Refactor initializing system entities from data files for better reusability (#8234) 2022-10-18 17:57:30 -07:00
Mohit Yadav
7af8c5418c
Adding Exception to Logger , and update batch jobs status as well (#8217) 2022-10-18 18:59:11 +05:30
Sriharsha Chintalapani
a4d8cbb818
Revert "ISSUE-1986: Replace System.out, System.err by a logger (#8139)" (#8163)
This reverts commit 1d3234ffe8ddf5e1f4f37a68be4226bf5ce5f67b.
2022-10-17 12:43:45 +02:00
Shivam Shrey
1d3234ffe8
ISSUE-1986: Replace System.out, System.err by a logger (#8139) 2022-10-14 06:39:00 +02:00
Mohit Yadav
71fcb17e59
Added Context Info in ES reindexing (#8123)
* Added Context Info in ES reindexing

* Fix File Formatting

* Update openmetadata-spec/src/main/resources/json/schema/settings/eventPublisherJob.json

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* revert python file

Co-authored-by: Ayush Shah <ayush@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2022-10-13 18:32:06 +05:30
Mohit Yadav
cba9240fe9
[Email] Added explicit senderMail in configuration (#8126)
* [Email] Added explicit senderMail in configuration

* Fix failing tests

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2022-10-13 18:24:32 +05:30
mosiac1
d8a4cbeeb9
UI (#6189) | Update SearchResource and add new searchAPI frontend implementation (#8083)
* Update SearchResource and add new searchAPI frontend implementation

SearchResource now supports `query_filter` and `post_filter` as json
encoded Elasticsearch filters; `fetch_source` and
`include_source_fileds` for reducing response sizes.

* Remove

* Use async/await for searchAPI

* Move formatting to util functions
2022-10-13 09:30:56 +05:30
Parth Panchal
cf28194e1e
Fixed#8064: Count API should support include filter (#8079)
* Fixed#8064: Count API should support include filter

* Fixed#8064: Count API should support include filter
2022-10-11 16:51:54 +05:30
Mohit Yadav
5d0fcb7483
[BasicAuth] Init default password to "admin" in case of no passwords (#8072)
* Added websocket updates on jobchannel

* Default Password to be "admin" for uninitialized PWDs
2022-10-11 12:14:59 +05:30
Suresh Srinivas
f4acc4af1f
Fixes #8068 Remove ConstructorType annotation from Collection (#8069) 2022-10-10 23:32:48 -07:00
Suresh Srinivas
de7a616788
Add log layout for tests and also printing ISO8601 timestamp (#8071) 2022-10-10 18:42:59 -07:00
Nahuel
13b76dfd88
Remove UserRepository constructor which could cause NPE (#8047) 2022-10-10 10:50:01 +02:00
Sriharsha Chintalapani
ba08cfd115
Fix #8043: add log4j dependency openmetadata-service (#8044) 2022-10-08 13:55:34 +05:30
Vivek Ratnavel Subramanian
ef51fc8dbd
Fix #7908 Backend: Glossary term deletion executes partial deletion (#8042) 2022-10-07 18:21:26 -07:00
Mohit Yadav
f2131d58a8
[Improve] Proactively instantiate resources instead of relying on Exc… (#7983)
* [Improve] Proactively instantiate resources instead of relying on Exception Handling + removed ConfigurationHolder.java

* Review Comments updated
2022-10-07 20:50:15 +05:30
Mohit Yadav
46bda6dc32
Added websocket updates on jobchannel (#8014) 2022-10-07 17:48:37 +05:30
Anubhav Jain
c6e4937259
Fix sonar issues #7857 (#7897)
* added assert statements for sonar build

* added assert statements to test cases for sonar build failure

* added asserts for sonar build failure

* build fix

* fixed indentation

Co-authored-by: Nahuel <nahuel@getcollate.io>

* java checkstyle compliance changes

* Update IngestionPipelineResourceTest.java

Co-authored-by: Nahuel <nahuel@getcollate.io>
2022-10-06 12:38:07 +02:00
Mohit Yadav
e7ec822679
[ESReindexing] Fixed slowness in ES write + added controlling params (#7974)
* [ESReindexing] Fixed slowness in ES write + added controlling params

* migrate-all failure fix during script run

* Update createEventPublisherJob.json
2022-10-06 15:58:44 +05:30
Semjon Nirmann
f9f951c44b
Fix 'Use the primitive boolean expression' - warning (#7945) 2022-10-04 13:34:00 -07:00
Suresh Srinivas
7e38b38217
Clean up unnecessary dependencies (#7943) 2022-10-04 13:29:58 -07:00
Vivek Ratnavel Subramanian
2557feef3b
Fix #7900 Backend: Fix NPE in tests (#7902) 2022-10-04 12:46:50 -07:00
Suresh Srinivas
7499277fcb
Update dependencies for release 0.13 (#7913)
* Update openmetadata-client module dependencies

* Update common module dependencies

* Update openmetadata-spec module dependencies

* Update openmetadata-ui module dependencies

* Update openmetadata-service module dependencies

* Upgrade remaining dependencies
2022-10-04 09:30:05 -07:00
Chirag Madlani
0e035c44ee
fix(ui-test): pipeline display name not set properly (#7918)
* fix(ui-test): pipeline display name not set properly

* Fixed failing snowflake cypress test

Co-authored-by: Shailesh Parmar <shailesh.parmar.webdev@gmail.com>
2022-10-04 17:06:33 +05:30
Mohit Yadav
895b2a35c3
[ BasicAuth] remove auth on registration (#7915)
* Fix Version issue b/w api/v1/version and entity {id}/versions

* [UserResource]  remove auth on user registration

* Fix Smtp settings

Co-authored-by: mohitdeuex <105265192+mohitdeuex@users.noreply.github.com>
2022-10-04 13:03:31 +05:30
Sriharsha Chintalapani
ba37fda0f1
Fix #7909: Remove ElasticSearch configs from tests (#7910) 2022-10-03 21:51:57 -07:00
Anubhav Jain
df84876da0
added assert statements for sonar build (#7865)
* added assert statements for sonar build

* added assert statements to test cases for sonar build failure
2022-10-03 07:31:05 -07:00
Chirag Madlani
bdca0ad150
fix(ui): show actual count for index requests (#7871)
* fix(ui): show actual count for index requests

* fix maven ci
2022-10-03 15:28:19 +05:30
Suresh Srinivas
6b5a788d2b
Sonar.2 oct22 (#7860)
* Fix of variable names according to the naming convention (#7855)

* Changed the fields to final static

* correct the java checkstyle

* Changed the naming of packages according to the naming conventions

* Fixing warnings in the code

Co-authored-by: Shivam Purohit <91889807+shivam-Purohit@users.noreply.github.com>
2022-10-02 18:43:34 -07:00