1565 Commits

Author SHA1 Message Date
Mohit Yadav
26efcb1197
Add Indexing Mapping Language in Reindexing (#10537) 2023-03-14 10:28:56 +05:30
Ashish Gupta
c0fe8ec871
UI : Added tags at schema Level (#10471)
* Added tags at schema Level

* Add task handling for Database Schema

* added cypress and unit test

* Changes as per comments

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-03-13 16:54:35 +00:00
Ayush Shah
0f9c2c2164
Add Labels on DatabaseSchema Level (#10547) 2023-03-13 14:13:51 +00:00
Milan Bariya
bc4abc44ed
Add steps in test_connection function (#10408)
* Add steps in test_connection funstion

* Add steps in test_connection funstion

* Add steps in test_connection funstion

* Fix: Pylint issue

* Status response changefor statuscode 200

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
2023-03-10 10:02:26 +05:30
Pere Miquel Brull
81dec813a0
Don't store the OM connection in the Ingestion Pipeline or Workflow (#10448)
* Do not store OM connection

* Migration to remove the server connection

* Update tests

* Add workflow masking and secrets manager

* Fix failing test

---------

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-03-09 17:32:40 +01:00
Sriharsha Chintalapani
d9e4fbdebb
Fix #10454: Improve Search Relevancy, by adding functional scoring an… (#10455)
* Fix #10454: Improve Search Relevancy, by adding functional scoring and add ngram analyzer; Fix #10452: Enable Table and Column search by BOTH name and displayName

* fix stylecheck

* Undo changes in table example names

* remove ngram from teams & users

* Fix topic tags

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf (#10430)

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Fix #10429: Kafka Sample data improvements and adding support for JSONSchema and Protobuf

* Added top level parsing and unit tests

* fix(ui): show schemaText and fields both

* fix no data placeholder for fields & schema text

* addressing comments

* fixed py checkstyle

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>

* revert common_broker_source changes

* revert common_broker_source changes

* remove changes to user & team indexes

* fix team index

* fix glossary & tag index

* Fix to TopicIndex

* fix advance search pre-requisites cypress failure

* fix group advance search cy failures

---------

Co-authored-by: Nahuel <nahuel@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-09 21:37:08 +05:30
NiharDoshi99
ddbc0311e8
fix: mark table deleted dependencies (#10476) 2023-03-09 09:15:05 +00:00
Suresh Srinivas
4c6d184ef5
Fixes #10480 Glossary rename results in rename of Classification with… (#10486)
* Fixes #10480 Glossary rename results in rename of Classification with the same name

* Rename TagSource Tag to Classification
2023-03-09 00:30:36 -08:00
Sriharsha Chintalapani
b42f457d88
Fix error code if else in webhooks (#10386) 2023-03-07 12:58:19 -08:00
Pere Miquel Brull
050da1e2d1
Add service type to container (#10441) 2023-03-06 14:44:30 +01:00
Pere Miquel Brull
477a5223eb
Fix #10401 - Add Automations Workflow Resource & PUT service test connection result (#10437)
Fix #10401 - Add Automations Workflow Resource & PUT service test connection result (#10437)
2023-03-06 14:44:16 +01:00
Mohit Yadav
df2001418e
add tags to schema Level (#10381)
=
2023-03-06 12:45:07 +05:30
Pere Miquel Brull
1e3652d35e
Fix #10382 - Test Connection Definitions, Results and Resource (#10383)
* Prep the skeleton

* Add DAO and tables

* Add Test Connection Definition Resource

* Format

* Add ResourceDescriptors & missing props

* Simplify APIs to scope for GET and LIST
2023-03-05 10:17:08 +01:00
Nahuel
247016307d
Fix#8648: Mask sensitive info from API responses (#10307)
* Mask sensitive info from API responses

* Rename converter classes

* Add missing Java classes from JSON schemas and class converters

* Update test service connection schema

* Update datalakeConnection JSON schema and fix some tests

* Fix AlertsRuleEvaluatorResourceTest and minor error in run_local_docker.sh

* Fix Pipeline and Database service tests

* Minor refactor

* Fix CsvUtilTest

* Fix EventMonitorFactoryTest

* Fix CloudWatchEventMonitorTest

* Update datalake metadata

* Update bigquery metadata

* Fix test connection functionality

* Fix OMeta service api test

* Update gcsValues title and revert changes in GH actions

* Mask sensitive enabled by default for local docker

* Add missing tests

* Address PR comments

* Address PR comments

* fix ui breaks on gcsValues.json

* Address PR comments

* Minor refactor

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-03-03 18:10:01 +00:00
Sachin Chaurasiya
4ce038557e
feat(ui)#10274: UI - allow to configure OM logo (#10316)
* feat(ui)#10274: UI - allow to configure OM logo

* chore: use logo config to render the brand and login page logo

* fix : cy tests

* doc: update the doc

* chore: remove check for filePath logo location type

* test: add unit test

* - removed FilePath
- Added configs to docker

* address comment

* remove config from test yaml

* update logo aspect ratio

* remove type

* chore: update ui logic as per backend config

* update doc

* address comments

* Revert "address comments"

This reverts commit c4f9da88918343cab08cd5e603cba29bd05b2ec9.

* address comments

---------

Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-03-01 14:09:44 +05:30
Teddy
754074f1be
Fixes #7758 - Added Column value and Integer Range Partitionning (#10350)
* feat(profiler): renamed  module to

* feat(profiler): added dbt-artifacts-parser to test setup.py

* feat(profiler): refactor workflow and interface

* feat(profiler): linting

* feat(profiler): removed old profiler modules

* feat(profiler): added support for value and integer range partition

* feat(profiler): fixed linting

* feat(profiler): added partitionning support for datalake profiler

* feat(profiler): removed `ProfilerInterfaceArgs` class

* feat(profiler): address comments

* feat(profiler): Added `OTHER` as an `IntervalType` for UI type generation
2023-03-01 08:20:38 +01:00
07Himank
01ec17f6f3
Lineage task (#9499)
* solved lineage data issue related to pipeline

* fixed some bugs

* formatting done

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2023-02-27 11:59:22 +05:30
07Himank
3e7f890b3f
Es update issue fix (#10289)
* elastic search update issue fix ..

* solved bug for searchSourceBuilder size

* added search request with batch size 50 per request

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-02-27 11:57:42 +05:30
Pere Miquel Brull
203e2b5fff
Simplify Pipeline Service Client Response and prep test connection for ingestion base (#10334)
* Simplify Response and prep test connection

* Format
2023-02-25 15:52:14 -08:00
Cristian Calugaru
3f61c3e05d
Issue 9064 - New Object Store Service and Container models (#10283)
* First cut of the store service model

* Second cut of the store service model

* reverted accidental rename of property

* Third version for the object container schema definition.

* final draft version for container and object store service related entities

* final first draft of api's and entities for the object store service and container

* formatting

* removed test file

* formatting

* test fixes

* formatting

* more fixed tests

* fixed tests, addressed PR comments

* added type for object store connections

* addressed PR comments

* formatting

* renamed objectstoreservice to service in schemas. Changed type to fullyQualifiedEntityName in createContainer schema
2023-02-24 16:34:08 -08:00
Mohit Yadav
960ae2918e
- Config Changes for Logo and Jwt Expiry (#10287)
* - Changes for Logo
- Make Jwt Token Expiry Configurable

* change config time

* fix tests

* review comments

* fix failing python

* moved login to application config as well

* fix login Config

* Added Nav Bar and Login Page Config for Logos

* Removed UI Api calls

* fix: unit test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-02-23 22:57:57 +05:30
Parth Panchal
cbe516b29b
Fixed#10247: Users associated with more than one team are being counted more than once (#10297)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-02-23 18:29:29 +05:30
Pere Miquel Brull
34a54461bd
Pipeline Service Client - Pass the service to run and deploy (#10294)
* Pass de service to run and deploy

* Generalize type map

* Format
2023-02-23 11:40:18 +01:00
Parth Panchal
9bd22369d7
Fixed#10211: Enable LDAP configuration to be configured via environment variable (#10252)
* Fixed#10211: Enable LDAP configuration to be configured via environment variable

* Fixed#10211: Enable LDAP configuration to be configured via environment variable
2023-02-22 12:53:24 +05:30
Mohit Yadav
8939d81470
Update Docs (#10233) 2023-02-20 14:38:43 +05:30
Suresh Srinivas
57093e583a
Fixes #10212 User email address should be unique (#10214) 2023-02-15 21:04:23 -08:00
Deepa Rao
f16e9dcc9f
Fixes #10137 - Reorganize API documentation sections (#10172) 2023-02-14 19:32:43 -08:00
Suresh Srinivas
afad0a4769
Fixes #10123 - Change entityReference in createRequests to fullyQualifiedName (#10124)
* Change entityReference to entity name or fullyQualifiedName

* Change backend code and tests to use FQN

* UI change for using fqns instead of EntityReference

* Ingestion framework changes for using fqns instead of EntityReference

* Fix test failures

* Fixed python tests and sample data new

* fix: minor ui changes for fqn

* Fixed python integration tests

* Fixed superset tests

* fix UI tests

* fix type issue

* fix cypress

* fix name for testcase

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-02-13 13:38:55 +05:30
JINZHANG2017
1f6ee4a408
update columnValueMaxToBeBetween json schema. (#10176)
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-02-13 06:32:32 +04:00
Nahuel
fc78d03cc4
Check if user is bot before updateOrCreate bot user (#10178) 2023-02-10 16:40:07 +00:00
Pere Miquel Brull
2a99114c94
Set the server connection when running a pipeline (#10152) 2023-02-10 15:32:05 +01:00
Suresh Srinivas
c4c660e25c
Relax data asset name restrictions to allow the special characters except "::" (#10169) 2023-02-09 21:27:08 -08:00
Parth Panchal
5c351781f5
Fixed#9427: LDAP-s support connection without MTLS (#10146)
* Fixed#9427: LDAP-s support connection without MTLS

* Fixed#9427: LDAP-s support connection without MTLS

* Fixed#9427: LDAP-s support connection without MTLS

* Fix Json Issues

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-02-09 17:42:38 +05:30
Pere Miquel Brull
1835de8bf2
Group airflowConfiguration into pipelineService config (#10120)
Group airflowConfiguration into pipelineService config (#10120)
2023-02-07 16:30:42 +01:00
Sriharsha Chintalapani
b76ec0a18f
Parallel tests (#10064)
* Staging parallel tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests
2023-02-06 21:26:13 -08:00
Suresh Srinivas
460a9288a7
Update project dependencies (#9978) 2023-02-06 12:41:10 -08:00
ragul balaji ravichandran
97747d9803
add GChat as alert destination (#10109) 2023-02-04 17:04:31 -08:00
krotonet
8b84ea2453
Use the primitive boolean expression (#10110)
* Use the primitive boolean expression for #7863

* Use the primitive boolean expression for #7863

* Update yarn-coverage.yml
2023-02-04 15:30:51 -08:00
Suresh Srinivas
1990ac56d9
10041 Part1 - Refactor and clean up System APIs (#10042)
* 10041 Part1 - Refactor and clean up System APIs

* Update the config resource endpoint url
2023-02-03 16:25:40 -08:00
Suresh Srinivas
3d016c46f2
Fixes #10065 Allow Unicode characters and digits in the entityName (#10066)
* Fixes #10065 Allow Unicode characters and digits in the entityName

* Use Unicode modifier (?U) to JSON schema patterns

* fix(dataModel): convert unicode modifier from uppercase to lowercase

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-02-02 12:49:45 -08:00
Mohit Yadav
7b6771f1cf
Revert "Prevent Authentication bypass using Jwt Token Config in case of OM su… (#10079)" (#10083)
This reverts commit e164bbb760886ca30327a5c0fe7983341775f7d1.
2023-02-02 20:19:32 +05:30
Mohit Yadav
e164bbb760
Prevent Authentication bypass using Jwt Token Config in case of OM su… (#10079)
* Prevent Authentication bypass using Jwt Token Config in case of OM supporting token generation

* fix failing tests
2023-02-02 20:18:28 +05:30
Nahuel
b9a3c06104
Bump main branch to version 1.0.0 (#10040)
* Bump to version 0.13.2

* Bump mvn projects to 1.0.0-SNAPSHOT

* Bump python projects to 1.0.0.dev0

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-02-02 12:56:14 +01:00
07Himank
d989aee887
solved issue of entity followed by user not visible after editing the… (#10051)
* solved issue of entity followed by user not visible after editing the entity

* did it for all the entities

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-02-02 15:49:38 +05:30
Parth Panchal
5805269506
Fixed#6145: Notification for service owner when ingestion pipeline fails (#9805) 2023-02-01 12:09:58 +05:30
Deepa Rao
3beea862fa
Fixes #9975 - Add missing documentation for path params (#9990) 2023-01-31 14:36:04 -08:00
Teddy
70b4055400
fix(testSuite): removed relationship update with testCase on testSuite update (#10029)
* fix(testSuite): removed relationship update with testCase on testSuite update

* fix(testSuite): empty commit for CI
2023-01-31 10:15:08 -08:00
Teddy
ba08302ea1
Issue #7291 - Implements Table Rows Inserted to be Between test (#9813)
* staging commit

* staging commit

* refactor: partitioning logic

* refactor (tests): move to parametrized tests for test validations

* refactor: local variables into global

* (feat): Added logic for table row inserted test

* (feat): fix python checkstyle

* feature: extracted get_query_filter logic into its own function
2023-01-31 15:57:51 +01:00
Suresh Srinivas
a1b9d3fe65
Fixes 10021 - Add CSV import/export for users (#10022)
* Fixes 10021 - Add CSV import/export for users

* Fixes 10021 - Add CSV import/export for users
2023-01-30 21:34:34 -08:00
Sriharsha Chintalapani
28c8ce1386
Fix #9750: Refactor interfaces into openmetadata-spec module (#9751) 2023-01-30 11:47:30 -08:00