2200 Commits

Author SHA1 Message Date
Teddy
754074f1be
Fixes #7758 - Added Column value and Integer Range Partitionning (#10350)
* feat(profiler): renamed  module to

* feat(profiler): added dbt-artifacts-parser to test setup.py

* feat(profiler): refactor workflow and interface

* feat(profiler): linting

* feat(profiler): removed old profiler modules

* feat(profiler): added support for value and integer range partition

* feat(profiler): fixed linting

* feat(profiler): added partitionning support for datalake profiler

* feat(profiler): removed `ProfilerInterfaceArgs` class

* feat(profiler): address comments

* feat(profiler): Added `OTHER` as an `IntervalType` for UI type generation
2023-03-01 08:20:38 +01:00
07Himank
01ec17f6f3
Lineage task (#9499)
* solved lineage data issue related to pipeline

* fixed some bugs

* formatting done

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2023-02-27 11:59:22 +05:30
07Himank
3e7f890b3f
Es update issue fix (#10289)
* elastic search update issue fix ..

* solved bug for searchSourceBuilder size

* added search request with batch size 50 per request

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-02-27 11:57:42 +05:30
Pere Miquel Brull
203e2b5fff
Simplify Pipeline Service Client Response and prep test connection for ingestion base (#10334)
* Simplify Response and prep test connection

* Format
2023-02-25 15:52:14 -08:00
Cristian Calugaru
3f61c3e05d
Issue 9064 - New Object Store Service and Container models (#10283)
* First cut of the store service model

* Second cut of the store service model

* reverted accidental rename of property

* Third version for the object container schema definition.

* final draft version for container and object store service related entities

* final first draft of api's and entities for the object store service and container

* formatting

* removed test file

* formatting

* test fixes

* formatting

* more fixed tests

* fixed tests, addressed PR comments

* added type for object store connections

* addressed PR comments

* formatting

* renamed objectstoreservice to service in schemas. Changed type to fullyQualifiedEntityName in createContainer schema
2023-02-24 16:34:08 -08:00
Mohit Yadav
960ae2918e
- Config Changes for Logo and Jwt Expiry (#10287)
* - Changes for Logo
- Make Jwt Token Expiry Configurable

* change config time

* fix tests

* review comments

* fix failing python

* moved login to application config as well

* fix login Config

* Added Nav Bar and Login Page Config for Logos

* Removed UI Api calls

* fix: unit test

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
2023-02-23 22:57:57 +05:30
Parth Panchal
cbe516b29b
Fixed#10247: Users associated with more than one team are being counted more than once (#10297)
Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
2023-02-23 18:29:29 +05:30
Pere Miquel Brull
34a54461bd
Pipeline Service Client - Pass the service to run and deploy (#10294)
* Pass de service to run and deploy

* Generalize type map

* Format
2023-02-23 11:40:18 +01:00
Parth Panchal
9bd22369d7
Fixed#10211: Enable LDAP configuration to be configured via environment variable (#10252)
* Fixed#10211: Enable LDAP configuration to be configured via environment variable

* Fixed#10211: Enable LDAP configuration to be configured via environment variable
2023-02-22 12:53:24 +05:30
Mohit Yadav
8939d81470
Update Docs (#10233) 2023-02-20 14:38:43 +05:30
Suresh Srinivas
57093e583a
Fixes #10212 User email address should be unique (#10214) 2023-02-15 21:04:23 -08:00
Deepa Rao
f16e9dcc9f
Fixes #10137 - Reorganize API documentation sections (#10172) 2023-02-14 19:32:43 -08:00
Suresh Srinivas
afad0a4769
Fixes #10123 - Change entityReference in createRequests to fullyQualifiedName (#10124)
* Change entityReference to entity name or fullyQualifiedName

* Change backend code and tests to use FQN

* UI change for using fqns instead of EntityReference

* Ingestion framework changes for using fqns instead of EntityReference

* Fix test failures

* Fixed python tests and sample data new

* fix: minor ui changes for fqn

* Fixed python integration tests

* Fixed superset tests

* fix UI tests

* fix type issue

* fix cypress

* fix name for testcase

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
Co-authored-by: karanh37 <karanh37@gmail.com>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-02-13 13:38:55 +05:30
JINZHANG2017
1f6ee4a408
update columnValueMaxToBeBetween json schema. (#10176)
Co-authored-by: Teddy <teddy.crepineau@gmail.com>
2023-02-13 06:32:32 +04:00
Nahuel
fc78d03cc4
Check if user is bot before updateOrCreate bot user (#10178) 2023-02-10 16:40:07 +00:00
Pere Miquel Brull
2a99114c94
Set the server connection when running a pipeline (#10152) 2023-02-10 15:32:05 +01:00
Suresh Srinivas
c4c660e25c
Relax data asset name restrictions to allow the special characters except "::" (#10169) 2023-02-09 21:27:08 -08:00
Parth Panchal
5c351781f5
Fixed#9427: LDAP-s support connection without MTLS (#10146)
* Fixed#9427: LDAP-s support connection without MTLS

* Fixed#9427: LDAP-s support connection without MTLS

* Fixed#9427: LDAP-s support connection without MTLS

* Fix Json Issues

---------

Co-authored-by: Mohit Yadav <105265192+mohityadav766@users.noreply.github.com>
Co-authored-by: mohitdeuex <mohit.y@deuexsolutions.com>
2023-02-09 17:42:38 +05:30
Pere Miquel Brull
1835de8bf2
Group airflowConfiguration into pipelineService config (#10120)
Group airflowConfiguration into pipelineService config (#10120)
2023-02-07 16:30:42 +01:00
Sriharsha Chintalapani
b76ec0a18f
Parallel tests (#10064)
* Staging parallel tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests

* Parallelize Tests
2023-02-06 21:26:13 -08:00
Suresh Srinivas
460a9288a7
Update project dependencies (#9978) 2023-02-06 12:41:10 -08:00
ragul balaji ravichandran
97747d9803
add GChat as alert destination (#10109) 2023-02-04 17:04:31 -08:00
krotonet
8b84ea2453
Use the primitive boolean expression (#10110)
* Use the primitive boolean expression for #7863

* Use the primitive boolean expression for #7863

* Update yarn-coverage.yml
2023-02-04 15:30:51 -08:00
Suresh Srinivas
1990ac56d9
10041 Part1 - Refactor and clean up System APIs (#10042)
* 10041 Part1 - Refactor and clean up System APIs

* Update the config resource endpoint url
2023-02-03 16:25:40 -08:00
Suresh Srinivas
3d016c46f2
Fixes #10065 Allow Unicode characters and digits in the entityName (#10066)
* Fixes #10065 Allow Unicode characters and digits in the entityName

* Use Unicode modifier (?U) to JSON schema patterns

* fix(dataModel): convert unicode modifier from uppercase to lowercase

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
2023-02-02 12:49:45 -08:00
Mohit Yadav
7b6771f1cf
Revert "Prevent Authentication bypass using Jwt Token Config in case of OM su… (#10079)" (#10083)
This reverts commit e164bbb760886ca30327a5c0fe7983341775f7d1.
2023-02-02 20:19:32 +05:30
Mohit Yadav
e164bbb760
Prevent Authentication bypass using Jwt Token Config in case of OM su… (#10079)
* Prevent Authentication bypass using Jwt Token Config in case of OM supporting token generation

* fix failing tests
2023-02-02 20:18:28 +05:30
Nahuel
b9a3c06104
Bump main branch to version 1.0.0 (#10040)
* Bump to version 0.13.2

* Bump mvn projects to 1.0.0-SNAPSHOT

* Bump python projects to 1.0.0.dev0

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2023-02-02 12:56:14 +01:00
07Himank
d989aee887
solved issue of entity followed by user not visible after editing the… (#10051)
* solved issue of entity followed by user not visible after editing the entity

* did it for all the entities

---------

Co-authored-by: Himank Mehta <himankmehta@Himanks-MacBook-Air.local>
2023-02-02 15:49:38 +05:30
Parth Panchal
5805269506
Fixed#6145: Notification for service owner when ingestion pipeline fails (#9805) 2023-02-01 12:09:58 +05:30
Deepa Rao
3beea862fa
Fixes #9975 - Add missing documentation for path params (#9990) 2023-01-31 14:36:04 -08:00
Teddy
70b4055400
fix(testSuite): removed relationship update with testCase on testSuite update (#10029)
* fix(testSuite): removed relationship update with testCase on testSuite update

* fix(testSuite): empty commit for CI
2023-01-31 10:15:08 -08:00
Teddy
ba08302ea1
Issue #7291 - Implements Table Rows Inserted to be Between test (#9813)
* staging commit

* staging commit

* refactor: partitioning logic

* refactor (tests): move to parametrized tests for test validations

* refactor: local variables into global

* (feat): Added logic for table row inserted test

* (feat): fix python checkstyle

* feature: extracted get_query_filter logic into its own function
2023-01-31 15:57:51 +01:00
Suresh Srinivas
a1b9d3fe65
Fixes 10021 - Add CSV import/export for users (#10022)
* Fixes 10021 - Add CSV import/export for users

* Fixes 10021 - Add CSV import/export for users
2023-01-30 21:34:34 -08:00
Sriharsha Chintalapani
28c8ce1386
Fix #9750: Refactor interfaces into openmetadata-spec module (#9751) 2023-01-30 11:47:30 -08:00
Sachin Chaurasiya
aa294a6a36
fix(ui) : owner dropdown for teams with search text is not working (#9921)
* fix(ui) : owner dropdown for teams with search text is not working

* chore : convert searchFormattedUsersAndTeams to async/await

* chore: use searchFormattedUsersAndTeams for owner search on add alerts page

* fix : search api call with query is not working

* fix : filter issue for team assets

* fix : cy test for alerts

* fix : cy tests

* fix: cy test

* chore: update the search query logic

* fix: cy tests

* Fix search teams with special chars

* fix localization missing for constant

---------

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
2023-01-30 09:00:18 +00:00
Suresh Srinivas
e16621b26c
Fixes #9988 - Add CSV import/export support for Teams (#9989) 2023-01-29 16:56:53 -08:00
Suresh Srinivas
d81187817a
Fixes #9986 - Add documentation support for the CSV template for imports and exports (#9987) 2023-01-29 13:47:02 -08:00
Sriharsha Chintalapani
8b45b639fd
Add table entity name pattern (#9970)
* Added ()0 to table entityName for oracle metadata

* move # character to columnName pattern

* Test newly allowed characters in table name and columns

---------

Co-authored-by: Teddy Crepineau <teddy.crepineau@gmail.com>
Co-authored-by: sureshms <srini30005@gmail.com>
2023-01-27 18:50:35 -08:00
Nahuel
813d2c4fe6
Bug: Change password of a user without auth mechanism set (#9965)
* Bug: Change password of a user without auth mechanism set

* Fix same issue for validating password
2023-01-27 18:57:51 +01:00
Teddy
1455d5eb29
Update webanalytics prometheus metrics (#9939)
* feature: added web analytic events handler

* feature: exclude web analytic events from audit logger

* empty commit to re-run CI
2023-01-27 15:51:53 +01:00
Sriharsha Chintalapani
4a5676d617
Fix #9801: ES: Search api is not returning expected result (#9948)
* Fix #9801: ES: Search api is not returning expected result

* Fix #9801: ES: Search api is not returning expected result

* Fix #9801: ES: Search api is not returning expected result
2023-01-27 10:34:00 +01:00
Nahuel
ed062c62d6
Fix: Bug when updating a topic with missing message schema (#9940) 2023-01-26 19:23:14 +00:00
Deepa Rao
d2e0e75ac4
Fixes #9930 - Add API support for delete entities by name (#9931) 2023-01-25 21:03:40 -08:00
Teddy
40111d810c
Added collect endpoint to response filters (#9884)
* fix: added collect endpoint to event filter

* fix: structure of global var EXCLUDED_ENDPOINTS
2023-01-25 10:31:25 +00:00
Nahuel
93057e476f
Fix: Superset encryption and decryption not working as expected (#9827)
* Fix superset sample data

* Update ingestion/examples/superset_data/service.json

* Update ingestion/examples/superset_data/service.json

* fix: pytest error (#9824)

* fix: pytest error

* fix: linting

* increased verbosity

* empty commit to re-run tests

* print registry and test definition set

* renamed columnValuesToBeUnique fqn

* removed print statements + verbosity

* Docs Using a Custom Ingestion Image in helm (#9835)

* Docs Using a Custom Ingestion Image in helm

* Update openmetadata-docs/content/deployment/kubernetes/index.md

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Update openmetadata-docs/content/deployment/kubernetes/index.md

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* Update openmetadata-docs/content/deployment/kubernetes/index.md

* Update index.md

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>

* fix(ui): ui changes for #9695 (#9770)

* Fix #9695: Teams show up in lower case

* changed owner advanced search filter field from name to display name

* fixed minor quick filter bug

* fixed failing cypress tests

* fixed failing unit tests

* Fixed failing cypress tests

* added comments in unit tests for better understanding of changes

* fixed failing cypress tests for advanced search

* improved logic for showing advanced search options

Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>

* Added powerbi docs for new field (#9836)

* Fix#9460: Avoid reuse inspector to get view definition (#9821)

* Avoid reuse inspector to get view definition

* Update openmetadata-sqllineage version

* Feat: Update GH action for E2E tests (#9839)

* Update E2E CI tests GH action

* Address PR comments

* Add converter for services when encypting or decrypting services objects

* Update E2E CI tests GH action

Co-authored-by: Teddy <teddy.crepineau@gmail.com>
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
2023-01-20 21:32:38 +00:00
Suresh Srinivas
89bd68cdf6
Fixes #9829 Add owner field to GlossaryTerm (#9833) 2023-01-20 12:20:25 -08:00
Suresh Srinivas
ca5e35eda2
Fixes #9783 Custom attributes descriptions are not updated (#9828) 2023-01-20 12:16:11 -08:00
Teddy
dcf220f867
fix: pytest error (#9824)
* fix: pytest error

* fix: linting

* increased verbosity

* empty commit to re-run tests

* print registry and test definition set

* renamed columnValuesToBeUnique fqn

* removed print statements + verbosity
2023-01-20 10:45:11 +01:00
Mayur Singal
939adf887b
Fix #8973: Superset fetch metadata from DB (#9645)
* Docs #8973: Superset with SSO docs

* Superset support for mysql & postgres db

* remove unwanted field from yaml

* Fix pylint

* Fix superset tests

* Fix sample data connection

* ci fix & review comments

* cypress & defualt provider fix
2023-01-19 16:39:43 +01:00