5395 Commits

Author SHA1 Message Date
Mayur Singal
18cd1c99ca
Add queries in sample data for lineage (#8674) 2022-11-14 13:11:16 +05:30
Mayur Singal
01bc9f1cfe
Fix PyMSSQL Version (#8696) 2022-11-14 08:40:41 +01:00
Sriharsha Chintalapani
895a123f81
Add restore method for metadata resource (#8695) 2022-11-13 23:18:28 -08:00
Mayur Singal
c3fd972813
Docs #8501: Added 0.12 to 0.13 upgrade docs (#8502) 2022-11-14 12:38:58 +05:30
Yandisa Ntlahla
e9a120dafa
small letter was corrected on features (#8691) 2022-11-14 07:45:57 +01:00
Sriharsha Chintalapani
9e34cb8440
Fix #8416: Restore Entities after soft delete with all it's old data (#8635) 2022-11-13 10:16:01 -08:00
Milan Bariya
ebfb872e16
Fix: Filter Datalake empty files (#8677) 2022-11-13 22:09:29 +05:30
Mohit Yadav
a20945e13f
Added pipelineTypes (#8692)
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config

* Add Amundsen config

* Changed SystemService to MetadataService

* Change to MetadataConnection

* Fixed failing test

* Fixed Failing test

* Added Metadata Service Test

* Bootstrapped Openmetadat service

* checkstyle fix

* circular import fix

* circular import fix

* Fix FileNames Issue causing pytest failures and mismatch in connection name due to Java Class

* add dataInsight Pipeline

* Add DataInsight + elasticSearchReindexing Pipeline Types
2022-11-13 21:41:41 +05:30
Pere Miquel Brull
34ba9d95c5
Ingestion Pipeline deployed, Athena tests and pydantic extras (#8682)
* Always run python tests

* Fix athena tests and types

* Update deployed prop in IngestionPipeline

* Fix #8554

* Format

* Use true as default deployed migration

* Remove repeated req

* Pydantic wiggle room
2022-11-13 11:59:43 +01:00
Suresh Srinivas
6306c9ac8d
Fixes #8688 Enforce mutuallyExclusive tag labels (#8689) 2022-11-12 18:44:17 -08:00
Suresh Srinivas
1db6f1c8a0
Simplify EntityRepository store method (#8690) 2022-11-12 14:11:30 -08:00
Shailesh Parmar
9bd0dbb67d
Fixed Add Partition Setting in UI for Profiler #8624 (#8673)
* Fixed Add Partition Setting in UI for Profiler #8624

* addressing comments
2022-11-12 19:23:52 +05:30
Suresh Srinivas
4d15696d71
Fixes #8506 Build tag and glossary term cache and use it instead of database lookups in list operations (#8686) 2022-11-11 14:51:41 -08:00
Aniket Katkar
072e190dd3
Fix(UI)#8659: Fixed issue with wrong link for custom attributes in activity feed (#8668)
* Fixed issue with wrong link for custom attributes in activity feed

* Function to get customAttributes path removed and used already existing function
2022-11-12 00:30:49 +05:30
Aniket Katkar
5972570f61
fixed tour flow failing on step 4 (#8667) 2022-11-12 00:28:57 +05:30
Mohit Yadav
4dc24b904f
python fix circular import (#8670)
python fix circular import (#8670)
2022-11-11 17:03:43 +01:00
NiharDoshi99
6da01b13a9
Changed format for s3 staging (#8632) 2022-11-11 12:15:37 +01:00
Pere Miquel Brull
dae85e92bd
Do not check labels on push (#8672) 2022-11-11 12:13:23 +01:00
Onkar Ravgan
eee3f9ffec
Fix:#8553 Parse Avro/Protobuf/Json schemas (#8654)
* Added topic parsers

* Fixed pylint

* Addressed review comments

Co-authored-by: Onkar Ravgan <onkarravgan@Onkars-MacBook-Pro.local>
2022-11-11 16:35:09 +05:30
Pere Miquel Brull
03c1c005cf
Add Workflow label verification for CI (#8653)
* Add labeler

* Update verify with comment

* Add label verification

* Add label verification

* Update .github/teams.yml
2022-11-11 11:25:59 +01:00
Pere Miquel Brull
ff028a6eb0
Fix Mysql bigint (#8665)
* Fix mysql bigint cast

* Remove upgrade from dockerfiles
2022-11-11 10:12:23 +01:00
Nahuel
91d0460b27
Fix#8577: Refactor part of the secrets manager implementation (#8617)
* Removed part of the secrets manager implementation in the server side

* Removed part of the secrets manager implementation in the openmetadata python library side

* Remove deprecated test

* Address pylint checks

* Address new pylint checks

* Address PR comments

* Fix import on airflows apis

* Clear singleton instances for running Ometa secrets manager test
2022-11-11 09:59:15 +01:00
Mayur Singal
5476879c51
Fix #8651: Fix Hive Table Descriptions (#8652)
* Fix #8651: Fix Hive Table Descriptions

* Removed pandas
2022-11-11 09:57:32 +01:00
Mayur Singal
8c7c08ae5d
Fix py-cli-e2e-tests (#8662) 2022-11-11 08:55:34 +01:00
Mohit Yadav
2dbd43a589
Added MetadataServices for creating DataInsight and ElasticSearch Reindex (#8565)
* Added SystemServices for creating DataInsight and ElasticSearch Reindexing Pipeling with Sink config

* Add Amundsen config

* Changed SystemService to MetadataService

* Change to MetadataConnection

* Fixed failing test

* Fixed Failing test

* Added Metadata Service Test

* Bootstrapped Openmetadat service

* checkstyle fix
2022-11-11 13:16:54 +05:30
Sachin Chaurasiya
2c430d1c7e
Fix #8642 Session ID is not unique across users (#8660) 2022-11-11 12:05:40 +05:30
Shailesh Parmar
54808a027e
Feat: Added functionality to connect node by dragging and dropping from anywhere on node (#8631)
* Feat: Added functionality to connect node by dragging and dropping from anywhere on node

* fixed rectflow warning

* updated selected node's edge style

* addressing comment
2022-11-11 11:58:10 +05:30
Teddy
9d594efcb5
Fixes #8473 - Implements KPI Workflow (#8657)
* Added KPI workflow logic

* Update ingestion/src/metadata/data_insight/runner/run_result_registry.py

* ran py format

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-11 06:35:33 +01:00
Sam Firke
6ba5f7ec90
cast to bigint to avoid overflow when summing (#8655)
* cast to bigint to avoid overflow when summing

fixes #8430

* Update ingestion/src/metadata/orm_profiler/orm/functions/sum.py

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
2022-11-11 06:33:38 +01:00
Suresh Srinivas
86c3ae30f1
Fixes #8596 Introduce mutually exclusive tags and glossary terms (#8597) 2022-11-10 16:47:21 -08:00
Chirag Madlani
d4b2621e9d
fix(ui): pipelineDetails page update (#8582)
* fix(ui): pipelineDetails page update

* fix Lineage and Activity & Task tab UI

* complete ui changes for pipelineDetails

* fix failing tests
add localizations

* fix tree view on execution tab

* fix wrapping for tree nodes

* comment addressed

* added missed localization

* add test ids for tabs

* fix cypress failing for ingestion

* fix missing condition
2022-11-10 21:37:35 +05:30
Sachin Chaurasiya
2e158237ea
Feat #8639 UI : Show charts latest value in data insight overview card and rename datasets to data assets (#8641)
* Fix #8639 UI : Show charts latest value in data insight overview card and rename datasets to data assets

* Add data summary for entities chart

* Add Percentage symbol for Percentage chart

* Add web charts summary data

* Address review comments

* Change active user index
2022-11-10 21:18:49 +05:30
Aniket Katkar
b2e2d9cff3
Worked on UI improvements from #8513 (#8647) 2022-11-10 20:02:57 +05:30
Aniket Katkar
af3a0df7ba
Fix(UI) #8549: Fixed issue with URL in the description breaking due to characters limit. (#8604)
* - Fixed issue where url was breaking in the description preview due to character limit
- Added localization in RichTextEditorPreviewer

* changed the limit of max description characters to show in preview

* Fixed failing unit tests

* Worked on comments

* - Fixed errors
- Improved the function to trim the description for preview

* Fixed failing unit tests
2022-11-10 19:47:23 +05:30
Aniket Katkar
a6822aa094
Fix(UI): Explore page bugs (#8607)
* - Made  changes to show more information about tables in data card on explore page
- Fixed bugs related to entity summary panel

* Replaced Space components for vertical flex with Row and Col for ColumnSummary
2022-11-10 13:32:37 +01:00
Pere Miquel Brull
3e3cf971c2
Add maven CI permissions (#8646) 2022-11-10 13:32:17 +01:00
Pere Miquel Brull
d5ac72c591
Revert "Add PR approval wait (#8640)" (#8644)
This reverts commit cc2973e61c231c5681d5fb29f387330600f2cbd4.
2022-11-10 11:21:59 +01:00
Teddy
199b342288
Fixes #8135 - Implement partitioning config for profiler (#8623)
* Added logic to handle partitioning config in profiler

* extracted get_partition_details out of workflow classes
2022-11-10 10:54:31 +01:00
Pere Miquel Brull
cc2973e61c
Add PR approval wait (#8640) 2022-11-10 10:53:48 +01:00
Sachin Chaurasiya
43ea44a0f9
Feat (#8161) Implement logic to fetch report data part-2 (#8605)
* Feat (#8161) Implement logic to fetch report data part-2

* Fix _get_user_details should return dict not None Type

* Format average session

* Make user name clickable

* Add provision for showing percentage symbol in graph tooltip

* Add summary support for entities

* Fix format issue

* Fix unit tests

* Fix labeling issue

* Add PageViewsByEntities chart

* Add DailyActiveUsers chart

* Add description to charts

* Fix unit tests

* remove startTs Overriding

* Address review comment
2022-11-10 09:56:04 +01:00
Mohit Yadav
b4e5f6ec13
Emailing Task and Test Notification (#8626)
* Emailing Task Notification [WIP]

* Emailing Test Result to Owners of table in case it is enabled
2022-11-10 14:22:44 +05:30
Pere Miquel Brull
33b395a6f7
Remove approval check (#8637) 2022-11-10 09:19:04 +01:00
Pere Miquel Brull
f7cdd31a15
Fix Workflows approval permissions (#8636)
* Add permissions and approval flow

* Approval fmt
2022-11-10 09:12:56 +01:00
Pere Miquel Brull
8a73d7e855
Add permissions and approval flow (#8625) 2022-11-10 09:03:08 +01:00
Mayur Singal
5d4f4a819f
Fix #8600: Add SQL query in lineage (#8603) 2022-11-10 08:25:23 +01:00
Shailesh Parmar
1a31baa2f9
Feat: Added Search functionality for lineage (#8609)
* Feat: Added Search functionality for lineage

* fixed edit mode search box overlap issue

* addressing comments
2022-11-10 12:27:15 +05:30
NiharDoshi99
283200449b
changed logic for parsing version (#8606) 2022-11-10 12:17:33 +05:30
Sachin Chaurasiya
4407c75e28
Fix typo in KPI json schema (#8629) 2022-11-10 10:57:40 +05:30
Pere Miquel Brull
600aecbdf8
Bump bind9 bullseye version for ingestion container (#8619)
* Bump bind9 bullseye version

* Remove bind9 fixed version
2022-11-09 21:17:20 -08:00
Pere Miquel Brull
acac1c1dcc
Java checkstyle add missing ref (#8622)
* Add approval workflow

* Add approval workflow

* Add java checkstyle ref

* Remove depth
2022-11-09 17:34:45 +01:00