sonika-shah
687b564ef6
GEN-1501 : Fix aggregation results on displayName.keyword for dataAssets ( #18569 )
2024-11-11 10:55:56 +05:30
Siddhant
2d6e21d7a9
fix postgres query. ( #18568 )
2024-11-10 09:22:23 +00:00
Pere Miquel Brull
92b9f44bf8
MINOR - Update Lineage Propagation Config ( #18486 )
...
* MINOR - Update Automator Lineage Propagation configs
* naming
* options
* Ignore metastore_db
* toggle parent propagation
* toggle parent propagation
2024-11-10 09:38:39 +01:00
Sriharsha Chintalapani
e7632428f4
Minor: Return pagination of for listHierarchy ( #18567 )
2024-11-09 23:28:52 -08:00
Sriharsha Chintalapani
a03d915909
Minor: JsonUtils.extractValue shouldn't throw exceptions ( #18554 )
2024-11-09 09:45:07 -08:00
Siddhant
9d9eccedda
Debuggability Improvements and Fixes ( #18564 )
...
* fix: list records from latest to earliest.
* refactor: remove listing unprocessed events from listEvents API.
* refactor: EventSubscriptionDiagnosticInfo.
2024-11-09 16:40:11 +01:00
Mayur Singal
b02c64931e
MINOR: Fix table not found error ( #18560 )
2024-11-09 20:33:32 +05:30
Sriharsha Chintalapani
7f5f47f618
Add export apis back and new apis should be called exportAsync ( #18552 )
...
* Add export apis back and new apis should be called exportAsync
* ui: use exportAsync endpoint for export assets
* fix build failure
---------
Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
Co-authored-by: sonikashah <sonikashah94@gmail.com>
2024-11-08 10:35:02 -08:00
Siddhant
2f39b76c33
Fix Fetching Successfully Sent Change Events For Debuggability API ( #18493 )
...
* fix getSuccessfullySentChangeEventsForAlert
* migrations.
* offset-based pagination
* add startingOffset in EventSubscriptionDiagnosticInfo
* fix missing paginationOffset
* Record successfully sent change events in a separate table, clean up associated successful and failed records on alert deletion.
* Remove oldest 30 records if record count reaches 100 for successful_sent_change_events.
* list unprocessed changeEvents based on alert subscription rules, ensuring only relevant unprocessed events are listed.
* refactor: enhance eventSubscriptionDiagnosticInfo
Added new fields to the eventSubscriptionDiagnosticInfo schema to support detailed diagnostics:
- `relevantUnprocessedEventsCount`: Count of relevant unprocessed events based on alert filtering rules.
- `relevantUnprocessedEventsList`: List of relevant unprocessed events based on alert filtering rules.
- `totalUnprocessedEventsCount`: Count of all unprocessed events.
- `totalUnprocessedEventsList`: List of all unprocessed events.
* Refactor: delete 30 oldest records per alert when the count reaches 100 records
* fix: table creation issue in PostgreSQL
* fix tests.
* scheduleCleanupJob
* remove in-line deletion of records.
* fix postgres table structure issue.
2024-11-08 12:47:16 +01:00
Prajwal214
c05a8ab6be
Docs: Removing Roadmap from collate docs ( #18561 )
...
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-11-08 16:28:49 +05:30
RounakDhillon
3da543ceaa
Docs: Images Updation for Usage and Ingestion in Connectors ( #18518 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-08 16:06:04 +05:30
RounakDhillon
0d106469a1
Docs: Connectors Missing Tile Addition ( #18559 )
2024-11-08 15:33:27 +05:30
RounakDhillon
4fe832f6b5
Docs: Connectors Order Correction ( #18557 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-08 14:03:00 +05:30
Prajwal214
7a68f626a1
Docs: Adding logo for MSTR, Qlik Cloud & dbtCloud ( #18555 )
...
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-11-08 12:34:15 +05:30
Prajwal214
90e7496e53
Docs: Fixing connector Docs for MicroStrategy ( #18538 )
...
* Docs: Fixing connector Docs for MicroStrategy
* Update index.md
---------
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-11-08 12:19:57 +05:30
Suman Maharana
da039b197f
Add: Azure Data factory Connector ( #18543 )
...
* Added Azure Data factory Connector
* Added Lineage data factory
* removed not required files
* removed not required files
* Removed datafactory ui changes from oss
* resolve merge conflicts
* resolve merge conflicts
* added python requirements
2024-11-08 07:38:45 +01:00
Imri Paran
b92b950060
Fix 18434: feat(statistics-profiler): use statistics tables to profile trino tables ( #18433 )
...
* feat(statistics-profiler): use statistics tables to profile trino tables
- implemented the collaborative root class
- added the "useStatistics" profiler parameter
- added the "supportsStatistics" database connection property
- implemented the ProfilerWithStatistics and StoredStatisticsSource to add this functionality to specific profilers
- implemented TrinoStoredStatisticsSource for specific trino statistics logic
* added ABC to terminal classes in collaborative root
* fixed docstring for TestSuiteInterface
* reverted unintended changes
* typo
2024-11-07 18:37:31 +01:00
Shrushti Polekar
f60e113026
name column sorting functionality for tables ( #18547 )
2024-11-07 22:55:51 +05:30
Imri Paran
a237ebf5f8
fix(profiler): disable view by default ( #18478 )
...
profiling views is considered advanced configuration and should only be enabled explicitly by users who have a specific requirement for this feature.
https://docs.open-metadata.org/latest/how-to-guides/data-quality-observability/profiler/workflow#1.-profile-what-you-need
2024-11-07 16:21:27 +00:00
Pranita Fulsundar
76c017a8aa
GEN-2009: update the delete message for ingestion pipeline ( #18546 )
2024-11-07 21:40:27 +05:30
harshsoni2024
01208ef4b4
Connector: add stitch schema ( #18452 )
2024-11-07 21:08:41 +05:30
Shailesh Parmar
198dd35cc1
Minor: style improvement for DataStatisticWidget ( #18544 )
2024-11-07 19:09:03 +05:30
RounakDhillon
0485e48db6
Docs: Images Updation for Connectors ( #18545 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-07 18:19:30 +05:30
RounakDhillon
d8d3fe7b03
Docs: Images Updation for Lineage in Ingestion ( #18528 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-07 18:13:50 +05:30
RounakDhillon
4e272f606b
Docs: Glossary Section Images Updation ( #18457 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-07 18:12:34 +05:30
RounakDhillon
f12dcdc0a3
Docs: Images Updation for dbt in Ingestion ( #18542 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-07 18:02:04 +05:30
sonika-shah
e0d175f78e
GEN-1894 GEN-771 : Improvement - Add displayName field for custom property ( #18496 )
2024-11-07 16:59:59 +05:30
Imri Paran
729a06b5f0
fix: use enum.Enum instead of sqlalchemy enum ( #18464 )
2024-11-07 11:42:03 +01:00
Sriharsha Chintalapani
9efe137466
add offset limits to hierarchy listing ( #18515 )
2024-11-07 15:22:11 +05:30
Mayur Singal
8d40d8ea77
MINOR: Fix Materialized View Lineage ( #18539 )
2024-11-07 09:21:54 +01:00
Chirag Madlani
6fa76ecde9
feat: persona based customisation for glossary and glossary term pages ( #18454 )
...
* Initial schemas for UI customization
* feat(ui): persona customization for entity details page
including Glossary & Glossary term detail page too
* WIP glossary term details page customization
* update persona epic
* WIP persona customization
* fix errors and warning
* WIP personalize glossary term
* WIP persona
* WIP glossary terms customization
* WIP glossary terms customization
* update glossary term customization
* remove glossary term reference from generic component
* use more of generic provider
* improved UI UX for customization
* complete glossary term customization
start with glossary customization
* apply backend linting
* support customization for glossary page
* fix issue with new tab on glossary page
* address feedbacks
* fix tests
* fix playwright for customize landing page
* fix tests
* fix tests
* address sonar errors
* fix glossary test
* fix glossary test
* fix failing playwright tests
* address comments
* fix conflict error
* add more widgets
---------
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
2024-11-07 11:13:12 +05:30
Onkar Ravgan
30fdf8de0b
[ER Diagrams]: Fix EntityRelationship data disappeared after reindexing ( #18477 )
...
* fix er diag reindex
* fix col index mapping
2024-11-06 10:25:26 -08:00
Sachin Chaurasiya
305f02c62a
Minor: improve the entity export modal feedback message ( #18526 )
2024-11-06 21:05:07 +05:30
Shailesh Parmar
b43c2ba4bd
Refactor: Improvement for data quality overview tab ( #18523 )
...
* Refactor: Improvement for data quality overview tab
* unite test for new component
* minor improvement
* remove unused icon
2024-11-06 20:59:54 +05:30
Mayur Singal
66cf003cc3
MINOR: Fix pytest 3.11 taking 2hr ( #18533 )
2024-11-06 19:28:48 +05:30
Aniket Katkar
5863c7e235
Add what's new content for 1.5.11 ( #18534 )
2024-11-06 18:53:14 +05:30
Siddhant
36025377fa
fix dependency. ( #18536 )
2024-11-06 14:02:12 +01:00
sonika-shah
1ade1d4eb6
GEN-1937 : Fix - User count doesn’t update on adding to the team while using search ( #18516 )
2024-11-06 16:13:23 +05:30
Karan Hotchandani
3dcbeb469f
App settings - lineage config ( #18522 )
...
* add lineage settings page
* update locales
* minor ui changes
* add playwright for lineage config
2024-11-06 10:26:18 +00:00
Mayur Singal
f813ab730e
MINOR: Airflow dependency Fix ( #18530 )
2024-11-06 15:51:43 +05:30
Teddy
d579008c99
GEN 1683 - Add Column Value to be At Expected Location Test ( #18524 )
...
* feat: added column value to be in expected location test
* fix: renamed value -> values
* doc: added 1.6 documentatio entry
* style: ran python linting
* fix: move data packaging to pyproject.yaml
* fix: add init file back for data package
* fix: failing test case
2024-11-06 11:17:13 +01:00
Sriharsha Chintalapani
f1ebe816b0
Minor: lineage settings should be readable by all users ( #18529 )
2024-11-06 15:05:32 +05:30
Mayur Singal
5660a751e3
GEN-2000: Add Support for PowerBI Report Server ( #18513 )
2024-11-06 14:55:05 +05:30
Siddhant
4d8b303447
fix tests. ( #18519 )
2024-11-06 11:37:38 +05:30
Prajwal214
e5764fbb49
Docs: Adding Connector Docs for MicroStrategy & Lightdash ( #18527 )
...
Co-authored-by: Prajwal Pandit <prajwalpandit@Prajwals-MacBook-Air.local>
2024-11-06 11:34:37 +05:30
Suman Maharana
426ad2000b
Fix #17778 : Databricks query run optimisation ( #18467 )
...
* Fix : Databricks query run optimization
* Fixed dialect error
* fix get columns
* py format
---------
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2024-11-06 10:10:01 +05:30
RounakDhillon
fffd5e593e
Docs: Images updation For Managing Team in Admin Guides ( #18514 )
...
Co-authored-by: Rounak Dhillon <rounakdhillon@Rounaks-MacBook-Air.local>
2024-11-06 10:05:12 +05:30
IceS2
dccba20101
Return s3 endpoint as str() instead of Url ( #18521 )
2024-11-05 17:39:50 +00:00
Sriharsha Chintalapani
e9a888fce7
Fix tests ( #18494 )
...
* Fix TestCaseResource testCaseInheritedFields
* Fix TableResourceTest
* Fix tests
* remove setInheritedFields in listing of search entities
* Fix tests
* remove unique entity name creations
* add specific names in search listing tests
* add large size for fetching from ES, as other tests adds to the table_search_index
* Fix tests
* fix tests
2024-11-05 08:55:02 -08:00
Katarzyna Kałek
47c75fe6a7
Enhanced Glue ingestion with external table features ( #18511 )
...
* added fileFormat, locationPath and external table lineage to Glue ingestion
* Improve Lineage Label
---------
Co-authored-by: Katarzyna Kałek <kkalek@olx.pl>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2024-11-05 21:48:20 +05:30
