Mohit Tilala
cc4b357444
Fixes #22238 : [SAP HANA] Correction of physical schema mapping and column lookup at each layer of calculation view ( #22952 )
2025-08-19 18:45:06 +05:30
Keshav Mohta
f39f57ddcd
Fix #22340 : Execution Time Support for NiFi Connector ( #22981 )
...
* feat: added nifi execution history
* doc: added pipeline status in available features
2025-08-19 08:25:02 +00:00
Teddy
d58b8a63d6
ISSUE #1753 - Add Row Count to Custom SQL Test ( #22697 )
...
* feat: add count rows support for custom SQL
* style: ran python linting
* feat: added logic for partitioned custom sql row count
* migration: partitionExpression parameter
* chore: resolve conflicts
2025-08-19 06:40:49 +02:00
Ayush Shah
cda93b1af5
Fix formatting in OpenMetadata class docstring for clarity on field overwrite limitations ( #22965 )
2025-08-18 16:56:01 +05:30
Copilot
1d7c03ac9b
Add comprehensive documentation for entity field update limitations in OpenMetadata Python SDK ( #22865 )
2025-08-18 14:10:59 +05:30
Mayur Singal
e74de5df81
MINOR: Fix usage failure after cross lineage ( #22926 )
2025-08-13 16:30:29 +05:30
harshsoni2024
2ceffa3e5c
precede source table name before pbi table name ( #22902 )
2025-08-13 09:59:08 +05:30
Mayur Singal
23959bd21a
Fix #22164 : Fix airflow compatibility issue with version 2.2.5 ( #22897 )
2025-08-12 18:30:43 +05:30
Copilot
8cc9d2af71
Add OpenAPI YAML format support for REST API ingestion ( #22304 )
...
* Initial plan
* Implement OpenAPI YAML support with backward JSON compatibility
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
* fix tests & lint
---------
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: harshach <38649+harshach@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-08-12 18:22:41 +05:30
Mayur Singal
dc4c75ded4
FIX #21180 : Implement Cross Service Lineage ( #22665 )
2025-08-12 16:54:40 +05:30
Dog
63bc1c5f5d
Fixes #18195 : fix deprecate parameter ( #18196 )
...
* fix kafka deprecated module
* fix elasticsearch deprecated parameter
* fix trusted_certificates
* fix workflow.print_status
* fix workflow print status
* fix datime to timestamp
* fix type of trusted_certificates
* style py format
* fix import path
* revert datatime to timestamp
* format
* Fix small issues
* Fix Avro Deserializer
---------
Co-authored-by: IceS2 <pjt1991@gmail.com>
2025-08-12 08:37:00 +02:00
harshsoni2024
fceb9f3c00
issue-22425: PowerBI parse expression along with measure ( #22870 )
2025-08-12 10:17:37 +05:30
Ayush Shah
4f82ab0557
MINOR: Enhance Sample Data with Owner and Descriptions ( #22872 )
...
* Enhance Sample Data Generation: Update table and column limits, add description and owner fields to table creation requests in sample_data.py
* Refactor SampleDataSource: Improve readability by adjusting conditional formatting for owner checks in sample_data.py
* Reduced number of tables per schema to 10
* Update sample_data.py: Reduce the maximum number of columns per table from 2000 to 200 for improved data generation efficiency
2025-08-12 10:10:01 +05:30
Sriharsha Chintalapani
15b92735b9
Fix #1093 : Add Grafana Support ( #22571 )
...
* Fix #1093 : Add Grafana Support
* Update generated TypeScript types
* Grafana test fix
* Update
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Mac.lan>
2025-08-11 19:39:39 +05:30
Ayush Shah
e0e7cf21d3
MINOR: Refactor BigQuery client type hinting in bigquery_utils.py ( #22873 )
...
* Refactor BigQuery client type hinting in bigquery_utils.py
- Updated type hint for the BigQuery client to use forward declaration for better compatibility with type checking.
- Moved import statement for google.cloud.bigquery inside TYPE_CHECKING block to optimize imports during runtime.
* Refactor BigQuery client import structure in bigquery_utils.py
- Moved the import statement for google.cloud.bigquery inside the TYPE_CHECKING block to enhance type hinting compatibility.
- Adjusted the import location for better runtime performance and adherence to best practices.
2025-08-11 17:54:08 +05:30
Aleksey Stefonyak
65928c149a
MINOR - fix(elasticsearch): add None value filter ( #18711 )
...
* fix(elasticsearch.py) - add None value filter
Sometimes elasticsearch returns lists with None values in it.
To fix this issue we need to filter them out first, befor returning most relevant to the endpoint.
* fix tests
---------
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-08-06 23:52:01 +05:30
mgorsk1
956a13f3f0
feat: Enable ES Search for Databases ( #19041 )
...
* 🎉 Init
* linter
* bring back removed code for api collection
* remove comment
* fix type hint
---------
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-08-06 23:51:09 +05:30
Ariel Schulz
d31e2d8ba0
Feature/1 fix and add lineage to exasol connector ( #21399 )
...
* Add lineage to Exasol connector
* Update test_connection to return TestConnectionResult
* Add exasol tests & dependencies to tests in setup.py
* Opensearch is required for testing, so add it there
* Modify metadata
* Update documentation for lineage
* Apply formatting changes to code
* Apply make py_format
2025-08-06 23:49:38 +05:30
Akash Verma
1cc1abcd27
feature: googlesheet connector ( #22464 )
...
* feature: googlesheet connector
* updates
* minor change
* java checkstyle
* googledrive files
* fix
* make the google sheets work
* fix directory and files
* remove ui
* update generated types
---------
Co-authored-by: Akash Verma <akashverma@Akashs-MacBook-Pro-2.local>
Co-authored-by: sonika-shah <58761340+sonika-shah@users.noreply.github.com>
Co-authored-by: Akash Verma <akashverma@Mac.lan>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
2025-08-06 22:01:41 +05:30
Mayur Singal
00b6da5b84
MINOR: Improve Databricks Profiler & Test Connection ( #22732 )
2025-08-06 00:41:11 +05:30
Ayush Shah
c68ea8c83f
Enhance Ingestion Framework: Add Drive Service support and improve logging for User Profiles ( #22733 )
2025-08-05 18:17:55 +05:30
Mayur Singal
b74e181d52
MINOR: Improve Unity Catalog Usage ( #22721 )
2025-08-04 11:04:10 +05:30
Mayur Singal
fe28faa13f
MINOR: Add support for csv.gz in datalake ( #22666 )
...
* MINOR: Add support for csv.gz in datalake
* fileformat change
* Update generated TypeScript types
* pyformat
2025-08-01 17:39:19 +05:30
Mayur Singal
dfb7eeaaaa
MINOR: Improve datalake processing table log ( #22631 )
2025-08-01 15:07:37 +05:30
Nick Acosta
0a395ea487
Fixed typo referring to airbyte in Fivetran file ( #22686 )
...
Co-authored-by: Nick Acosta <nick.acosta@getcollate.io>
2025-08-01 14:49:23 +05:30
IceS2
7f8298d49e
Update DataLake and PostgreSQL connection ( #22682 )
2025-08-01 11:08:43 +02:00
MarkSaf17
58078f582c
[WIP] Issue 22627 ( #22647 )
...
* [ISSUE-22627] fix(dbt): Support documented owner configuration with backward compatibility
* typo
* added tests
---------
Co-authored-by: marsafronov <marsafronov@ecom.tech>
Co-authored-by: SumanMaharana <sumanmaharana786@gmail.com>
2025-07-31 11:02:18 +00:00
IceS2
f578a81277
MINOR: Update table profile config to add spark configs. Update spark config to add temp path ( #22646 )
...
* Update table profile config to add spark configs. Update spark config to add temp path
* Add default null value for sparkTableProfilerConfig
* Fix TableProfileConfig extension DAO query
* Update generated TypeScript types
* Implemented Dependency Injection for the ProfilerProcessorConfig
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-07-31 11:50:30 +02:00
Roman Sheludko
e098635842
fix: Remove redundant set of braces in additional_config ( #22640 )
...
After the changes in https://github.com/open-metadata/OpenMetadata/pull/22474 we've started to experience the following error:
2025-07-31 10:22:45 +02:00
Keshav Mohta
f8b588e6f0
Feature: Security Service ( #22450 )
...
* feat: security service initial code
* support secrity type for service from ui
* refactor: added missing java files for security service and require json files
* refactor: added doc file, oneOf java changes for ranger
* Merge branch 'main' of https://github.com/open-metadata/OpenMetadata into issue-20145
* update the security services schema to have domains instead of domain
* fix: added security service metadata pipeline
* Make changes for security service UI
* Update missing translation
* update type
* Fix the java checkstyle
* fix: added ingestionRunner in security service json
* Hide security service for OSS
* fix: reverse metadata documentation
* refactor: added securityConnection in test connection
* fix: documentation and ts file changes
* fix: deleted __init__ file and added SSISConnection again in the workflowclassconverter.java
* fix: convert domain to domains
* fix: added new file for basicAuth for ranger and change in rangerConnectionClassConverter.java file
* fix: java checkstyle
* fix: mysql security service sql
* fix: security service index mapping
* fix: moved migrations in new version and fix classConverterFactory
---------
Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: Aniket Katkar <aniketkatkar97@gmail.com>
2025-07-31 06:38:21 +02:00
Pere Miquel Brull
dfe3fd6357
MINOR - Data Contract Validation ( #22541 )
2025-07-30 23:01:27 +02:00
Ariel Schulz
798a20afd8
Fix test_connection to adhere to OMD standards for DB connections ( #22478 )
2025-07-31 00:29:03 +05:30
Suman Maharana
3a90b38a26
Fix: Tableau ca cert auth ( #22041 )
...
* Fix: Tableau ca cert auth
* py_format
* Added ssl tests
* fix lint errors
2025-07-30 09:38:47 +05:30
harshsoni2024
50428e2e7b
feat-22574: Datalake ingestion fix for larger files ( #22575 )
2025-07-29 20:40:19 +05:30
Suman Maharana
670dc53b46
Minor: fix tableau handle none entities ( #22630 )
...
* Minor: fix tableau handle none entities
* added tests
2025-07-29 13:58:11 +02:00
Ayush Shah
987e3ed9e0
Fixes #22144 : Enhance memory management and proper cleanup of resources in profiler ( #22438 )
2025-07-29 16:22:21 +05:30
Mayur Singal
199e3b981c
Fix #14830 : Ignore non current columns for iceberg tables for glue & athena ( #22564 )
2025-07-29 16:19:09 +05:30
Mayur Singal
cc9506db20
MINOR: Postgres Implement schema fallback ( #21858 )
...
* MINOR: Postgres Implement schema fallback
* missing sql_lineage file
2025-07-29 14:45:21 +05:30
Suman Maharana
54dcdc7d82
Fix #20689 : Trino Column validation errors for highly complex fields ( #22421 )
...
* Fix: Trino Column validation errors for highly complex fields
* addressed copilot comms
* fixed tests
* fixed tests and addressed comms
* missed file
2025-07-28 11:11:44 +05:30
Ayush Shah
1e8e38f2ca
MINOR: Custom properties Data types fix ( #22342 )
2025-07-25 18:39:53 +05:30
Mayur Singal
37b10a102f
MINOR: Improve ometa logging ( #22586 )
2025-07-25 18:26:44 +05:30
Mayur Singal
b8db86bc4f
MINOR: Fix airflow ingestion for older version ( #22581 )
2025-07-25 18:22:33 +05:30
Sriharsha Chintalapani
b0586f849f
Fix #22511 : k8s secret support for Secrets Manager ( #22516 )
...
* Fix #22511 : k8s secret support for Secrets Manager
* Update generated TypeScript types
* address comments
* pylint fix
* fix java checkstyle
* improve inCluster description in schema
* fix failing tests
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
Co-authored-by: Mayur Singal <39544459+ulixius9@users.noreply.github.com>
2025-07-24 12:40:51 +02:00
Lukas Biermann
fb601292ad
fixes 16053: implemented timeout for airflow lineage backend ( #22474 )
...
* implemented timeout for airflow lineage backend
* Delete CLAUDE.md
* linting
* restored orginal claude code file
* reimplemented the envsioned solution to address @pmbrulls feedback
* removed unsed comment
* catched issue with empty dictionary
* fixed typing error
* adapted documentation to cover new additional optional settings for airflow backend
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-22 19:29:54 +02:00
Chirag Madlani
b098395602
Data contracts support for tables & Multi Domain Migration ( #22108 )
...
* WIP - MINOR - Rule Engine
* WIP - MINOR - Rule Engine
* WIP - MINOR - Rule Engine
* WIP - MINOR - Rule Engine
* rules
* rules
* rules
* fix retrieval by entity
* test dc
* test dc
* WIP: Data contract feature
* destructure component to it's own files
* WIP contract tab
* update local
* fix test
* First iteration for multi domain support
* fix inheritance fields
* fix inheritance fields
* fix create interface
* fix few more tests
* fix indexing updates
* fix domain rel
* update domain --> domains
* merge
* fix merge
* fix csv tests and createEntity interface
* Update generated TypeScript types
* Trigger Build
* migrations
* fix tests
* fix tests
* fix tests
* Update generated TypeScript types
* Trigger Build
* handle drive service
* fix pg migration
* fix domains ref after merge and clean python tests
* Update generated TypeScript types
* fix merge domains
* format
* add missing migrations
* Update generated TypeScript types
* tests
* Update generated TypeScript types
* Trigger Build
* tests
* tests
* fix py test
* migrate domain to domains and fix compilation errors
* fix domain assignement
* fix domain spec
* fix py tests
* fix data product creation issue
* fix domain tests
* fix bulk import
* fix tests
* fix tests
* fix query and domain migration
* fix py test
* fix playwrights
* fix getEntitiesWithDisplayName indexing quotes
* fix domain prapogation tests
* fix domain propagation
* Fix patch api
* fix domain schema build edit playwright
* fix test
* fix test
* fix domain selection issue and console errors
* quick fix landing page changes
* fix remaining tests
* fix ui tests
* Fix adding data products
* format
---------
Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sriharsha Chintalapani <harsha@getcollate.io>
Co-authored-by: Sriharsha Chintalapani <harshach@users.noreply.github.com>
2025-07-22 09:34:50 +02:00
Teddy
9a1fedf2a0
feat: pass GX description on test case creation ( #22481 )
2025-07-21 17:57:26 +02:00
Mohit Tilala
64ec471e52
Fixes #22363 #22369 : Stored procedure temp table processing and lineage filtering with db & schema ( #22416 )
...
* Process temp table graph in stored procedure processor and add db/schema filtering on lineage
* Add tests for stored procedure lineage processing
* Fix tests and py_format
* Fix the filters and log stored proc query count info
2025-07-18 12:32:22 +05:30
Teddy
4a264e7a3a
feat: improve test result details for GX integration ( #22424 )
2025-07-17 15:41:29 +02:00
Suman Maharana
9838278ac4
Add: Schema and Database Mark Deletion ( #22088 )
...
* Added Schema and Database Mark Deletion
* removed unnecessary changes
* fixed marked deleted databases
* Added to all db connectors
* Added generated types
* Added tests
2025-07-15 16:26:46 +02:00
Suman Maharana
5b3bb637fb
Fix: Postgres query column name for exec time ( #22366 )
2025-07-15 12:58:53 +00:00
