yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-09-25 17:04:54 +00:00
Code Issues Packages Projects Releases Wiki Activity
6,779 Commits 812 Branches 164 Tags
Commit Graph

1624 Commits

Author SHA1 Message Date
Ayush Shah
9e0a84e904
Fix Profiler Workflow infinite loop (#12185) 
* Fix Profiler Workflow infinite loop
 2023-06-27 20:19:02 +05:30
Ayush Shah
81a152140c
fix connection kwargs error in profiler (#12181) 2023-06-27 19:44:53 +05:30
Pere Miquel Brull
c22c5871f8
Update logging messages for JWT tokens (#12169) 2023-06-27 12:32:08 +02:00
Teddy
45a5ff49c8
fix: check on undefined bool value of clause (#12162) 2023-06-26 20:31:37 +02:00
Pere Miquel Brull
a9135e8db5
Mask queries, Table sample data and Topic sample data (#12139) 
* Filter out PII queries

* Mask topic PII

* Mask topic PII

* Update sample data test

* Format

* Moved logic to repository or PIIMasker

* Fix test

* chore(ui): update sample data api endpoint for topic

---------

Co-authored-by: Sachin Chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2023-06-26 11:47:39 +02:00
Ayush Shah
29d3de2520
Move Top Level Imports (#12145) 2023-06-26 11:54:25 +05:30
Mayur Singal
a3fd6e9522
Fix #11659: Add support for filter patterns in dbt workflow (#12063) 2023-06-26 11:30:35 +05:30
Mayur Singal
18c8eb318e
Databricks Support Table Constraints (#12138) 
* Databricks Support Table Constraints

* pylint fix

---------

Co-authored-by: Pere Miquel Brull <peremiquelbrull@gmail.com>
 2023-06-26 07:01:53 +02:00
Mayur Singal
7d1b123efe
Fix atlas lineage custom db name issue (#12108) 
* Fix atlas lineage custom db name issue

* Fix test
 2023-06-25 19:16:00 -07:00
Onkar Ravgan
3a9d8a9a45
powerbi loop bug fix (#12120) 2023-06-25 18:20:59 +02:00
Pere Miquel Brull
97e08ee25c
Fix #12106 - Fix looker chart sourceUrl & Array datatype handling (#12113) 
* Fix looker chart url

* Handle array datatype

* Handle array datatype
 2023-06-25 08:18:36 -07:00
Aniket Katkar
67ffa1cce3
fix(UI): reverted the ES config step for 'Data Insights Pipeline' (#12121) 
* Reverted the ES config step for Data Insights pipeline

* es sink fixes for ingestion

---------

Co-authored-by: Chirag Madlani <12962843+chirag-madlani@users.noreply.github.com>
Co-authored-by: ulixius9 <mayursingal9@gmail.com>
 2023-06-24 18:15:51 +05:30
Onkar Ravgan
d9d3f6895b
Fix 6874: Added Support for lineage from dbt ephemeral nodes (#12101) 
* fixed dbt ephemeral nodes lin

* fixed dbt tests
 2023-06-23 10:01:22 +02:00
Mayur Singal
258a2e33e2
Fix #12078: Add clientSessionKeepAlive Field for snowflake (#12107) 2023-06-23 10:00:53 +02:00
Pere Miquel Brull
b5c4d5a9d3
Fix #10175 - Add Oracle lineage and usage (#12090) 
* Add Oracle lineage and usage

* Add docs

* Add examples
 2023-06-23 06:52:34 +02:00
Teddy
6f33465b7c
fix: move service retrival to workflow (#12109) 2023-06-23 06:40:32 +02:00
Ayush Shah
cb6e42941a
Fix 12025: Clickhouse NaN issue (#12079) 2023-06-22 12:51:56 +05:30
Onkar Ravgan
5197682921
Fixed dagster bugs and Added Pydantic Models (#12048) 2023-06-22 10:59:09 +05:30
Onkar Ravgan
78d7faf04a
Added Azure Blob Storage to dbt config (#11839) 2023-06-22 10:58:38 +05:30
Pere Miquel Brull
3b8e5e69fd
Fix #12056 - Clean verbose debug logs (#12060) 
* Clean verbose debug logs

* Format

* Remove unnecessary test

* remove verbosity
 2023-06-22 06:54:09 +02:00
Teddy
1e86b6533c
Fixes #11743 - Remove SQLParse dependency for System Metrics (#12072) 
* fix: removed sqlparse dependency for system metrics

* fix: update sample query

* fix: move system test os retrieval to `.get()`

* fix: move os.environ to `get`
 2023-06-22 06:51:24 +02:00
Onkar Ravgan
8fac9d8976
Added Powerbi Lineage across workspaces and datamodel projects (#12052) 
* powerbi lin multiple workspace

* Addressed review comments
 2023-06-21 17:16:09 +02:00
Onkar Ravgan
0cfd8d29c5
Added dbt test_metadata check (#12067) 2023-06-21 12:17:26 +02:00
Ayush Shah
9fa7b78d87
Issue 11686: Add IncludeOwner + scheduleInterval in Airflow (#12005) 2023-06-21 14:18:45 +05:30
Onkar Ravgan
47514f6c5f
Fixed dbt test col name (#12065) 2023-06-21 10:47:54 +02:00
Mayur Singal
c3cec54be9
Fix for #11807 Part 2: Add SourceUrl for table entity (#12013) 
* Fix #11807 Part 2: Add SourceUrl for table entity

* address review comments: centralize sourceurl

* remove qlick

* pytest fix

* fix typo
 2023-06-20 11:46:45 +02:00
Pere Miquel Brull
8751427679
Add project to Data Models JSON Schema & Implement in Looker (#12030) 
* Add project to dashboards and models

* Add project to dashboards and models

* Update openmetadata-spec/src/main/resources/json/schema/entity/data/dashboardDataModel.json

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>

* Update openmetadata-spec/src/main/resources/json/schema/api/data/createDashboardDataModel.json

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>

* Fix tests

---------

Co-authored-by: Onkar Ravgan <onkar.10r@gmail.com>
 2023-06-20 11:45:29 +02:00
Mayur Singal
2738310887
Fix #12012: Fix clickhouse usage schema_name error (#12032) 2023-06-20 11:41:28 +05:30
Ayush Shah
83e9b6c310
Fixes 10395: Validation of yaml workflow configs (#11985) 2023-06-20 11:20:59 +05:30
Onkar Ravgan
f07c421264
Removed Empty Description Assignment to entities and added database name logic to tableau (#12031) 2023-06-19 19:19:42 +05:30
Teddy
76f5d3d571
Fixes #11994 - Update dbt and GE integration with new DQ flow (#12018) 
* feat: updated GE integration to match new test workflow

* feat: updated unit tests to match new signature

* feat: added GE integration tests

* feat: ran python linting

* feat: updated dbt ingestion to match new TestSuite workflow

* feat: ran python linting

* feat: remove testSuite from Elasticsearch event test case update

* feat: ran java linting
 2023-06-19 15:05:51 +02:00
Pere Miquel Brull
7d39584bc9
Fix Airflow callback import (#12008) 2023-06-19 11:39:23 +02:00
Onkar Ravgan
d6d721225d
Fixed mark deleted all dbs (#11996) 2023-06-19 12:59:13 +05:30
Mayur Singal
8ecd88fd1b
Fix #11312: Deprecate ES Reindex on Ingestion and use reindex APIs instead (#11988) 2023-06-19 12:45:18 +05:30
Teddy
bc76515a6b
fix: release connection from engine pool (#12006) 2023-06-16 16:49:55 +02:00
Ayush Shah
f80eaf3a26
Fixes 11068: mysql & postgres iam auth (#11937) 2023-06-16 13:18:12 +05:30
Teddy
3f01ee938f
Fixes #11895 - Add Indexing and Search logic for TestCases (#11989) 
* feat: added logic to delete logical test suite + added check to prevent adding existing testCases to executable test suite

* feat: added elasticsearch index logic for testCases

* feat: added deletion logic from index logic when deleting test suites

* feat: added test case index search to  endpoint

* feat: add executable/logical filter in list testSuite + filterOut tables without tests in Table resource

* feat: added summary field to testSuite

* feat: added executionSummary endpoint for test cases

* feat: removed tick marks around timestamp

* feat: addressed test failures

* feat: ran python linting

* feat: add limit to fetch all tables in TableResource testSuite test

* feat: fix conflict

* feat: ran java checkstyle

* feat: fixed mongo linting + disabled mongo failing tests

* feat: removed mongo test skip

* feat: removed unsued pytest import
 2023-06-15 21:27:54 +02:00
Onkar Ravgan
d08c928801
Added project property to dashboards (#11986) 
* Added projects to dashboards

* Added powerbi proj

* merge conflicts after source url

* fixed mongo pytest
 2023-06-15 21:23:43 +05:30
Mayur Singal
82a0222257
SourceUrl changes for dashboard, pipeline & chart entities (#11991) 2023-06-15 14:44:48 +05:30
Mayur Singal
7fa963eec3
Fix #1076: Add mongodb support (#11943) 2023-06-15 11:14:22 +05:30
YAMADA Yutaka
63e8aa57ce
Fixes #11955: Modify URL to register with Airflow Lineage Backend (#11956) 
* fix: include host_port in url

* fix: run make py_format
 2023-06-14 14:06:01 +02:00
Onkar Ravgan
d409c339e4
Fix 10689: Added Powerbi Datamodels (#11923) 2023-06-14 17:00:08 +05:30
Onkar Ravgan
81ec95ab27
dbt test value fixed (#11948) 2023-06-13 10:54:32 +05:30
Pere Miquel Brull
095f15064c
Fix #11752 - Multiple inlets in AirflowLineageOperator (#11945) 
* Fix multiple inlets in AirflowLineageOperator

* Update dag file
 2023-06-12 07:01:19 +02:00
Mayur Singal
05dc42bdb8
Fix #11808: Handle lineage for single db sources in superset (#11933) 2023-06-09 12:43:06 +05:30
Onkar Ravgan
caabe89f9c
Centralize tags ingestion logic (#11880) 2023-06-09 10:45:53 +05:30
Onkar Ravgan
66aa28a3ee
Added check for parent nodes (#11911) 2023-06-08 10:50:11 +05:30
Teddy
8dfa640a82
fix: check for empty description strings (#11914) 2023-06-07 12:49:29 +02:00
Mayur Singal
9e6e00caf9
Fix #9282: Support Databricks Unity Catalog (#11896) 2023-06-07 11:50:31 +05:30
Sriharsha Chintalapani
2b2602b76b
Fix column resize to limit to 128 chars (#11889) 
* Fix column resize to limit to 128 chars

* Fix pyformat issue

* replace column_name with col_name

---------

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2023-06-07 07:24:08 +02:00