yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-07 16:48:02 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,395 Commits 705 Branches 151 Tags
Commit Graph

1489 Commits

Author SHA1 Message Date
Ayush Shah
47a97e7be0 FQN changed from bigquery to bigquery_gcp 2021-11-29 16:57:39 +05:30
Matt
09634e1a79 Populate service name correctly for Location as part of s3 ingestion 2021-11-29 02:05:24 +01:00
Sriharsha Chintalapani
be9195317b
Fix #1443: sample-usage ingestion is broken (#1444) 2021-11-28 14:25:55 -08:00
Matt
ededd58e25 Add ingestion for S3 buckets 2021-11-28 16:26:32 +01:00
Alberto Miorin
5c9c8612dd Fix #1385: python -m metadata should work 2021-11-28 16:23:56 +01:00
pmbrull
98066bf986 Rename FQN for bigquery 2021-11-28 16:09:32 +01:00
pmbrull
7bfceaff3a Add mlmodels to sample_data 2021-11-28 16:09:32 +01:00
Sriharsha Chintalapani
981be4f696
Fix #1431: Sample data ingestion is broken (#1432) 2021-11-27 21:11:25 -08:00
Sriharsha Chintalapani
221c5636b2
Fix #1386: Add metadata version (#1427) 2021-11-27 18:46:09 -08:00
Pere Miquel Brull
fdd6ca14b7
Merge pull request #1409 from TeddyCr/issue-1049 
issue-1049: Refactor code to use functions from utils.helper
 2021-11-26 18:51:01 +01:00
Ayush Shah
267a3d7aa2 Removed Platform from docker-compose.yml files, emulation fix 2021-11-26 18:10:27 +01:00
Teddy Crepineau
2507b7006a issue-1049: Refactor code to use functions from utils.helper 2021-11-26 16:16:34 +01:00
Akash Jain
96c65e7ebd
fix: remove spaCy dependencies from setup.py (#1362) 
* remove spaCy dependencies from setup.py

* Spacy, PII and Processor dependencies removed

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-11-24 12:23:17 -08:00
Ayush Shah
11e2229972
Added OMeta API, removed wget (#1376) 
* Added OMeta API, removed wget

* Added curl instead of Wget in run_local_docker.sh
 2021-11-24 11:57:33 -08:00
Sriharsha Chintalapani
27c439a53d
Update README.md 
update ingestion docs to point to docs.open-metadata.org
 2021-11-24 09:06:56 -08:00
Sriharsha Chintalapani
d2458777c8
Update README.md 2021-11-24 07:18:33 -08:00
Ayush Shah
eb34d04285 Setup.py modified to support 3.10 2021-11-23 21:50:44 -08:00
Sriharsha Chintalapani
5a3bdf2f70
Fix #1327: rename Model to DBTModel and provide indexing support (#1330) 
* Fix #1327: rename Model to DBTModel and provide indexing support

* Fix #1327: update dbt connector

* Fix #1327: add search index for dbt models

* Fix #1327: Address checkstyle issues
 2021-11-23 13:37:52 -08:00
Ayush Shah
7156bf60a0
Import Error fix - Okta (#1315) 
* Import Error fix

* Import errors fixed

* Make file updated as per comments
 2021-11-22 15:06:05 -08:00
Pere Miquel Brull
67ac286f56
[Issue-1285] - Update ingestion package generation (#1295) 
* Remove generated sources

* Ignore python generated sources

* Keep the generated dir

* Prepare publish recipe

* Simplify recipe

* Update README with generation

* Update docs with python local setup information

* Generate python sources in the CI
 2021-11-21 08:02:31 -08:00
Alberto Miorin
00fd7f4175 Fix #1291: Python Inspect Code errors 2021-11-21 15:51:51 +01:00
Alberto Miorin
3638786162 Fix warning in pytest unit tests (use raw string for regex) 2021-11-21 08:54:22 +01:00
Sriharsha Chintalapani
e4fa0247f5
Fix #1280: Amundsen connector to import metadata (#1281) 
* Fix #1280: Amundsen connector to import metadata
 2021-11-20 14:08:27 -08:00
Ayush Shah
219246b78e
Glue pagination added (#1282) 2021-11-20 12:46:18 -08:00
Pere Miquel Brull
ea79b47c45
[Issue-1268] - MlModel generated sources (#1288) 
* Update ML model naming for generated python src

* Update MlModel id and title

* Update MlModel descriptions

* Generate pydantic models

* Update OpenMetadata with new MlModel naming

* Update MlModel naming

* Update MlModel naming

* Update MlModel namings for backend sources
 2021-11-20 08:26:45 -08:00
Pere Miquel Brull
001a58f61f
Merge pull request #1262 from StuartApp/issue-1260 
[Issue-1260] - Github action to validate pydantic models
 2021-11-20 15:46:37 +01:00
Sriharsha Chintalapani
c078200f7c
Fix #1276: Add entity type to ES index and aggregations (#1278) 2021-11-19 12:23:35 -08:00
Sriharsha Chintalapani
a3e9c8f844
Fix #1273: Add service_category to ES index (#1274) 
* Fix #1273: Add service_category to ES index
 2021-11-19 11:31:14 -08:00
Sriharsha Chintalapani
eea60a8696
Fix #1264: Pipelines: remove 64 character constraint in names (#1265) 
* Fix #1264: Pipelines: remove 64 character constraint in names
 2021-11-18 16:27:43 -08:00
pmbrull
c53e5d0577 Remove deprecated import 2021-11-18 20:22:05 +01:00
Sriharsha Chintalapani
f3054658f5
Fix #968: Add DBT Connector (#1200) 2021-11-16 01:02:45 -08:00
Ayush Shah
2111f6c938
Docker Commands Modified (#1199) 
* Docker ingestion modified

* Command line commands updated
 2021-11-16 00:25:40 -08:00
Sriharsha Chintalapani
f018664e0c
Issue-1197: Add MariaDB Connector (#1198) 2021-11-16 00:25:24 -08:00
Pere Miquel Brull
ffd7818978
[Issue-1099] - Update MLModel Ingestion (#1179) 
* Refactor MLModel

* Prepare MLModel properties example

* Update API tags to MLModels

* Update API descriptions for MLModel

* Rename tags to mlModels
 2021-11-15 07:58:15 -08:00
parthp2107
4a5f5e69b3
uncommenting add-user test (#1097) 
* uncommenting add-user test

* quick-fix

* Ingestion script modified

* Airflow sample_usage modified, added sleep in curl commands

* adding chrome options for failing tests

* addressing reviewdog finding

* testing

* addressing reviewdog findings

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-11-14 20:16:39 -08:00
AviG
f5a7c193e3
ISSUE-1012 support dashboard charts of redash (widgets) (#1177) 
* ISSUE-1012 support dashboard charts of redash (widgets)

* ISSUE-1012 add comma
 2021-11-13 19:38:44 -08:00
Ayush Shah
5dc3bb9297
Docker Support from Python added (#1158) 
* Script modified - supports running from different locations

* Docker support from Python CLI

* Docker plugin setup.py

* Paths for latest and local dockers updated

* Resolved Comments - Docker CLI optimized, timestamp added

* help attribute added to options

* Docker clean code refactored
 2021-11-12 10:30:28 -08:00
Sriharsha Chintalapani
ab836ac26f
Fix #1151: Refactor Model to MLModel (#1152) 
* Fix #1151: Refactor Model to MLModel

* Fix #1151: Refactor Model to MLModel

* Fix #1151: Refactor Model to MLModel

* Fix #1151: Refactor Model to MLModel
 2021-11-11 12:44:03 -08:00
Ayush Shah
fa3c9b1758
Reduced the sample-users to 100 (#1156) 2021-11-11 07:31:03 -08:00
Sriharsha Chintalapani
6c9202db3d
Fix #1149: Fix Airflow Lineage backend to use new APIs to publish pip… (#1150) 
* Fix #1149: Fix Airflow Lineage backend to use new APIs to publish pipeline and tasks

* Fix #1149: Fix Airflow Lineage backend to use new APIs to publish pipeline and tasks

* Fix #1149: Fix Airflow Lineage backend to use new APIs to publish pipeline and tasks
 2021-11-11 00:06:47 -08:00
Ayush Shah
c95f1542eb
Docker fix (#1101) 
* Docker Fix, User Ingestion Fix

* Docker file optimized

* ES docker version rolledback

* Healthcheck removed - incompatible with 3.9

* Docker & Airflow Config files updated with - resolved comments

* Openmetadata managed Airflow apis support added

* Dockerfile updated

* Docker file Updated with release package

* Elasticsearch allocated memory increased
 2021-11-10 21:22:32 -08:00
Sriharsha Chintalapani
b29a6c3699
Fix #1127: Terms in descriptions for fields of struct column not searchable (#1132) 
* Fix #1127: Terms in descriptions for fields of struct column not searchable

* Fix #1127: Terms in descriptions for fields of struct column not searchable
 2021-11-10 11:33:08 -08:00
Ayush Shah
9839191242
Issue 483 - Glue Implementation (#1124) 
* Glue Tables and Pipeline workflows implemented

* Glue Config Added

* Relative imports changed to absolute

* Resolving Comments - Changed Imports, serviceTypes

* Type fixed in setup.py
 2021-11-10 07:28:13 -08:00
Sriharsha Chintalapani
cc539f37fd
Fix #1116: make elastic search database not include FQN (#1126) 2021-11-10 13:04:56 +05:30
Sriharsha Chintalapani
58460f3f2b
Fix #1034: workflow/bot operations API (#1053) 
* [WIP] workflow/bot operations API

* workflow/bot operations API

* workflow/bot operations API- Fix tests

* workflow/bot operations API- Fix styling issues

* workflow/bot operations API- Fix styling issues

* workflow/bot operations API- Add list runs api

* workflow/bot operations API - Fix styling issues; address reviews

* workflow/bot operations API - Fix styling issues; address reviews

* workflow/bot operations API - Fix styling issues; address reviews
 2021-11-09 20:56:45 -08:00
Pere Miquel Brull
a41e1d751e
[Issue-1119] - Generate Fix (#1120) 
* Remove additionalProperties from table definitions

* Regenerate pydantic models
 2021-11-09 15:08:21 -08:00
vijaypm
d14755b4e1
Issue - 1091 (#1096) 
* fixed issue with not being able to load config file; cleaned up unused code

* fixed test case to test configuration error

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
 2021-11-07 11:19:06 -08:00
vijaypm
d5758a0fbb
Issue 1023 (#1088) 
* fixed bug that was setting to lowercase property names that were already in camelCase

* added datetime prefix to allow integration tests to be run repeatedly

* fixed test to use the ldap entries from ldap service in docker to test the service

* updated instructions for ldap test

* added comments to clarify the fix done in snake_to_camel method

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
 2021-11-06 16:42:23 -07:00
Ayush Shah
bb3a7a57b8
Issue 1000 (#1083) 
* Sample Users fix #1000

* User Entity Implemented

* Teams Entity Implemented

* Added displayName Param
 2021-11-06 08:52:02 -07:00
Pere Miquel Brull
bc45c33f4d
[Issue-998] - Deprecate OpenMetadataAPIClient (#1052) 
* Refactor OpenMetadata and remove unused task functionality

* Refactor OpenMetadata in helpers

* Refactor OpenMetadata in sample_data helpers

* Remove unused client

* Remove unused client

* Remove unused client

* Align fields signature

* Refactor source OpenMetadata

* Refactor metadata_rest sink OpenMetadata

* Add list tags

* Refactor PII OpenMetadata

* Refactor LDAP REST users OpenMetadata

* isort imports

* Fix metadata to ES pipeline

* Refactor sample_entity OpenMetadata

* Remove helpers test - covered by OMeta testing

* Refactor workflow_test OpenMetadata

* Refactor mysql integration test for OpenMetadata

* Remove tasks as their refactor to pipelines

* Refactor Hive integration tests for OpenMetadata

* Remove OpenMetadataAPIClient

* Remove OpenMetadataAPIClient
 2021-11-03 13:02:34 -07:00