yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-09-06 07:32:46 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,284 Commits 783 Branches 159 Tags
Commit Graph

2362 Commits

Author SHA1 Message Date
Ayush Shah
63ea123b43
Sample User parameters modified (#1622) 2021-12-08 14:53:30 +05:30
Sriharsha Chintalapani
f33a08377c
Fix #1618: Fix usage query parsing (#1619) 2021-12-07 23:53:53 -08:00
Ayush Shah
67433f559c
Trino JDBC updated (#1614) 2021-12-08 13:14:38 +05:30
Pere Miquel Brull
0a716a49a9
[issue-1484] - Deprecate ingestion Common Record (#1608) 
* Refactor Sink to Generic Entity

* Refactor Source to Generic Entity

* Refactor Processor & Stage to Generic Entity

* Deprecate common Record

* Clean unused imports

* Scope import
 2021-12-07 18:00:59 -08:00
Ayush Shah
777afd1d3f
Openmetadata.yaml for docker updated (#1606) 
* Dockerfiles changed - updated elasticsearch, openmetadata.yaml

* Added blue color to docker info
 2021-12-07 11:27:16 -08:00
Ayush Shah
b592f86941
Added Unit tests for datatypes (#1405) 
* Added Unittests for datatypes

* OpenMetadata Datatypes added in unittest

* Added few more datatype support

* SqlTypes updated
 2021-12-08 00:31:51 +05:30
Ayush Shah
1eae6f39ab
fix 1596, fixed indexing of DBT models (#1600) 2021-12-07 16:37:02 +05:30
Alberto Miorin
8621ee3fa0
Fix #1533, #1522: (#1575) 
- Glue works with columns containing dots.
- Glue works with temporary credentials.
- Fix bug in TableRepository, the EntityType was database instead of table.
- only region_name is mandatory in Glue config.
- first integration test for Glue. The CI integration with AWS is still missing.
 2021-12-06 16:03:05 -08:00
Sriharsha Chintalapani
3cc892769a
Fix #1451: Avoid printing password values into log files during ingestion (#1452) 
* Fix #1451: Avoid printing password values into log files during ingestion

* Update cmd.py - removed printing of config

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-12-06 14:18:13 -08:00
Sriharsha Chintalapani
ddf4f13c22
Fix #1563: Filter by database name (#1580) 2021-12-06 12:17:24 -08:00
Ayush Shah
3bcbada155
Fix Sample Data ingestion (#1583) 2021-12-07 00:36:50 +05:30
Ayush Shah
85f132738b
Remove faker from Sample-data (#1536) 
* Removed Faker as a dependency

* Added ModuleNotFoundError

* Removed faker from requirements.txt

* Removed SampleData plugin from setup.py
 2021-12-06 10:22:27 -08:00
Pere Miquel Brull
185ef5e98f
Get id as str or uuid (#1562) 2021-12-06 08:40:53 +01:00
Sriharsha Chintalapani
4206f4d119
Fix #1558: Fix metadata ingestion to remove service, database fields from api calls (#1559) 2021-12-05 20:32:17 -08:00
Sriharsha Chintalapani
2d348e9704
Add SSL options to ElasticSearch client - Ingestion & Server (#1548) (#1557) 
* Add SSL options to ElasticSearch client - Ingestion & Server (#1548)

* Add SSL options to ElasticSearch client - Ingestion & Server

* Add SSL options to ElasticSearch client - Ingestion & Server

* Issue-1556: Support for ElasticSearch SSL , Bootstrap command create and delete, ingestion updates for change descriptions

* Issue-1556: Fix checkstyle issues

* Issue-1556: Fix checkstyle issues
 2021-12-04 18:54:36 -08:00
Sriharsha Chintalapani
63a93c8944
Fix #1356: Add new entities to ES index from OpenMetadata server (#1423) 
* Fix #1356: Add new entities to ES index from OpenMetadata server

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2021-12-04 08:45:17 -08:00
Ayush Shah
128a69045d
Fix 1477: Bigquery Usage - queryConfig (#1478) 
* Fix 1477: Bigquery Usage - queryConfig

* Bigquery Usage Modified
 2021-12-03 08:57:44 -08:00
Alberto Miorin
f9436c65f0
Fix #1306: Evolve Location entity integration (#1442) 2021-12-03 02:13:13 +01:00
Ayush Shah
0e205d93dd
Added DBT to airflow, modified tables.json - added profile data, fixed user's displayName (#1501) 
* User's Name fixed, added profile data, added dbt pipeline under airflow

* service name changed
 2021-12-01 08:32:29 -08:00
parthp2107
a9e70e6a89
License header update (#1498) 
* updated liscense header

* updated license header

* updated license header

* updated license header

* addressing stylecheck findings
 2021-12-01 12:46:28 +05:30
Sriharsha Chintalapani
4ea45d3be3
Fix #1496: Follow-up: fix for sample-data after user classes refactored (#1497) 
* Fix #1496: Follow-up: fix for sample-data after user classes refactored

* Fix #1496: Follow-up: fix for sample-data after user classes refactored
 2021-12-01 09:38:30 +05:30
Sriharsha Chintalapani
4160f209ef
Fix #1490: Fix broken sample-data ignestion due to User classes refactored (#1491) 2021-11-30 14:41:10 -08:00
omriAl
96e473b5cb
#1051: migrated all usages of models.MetadataUser & models.User classes to g… (#1473) 
* migrated all usages of models.MetadataUser & models.User classes to generated.schema.teams.user.User classes instead.

* formatted file with black

Co-authored-by: omri.alon <omri.alon@myheritage.com>
 2021-11-30 07:57:07 -08:00
Sriharsha Chintalapani
7009a0bc12
Fix #1073: Apache Druid Support (#1424) 
* Fix #1073: Apache Druid Support
 2021-11-29 10:59:15 -08:00
Ayush Shah
47a97e7be0 FQN changed from bigquery to bigquery_gcp 2021-11-29 16:57:39 +05:30
Matt
09634e1a79 Populate service name correctly for Location as part of s3 ingestion 2021-11-29 02:05:24 +01:00
Sriharsha Chintalapani
be9195317b
Fix #1443: sample-usage ingestion is broken (#1444) 2021-11-28 14:25:55 -08:00
Matt
ededd58e25 Add ingestion for S3 buckets 2021-11-28 16:26:32 +01:00
Alberto Miorin
5c9c8612dd Fix #1385: python -m metadata should work 2021-11-28 16:23:56 +01:00
pmbrull
7bfceaff3a Add mlmodels to sample_data 2021-11-28 16:09:32 +01:00
Sriharsha Chintalapani
981be4f696
Fix #1431: Sample data ingestion is broken (#1432) 2021-11-27 21:11:25 -08:00
Sriharsha Chintalapani
221c5636b2
Fix #1386: Add metadata version (#1427) 2021-11-27 18:46:09 -08:00
Teddy Crepineau
2507b7006a issue-1049: Refactor code to use functions from utils.helper 2021-11-26 16:16:34 +01:00
Akash Jain
96c65e7ebd
fix: remove spaCy dependencies from setup.py (#1362) 
* remove spaCy dependencies from setup.py

* Spacy, PII and Processor dependencies removed

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-11-24 12:23:17 -08:00
Ayush Shah
11e2229972
Added OMeta API, removed wget (#1376) 
* Added OMeta API, removed wget

* Added curl instead of Wget in run_local_docker.sh
 2021-11-24 11:57:33 -08:00
Sriharsha Chintalapani
5a3bdf2f70
Fix #1327: rename Model to DBTModel and provide indexing support (#1330) 
* Fix #1327: rename Model to DBTModel and provide indexing support

* Fix #1327: update dbt connector

* Fix #1327: add search index for dbt models

* Fix #1327: Address checkstyle issues
 2021-11-23 13:37:52 -08:00
Ayush Shah
7156bf60a0
Import Error fix - Okta (#1315) 
* Import Error fix

* Import errors fixed

* Make file updated as per comments
 2021-11-22 15:06:05 -08:00
Pere Miquel Brull
67ac286f56
[Issue-1285] - Update ingestion package generation (#1295) 
* Remove generated sources

* Ignore python generated sources

* Keep the generated dir

* Prepare publish recipe

* Simplify recipe

* Update README with generation

* Update docs with python local setup information

* Generate python sources in the CI
 2021-11-21 08:02:31 -08:00
Alberto Miorin
00fd7f4175 Fix #1291: Python Inspect Code errors 2021-11-21 15:51:51 +01:00
Alberto Miorin
3638786162 Fix warning in pytest unit tests (use raw string for regex) 2021-11-21 08:54:22 +01:00
Sriharsha Chintalapani
e4fa0247f5
Fix #1280: Amundsen connector to import metadata (#1281) 
* Fix #1280: Amundsen connector to import metadata
 2021-11-20 14:08:27 -08:00
Ayush Shah
219246b78e
Glue pagination added (#1282) 2021-11-20 12:46:18 -08:00
Pere Miquel Brull
ea79b47c45
[Issue-1268] - MlModel generated sources (#1288) 
* Update ML model naming for generated python src

* Update MlModel id and title

* Update MlModel descriptions

* Generate pydantic models

* Update OpenMetadata with new MlModel naming

* Update MlModel naming

* Update MlModel naming

* Update MlModel namings for backend sources
 2021-11-20 08:26:45 -08:00
Sriharsha Chintalapani
c078200f7c
Fix #1276: Add entity type to ES index and aggregations (#1278) 2021-11-19 12:23:35 -08:00
Sriharsha Chintalapani
a3e9c8f844
Fix #1273: Add service_category to ES index (#1274) 
* Fix #1273: Add service_category to ES index
 2021-11-19 11:31:14 -08:00
Sriharsha Chintalapani
eea60a8696
Fix #1264: Pipelines: remove 64 character constraint in names (#1265) 
* Fix #1264: Pipelines: remove 64 character constraint in names
 2021-11-18 16:27:43 -08:00
Sriharsha Chintalapani
f3054658f5
Fix #968: Add DBT Connector (#1200) 2021-11-16 01:02:45 -08:00
Ayush Shah
2111f6c938
Docker Commands Modified (#1199) 
* Docker ingestion modified

* Command line commands updated
 2021-11-16 00:25:40 -08:00
Sriharsha Chintalapani
f018664e0c
Issue-1197: Add MariaDB Connector (#1198) 2021-11-16 00:25:24 -08:00
AviG
f5a7c193e3
ISSUE-1012 support dashboard charts of redash (widgets) (#1177) 
* ISSUE-1012 support dashboard charts of redash (widgets)

* ISSUE-1012 add comma
 2021-11-13 19:38:44 -08:00