yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-08-16 21:17:03 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,673 Commits 728 Branches 153 Tags
Commit Graph

2916 Commits

Author SHA1 Message Date
parthp2107
64386b035e
added new tests for tags page (#1621) 
* added new tests for tags page

* addressing reviewdog findings

* Added Sample-usage service_name

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-12-08 16:54:48 +05:30
Ayush Shah
63ea123b43
Sample User parameters modified (#1622) 2021-12-08 14:53:30 +05:30
Sriharsha Chintalapani
f33a08377c
Fix #1618: Fix usage query parsing (#1619) 2021-12-07 23:53:53 -08:00
Ayush Shah
67433f559c
Trino JDBC updated (#1614) 2021-12-08 13:14:38 +05:30
Pere Miquel Brull
0a716a49a9
[issue-1484] - Deprecate ingestion Common Record (#1608) 
* Refactor Sink to Generic Entity

* Refactor Source to Generic Entity

* Refactor Processor & Stage to Generic Entity

* Deprecate common Record

* Clean unused imports

* Scope import
 2021-12-07 18:00:59 -08:00
Ayush Shah
777afd1d3f
Openmetadata.yaml for docker updated (#1606) 
* Dockerfiles changed - updated elasticsearch, openmetadata.yaml

* Added blue color to docker info
 2021-12-07 11:27:16 -08:00
Ayush Shah
b592f86941
Added Unit tests for datatypes (#1405) 
* Added Unittests for datatypes

* OpenMetadata Datatypes added in unittest

* Added few more datatype support

* SqlTypes updated
 2021-12-08 00:31:51 +05:30
Ayush Shah
1eae6f39ab
fix 1596, fixed indexing of DBT models (#1600) 2021-12-07 16:37:02 +05:30
Alberto Miorin
8621ee3fa0
Fix #1533, #1522: (#1575) 
- Glue works with columns containing dots.
- Glue works with temporary credentials.
- Fix bug in TableRepository, the EntityType was database instead of table.
- only region_name is mandatory in Glue config.
- first integration test for Glue. The CI integration with AWS is still missing.
 2021-12-06 16:03:05 -08:00
Sriharsha Chintalapani
3cc892769a
Fix #1451: Avoid printing password values into log files during ingestion (#1452) 
* Fix #1451: Avoid printing password values into log files during ingestion

* Update cmd.py - removed printing of config

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-12-06 14:18:13 -08:00
Sriharsha Chintalapani
ddf4f13c22
Fix #1563: Filter by database name (#1580) 2021-12-06 12:17:24 -08:00
Ayush Shah
3bcbada155
Fix Sample Data ingestion (#1583) 2021-12-07 00:36:50 +05:30
Ayush Shah
85f132738b
Remove faker from Sample-data (#1536) 
* Removed Faker as a dependency

* Added ModuleNotFoundError

* Removed faker from requirements.txt

* Removed SampleData plugin from setup.py
 2021-12-06 10:22:27 -08:00
Pere Miquel Brull
185ef5e98f
Get id as str or uuid (#1562) 2021-12-06 08:40:53 +01:00
Sriharsha Chintalapani
4206f4d119
Fix #1558: Fix metadata ingestion to remove service, database fields from api calls (#1559) 2021-12-05 20:32:17 -08:00
Sriharsha Chintalapani
2d348e9704
Add SSL options to ElasticSearch client - Ingestion & Server (#1548) (#1557) 
* Add SSL options to ElasticSearch client - Ingestion & Server (#1548)

* Add SSL options to ElasticSearch client - Ingestion & Server

* Add SSL options to ElasticSearch client - Ingestion & Server

* Issue-1556: Support for ElasticSearch SSL , Bootstrap command create and delete, ingestion updates for change descriptions

* Issue-1556: Fix checkstyle issues

* Issue-1556: Fix checkstyle issues
 2021-12-04 18:54:36 -08:00
Sriharsha Chintalapani
63a93c8944
Fix #1356: Add new entities to ES index from OpenMetadata server (#1423) 
* Fix #1356: Add new entities to ES index from OpenMetadata server

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2021-12-04 08:45:17 -08:00
Ayush Shah
128a69045d
Fix 1477: Bigquery Usage - queryConfig (#1478) 
* Fix 1477: Bigquery Usage - queryConfig

* Bigquery Usage Modified
 2021-12-03 08:57:44 -08:00
Ayush Shah
341d2d5bf8
Update setup.py (#1542) 2021-12-03 08:56:29 -08:00
Alberto Miorin
f9436c65f0
Fix #1306: Evolve Location entity integration (#1442) 2021-12-03 02:13:13 +01:00
Ayush Shah
0e205d93dd
Added DBT to airflow, modified tables.json - added profile data, fixed user's displayName (#1501) 
* User's Name fixed, added profile data, added dbt pipeline under airflow

* service name changed
 2021-12-01 08:32:29 -08:00
parthp2107
a9e70e6a89
License header update (#1498) 
* updated liscense header

* updated license header

* updated license header

* updated license header

* addressing stylecheck findings
 2021-12-01 12:46:28 +05:30
Sriharsha Chintalapani
4ea45d3be3
Fix #1496: Follow-up: fix for sample-data after user classes refactored (#1497) 
* Fix #1496: Follow-up: fix for sample-data after user classes refactored

* Fix #1496: Follow-up: fix for sample-data after user classes refactored
 2021-12-01 09:38:30 +05:30
Sriharsha Chintalapani
4160f209ef
Fix #1490: Fix broken sample-data ignestion due to User classes refactored (#1491) 2021-11-30 14:41:10 -08:00
Sriharsha Chintalapani
a595332701
Fix #1471: Add Intellij idea settings to repo (#1472) 
* Fix #1471: Add Intellij idea settings to repo
 2021-11-30 12:14:54 -08:00
omriAl
96e473b5cb
#1051: migrated all usages of models.MetadataUser & models.User classes to g… (#1473) 
* migrated all usages of models.MetadataUser & models.User classes to generated.schema.teams.user.User classes instead.

* formatted file with black

Co-authored-by: omri.alon <omri.alon@myheritage.com>
 2021-11-30 07:57:07 -08:00
Sriharsha Chintalapani
7009a0bc12
Fix #1073: Apache Druid Support (#1424) 
* Fix #1073: Apache Druid Support
 2021-11-29 10:59:15 -08:00
Ayush Shah
47a97e7be0 FQN changed from bigquery to bigquery_gcp 2021-11-29 16:57:39 +05:30
Matt
09634e1a79 Populate service name correctly for Location as part of s3 ingestion 2021-11-29 02:05:24 +01:00
Sriharsha Chintalapani
be9195317b
Fix #1443: sample-usage ingestion is broken (#1444) 2021-11-28 14:25:55 -08:00
Matt
ededd58e25 Add ingestion for S3 buckets 2021-11-28 16:26:32 +01:00
Alberto Miorin
5c9c8612dd Fix #1385: python -m metadata should work 2021-11-28 16:23:56 +01:00
pmbrull
98066bf986 Rename FQN for bigquery 2021-11-28 16:09:32 +01:00
pmbrull
7bfceaff3a Add mlmodels to sample_data 2021-11-28 16:09:32 +01:00
Sriharsha Chintalapani
981be4f696
Fix #1431: Sample data ingestion is broken (#1432) 2021-11-27 21:11:25 -08:00
Sriharsha Chintalapani
221c5636b2
Fix #1386: Add metadata version (#1427) 2021-11-27 18:46:09 -08:00
Pere Miquel Brull
fdd6ca14b7
Merge pull request #1409 from TeddyCr/issue-1049 
issue-1049: Refactor code to use functions from utils.helper
 2021-11-26 18:51:01 +01:00
Ayush Shah
267a3d7aa2 Removed Platform from docker-compose.yml files, emulation fix 2021-11-26 18:10:27 +01:00
Teddy Crepineau
2507b7006a issue-1049: Refactor code to use functions from utils.helper 2021-11-26 16:16:34 +01:00
Akash Jain
96c65e7ebd
fix: remove spaCy dependencies from setup.py (#1362) 
* remove spaCy dependencies from setup.py

* Spacy, PII and Processor dependencies removed

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-11-24 12:23:17 -08:00
Ayush Shah
11e2229972
Added OMeta API, removed wget (#1376) 
* Added OMeta API, removed wget

* Added curl instead of Wget in run_local_docker.sh
 2021-11-24 11:57:33 -08:00
Sriharsha Chintalapani
27c439a53d
Update README.md 
update ingestion docs to point to docs.open-metadata.org
 2021-11-24 09:06:56 -08:00
Sriharsha Chintalapani
d2458777c8
Update README.md 2021-11-24 07:18:33 -08:00
Ayush Shah
eb34d04285 Setup.py modified to support 3.10 2021-11-23 21:50:44 -08:00
Sriharsha Chintalapani
5a3bdf2f70
Fix #1327: rename Model to DBTModel and provide indexing support (#1330) 
* Fix #1327: rename Model to DBTModel and provide indexing support

* Fix #1327: update dbt connector

* Fix #1327: add search index for dbt models

* Fix #1327: Address checkstyle issues
 2021-11-23 13:37:52 -08:00
Ayush Shah
7156bf60a0
Import Error fix - Okta (#1315) 
* Import Error fix

* Import errors fixed

* Make file updated as per comments
 2021-11-22 15:06:05 -08:00
Pere Miquel Brull
67ac286f56
[Issue-1285] - Update ingestion package generation (#1295) 
* Remove generated sources

* Ignore python generated sources

* Keep the generated dir

* Prepare publish recipe

* Simplify recipe

* Update README with generation

* Update docs with python local setup information

* Generate python sources in the CI
 2021-11-21 08:02:31 -08:00
Alberto Miorin
00fd7f4175 Fix #1291: Python Inspect Code errors 2021-11-21 15:51:51 +01:00
Alberto Miorin
3638786162 Fix warning in pytest unit tests (use raw string for regex) 2021-11-21 08:54:22 +01:00
Sriharsha Chintalapani
e4fa0247f5
Fix #1280: Amundsen connector to import metadata (#1281) 
* Fix #1280: Amundsen connector to import metadata
 2021-11-20 14:08:27 -08:00