yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-09-02 13:43:22 +00:00
Code Issues Packages Projects Releases Wiki Activity
10,268 Commits 771 Branches 157 Tags
Commit Graph

2826 Commits

Author SHA1 Message Date
Akash Jain
d0d3fce332
fix: add container_name to docker-compose (#1639) 
* adding container_name

* fixed typo --run to --start

* updated container_name prefixing openmetadata_

* updated container_name to prefix openmetadata_
 2021-12-10 08:01:08 -08:00
Matt
3831bb9e4d
Implement s3 bucket policy ingestion (#1570) 
- Fix broken json schema policies (minItems in array instead of minLength)
- Amend s3 ingestion to create policies
- Amend PolicyResource and PolicyRepository to support Policy Rules
 2021-12-10 16:19:43 +01:00
Sriharsha Chintalapani
7b637d4628
Fix #1665: Oracle connector add an option to configure oracle service name (#1666) 
* Fix #1665: Oracle connector add an option to configure oracle service name

* Fixed removal of semi colon

Fixes SQL Command Warning while ingesting

Co-authored-by: Akash Jain <15995028+akash-jain-10@users.noreply.github.com>
 2021-12-10 16:37:19 +05:30
Alberto Miorin
ec7ff6fa13
pip install openmetadata instead of pip install openmetadata-ingestion (#1669) 2021-12-10 10:55:35 +01:00
Sriharsha Chintalapani
6f0ef68701
Fix #1392: parse exclude/include filters from UI generated config (#1634) 2021-12-10 15:17:43 +05:30
Sriharsha Chintalapani
c8c57de37e
Issue 1658: Ingestion changes to add dbtModel as part of Table entity (#1659) 
* Fix #1658: Ingestion changes to add dbtModel as part of Table entity

* Fixes #1652 Remove DBTModel as top level entity and capture information from DBT in existing Table entity

Co-authored-by: sureshms <suresh@getcollate.io>
 2021-12-09 20:32:17 -08:00
Pere Miquel Brull
af134d4afc
Simplify service create or update (#1648) 2021-12-09 17:08:39 +01:00
Ayush Shah
65fb71f819
Update setup.py - removed upper click version (#1638) 
fix #1636 
Removed click upper limit version as upgraded click package doesn't conflict if installed with openmetadata
 2021-12-09 07:58:09 -08:00
Ayush Shah
d5e13a9d22
pymssql and pyodbc support added (#1625) 2021-12-08 08:06:13 -08:00
Ayush Shah
7263510124
Query Log fixed (#1615) 
* Query Log fixed

* Wrong ColumnName fixed

* Added Service Name in usage configs
 2021-12-08 07:36:45 -08:00
parthp2107
64386b035e
added new tests for tags page (#1621) 
* added new tests for tags page

* addressing reviewdog findings

* Added Sample-usage service_name

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-12-08 16:54:48 +05:30
Ayush Shah
63ea123b43
Sample User parameters modified (#1622) 2021-12-08 14:53:30 +05:30
Sriharsha Chintalapani
f33a08377c
Fix #1618: Fix usage query parsing (#1619) 2021-12-07 23:53:53 -08:00
Ayush Shah
67433f559c
Trino JDBC updated (#1614) 2021-12-08 13:14:38 +05:30
Pere Miquel Brull
0a716a49a9
[issue-1484] - Deprecate ingestion Common Record (#1608) 
* Refactor Sink to Generic Entity

* Refactor Source to Generic Entity

* Refactor Processor & Stage to Generic Entity

* Deprecate common Record

* Clean unused imports

* Scope import
 2021-12-07 18:00:59 -08:00
Ayush Shah
777afd1d3f
Openmetadata.yaml for docker updated (#1606) 
* Dockerfiles changed - updated elasticsearch, openmetadata.yaml

* Added blue color to docker info
 2021-12-07 11:27:16 -08:00
Ayush Shah
b592f86941
Added Unit tests for datatypes (#1405) 
* Added Unittests for datatypes

* OpenMetadata Datatypes added in unittest

* Added few more datatype support

* SqlTypes updated
 2021-12-08 00:31:51 +05:30
Ayush Shah
1eae6f39ab
fix 1596, fixed indexing of DBT models (#1600) 2021-12-07 16:37:02 +05:30
Alberto Miorin
8621ee3fa0
Fix #1533, #1522: (#1575) 
- Glue works with columns containing dots.
- Glue works with temporary credentials.
- Fix bug in TableRepository, the EntityType was database instead of table.
- only region_name is mandatory in Glue config.
- first integration test for Glue. The CI integration with AWS is still missing.
 2021-12-06 16:03:05 -08:00
Sriharsha Chintalapani
3cc892769a
Fix #1451: Avoid printing password values into log files during ingestion (#1452) 
* Fix #1451: Avoid printing password values into log files during ingestion

* Update cmd.py - removed printing of config

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-12-06 14:18:13 -08:00
Sriharsha Chintalapani
ddf4f13c22
Fix #1563: Filter by database name (#1580) 2021-12-06 12:17:24 -08:00
Ayush Shah
3bcbada155
Fix Sample Data ingestion (#1583) 2021-12-07 00:36:50 +05:30
Ayush Shah
85f132738b
Remove faker from Sample-data (#1536) 
* Removed Faker as a dependency

* Added ModuleNotFoundError

* Removed faker from requirements.txt

* Removed SampleData plugin from setup.py
 2021-12-06 10:22:27 -08:00
Pere Miquel Brull
185ef5e98f
Get id as str or uuid (#1562) 2021-12-06 08:40:53 +01:00
Sriharsha Chintalapani
4206f4d119
Fix #1558: Fix metadata ingestion to remove service, database fields from api calls (#1559) 2021-12-05 20:32:17 -08:00
Sriharsha Chintalapani
2d348e9704
Add SSL options to ElasticSearch client - Ingestion & Server (#1548) (#1557) 
* Add SSL options to ElasticSearch client - Ingestion & Server (#1548)

* Add SSL options to ElasticSearch client - Ingestion & Server

* Add SSL options to ElasticSearch client - Ingestion & Server

* Issue-1556: Support for ElasticSearch SSL , Bootstrap command create and delete, ingestion updates for change descriptions

* Issue-1556: Fix checkstyle issues

* Issue-1556: Fix checkstyle issues
 2021-12-04 18:54:36 -08:00
Sriharsha Chintalapani
63a93c8944
Fix #1356: Add new entities to ES index from OpenMetadata server (#1423) 
* Fix #1356: Add new entities to ES index from OpenMetadata server

Co-authored-by: Sachin-chaurasiya <sachinchaurasiyachotey87@gmail.com>
 2021-12-04 08:45:17 -08:00
Ayush Shah
128a69045d
Fix 1477: Bigquery Usage - queryConfig (#1478) 
* Fix 1477: Bigquery Usage - queryConfig

* Bigquery Usage Modified
 2021-12-03 08:57:44 -08:00
Ayush Shah
341d2d5bf8
Update setup.py (#1542) 2021-12-03 08:56:29 -08:00
Alberto Miorin
f9436c65f0
Fix #1306: Evolve Location entity integration (#1442) 2021-12-03 02:13:13 +01:00
Ayush Shah
0e205d93dd
Added DBT to airflow, modified tables.json - added profile data, fixed user's displayName (#1501) 
* User's Name fixed, added profile data, added dbt pipeline under airflow

* service name changed
 2021-12-01 08:32:29 -08:00
parthp2107
a9e70e6a89
License header update (#1498) 
* updated liscense header

* updated license header

* updated license header

* updated license header

* addressing stylecheck findings
 2021-12-01 12:46:28 +05:30
Sriharsha Chintalapani
4ea45d3be3
Fix #1496: Follow-up: fix for sample-data after user classes refactored (#1497) 
* Fix #1496: Follow-up: fix for sample-data after user classes refactored

* Fix #1496: Follow-up: fix for sample-data after user classes refactored
 2021-12-01 09:38:30 +05:30
Sriharsha Chintalapani
4160f209ef
Fix #1490: Fix broken sample-data ignestion due to User classes refactored (#1491) 2021-11-30 14:41:10 -08:00
Sriharsha Chintalapani
a595332701
Fix #1471: Add Intellij idea settings to repo (#1472) 
* Fix #1471: Add Intellij idea settings to repo
 2021-11-30 12:14:54 -08:00
omriAl
96e473b5cb
#1051: migrated all usages of models.MetadataUser & models.User classes to g… (#1473) 
* migrated all usages of models.MetadataUser & models.User classes to generated.schema.teams.user.User classes instead.

* formatted file with black

Co-authored-by: omri.alon <omri.alon@myheritage.com>
 2021-11-30 07:57:07 -08:00
Sriharsha Chintalapani
7009a0bc12
Fix #1073: Apache Druid Support (#1424) 
* Fix #1073: Apache Druid Support
 2021-11-29 10:59:15 -08:00
Ayush Shah
47a97e7be0 FQN changed from bigquery to bigquery_gcp 2021-11-29 16:57:39 +05:30
Matt
09634e1a79 Populate service name correctly for Location as part of s3 ingestion 2021-11-29 02:05:24 +01:00
Sriharsha Chintalapani
be9195317b
Fix #1443: sample-usage ingestion is broken (#1444) 2021-11-28 14:25:55 -08:00
Matt
ededd58e25 Add ingestion for S3 buckets 2021-11-28 16:26:32 +01:00
Alberto Miorin
5c9c8612dd Fix #1385: python -m metadata should work 2021-11-28 16:23:56 +01:00
pmbrull
98066bf986 Rename FQN for bigquery 2021-11-28 16:09:32 +01:00
pmbrull
7bfceaff3a Add mlmodels to sample_data 2021-11-28 16:09:32 +01:00
Sriharsha Chintalapani
981be4f696
Fix #1431: Sample data ingestion is broken (#1432) 2021-11-27 21:11:25 -08:00
Sriharsha Chintalapani
221c5636b2
Fix #1386: Add metadata version (#1427) 2021-11-27 18:46:09 -08:00
Pere Miquel Brull
fdd6ca14b7
Merge pull request #1409 from TeddyCr/issue-1049 
issue-1049: Refactor code to use functions from utils.helper
 2021-11-26 18:51:01 +01:00
Ayush Shah
267a3d7aa2 Removed Platform from docker-compose.yml files, emulation fix 2021-11-26 18:10:27 +01:00
Teddy Crepineau
2507b7006a issue-1049: Refactor code to use functions from utils.helper 2021-11-26 16:16:34 +01:00
Akash Jain
96c65e7ebd
fix: remove spaCy dependencies from setup.py (#1362) 
* remove spaCy dependencies from setup.py

* Spacy, PII and Processor dependencies removed

Co-authored-by: Ayush Shah <ayush@getcollate.io>
 2021-11-24 12:23:17 -08:00