63 Commits

Author SHA1 Message Date
Matt
4a4124d45d
Rename CatalogAuthorizer to Authorizer (#1966) 2021-12-29 11:37:47 -08:00
Matt
f1a8a7886e
Link Lifecycle Policy to specific Location (#1720)
- Amend ingestion to support Location reference from Policy
- Amend PolicyResource and PolicyRepository to accommodate Location reference
2021-12-23 11:06:15 -08:00
Alberto Miorin
ec1e3a2d61
Fix #1344: Remove requirements.txt (#1588) 2021-12-20 21:36:23 -08:00
Sachin Chaurasiya
208b1cbabd
GitBook: [#5] No subject (#1790) 2021-12-16 12:39:22 +05:30
parthp2107
c2f1b6bb8a
Doc update (#1716)
* GitBook: [#70] Update to Roadmap

* GitBook: [#72] Modified Looker and Oracle Connector

* GitBook: [#71] Change Events

* GitBook: [#74] API Component

* GitBook: [#73] MlFlow Connector

* GitBook: [#75] PUT Diagram

* GitBook: [#76] Change Events

* GitBook: [#77] Snowflake Single Sign-on changes

Co-authored-by: OpenMetadata <github@harsha.io>
Co-authored-by: Ayush Shah <ayush.shah@deuexsolutions.com>
Co-authored-by: pmbrull <peremiquelbrull@gmail.com>
2021-12-13 12:49:33 +05:30
OpenMetadata
9fc0eb0475 GitBook: [#68] Update dist to openmetadata-dist 2021-12-09 08:01:49 -08:00
pmbrull
b4d97b1e2a GitBook: [#66] Update Python API id type 2021-12-09 08:01:49 -08:00
pmbrull
9bbc676c3b GitBook: [#65] Python API 2021-12-09 08:01:49 -08:00
pmbrull
d0b6ed4036 GitBook: [#64] API Container Diagram 2021-12-09 08:01:49 -08:00
pmbrull
dedcc9b7d0 GitBook: [#63] Add link in Build a Connector 2021-12-09 08:01:49 -08:00
OpenMetadata
acb9293642 GitBook: [#61] Fix elastic search connector config 2021-12-09 08:01:49 -08:00
Sachin Chaurasiya
b7994a0639 GitBook: [#58] Architecture description 2021-12-09 08:01:49 -08:00
OpenMetadata
959683acf3 GitBook: [#48] Developer docs - Update the image and steps to create a runtime config 2021-12-09 08:01:49 -08:00
OpenMetadata
e0a0ef3b2f GitBook: [#47] Update the Intellij run-time config 2021-12-09 08:01:49 -08:00
Ayush Shah
2aca271190 GitBook: [#37] Developer Docs modified 2021-12-09 08:01:49 -08:00
Ayush Shah
e745856b64 GitBook: [#36] MariaDB moved to DatabaseServices 2021-12-09 08:01:49 -08:00
Krishna Sadasivam
2ec12efcd6
Issue-1488: Quick start guide to developing in OpenMetadata (#1532)
Fix #1407 1488: Quick start guide to developing in OpenMetadata

Co-authored-by: Shannon Bradshaw <shannon.bradshaw@arrikto.com>
2021-12-07 11:03:16 -08:00
Sachin Chaurasiya
a094f1d5f8
GitBook: [#60] Updating Document for Json Schema to Typescript Types generation. (#1535) 2021-12-03 16:01:06 +05:30
Matt
ededd58e25 Add ingestion for S3 buckets 2021-11-28 16:26:32 +01:00
Akash Jain
74a10382a2
Fix: Docker Image to use new Dist Location while running locally (#1381)
* fix path for dist folder

* updated docs wrt new dist folder
2021-11-25 12:33:20 +05:30
Akash Jain
96c65e7ebd
fix: remove spaCy dependencies from setup.py (#1362)
* remove spaCy dependencies from setup.py

* Spacy, PII and Processor dependencies removed

Co-authored-by: Ayush Shah <ayush@getcollate.io>
2021-11-24 12:23:17 -08:00
Ayush Shah
eb34d04285 Setup.py modified to support 3.10 2021-11-23 21:50:44 -08:00
Ayush Shah
60dc4b44bc GitBook: [#32] Page link Glue Catalog 2021-11-23 19:58:23 -08:00
Sachin Chaurasiya
3f5510f340
GitBook: [#27] Adding guide for generate types from JSON Schema. (#1332)
* GitBook: [#27] Adding guide for generate types from JSON Schema.

* Removed unwanted files.

Co-authored-by: Sachin Chaurasiya <sachin.c@deuexsolutions.com>
2021-11-23 15:11:26 +05:30
Pere Miquel Brull
67ac286f56
[Issue-1285] - Update ingestion package generation (#1295)
* Remove generated sources

* Ignore python generated sources

* Keep the generated dir

* Prepare publish recipe

* Simplify recipe

* Update README with generation

* Update docs with python local setup information

* Generate python sources in the CI
2021-11-21 08:02:31 -08:00
parthp2107
e2578d6be3
Added documentation changes done in 0.5.0 branch to main (#1168)
* GitBook: [#177] Documentation Update - Airflow

* GitBook: [#195] Removing Cron from databaseServices

* GitBook: [#196] Added trino

* GitBook: [#197] removed cron from config

* GitBook: [#198] Added Redash Documentation

* GitBook: [#199] Added Bigquery Usage Documentation

* GitBook: [#200] Added page link for presto

* GitBook: [#201] Added Local Docker documentation

* GitBook: [#202] Added Documentation for Local Docker Setup

* GitBook: [#203] Added Git Command to clone Openmetadata in docs

* GitBook: [#207] links update

* GitBook: [#208] Updating Airflow Documentation

* GitBook: [#210] Adding Python installation package under Airflow Lineage config

* GitBook: [#211] Change the links to 0.5..0

* GitBook: [#213] Move buried connectors page up

* GitBook: [#214] Update to connectors page

* GitBook: [#215] Removed sub-categories

* GitBook: [#212] Adding Discovery tutorial

* GitBook: [#220] Updated steps to H2s.

* GitBook: [#230] Complex queries

* GitBook: [#231] Add lineage to feature overview

* GitBook: [#232] Make feature overview headers verbs instead of nouns

* GitBook: [#233] Add data reliability to features overview

* GitBook: [#234] Add complex data types to feature overview

* GitBook: [#235] Simplify and further distinguish discovery feature headers

* GitBook: [#236] Add data importance to feature overview

* GitBook: [#237] Break Connectors into its own section

* GitBook: [#238] Reorganize first section of docs.

* GitBook: [#239] Add connectors to feature overview

* GitBook: [#240] Organize layout of feature overview into feature categories as agreed with Harsha.

* GitBook: [#242] Make overview paragraph more descriptive.

* GitBook: [#243] Create a link to Connectors section from feature overview.

* GitBook: [#244] Add "discover data through association" to feature overview.

* GitBook: [#245] Update importance and owners gifs

* GitBook: [#246] Include a little more descriptive documentation for key features.

* GitBook: [#248] Small tweaks to intro paragraph.

* GitBook: [#249] Clean up data profiler paragraph.

* GitBook: [#250] Promote Complex Data Types to its own feature.

* GitBook: [#251] Update to advanced search

* GitBook: [#252] Update Roadmap

* GitBook: [#254] Remove old features page (text and screenshot based).

* GitBook: [#255] Remove references to removed page.

* GitBook: [#256] Add Descriptions and Tags section to feature overview.

* GitBook: [#257] Update title for "Know Your Data"

Co-authored-by: Ayush Shah <ayush.shah@deuexsolutions.com>
Co-authored-by: Suresh Srinivas <suresh@getcollate.io>
Co-authored-by: Shannon Bradshaw <shannon.bradshaw@arrikto.com>
Co-authored-by: OpenMetadata <github@harsha.io>
2021-11-13 09:33:20 -08:00
vijaypm
d5758a0fbb
Issue 1023 (#1088)
* fixed bug that was setting to lowercase property names that were already in camelCase

* added datetime prefix to allow integration tests to be run repeatedly

* fixed test to use the ldap entries from ldap service in docker to test the service

* updated instructions for ldap test

* added comments to clarify the fix done in snake_to_camel method

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
2021-11-06 16:42:23 -07:00
vijaypm
5d796172ce
ISSUE-960: (#988)
* ISSUE-960: fixed test cases and updated documented with list of pip install

* using requests package for testing http port responsiveness and socket for non-http ports

* use healthcheck api instead of just service endpoint

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
2021-11-01 08:32:34 -07:00
vijaypm
9edd824c3a
Issue 910 (#914)
* Issue 898 (#905)

* ISSUE-898: additional information in the prerequisities for building and running code

* ISSUE-898: removed unreachable old doc

* ISSUE-898: added new docker compose to expose MySQL and ES ports to host machines

* ISSUE-898: changed jdbc connect url to allow Public Key Retrieval

* ISSUE-898: fixed log name to openmetadata.log

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>

* Fixes #906 Remove unused methods lingering from #899

* Update pull_request_template.md

* Update pull_request_template.md

* ISSUE-861: add elasticsearch username & password (#894)

* ISSUE-861: add elasticsearch username & password

* ISSUE-861:  python elasticsearch sink add username & password

* ISSUE-861: bugfix

* format code

* format code

* updated instructions to run integration tests

* fixed api call to metadata server; changed test to cover both database as well as table operations everytime

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
Co-authored-by: sureshms <suresh@getcollate.io>
Co-authored-by: Suresh Srinivas <srini30005@gmail.com>
Co-authored-by: rong fengliang <1141591465@qq.com>
2021-10-23 19:58:26 -07:00
vijaypm
b8863648d6
Issue 898 (#905)
* ISSUE-898: additional information in the prerequisities for building and running code

* ISSUE-898: removed unreachable old doc

* ISSUE-898: added new docker compose to expose MySQL and ES ports to host machines

* ISSUE-898: changed jdbc connect url to allow Public Key Retrieval

* ISSUE-898: fixed log name to openmetadata.log

Co-authored-by: Vijay Mariadassou <vijay@mariadassou.com>
2021-10-22 19:35:12 -07:00
parthp2107
aec586a5fe
updated metadata-ingestion and apis documents (#839)
* updated metadata-ingestion and apis documents

* minor changes in

* addressing maven ci findings

Co-authored-by: Parth Panchal <parthpanchal@Parths-MacBook-Air.local>
2021-10-18 18:02:22 +05:30
Pere Miquel Brull
1804de6d73
[Issue-760] - Precommit & isort (#772)
* Update configs

* Update configs

* Update precommit black exclude

* Update precommit exclude isort

* Test precommit

* Revert test commit

* isort & black

* Test precommit

* Revert test precommit

* Update docs

* Apply recipe update

* Fix black_check recipe

* Grammar
2021-10-14 15:22:59 -07:00
Ayush Shah
5b22809be6
Documentation Update (#774) 2021-10-14 15:21:13 -07:00
Sriharsha Chintalapani
e2d6966fb4
Fix slack links (#575) 2021-09-24 09:40:07 -07:00
Suresh Srinivas
280ce8c350
GitBook: [main] 29 pages modified 2021-08-29 21:24:50 +00:00
Marty Goode
d7fee32a74 ISSUE-283: Corrected and cleaned up Workflow section of documentation 2021-08-23 19:20:49 -04:00
Ayush Shah
31a6ae4420
GitBook: [main] 3 pages and one asset modified 2021-08-20 14:14:14 +00:00
NAQVI
613fa583b3 added steps for upstream 2021-08-19 13:08:12 +05:30
Shannon Bradshaw
f3eb15682d
GitBook: [main] 77 pages and 6 assets modified 2021-08-18 19:30:55 +00:00
Suresh Srinivas
04c7c939fd Docs: How to contribute to OpenMetadata 2021-08-18 10:56:46 -07:00
Suresh Srinivas
885d09e2fc Docs: How to contribute to OpenMetadata 2021-08-18 10:55:24 -07:00
Suresh Srinivas
b633c80c0b Docs: How to contribute to OpenMetadata 2021-08-18 10:47:35 -07:00
Sanket Shah
e04626cb1b
GitBook: [main] one page and one asset modified 2021-08-18 17:22:45 +00:00
Sanket Shah
f87b588934
GitBook: [main] 2 pages and 6 assets modified 2021-08-18 07:27:45 +00:00
Suresh Srinivas
856be1f640
GitBook: [main] 11 pages and one asset modified 2021-08-17 15:45:52 +00:00
Suresh Srinivas
192672f1a5 Add ingestion docs to implement a connector 2021-08-16 15:58:44 -07:00
Suresh Srinivas
4d74050884 Add ingestion docs to implement a connector 2021-08-16 15:56:58 -07:00
Suresh Srinivas
9e23bd99e7 Add ingestion docs to implement a connector 2021-08-16 15:55:36 -07:00
Suresh Srinivas
2df2e89c60 Add ingestion docs to implement a connector 2021-08-16 15:51:04 -07:00
Suresh Srinivas
8027f631c3 Add ingestion docs to implement a connector 2021-08-16 15:37:12 -07:00