GitBook: [0.4.0] 2 pages modified

This commit is contained in:
Parth Panchal 2021-09-20 06:45:37 +00:00 committed by gitbook-bot
parent 3ebe7972d9
commit a2e6ec819a
No known key found for this signature in database
GPG Key ID: 07D2180C7B12D0FF
2 changed files with 101 additions and 0 deletions

View File

@ -86,6 +86,7 @@
* [Salesforce](install/metadata-ingestion/connectors/database-services/salesforce.md)
* [Snowflake](install/metadata-ingestion/connectors/database-services/snowflake.md)
* [Snowflake Usage](install/metadata-ingestion/connectors/database-services/snowflake-usage.md)
* [Vertica](install/metadata-ingestion/connectors/database-services/vertica.md)
* [Messaging Services](install/metadata-ingestion/connectors/messaging-services/README.md)
* [Kafka](install/metadata-ingestion/connectors/messaging-services/kafka.md)
* [Scheduler](install/metadata-ingestion/scheduler.md)

View File

@ -0,0 +1,100 @@
---
description: This guide will help install Vertica connector and run manually
---
# Vertica
{% hint style="info" %}
**Prerequisites**
OpenMetadata is built using Java, DropWizard, Jetty, and MySQL.
1. Python 3.7 or above
{% endhint %}
### Install from PyPi
{% tabs %}
{% tab title="Install Using PyPi" %}
```javascript
pip install 'openmetadata-ingestion[vertica]'
```
{% endtab %}
{% endtabs %}
### Run Manually
```javascript
metadata ingest -c ./examples/workflows/vertica.json
```
### Configurationvertica.json
{% code title="vertica.json" %}
```javascript
{
"source": {
"type": "vertica",
"config": {
"username": "openmetadata_user",
"password": "openmetadata_password",
"database": "openmetadata_db",
"service_name": "local_vertica",
"filter_pattern": {
"excludes": []
}
}
},
...
```
{% endcode %}
1. **username** - pass the Vertica username.
2. **password** - password for the username.
3. **service\_name** - Service Name for this Vertica cluster. If you added Vertica cluster through OpenMetadata UI, make sure the service name matches the same.
4. **filter\_pattern** - It contains includes, excludes options to choose which pattern of datasets you want to ingest into OpenMetadata
### Publish to OpenMetadata
Below is the configuration to publish MySQL data into the OpenMetadata service.
Add optionally `pii` processor and `metadata-rest-tables` sink along with `metadata-server` config
{% code title="vertica.json" %}
```javascript
{
"source": {
"type": "vertica",
"config": {
"username": "openmetadata_user",
"password": "openmetadata_password",
"database": "openmetadata_db",
"service_name": "local_vertica",
"filter_pattern": {
"excludes": []
}
}
},
"sink": {
"type": "metadata-rest",
"config": {}
},
"metadata_server": {
"type": "metadata-server",
"config": {
"api_endpoint": "http://localhost:8585/api",
"auth_provider_type": "no-auth"
}
},
"cron": {
"minute": "*/5",
"hour": null,
"day": null,
"month": null,
"day_of_week": null
}
}
```
{% endcode %}