2024-09-25 10:49:44 +05:30
---
title: ADLS Datalake
slug: /connectors/database/adls-datalake
---
{% connectorDetailsHeader
name="ADLS Datalake"
stage="PROD"
platform="OpenMetadata"
availableFeatures=["Metadata", "Data Profiler", "Data Quality"]
unavailableFeatures=["Query Usage", "Lineage", "Column-level Lineage", "Owners", "dbt", "Tags", "Stored Procedures"]
/ %}
In this section, we provide guides and references to use the ADLS Datalake connector.
Configure and schedule Datalake metadata and profiler workflows from the OpenMetadata UI:
- [Requirements ](#requirements )
- [Metadata Ingestion ](#metadata-ingestion )
- [Data Profiler ](/how-to-guides/data-quality-observability/profiler/workflow )
- [Data Quality ](/how-to-guides/data-quality-observability/quality )
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/ingestion-modes-tiles.md" variables={yamlPath: "/connectors/database/adls-datalake/yaml"} /%}
2024-09-25 10:49:44 +05:30
## Requirements
{% note %}
The ADLS Datalake connector supports extracting metadata from file types `JSON` , `CSV` , `TSV` & `Parquet` .
{% /note %}
### ADLS Permissions
To extract metadata from Azure ADLS (Storage Account - StorageV2), you will need an **App Registration** with the following
permissions on the Storage Account:
- Storage Blob Data Contributor
- Storage Queue Data Contributor
## Metadata Ingestion
{% partial
2024-12-12 11:34:09 +05:30
file="/v1.7/connectors/metadata-ingestion-ui.md"
2024-09-25 10:49:44 +05:30
variables={
connector: "Datalake",
2024-12-12 11:34:09 +05:30
selectServicePath: "/images/v1.7/connectors/datalake/select-service.png",
addNewServicePath: "/images/v1.7/connectors/datalake/add-new-service.png",
serviceConnectionPath: "/images/v1.7/connectors/datalake/service-connection.png",
2024-09-25 10:49:44 +05:30
}
/%}
{% stepsContainer %}
{% extraContent parentTagName="stepsContainer" %}
#### Connection Details for Azure
- **Azure Credentials**
- **Client ID** : Client ID of the data storage account
- **Client Secret** : Client Secret of the account
- **Tenant ID** : Tenant ID under which the data storage account falls
- **Account Name** : Account Name of the data Storage
- **Required Roles**
Please make sure the following roles associated with the data storage account.
- `Storage Blob Data Contributor`
- `Storage Queue Data Contributor`
The current approach for authentication is based on `app registration` , reach out to us on [slack ](https://slack.open-metadata.org/ ) if you find the need for another auth system
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/database/advanced-configuration.md" /%}
2024-09-25 10:49:44 +05:30
{% /extraContent %}
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/test-connection.md" /%}
2024-09-25 10:49:44 +05:30
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/database/configure-ingestion.md" /%}
2024-09-25 10:49:44 +05:30
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/ingestion-schedule-and-deploy.md" /%}
2024-09-25 10:49:44 +05:30
{% /stepsContainer %}
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/troubleshooting.md" /%}
2024-09-25 10:49:44 +05:30
2024-12-12 11:34:09 +05:30
{% partial file="/v1.7/connectors/database/related.md" /%}