yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-12-05 07:04:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

Mark data lake metadata source as Beta (#4061)

Browse Source
This commit is contained in:
Pedro Silva 2022-02-05 00:27:44 +00:00 committed by GitHub
parent cc32c30b2a
commit ef617784b1
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 6 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
metadata-ingestion/source_docs/data_lake.md
View File

@ -2,6 +2,12 @@
For context on getting started with ingestion, check out our [metadata ingestion guide](../README.md). For context on getting started with ingestion, check out our [metadata ingestion guide](../README.md).
:::caution
This source is in **Beta** and under active development. Not yet considered ready for production.
:::
## Setup ## Setup
To install this plugin, run `pip install 'acryl-datahub[data-lake]'`. Because the files are read using PySpark, we require Spark 3.0.3 with Hadoop 3.2 to be installed. To install this plugin, run `pip install 'acryl-datahub[data-lake]'`. Because the files are read using PySpark, we require Spark 3.0.3 with Hadoop 3.2 to be installed.