yujunjun/datahub
2
0
Fork 0
mirror of https://github.com/datahub-project/datahub.git synced 2025-10-26 16:34:44 +00:00
Code Issues Packages Projects Releases Wiki Activity

docs: upgrade docusaurus, minor ingestion updates (#2774)

Browse Source
This commit is contained in:
Harshal Sheth 2021-06-27 23:38:38 -07:00 committed by GitHub
parent 942196e3c1
commit c05459b446
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
4 changed files with 1587 additions and 1574 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
docs-website/package.json
View File

@ -15,9 +15,9 @@
"lint-check": "prettier -l generateDocsDir.ts sidebars.js src/pages/index.js"
},
"dependencies": {
"@docusaurus/core": "^2.0.0-beta.0",
"@docusaurus/plugin-ideal-image": "^2.0.0-beta.0",
"@docusaurus/preset-classic": "^2.0.0-beta.0",
"@docusaurus/core": "^2.0.0-beta.2",
"@docusaurus/plugin-ideal-image": "^2.0.0-beta.2",
"@docusaurus/preset-classic": "^2.0.0-beta.2",
"clsx": "^1.1.1",
"react": "^16.12.0",
"react-dom": "^16.12.0",

3145
docs-website/yarn.lock
View File

File diff suppressed because it is too large Load Diff

1
metadata-ingestion/README.md
View File

@ -19,7 +19,6 @@ The folks over at [Acryl Data](https://www.acryl.io/) maintain a PyPI package fo
```shell
# Requires Python 3.6+
python3 -m pip install --upgrade pip wheel setuptools
python3 -m pip uninstall datahub acryl-datahub || true # sanity check - ok if it fails
python3 -m pip install --upgrade acryl-datahub
datahub version
# If you see "command not found", try running this instead: python3 -m datahub version

9
metadata-ingestion/developing.md
View File

@ -22,7 +22,7 @@ The architecture of this metadata ingestion framework is heavily inspired by [Ap
```shell
../gradlew :metadata-ingestion:installDev
source venv/bin/activate
datahub version # check that it works
datahub version # should print "version: unavailable (installed via git)"
```
### Common setup issues
@ -94,10 +94,10 @@ Also take a look at the guide to [adding a source](./adding-source.md).
pip install -e '.[dev]'
# Run unit tests.
pytest tests/unit
pytest -m 'not slow'
# Run integration tests. Note that the integration tests require docker.
pytest tests/integration
# Run Docker-based integration tests.
pytest -m 'slow'
```
### Sanity check code before committing
@ -111,5 +111,6 @@ mypy .
pytest
# These steps are all included in the gradle build:
../gradlew :metadata-ingestion:lintFix
../gradlew :metadata-ingestion:check
```