yujunjun/OpenMetadata
1
0
Fork 0
mirror of https://github.com/open-metadata/OpenMetadata.git synced 2025-07-16 21:50:27 +00:00
Code Issues Packages Projects Releases Wiki Activity
OpenMetadata/ingestion/tests/integration/source/mlflow
History
Pere Miquel Brull f2fb0521c2
Update airflow loggers and rename ometa loggers (#9868) 
* Update airflow loggers and rename ometa loggers

* ANSI print to logger

* Remove colored logging from tests

* Merge ometa_logger into the one used in loggers class

* linting

* linting

Co-authored-by: Nahuel Verdugo Revigliono <nahuel@getcollate.io>
2023-01-23 16:28:17 +01:00
..
__init__.py
[issue-1976] - Ingestion SonarCloud (#2085)
2022-01-07 10:28:38 +01:00
docker-compose.yml
Fix #5367 - MlFlow connector & MLServices (#5446)
2022-06-21 14:54:36 +02:00
Dockerfile
fix: ingestion/tests/integration/source/mlflow/Dockerfile to reduce vulnerabilities (#3618)
2022-03-23 18:26:41 -07:00
experiment.py
[issue-1976] - Ingestion SonarCloud (#2085)
2022-01-07 10:28:38 +01:00
Makefile
[issue-1976] - Ingestion SonarCloud (#2085)
2022-01-07 10:28:38 +01:00
README.md
Fix #5367 - MlFlow connector & MLServices (#5446)
2022-06-21 14:54:36 +02:00
train.py
Update airflow loggers and rename ometa loggers (#9868)
2023-01-23 16:28:17 +01:00

README.md

MlFlow Integration Test

We have prepared a small test to check the MlFlow ingestion.

We have used a decoupled architecture for MlFlow with:

  • mlflow running in a remote server
  • minio as the artifact store
  • mysql as the registry

To run this test:

  • cd into this directory
  • make build
  • pip install mlflow-skinny sklearn. We use the skinny one for the client.
  • python experiment.py should show new experiments in http://localhost:5000
  • python train.py will register a new model
  • metadata ingest -c examples/workflows/mlflow.yaml will run the workflow.