Skip to content

Latest commit

 

History

History
 
 

gnmt

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

Current implementation

Project setup

# Create Python environment 
virtualenv -p python3 ./env && source ./env/bin/activate

# Install MLCube and MLCube docker runner from GitHub repository (normally, users will just run `pip install mlcube mlcube_docker`)
git clone https://github.com/mlcommons/mlcube && cd mlcube/mlcube
python setup.py bdist_wheel  && pip install --force-reinstall ./dist/mlcube-* && cd ..
cd ./runners/mlcube_docker && python setup.py bdist_wheel  && pip install --force-reinstall --no-deps ./dist/mlcube_docker-* && cd ../../..

# Fetch the translation workload
git clone https://github.com/mlcommons/inference && cd ./inference
git fetch origin pull/1022/head:feature/mlcube_translation && git checkout feature/mlcube_translation
cd ./translation/gnmt/mlcube

Tasks execution

# Download dataset. Default path = /workspace/data
# To override it, use data_dir=DATA_DIR
mlcube run --task download_data

# Download model. Default path = /workspace/model
# To override it, use model_dir=MODEL_DIR
mlcube run --task download_model

# Evaluate performance. Default ouptut path = ./workspace/output
# Parameters to override: data_dir=DATA_DIR, model_dir=MODEL_DIR, parameters_file=PATH_TO_FILE, output_dir=OUTPUT_DIR
mlcube run --task run_performance

# Evaluate accuracy. Default ouptut path = ./workspace/output
# Parameters to override: data_dir=DATA_DIR, model_dir=MODEL_DIR, parameters_file=PATH_TO_FILE, output_dir=OUTPUT_DIR
mlcube run --task run_accuracy

Important: We are targeting pull-type installation, so MLCubes should be available on docker hub. If not, try this:

mlcube run ... -Pdocker.build_strategy=auto

Also, users can override the workspace directory by using:

mlcube run --task=download --workspace=absolute_path_to_custom_dir