Skip to the content.

Install MMS

Prerequisites

For ubuntu:

sudo apt-get install openjdk-8-jre-headless

For centos

sudo yum install java-1.8.0-openjdk

For Mac:

brew tap caskroom/versions
brew update
brew cask install java8

You can also download and install Oracle JDK manually if you have trouble with above commands.

pip install mxnet-mkl

or for GPU instance:

pip install mxnet-cu90mkl

Install MMS with pip

To install MMS for the first time, install Python, then run the following command:

pip install multi-model-server

To upgrade from a previous version of MMS, run:

pip install -U multi-model-server

Install MMS from Source Code

If you prefer, you can clone MMS from source code. First, run the following command:

git clone https://github.com/awslabs/multi-model-server.git && cd multi-model-server

To install MMS, run:

pip install .

To upgrade MMS, run:

pip install -U .

Install MMS for Development

If you plan to develop with MMS and change some of the source code, install it from source code and make your changes executable with this command:

pip install -e .

To upgrade MMS from source code and make changes executable, run:

pip install -U -e .

Troubleshooting Installation

Issue Solution
java not found, please make sure JAVA_HOME is set properly. Make sure java is installed. java is on the $PATH or $JAVA_HOME is set properly.
Your PYTHONPATH points to a site-packages dir for Python 3.x but you are running Python 2.x! You do one of following: <ul><li>use virtualenv</li><li>unset PYTHONPATH</li><li>set PYTHONPATH properly</li></ul>