yjcelly / parameter_server

A distributed machine learning framework.

Parameter Server

The parameter server is a distributed system scaling to industry size machine learning problems. It is a joint project by CMU SML-Lab, Baidu IDL, and Google

Requirements

• Compiler: gcc >= 4.7.2 (prefer >=4.9) or llvm >= 3.4
• OS: Should work on both linux and mac. Tested on Ubuntu 12.10, 13.10, 14.04, RHEL 4U3, Mac OS X 10.9
• Dependent libraries: zeromq, gflags, glogs, gtest, protobuf, zlib, snappy, and eigen3.

Build dependent libraries

git clone https://github.com/mli/third_party
cd third_party
./install.sh

Build the system

git clone https://github.com/mli/parameter_server
cd parameter_server
ln -s /your/third/library third_party
make -j8

Run the system See examples in config/rcv1. More information are in the wiki.