Lazy Release Persistency (LRP).

LRP is integrated to the PriME simulator. PriME is an execution-driven x86 simulator for manycore architectures. It is capable of simulating 1000+ cores with rich cache hierarchies, coherence protocols and On-chip Network. It is capable of running both multi-threaded and multi-programmed workloads. Moreover, it can distribute multi-programmed workloads into multiple host machines and communicate via OpenMPI.

Note that this is not cycle accurate and a preliminary prototype of the idea.

Directory structure

bin: executable binary files
cmd: bash command files generated by run_prime
dep: dependency files generated during compilation
obj: object files generated during compilation
output: default location for simulation report files
src: source code files
tools: python scripts to config and run PriME
xml: default location for configuration xml files generated by config_prime
pbench: benchmark based on the synchrobench lock-free data structures
ppin: pin tests for lrp annotated with release semantics
asplos: scripts and files for asplos artifacts.
- /asplos
  - /asplos-scripts - scripts required to run some test programs
  - /asplos-result - final results of each program
  - /asplos-output - raw output of the primesim and lrp

Requirements for LRP

We recommend you to install these software manually. But you can also use build_all.sh
gcc v4.8 (tested) or higher is recommended
Intel Pin tested under v2.14 71313 (Download here )
OpenMPI tested under v3.0.0 (Download here)
- Need to enable MPI_THREAD_MULTIPLE which can be done by adding --enable-mpi-thread-multiple option during installation. If you already have OPEN MPI you can chek this by running "ompi_info | grep -i thread" command. If not you have to install openmpi. Please follow the MPI_README.md for more information.
libxml2 tested under v2.9.1
Python 2.7 or above
GNU bash, version 4.2.46(2)-release (x86_64-redhat-linux-gnu)

Our Setup

Linux 3.10.0-1062.1.1.el7.x86_64
AMD server with 64 CPUs (2 threads per core) with AMD Opteron(tm) Processor 6376 x86_64, 2.3 GHz.
16GiB in memory is enough

Installation

Option 1: Build from DOI or other sources

Access doi here
Run the script provided.
sh build_lrp_all.sh
- This will create lrp+primesim and all the required software.I.e.
  - primsim
  - software
- Setup the environment on primesim/env.sh
- compile lrp and pbench and generate binaries.
- You can continue with the common-steps and experimental-workflow.

Option 2: Download LRP Source and Build (Preferred)

git clone https://github.com/dananjayamahesh/primesim.git
cd primesim
git checkout dimp
(make sure you are in the dimp branch which is LRP)

Build all and compile automatically

please check build_all.sh and run,
sh build_all.sh
- This creates software directory outside your primesim path with openmpi and pin.
- Compile lrp and pbench and generate binaries.

Option 3: Build Manually

This might be helpful if you already have some software like open MPI.
Install all software dependencies manually.
- Check build_all.sh as well env.sh.

Common Steps (From primesim path)

Compile LRP (PRiME)

check and modify env.sh to set those environment variables to be the correct paths.(Important)
source env.sh
make -B

Compile Benchmarks (PBench)

cd pbench/syncbench
make -B
cd ../..

Experimental Workflow

Simple Test for MPI,Pin and LRP

mpiexec --verbose --display-map --display-allocation -mca btl_sm_use_knem 0 -np 1 ls
Run this script to check if all components are working.
sh run_all.sh simple-test

Test and Run the Framework

This is just to make sure all the software/frameworks are working fine.
sh run_all.sh test

Possible Issues/Errors and Fix(Please go to next section if no errors)

libxml2 file path not found. Plase check if your libxml2 path in the env.sh is right.
- sudo apt-get install libxml2-dev (please check here)
MPI Errors: libmpi.so path not found or similar MPI ERRORs. Please check OPENMPI_LIB_PATH in env.sh and check if the path is in the right path. MPI_README.md
- Please check the env.sh and make sure libmpi.so file is in the correct path.
- Also make sure your PATH and LD_LIBRARY_PATH have been set to correct locations.
- Please check build_all.sh and env.sh file.
- Reinstall Opem MPI, edit env.sh and source env.sh.
please check the MPI_THREAD_MULTIPLE flag. Most of the time it is not set by default. In case, you have to reinstall MPI with the flag set (--enable-mpi-thread-multiple).
Run "ompi_info | grep -i thread". It should say yes. (Thread support: posix (MPI_THREAD_MULTIPLE: yes, OPAL support: yes, OMPI progress: no, ORTE progress: yes, Event lib: yes))
echo 0 > /proc/sys/kernel/yama/ptrace_scop . If you are asked to do this, please do it. You may need to do this as root. (su && echo 0 > /proc/sys/kernel/yama/ptrace_scop)

Please contact dananjayamahesh@gmail.com if you have any question or issue.

dananjayamahesh / primesim