Copyright © 2022 Vincent A. Cicirello
This repository contains code to reproduce the experiments, and analysis of experimental data, from the following paper:
Vincent A. Cicirello. 2022. Cycle Mutation: Evolving Permutations via Cycle Induction, Applied Sciences, 12(11), Article 5506 (June 2022). doi:10.3390/app12115506
Related Publication | |
---|---|
License | |
Packages and Releases |
The experiments depend upon the following libraries, and in some cases this research has also contributed to these libraries:
To build and run the experiments on your own machine, you will need the following:
- JDK 11: I used OpenJDK 11, but other distributions should be fine.
- Apache Maven: In the root of the repository, there is a
pom.xml
for building the Java programs for the experiments. Using thispom.xml
, Maven will take care of downloading the exact versions of Chips-n-Salsa (release 4.7.0), JavaPermutationTools (release 3.1.1), and ρμ (release 1.2.0) that were used in the experiments. - Python 3: The repository contains Python programs that were used to
compute summary statistics, and to generate
graphs for the figures of the paper. If you want to run the Python programs,
you will need Python 3. I specifically used Python 3.9.6. You also need
matplotlib installed. - Make: The repository contains a Makefile to simplify running the build, running the experiment's Java programs, and running the Python program to analyze the data. If you are familiar with using the Maven build tool, and running Python programs, then you can just run these directly, although the Makefile may be useful to see the specific commands needed.
The source code of the Java programs implementing the experiments is in the src/main directory. You can build the experiment programs in one of the following ways.
Using Maven: Execute the following from the root of the repository.
mvn clean package
Using Make: Or, you can execute the following from the root of the repository.
make build
This produces a jar file containing several Java programs for running
different parts of the experiments and analysis. The jar also contains all
dependencies, including Chips-n-Salsa,
JavaPermutationTools, and
ρμ.
If you are unfamiliar with the usual structure of the directories of
a Java project built with Maven, the .class
files, the .jar
file,
etc will be found in a target
directory that is created by the
build process.
As an alternative to building the jar (see above), you can choose to instead download a prebuilt jar of the experiments from the Maven Central repository. The Makefile contains a target that will do this for you, provided that you have curl installed on your system. To download the jar of the precompiled code of the experiments, run the following from the root of the repository:
make download
The jar that it downloads contains the compiled code of the experiments as well as all dependencies within a single jar file.
If you just want to inspect the data from my runs, then you can find that output in the /data directory. If you instead want to run the experiments yourself, you must first either follow the build instructions or download a prebuilt jar (see above sections). Once the jar of the experiments is either built or downloaded, you can then run the experiments with the following executed at the root of the repository:
make experiments
If you don't want to overwrite my original data files, then first change the variable
pathToDataFiles
in the Makefile
before running the above command.
This will run each of the experiment programs in sequence, with the results piped to text files in the /data directory. Note that this directory already contains the output from my runs, so if you execute this command, you will overwrite the data that was used in the paper. Some parts of this will not change, but certain parts, due to randomization may not be exactly the same, although should be statistically consistent.
There are also several other targets in the Makefile if you wish to run only some of the experiments from the paper. See the Makefile for details.
One of the other make targets will execute the program that computes the fitness distance correlation (FDC) results for the three small instances of the different problems. To tun the FDC program, execute the following:
make fdc
To run the Python program that I used to generate summary statistics,
and generate the graphs for the figures from the paper,
you need Python 3 installed. The source code of the Python programs is
found in the src/analysis directory. To run the analysis
execute the following at the root of the repository:
make analysis
If you don't want to overwrite my original data files, and figures, then change the variable
pathToDataFiles
in the Makefile
before running the above command.
This will analyze the data from the /data directory. It will also generate the figures in that directory, as well as output a few txt files with summary statistics into that directory. This make command will also take care of installing any required Python packages if you don't already have them installed, such as matplotlib.
To convert the eps
versions of the figures to pdf
, then after running the above
analysis, run the following (this assumes that you have epstopdf installed):
make epstopdf
There are a few other files, potentially of interest, in the repository, which include:
system-stats.txt
: This file contains details of the system I used to run the experiments, such as operating system, processor specs, Java JDK and VM. It is in the /data directory.
The code to replicate the experiments from the paper, as well as the Chips-n-Salsa, JavaPermutationTools, and ρμ libraries are licensed under the GNU General Public License 3.0.