SYNTCOMP / benchmarks

Repository of benchmarks for SYNTCOMP

SYNTCOMP benchmarks

This repository contains all benchmarks collected over the years by SYNTCOMP community. There are several kinds of benchmarks:

• aiger: safety games encoded in the extended AIGER format,
• tlsf: LTL synthesis encoded in TLSF format,
• tlsf-fin: LTLf synthesis, that is LTL for finite words, encoded in extended TLSF format
• parity: parity games encoded in the extended HOA format.

Their folders contain more descriptions.

Submit new benchmarks

To submit a new benchmark

• create a new issue
• attach an archive with your new benchmarks with a sensible name
• the archive should also contain readme.md or readme.pdf describing the benchmarks, relevant papers, etc.

We will check if everything is ok, and then add to the repository. Alternatively, you can create a pull request with your benchmarks.

Download benchmarks

• year 2023: TLSF, TLSF-fin, parity
• year 2022: TLSF, parity
• year 2021: TLSF, parity synthesis and realizability
• year 2020: AIGER, TLSF, for parity, see the repository.
• year 2019: AIGER, TLSF
• for the years 2015-2018, see here

If you find bugs in benchmarks, please create an issue describing the problem.