Track the performance of official Stockfish
in finding the (best) mates within the 6558 mate problems in matetrack.epd.
The raw data is available in matetrack1000000.csv,
and is visualized in the graphs below.
ChestUCI_23102018.epd: the original suite derived from publicly availableChestUCI.epdfiles, see FishCooking. It contains 6561 positions, with one draw, two positions that are likely draws due to the 50 move rule, some illegal positions and some positions with a sub-optimal value for the fastest known mate.matetrack.epd: The successor toChestUCI_23102018.epd, with all illegal positions removed and all known errors corrected. The plots shown above are based on this file. It contains 6558 mate problems, ranging from mate in 1 (#1) to #126 for positions with between 4 and 32 pieces. In 26 positions the side to move is going to get mated.matetrackpv.epd: The same asmatetrack.epd, but for each position the file also includes a PV leading to the checkmate, if such a PV is known.matedtrack.epd: Derived frommatetrackpv.epdby applying a best move in all those positions, where the winning side is to move, and where a best move is known. The order of the positions inmatedtrack.epdcorresponds 1:1 to the order inmatetrack.epd. So the new test suite still contains 6558 mate problems, but for 6506 of them the side to move is going to get mated.
With the help of the script advancepvs.py it is easy to derive new mate
puzzles from the information stored in matetrackpv.epd. For example, the file matedtrack.epd has been created with the command
python advancepvs.py --plies 1 --mateType won && sed 's/; PV.*/;/' matedtrackpv.epd > matedtrack.epdSimilarly, a file with only #-10 positions can be created with the command
python advancepvs.py --targetMate -10 && grep 'bm #-10;' matedtrackpv.epd > mate-10.epd