Comparison with GGP-Base Prover:
| Median speedup | 48.410648654018075 |
| Mean speedup | 235.54674481396236 |
| Geometric mean speedup | 53.50416703044475 |
| Ratio of # state changes with 1 second per game | 40.0778377793631 |
| Ratio of times to run 1000 states per game | 0.008053950215990235 |
| Number of games with errors | 36 |
Comparison with other engines:
| Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
| PALAMEDES_JOCULAR:0.6.1 (comparison) | 401 | 75 | 44 | 26 |
| PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 (comparison) | 510 | 8 | 2 | 32 |
| SANCHO_DEAD_RECKONING_PROPNET:1.61c (comparison) | 0 | 18 | 502 | 0 |
| ALLOY_TUPLE_PROVER:2 (comparison) | 507 | 0 | 13 | 34 |
| CADIAPLAYER_PROLOG:3.0 (comparison) | 372 | 142 | 6 | 15 |
| REKKURA_GENERIC_FORWARD_PROVER:1.0.0 (comparison) | 517 | 3 | 0 | 26 |
| REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 (comparison) | 516 | 4 | 0 | 26 |
| REKKURA_BACKWARD_PROVER:1.0.0 (comparison) | 517 | 3 | 0 | 26 |
| REKKURA_BACKWARD_PROVER_OSTD:1.0.0 (comparison) | 516 | 4 | 0 | 26 |
| PALAMEDES_JAVA_ECLIPSE:0.6.1 (comparison) | 462 | 7 | 51 | 34 |
| GGP_BASE_PROVER:2015-04-26 (comparison) | 514 | 0 | 6 | 36 |
| PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 (comparison) | 506 | 13 | 1 | 32 |
| ALLOY_COMPILED_PROVER_CACHING:2 (comparison) | 258 | 2 | 260 | 32 |
| FLUXPLAYER_PROLOG:1.1 (comparison) | 464 | 40 | 16 | 34 |
Game-by-game statistics:
Games with errors:
| Game | Error message |
| BASE/cylinder-checkers/hlldmw | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| DRESDEN/knightwar/7hhAqg | Test process timed out after 240 seconds |
| BASE/gt_two_thirds_6p/867v3Q | Test process timed out after 240 seconds |
| DRESDEN/checkers-newgoals/IJOqXQ | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| DRESDEN/checkers-cylinder-mustjump/vW_-pA | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| BASE/amazonsSuicide/dE1QEQ | Test process timed out after 240 seconds |
| BASE/factoringImpossibleTurtleBrain/kcBhdw | OutOfMemoryError: Java heap space |
| DRESDEN/merrills/aYEzwA | OutOfMemoryError: GC overhead limit exceeded |
| DRESDEN/checkers-mustjump-torus/cVc3gA | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| BASE/amazonsTorus/soxT8g | Test process timed out after 240 seconds |
| BASE/alexChess/LNo83g | Test process timed out after 240 seconds |
| DRESDEN/vacuumcleaner_obstacles_5/fXBV4g | Test process timed out after 240 seconds |
| DRESDEN/uf20-01.cnf.SAT/42Rs8A | Exception of type NullPointerException |
| BASE/merrills/pku8Tg | OutOfMemoryError: GC overhead limit exceeded |
| DRESDEN/vacuumcleaner_obstacles_3/4NjSmw | Test process timed out after 240 seconds |
| DRESDEN/checkers/jIDMIg | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| DRESDEN/pancakes88/aD3E7g | Test process timed out after 240 seconds |
| DRESDEN/vacuumcleaner_random_big/DwzFaQ | Test process timed out after 240 seconds |
| DRESDEN/checkers-suicide-cylinder-mustjump/L2BYWg | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| DRESDEN/checkers-mustjump/HUr33w | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| DRESDEN/laikLee_hex/ZeP3QQ | Test process timed out after 240 seconds |
| DRESDEN/battlesnakes2011/93VtTw | Test process timed out after 240 seconds |
| DRESDEN/god/2EDD5w | Test process timed out after 240 seconds |
| BASE/mummymaze1p/PT_EXA | Exception of type NullPointerException |
| BASE/knightwar/DVGY4Q | Exception of type NullPointerException |
| BASE/laikLee_hex/zbyscQ | Test process timed out after 240 seconds |
| DRESDEN/cylinder-checkers/clOO3Q | IllegalArgumentException: Cartesian product too large, must have size at most Integer.MAX_VALUE |
| DRESDEN/mummymaze1p/AekgaQ | Test process timed out after 240 seconds |
| DRESDEN/farmers/S_ASnw | Test process timed out after 240 seconds |
| DRESDEN/battlesnakes1509/-qZrLw | Test process timed out after 240 seconds |
| DRESDEN/vacuumcleaner_obstacles_6/NVwsZw | Test process timed out after 240 seconds |
| BASE/sudoku/NTaNkw | Test process timed out after 240 seconds |
| BASE/god/qF06gw | Test process timed out after 240 seconds |
| DRESDEN/ggp-course2013_nicolai/uEin8g | Test process timed out after 240 seconds |
| BASE/slaughter/cOch8A | Test process timed out after 240 seconds |
| DRESDEN/small_dominion/yB5GJA | Test process timed out after 240 seconds |