Comparison with GGP-Base Prover:
| Median speedup | 0.4285787165450585 |
| Mean speedup | 2.2724551103772836 |
| Geometric mean speedup | 0.0 |
| Ratio of # state changes with 1 second per game | 0.37592856488561444 |
| Ratio of times to run 1000 states per game | Infinity |
| Number of games with errors | 15 |
Comparison with other engines:
| Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
| REKKURA_BACKWARD_PROVER:1.0.0 | 222 | 0 | 305 | 1 |
| ALLOY_COMPILED_PROVER_CACHING:1 | 4 | 10 | 513 | 12 |
| PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 | 199 | 8 | 320 | 11 |
| GGP_BASE_PROVER:2015-04-26 | 114 | 1 | 412 | 14 |
| ALLOY_TUPLE_PROVER:1 | 35 | 4 | 488 | 12 |
| REKKURA_GENERIC_BACKWARD_PROVER_OSTD:1.0.0 | 526 | 1 | 0 | 0 |
| PALAMEDES_JOCULAR:0.6.1 | 93 | 77 | 357 | 8 |
| REKKURA_GENERIC_FORWARD_PROVER:1.0.0 | 518 | 0 | 9 | 1 |
| REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 | 517 | 0 | 10 | 0 |
| REKKURA_GENERIC_BACKWARD_PROVER:1.0.0 | 526 | 1 | 0 | 1 |
| PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 | 273 | 8 | 246 | 10 |
Game-by-game statistics:
Games with errors:
| Game | Error message |
| BASE/ruleDepthExponential/UamhHQ | Test process timed out after 240 seconds |
| BASE/gt_two_thirds_4p/DStnxQ | Test process timed out after 240 seconds |
| DRESDEN/vacuumcleaner_obstacles_3/4NjSmw | Test process timed out after 240 seconds |
| DRESDEN/mummymaze1p/AekgaQ | Test process timed out after 240 seconds |
| BASE/sudoku/NTaNkw | Test process timed out after 240 seconds |
| DRESDEN/queens/mW2wHQ | IllegalArgumentException: too many occurrences: 2147484126 |
| DRESDEN/vacuumcleaner_obstacles_5/fXBV4g | Test process timed out after 240 seconds |
| BASE/gt_two_thirds_6p/867v3Q | Test process timed out after 240 seconds |
| DRESDEN/vacuumcleaner_obstacles_6/NVwsZw | Test process timed out after 240 seconds |
| DRESDEN/laikLee_hex/ZeP3QQ | Test process timed out after 240 seconds |
| BASE/queens/HyJJnQ | IllegalArgumentException: too many occurrences: 2147484126 |
| BASE/mummymaze1p/PT_EXA | Test process timed out after 240 seconds |
| BASE/slaughter/cOch8A | Test process timed out after 240 seconds |
| BASE/laikLee_hex/zbyscQ | Test process timed out after 240 seconds |