Comparison with GGP-Base Prover:
Median speedup | 0.29267919820014476 |
Mean speedup | 0.39719421792467274 |
Geometric mean speedup | 0.0 |
Ratio of # state changes with 1 second per game | 0.5640782977862762 |
Ratio of times to run 1000 states per game | Infinity |
Number of games with errors | 13 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
REKKURA_BACKWARD_PROVER:1.0.0 | 244 | 9 | 276 | 8 |
REKKURA_BACKWARD_PROVER_OSTD:1.0.0 | 246 | 10 | 273 | 8 |
ALLOY_COMPILED_PROVER_CACHING:1 | 0 | 10 | 519 | 10 |
PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 | 122 | 3 | 404 | 4 |
GGP_BASE_PROVER:2015-04-26 | 35 | 1 | 493 | 12 |
ALLOY_TUPLE_PROVER:1 | 1 | 6 | 522 | 12 |
REKKURA_GENERIC_BACKWARD_PROVER_OSTD:1.0.0 | 397 | 10 | 122 | 7 |
PALAMEDES_JOCULAR:0.6.1 | 4 | 74 | 451 | 3 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 | 381 | 9 | 139 | 8 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 | 384 | 10 | 135 | 8 |
REKKURA_GENERIC_BACKWARD_PROVER:1.0.0 | 392 | 9 | 128 | 7 |
Game-by-game statistics:
Games with errors:
Game | Error message |
BASE/gt_two_thirds_4p/DStnxQ | Exception of type NullPointerException |
BASE/queens08lg/Ru7eqQ | Test process timed out after 240 seconds |
BASE/sudoku/NTaNkw | Exception of type NullPointerException |
BASE/alexChess/LNo83g | Exception of type StackOverflowError |
STANFORD/rainbow/_4qNSQ | Exception of type NullPointerException |
BASE/gt_two_thirds_2p/1APDGg | Exception of type NullPointerException |
BASE/queens31lg/0gID-A | Test process timed out after 240 seconds |
BASE/gt_two_thirds_6p/867v3Q | Exception of type NullPointerException |
STANFORD/dualrainbow/G3OnRQ | Exception of type NullPointerException |
BASE/amazonsTorus/soxT8g | Exception of type StackOverflowError |
BASE/reversi/d8UMeA | Test process timed out after 240 seconds |
BASE/queens/HyJJnQ | Test process timed out after 240 seconds |