Comparison with GGP-Base Prover:
Median speedup | 0.6177414587221218 |
Mean speedup | 0.6234018970982927 |
Geometric mean speedup | 0.5374851648454426 |
Ratio of # state changes with 1 second per game | 0.588009881600954 |
Ratio of times to run 1000 states per game | 3.231003710790238 |
Number of games with errors | 11 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
REKKURA_BACKWARD_PROVER:1.0.0 | 308 | 10 | 212 | 8 |
REKKURA_BACKWARD_PROVER_OSTD:1.0.0 | 320 | 11 | 199 | 8 |
ALLOY_COMPILED_PROVER_CACHING:1 | 0 | 9 | 521 | 8 |
GGP_BASE_PROVER:2015-04-26 | 21 | 0 | 509 | 10 |
ALLOY_TUPLE_PROVER:1 | 1 | 5 | 524 | 10 |
REKKURA_GENERIC_BACKWARD_PROVER_OSTD:1.0.0 | 477 | 11 | 42 | 7 |
PALAMEDES_JOCULAR:0.6.1 | 104 | 77 | 349 | 5 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 | 454 | 10 | 66 | 8 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 | 456 | 11 | 63 | 8 |
REKKURA_GENERIC_BACKWARD_PROVER:1.0.0 | 477 | 10 | 43 | 7 |
PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 | 404 | 4 | 122 | 3 |
Game-by-game statistics:
Games with errors:
Game | Error message |
BASE/gt_two_thirds_4p/DStnxQ | Exception of type NullPointerException |
BASE/sudoku/NTaNkw | Exception of type NullPointerException |
STANFORD/kono/HI7CHA | Exception of type NullPointerException |
BASE/alexChess/LNo83g | Exception of type StackOverflowError |
STANFORD/rainbow/_4qNSQ | Exception of type NullPointerException |
BASE/gt_two_thirds_2p/1APDGg | Exception of type NullPointerException |
BASE/gt_two_thirds_6p/867v3Q | Exception of type NullPointerException |
STANFORD/dualrainbow/G3OnRQ | Exception of type NullPointerException |
DRESDEN/minichess-evilconjuncts/th24Tw | Exception of type NullPointerException |
BASE/amazonsTorus/soxT8g | Test process timed out after 240 seconds |
BASE/minichess-evilconjuncts/4OpQzw | Exception of type NullPointerException |