Comparison with GGP-Base Prover:
Median speedup | 47.258327927306716 |
Mean speedup | 65.83615026099721 |
Geometric mean speedup | 52.656709531129586 |
Ratio of # state changes with 1 second per game | 35.61812334915843 |
Ratio of times to run 1000 states per game | 0.013578926425813199 |
Number of games with errors | 12 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
REKKURA_BACKWARD_PROVER:1.0.0 | 515 | 11 | 3 | 10 |
REKKURA_BACKWARD_PROVER_OSTD:1.0.0 | 513 | 12 | 4 | 10 |
PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 | 521 | 8 | 0 | 9 |
GGP_BASE_PROVER:2015-04-26 | 529 | 0 | 0 | 11 |
ALLOY_TUPLE_PROVER:1 | 529 | 0 | 0 | 6 |
REKKURA_GENERIC_BACKWARD_PROVER_OSTD:1.0.0 | 516 | 13 | 0 | 10 |
PALAMEDES_JOCULAR:0.6.1 | 413 | 77 | 39 | 6 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 | 518 | 11 | 0 | 10 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 | 517 | 12 | 0 | 10 |
REKKURA_GENERIC_BACKWARD_PROVER:1.0.0 | 517 | 12 | 0 | 10 |
PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 | 519 | 10 | 0 | 10 |
Game-by-game statistics:
Games with errors:
Game | Error message |
DRESDEN/Goldrush/VeWczQ | RuntimeException: CompiledProver could not be created |
STANFORD/kono/HI7CHA | IllegalArgumentException: bound must be positive |
BASE/alexChess/LNo83g | Exception of type StackOverflowError |
BASE/racetrackcorridor/k1OQRg | GameDescriptionException: Goal is poorly defined for black in [( true ( cell blane a 1 b ) ), ( true ( cell blane a 2 b ) ), ( true ( cell blane a 3 b ) ), ( true ( cell blane b 1 b ) ), ( true ( cell blane b 2 b ) ), ( true ( cell blane b 3 b ) ), ( true ( cell blane c 1 b ) ), ( true ( cell blane c 2 b ) ), ( true ( cell blane c 3 b ) ), ( true ( cell blane d 1 b ) ), ( true ( cell blane d 2 b ) ), ( true ( cell blane d 3 b ) ), ( true ( cell blane e 1 black ) ), ( true ( cell blane e 2 b ) ), ( true ( cell blane e 3 b ) ), ( true ( cell wlane a 1 b ) ), ( true ( cell wlane a 2 b ) ), ( true ( cell wlane a 3 b ) ), ( true ( cell wlane b 1 b ) ), ( true ( cell wlane b 2 b ) ), ( true ( cell wlane b 3 b ) ), ( true ( cell wlane c 1 b ) ), ( true ( cell wlane c 2 b ) ), ( true ( cell wlane c 3 b ) ), ( true ( cell wlane d 1 b ) ), ( true ( cell wlane d 2 b ) ), ( true ( cell wlane d 3 b ) ), ( true ( cell wlane e 1 b ) ), ( true ( cell wlane e 2 white ) ), ( true ( cell wlane e 3 b ) ), ( true ( step 8 ) ), ( true ( wall blane c none ) ), ( true ( wall blane d right ) ), ( true ( wall wlane a none ) ), ( true ( wall wlane c left ) ), ( true ( wall wlane d none ) ), ( true ( walls black 6 ) ), ( true ( walls white 7 ) )] |
DRESDEN/SC_TestOnly_enabled/09o7gQ | RuntimeException: CompiledProver could not be created |
BASE/amazonsTorus/soxT8g | Exception of type StackOverflowError |
STANFORD/multiplesukoshi/vLSQPg | ArrayIndexOutOfBoundsException: 5 |
STANFORD/breakthroughsmall/HM0s5w | Exception of type NullPointerException |
DRESDEN/laikLee_hex/ZeP3QQ | Test process timed out after 240 seconds |
BASE/snakeAssemblit/sOydSg | GameDescriptionException: Goal is poorly defined for red in [( true ( at blue 4 1 ) ), ( true ( at red 4 1 ) ), ( true ( cell 3 3 f ) ), ( true ( cell 4 1 red ) ), ( true ( cell 4 2 f ) ), ( true ( cell 4 3 f ) ), ( true ( cell 4 4 f ) ), ( true ( cell 4 5 f ) ), ( true ( cell 4 6 f ) ), ( true ( cell 5 1 f ) ), ( true ( cell 5 2 f ) ), ( true ( cell 5 6 f ) ), ( true ( cell 6 2 f ) ), ( true ( cell 6 3 f ) ), ( true ( cell 6 4 f ) ), ( true ( cell 6 5 f ) ), ( true ( cell 6 6 f ) ), ( true ( cell 7 2 blue ) ), ( true ( control_assem blue ) ), ( true ( control_snake red ) ), ( true ( marked 2 4 ) ), ( true ( marked 3 4 ) ), ( true ( marked 4 3 ) ), ( true ( marked 4 4 ) ), ( true ( marked 6 3 ) ), ( true ( marks_remain blue 5 ) ), ( true ( marks_remain red 5 ) ), ( true ( score blue 20 ) ), ( true ( score red 12 ) ), ( true ( step 40 ) )] |
BASE/laikLee_hex/zbyscQ | Test process timed out after 240 seconds |
DRESDEN/javastrike/whONTQ | Exception of type StackOverflowError |