Comparison with GGP-Base Prover:
Median speedup | 0.4368400099331091 |
Mean speedup | 2.2195756584197825 |
Geometric mean speedup | 0.0 |
Ratio of # state changes with 1 second per game | 0.3750252130810035 |
Ratio of times to run 1000 states per game | Infinity |
Number of games with errors | 14 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
ALLOY_DIFF_PROP_NET:1 (comparison) | 0 | 26 | 516 | 4 |
PALAMEDES_JOCULAR:0.6.1 (comparison) | 100 | 79 | 363 | 8 |
PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 (comparison) | 206 | 9 | 327 | 11 |
SANCHO_DEAD_RECKONING_PROPNET:1.61c (comparison) | 0 | 44 | 498 | 4 |
ALLOY_TUPLE_PROVER:2 (comparison) | 34 | 0 | 508 | 12 |
CADIAPLAYER_PROLOG:3.0 (comparison) | 23 | 153 | 366 | 4 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 (comparison) | 533 | 0 | 9 | 1 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 (comparison) | 532 | 0 | 10 | 0 |
REKKURA_BACKWARD_PROVER:1.0.0 (comparison) | 231 | 0 | 311 | 1 |
PALAMEDES_JAVA_ECLIPSE:0.6.1 (comparison) | 45 | 8 | 489 | 13 |
GGP_BASE_PROVER:2015-04-26 (comparison) | 117 | 0 | 425 | 14 |
PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 (comparison) | 281 | 13 | 248 | 10 |
ALLOY_COMPILED_PROVER_CACHING:2 (comparison) | 4 | 4 | 534 | 12 |
FLUXPLAYER_PROLOG:1.1 (comparison) | 105 | 41 | 396 | 13 |
Game-by-game statistics:
Games with errors:
Game | Error message |
BASE/ruleDepthExponential/UamhHQ | Test process timed out after 240 seconds |
BASE/gt_two_thirds_6p/867v3Q | Test process timed out after 240 seconds |
BASE/gt_two_thirds_4p/DStnxQ | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_obstacles_5/fXBV4g | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_obstacles_3/4NjSmw | Test process timed out after 240 seconds |
DRESDEN/queens/mW2wHQ | IllegalArgumentException: too many occurrences: 2147484126 |
DRESDEN/laikLee_hex/ZeP3QQ | Test process timed out after 240 seconds |
BASE/queens/HyJJnQ | IllegalArgumentException: too many occurrences: 2147484126 |
BASE/mummymaze1p/PT_EXA | Test process timed out after 240 seconds |
BASE/laikLee_hex/zbyscQ | Test process timed out after 240 seconds |
DRESDEN/mummymaze1p/AekgaQ | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_obstacles_6/NVwsZw | Test process timed out after 240 seconds |
BASE/sudoku/NTaNkw | Test process timed out after 240 seconds |
BASE/slaughter/cOch8A | Test process timed out after 240 seconds |