Comparison with GGP-Base Prover:
Median speedup | 1.4848323933717635 |
Mean speedup | 117.99519996142153 |
Geometric mean speedup | 1.4503581079716512 |
Ratio of # state changes with 1 second per game | 89.2888024201429 |
Ratio of times to run 1000 states per game | 16.884223124320854 |
Number of games with errors | 85 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
ALLOY_DIFF_PROP_NET:1 (comparison) | 44 | 26 | 401 | 75 |
PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 (comparison) | 352 | 7 | 112 | 80 |
SANCHO_DEAD_RECKONING_PROPNET:1.61c (comparison) | 39 | 39 | 393 | 70 |
ALLOY_TUPLE_PROVER:2 (comparison) | 179 | 2 | 290 | 85 |
CADIAPLAYER_PROLOG:3.0 (comparison) | 129 | 139 | 203 | 61 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 (comparison) | 427 | 8 | 36 | 80 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 (comparison) | 427 | 8 | 36 | 79 |
REKKURA_BACKWARD_PROVER:1.0.0 (comparison) | 361 | 8 | 102 | 80 |
REKKURA_BACKWARD_PROVER_OSTD:1.0.0 (comparison) | 363 | 8 | 100 | 79 |
PALAMEDES_JAVA_ECLIPSE:0.6.1 (comparison) | 176 | 0 | 295 | 76 |
GGP_BASE_PROVER:2015-04-26 (comparison) | 296 | 0 | 175 | 85 |
PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 (comparison) | 461 | 5 | 5 | 73 |
ALLOY_COMPILED_PROVER_CACHING:2 (comparison) | 39 | 4 | 428 | 83 |
FLUXPLAYER_PROLOG:1.1 (comparison) | 179 | 37 | 255 | 80 |
Game-by-game statistics:
Games with errors:
Game | Error message |
BASE/ruleDepthExponential/UamhHQ | Exception of type NullPointerException |
BASE/queens16ug/gT-ylw | Test process timed out after 240 seconds |
BASE/queens08ug/kJ_ZFQ | Test process timed out after 240 seconds |
BASE/reversiSuicide/9OxJlg | Test process timed out after 240 seconds |
BASE/factoringMutuallyAssuredDestruction/NH0LGg | Exception of type NullPointerException |
BASE/wargame02/BkVqqQ | Exception of type NullPointerException |
DRESDEN/bidding-tictactoe/yW5vTA | IllegalArgumentException: bound must be positive |
BASE/amazons_10x10/Bun8dA | Exception of type NullPointerException |
BASE/queens08lg/Ru7eqQ | Test process timed out after 240 seconds |
DRESDEN/knightwar/7hhAqg | Exception of type NullPointerException |
BASE/gt_two_thirds_6p/867v3Q | IllegalArgumentException: bound must be positive |
DRESDEN/knightazons/02I8BQ | Exception of type NullPointerException |
DRESDEN/breakthroughsuicide_v2/LU1nAw | Exception of type NullPointerException |
BASE/breakthroughSmall/HJ0tIA | Exception of type NullPointerException |
DRESDEN/ghostmaze2p/HY0UwA | Exception of type NullPointerException |
BASE/amazonsSuicide/dE1QEQ | Exception of type NullPointerException |
BASE/zhadu/DlA8iQ | ClassCastException: stanfordlogic.prover.VariableFact cannot be cast to stanfordlogic.prover.GroundFact |
BASE/mineClearingSmall/frsbvw | Exception of type NullPointerException |
DRESDEN/battlebrushes/QHXV4A | Exception of type NullPointerException |
DRESDEN/tttcc4/sAvtFg | Exception of type NullPointerException |
BASE/asteroids/BKCmPQ | Exception of type NullPointerException |
BASE/ttcc4_2player_alt/ZEJvYA | Exception of type NullPointerException |
BASE/wargame03/klXI8w | Exception of type NullPointerException |
BASE/pentago/86NgKw | Exception of type NullPointerException |
BASE/mummyMaze2p_2007/YGA3Vw | Exception of type NullPointerException |
BASE/queens12ug/u6Bkmg | Test process timed out after 240 seconds |
BASE/knightThrough/gcwFjA | Exception of type NullPointerException |
BASE/gt_attrition/kD_SCA | IllegalArgumentException: bound must be positive |
DRESDEN/bidding-tictactoe_10coins/mu5VhQ | IllegalArgumentException: bound must be positive |
BASE/biddingTicTacToe/8mESVw | IllegalArgumentException: bound must be positive |
BASE/amazonsTorus/soxT8g | Exception of type NullPointerException |
BASE/alexChess/LNo83g | Exception of type StackOverflowError |
STANFORD/pilgrimage/ObRZnQ | Exception of type NullPointerException |
BASE/colonelBlottoVariant/X-n-KQ | IllegalArgumentException: bound must be positive |
BASE/gt_two_thirds_4p/DStnxQ | IllegalArgumentException: bound must be positive |
STANFORD/untwistycomplex/HTWEwg | Exception of type NullPointerException |
DRESDEN/capture_the_king/EQ229Q | Exception of type NullPointerException |
BASE/amazons_8x8/7SOsIw | Exception of type NullPointerException |
BASE/queens31lg/0gID-A | Test process timed out after 240 seconds |
BASE/asteroidsSerial/id2QkA | Exception of type NullPointerException |
DRESDEN/pacman3p/rBnk8Q | Exception of type NullPointerException |
DRESDEN/amazons/dNB28A | Exception of type NullPointerException |
DRESDEN/babel/WdSW4A | Exception of type NullPointerException |
DRESDEN/backgammon/mqCW0Q | Exception of type NullPointerException |
BASE/knightazons/apnJBQ | Exception of type NullPointerException |
BASE/snakeParallel/RCVNtw | Exception of type NullPointerException |
BASE/shmup/ssTNlg | Exception of type NullPointerException |
DRESDEN/bomberman2p/x4h6jQ | Exception of type NullPointerException |
BASE/queens06ug/7Lq3tw | Test process timed out after 240 seconds |
BASE/majorities/ibJzSQ | IllegalArgumentException: bound must be positive |
DRESDEN/SC_TestOnly_enabled/09o7gQ | Exception of type NullPointerException |
BASE/ttcc4_2player/_aH_Mw | Exception of type NullPointerException |
BASE/othello-comp2007/86ZoMw | Exception of type NullPointerException |
BASE/ttcc4_2player_small/Cv72TA | Exception of type NullPointerException |
DRESDEN/queens/mW2wHQ | Test process timed out after 240 seconds |
BASE/asteroidsParallel/WauZiA | Exception of type NullPointerException |
BASE/ruleDepthLinear/OUBJpQ | Exception of type NullPointerException |
BASE/biddingTicTacToe_10coins/a-9ccQ | IllegalArgumentException: bound must be positive |
BASE/colonelBlottoVariant2/jruwGw | IllegalArgumentException: bound must be positive |
DRESDEN/mummymaze2p-comp2007/oTQRQg | Exception of type NullPointerException |
BASE/queens/HyJJnQ | Test process timed out after 240 seconds |
BASE/gt_two_thirds_2p/1APDGg | IllegalArgumentException: bound must be positive |
DRESDEN/god/2EDD5w | Test process timed out after 240 seconds |
BASE/amazonsTorus_10x10/Uxc08g | Exception of type NullPointerException |
DRESDEN/knightthrough/J7Fc_Q | Exception of type NullPointerException |
BASE/knightwar/DVGY4Q | Exception of type NullPointerException |
BASE/reversi/d8UMeA | Test process timed out after 240 seconds |
BASE/pentagoSuicide/SBgNhw | Exception of type NullPointerException |
BASE/catcha_mouse/cHv4dw | Exception of type NullPointerException |
BASE/wargame01/_GZFZg | Exception of type NullPointerException |
DRESDEN/breakthroughsuicide/Y9QzqQ | Exception of type NullPointerException |
BASE/ttcc4/Le0qjQ | Exception of type NullPointerException |
BASE/amazonsSuicide_10x10/XIbQkg | Exception of type NullPointerException |
DRESDEN/connectfoursuicide/M9CNQg | Exception of type NullPointerException |
DRESDEN/breakthrough/z4hK7Q | Exception of type NullPointerException |
DRESDEN/catcha_mouse/cHv4dw | Exception of type NullPointerException |
BASE/god/qF06gw | Test process timed out after 240 seconds |
DRESDEN/Goldrush/VeWczQ | Exception of type NullPointerException |
BASE/choicethroughalt/tt71Lg | Exception of type NullPointerException |
BASE/slaughter/cOch8A | Exception of type NullPointerException |
BASE/amazons/RKKZjw | Exception of type NullPointerException |
STANFORD/ttcc4/Cx9SGw | Exception of type NullPointerException |
DRESDEN/small_dominion/yB5GJA | Exception of type NullPointerException |
BASE/tttcc4/8Bs2lg | Exception of type NullPointerException |
DRESDEN/connectfour/5tc-Mg | Exception of type NullPointerException |