Comparison with GGP-Base Prover:
| Median speedup | 1.4848323933717635 |
| Mean speedup | 117.99519996142153 |
| Geometric mean speedup | 1.4503581079716512 |
| Ratio of # state changes with 1 second per game | 89.2888024201429 |
| Ratio of times to run 1000 states per game | 16.884223124320854 |
| Number of games with errors | 85 |
Comparison with other engines:
| Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
| ALLOY_DIFF_PROP_NET:1 (comparison) | 44 | 26 | 401 | 75 |
| PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 (comparison) | 352 | 7 | 112 | 80 |
| SANCHO_DEAD_RECKONING_PROPNET:1.61c (comparison) | 39 | 39 | 393 | 70 |
| ALLOY_TUPLE_PROVER:2 (comparison) | 179 | 2 | 290 | 85 |
| CADIAPLAYER_PROLOG:3.0 (comparison) | 129 | 139 | 203 | 61 |
| REKKURA_GENERIC_FORWARD_PROVER:1.0.0 (comparison) | 427 | 8 | 36 | 80 |
| REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 (comparison) | 427 | 8 | 36 | 79 |
| REKKURA_BACKWARD_PROVER:1.0.0 (comparison) | 361 | 8 | 102 | 80 |
| REKKURA_BACKWARD_PROVER_OSTD:1.0.0 (comparison) | 363 | 8 | 100 | 79 |
| PALAMEDES_JAVA_ECLIPSE:0.6.1 (comparison) | 176 | 0 | 295 | 76 |
| GGP_BASE_PROVER:2015-04-26 (comparison) | 296 | 0 | 175 | 85 |
| PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 (comparison) | 461 | 5 | 5 | 73 |
| ALLOY_COMPILED_PROVER_CACHING:2 (comparison) | 39 | 4 | 428 | 83 |
| FLUXPLAYER_PROLOG:1.1 (comparison) | 179 | 37 | 255 | 80 |
Game-by-game statistics:
Games with errors:
| Game | Error message |
| BASE/ruleDepthExponential/UamhHQ | Exception of type NullPointerException |
| BASE/queens16ug/gT-ylw | Test process timed out after 240 seconds |
| BASE/queens08ug/kJ_ZFQ | Test process timed out after 240 seconds |
| BASE/reversiSuicide/9OxJlg | Test process timed out after 240 seconds |
| BASE/factoringMutuallyAssuredDestruction/NH0LGg | Exception of type NullPointerException |
| BASE/wargame02/BkVqqQ | Exception of type NullPointerException |
| DRESDEN/bidding-tictactoe/yW5vTA | IllegalArgumentException: bound must be positive |
| BASE/amazons_10x10/Bun8dA | Exception of type NullPointerException |
| BASE/queens08lg/Ru7eqQ | Test process timed out after 240 seconds |
| DRESDEN/knightwar/7hhAqg | Exception of type NullPointerException |
| BASE/gt_two_thirds_6p/867v3Q | IllegalArgumentException: bound must be positive |
| DRESDEN/knightazons/02I8BQ | Exception of type NullPointerException |
| DRESDEN/breakthroughsuicide_v2/LU1nAw | Exception of type NullPointerException |
| BASE/breakthroughSmall/HJ0tIA | Exception of type NullPointerException |
| DRESDEN/ghostmaze2p/HY0UwA | Exception of type NullPointerException |
| BASE/amazonsSuicide/dE1QEQ | Exception of type NullPointerException |
| BASE/zhadu/DlA8iQ | ClassCastException: stanfordlogic.prover.VariableFact cannot be cast to stanfordlogic.prover.GroundFact |
| BASE/mineClearingSmall/frsbvw | Exception of type NullPointerException |
| DRESDEN/battlebrushes/QHXV4A | Exception of type NullPointerException |
| DRESDEN/tttcc4/sAvtFg | Exception of type NullPointerException |
| BASE/asteroids/BKCmPQ | Exception of type NullPointerException |
| BASE/ttcc4_2player_alt/ZEJvYA | Exception of type NullPointerException |
| BASE/wargame03/klXI8w | Exception of type NullPointerException |
| BASE/pentago/86NgKw | Exception of type NullPointerException |
| BASE/mummyMaze2p_2007/YGA3Vw | Exception of type NullPointerException |
| BASE/queens12ug/u6Bkmg | Test process timed out after 240 seconds |
| BASE/knightThrough/gcwFjA | Exception of type NullPointerException |
| BASE/gt_attrition/kD_SCA | IllegalArgumentException: bound must be positive |
| DRESDEN/bidding-tictactoe_10coins/mu5VhQ | IllegalArgumentException: bound must be positive |
| BASE/biddingTicTacToe/8mESVw | IllegalArgumentException: bound must be positive |
| BASE/amazonsTorus/soxT8g | Exception of type NullPointerException |
| BASE/alexChess/LNo83g | Exception of type StackOverflowError |
| STANFORD/pilgrimage/ObRZnQ | Exception of type NullPointerException |
| BASE/colonelBlottoVariant/X-n-KQ | IllegalArgumentException: bound must be positive |
| BASE/gt_two_thirds_4p/DStnxQ | IllegalArgumentException: bound must be positive |
| STANFORD/untwistycomplex/HTWEwg | Exception of type NullPointerException |
| DRESDEN/capture_the_king/EQ229Q | Exception of type NullPointerException |
| BASE/amazons_8x8/7SOsIw | Exception of type NullPointerException |
| BASE/queens31lg/0gID-A | Test process timed out after 240 seconds |
| BASE/asteroidsSerial/id2QkA | Exception of type NullPointerException |
| DRESDEN/pacman3p/rBnk8Q | Exception of type NullPointerException |
| DRESDEN/amazons/dNB28A | Exception of type NullPointerException |
| DRESDEN/babel/WdSW4A | Exception of type NullPointerException |
| DRESDEN/backgammon/mqCW0Q | Exception of type NullPointerException |
| BASE/knightazons/apnJBQ | Exception of type NullPointerException |
| BASE/snakeParallel/RCVNtw | Exception of type NullPointerException |
| BASE/shmup/ssTNlg | Exception of type NullPointerException |
| DRESDEN/bomberman2p/x4h6jQ | Exception of type NullPointerException |
| BASE/queens06ug/7Lq3tw | Test process timed out after 240 seconds |
| BASE/majorities/ibJzSQ | IllegalArgumentException: bound must be positive |
| DRESDEN/SC_TestOnly_enabled/09o7gQ | Exception of type NullPointerException |
| BASE/ttcc4_2player/_aH_Mw | Exception of type NullPointerException |
| BASE/othello-comp2007/86ZoMw | Exception of type NullPointerException |
| BASE/ttcc4_2player_small/Cv72TA | Exception of type NullPointerException |
| DRESDEN/queens/mW2wHQ | Test process timed out after 240 seconds |
| BASE/asteroidsParallel/WauZiA | Exception of type NullPointerException |
| BASE/ruleDepthLinear/OUBJpQ | Exception of type NullPointerException |
| BASE/biddingTicTacToe_10coins/a-9ccQ | IllegalArgumentException: bound must be positive |
| BASE/colonelBlottoVariant2/jruwGw | IllegalArgumentException: bound must be positive |
| DRESDEN/mummymaze2p-comp2007/oTQRQg | Exception of type NullPointerException |
| BASE/queens/HyJJnQ | Test process timed out after 240 seconds |
| BASE/gt_two_thirds_2p/1APDGg | IllegalArgumentException: bound must be positive |
| DRESDEN/god/2EDD5w | Test process timed out after 240 seconds |
| BASE/amazonsTorus_10x10/Uxc08g | Exception of type NullPointerException |
| DRESDEN/knightthrough/J7Fc_Q | Exception of type NullPointerException |
| BASE/knightwar/DVGY4Q | Exception of type NullPointerException |
| BASE/reversi/d8UMeA | Test process timed out after 240 seconds |
| BASE/pentagoSuicide/SBgNhw | Exception of type NullPointerException |
| BASE/catcha_mouse/cHv4dw | Exception of type NullPointerException |
| BASE/wargame01/_GZFZg | Exception of type NullPointerException |
| DRESDEN/breakthroughsuicide/Y9QzqQ | Exception of type NullPointerException |
| BASE/ttcc4/Le0qjQ | Exception of type NullPointerException |
| BASE/amazonsSuicide_10x10/XIbQkg | Exception of type NullPointerException |
| DRESDEN/connectfoursuicide/M9CNQg | Exception of type NullPointerException |
| DRESDEN/breakthrough/z4hK7Q | Exception of type NullPointerException |
| DRESDEN/catcha_mouse/cHv4dw | Exception of type NullPointerException |
| BASE/god/qF06gw | Test process timed out after 240 seconds |
| DRESDEN/Goldrush/VeWczQ | Exception of type NullPointerException |
| BASE/choicethroughalt/tt71Lg | Exception of type NullPointerException |
| BASE/slaughter/cOch8A | Exception of type NullPointerException |
| BASE/amazons/RKKZjw | Exception of type NullPointerException |
| STANFORD/ttcc4/Cx9SGw | Exception of type NullPointerException |
| DRESDEN/small_dominion/yB5GJA | Exception of type NullPointerException |
| BASE/tttcc4/8Bs2lg | Exception of type NullPointerException |
| DRESDEN/connectfour/5tc-Mg | Exception of type NullPointerException |