Comparison with GGP-Base Prover:
Median speedup | 2.5475022920390296 |
Mean speedup | 5.53059381563295 |
Geometric mean speedup | 2.6891382357617197 |
Ratio of # state changes with 1 second per game | 1.5589937448633027 |
Ratio of times to run 1000 states per game | 0.10884059936003343 |
Number of games with errors | 163 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
ALLOY_DIFF_PROP_NET:1 (comparison) | 6 | 15 | 372 | 142 |
PALAMEDES_JOCULAR:0.6.1 (comparison) | 203 | 61 | 129 | 139 |
PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 (comparison) | 382 | 2 | 9 | 153 |
SANCHO_DEAD_RECKONING_PROPNET:1.61c (comparison) | 0 | 30 | 363 | 139 |
ALLOY_TUPLE_PROVER:2 (comparison) | 252 | 2 | 139 | 163 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 (comparison) | 388 | 4 | 1 | 154 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 (comparison) | 388 | 4 | 1 | 153 |
REKKURA_BACKWARD_PROVER:1.0.0 (comparison) | 365 | 4 | 24 | 154 |
REKKURA_BACKWARD_PROVER_OSTD:1.0.0 (comparison) | 366 | 4 | 23 | 153 |
PALAMEDES_JAVA_ECLIPSE:0.6.1 (comparison) | 275 | 5 | 113 | 159 |
GGP_BASE_PROVER:2015-04-26 (comparison) | 334 | 0 | 59 | 163 |
PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 (comparison) | 377 | 4 | 12 | 150 |
ALLOY_COMPILED_PROVER_CACHING:2 (comparison) | 2 | 4 | 387 | 161 |
FLUXPLAYER_PROLOG:1.1 (comparison) | 156 | 27 | 210 | 148 |
Game-by-game statistics:
Games with errors:
Game | Error message |
BASE/ruleDepthExponential/UamhHQ | Test process failed to output results for unknown reason |
BASE/gt_ultimatum/GE-uOA | Test process failed to output results for unknown reason |
BASE/snake_2008/i6K26g | Test process failed to output results for unknown reason |
BASE/gt_centipede/9fRMpw | Test process failed to output results for unknown reason |
STANFORD/knightstourmedium/x1wu8Q | Test process failed to output results for unknown reason |
STANFORD/checkersonabarrelnokings/Zrevdw | Test process failed to output results for unknown reason |
BASE/rubiksCube/9tNO9Q | Test process failed to output results for unknown reason |
BASE/cylinder-checkers/hlldmw | Test process failed to output results for unknown reason |
BASE/4pttc/AL1k2Q | Test process failed to output results for unknown reason |
BASE/queens08lg/Ru7eqQ | Test process timed out after 240 seconds |
BASE/battle/8oAvhQ | Test process failed to output results for unknown reason |
DRESDEN/knightwar/7hhAqg | Test process failed to output results for unknown reason |
BASE/nonogram_10x10_1/0Xc62g | Test process failed to output results for unknown reason |
BASE/pacman3p/wW7UVQ | Test process failed to output results for unknown reason |
BASE/kalaha_2009/dRiN3g | Test process failed to output results for unknown reason |
BASE/checkers-mustjump/T-8UuQ | Test process failed to output results for unknown reason |
BASE/gt_two_thirds_6p/867v3Q | Test process failed to output results for unknown reason |
DRESDEN/checkers-newgoals/IJOqXQ | Test process failed to output results for unknown reason |
STANFORD/dualrainbow/G3OnRQ | Test process failed to output results for unknown reason |
DRESDEN/2player_normal_form_2010/NG_Kdg | Test process failed to output results for unknown reason |
BASE/chineseCheckers1/gqtwHw | Test process failed to output results for unknown reason |
STANFORD/knightstour/cEwgNA | Test process failed to output results for unknown reason |
STANFORD/alquerquezero/uVgA_A | Test process failed to output results for unknown reason |
DRESDEN/3pffa/0YrmQw | Test process failed to output results for unknown reason |
BASE/othelloHoles/c0qAzw | Test process timed out after 240 seconds |
DRESDEN/gt_prisoner/huCp4w | Test process failed to output results for unknown reason |
BASE/kalaha5x2x3/WviNsw | Test process failed to output results for unknown reason |
DRESDEN/chinesecheckers6/yTbPDA | Test process failed to output results for unknown reason |
BASE/snake_2009_big/-oRfVw | Test process failed to output results for unknown reason |
DRESDEN/grid_game2/kypTYQ | Test process failed to output results for unknown reason |
DRESDEN/checkers-cylinder-mustjump/vW_-pA | Test process failed to output results for unknown reason |
BASE/factoringImpossibleTurtleBrain/kcBhdw | Test process timed out after 240 seconds |
DRESDEN/point_grab/r5DPmQ | Test process failed to output results for unknown reason |
BASE/cephalopodMicro/9l2D3g | Test process timed out after 240 seconds |
BASE/gt_coordination/IVMOzA | Test process failed to output results for unknown reason |
BASE/duplicateStateLarge/dcjyuw | Test process failed to output results for unknown reason |
DRESDEN/skirmish/RjGQYQ | Test process failed to output results for unknown reason |
BASE/mineClearingSmall/frsbvw | Test process failed to output results for unknown reason |
BASE/skirmishNew/sibw2g | Test process failed to output results for unknown reason |
DRESDEN/othello-cornercontrol/r5Gdlg | Test process failed to output results for unknown reason |
DRESDEN/gt_chicken/CeuKtw | Test process failed to output results for unknown reason |
BASE/crissrace/ERWGDA | Test process failed to output results for unknown reason |
DRESDEN/skirmishfinal/hzq8ww | Test process failed to output results for unknown reason |
BASE/skirmishFinal2/gdB62Q | Test process failed to output results for unknown reason |
BASE/strangeSkirmish/gc1zKA | Test process failed to output results for unknown reason |
DRESDEN/checkers-mustjump-torus/cVc3gA | Test process failed to output results for unknown reason |
STANFORD/freeforall/Lfp40Q | Test process failed to output results for unknown reason |
BASE/max_knights/2fq3Ag | Test process failed to output results for unknown reason |
BASE/smallest_4player/ADDROA | Test process failed to output results for unknown reason |
BASE/skirmish/Y_psYQ | Test process failed to output results for unknown reason |
BASE/4pffa/Q3ADlg | Test process failed to output results for unknown reason |
BASE/gt_attrition/kD_SCA | Test process failed to output results for unknown reason |
BASE/amazonsTorus/soxT8g | Test process timed out after 240 seconds |
BASE/alexChess/LNo83g | Test process timed out after 240 seconds |
STANFORD/pilgrimage/ObRZnQ | Test process failed to output results for unknown reason |
BASE/colonelBlottoVariant/X-n-KQ | Test process failed to output results for unknown reason |
DRESDEN/kalaha_2009/gcC8uA | Test process failed to output results for unknown reason |
DRESDEN/knightstour/cGISAA | Test process failed to output results for unknown reason |
DRESDEN/max_knights/hCipiA | Test process failed to output results for unknown reason |
BASE/knightsTour/mvtVIg | Test process failed to output results for unknown reason |
BASE/gt_two_thirds_4p/DStnxQ | Test process failed to output results for unknown reason |
DRESDEN/vacuumcleaner_obstacles_5/fXBV4g | Test process failed to output results for unknown reason |
DRESDEN/statespacelarge/8-y5HQ | Test process failed to output results for unknown reason |
BASE/gt_tinfoil/Q8DyKg | Test process failed to output results for unknown reason |
BASE/checkers-mustjump-torus/uSApKQ | Test process failed to output results for unknown reason |
DRESDEN/chinesecheckers6-simultaneous/gPPGUw | Test process failed to output results for unknown reason |
DRESDEN/statespacemedium/dVJZ_w | Test process failed to output results for unknown reason |
BASE/copolymer_4/2LDVhQ | Test process failed to output results for unknown reason |
BASE/queens31lg/0gID-A | Test process timed out after 240 seconds |
BASE/skirmishHoles/AUCxCA | Test process failed to output results for unknown reason |
DRESDEN/pacman3p/rBnk8Q | Test process failed to output results for unknown reason |
STANFORD/eightpuzzle/W_aWbA | Test process failed to output results for unknown reason |
BASE/2pffa/6oHijA | Test process failed to output results for unknown reason |
DRESDEN/vacuumcleaner_obstacles_3/4NjSmw | Test process failed to output results for unknown reason |
DRESDEN/babel/WdSW4A | Test process failed to output results for unknown reason |
BASE/snake_2008_tweaked/bX0NJQ | Test process failed to output results for unknown reason |
DRESDEN/vacuum_cleaner_1/eUNjpw | Test process failed to output results for unknown reason |
STANFORD/skirmish/w4V6Vw | Test process failed to output results for unknown reason |
BASE/skirmishFinal3/-Olhfw | Test process failed to output results for unknown reason |
BASE/shmup/ssTNlg | Test process failed to output results for unknown reason |
BASE/copolymer_4_pie/IN5_jA | Test process failed to output results for unknown reason |
DRESDEN/vacuumcleaner_random_big/DwzFaQ | Test process failed to output results for unknown reason |
BASE/chineseCheckers3/-1rZdQ | Test process failed to output results for unknown reason |
DRESDEN/four_way_battle/xSOQXA | Test process failed to output results for unknown reason |
DRESDEN/snake_2008/E56l3A | Test process failed to output results for unknown reason |
STANFORD/knightstourbig/TQUI2g | Test process failed to output results for unknown reason |
BASE/colonelBlotto/jip21A | Test process failed to output results for unknown reason |
BASE/duplicateStateMedium/U163eQ | Test process failed to output results for unknown reason |
STANFORD/dualhunter/1rPZjQ | Test process failed to output results for unknown reason |
BASE/checkersTorus/2vm1EQ | Test process failed to output results for unknown reason |
DRESDEN/SC_TestOnly_enabled/09o7gQ | Test process failed to output results for unknown reason |
BASE/othelloSuicide/B442jg | Test process timed out after 240 seconds |
BASE/knightsTourLarge/M8jgLA | Test process failed to output results for unknown reason |
DRESDEN/checkers-suicide-cylinder-mustjump/L2BYWg | Test process failed to output results for unknown reason |
DRESDEN/vacuumcleaner_obstacles_2/Y-R7tA | Test process failed to output results for unknown reason |
DRESDEN/checkers-mustjump/HUr33w | Test process failed to output results for unknown reason |
DRESDEN/queens/mW2wHQ | Test process failed to output results for unknown reason |
DRESDEN/chinesecheckers3/QsCb2A | Test process failed to output results for unknown reason |
DRESDEN/smallest_4player/ADDROA | Test process failed to output results for unknown reason |
BASE/chineseCheckers2/eCMR3Q | Test process failed to output results for unknown reason |
BASE/gt_staghunt/xPjLRA | Test process failed to output results for unknown reason |
DRESDEN/vacuumcleaner_obstacles_1/CqS-7A | Test process failed to output results for unknown reason |
STANFORD/hunter/14dD-g | Test process failed to output results for unknown reason |
BASE/checkers-newgoals/0XkFiA | Test process failed to output results for unknown reason |
DRESDEN/battlesnakes2011/93VtTw | Test process failed to output results for unknown reason |
BASE/ruleDepthLinear/OUBJpQ | Test process failed to output results for unknown reason |
BASE/nonogram_5x5_1/qLKEZw | Test process failed to output results for unknown reason |
BASE/skirmishFinal1/ecWTnQ | Test process failed to output results for unknown reason |
DRESDEN/Travelers-Dilemma/PvZwYw | Test process failed to output results for unknown reason |
BASE/colonelBlottoVariant2/jruwGw | Test process failed to output results for unknown reason |
DRESDEN/skirmish3/3LU8Nw | Test process failed to output results for unknown reason |
BASE/ad_game_2x2/D0aWqg | Test process failed to output results for unknown reason |
STANFORD/rainbow/_4qNSQ | Test process failed to output results for unknown reason |
BASE/queens/HyJJnQ | Test process failed to output results for unknown reason |
DRESDEN/chinesecheckers2/06E6-Q | Test process failed to output results for unknown reason |
BASE/gt_two_thirds_2p/1APDGg | Test process failed to output results for unknown reason |
BASE/kalaha6x2x4/XS81Mg | Test process failed to output results for unknown reason |
DRESDEN/crissrace/KWb9bw | Test process failed to output results for unknown reason |
BASE/checkers-cylinder-mustjump/rjr6qQ | Test process failed to output results for unknown reason |
BASE/checkersBarrelNoKings/rnKNeg | Test process failed to output results for unknown reason |
BASE/knightwar/DVGY4Q | Test process failed to output results for unknown reason |
BASE/brawl/6Ymo_Q | Test process failed to output results for unknown reason |
BASE/stateSpaceMedium/3bUoIw | Test process failed to output results for unknown reason |
DRESDEN/battle/8oAvhQ | Test process failed to output results for unknown reason |
DRESDEN/snake_2009_big/DgC1NQ | Test process failed to output results for unknown reason |
BASE/3pffa/pR0dzA | Test process failed to output results for unknown reason |
BASE/beatMania/qUHwvQ | Test process failed to output results for unknown reason |
BASE/gt_prisoner/klthDw | Test process failed to output results for unknown reason |
BASE/checkers-suicide-cylinder-mustjump/YeW5Tw | Test process failed to output results for unknown reason |
BASE/chineseCheckers6/rREH3A | Test process failed to output results for unknown reason |
STANFORD/madness/UO_B3A | Test process failed to output results for unknown reason |
DRESDEN/snake_2009/zIYLVw | Test process failed to output results for unknown reason |
BASE/duplicateStateSmall/bCPAXw | Test process failed to output results for unknown reason |
BASE/stateSpaceLarge/0Ge_CQ | Test process failed to output results for unknown reason |
DRESDEN/cylinder-checkers/clOO3Q | Test process failed to output results for unknown reason |
DRESDEN/smallest/9kaGFw | Test process failed to output results for unknown reason |
BASE/pacman2p/4LEdQg | Test process failed to output results for unknown reason |
BASE/checkersTorusNoKings/pwb6oQ | Test process failed to output results for unknown reason |
BASE/snake_2009/7l-qAQ | Test process failed to output results for unknown reason |
DRESDEN/battlesnakes1509/-qZrLw | Test process failed to output results for unknown reason |
DRESDEN/gt_ultimatum/pAiiQw | Test process failed to output results for unknown reason |
DRESDEN/vacuumcleaner_obstacles_6/NVwsZw | Test process failed to output results for unknown reason |
DRESDEN/logistics/fPru1Q | Test process failed to output results for unknown reason |
DRESDEN/brawl/2kXtfQ | Test process failed to output results for unknown reason |
BASE/sudoku/NTaNkw | Test process failed to output results for unknown reason |
DRESDEN/ticblock/Z2yNWQ | Test process failed to output results for unknown reason |
DRESDEN/towerworld/HCX34w | Test process failed to output results for unknown reason |
BASE/stateSpaceSmall/Q7osKA | Test process failed to output results for unknown reason |
BASE/four_way_battle/xSOQXA | Test process failed to output results for unknown reason |
DRESDEN/CephalopodMicro/H3XQfg | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_random/_6AGDA | Test process failed to output results for unknown reason |
DRESDEN/Goldrush/VeWczQ | Test process failed to output results for unknown reason |
BASE/snakeAssemblit/UO4sdg | Test process failed to output results for unknown reason |
DRESDEN/skirmish2/iPpWhQ | Test process failed to output results for unknown reason |
BASE/gt_chicken/gmepTQ | Test process failed to output results for unknown reason |
BASE/solitaireChineseCheckers/-ET6gw | Test process failed to output results for unknown reason |
BASE/slaughter/cOch8A | Test process failed to output results for unknown reason |
BASE/point_grab/V_osUg | Test process failed to output results for unknown reason |
BASE/gt_dollar/TGjqRw | Test process failed to output results for unknown reason |
DRESDEN/statespacesmall/h-NqjA | Test process failed to output results for unknown reason |
DRESDEN/4pttc/9pB9AQ | Test process failed to output results for unknown reason |
STANFORD/chinook/osFbPA | Test process failed to output results for unknown reason |
BASE/ticblock/T21C1g | Test process failed to output results for unknown reason |