Comparison with GGP-Base Prover:
Median speedup | 383.55145455512417 |
Mean speedup | 2967.123325053597 |
Geometric mean speedup | 406.86389447798484 |
Ratio of # state changes with 1 second per game | 202.90167195016534 |
Ratio of times to run 1000 states per game | 4.004868925127173E-4 |
Number of games with errors | 54 |
Comparison with other engines:
Engine | We're faster in N games | Only they fail | They're faster in N games | Only we fail |
ALLOY_DIFF_PROP_NET:1 (comparison) | 502 | 0 | 0 | 18 |
PALAMEDES_JOCULAR:0.6.1 (comparison) | 393 | 70 | 39 | 39 |
PALAMEDES_JAVA_PROVER_USEOPT_TRUE:0.6.1 (comparison) | 493 | 8 | 1 | 50 |
ALLOY_TUPLE_PROVER:2 (comparison) | 501 | 0 | 1 | 52 |
CADIAPLAYER_PROLOG:3.0 (comparison) | 363 | 139 | 0 | 30 |
REKKURA_GENERIC_FORWARD_PROVER:1.0.0 (comparison) | 499 | 3 | 0 | 44 |
REKKURA_GENERIC_FORWARD_PROVER_OSTD:1.0.0 (comparison) | 498 | 4 | 0 | 44 |
REKKURA_BACKWARD_PROVER:1.0.0 (comparison) | 499 | 3 | 0 | 44 |
REKKURA_BACKWARD_PROVER_OSTD:1.0.0 (comparison) | 498 | 4 | 0 | 44 |
PALAMEDES_JAVA_ECLIPSE:0.6.1 (comparison) | 453 | 7 | 42 | 52 |
GGP_BASE_PROVER:2015-04-26 (comparison) | 501 | 0 | 1 | 54 |
PALAMEDES_JAVA_PROVER_USEOPT_FALSE:0.6.1 (comparison) | 489 | 13 | 0 | 50 |
ALLOY_COMPILED_PROVER_CACHING:2 (comparison) | 479 | 2 | 21 | 50 |
FLUXPLAYER_PROLOG:1.1 (comparison) | 462 | 39 | 1 | 51 |
Game-by-game statistics:
Games with errors:
Game | Error message |
BASE/cylinder-checkers/hlldmw | Test process timed out after 240 seconds |
DRESDEN/knightwar/7hhAqg | Test process timed out after 240 seconds |
BASE/gt_two_thirds_6p/867v3Q | Test process timed out after 240 seconds |
DRESDEN/knightazons/02I8BQ | Test process timed out after 240 seconds |
DRESDEN/checkers-newgoals/IJOqXQ | Test process timed out after 240 seconds |
BASE/battlebrushes/arCwyA | Exception of type NullPointerException |
DRESDEN/checkers-cylinder-mustjump/vW_-pA | Test process timed out after 240 seconds |
BASE/amazonsSuicide/dE1QEQ | Test process timed out after 240 seconds |
BASE/factoringImpossibleTurtleBrain/kcBhdw | Test process timed out after 240 seconds |
DRESDEN/merrills/aYEzwA | OutOfMemoryError: GC overhead limit exceeded |
DRESDEN/battlebrushes/QHXV4A | Exception of type NullPointerException |
BASE/pancakes88/l2Xaig | Exception of type StackOverflowError |
DRESDEN/checkers-mustjump-torus/cVc3gA | Test process timed out after 240 seconds |
BASE/amazonsTorus/soxT8g | OutOfMemoryError: GC overhead limit exceeded |
BASE/alexChess/LNo83g | Test process timed out after 240 seconds |
BASE/chess_200/XsTpYA | Exception of type StackOverflowError |
DRESDEN/vacuumcleaner_obstacles_5/fXBV4g | Test process timed out after 240 seconds |
DRESDEN/uf20-01.cnf.SAT/42Rs8A | Exception of type NullPointerException |
BASE/merrills/pku8Tg | OutOfMemoryError: GC overhead limit exceeded |
DRESDEN/chinesecheckers6-simultaneous/gPPGUw | Exception of type NullPointerException |
BASE/endgame/jYjfOA | Exception of type NullPointerException |
DRESDEN/hallway/0H4l-Q | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_obstacles_3/4NjSmw | Test process timed out after 240 seconds |
DRESDEN/checkers/jIDMIg | Test process timed out after 240 seconds |
DRESDEN/amazons/dNB28A | Test process timed out after 240 seconds |
DRESDEN/pancakes88/aD3E7g | Test process timed out after 240 seconds |
BASE/hallway/ckCJOw | Test process timed out after 240 seconds |
BASE/knightazons/apnJBQ | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_random_big/DwzFaQ | Test process timed out after 240 seconds |
DRESDEN/four_way_battle/xSOQXA | Exception of type NullPointerException |
DRESDEN/crossers3/xiPTxg | ArrayIndexOutOfBoundsException: 65536 |
DRESDEN/checkers-suicide-cylinder-mustjump/L2BYWg | Test process timed out after 240 seconds |
DRESDEN/checkers-mustjump/HUr33w | Test process timed out after 240 seconds |
DRESDEN/laikLee_hex/ZeP3QQ | Exception of type StackOverflowError |
DRESDEN/battlesnakes2011/93VtTw | Test process timed out after 240 seconds |
BASE/crossers3/O0rORg | ArrayIndexOutOfBoundsException: 65536 |
DRESDEN/god/2EDD5w | Test process timed out after 240 seconds |
BASE/mummymaze1p/PT_EXA | Exception of type NullPointerException |
BASE/knightwar/DVGY4Q | Exception of type NullPointerException |
BASE/laikLee_hex/zbyscQ | Exception of type StackOverflowError |
STANFORD/triplesukoshi/Iu9mbA | Exception of type NullPointerException |
DRESDEN/cylinder-checkers/clOO3Q | Test process timed out after 240 seconds |
DRESDEN/mummymaze1p/AekgaQ | OutOfMemoryError: Java heap space |
DRESDEN/farmers/S_ASnw | Test process timed out after 240 seconds |
DRESDEN/battlesnakes1509/-qZrLw | Test process timed out after 240 seconds |
DRESDEN/vacuumcleaner_obstacles_6/NVwsZw | Test process timed out after 240 seconds |
BASE/sudoku/NTaNkw | Test process timed out after 240 seconds |
BASE/four_way_battle/xSOQXA | Exception of type NullPointerException |
BASE/god/qF06gw | Test process timed out after 240 seconds |
DRESDEN/ggp-course2013_nicolai/uEin8g | OutOfMemoryError: GC overhead limit exceeded |
BASE/slaughter/cOch8A | Test process timed out after 240 seconds |
BASE/amazons/RKKZjw | Test process timed out after 240 seconds |
DRESDEN/small_dominion/yB5GJA | OutOfMemoryError: GC overhead limit exceeded |
BASE/racer4/0vs7Ww | Exception of type NullPointerException |