Variant Stockfish Testing Queue

Filter: variant = standard

Pending - 0 tests 0.0 hrs

None

Active - 2 machines 12 cores 0.48M nps (5.77M total nps) 13 games/minute

Machine Cores MNps System Version Running on Last updated
Belzedar94 11 0.44 Windows 10 70 master seconds ago
ianfab 1 0.89 Linux 4.15.0-1051-aws 72:2.7.17 master seconds ago

Finished - 226 tests

12-06-21 ia standard master diff
ELO: 1.04 +-10.2 (95%) LOS: 57.9%
Total: 2000 W: 457 L: 451 D: 1092
2000 @ 10+0.1 th 1 regression test against 13.1
22-05-21 ia standard master diff
ELO: -2.43 +-14.2 (95%) LOS: 36.9%
Total: 1000 W: 214 L: 221 D: 565
1000 @ 10+0.1 th 1
01-05-21 ia standard master diff
ELO: 12.06 +-4.3 (95%) LOS: 100.0%
Total: 10000 W: 2136 L: 1789 D: 6075
10000 @ 30+0.3 th 1 regression test against Fairy-SF 13
01-05-21 ia standard master diff
ELO: 0.73 +-4.5 (95%) LOS: 62.4%
Total: 10000 W: 2202 L: 2181 D: 5617
10000 @ 10+0.1 th 1 regression test against Fairy-SF 13
30-04-21 ia standard diag_cannon diff
ELO: 0.94 +-4.6 (95%) LOS: 65.5%
Total: 10000 W: 2291 L: 2264 D: 5445
10000 @ 10+0.1 th 1 speed regression test
23-04-21 ia standard master diff
ELO: 14.67 +-4.5 (95%) LOS: 100.0%
Total: 10400 W: 2609 L: 2170 D: 5621
10000 @ 10+0.1 th 1 regression test against v13
21-04-21 ia standard pieces_eval diff
ELO: 16.27 +-4.6 (95%) LOS: 100.0%
Total: 10000 W: 2492 L: 2024 D: 5484
10000 @ 10+0.1 th 1
18-04-21 ia standard extra_slots diff
ELO: 2.22 +-4.5 (95%) LOS: 83.2%
Total: 10000 W: 2243 L: 2179 D: 5578
10000 @ 10+0.1 th 1
17-04-21 ia standard piece_config diff
ELO: -7.99 +-4.6 (95%) LOS: 0.0%
Total: 10000 W: 2181 L: 2411 D: 5408
10000 @ 10+0.1 th 1
17-04-21 ia standard piece_config diff
ELO: -7.19 +-4.5 (95%) LOS: 0.1%
Total: 10000 W: 2135 L: 2342 D: 5523
10000 @ 10+0.1 th 1 test PR
13-04-21 ia standard piece_slots diff
ELO: -10.81 +-4.3 (95%) LOS: 0.0%
Total: 10000 W: 1820 L: 2131 D: 6049
10000 @ 30+0.3 th 1
11-04-21 ia standard piece_slots diff
ELO: -9.70 +-4.6 (95%) LOS: 0.0%
Total: 10000 W: 2119 L: 2398 D: 5483
10000 @ 10+0.1 th 1
03-04-21 ia standard bughouse_virtual diff
LLR: 2.94 (-2.94,2.94) [-10.00,5.00]
Total: 4399 W: 978 L: 956 D: 2465
sprt @ 10+0.1 th 1
02-04-21 ia standard rook_magics diff
ELO: -0.56 +-4.6 (95%) LOS: 40.6%
Total: 10000 W: 2237 L: 2253 D: 5510
10000 @ 10+0.1 th 1
01-04-21 ia standard rook_magics diff
LLR: -2.95 (-2.94,2.94) [0.00,10.00]
Total: 1686 W: 345 L: 394 D: 947
sprt @ 10+0.1 th 1
12-03-21 ia standard master diff
ELO: 49.67 +-10.6 (95%) LOS: 100.0%
Total: 2000 W: 630 L: 346 D: 1024
2000 @ 10+0.1 th 1 Fairy-SF 13 RC2
09-03-21 ia standard master diff
ELO: 20.52 +-9.7 (95%) LOS: 100.0%
Total: 2000 W: 464 L: 346 D: 1190
2000 @ 30+0.3 th 1 Fairy-SF 13 RC1
11-03-21 ia standard largeboards diff
ELO: 27.16 +-9.9 (95%) LOS: 100.0%
Total: 2000 W: 503 L: 347 D: 1150
2000 @ 30+0.3 th 1 Fairy-SF 13 RC1, largeboards
11-03-21 ia standard nnue diff
ELO: 319.72 +-23.4 (95%) LOS: 100.0%
Total: 1000 W: 758 L: 32 D: 210
1000 @ 10+0.1 th 1 NNUE vs. 11.2
11-03-21 ia standard nnue_largeboards diff
ELO: -27.16 +-10.8 (95%) LOS: 0.0%
Total: 1000 W: 88 L: 166 D: 746
1000 @ 10+0.1 th 1 NNUE LB vs. NNUE
06-03-21 ia standard shogi_nnue_final diff
ELO: 0.10 +-4.5 (95%) LOS: 51.8%
Total: 10000 W: 2170 L: 2167 D: 5663
10000 @ 10+0.1 th 1
06-03-21 ia standard shogi_nnue_final diff
LLR: -2.99 (-2.94,2.94) [-10.00,5.00]
Total: 1925 W: 377 L: 430 D: 1118
sprt @ 10+0.1 th 1
28-02-21 ia standard pseudo_royal diff
LLR: 2.98 (-2.94,2.94) [-10.00,5.00]
Total: 8457 W: 1909 L: 1907 D: 4641
sprt @ 10+0.1 th 1
28-02-21 ia standard master diff
ELO: -109.26 +-9.7 (95%) LOS: 0.0%
Total: 2000 W: 124 L: 733 D: 1143
2000 @ 30+0.3 th 1 vs. MV-SF
28-02-21 ia standard atomic_pseudo_royal diff
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 4012 W: 918 L: 894 D: 2200
sprt @ 10+0.1 th 1
22-02-21 ia standard fast_moves diff
LLR: -2.97 (-2.94,2.94) [0.00,10.00]
Total: 7654 W: 1715 L: 1705 D: 4234
sprt @ 10+0.1 th 1
22-02-21 ia standard fast_blockers diff
LLR: 2.96 (-2.94,2.94) [0.00,10.00]
Total: 1370 W: 361 L: 280 D: 729
sprt @ 10+0.1 th 1
19-02-21 ia standard fast_attacks3 diff
LLR: 3.00 (-2.94,2.94) [-10.00,5.00]
Total: 3354 W: 782 L: 754 D: 1818
sprt @ 10+0.1 th 1
17-02-21 ia standard fast_attacks2 diff
LLR: 3.01 (-2.94,2.94) [-10.00,5.00]
Total: 5190 W: 1157 L: 1138 D: 2895
sprt @ 10+0.1 th 1
16-02-21 ia standard fast_attacks2 diff
LLR: -2.98 (-2.94,2.94) [-10.00,5.00]
Total: 4322 W: 933 L: 999 D: 2390
sprt @ 10+0.1 th 1
12-02-21 ia standard fast_attacks diff
LLR: 3.00 (-2.94,2.94) [-10.00,5.00]
Total: 31166 W: 6843 L: 6953 D: 17370
sprt @ 10+0.1 th 1
12-02-21 ia standard check_info diff
LLR: 2.97 (-2.94,2.94) [-10.00,5.00]
Total: 3268 W: 752 L: 724 D: 1792
sprt @ 10+0.1 th 1
07-02-21 ia standard futility_depth1 diff
LLR: -2.97 (-2.94,2.94) [0.00,10.00]
Total: 10919 W: 2165 L: 2130 D: 6624
sprt @ 30+0.3 th 1
07-02-21 ia standard futility_depth1 diff
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 5221 W: 1244 L: 1125 D: 2852
sprt @ 10+0.1 th 1
04-02-21 ia standard futility_depth1 diff
LLR: -2.97 (-2.94,2.94) [0.00,10.00]
Total: 3331 W: 746 L: 779 D: 1806
sprt @ 10+0.1 th 1
31-01-21 ia standard master diff
ELO: 6.08 +-9.7 (95%) LOS: 89.0%
Total: 2000 W: 424 L: 389 D: 1187
2000 @ 30+0.3 th 1 vs. 11.2
31-01-21 ia standard merge diff
ELO: -6.95 +-10.1 (95%) LOS: 8.9%
Total: 2000 W: 422 L: 462 D: 1116
2000 @ 10+0.1 th 1
31-01-21 ia standard master diff
ELO: -129.55 +-10.1 (95%) LOS: 0.0%
Total: 2000 W: 104 L: 817 D: 1079
2000 @ 30+0.3 th 1 vs. MV-SF
18-01-21 ia standard atomic_no_check diff
ELO: 0.10 +-4.5 (95%) LOS: 51.8%
Total: 10000 W: 2205 L: 2202 D: 5593
10000 @ 10+0.1 th 1
16-01-21 ia standard atomic_no_check diff
ELO: -5.21 +-6.4 (95%) LOS: 5.5%
Total: 5000 W: 1064 L: 1139 D: 2797
5000 @ 10+0.1 th 1 retest for performance regression
16-01-21 ia standard atomic_no_check diff
LLR: -2.95 (-2.94,2.94) [-10.00,5.00]
Total: 1273 W: 254 L: 304 D: 715
sprt @ 10+0.1 th 1 retest for performance regression
15-01-21 ia standard atomic_no_check diff
LLR: 2.99 (-2.94,2.94) [-10.00,5.00]
Total: 7561 W: 1666 L: 1659 D: 4236
sprt @ 10+0.1 th 1 performance regression test
31-12-20 ia standard history_slots2 diff
LLR: 2.95 (-2.94,2.94) [-10.00,5.00]
Total: 6933 W: 1610 L: 1601 D: 3722
sprt @ 10+0.1 th 1
24-12-20 ia standard horde_material5 diff
LLR: 2.98 (-2.94,2.94) [-10.00,5.00]
Total: 1232 W: 286 L: 248 D: 698
sprt @ 10+0.1 th 1
20-12-20 ia standard largeboards diff
ELO: 9.04 +-13.8 (95%) LOS: 90.0%
Total: 1000 W: 220 L: 194 D: 586
1000 @ 30+0.3 th 1 vs. 11.2.
12-12-20 ia standard best_promotion diff
LLR: -2.95 (-2.94,2.94) [0.00,10.00]
Total: 12975 W: 2992 L: 2927 D: 7056
sprt @ 10+0.1 th 1
11-12-20 ia standard nnue_pure diff
ELO: -1.81 +-4.5 (95%) LOS: 21.7%
Total: 5000 W: 538 L: 564 D: 3898
5000 @ 30+0.3 th 1 test pure vs. hybrid. LTC
12-12-20 ia standard is_chess diff
LLR: 2.95 (-2.94,2.94) [0.00,10.00]
Total: 7282 W: 1659 L: 1522 D: 4101
sprt @ 10+0.1 th 1 measure speedup
11-12-20 ia standard is_chess diff
LLR: -2.99 (-2.94,2.94) [0.00,10.00]
Total: 1703 W: 364 L: 414 D: 925
sprt @ 10+0.1 th 1 measure speedup
08-12-20 ia standard nnue_pure diff
ELO: 2.78 +-3.6 (95%) LOS: 93.2%
Total: 10000 W: 1480 L: 1400 D: 7120
10000 @ 10+0.1 th 1 test pure vs. hybrid