chess engines testers

[deeds]

http://outskirts.altervista.org/forum/v ... 027#p48027

[sarona]

I know. We spoke about this via PM when this post first came out at another forum.

Look, I agree with you and believe he is in error on the subject of engine learning. But Peter is a very experienced engine tester (although I doubt he examined the source of SugaR AI SE before making an assessment about it's uniqueness). It is very unlikely I will agree 100% with anybody on the vast subject of chess engines. But I certainly do respect his testing methods and, most certainly, his demeanor.

For every poster like that, there a few enlightened ones. Not many, but there are a few of us. . .
https://outskirts.altervista.org/forum/ ... ost#p48082

[deeds]

For every poster like that, there a few enlightened ones. Not many, but there are a few of us. . .
https://outskirts.altervista.org/forum/ ... ost#p48082

https://blog.chessnibble.com/

[deeds]

new additions

[deeds]

Christophe Jean - stats :

Code: Select all

014 players                          : avg. D35, 023 243 ms/move, 003 780 games, 00 399 668 moves

2070 lc0 0.21.2 rc2 cuda 42493       : avg. D13, 017 818 ms/move, 000 312 games, 00 027 694 moves
20t asmfish 051117 x64 bmi2          : avg. D39, 024 090 ms/move, 000 800 games, 00 041 819 moves
20t brainfish 031117 x64 bmi2        : avg. D40, 023 624 ms/move, 000 800 games, 00 042 542 moves
20t brainfish 110720 x64 bmi2        : avg. D46, 024 665 ms/move, 000 400 games, 00 016 151 moves
20t brainlearn 12.1 nn-04cf2b4ed1da  : avg. D46, 023 391 ms/move, 000 400 games, 00 016 326 moves
20t dragon 1.0 x64 avx2              : avg. D36, 028 428 ms/move, 000 400 games, 00 016 010 moves
20t houdini 6.03 pro x64 pext        : avg. D31, 023 457 ms/move, 001 112 games, 00 063 500 moves
20t komodo 11.2.2 x64                : avg. D33, 022 891 ms/move, 000 800 games, 00 043 520 moves
20t komodo 13.1 x64 bmi2             : avg. D38, 021 729 ms/move, 000 312 games, 00 019 465 moves
20t komodo 13.1 x64 bmi2 mcts        : avg. D20, 022 667 ms/move, 000 312 games, 00 020 597 moves
20t stockfish 010819 x64 bmi2        : avg. D42, 021 757 ms/move, 000 312 games, 00 016 935 moves
20t stockfish 051117 x64 bmi2 ult    : avg. D39, 023 866 ms/move, 000 800 games, 00 042 207 moves
20t stockfish 210920 nn-03744f8d56d8 : avg. D43, 024 261 ms/move, 000 400 games, 00 016 147 moves
qh-fine-0803-5                       : avg. D45, 024 170 ms/move, 000 400 games, 00 016 755 moves

Averages :
2 457 sec/game (41 min/game)
134 plies/game (106 played plies/game)

Game stages :
- opening @ avg. D32, 036 637 ms/move
- middleg @ avg. D35, 021 474 ms/move
- endgame @ avg. D38, 012 476 ms/move

[deeds]

Basti Dangca - stats :

Code: Select all

012 players                   : avg. D29, 046 604 ms/move, 000 132 games, 00 017 368 moves

black marlin 8.0-dev_28102022 : avg. D30, 048 676 ms/move, 000 022 games, 00 001 407 moves
chiron 5.01                   : avg. D29, 044 249 ms/move, 000 022 games, 00 001 447 moves
clover 3.2.1                  : avg. D29, 043 937 ms/move, 000 022 games, 00 001 553 moves
ginkgo vienna                 : avg. D30, 046 886 ms/move, 000 022 games, 00 001 505 moves
hiarcs 15.1                   : avg. D29, 044 921 ms/move, 000 022 games, 00 001 549 moves
marvin 6.2.0-dev_0d21         : avg. D30, 047 574 ms/move, 000 022 games, 00 001 370 moves
rebel 16.1                    : avg. D28, 050 613 ms/move, 000 022 games, 00 001 212 moves
tucano 10.10                  : avg. D31, 044 586 ms/move, 000 022 games, 00 001 542 moves
uralochka 3.39d               : avg. D30, 046 995 ms/move, 000 022 games, 00 001 457 moves
vajolet 2.9.0-pre-20          : avg. D28, 047 445 ms/move, 000 022 games, 00 001 440 moves
weiss 2.1-dev                 : avg. D30, 049 074 ms/move, 000 022 games, 00 001 370 moves
zahak 10                      : avg. D29, 045 664 ms/move, 000 022 games, 00 001 516 moves

Averages :
6 132 sec/game (102 min/game)
143 plies/game (132 played plies/game)

Game stages :
- opening @ avg. D28, 075 589 ms/move
- middleg @ avg. D29, 040 304 ms/move
- endgame @ avg. D31, 023 969 ms/move

[deeds]

Lars Sandin - stats :

Code: Select all

039 players                   : avg. D36, 190 469 ms/move, 002 728 games, 00 205 354 moves

arasan 22.3 x64 1800x         : avg. D37, 180 085 ms/move, 000 080 games, 00 000 352 moves
arasan 23.01 x64 1800x        : avg. D46, 205 649 ms/move, 000 179 games, 00 002 612 moves
booot 6.3.1 x64 1800x         : avg. D33, 185 699 ms/move, 000 040 games, 00 000 279 moves
booot 6.5 x64 1800x           : avg. D45, 180 023 ms/move, 000 200 games, 00 008 702 moves
booot 6.5 x64 q6600           : avg. D49, 192 218 ms/move, 000 040 games, 00 000 547 moves
booot 7 x64 1800x             : avg. D47, 181 593 ms/move, 000 179 games, 00 007 444 moves
chiron 3.01 mp x64 q6600      : avg. D40, 204 494 ms/move, 000 040 games, 00 001 785 moves
chiron 5.01 x64 1800x         : avg. D46, 194 842 ms/move, 000 439 games, 00 009 072 moves
chiron 5.01 x64 q6600         : avg. D45, 191 220 ms/move, 000 280 games, 00 010 482 moves
deep rybka 4 x64 q6600        : avg. D42, 193 609 ms/move, 000 040 games, 00 000 276 moves
deep shredder 13 x64 q6600    : avg. D44, 198 579 ms/move, 000 040 games, 00 002 264 moves
dragon komodo 2.51 x64 1800x  : avg. D26, 187 602 ms/move, 000 080 games, 00 000 420 moves
dragon komodo 3 x64 1800x     : avg. D46, 179 155 ms/move, 000 279 games, 00 020 007 moves
dragon komodo 3.1 mcts 1800x  : avg. D27, 199 804 ms/move, 000 280 games, 00 012 681 moves
dragon komodo mcts x64 1800x  : avg. D61, 190 971 ms/move, 000 040 games, 00 000 419 moves
komodo 11.01 x64 1800x        : avg. D67, 215 854 ms/move, 000 039 games, 00 000 506 moves
komodo 13.1 x64 1800x         : avg. D19, 202 628 ms/move, 000 040 games, 00 000 043 moves
komodo 14 x64 1800x           : avg. D26, 210 223 ms/move, 000 080 games, 00 000 898 moves
lc0 0.28.2 cuda-611213 3060ti : avg. D16, 189 774 ms/move, 000 736 games, 00 062 207 moves
marvin 5.1.0 x64 q6600        : avg. D33, 190 324 ms/move, 000 080 games, 00 004 872 moves
marvin 5.2.0 x64 1800x        : avg. D40, 194 465 ms/move, 000 360 games, 00 005 475 moves
marvin 6.0.0 x64 1800x        : avg. D40, 192 000 ms/move, 000 219 games, 00 005 868 moves
pedone 3 x64 1800x            : avg. D57, 207 597 ms/move, 000 040 games, 00 001 483 moves
pedone 3 x64 q6600            : avg. D30, 211 330 ms/move, 000 040 games, 00 000 297 moves
pedone 3.1 x64 1800x          : avg. D26, 215 092 ms/move, 000 100 games, 00 000 990 moves
pedone 3.1 x64 q6600          : avg. D57, 225 960 ms/move, 000 040 games, 00 000 945 moves
spike 1.4 q6600               : avg. D42, 193 889 ms/move, 000 040 games, 00 000 368 moves
stockfish 12 nnue x64 1800x   : avg. D75, 210 486 ms/move, 000 040 games, 00 000 813 moves
stockfish 13 x64 1800x        : avg. D33, 224 611 ms/move, 000 120 games, 00 000 339 moves
stockfish 14 x64 1800x        : avg. D59, 199 016 ms/move, 000 159 games, 00 009 713 moves
stockfish 15 x64 1800x        : avg. D62, 202 542 ms/move, 000 317 games, 00 013 893 moves
stockfish 8 x64 1800x         : avg. D47, 157 846 ms/move, 000 040 games, 00 000 364 moves
stockfish 9 x64 1800x         : avg. D14, 190 852 ms/move, 000 040 games, 00 000 446 moves
wasp 4.5 x64 1800x            : avg. D39, 179 457 ms/move, 000 140 games, 00 004 407 moves
wasp 5 x64 1800x              : avg. D37, 179 076 ms/move, 000 160 games, 00 004 884 moves
wasp 5.5 x64 1800x            : avg. D39, 176 181 ms/move, 000 280 games, 00 009 201 moves

Averages :
14 338 sec/game (239 min/game)
163 plies/game (075 played plies/game)

Game stages :
- opening @ avg. D31, 192 007 ms/move
- middleg @ avg. D37, 194 390 ms/move
- endgame @ avg. D39, 185 230 ms/move

[deeds]

TCEC Team - stats :

Code: Select all

002 players              : avg. D47, 118 880 ms/move, 000 100 games, 00 012 847 moves

komododragon 2894.00     : avg. D42, 118 275 ms/move, 000 100 games, 00 006 560 moves
stockfish dev15_20220401 : avg. D52, 119 512 ms/move, 000 100 games, 00 006 287 moves

Averages :
15 273 sec/game (255 min/game)
149 plies/game (128 played plies/game)

Game stages :
- opening @ avg. D46, 211 750 ms/move
- middleg @ avg. D47, 103 511 ms/move
- endgame @ avg. D48, 041 561 ms/move

[deeds]