current rating comparison of top engines

[gsgs]

Stefan Pohl's list:


performance in promille

Code: Select all

                 af ,af ,af ,af ,sf ,sf ,sf ,sf ,ho ,
Elo-3000=        ---,426,425,421,408,395,393,390,366,
date            04n,07d,17d,04o,12d,20n,27n,01n,09n,
----------------------------------------------------
Houdini 5       ---,595,585,---,575,537,551,534,---,
Shredder 13     ---,802,793,---,776,773,777,767,732,
Komodo 10.2     ---,675,665,659?649,624,630,628,583,
Critter 1.6a    ---,850,863,845,835,831,820,813,813,
Gull 3          ---,833,850,828,821,815,811,816,793,
Fire 4          ---,848,850,835,832,832,828,811,820,
Equinox 3.3     ---,863,853,851,857,844,826,830,837,
----------------------------------------------------
all 7           ---,781,780,   ,764,751,749,743,725,
5               ---,814,816,805,799,789,783,780,763,
bottom 4        ---,849,854,840,836,831,821,818,815,
top 2           ---,635,625,---,612,593,588,581,542,

[gsgs]

2016/12/13 , average of 13 lists
3287 Stockfish 8
3276 Houdini 5
3243 Komodo 10.2

2017/01/15 , average of 14 lists
3288 Stockfish 8
3276 Houdini 5
3256(+2) Komodo 10.3

CCRL 40/40
3389 Stockfish 8 64-bit 4CPU
3384 Houdini 5.01 64-bit +80
3392 Komodo 10.3 64-bit 4CPU

CCRL 40/4
3480 Stockfish 8 64-bit 4CPU
3471 Houdini 5.01 64-bit 4CPU
3454 Komodo 10.3 64-bit 4CPU

CEGT 40/20
3414 Stockfish 8.0 x64 4CPU
3380 Houdini 5.0 x64 4CPU
3355 Komodo 10.3 x64 4CPU

CEGT 40/4
3544 Stockfish 8.0 x64 12CPU
3538 Houdini 5.0 x64 12CPU
3485 Komodo 10.3 x64 12CPU

ipman i7-5960x
3150 Stockfish 8 64 BMI2 8c
3151 Houdini 5 Pro x64-pext 8c
3145 Komodo 10.3 64-bit 8c

ipman i7-2670QM
3050 Stockfish 8 64 POPCNT 4c
3048 Houdini 5.01 Pro x64-popc 4c
3039 Komodo 10.3 64-bit 4c

ipman i3-M380
2907 Stockfish 8 64 POPCNT 1c
2890 Houdini 5 Pro x64-popc 1c
2850 Komodo 10.3 64-bit 1c

SPCC
3390 Stockfish 8 161101
3368 Houdini 5 x64
3341 Komodo 10.3 x64

SPCC , long thinking time
3373e Stockfish 8
3350 Houdini 5
3328 Komodo 10.3

FCP
3216 Stockfish 8 BMI2 x64 C15
3207 Houdini 5 Pro x64 C1
3200 Komodo 10.2 x64 C15

FGRL,60min
3166 Stockfish 8
3152 Houdini 5.01
3151 Komodo 10.3

FGRL,10min
3156 Stockfish 8 64
3146 Houdini 5.01 x64
3134 Komodo 10.3 64-bit

FGRL,1min
3501 Stockfish 8 64
3487 Houdini 5 x64
3449 Komodo 10.3 64-bit

IPON
3296 Stockfish 8
3285 Houdini 5
3258 Komodo 10.2

[gsgs]

2016/12/13 , average of 13 lists
3287 Stockfish 8
3276 Houdini 5
3243 Komodo 10.2

2017/01/15 , average of 14 lists
3288 Stockfish 8
3276 Houdini 5
3256(+2) Komodo 10.3

2017/02/14 , average of 13 lists, 4 STC, 5 LTC
3304,3478,3312 Stockfish 8
3289,3466,3290 Houdini 5
3271,3429,3285 Komodo 10.3

CCRL 40/40 , LTC
3394 Stockfish 8 64-bit 4CPU
3389 Houdini 5.01 64-bit +80
3384 Komodo 10.3 64-bit 4CPU

CCRL 40/4 , STC
3482 Stockfish 8 64-bit 4CPU
3474 Houdini 5.01 64-bit 4CPU
3456 Komodo 10.3 64-bit 4CPU

CEGT 40/20 , LTC
3407 Stockfish 8.0 x64 4CPU
3376 Houdini 5.0 x64 4CPU
3359 Komodo 10.3 x64 4CPU

CEGT 40/4
3544 Stockfish 8.0 x64 12CPU
3538 Houdini 5.0 x64 12CPU
3485 Komodo 10.3 x64 12CPU

ipman i7-5960x
3142 Stockfish 8 64 BMI2 8c
3144 Houdini 5 Pro x64-pext 8c
3140 Komodo 10.3 64-bit 8c

ipman i3-M380
2888 Stockfish 8 64 POPCNT 1c
2877 Houdini 5 Pro x64-popc 1c
2842 Komodo 10.3 64-bit 1c

SPCC , STC
3390 Stockfish 8 161101
3367 Houdini 5 x64
3333 Komodo 10.3 x64

SPCC , long thinking time , LTC
3394e Stockfish 8
3350 Houdini 5
3343 Komodo 10.3

FCP , LTC
3216 Stockfish 8 BMI2 x64 C15
3207 Houdini 5 Pro x64 C1
3200 Komodo 10.2 x64 C15

FGRL,60min , LTC
3149 Stockfish 8
3127 Houdini 5.01
3126 Komodo 10.3

FGRL,10min
3155 Stockfish 8 64
3146 Houdini 5.01 x64
3132 Komodo 10.3 64-bit

FGRL,1min , STC
3495 Stockfish 8 64
3483 Houdini 5 x64
3442 Komodo 10.3 64-bit

IPON
3296 Stockfish 8
3285 Houdini 5
3258 Komodo 10.2

[gsgs]

average normed Elos from 6 lists :
FCP,CEGT,CCRL,ERET,FastGM,OWL
(some engines missing)

Code: Select all

 1.957559 : Stockfish 8
 1.882873 : Houdini 5
 1.588978 : Komodo 10
 1.571578 : Stockfish 7
 1.543519 : Komodo 9.42
 1.416911 : Komodo 9.2
 1.322012 : Stockfish 6
 1.246330 : Komodo 9
 1.017573 : Stockfish 5
 1.015574 : Shredder 13
 0.972659 : Komodo 8
 0.830549 : Houdini 4
 0.430845 : Critter 1.6
 0.413320 : Equinox 3.30
 0.379283 : Fizbo 1.8
 0.348101 : Fritz 15
 0.301845 : Andscacs 0.87
 0.163401 : Rybka 4.1
 0.142509 : Andscacs 0.86
 0.130789 : Hannibal 1.7
 0.109728 : Nirvanachess 2.3
 0.041862 : Fizbo 1.7
 0.024684 : Protector 1.9
-0.004333 : Booot 6.1
-0.039733 : Texel 1.06
-0.04.352 : iCE 3.0
-0.054909 : Protector 1.8
-0.075118 : Nirvanachess 2.2
-0.253984 : Texel 1.05
-0.262616 : Chiron 2
-0.310378 : Naum 4.6
-0.525007 : Senpai 1.0
-0.619843 : Hakkapeliitta 3.0
-0.753182 : Vajolet2 2.2
-0.854128 : Arasan 19.1
-0.904273 : Spark 1.0
-0.969422 : Spike 1.4
-1.063715 : Rodent II 0.9.64
-1.073531 : Quazar 0.4
-1.219396 : Junior 13.8 Yokohama
-1.230542 : Deuterium 14.3.34.130
-1.249748 : SmarThink 1.7
-1.306352 : Gaviota 1.0
-1.324076 : Murka 3
-1.380123 : Laser 1.2
-1.413527 : Minko 1.3
-1.920587 : Octochess r5190

[gsgs]

2017/03/27 , 8 lists with Komodo 10.4

Elos weighted by games (all 8 lists normed to sf=3400)

3400,Stockfish 8
3385,Houdini 5
3391,Komodo 10.4
3368,Komodo 10.3

Code: Select all

Ipman  i7 5960x 8c 
3135,0400,Stockfish 8
3124,0400,Houdini 5
3133,0400,Komodo 10.4
3121,0400,Komodo 10.3

ipman , i7 2670QM
2980e,0240,Stockfish 8
2975,0240,Houdini 5.01
2961,0240,Komodo 10.4
2961,0000,Komodo 10.3

IPON
3294,2500,Stockfish 8
3280,2500,Houdini 5.01
3284,2500,Komodo 10.4
3284,0000,Komodo 10.3

fastgm 10+6
3151,2700,Stockfish 8
3141,2700,Houdini 5.01
3143,2700,Komodo 10.4
3143,0000,Komodo 10.3

CEGT 40/20 , 4CPU
3409,1200,Stockfish 8.0
3377,1205,Houdini 5.0
3434,0331,Komodo 10.4
3360,1102,Komodo 10.3

CEGT 40/20 , 1CPU
3345,1996,Stockfish 8.0
3310,2122,Houdini 5.0
3320,1200,Komodo 10.4
3297,1217,Komodo 10.3

CCRL 40/40 , 4CPU
3390,1067,Stockfish 8
3387,0838,Houdini 5.01
3372,0104,Komodo 10.4
3380,0698,Komodo 10.3

CCRL 40/40 , 1CPU
3294,1525,Stockfish 8
3306,1235,Houdini 5.01
3305,0328,Komodo 10.4
3275,1050,Komodo 10.3

[gsgs]

2016/12/13 , average of 13 lists
3287 Stockfish 8
3276 Houdini 5
3243 Komodo 10.2

2017/01/15 , average of 14 lists
3288 Stockfish 8
3276 Houdini 5
3256(+2) Komodo 10.3

2017/02/14 , average of 13 lists, 4 STC, 5 LTC
3304,3478,3312 Stockfish 8
3289,3466,3290 Houdini 5
3271,3429,3285 Komodo 10.3

2017/03/27 , 8 lists with Komodo 10.4 ,wieghted
3400,Stockfish 8
3385,Houdini 5
3391,Komodo 10.4
3368,Komodo 10.3

2017/04/16 , average of 15 lists
3329,Stockfish 8
3313,Houdini 5
3310,Komodo 10.4
3294,Komodo 10.3 (-20)

-----------------------------------------

Code: Select all

CCRL 40/40 , LTC
3391 Stockfish 8 64-bit 4CPU
3388 Houdini 5.01 64-bit +80
3389 Komodo 10.4 64bit 4CPU (281)
3380 Komodo 10.3 64-bit 4CPU (698)

CCRL 40/4 , STC
3486 Stockfish 8 64-bit 4CPU
3473 Houdini 5.01 64-bit 4CPU
3466 Komodo 10.4 64-bit 4CPU (1010)
3456 Komodo 10.3 64-bit 4CPU (1282)

CEGT 40/20 , LTC
3411 Stockfish 8.0 x64 4CPU
3380 Houdini 5.0 x64 4CPU
3394 Komodo 10.4 x64 4CPU (969)
3360 Komodo 10.3 x64 4CPU (1102)

CEGT 40/4
3543 Stockfish 8.0 x64 12CPU
3538 Houdini 5.0 x64 12CPU
3484 Komodo 10.4 x64 12CPU (600)
3484 Komodo 10.3 x64 12CPU (650)

ipman i7-5960x
3140 Stockfish 8 64 BMI2 8c
3144 Houdini 5 Pro x64-pext 8c
3136 Komodo 10.4 64-bit 8c (400)
3120 Komodo 10.3 64-bit 8c (400)

ipman i3-M380
2861 Stockfish 8 64 POPCNT 1c
2848 Houdini 5 Pro x64-popc 1c
2840 Komodo 10.4 64-bit 1c (660)
2823 Komodo 10.3 64-bit 1c (660)

SPCC , STC
3390 Stockfish 8 161101
3364 Houdini 5 x64
3343 Komodo 10.4 x64 (11000)
3328 Komodo 10.3 x64 (20000)

SPCC , long thinking time , LTC
3395e Stockfish 8 3430-35
3350 Houdini 5
3363 Komodo 10.4 (539)
3351 Komodo 10.3 (1551)

FCP , LTC
3216 Stockfish 8 BMI2 x64 C15
3207 Houdini 5 Pro x64 C1
3230e Komodo 10.4  (0)
3210e Komodo 10.2 x64 C15 3200+10 (0)

FGRL,60min , LTC
3149 Stockfish 8
3129 Houdini 5.01
3152 Komodo 10.4 (1350)
3128 Komodo 10.3 (1800)

FGRL,10min
3236 Stockfish 8 64
3221 Houdini 5.01 x64
3222 Komodo 10.4 64-bit (3000)
3209 Komodo 10.3 64-bit (4200)

FGRL,1min , STC
3472 Stockfish 8 64
3455 Houdini 5 x64
3440 Komodo 10.4 64-bit (14000)
3412 Komodo 10.3 64-bit (15750)

IPON
3302 Stockfish 8
3288 Houdini 5
3288 Komodo 10.4 (3520)
3268e Komodo 10.2 (4840)

OWL
3535 Stockfish 8 x64
3513 Houdini 5.01 Pro x64
3500 Komodo 10.4 x64 (5600)
3480e Komodo 10.3 (0)

ERET
3408 Stockfish 8
3401 Houdini 5
3409 Komodo 10.4 (111)
3395 Komodo 10.3 (111)

[gsgs]

IPON rating list

A: normal rating
B: only opponents within +-70 range
C: number of such opponents
D: name

Code: Select all

   A     B   C     D
-------------------------------
3299  3274   2  Komodo 11.01    
 3297  3326   2  Stockfish 8     
 3279  3275   2  Houdini 5.01    
 3121  3102   3  Shredder 13     
 3066  3069   8  Fizbo 1.9       
 3058  3058  10  Gull 3          
 3053  3049  10  Ginkgo 1.96     
 3031  3028  10  Booot 6.2       
 3029  3031  10  Jonny 8.00      
 3027  3029  10  Andscacs 0.90   
 3006  3009  10  Equinox 3.30    
 3000  3006  10  Chiron 4        
 2996  2996  10  Fritz 15        
 2993  2994  10  Critter 1.6a    
 2962  2957   8  Hannibal 1.7    
 2930  2931   3  Protector 1.9.0 

[gsgs]

rows are : H6,K11.2,SF9dev,sf8
columns are : Elo basic list , number of games, elo complete list , number of games

Code: Select all

l,CCRL 40/40
3385,0228,,3337,0212,
3396,0679,,3310,1146,
3415,0364,,3302,0922,
3387,1340,,3294,2123,

s,CCRL 40/4
3520,1485,,3440,2289,
3497,0090,,3419,2264,
----,----,,----,----,
3485,2060,,3420,5155,

l,CEGT 40/4 12CPU
3598,0300,
3517,0800,
3562,0800,
3542,1900,

s,CEGT 40/4 1CPU
3371,2300,
3328,2400,
3354,2000,
3331,5150,

s,FastGM 1m
3519,14750,,3477,15500,
3522,14750,,3478,17000,
3559,14750,,3519,17500,
3521,14750,,3481,27500,

m,FastGM,10m
3168,2700,,3279,2700,,3254,3300,
3146,1700,,3257,2700,,3231,3600,
----,----,,----,----,,----,----,
3136,1700,,3243,2700,,3226,9900,

l,FastGM,60m
3154,1350,,3164,1500,
3147,1350,,3159,1650,
----,----,
3125,1350,,3138,3600,

m,sedat ,60+1
3470,1100,
3416,1100,
3462,8800,
3417,1100,

l,sedat ,180+2,8CPU,
3613,450,
3603,480,
3578,480,
3604e,480e,

s,ipon,300+3
3350,3300,,3360,3520,
3312,3300,,3319,3740,
----,----,,----,----,
3297,3300,,3310,6600,

s,OWL
3564,,17980,
3537,,08660,
----,,-----,
3512,,37440,

l,SPCC
3379,136,,3382,136,
3400,136,,3400,727,
3410,136,,3416,726,
3401e,136e,,----,---,

l,Bertil Eklund,360+1,20core
3016,1162,
---,----,
2984,1162,
2969e,1162e,

l,Bertil Eklund,360+1,16core
3016,1310,
---,----,
2984,1310,
2969e,1310e,

l,Ipman i7-5960x,8c,5m
3137,400,,
3123,400,,
3118,1600,,
3105,400,,

s,ipman i3-m380.1c,5m
2839,740,*
2825,740,
2859,1480,
2819,740,

s=short TC,6
ho,3213
ko,3203
s9,3237
s8,3200

l=long TC,8
ho,3235
ko,3206
s9,3212
s8,3200

[gsgs]

fastGM at 60+1 with 14750 games has SF8 ahead of H6,
I speculate this includes time losses of H6 as in Ipman's list.
So I exclude fastGM and ipman-i3 for STC.

OWL has asmFish-Jun28 with 11750 games way ahead of all others,
e.g. 93 Elo better than sf8, which is just not credible, so I exclude this too.

At LTC CEGT has Komodo way too low, so I exclude this

this leaves :

Code: Select all

LTC , rest , STC
33.6,40.2,30.2,H6-SF8
21.7,05.7,09.9,K11.2-SF8
20.1,45.0,36.4,SF9-SF8