STS Testsuite - Top Enginges Results

[TheKnilch]

Hi all,

for your information. Intel Q9550 / 4 Cores / 10s (Arena 2.01, Deep Fritz 12 with Chessbase 11)

Code: Select all

                     STS1   STS2   STS3   STS4   STS5   STS6   STS7   STS8   STS9   STS10  Gesamt
IvanHoeB55           98     93     96     91     94     92     92     84     90     94     924
Houdini 1.02         97     92     93     88     93     94     93     85     89     96     920
IvanHoeB63m12c       96     94     93     92     94     91     91     80     91     95     917
Fire 1.31            96     92     87     93     96     92     91     81     86     98     912
Deep Rybka 3         88     90     93     90     94     94     92     86     86     95     908
Deep Rybka 4         94     89     88     94     93     92     93     81     84     90     898
Naum 4.2             96     93     89     90     85     89     87     83     83     83     878
Deep Fritz 12 (32b)  95     91     93     89     90     88     81     77     74     87     865
Stockfish 1.8        89     85     87     93     84     88     84     78     83     88     859
Stockfish 1.7.1      90     85     85     93     86     86     81     73     84     91     854
Critter 0.70         94     88     85     85     93     83     84     82     72     87     853
Protector 1.35       90     88     78     90     81     80     78     75     74     86     820
Deep Shredder 12     90     78     80     81     83     77     80     75     70     88     802

http://sites.google.com/site/strategictestsuite/

As already discussed. Stockfish not as good as against other engines.
Asthonishing: Rybka 3 better than Rybka 4.
And with Ivan55 as a new leader with my configuration.

Greetings
TK

[Vael Jean-Paul]

Hi TK,

Very nice list you have!
Can i ask you which Arena version you have used..or maybe used a other program to run this STS tests!

Thanks,
JP.

Ahh,i was to fast..i see it now above your list...

[Swaminathan]

Thanks for the tests. As I had indicated, the total score is not everything. Individual tests sometimes count more.

In this case, Rybka 4 has better results in STS 4 than Rybka 3. It's my belief that STS 4 is the most important of all STS's.

[John_R]

Thanks for the tests. As I had indicated, the total score is not everything. Individual tests sometimes count more.

In this case, Rybka 4 has better results in STS 4 than Rybka 3. It's my belief that STS 4 is the most important of all STS's.

I suppose someone could weight the test so that it would correspond more closely to playing strength.

[Swaminathan]

Thanks for the tests. As I had indicated, the total score is not everything. Individual tests sometimes count more.

In this case, Rybka 4 has better results in STS 4 than Rybka 3. It's my belief that STS 4 is the most important of all STS's.

I suppose someone could weight the test so that it would correspond more closely to playing strength.

Yes, It would be interesting if someone could offer exact formula to do so.

You can review this thread for a related topic:
http://www.talkchess.com/forum/viewtopic.php?t=31700

There's also unexplored areas. (STS 11, 12... and so on)

[AnthonyTheSage]

Thanks for the results I was waiting for some Naum 4.2 tests. Seems to be almost as strong as Rybka 4 tactically. I was also curious if it would make a difference on these tests if Houdini 1.02 had the contempt analyze on?