Page 1 of 1

STS Testsuite - Top Enginges Results

Posted: Mon Jul 05, 2010 7:00 pm
by TheKnilch
Hi all,

for your information. Intel Q9550 / 4 Cores / 10s (Arena 2.01, Deep Fritz 12 with Chessbase 11)

Code: Select all

                     STS1   STS2   STS3   STS4   STS5   STS6   STS7   STS8   STS9   STS10  Gesamt
IvanHoeB55           98     93     96     91     94     92     92     84     90     94     924
Houdini 1.02         97     92     93     88     93     94     93     85     89     96     920
IvanHoeB63m12c       96     94     93     92     94     91     91     80     91     95     917
Fire 1.31            96     92     87     93     96     92     91     81     86     98     912
Deep Rybka 3         88     90     93     90     94     94     92     86     86     95     908
Deep Rybka 4         94     89     88     94     93     92     93     81     84     90     898
Naum 4.2             96     93     89     90     85     89     87     83     83     83     878
Deep Fritz 12 (32b)  95     91     93     89     90     88     81     77     74     87     865
Stockfish 1.8        89     85     87     93     84     88     84     78     83     88     859
Stockfish 1.7.1      90     85     85     93     86     86     81     73     84     91     854
Critter 0.70         94     88     85     85     93     83     84     82     72     87     853
Protector 1.35       90     88     78     90     81     80     78     75     74     86     820
Deep Shredder 12     90     78     80     81     83     77     80     75     70     88     802
http://sites.google.com/site/strategictestsuite/

As already discussed. Stockfish not as good as against other engines.
Asthonishing: Rybka 3 better than Rybka 4.
And with Ivan55 as a new leader with my configuration.

Greetings
TK

Re: STS Testsuite - Top Enginges Results

Posted: Mon Jul 05, 2010 7:05 pm
by Vael Jean-Paul
Hi TK,

Very nice list you have!
Can i ask you which Arena version you have used..or maybe used a other program to run this STS tests!

Thanks,
JP.

Ahh,i was to fast..i see it now above your list...

Re: STS Testsuite - Top Enginges Results

Posted: Tue Jul 06, 2010 4:11 am
by Swaminathan
Thanks for the tests. As I had indicated, the total score is not everything. Individual tests sometimes count more.

In this case, Rybka 4 has better results in STS 4 than Rybka 3. It's my belief that STS 4 is the most important of all STS's.

Re: STS Testsuite - Top Enginges Results

Posted: Tue Jul 06, 2010 4:45 am
by John_R
Swaminathan wrote:Thanks for the tests. As I had indicated, the total score is not everything. Individual tests sometimes count more.

In this case, Rybka 4 has better results in STS 4 than Rybka 3. It's my belief that STS 4 is the most important of all STS's.
I suppose someone could weight the test so that it would correspond more closely to playing strength.

Re: STS Testsuite - Top Enginges Results

Posted: Tue Jul 06, 2010 4:47 am
by Swaminathan
John_R wrote:
Swaminathan wrote:Thanks for the tests. As I had indicated, the total score is not everything. Individual tests sometimes count more.

In this case, Rybka 4 has better results in STS 4 than Rybka 3. It's my belief that STS 4 is the most important of all STS's.
I suppose someone could weight the test so that it would correspond more closely to playing strength.
Yes, It would be interesting if someone could offer exact formula to do so.

You can review this thread for a related topic:
http://www.talkchess.com/forum/viewtopic.php?t=31700

There's also unexplored areas. (STS 11, 12... and so on)

Re: STS Testsuite - Top Enginges Results

Posted: Fri Jul 09, 2010 4:53 am
by AnthonyTheSage
Thanks for the results I was waiting for some Naum 4.2 tests. Seems to be almost as strong as Rybka 4 tactically. I was also curious if it would make a difference on these tests if Houdini 1.02 had the contempt analyze on?