STS engine comparison: suggestions, criticism and help

Discussion about chess-playing software (engines, hosts, opening books, platforms, etc...)
Post Reply
User avatar
noctiferus
Posts: 122
Joined: Thu Jun 10, 2010 7:57 am
Location: Ivrea (To), Italy

STS engine comparison: suggestions, criticism and help

Post by noctiferus » Sun Jan 01, 2012 4:38 pm

First of all, happy new year to everybody.

Now, to the point: I asked Swami's permission to use his STS suite, and publish results (he kindly agreed).
My idea is to use STS to compare last\previous versions of an engine, hoping with it to help authors to see in which areas improvements are effective and where they worsen engines performance. The question is: do you think it could be useful?
I have an i7\720 quad, allowing hyperthreading.
I have run a few tests, up to now (see in attach Komodo 3\4, 10 sec/pos, no HT).
I need, however, some help on Hyperthreading: I know that for chess engines HT is bad. Unfortunately my BIOS does not allow me to switch it off, so I'm forced to use TaskManager's options, but some engines, under Arena 2.5 behave in different ways (some using 4 thr, some only 3...). In order to have a uniform behaviour, my idea is to allow HT, so that at least, all engines will work under the same conditions, Do the experts agree?
Txs for comments.
Attachments
Komodo compare.zip
(154.08 KiB) Downloaded 231 times

User avatar
noctiferus
Posts: 122
Joined: Thu Jun 10, 2010 7:57 am
Location: Ivrea (To), Italy

Re: STS engine comparison: suggestions, criticism and help

Post by noctiferus » Thu Jan 05, 2012 10:42 am

I was asked to publish the detailed Komodo reports (sorry for bringing up again this topic)
Attachments
kom sts reps.zip
(28.91 KiB) Downloaded 189 times

AnthonyTheSage
Posts: 92
Joined: Wed Jun 16, 2010 12:31 am
Real Name: Anthony

Re: STS engine comparison: suggestions, criticism and help

Post by AnthonyTheSage » Sun Jan 08, 2012 10:36 am

I personally would love to see a STS comparison between all the top engines. I know someone did start a site a while back, but I'm not sure if they followed through with it.

User avatar
noctiferus
Posts: 122
Joined: Thu Jun 10, 2010 7:57 am
Location: Ivrea (To), Italy

Re: STS engine comparison: suggestions, criticism and help

Post by noctiferus » Sun Jan 08, 2012 5:39 pm

Swaminathan did it, some time ago, but he's busy, now.
I can try to (slowly) complete the list with the new engines. here some results Critter14 and Stockfish211, 7 threads, 10 sec on a i7/720.

I decided to use Hyperthread, because it seems that some engines behave differently, on my comp, when I exclude Hyperthreading using the task manager.
Attachments
crit14 SF221.zip
(1.89 KiB) Downloaded 196 times

User avatar
Carlos Ylich
Posts: 56
Joined: Thu Jun 10, 2010 3:04 am
Location: São Paulo

Re: STS engine comparison: suggestions, criticism and help

Post by Carlos Ylich » Mon Feb 13, 2012 4:54 pm

Thanks, great job !! :!:

User avatar
noctiferus
Posts: 122
Joined: Thu Jun 10, 2010 7:57 am
Location: Ivrea (To), Italy

Re: STS engine comparison: suggestions, criticism and help

Post by noctiferus » Tue Feb 14, 2012 2:37 pm

Txs. I want to extend these tests to the new engines (even if I have troubles with multi threading) at a slow pace, however, due to limited time availabiity.

ernest
Posts: 247
Joined: Thu Sep 02, 2010 10:33 am

Re: STS engine comparison: suggestions, criticism and help

Post by ernest » Tue Feb 14, 2012 6:12 pm

noctiferus wrote:when I exclude Hyperthreading using the task manager.
How do you do that?
(I thought you could only do it in the BIOS...)

User avatar
noctiferus
Posts: 122
Joined: Thu Jun 10, 2010 7:57 am
Location: Ivrea (To), Italy

Re: STS engine comparison: suggestions, criticism and help

Post by noctiferus » Wed Feb 15, 2012 11:04 am

i have Windows7.
Go to task manager- processes- righy click on the gui process: you will get a window with several options - Click on " select affinities" (or something like that, in english- I have the italian version). Then you'll get the list of threads: select only those you want to be accessed by the gui.
The same thing you can do to limit the number of threads to an engine.

Post Reply