Page 1 of 1

STS engine comparison: suggestions, criticism and help

Posted: Sun Jan 01, 2012 4:38 pm
by noctiferus
First of all, happy new year to everybody.

Now, to the point: I asked Swami's permission to use his STS suite, and publish results (he kindly agreed).
My idea is to use STS to compare last\previous versions of an engine, hoping with it to help authors to see in which areas improvements are effective and where they worsen engines performance. The question is: do you think it could be useful?
I have an i7\720 quad, allowing hyperthreading.
I have run a few tests, up to now (see in attach Komodo 3\4, 10 sec/pos, no HT).
I need, however, some help on Hyperthreading: I know that for chess engines HT is bad. Unfortunately my BIOS does not allow me to switch it off, so I'm forced to use TaskManager's options, but some engines, under Arena 2.5 behave in different ways (some using 4 thr, some only 3...). In order to have a uniform behaviour, my idea is to allow HT, so that at least, all engines will work under the same conditions, Do the experts agree?
Txs for comments.

Re: STS engine comparison: suggestions, criticism and help

Posted: Thu Jan 05, 2012 10:42 am
by noctiferus
I was asked to publish the detailed Komodo reports (sorry for bringing up again this topic)

Re: STS engine comparison: suggestions, criticism and help

Posted: Sun Jan 08, 2012 10:36 am
by AnthonyTheSage
I personally would love to see a STS comparison between all the top engines. I know someone did start a site a while back, but I'm not sure if they followed through with it.

Re: STS engine comparison: suggestions, criticism and help

Posted: Sun Jan 08, 2012 5:39 pm
by noctiferus
Swaminathan did it, some time ago, but he's busy, now.
I can try to (slowly) complete the list with the new engines. here some results Critter14 and Stockfish211, 7 threads, 10 sec on a i7/720.

I decided to use Hyperthread, because it seems that some engines behave differently, on my comp, when I exclude Hyperthreading using the task manager.

Re: STS engine comparison: suggestions, criticism and help

Posted: Mon Feb 13, 2012 4:54 pm
by Carlos Ylich
Thanks, great job !! :!:

Re: STS engine comparison: suggestions, criticism and help

Posted: Tue Feb 14, 2012 2:37 pm
by noctiferus
Txs. I want to extend these tests to the new engines (even if I have troubles with multi threading) at a slow pace, however, due to limited time availabiity.

Re: STS engine comparison: suggestions, criticism and help

Posted: Tue Feb 14, 2012 6:12 pm
by ernest
noctiferus wrote:when I exclude Hyperthreading using the task manager.
How do you do that?
(I thought you could only do it in the BIOS...)

Re: STS engine comparison: suggestions, criticism and help

Posted: Wed Feb 15, 2012 11:04 am
by noctiferus
i have Windows7.
Go to task manager- processes- righy click on the gui process: you will get a window with several options - Click on " select affinities" (or something like that, in english- I have the italian version). Then you'll get the list of threads: select only those you want to be accessed by the gui.
The same thing you can do to limit the number of threads to an engine.