STS engine comparison: suggestions, criticism and help
- noctiferus
- Posts: 122
- Joined: Thu Jun 10, 2010 7:57 am
- Location: Ivrea (To), Italy
STS engine comparison: suggestions, criticism and help
First of all, happy new year to everybody.
Now, to the point: I asked Swami's permission to use his STS suite, and publish results (he kindly agreed).
My idea is to use STS to compare last\previous versions of an engine, hoping with it to help authors to see in which areas improvements are effective and where they worsen engines performance. The question is: do you think it could be useful?
I have an i7\720 quad, allowing hyperthreading.
I have run a few tests, up to now (see in attach Komodo 3\4, 10 sec/pos, no HT).
I need, however, some help on Hyperthreading: I know that for chess engines HT is bad. Unfortunately my BIOS does not allow me to switch it off, so I'm forced to use TaskManager's options, but some engines, under Arena 2.5 behave in different ways (some using 4 thr, some only 3...). In order to have a uniform behaviour, my idea is to allow HT, so that at least, all engines will work under the same conditions, Do the experts agree?
Txs for comments.
Now, to the point: I asked Swami's permission to use his STS suite, and publish results (he kindly agreed).
My idea is to use STS to compare last\previous versions of an engine, hoping with it to help authors to see in which areas improvements are effective and where they worsen engines performance. The question is: do you think it could be useful?
I have an i7\720 quad, allowing hyperthreading.
I have run a few tests, up to now (see in attach Komodo 3\4, 10 sec/pos, no HT).
I need, however, some help on Hyperthreading: I know that for chess engines HT is bad. Unfortunately my BIOS does not allow me to switch it off, so I'm forced to use TaskManager's options, but some engines, under Arena 2.5 behave in different ways (some using 4 thr, some only 3...). In order to have a uniform behaviour, my idea is to allow HT, so that at least, all engines will work under the same conditions, Do the experts agree?
Txs for comments.
- Attachments
-
- Komodo compare.zip
- (154.08 KiB) Downloaded 231 times
- noctiferus
- Posts: 122
- Joined: Thu Jun 10, 2010 7:57 am
- Location: Ivrea (To), Italy
Re: STS engine comparison: suggestions, criticism and help
I was asked to publish the detailed Komodo reports (sorry for bringing up again this topic)
- Attachments
-
- kom sts reps.zip
- (28.91 KiB) Downloaded 189 times
-
- Posts: 92
- Joined: Wed Jun 16, 2010 12:31 am
- Real Name: Anthony
Re: STS engine comparison: suggestions, criticism and help
I personally would love to see a STS comparison between all the top engines. I know someone did start a site a while back, but I'm not sure if they followed through with it.
- noctiferus
- Posts: 122
- Joined: Thu Jun 10, 2010 7:57 am
- Location: Ivrea (To), Italy
Re: STS engine comparison: suggestions, criticism and help
Swaminathan did it, some time ago, but he's busy, now.
I can try to (slowly) complete the list with the new engines. here some results Critter14 and Stockfish211, 7 threads, 10 sec on a i7/720.
I decided to use Hyperthread, because it seems that some engines behave differently, on my comp, when I exclude Hyperthreading using the task manager.
I can try to (slowly) complete the list with the new engines. here some results Critter14 and Stockfish211, 7 threads, 10 sec on a i7/720.
I decided to use Hyperthread, because it seems that some engines behave differently, on my comp, when I exclude Hyperthreading using the task manager.
- Attachments
-
- crit14 SF221.zip
- (1.89 KiB) Downloaded 196 times
- Carlos Ylich
- Posts: 56
- Joined: Thu Jun 10, 2010 3:04 am
- Location: São Paulo
Re: STS engine comparison: suggestions, criticism and help
Thanks, great job !!
- noctiferus
- Posts: 122
- Joined: Thu Jun 10, 2010 7:57 am
- Location: Ivrea (To), Italy
Re: STS engine comparison: suggestions, criticism and help
Txs. I want to extend these tests to the new engines (even if I have troubles with multi threading) at a slow pace, however, due to limited time availabiity.
Re: STS engine comparison: suggestions, criticism and help
How do you do that?noctiferus wrote:when I exclude Hyperthreading using the task manager.
(I thought you could only do it in the BIOS...)
- noctiferus
- Posts: 122
- Joined: Thu Jun 10, 2010 7:57 am
- Location: Ivrea (To), Italy
Re: STS engine comparison: suggestions, criticism and help
i have Windows7.
Go to task manager- processes- righy click on the gui process: you will get a window with several options - Click on " select affinities" (or something like that, in english- I have the italian version). Then you'll get the list of threads: select only those you want to be accessed by the gui.
The same thing you can do to limit the number of threads to an engine.
Go to task manager- processes- righy click on the gui process: you will get a window with several options - Click on " select affinities" (or something like that, in english- I have the italian version). Then you'll get the list of threads: select only those you want to be accessed by the gui.
The same thing you can do to limit the number of threads to an engine.