New Stockfish 1.8 JA release?!
Re: New Stockfish 1.8 JA release?!
Has anyone actually tested it against DR4 or even 1.71 for over 100 games before giving an opinion based on fact instead of wishes?
-
Swaminathan
- Posts: 375
- Joined: Wed Jun 09, 2010 12:14 pm
Re: New Stockfish 1.8 JA release?!
On total score, yes. But on individual scores, Stockfish 1.8 does some themes better than Stockfish 1.7.1. I hope that those themes count more.
One can't take total score alone in STS and conclude that one version is better than other.
If for example, one version does a lot better in certain theme (let's call it STS 5), but does worser in total score, it may even play better than the other because STS 5 may be more important than other STS's). We just don't know which theme is important.
It's tested on my old cpu: 2.4 GHZ, 32 bits and Q6600 and at 10 seconds per position.
I hope someone with better hardware tests both the versions. Stronger engines obviously should be tested on better hardware and at intermediate time controls (minimum of 30 seconds per position)
I have done many tests on updates of others engines. So far, the STS results seems fairly consistent in telling us how much the version has improved over the previous one.
It also predicts the rough ratings of the new engine.
It worked for 95% of the engines.
Remaining 5% is tough to predict and it's especially for engines which are well beyond 3000. Total score sometimes tells, sometimes it doesn't -- especially in 10 seconds/per position and a bit slow hardware. So I hope this is the case and that Stockfish 1.8 is indeed few elo's better than Stockfish 1.7.1.
One can't take total score alone in STS and conclude that one version is better than other.
If for example, one version does a lot better in certain theme (let's call it STS 5), but does worser in total score, it may even play better than the other because STS 5 may be more important than other STS's). We just don't know which theme is important.
It's tested on my old cpu: 2.4 GHZ, 32 bits and Q6600 and at 10 seconds per position.
I hope someone with better hardware tests both the versions. Stronger engines obviously should be tested on better hardware and at intermediate time controls (minimum of 30 seconds per position)
I have done many tests on updates of others engines. So far, the STS results seems fairly consistent in telling us how much the version has improved over the previous one.
It also predicts the rough ratings of the new engine.
It worked for 95% of the engines.
Remaining 5% is tough to predict and it's especially for engines which are well beyond 3000. Total score sometimes tells, sometimes it doesn't -- especially in 10 seconds/per position and a bit slow hardware. So I hope this is the case and that Stockfish 1.8 is indeed few elo's better than Stockfish 1.7.1.
Logo made by Ulysses P (Vytron)
Co-Authored with Dann Corbit: Strategic Test Suite
Co-Authored with Dann Corbit: Strategic Test Suite
-
LetoAtreides82
- Posts: 32
- Joined: Thu Jun 10, 2010 12:46 am
Re: New Stockfish 1.8 JA release?!
At CEGT Blitz one of our testers Gerhard has Stockfish 1.8 x64 1CPU at 3129 after 1000 games, 31 elo higher than Stockfish 1.7.1 x64 1CPU and 8 elo higher than Rybka 3 x64 1CPU, quite an impressive achievement by the Stockfish team. Rybka 3 appears to have been conquered, now only Rybka 4 and Houdini and the Ippolit family remains.
-
Archimedes
- Posts: 1
- Joined: Thu Jun 10, 2010 12:29 pm
Re: New Stockfish 1.8 JA release?!
Found in the german CSS-Forum. At the following position, Crafty 23.1 (Chessbase version) only needs a few seconds to find the solution, whereas Stockfish is calculating "endless" and did'nt find the "correct move".
R7/1B6/pB1K4/1P1P4/8/3p4/pp1p4/krbR4 w - - 0 1
R7/1B6/pB1K4/1P1P4/8/3p4/pp1p4/krbR4 w - - 0 1
Analysis by Crafty 23.01:
1. +- (#5): 1.La5 axb5 2.La6 b4 3.Lxd3 b3 4.Lxd2 Lxd2 5.Txb1#
2. +- (6.89): 1.Ke6 a5 2.d6 a4 3.Ld5 a3 4.Tg1 d1S 5.Txa3 Sc3 6.Txc3 Le3 7.Ta3 Txg1 8.Txa2+ Kb1 9.Lxe3 Tg4