Page 1 of 1
STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Wed Jun 09, 2010 2:39 pm
by Jeremy Bernstein
Attached to this post is a PDF summary of Strategic Test Suite (
http://sites.google.com/site/strategictestsuite/) results from IPPOLIT, Rybka 3 and Stockfish. My initial idea was to attempt to demonstrate that IPPOLIT and Rybka 3 have similar weaknesses via the suite, using Stockfish 1.7.1 as a 'control'. The results are far from conclusive, which is to say, I can't identify any correspondences between IPPOLIT and Rybka based on time spent or inability to solve certain positions. I've marked wrong answers in blue and "hard problems" (> 10 seconds of thinking) in orange. All engines were 1-core, 32-bit. Each engine had up to 420 seconds to solve each problem.
Jeremy
STS.pdf
- STS 1-9 IPP/RYB/STO
- (86.07 KiB) Downloaded 837 times
Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Thu Jun 10, 2010 3:02 am
by Angel
Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Thu Jun 10, 2010 5:26 am
by gaard
Jeremy Bernstein wrote:Attached to this post is a PDF summary of Strategic Test Suite (
http://sites.google.com/site/strategictestsuite/) results from IPPOLIT, Rybka 3 and Stockfish. My initial idea was to attempt to demonstrate that IPPOLIT and Rybka 3 have similar weaknesses via the suite, using Stockfish 1.7.1 as a 'control'. The results are far from conclusive, which is to say, I can't identify any correspondences between IPPOLIT and Rybka based on time spent or inability to solve certain positions. I've marked wrong answers in blue and "hard problems" (> 10 seconds of thinking) in orange. All engines were 1-core, 32-bit. Each engine had up to 420 seconds to solve each problem.
Jeremy
STS.pdf
When only looking at move choice, there seemed to be significant correlations between the Ippos and Rybka. I saw an analysis by Miguel on CCC and it left me with little doubt that the two play markedly similar moves. I can't speak to the origins of Ippo, or the code, but as far as playing style goes... the two are incredibly close.
Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Thu Jun 10, 2010 8:51 pm
by Jeremy Bernstein
The next batch I'll hit is a 3-way comparison of IPPOLIT, RobboLito and Houdini. I'm mostly just curious about how well STS works as a relationship indicator.
Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Thu Jun 10, 2010 9:58 pm
by Richard Vida
BTW, what happened with the material Zach Wegner mentioned in
this post?
Richard
Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Sat Jun 12, 2010 12:10 pm
by mcostalba
Richard Vida wrote:BTW, what happened with the material Zach Wegner mentioned in
this post?
C'mon Richard, lets throw some good your idea on the table
![Smile :-)](./images/smilies/icon_e_smile.gif)
don't just ask for other's
P.S: Take with a bit of joking, not too serious, I say this because from the few posts where you expressed some idea/suggestion I've made up my mind you have a good vision of how an engine works.
Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish
Posted: Sat Jun 12, 2010 12:36 pm
by kingliveson
Richard Vida wrote:BTW, what happened with the material Zach Wegner mentioned in
this post?
Richard
It's in a hidden forum.
![Surprised :o](./images/smilies/icon_e_surprised.gif)