STS comparison of IPPOLIT, Rybka 3 and Stockfish

[Jeremy Bernstein]

Attached to this post is a PDF summary of Strategic Test Suite (http://sites.google.com/site/strategictestsuite/) results from IPPOLIT, Rybka 3 and Stockfish. My initial idea was to attempt to demonstrate that IPPOLIT and Rybka 3 have similar weaknesses via the suite, using Stockfish 1.7.1 as a 'control'. The results are far from conclusive, which is to say, I can't identify any correspondences between IPPOLIT and Rybka based on time spent or inability to solve certain positions. I've marked wrong answers in blue and "hard problems" (> 10 seconds of thinking) in orange. All engines were 1-core, 32-bit. Each engine had up to 420 seconds to solve each problem.

Jeremy

STS.pdf

STS 1-9 IPP/RYB/STO

(86.07 KiB) Downloaded 846 times

[Angel]

An EXELLENT post

[gaard]

Attached to this post is a PDF summary of Strategic Test Suite (http://sites.google.com/site/strategictestsuite/) results from IPPOLIT, Rybka 3 and Stockfish. My initial idea was to attempt to demonstrate that IPPOLIT and Rybka 3 have similar weaknesses via the suite, using Stockfish 1.7.1 as a 'control'. The results are far from conclusive, which is to say, I can't identify any correspondences between IPPOLIT and Rybka based on time spent or inability to solve certain positions. I've marked wrong answers in blue and "hard problems" (> 10 seconds of thinking) in orange. All engines were 1-core, 32-bit. Each engine had up to 420 seconds to solve each problem.

Jeremy

STS.pdf

When only looking at move choice, there seemed to be significant correlations between the Ippos and Rybka. I saw an analysis by Miguel on CCC and it left me with little doubt that the two play markedly similar moves. I can't speak to the origins of Ippo, or the code, but as far as playing style goes... the two are incredibly close.

[Jeremy Bernstein]

The next batch I'll hit is a 3-way comparison of IPPOLIT, RobboLito and Houdini. I'm mostly just curious about how well STS works as a relationship indicator.

[Richard Vida]

BTW, what happened with the material Zach Wegner mentioned in this post?

Richard

[mcostalba]

BTW, what happened with the material Zach Wegner mentioned in this post?

C'mon Richard, lets throw some good your idea on the table don't just ask for other's

P.S: Take with a bit of joking, not too serious, I say this because from the few posts where you expressed some idea/suggestion I've made up my mind you have a good vision of how an engine works.

[kingliveson]

BTW, what happened with the material Zach Wegner mentioned in this post?

Richard

It's in a hidden forum.