Page 1 of 1

STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Wed Jun 09, 2010 2:39 pm
by Jeremy Bernstein
Attached to this post is a PDF summary of Strategic Test Suite (http://sites.google.com/site/strategictestsuite/) results from IPPOLIT, Rybka 3 and Stockfish. My initial idea was to attempt to demonstrate that IPPOLIT and Rybka 3 have similar weaknesses via the suite, using Stockfish 1.7.1 as a 'control'. The results are far from conclusive, which is to say, I can't identify any correspondences between IPPOLIT and Rybka based on time spent or inability to solve certain positions. I've marked wrong answers in blue and "hard problems" (> 10 seconds of thinking) in orange. All engines were 1-core, 32-bit. Each engine had up to 420 seconds to solve each problem.

Jeremy
STS.pdf
STS 1-9 IPP/RYB/STO
(86.07 KiB) Downloaded 863 times

Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Thu Jun 10, 2010 3:02 am
by Angel
:o :) :idea: An EXELLENT post

Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Thu Jun 10, 2010 5:26 am
by gaard
Jeremy Bernstein wrote:Attached to this post is a PDF summary of Strategic Test Suite (http://sites.google.com/site/strategictestsuite/) results from IPPOLIT, Rybka 3 and Stockfish. My initial idea was to attempt to demonstrate that IPPOLIT and Rybka 3 have similar weaknesses via the suite, using Stockfish 1.7.1 as a 'control'. The results are far from conclusive, which is to say, I can't identify any correspondences between IPPOLIT and Rybka based on time spent or inability to solve certain positions. I've marked wrong answers in blue and "hard problems" (> 10 seconds of thinking) in orange. All engines were 1-core, 32-bit. Each engine had up to 420 seconds to solve each problem.

Jeremy
STS.pdf
When only looking at move choice, there seemed to be significant correlations between the Ippos and Rybka. I saw an analysis by Miguel on CCC and it left me with little doubt that the two play markedly similar moves. I can't speak to the origins of Ippo, or the code, but as far as playing style goes... the two are incredibly close.

Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Thu Jun 10, 2010 8:51 pm
by Jeremy Bernstein
The next batch I'll hit is a 3-way comparison of IPPOLIT, RobboLito and Houdini. I'm mostly just curious about how well STS works as a relationship indicator.

Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Thu Jun 10, 2010 9:58 pm
by Richard Vida
BTW, what happened with the material Zach Wegner mentioned in this post?

Richard

Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Sat Jun 12, 2010 12:10 pm
by mcostalba
Richard Vida wrote:BTW, what happened with the material Zach Wegner mentioned in this post?
C'mon Richard, lets throw some good your idea on the table :-) don't just ask for other's :-)

P.S: Take with a bit of joking, not too serious, I say this because from the few posts where you expressed some idea/suggestion I've made up my mind you have a good vision of how an engine works.

Re: STS comparison of IPPOLIT, Rybka 3 and Stockfish

Posted: Sat Jun 12, 2010 12:36 pm
by kingliveson
Richard Vida wrote:BTW, what happened with the material Zach Wegner mentioned in this post?

Richard

It's in a hidden forum. :o