Re: Deep Fritz 11 eval
Posted: Thu Oct 27, 2011 5:05 pm
I'm hoping that his analysis is only dealing with a single "false-positive" here. Because it has provided two kinds of information. First, it has (if it can be trusted) shown that several commercial programs are completely original. As opposed to a few on Talkchess or the Rybka forum that claim all commercials are code-copying cheaters. I find it hard to imagine that one could copy any significant amount of code, and still look "unrelated". But we will see. However, secondly, it has suggested that Fritz 11 is related to strelka/et. al. The interesting thing is that it suggests that fritz 11 is not related to fritz 10, and that represents a huge departure from the rest of his results. If you look at "families" in his graph, different versions of the same program always show to be very close relatives. Which is, to me, the expected result. That Fritz 11 is so related to strelka is interesting. That Fritz 11 is so unrelated to fritz 10 is really unexpected. However, commercial authors are always quite secretive, so I do not know if there are any known specifics about the differences between F10 and F11. For example, adding reductions to a program that didn't have them might suddenly make that version appear much closer to others that use reductions as opposed to the original that did not. If this question can be answered, it is possible that this could be a first-approximation to decide which programs are suspicious and need further examination. I'm still convinced that the final determination has to be source code (or RE'ed source if necessary) comparison to make sure we are not looking at the same idea with two different implementations, which would be perfectly acceptable...
But it would certainly be nice to have some sort of filtration process to eliminate RE analysis of so many engines, which is a pain... without overlooking those that are potential problems...
But it would certainly be nice to have some sort of filtration process to eliminate RE analysis of so many engines, which is a pain... without overlooking those that are potential problems...