STS - Important problem with scoring of STS2
Posted: Thu Jul 15, 2010 1:43 pm
There is a major problem with the scoring of STS2 by STSStat which is apparent when you look at the results.
For example:
For STS2 the best move is found 88/100, but this gets a Score/1000 of only 861 (less than 10 times the "best move found" count). For all other STS the "Score/1000" is always higher than 10 times the best move hit.
The problem comes from typos in the STS2.epd file which make STSStat work incorrectly for at least 9 positions.
For positions 31, 41, 55, 62, 78 the "c0" comment contains a full move instead of a short move (e.g. "Bb7c8=10" instead of "Bc8=10").
For positions 32, 45, 93 the "c0" comment comes after the "id" text, and the comment starts with a space.
For position 28 the best move Bf8 only gets 8 points, whereas Rc2 gets 10 points.
Hope this helps,
Robert
For example:
For STS2 the best move is found 88/100, but this gets a Score/1000 of only 861 (less than 10 times the "best move found" count). For all other STS the "Score/1000" is always higher than 10 times the best move hit.
The problem comes from typos in the STS2.epd file which make STSStat work incorrectly for at least 9 positions.
For positions 31, 41, 55, 62, 78 the "c0" comment contains a full move instead of a short move (e.g. "Bb7c8=10" instead of "Bc8=10").
For positions 32, 45, 93 the "c0" comment comes after the "id" text, and the comment starts with a space.
For position 28 the best move Bf8 only gets 8 points, whereas Rc2 gets 10 points.
Hope this helps,
Robert