Engine Match/Tournament Test Suite

[kingliveson]

Kingliveson ECO A00-E97 Variations Test Suites

KLOECOA00E97V pgn files are a series of chess opening positions designed specifically for running engine versus engine matches to determine strength. Each test suite contains positions ranging from ECO (Encyclopedia of Chess Openings) A00 to E97 with 8 half moves. The smallest suite has 25 unique starting positions.

The advantage of this method compared to traditional book is that, each chess engine is given an equal opportunity to have the exact starting position. It also prevents repetition of a variation favored based on number of occurrences in a book. In addition, playing engine versus engine matches without defining starting positions will result in less than a handful opening variations regardless of the number of games played. A well designed ECO approach to testing chess engines will present a more precise and accurate final result.

Usage: From the Arena GUI Engines menu, select Tournament..., click the Options tab, browse and load the pgn file. You have the option under 'Starting position:' to either load the positions randomly or sequentially. For ChessGui program, the option is available under 'Start Positions...' with 'Use start positions' enabled. This can also be used with Fritz GUI -- it is available under the 'Openings DB' option.

klo_250_eco_a00-e97_variations.pgn - Best for matches between 2 different engines.
klo_150_eco_a00-e97_variations.pgn
klo_100_eco_a00-e97_variations.pgn
klo_50_eco_a00-e97_variations.pgn
klo_25_eco_a00-e97_variations.pgn - Best for multiple engines


klo_250_eco_a00-e97_variations:
----------
ECO A: 21%
ECO B: 32%
ECO C: 19%
ECO D: 16%
ECO E: 12%

klo_150_eco_a00-e97_variations:
----------
ECO A: 20%
ECO B: 31%
ECO C: 17%
ECO D: 19%
ECO E: 13%

klo_100_eco_a00-e97_variations:
----------
ECO A: 12%
ECO B: 32%
ECO C: 18%
ECO D: 22%
ECO E: 16%

klo_50_eco_a00-e97_variations:
----------
ECO A: 14%
ECO B: 28%
ECO C: 28%
ECO D: 18%
ECO E: 12%

klo_25_eco_a00-e97_variations:
----------
ECO A: 12%
ECO B: 36%
ECO C: 20%
ECO D: 16%
ECO E: 16%

A sample database of 4,000,000 games:
----------
ECO A: 22%
ECO B: 32%
ECO C: 19%
ECO D: 15%
ECO E: 12%


This package is provided as is without guarantee or warranty, and may be used as you will freely.


Sample:

[Event "KLO 250 ECO (A00-E97) Variations"]
[Site "?"]
[Date "2009.10.02"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A00"]
[WhiteElo "3000"]
[BlackElo "3000"]
[PlyCount "8"]
[EventDate "2009.??.??"]

1. h3 e5 2. c3 d5 3. d4 Nc6 4. Be3 Nf6 *

[Event "KLO 250 ECO (A00-E97) Variations"]
[Site "?"]
[Date "2010.01.08"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B10"]
[WhiteElo "3000"]
[BlackElo "3000"]
[PlyCount "8"]
[EventDate "2010.01.08"]

1. e4 c6 2. Qe2 d6 3. d4 Nf6 4. Nf3 g6 *

[Event "KLO 250 ECO (A00-E97) Variations"]
[Site "?"]
[Date "2009.11.06"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C39"]
[WhiteElo "3000"]
[BlackElo "3000"]
[PlyCount "8"]
[EventDate "2009.??.??"]

1. e4 e5 2. f4 exf4 3. Nf3 g5 4. h4 g4 *

[Event "KLO 250 ECO (A00-E97) Variations"]
[Site "?"]
[Date "2009.04.19"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D38"]
[WhiteElo "3000"]
[BlackElo "3000"]
[PlyCount "8"]
[EventDate "2009.??.??"]

1. d4 Nf6 2. c4 e6 3. Nf3 d5 4. Nc3 Bb4 *

[Event "KLO 250 ECO (A00-E97) Variations"]
[Site "?"]
[Date "2009.10.05"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E60"]
[WhiteElo "3000"]
[BlackElo "3000"]
[PlyCount "8"]
[EventDate "2009.??.??"]

1. d4 Nf6 2. c4 g6 3. g3 Bg7 4. Bg2 O-O *