Page 1 of 5

New Rating List

Posted: Tue Jul 06, 2010 6:28 am
by gaard
A) All matches are done with a test suite, with colors reversed. No opening books are used.

B) For designing the suite I took 30 recent, pseudo-random, high level games from my TWIC database. I wanted the suite to be representative of chess as it is played by OTB high level players, and not necessarily the entirety of chess theory. I have only looked at the positions to ensure that there are no doubles. Barring that I have done little else with them to preclude introducing a bias.

C) For all moves, engines use a constant time of 4" per move. 4" is somewhat arbitrary but it is comparable to CCRL's 40/4 time limit, when you compare average move time and accounting for hardware.

D) Ponder is off.

E) All engines have access to 3-4 Scorpio BitBases, 3-4-5 Nalimov EGTBs, fast 3-4-5 ShredderBases, and 3-4-5 TripleBases, where applicable.

D) My aim will be to test only top engines, with a few exceptions.


My intention was to create a rating list that gives you a better idea of how a particular engine might fare for analysis. Which means no specially tailored books, ponder, or time management. Games are currently running with plenty more to be played. What I have so far:

Code: Select all

Rank Name                    Elo    +    - games score oppo. draws 
   1 IvanHoe 9.57a           132   23   22   601   70%   -14   37% 
   2 Houdini 1.02            130   23   22   598   69%   -13   36% 
   3 Deep Rybka 4            128   23   22   601   69%   -13   36% 
   4 Stockfish 1.8            73   29   29   337   61%    -7   39% 
   5 Stockfish 1.7.1          64   24   24   480   59%    -6   40% 
   6 Komodo 1.2               58   31   31   287   59%    -7   45% 
   7 Naum 4.2                 13   22   21   599   51%    -2   40% 
   8 Shredder 12 32-bit      -24   22   22   599   46%     2   32% 
   9 Spark 0.4               -83   22   23   601   37%     8   32% 
  10 Zappa Mexico II         -97   22   23   600   35%    10   34% 
  11 Toga II 1.4b5c 32-bit  -145   30   31   341   31%    -5   33% 
  12 Scorpio 2.6            -248   26   27   600   17%    25   21% 
All 64-bit engines, unless otherwise noted. Games will be posted when current matches are finished.

Shredder - Opening Advice Off, Position Learning Off
IvanHoe - 128MB PawnHash, 32MB PVHash

Re: New Rating List

Posted: Tue Jul 06, 2010 7:16 am
by notyetagm
Wow, the triumvirate of IvanHoe, Houdini, and Rybka 4 are much stronger than any other engine.

Re: New Rating List

Posted: Tue Jul 06, 2010 7:30 am
by gaard
notyetagm wrote:Wow, the triumvirate of IvanHoe, Houdini, and Rybka 4 are much stronger than any other engine.

They are definitely the ones to beat right now. Stockfish and Komodo are not far behind, however.

Komodo really stands out to me. At CCRL and CEGT too I think, it is ~150 Elo behind Rybka 4 and ~80 behind Stockfish. Strange then that on my rating list it is only 70 ELo behind Rybka 4 and 6 behind Stockfish. All the more amazing to me with it being very weak tactically. More games will provide a clearer picture...

Re: New Rating List

Posted: Tue Jul 06, 2010 10:33 am
by Stefan
Interesting. I tested at 32 Bit, single core, without EGTB at timecontrol 1/4'+1/4'', 200 fixed opening positions

Program Elo + - Games Score Av.Op. Draws

1 Houdini_w32_1CPU : 2507 45 44 128 59.0 % 2444 46.1 %
2 IvanHoe999957a : 2463 22 22 400 52.8 % 2444 57.5 %
3 IvanHoe999963 : 2444 11 11 2128 56.8 % 2397 44.8 %
4 FireBird_12_w32_no_SSE2 : 2397 15 15 1200 52.5 % 2380 41.6 %
5 Fire_13_w32_NS_no_SSE2 : 2393 25 25 400 42.6 % 2444 45.8 %
6 Stockfish-171-32-ja : 2351 16 16 1200 43.6 % 2395 32.8 %
7 Rybka 3 1-cpu w32 : 2344 15 15 1200 42.3 % 2397 39.7 %

Re: New Rating List

Posted: Tue Jul 06, 2010 10:57 am
by Stefan
You see the difference between Ivanhoe and Stockfish is much larger in my test. Possible reasons are:
-The difference becomes smaller with slower games like in your list
-time management is better in Ivanhoe than in Stockfish
-Ivanhoe is better 32 Bit optimized than Stockfish
-EGTB hurts Ivanhoe's performance!

Re: New Rating List

Posted: Tue Jul 06, 2010 11:14 am
by gaard
Stefan wrote:You see the difference between Ivanhoe and Stockfish is much larger in my test. Possible reasons are:
-The difference becomes smaller with slower games like in your list
-time management is better in Ivanhoe than in Stockfish
-Ivanhoe is better 32 Bit optimized than Stockfish
-EGTB hurts Ivanhoe's performance!
Do I understand it right that your games are 15"+250ms? You are right that faster time controls will favor IvanHoe over Stockfish. I can tell you that TripleBases do not hinder IvanHoe's performance in my tests, but they don't seem to help much either. Over 1200 games TripleBases yielded 2 Elo more than without.

Re: New Rating List

Posted: Tue Jul 06, 2010 2:52 pm
by Stefan
gaard wrote: Do I understand it right that your games are 15"+250ms?
Yes, right.

Re: New Rating List

Posted: Tue Jul 06, 2010 4:54 pm
by gaard
gaard wrote:
notyetagm wrote:Wow, the triumvirate of IvanHoe, Houdini, and Rybka 4 are much stronger than any other engine.

They are definitely the ones to beat right now. Stockfish and Komodo are not far behind, however.

Komodo really stands out to me. At CCRL and CEGT too I think, it is ~150 Elo behind Rybka 4 and ~80 behind Stockfish. Strange then that on my rating list it is only 70 ELo behind Rybka 4 and 6 behind Stockfish. All the more amazing to me with it being very weak tactically. More games will provide a clearer picture...
Removed Komodo 1.2 from the rating list. Not only was it crashing, it was not adhering to the allowed move time of 4". In some positions it was analyzing up to 16" which would explain why it was performing much better than expected.

Re: New Rating List

Posted: Wed Jul 07, 2010 4:08 am
by gaard
Finished testing Stockfish for an improvement of 16 Elo.

Code: Select all

Rank Name                      Elo    +    - games score oppo. draws 
   1 IvanHoe 9.57a             139   23   22   600   70%   -14   37% 
   2 Houdini 1.02              138   23   22   600   70%   -14   36% 
   3 Rybka 4                   132   23   22   600   69%   -13   36% 
   4 Stockfish 1.8              85   23   23   540   63%   -17   37% 
   5 Stockfish 1.7.1            69   24   24   480   59%    -2   40% 
   6 Naum 4.2                   19   22   21   600   52%    -2   38% 
   7 Shredder 12 32-bit        -21   22   22   600   47%     2   31% 
   8 Spark 0.4                 -78   22   23   600   38%     8   31% 
   9 Zappa Mexico II           -97   22   23   600   35%    10   33% 
  10 Toga II 1.4b5c 32-bit    -141   24   25   540   30%     8   31% 
  11 Scorpio 2.6              -244   26   27   600   17%    24   22% 
games @ http://www.mediafire.com/?zuj3akjzmtd

Re: New Rating List

Posted: Wed Jul 07, 2010 4:51 am
by gaard
gaard wrote:Finished testing Stockfish for an improvement of 16 Elo.

Code: Select all

Rank Name                      Elo    +    - games score oppo. draws 
   1 IvanHoe 9.57a             139   23   22   600   70%   -14   37% 
   2 Houdini 1.02              138   23   22   600   70%   -14   36% 
   3 Rybka 4                   132   23   22   600   69%   -13   36% 
   4 Stockfish 1.8              85   23   23   540   63%   -17   37% 
   5 Stockfish 1.7.1            69   24   24   480   59%    -2   40% 
   6 Naum 4.2                   19   22   21   600   52%    -2   38% 
   7 Shredder 12 32-bit        -21   22   22   600   47%     2   31% 
   8 Spark 0.4                 -78   22   23   600   38%     8   31% 
   9 Zappa Mexico II           -97   22   23   600   35%    10   33% 
  10 Toga II 1.4b5c 32-bit    -141   24   25   540   30%     8   31% 
  11 Scorpio 2.6              -244   26   27   600   17%    24   22% 
games @ http://www.mediafire.com/?zuj3akjzmtd
My latest suite... please feel free to pick it apart and let me know if anything looks unusual. Again, I have only gone so far as to ensure there are no doubles, but I haven't looked much at possible transposition.

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D78"]
[Opening "Neo-Grünfeld, 6.O-O c6 7.b3 Bf5"]
[PlyCount "18"]
[Termination "normal"]

1. Nf3 Nf6 2. c4 g6 3. g3 Bg7 4. Bg2 c6 5. O-O d5 6. b3 Ne4 7. d4 O-O 8.
Bb2 Bf5 9. e3 Nd7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D19"]
[Opening "Slav"]
[Variation "Dutch, 8...O-O 9.Qe2 Nbd7 10.e4 Bg6 11.Bd3 Bh5 12.e5"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 c6 3. Nf3 Nf6 4. Nc3 Bf5 5. a4 dxc4 6. e3 e6 7. Bxc4 Bb4 8.
O-O O-O 9. Qe2 Nbd7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A36"]
[Opening "English"]
[Variation "Symmetrical, Botvinnik System, 5...d6, 7.O-O O-O"]
[PlyCount "18"]
[Termination "normal"]

1. e4 c5 2. Nc3 a6 3. Nge2 d6 4. g3 g6 5. d4 cxd4 6. Nxd4 Bg7 7. Bg2 Nf6 8.
O-O O-O 9. h3 Nc6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B12"]
[Opening "Caro-Kann"]
[Variation "Advance, 4.Nf3 e6 5.Be2 c5 6.Be3 Nd7 7.O-O"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c6 2. d4 d5 3. e5 Bf5 4. Nf3 e6 5. Be2 Nd7 6. O-O Bg6 7. Nbd2 Ne7 8.
Nh4 c5 9. c3 Nc6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B44"]
[Opening "Sicilian"]
[Variation "Taimanov, Szen, Hedgehog, 11.Be3 Bb7 12.Qb3"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 e6 3. d4 cxd4 4. Nxd4 Nc6 5. Nb5 d6 6. c4 Nf6 7. N1c3 a6 8.
Na3 b6 9. Be2 Bb7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D45"]
[Opening "Semi-Slav"]
[Variation "Stonewall Defence"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 c6 3. Nc3 Nf6 4. e3 a6 5. Qc2 e6 6. Nf3 c5 7. a3 Nc6 8. dxc5
Bxc5 9. b4 Bd6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C45"]
[Opening "Scotch"]
[Variation "4.Nxd4 Bc5 5.Nxc6 Qf6 6.Qd2"]
[Termination "normal"]
[PlyCount "18"]

1. e4 e5 2. Nf3 Nc6 3. d4 exd4 4. Nxd4 Bc5 5. Nxc6 Qf6 6. Qf3 bxc6 7. Nd2
d6 8. Nb3 Bb6 9. Bd2 Qxf3 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E37"]
[Opening "Nimzo-Indian"]
[Variation "Classical, Noa, San Remo Variation"]
[Termination "normal"]
[PlyCount "18"]

1. d4 e6 2. c4 Nf6 3. Nc3 Bb4 4. Qc2 d5 5. a3 Bxc3+ 6. Qxc3 Ne4 7. Qc2 c5
8. dxc5 Nc6 9. e3 Qa5+ *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B14"]
[Opening "Caro-Kann"]
[Variation "Panov-Botvinnik, 5...e6 6.Nf3 Bb4 7.cxd5 Nxd5 8.Bd2 Nc6 9.Bd3 O-O"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c6 2. d4 d5 3. exd5 cxd5 4. c4 Nf6 5. Nc3 e6 6. Nf3 Bb4 7. cxd5 Nxd5
8. Bd2 Nc6 9. Bd3 O-O *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D12"]
[Opening "Slav"]
[Variation "4.e3 Bf5 5.Nc3 e6 6.Nh4 Be4"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 c6 3. Nf3 Nf6 4. e3 Bf5 5. Nc3 e6 6. Nh4 Be4 7. f3 Bg6 8.
Qb3 Qc7 9. Bd2 Nbd7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C55"]
[Opening "Two Knights"]
[Variation "4.d3 Be7 5.O-O O-O 6.Re1"]
[Termination "normal"]
[PlyCount "18"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Nf6 4. d3 Be7 5. O-O O-O 6. Re1 d6 7. c3 Na5 8.
Bb5 a6 9. Ba4 b5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E58"]
[Opening "Nimzo-Indian"]
[Variation "Main Line, 9.bxc3 Qc7 10.cxd5 exd5 11.a4 Re8"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. Nc3 Bb4 4. e3 O-O 5. Bd3 d5 6. Nf3 c5 7. O-O Nc6 8.
a3 Bxc3 9. bxc3 Qc7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C44"]
[Opening "Scotch"]
[Variation "Goring Gambit, 4...dxc3 5.Nxc3"]
[Termination "normal"]
[PlyCount "18"]

1. e4 e5 2. Nf3 Nc6 3. Bb5 Bc5 4. c3 Nge7 5. d4 exd4 6. cxd4 Bb4+ 7. Bd2
Bxd2+ 8. Qxd2 a6 9. Ba4 d5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D27"]
[Opening "QGA"]
[Variation "Classical, Spassky, 7...Qxd1"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 dxc4 3. Nf3 e6 4. e3 c5 5. Bxc4 a6 6. O-O Nf6 7. Bb3 Be7 8.
dxc5 Qxd1 9. Bxd1 Bxc5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E18"]
[Opening "Queen's Indian"]
[Variation "7.Nc3 d5 8.cxd5 exd5"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. g3 d5 4. cxd5 exd5 5. Nc3 Be7 6. Bg2 O-O 7. Bg5 c6 8.
Nf3 Nbd7 9. O-O Re8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B08"]
[Opening "Pirc"]
[Variation "Classical, 5.Be2 O-O 6.O-O Bg4 7.Be3 Nc6 8.Qd2 e5"]
[Termination "normal"]
[PlyCount "18"]

1. e4 d6 2. d4 Nf6 3. Nc3 g6 4. Be2 Bg7 5. Nf3 O-O 6. O-O Bg4 7. Be3 Nc6 8.
Qd2 e5 9. dxe5 dxe5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A07"]
[Opening "Reti Opening"]
[Variation "KIA, Petrosian Variation"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c6 2. d4 d5 3. Nd2 dxe4 4. Nxe4 Bf5 5. Nc5 Qc7 6. Nf3 e6 7. Nd3 Nf6
8. g3 Nbd7 9. Bg2 Bd6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C00"]
[Opening "French"]
[Variation "KIA, Reversed Philidor, 4...b6"]
[Termination "normal"]
[PlyCount "18"]

1. Nf3 Nf6 2. g3 d5 3. Bg2 e6 4. O-O Be7 5. d3 b6 6. Nbd2 Bb7 7. b3 O-O 8.
Bb2 Nbd7 9. Re1 c5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A90"]
[Opening "Dutch"]
[Variation "2.c4 Nf6 3.g3 e6 4.Bg2 d5 5.Nh3"]
[Termination "normal"]
[PlyCount "18"]

1. d4 f5 2. g3 Nf6 3. Bg2 e6 4. c4 d5 5. Nh3 c6 6. O-O Bd6 7. b3 Qe7 8. Bf4
O-O 9. Nd2 Nbd7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B19"]
[Opening "Caro-Kann"]
[Variation "Classical, Spassky, 10.Qxd3 e6 11.Bf4"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c6 2. d4 d5 3. Nc3 dxe4 4. Nxe4 Bf5 5. Ng3 Bg6 6. h4 h6 7. Nf3 Nd7 8.
h5 Bh7 9. Bd3 Bxd3 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D94"]
[Opening "Grünfeld"]
[Variation "Slav/Schlecter, 6.Be2 O-O 7.O-O"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 c6 3. Nc3 Nf6 4. e3 g6 5. Nf3 Bg7 6. Be2 O-O 7. O-O a6 8. a4
a5 9. Qb3 Na6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A08"]
[Opening "Reti Opening"]
[Variation "KIA, French, 3...Nc6 4.O-O e6 5.d3 Nf6 6.Nbd2 g6 7.e4 Bg7"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 e6 3. d3 d5 4. Nbd2 Nc6 5. g3 Nf6 6. Bg2 g6 7. O-O Bg7 8.
Re1 O-O 9. c3 dxe4 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A62"]
[Opening "Benoni"]
[Variation "Fianchetto Variation, 9.O-O Na6 10.Nd2 Nc7"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 c5 3. d5 e6 4. Nc3 exd5 5. cxd5 d6 6. Nf3 g6 7. g3 Bg7 8.
Bg2 O-O 9. O-O Re8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C54"]
[Opening "Giuoco Pianissimo"]
[Variation "5.d3 d6 6.O-O O-O"]
[Termination "normal"]
[PlyCount "18"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Nf6 4. d3 Bc5 5. c3 Bb6 6. Bb3 d6 7. Nbd2 O-O 8.
Nc4 Ne7 9. h3 Ng6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D20"]
[Opening "QGA"]
[Variation "3.e4 Nf6 4.e5 Nd5 5.Bxc4 Nb6 6.Bb3 Nc6 7.Ne2"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 dxc4 3. e4 Nf6 4. e5 Nd5 5. Bxc4 Nb6 6. Bb3 Nc6 7. Ne2 Bg4
8. f3 Bf5 9. Nbc3 e6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B52"]
[Opening "Sicilian"]
[Variation "Bronstein Gambit, 3.Bb5+ Bd7 4.Bxd7+ Qxd7 5.O-O Nc6 6.c3 Nf6 7.d4"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 d6 3. Bb5+ Bd7 4. Bxd7+ Qxd7 5. O-O Nf6 6. Qe2 Nc6 7. c3 e6
8. d4 cxd4 9. cxd4 d5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D46"]
[Opening "Semi-Slav"]
[Variation "6.Bd3 a6"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 c6 3. Nc3 Nf6 4. e3 a6 5. Qc2 g6 6. Bd3 Bg7 7. Nf3 Bg4 8.
Qb3 Ra7 9. Ne5 Be6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E18"]
[Opening "Queen's Indian"]
[Variation "7.Nc3 Ne4 8.Nxe4 Bxe4 9.Ne1 Bxg2 10.Nxg2 d5 11.Qa4 dxc4"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. Nf3 b6 4. g3 Bb7 5. Bg2 Be7 6. O-O O-O 7. Nc3 Ne4 8.
Nxe4 Bxe4 9. Ne1 Bxg2 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B12"]
[Opening "Caro-Kann"]
[Variation "Advance, 4.Nf3 e6 5.Be2 c5 6.O-O Ne7"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c6 2. d4 d5 3. e5 Bf5 4. Nf3 e6 5. Be2 c5 6. Be3 cxd4 7. Nxd4 Ne7 8.
Bg5 Qd7 9. Bxe7 Bxe7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B36"]
[Opening "Sicilian"]
[Variation "Maroczy Bind, 5...d6 6.Nc3 Bg7"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 Nc6 3. Bb5 g6 4. Bxc6 bxc6 5. O-O Bg7 6. Re1 Nf6 7. e5 Nd5
8. c4 Nc7 9. d4 cxd4 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E04"]
[Opening "Catalan"]
[Variation "Open, 5.Nf3 c5 6.O-O Nc6"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. g3 d5 4. Bg2 dxc4 5. Nf3 c5 6. O-O Nc6 7. dxc5 Qxd1
8. Rxd1 Bxc5 9. Nbd2 c3 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E20"]
[Opening "Nimzo-Indian"]
[Variation "Romanishin, 6.Nxd4 O-O 7.Bg2"]
[Termination "normal"]
[PlyCount "18"]

1. d4 e6 2. Nf3 c5 3. c4 cxd4 4. Nxd4 Nf6 5. g3 Nc6 6. Bg2 Bb4+ 7. Nc3 O-O
8. O-O Qe7 9. Na4 Rd8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A29"]
[Opening "English"]
[Variation "Four Knights, Main Line 6.O-O e4"]
[Termination "normal"]
[PlyCount "18"]

1. c4 e5 2. Nc3 Nf6 3. Nf3 Nc6 4. g3 Bb4 5. Nd5 a5 6. Nxb4 axb4 7. d4 e4 8.
d5 exf3 9. dxc6 bxc6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D31"]
[Opening "Semi-Slav"]
[Variation "Noteboom, Abrahams, Main Line, 14.O-O O-O"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. c4 e6 3. Nc3 c6 4. Nf3 dxc4 5. e3 b5 6. a4 Bb4 7. Bd2 a5 8.
axb5 Bxc3 9. Bxc3 cxb5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D43"]
[Opening "Semi-Slav"]
[Variation "Moscow, 6.Bh4 Gambit, Main Line, 9...Bb7"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. Nf3 d5 4. Nc3 c6 5. Bg5 h6 6. Bh4 dxc4 7. e4 g5 8.
Bg3 b5 9. Be2 Bb7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E11"]
[Opening "Bogo-Indian"]
[Variation "4.Bd2 Be7 5.g3 d5 6.Bg2 O-O 7.O-O c6 8.Qc2"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. g3 d5 4. Nf3 Bb4+ 5. Bd2 Be7 6. Bg2 O-O 7. O-O c6 8.
Qc2 Nbd7 9. Bf4 a5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A08"]
[Opening "Reti Opening"]
[Variation "KIA, French, 3...Nc6 4.O-O e6 5.d3 Nf6 6.Nbd2 Be7 7.e4 O-O 8.Re1"]
[Termination "normal"]
[PlyCount "18"]

1. Nf3 Nf6 2. g3 b6 3. Bg2 Bb7 4. O-O e6 5. d3 d5 6. Nbd2 Be7 7. e4 dxe4 8.
dxe4 O-O 9. Qe2 c5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B42"]
[Opening "Sicilian"]
[Variation "Kan, 5.Bd3 Nf6 6.O-O Qc7 7.Qe2"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nc3 e6 3. Nf3 a6 4. d4 cxd4 5. Nxd4 Qc7 6. Bd3 Nf6 7. Qe2 d6 8.
f4 Nbd7 9. g4 Nc5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D45"]
[Opening "Semi-Slav"]
[Variation "6.Qc2 Bd6 7.g4 h6"]
[Termination "normal"]
[PlyCount "18"]

1. c4 c6 2. Nf3 d5 3. e3 Nf6 4. Nc3 e6 5. d4 Nbd7 6. Qc2 Bd6 7. g4 h6 8. h3
e5 9. Bd2 O-O *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B23"]
[Opening "Sicilian"]
[Variation "Closed, Grand Prix, 3...g6 4.Nf3 Bg7 5.Bb5 Nd4 6.O-O"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 Nc6 3. Nc3 d6 4. b3 g6 5. Bb2 Bg7 6. Bb5 e5 7. Bc4 Nf6 8.
O-O O-O 9. d3 a6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D17"]
[Opening "Slav"]
[Variation "Central, Carlsbad, Main Line"]
[Termination "normal"]
[PlyCount "18"]

1. Nf3 Nf6 2. c4 c6 3. d4 d5 4. Nc3 dxc4 5. a4 Bf5 6. Ne5 Nbd7 7. Nxc4 Qc7
8. g3 e5 9. dxe5 Nxe5 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A77"]
[Opening "Benoni"]
[Variation "Classical, Main Line, 10.Nd2 Nbd7 11.a4 a6 12.Ra3"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. Nf3 c5 4. d5 d6 5. Nc3 exd5 6. cxd5 g6 7. Nd2 Bg7 8.
e4 O-O 9. Be2 Re8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B80"]
[Opening "Sicilian"]
[Variation "Scheveningen, Fianchetto Variation, 6.g3 Nc6 7.Bg2 a6"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 e6 3. d4 cxd4 4. Nxd4 a6 5. c4 Nf6 6. Nc3 Bb4 7. Qf3 Bxc3+
8. bxc3 d6 9. Ba3 O-O *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A29"]
[Opening "English"]
[Variation "Four Knights, Main Line 6.O-O"]
[Termination "normal"]
[PlyCount "18"]

1. c4 Nf6 2. Nc3 e5 3. Nf3 Nc6 4. g3 Nd4 5. Bg2 Nxf3+ 6. Bxf3 Bb4 7. Qb3
Bc5 8. d3 h6 9. O-O O-O *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A77"]
[Opening "Benoni"]
[Variation "Classical, Main Line, 10.Nd2 Nbd7 11.a4 Ne5 12.Re1"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 e6 3. Nf3 c5 4. d5 d6 5. Nc3 exd5 6. cxd5 g6 7. Nd2 Bg7 8.
e4 O-O 9. Be2 Re8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D85"]
[Opening "Grünfeld"]
[Variation "Modern Exchange, 8.Be2 O-O 9.O-O Nc6"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 g6 3. Nc3 d5 4. cxd5 Nxd5 5. e4 Nxc3 6. bxc3 Bg7 7. Be3 c5
8. Qd2 cxd4 9. cxd4 Nc6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B19"]
[Opening "Caro-Kann"]
[Variation "Classical, Spassky, Main Line, 13.Ne4"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c6 2. d4 d5 3. Nc3 dxe4 4. Nxe4 Bf5 5. Ng3 Bg6 6. h4 h6 7. Nf3 Nd7 8.
h5 Bh7 9. Bd3 Bxd3 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B85"]
[Opening "Sicilian"]
[Variation "Scheveningen, Classical, Main Line, 9...Nc6 10.a4 Qc7 11.Kh1"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 e6 3. d4 cxd4 4. Nxd4 a6 5. Nc3 Qc7 6. Be2 Nf6 7. O-O Be7
8. f4 d6 9. a4 Nc6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D32"]
[Opening "QGD Tarrasch"]
[Variation "5.Nf3 Nc6 6.e3 Nf6 7.Be2 cxd4 8.Nxd4 Bd6 9.O-O O-O"]
[Termination "normal"]
[PlyCount "18"]

1. Nf3 c5 2. c4 Nc6 3. d4 cxd4 4. Nxd4 Nf6 5. Nc3 e6 6. e3 d5 7. cxd5 exd5
8. Be2 Bd6 9. O-O O-O *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C54"]
[Opening "Giuoco Pianissimo"]
[Variation "5.d3 a6"]
[Termination "normal"]
[PlyCount "18"]

1. e4 e5 2. Nf3 Nc6 3. Bc4 Bc5 4. c3 Nf6 5. d3 O-O 6. O-O d5 7. exd5 Nxd5
8. Re1 Bg4 9. Nbd2 Nb6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "A55"]
[Opening "Old Indian"]
[Variation "5.e4 Be7 6.g3 c6 7.Bg2 O-O 8.O-O a6 9.a4"]
[Termination "normal"]
[PlyCount "18"]

1. e4 e5 2. Nf3 d6 3. d4 Nf6 4. Nc3 Nbd7 5. g3 Be7 6. Bg2 c6 7. O-O O-O 8.
a4 b6 9. b3 Re8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C05"]
[Opening "French"]
[Variation "Tarrasch, Closed, 5.f4 c5 6.c3 Nc6 7.Ndf3 cxd4"]
[Termination "normal"]
[PlyCount "18"]

1. e4 b6 2. d4 Bb7 3. Bd3 e6 4. Nf3 Nf6 5. Qe2 d5 6. e5 Nfd7 7. c3 c5 8.
O-O Qc8 9. Be3 Ba6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C15"]
[Opening "French"]
[Variation "Winawer, 4.Bd3 dxe4 5.Bxe4 Nf6"]
[Termination "normal"]
[PlyCount "18"]

1. e4 b6 2. d4 Bb7 3. Nc3 e6 4. f4 Bb4 5. Bd3 Nf6 6. Qe2 d5 7. e5 Ne4 8.
Bd2 Bxc3 9. bxc3 O-O *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E69"]
[Opening "King's Indian"]
[Variation "Fianchetto, Classical, 9.h3 Re8 10.Be3"]
[Termination "normal"]
[PlyCount "18"]

1. d4 Nf6 2. c4 g6 3. g3 Bg7 4. Bg2 O-O 5. Nc3 d6 6. Nf3 Nbd7 7. O-O e5 8.
e4 a6 9. Re1 Rb8 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B01"]
[Opening "Scandinavian"]
[Variation "Marshall, 4.Nf3 g6 5.Be2 Bg7"]
[Termination "normal"]
[PlyCount "18"]

1. e4 d5 2. exd5 Qxd5 3. Nc3 Qd6 4. d4 Nf6 5. Nf3 c6 6. Ne5 Nbd7 7. Nc4 Qc7
8. Qf3 Nb6 9. Bf4 Qd7 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B30"]
[Opening "Sicilian"]
[Variation "2...Nc6 3.g3 e6 4.d3"]
[Termination "normal"]
[PlyCount "18"]

1. b3 b6 2. Bb2 Bb7 3. Nf3 Nf6 4. g3 e6 5. Bg2 c5 6. O-O Be7 7. d3 O-O 8.
e4 d6 9. Qe2 Nc6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "C41"]
[Opening "Philidor"]
[Variation "Improved Hanham, Sozin Variation"]
[Termination "normal"]
[PlyCount "18"]

1. e4 d6 2. d4 Nf6 3. Nc3 e5 4. Nf3 Nbd7 5. Bc4 Be7 6. O-O O-O 7. Re1 a6 8.
a4 b6 9. Ba2 c6 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "E49"]
[Opening "Nimzo-Indian"]
[Variation "Botvinnik, 7...c5 8.cxd5 exd5"]
[Termination "normal"]
[PlyCount "18"]

1. Nf3 Nf6 2. d4 d5 3. c4 e6 4. Nc3 Bb4 5. cxd5 exd5 6. Bg5 Nbd7 7. e3 c5
8. Qc2 Qa5 9. Bd3 c4 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "D52"]
[Opening "QGD"]
[Variation "Cambridge Springs, Bogoljubow Variation"]
[Termination "normal"]
[PlyCount "18"]

1. d4 d5 2. Nf3 Nf6 3. c4 e6 4. Nc3 Bb4 5. Bg5 Nbd7 6. cxd5 exd5 7. Rc1 c6
8. e3 Qa5 9. Qb3 Ne4 *

[Event "?"]
[Site "?"]
[Date "?"]
[Round "?"]
[White "?"]
[Black "?"]
[Result "*"]
[ECO "B42"]
[Opening "Sicilian"]
[Variation "Kan, 5.Bd3 Nf6 6.c4"]
[Termination "normal"]
[PlyCount "18"]

1. e4 c5 2. Nf3 Nc6 3. d4 cxd4 4. Nxd4 Qb6 5. Be3 Qxb2 6. Nb3 Nf6 7. Bd3 d5
8. Bc1 Qe5 9. f4 Qc7 *