These are the hard ones:
- r2qkb1r/1b1n1ppp/p2ppn2/1p4B1/3NP3/1BN5/PPP1QPPP/R3K2R w KQkq - acd 30; acs 559; bm f4; cce 94; ce 30; pm O-O-O {46} f3 {5} O-O {2} f4 {2}; pv f4 Qc8 a3 Nc5 Bxf6 gxf6 O-O Bg7 f5 O-O fxe6 fxe6 Qg4; white_wins 26; black_wins 15; draws 11;
r1b2rk1/pp1pqpbp/6p1/1N2p3/2PnP3/4B3/PP1Q1PPP/R3KB1R w KQ - acd 31; acs 84; bm Nc7; cce 104; ce 72; pm O-O-O {29} Bd3 {13} Be2 {13} f3 {12} Rd1 {4} Nc7 {3}; pv Nc7 Rb8 Nd5 Qd8 Bd3 d6 O-O Be6 Bg5 f6 Be3 Nc6 f3 Rc8 b3 Nd4 Rac1 Qd7 Bxd4 exd4 Qf2 Bxd5 cxd5 Rxc1 Rxc1 Rc8 Rd1 a6 Qxd4 f5 Qe3 fxe4 Qxe4 Be5 Re1 Rc3 Rf1; white_wins 32; black_wins 16; draws 20;
r1bq1rk1/1p1n1ppp/p1n1p3/2bpP3/3N1P2/2N1B3/PPPQB1PP/R3K2R w KQ - acd 31; acs 218; bm Rd1; cce 84; ce -2; pm O-O-O {36} O-O {32} Nxc6 {19} a3 {6} Rd1 {2} h4 {1}; pv Rd1 Qc7 Nxc6 bxc6 O-O Bxe3+ Qxe3; white_wins 38; black_wins 23; draws 18;
r1bq1rk1/pp1nb1pp/2p1p3/3p1p2/2PPnB2/2NBPN1P/PPQ2PP1/R3K2R w KQ - acd 31; acs 266; bm O-O; cce 160; ce 82; pm O-O-O {17} g4 {16} O-O {10} Ne5 {8} Rc1 {1}; pv O-O Nb6 b3 Nd7 Na4 Ndf6 Rab1 Nh5 Bh2 Nhf6 Rfd1 Nd7 Bf4 Ndf6 Rbc1 Nd7 Qb2 Re8 Qe2 Ba3 Rb1 Be7 Qc2; white_wins 28; black_wins 10; draws 12;
r1bq1rk1/ppp1n1bp/1n4p1/3Ppp2/2P3P1/2N1BN1P/PP1Q1P2/R3KB1R w KQ - acd 31; acs 535; bm Bh6; cce 242; ce 136; pm O-O-O {54} Bh6 {10} Be2 {4} Ng5 {2} Nh4 {2}; pv Bh6 fxg4 Bxg7; white_wins 45; black_wins 8; draws 15;
r1bqk2r/pp1nbppp/2pp1n2/4p3/3PP3/2N1BP2/PPPQ2PP/R3KBNR w KQkq - acd 31; acs 290; bm Nge2; cce 95; ce 33; pm O-O-O {53} Nge2 {42} g4 {20} Nh3 {6} a4 {3} Bd3 {2}; pv Nge2; white_wins 61; black_wins 34; draws 31;
r2qkb1r/1b1n1pp1/p2ppn1p/1p6/3NP1PP/2N1BP2/PPPQ4/R3KB1R w KQkq - acd 31; acs 563; bm Rh3; cce 137; ce 40; pm O-O-O {97} Rg1 {70} Rh3 {13} Bh3 {7} Bd3 {2} Qg2 {2} Be2 {1} Rh2 {1}; pv Rh3 b4 Nd1; white_wins 104; black_wins 45; draws 42;
r3k2r/pbppnppp/1pn2q2/2b5/2BNPP2/2P1B3/PP4PP/RN1Q1RK1 b kq - acd 31; acs 516; bm O-O; cce 19; ce -41; pm O-O-O {74} O-O {12} Qg6 {7} d5 {2} Bxd4 {1}; pv O-O Qd2 a6 b4 b5; white_wins 35; black_wins 39; draws 21;
rq2kb1r/p2p1ppp/1pb1p3/7n/2P1P3/P1N1B3/1PQ2PPP/R3KB1R w KQkq - acd 31; acs 583; bm g3; cce 108; ce 20; pm O-O-O {90} g3 {31} Be2 {8} Rd1 {3} Qd2 {2} Qd3 {1}; pv g3 Be7 Be2 Nf6; white_wins 62; black_wins 30; draws 40;
r1bqk2r/1p1n1ppp/p1n1p3/2bpP3/3N1P2/2N1B3/PPPQ2PP/R3KB1R w KQkq - acd 32; acs 539; bm Qf2; cce 69; ce 0; pm O-O-O {528} Be2 {59} g3 {30} Nxc6 {16} Nce2 {15} Nb3 {13} h4 {13} Qf2 {10} a3 {9} Rd1 {1}; pv Qf2 Nxd4 Bxd4 Qc7 Be2 b5 Bd3 Bxd4 Qxd4 O-O O-O Bb7 a4 bxa4 Rxa4 Rfb8 Ra3 Bc6 Bxa6 Rxb2 Nxd5 Rxc2 Nxc7 Rxg2+ Kh1 Rd2+ Kg1 Rg2+ Kh1 Rd2+ Kg1 Rg2+; white_wins 235; black_wins 151; draws 158;
r1bqk2r/1p1nbppp/p2ppn2/8/3NP3/2N1BP2/PPPQ2PP/R3KB1R w KQkq - acd 32; acs 78; bm g4; cce 194; ce 70; pm O-O-O {31} g4 {29} Be2 {18} Bc4 {1} Nb3 {1} a3 {1}; pv g4 b5 g5 Nh5 Nc6 Ne5; white_wins 54; black_wins 19; draws 7;
r3kb1r/ppq4p/2p2p2/4nbp1/P1NQ4/2N3P1/1P2PPBP/R3K2R w KQkq - acd 32; acs 541; bm a5; cce 111; ce 0; pm O-O-O {52} Ne3 {29} O-O {12} h4 {8} Nxe5 {5} Ne4 {2} Rd1 {2} a5 {2}; pv a5 a6 Ne3 Bg6 O-O Rd8 Qa4 Bc5 Ne4 Be7 f4 gxf4 gxf4 f5 fxe5 fxe4 Qb3 Qxe5 Kh1 Bg5 Bh3 Bxe3 Qxe3 Rf8 Qb3 Qe7 Qc3 e3 Rxf8+ Qxf8 Qe5+ Qe7 Qh8+ Qf8 Qe5+ Qe7 Qh8+ Qf8 Qe5+; white_wins 35; black_wins 13; draws 40;
rnb1kb1r/2q2pp1/p2ppn1p/1p6/3NP1P1/2N1BP2/PPPQ3P/R3KB1R w KQkq - acd 32; acs 586; bm h4; cce 175; ce 56; pm O-O-O {60} h4 {5} Bg2 {4} Bd3 {1}; pv h4 Nbd7 Rg1 Ne5 g5 hxg5 hxg5 Nh5 f4 b4 Ncb5; white_wins 44; black_wins 18; draws 4;
rnbq1rk1/pp2bppp/3ppn2/8/3NP3/2N1BQ2/PPP2PPP/R3KB1R w KQ - acd 32; acs 338; bm Be2; cce 67; ce 6; pm O-O-O {57} Be2 {29} Bb5 {7} Bd3 {1}; pv Be2 Nc6 Nxc6 bxc6 O-O e5 Qg3 Kh8 Rfd1 Rb8 b3 Qa5 Bg5 Rd8 Bxf6 Bxf6 Bc4 Qc7 Rd3 Qe7 Rad1 g6 a3 Kg7 Re1 Bg5 Qf3 Be6 Bxe6 Qxe6; white_wins 40; black_wins 26; draws 27;
r1b1kb1r/1pqn1ppp/p2ppn2/6B1/4PP2/1NN2Q2/PPP3PP/R3KB1R w KQkq - acd 33; acs 555; bm Bd3; cce 26; ce 0; pm O-O-O {309} Bd3 {107} a4 {62} Be2 {12} Bxf6 {9} f5 {4} g4 {3} Rd1 {2}; pv Bd3 b5 O-O Be7 a3 Bb7 Rae1 O-O Qh3 h6 Bxh6 gxh6 e5 dxe5 Qxh6 e4 Rf3 Bc5+ Kh1 exf3 Qg5+ Kh8 Qh6+ Kg8 Qg5+ Kh8 Qh6+ Kg8; white_wins 198; black_wins 171; draws 101;
r1bq1rk1/pp2bppp/2nppn2/8/2BNP3/2N1B3/PPP1QPPP/R3K2R w KQ - acd 33; acs 222; bm Bb3; cce 33; ce 0; pm O-O-O {1832} Bb3 {320} O-O {178} Rd1 {23} Nxc6 {15} h3 {6} Rg1 {3} f3 {3} Nf3 {2}; pv Bb3 a6 O-O Qc7 Nxc6 bxc6 Bf4 e5; white_wins 951; black_wins 784; draws 495;
r1bqk2r/1p2bppp/p1nppn2/8/3NP3/2N1B3/PPPQBPPP/R3K2R w KQkq - acd 33; acs 403; bm f4; cce 77; ce 39; pm O-O-O {131} f4 {97} Nxc6 {19} O-O {18} g4 {7} f3 {5}; pv f4 e5 Nxc6 bxc6; white_wins 116; black_wins 71; draws 74;
r1bqkb1r/3n1ppp/p2ppn2/8/Np1NP3/4BP2/PPPQ2PP/R3KB1R w KQkq - acd 33; acs 524; bm c4; cce 87; ce 25; pm O-O-O {212} c4 {119} Qxb4 {94} Bc4 {68} Bd3 {50} c3 {40} g4 {36} a3 {26} Nc6 {3} Be2 {2} Rd1 {1}; pv c4 bxc3 Nxc3 Bb7 Rc1; white_wins 315; black_wins 194; draws 107;
r2q1rk1/pp1bbppp/2nppn2/8/3NP3/1BN1B3/PPP1QPPP/R3K2R w KQ - acd 33; acs 446; bm O-O; cce 80; ce 4; pm O-O-O {109} O-O {21} f4 {4} Nxc6 {2} Rd1 {2} f3 {2}; pv O-O a6 f4 b5 a3 Nxd4 Bxd4 Bc6 Rad1 Qc7 f5 e5 Be3 Bd8 Nd5 Bxd5 Bxd5 Rc8 c3 Be7 Qf3 Rfe8 Rd3 Qd7 Rfd1 Qc7 R3d2 Red8 Bb3 Qb7 Bg5 Nxe4; white_wins 66; black_wins 42; draws 25;
r2q1rk1/pp1bppbp/3p1np1/n7/3NP3/1BN1BP2/PPP1Q1PP/R3K2R w KQ - acd 33; acs 90; bm Qf2; cce 145; ce 8; pm O-O-O {47} O-O {6} Qd2 {2} Qd3 {2} h4 {2} g4 {1}; pv Qf2 Re8 O-O Qb8 Rad1 b5 Bg5 Nc4 Rb1 Qb7 Bxc4 bxc4; white_wins 34; black_wins 15; draws 9;
rn2k2r/pp3ppp/2p1pn2/q4b2/1bBP4/2N2N2/PPPBQPPP/R3K2R w KQkq - acd 33; acs 877; bm O-O; cce 56; ce 30; pm O-O-O {1123} Ne5 {415} a3 {406} O-O {167} Bb3 {16} Bd3 {1} d5 {1} h3 {1}; pv O-O O-O a3 Bxc3 Bxc3 Qc7 Nh4 Be4; white_wins 692; black_wins 468; draws 613;
r1bq1rk1/pp1n1ppp/2n1p3/2bpP3/3N1P2/2N1B3/PPPQ2PP/R3KB1R w KQ - acd 34; acs 441; bm Qf2; cce 52; ce 0; pm O-O-O {2449} g3 {171} Be2 {139} Bb5 {37} Rd1 {9} h4 {9} Nxc6 {7} Qf2 {6} a3 {4} Nb3 {3}; pv Qf2 Nxd4 Bxd4 Bxd4 Qxd4 a6 Be2 Nb8 Qf2 Nc6 O-O Qa5 Rad1 Bd7 a3 Rac8 Bd3 Ne7 Bxh7+ Kxh7 Qh4+ Kg8 Qxe7 Qb6+ Rf2 Qxb2 Nxd5 Rxc2 Nf6+ gxf6 Qxf6 Rxf2 Qg5+ Kh7 Qh5+ Kg8 Qg5+ Kh7 Qh5+ Kg8 Qg5+; white_wins 1088; black_wins 778; draws 775;
r1bq1rk1/pp3ppp/4pn2/2b5/8/3B4/PPPBQPPP/R3K1NR w KQ - acd 34; acs 507; bm Nf3; cce 103; ce 0; pm O-O-O {66} Nf3 {9}; pv Nf3 b6 Rd1 Bb7 O-O Qc7 c3 Rad8 Bg5 Bd6 Bxf6 gxf6 Be4 Bc8 Bd3 Bb7 Be4 Bc8 Bd3 Bb7; white_wins 33; black_wins 17; draws 19;
r1bq1rk1/pppn1ppp/4pb2/6B1/3P4/5N2/PPPQ1PPP/R3KB1R w KQ - acd 34; acs 578; bm h4; c1 Permutation; cce 92; ce 15; pm O-O-O {48} Bd3 {7} Bxf6 {4} Bb5 {3} Be2 {3} h4 {3} Bc4 {1} Qe3 {1} Rd1 {1}; pv h4 e5 Bxf6 Qxf6 O-O-O; white_wins 31; black_wins 18; draws 14;
r1bQ2nr/pp3kpp/n1p1pp2/B7/2P1q3/8/PP2BPPP/R3K1NR w KQ - acd 34; acs 471; bm Rd1; cce 37; ce 0; pm O-O-O {65} Nf3 {30} Kf1 {2} Rd1 {2} f3 {1}; pv Rd1 e5 Nf3 b6 Bc3 Nc5 Rd6 Qb1+ Rd1 Qe4 Rd6 Qb1+ Rd1 Qe4; white_wins 25; black_wins 20; draws 15;
r1bqrnk1/pp2bppp/2p2n2/3p2B1/3P4/2NBP2P/PPQ1NPP1/R3K2R w KQ - acd 34; acs 699; bm O-O; cce 125; ce 9; id "Hyatt-Quiet.1641"; pm O-O-O {76} g4 {56} Bf4 {3} O-O {2} Ng3 {1}; pv O-O Nh5 Bxe7 Qxe7 Kh1 g6 Ng1 Ng7 Qa4 Bf5 Be2 Nd7 Nf3 Nf6 Qb3 Ne4 Nxe4 Bxe4 Nd2 Rab8 Nxe4 Qxe4 Bd3 Qe7 Rac1 Ne6 Rfd1 Kg7 Qa4 Qh4 Kg1 Ra8 Qb3 Qe7 a3 a5 Bc2 a4; white_wins 67; black_wins 27; draws 48;
r3k2r/pppqnppp/2nb4/3p4/3P2b1/2PB1N2/PP1N1PPP/R1BQR1K1 b kq - acd 34; acs 588; bm O-O; cce 10; ce -23; pm O-O-O {129} O-O {68} f6 {15} Bf5 {1} Bh5 {1}; pv O-O Nf1 Rfe8 Bd2 f6 a4 Bf5 Be2 Be6 a5 a6 Qb3 Nf5 Bd3 Kh8 Qc2 g6 Qb3 Rab8 h3 Ra8 N3h2 Rab8 Ng4 Qe7 Nge3 Nxe3 Nxe3 Qf7 Ng4; white_wins 75; black_wins 80; draws 60;
rn1qk2r/1p2bpp1/p2pbn2/4p2p/4P3/1NN1BQ1P/PPP2PP1/R3KB1R w KQkq - acd 34; acs 523; bm Bd3; cce 158; ce 46; pm O-O-O {62} Be2 {12} a3 {4} Rd1 {1}; pv Bd3 Nbd7 O-O O-O a4 Rc8 a5 Qc7 Nd2 Qc6 Bg5 Rfe8 Rfd1 Bd8 Nb3 Be7; white_wins 48; black_wins 21; draws 7;
rq2k2r/pb1p1pp1/1p2pn1p/4b3/2P1P3/P1NB2B1/1PQ2PPP/R3K2R w KQkq - acd 34; acs 456; bm Bxe5; cce 103; ce 8; pm O-O-O {29} Qd2 {14} O-O {6} Qe2 {6} Bxe5 {3} Ne2 {2} Kd2 {1} Rc1 {1} Rd1 {1} Rf1 {1} b3 {1}; pv Bxe5 Qxe5 Qd2 d6 f3 O-O O-O Rfd8 Rfd1 Qc5+ Kh1 d5 cxd5 exd5 e5 d4 exf6 dxc3 Qxc3 Qxc3 bxc3 gxf6 Kg1 Rac8 Bb5 Kf8 Kf2 Bd5 Rac1 Be6 Rxd8+ Rxd8 Ke3 Ke7 f4 Rc8 Bd3 Rc5 g3 Ra5 Ra1; white_wins 24; black_wins 11; draws 21;
r1b2rk1/1pq1bppp/p1nppn2/8/3NPP2/1BN1BQ2/PPP3PP/R3K2R w KQ - acd 35; acs 422; bm f5; cce 42; ce 0; pm O-O-O {250} f5 {151} O-O {135} Nxc6 {31} g4 {7} Rg1 {2}; pv f5 Nxd4 Bxd4 e5 Bf2 b5 a3 Bb7 O-O Rac8 Rfe1 Qb8; white_wins 222; black_wins 170; draws 156;
r1bq1rk1/1p2bppp/p1nppn2/8/3NP3/1BN1B3/PPP1QPPP/R3K2R w KQ - acd 35; acs 518; bm f4; cce 35; ce 0; pm O-O-O {1043} f4 {36} Rg1 {25} O-O {11} Nxc6 {9} Rd1 {3} a3 {1} a4 {1}; pv f4 Na5 O-O Qc7 g4 d5 e5 Nxb3 cxb3 Nd7 Rac1 Qd8 Qc2 Qe8 Rf3 b6 Rh3 g6 Nce2 Bb7 Qc7 Rb8 f5 Bd8 Qd6; white_wins 477; black_wins 392; draws 204;
r1bq1rk1/pp1p1ppp/2nQpn2/1N6/4P3/2N5/PPP2PPP/R3KB1R w KQ - acd 35; acs 551; bm Nc7; cce 118; ce 68; pm O-O-O {52} Nc7 {17} Be2 {3} Qg3 {3} Qc7 {2}; pv Nc7 Rb8 Be2 b5 e5 b4 exf6 bxc3 fxg7 Kxg7 Qg3+; white_wins 36; black_wins 16; draws 23;
rn1qkb1r/1b1n1ppp/p2pp3/1p6/3NP1P1/2N1BP2/PPPQ3P/R3KB1R w KQkq - acd 35; acs 3183; bm a4; cce 63; ce 24; pm O-O-O {1424} a3 {161} a4 {87} g5 {73} Qf2 {27} h4 {13} Bd3 {6} Bg2 {3} Bg5 {2} Nb3 {2}; pv a4 b4 Na2 a5 c3 d5 exd5 Bxd5 Bb5 Be7 O-O O-O cxb4 Bxa2 Rxa2 Bxb4 Qe2 Nf6 Raa1 Nd5 Rfd1 Qf6 Rac1 Na6 Bxa6 Nxe3 Qxe3 Rxa6 g5 Qe7 Nc6 Qb7 Qe4 Be7 f4 Re8 Qc4 Bf8 h3; white_wins 889; black_wins 638; draws 252;
rnbq1rk1/p1p2ppp/1p2pb2/8/3PN3/5N2/PPPQ1PPP/R3KB1R w KQ - acd 35; acs 529; bm Nxf6+; cce 60; ce 24; pm O-O-O {521} Nxf6+ {247} c3 {73} Bd3 {44} Bc4 {30} Qe3 {22} Qf4 {8} Be2 {6} Rd1 {1}; pv Nxf6+ Qxf6 Bd3 Bb7 Ng5 g6 Be4 Bxe4 Nxe4 Qf5 f3 Nd7 c4 Rad8 Rd1 Nf6 Ng3 Qa5; white_wins 373; black_wins 252; draws 264;
r1bq1k1r/ppN2ppp/2n1p3/3p4/1b2nB2/2N2Q2/PPP2PPP/R3KB1R w KQ - acd 36; acs 538; bm Nxa8; cce 80; ce 17; pm O-O-O {107} Nxa8 {52} Rd1 {4}; pv Nxa8 e5 Bd2 Nd4 Qd3 Nc5; white_wins 74; black_wins 46; draws 35;
rn1qk2r/4bppp/p2pbn2/1p2p3/4P3/1NN1BP2/PPPQ2PP/R3KB1R w KQkq - acd 36; acs 540; bm a4; cce 118; ce 63; pm O-O-O {27} a4 {25} Nd5 {9} g4 {9} Bd3 {1} Be2 {1}; pv a4 b4; white_wins 31; black_wins 14; draws 19;
r1b1rnk1/pp3ppp/2pq1n2/3p4/3P4/2NBPN1P/PPQ2PP1/R3K2R w KQ - acd 37; acs 3153; bm Rc1; cce 125; ce 50; pm O-O-O {167} O-O {45} g4 {2}; pv Rc1 Qe7 O-O Ng6 Rfd1 Be6 a3 Nd7 Ne2 Nf6 Ng3 a5 Re1 Rac8 Ne2 b6 Nc3 Qd6 Na4 Rb8 Red1 Rec8 Ba6 Re8 Be2 Bd7 Bd3; white_wins 66; black_wins 26; draws 50;
rn1qkb1r/1b2pp1p/p2p1np1/1p6/3NP3/2N1BP2/PPPQ2PP/R3KB1R w KQkq - acd 37; acs 6938; bm a4; cce 117; ce 56; pm O-O-O {26} a4 {18} g4 {6} Bd3 {3} Be2 {2}; pv a4 b4 Nd1 e5 Qxb4 Qc7 Nb3 d5 Qa5 Qxa5+ Nxa5 Bb4+ Bd2 Bxa5 Bxa5 dxe4 fxe4 Bxe4 c4 Nc6; white_wins 19; black_wins 5; draws 29;
2kr1b1r/pppb1ppp/2n5/3p4/3P1B2/2PB4/PP3PPP/R3K1NR w KQ - acd 40; acs 7189; bm h4; cce 77; ce 32; pm O-O-O {40} Kd2 {14} Nf3 {13} Ne2 {3}; pv h4 Ne7 Nf3 f6 h5 Bf5 Kd2 Bxd3 Kxd3 Nf5 g4 Bd6 Bd2 Ne7 Rae1 Rdf8 Bf4 Bxf4 Rxe7 Kd8 Rhe1 Rhg8 Nh4 Bd6 R7e3 g6 Rh3 Kd7 Ng2 gxh5 Rxh5 f5 Rxh7+ Kc6 g5 Rxg5 Nh4 f4 Re6 Rfg8 Nf3 Rg2; white_wins 24; black_wins 12; draws 33;
My engines have not solved them yet.
For each of the positions in the test set, the move most frequently played was the long castle. The actual outcome in games was better for the players/engines that performed long castle than the centipawn evaluation estimate for the supposedly best moves chosen by the computers.
Several of the positions are not very good, because the castle move does not have to be made immediately. Rather, the long castle can be delayed for two or three moves and you will see it later in the pv. I should probably remove all of these positions from the set.
All of them will give some engines problems to solve them and many of them take more than ten minutes. For each position in the set, at least one very strong engine did not solve it in 27 plies or more.
There are probably also a few where an alternative is actually better, and I am still analyzing this test set to know for sure.
On the down side, it's not much fun for a human player for two reasons:
1. The long castle moves are really obvious (most humans would consider long castling immediately for all of these positions)
2. Since every answer is the same, we don't wonder if our guess is right.
For those reasons, it's really a "computer-only" test.