Page 1 of 1

32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 4:57 am
by Adam Hair
1' + 1" time control
2.8 GHz Pentium IV
Windows XP 32-bit
Arena 2.01
50 Silver Positions
256 MB hash
Bayeselo ( covariance command )

Stockfish 1.7.1 included in tournament for reference.

Code: Select all

Rank Name                           Elo    +    - games score oppo. draws 
   1 Houdini_1.01_w32_1CPU           39   16   16  1000   58%    -6   52% 
   2 Tankist 1.7 32-bit              21   15   15  1100   54%    -2   56% 
   3 Houdini_w32_1CPU                18   15   15  1000   54%    -6   53% 
   4 RobboLito_009_w32               12   15   15  1100   52%    -1   55% 
   5 IvanHoe_v81a_w32_bs              9   14   14  1100   52%    -1   58% 
   6 Igorrit0.086v6w32SSE2timefix    -2   15   15  1100   50%     0   48% 
   7 Fire_12_w32                     -5   16   16  1000   49%     1   52% 
   8 Fire_131_w32_KLO                -6   16   16  1000   49%     1   50% 
   9 DamirsRybkaKiller30             -7   15   15  1100   49%     1   52% 
  10 Ippolit0080c_w32_bs            -10   15   15  1100   48%     1   51% 
  11 MishasSwooper06                -23   15   15  1100   46%     2   45% 
  12 Stockfish-171-32-ja            -46   16   16  1100   42%     4   37% 

Code: Select all

LOS                           Ho Ta Ho Ro Iv Ig Fi Fi Da Ip Mi St
Houdini_1.01_w32_1CPU            94 95 99 99 99 99 99 99 99 99 99
Tankist 1.7 32-bit             5    60 80 85 97 98 99 99 99 99 99
Houdini_w32_1CPU               4 39    70 77 95 97 98 98 99 99 99
RobboLito_009_w32              0 19 29    58 88 93 94 95 97 99 99
IvanHoe_v81a_w32_bs            0 14 22 41    84 89 91 93 96 99 99
Igorrit0.086v6w32SSE2timefix   0  2  4 11 15    61 65 70 77 97 99
Fire_12_w32                    0  1  2  6 10 38    54 58 67 94 99
Fire_131_w32_KLO               0  0  1  5  8 34 45    54 63 92 99
DamirsRybkaKiller30            0  0  1  4  6 29 41 45    59 91 99
Ippolit0080c_w32_bs            0  0  0  2  3 22 32 36 40    87 99
MishasSwooper06                0  0  0  0  0  2  5  7  8 12    97
Stockfish-171-32-ja            0  0  0  0  0  0  0  0  0  0  2   

Code: Select all

Individual statistics:

1 Houdini_1.01_w32_1CPU       :1000 (+316,=519,-165), 57.5 %

IvanHoe_v81a_w32_bs           : 100 (+ 27,= 59,- 14), 56.5 %
Fire_131_w32_KLO              : 100 (+ 38,= 51,- 11), 63.5 %
Tankist 1.7 32-bit            : 100 (+ 18,= 55,- 27), 45.5 %
Fire_12_w32                   : 100 (+ 33,= 52,- 15), 59.0 %
DamirsRybkaKiller30           : 100 (+ 36,= 52,- 12), 62.0 %
MishasSwooper06               : 100 (+ 32,= 52,- 16), 58.0 %
Ippolit0080c_w32_bs           : 100 (+ 30,= 49,- 21), 54.5 %
RobboLito_009_w32             : 100 (+ 31,= 52,- 17), 57.0 %
Stockfish-171-32-ja           : 100 (+ 44,= 40,- 16), 64.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 27,= 57,- 16), 55.5 %

2 Tankist 1.7 32-bit          :1100 (+284,=618,-198), 53.9 %

Houdini_1.01_w32_1CPU         : 100 (+ 27,= 55,- 18), 54.5 %
IvanHoe_v81a_w32_bs           : 100 (+ 11,= 72,- 17), 47.0 %
Fire_131_w32_KLO              : 100 (+ 33,= 54,- 13), 60.0 %
Houdini_w32_1CPU              : 100 (+ 22,= 64,- 14), 54.0 %
Fire_12_w32                   : 100 (+ 27,= 55,- 18), 54.5 %
DamirsRybkaKiller30           : 100 (+ 31,= 53,- 16), 57.5 %
MishasSwooper06               : 100 (+ 31,= 50,- 19), 56.0 %
Ippolit0080c_w32_bs           : 100 (+ 23,= 55,- 22), 50.5 %
RobboLito_009_w32             : 100 (+ 20,= 61,- 19), 50.5 %
Stockfish-171-32-ja           : 100 (+ 36,= 38,- 26), 55.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 23,= 61,- 16), 53.5 %

3 Houdini_w32_1CPU            :1000 (+272,=534,-194), 53.9 %

IvanHoe_v81a_w32_bs           : 100 (+ 21,= 64,- 15), 53.0 %
Fire_131_w32_KLO              : 100 (+ 22,= 60,- 18), 52.0 %
Tankist 1.7 32-bit            : 100 (+ 14,= 64,- 22), 46.0 %
Fire_12_w32                   : 100 (+ 28,= 57,- 15), 56.5 %
DamirsRybkaKiller30           : 100 (+ 28,= 50,- 22), 53.0 %
MishasSwooper06               : 100 (+ 41,= 39,- 20), 60.5 %
Ippolit0080c_w32_bs           : 100 (+ 26,= 57,- 17), 54.5 %
RobboLito_009_w32             : 100 (+ 21,= 59,- 20), 50.5 %
Stockfish-171-32-ja           : 100 (+ 41,= 35,- 24), 58.5 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 30,= 49,- 21), 54.5 %

4 RobboLito_009_w32           :1100 (+274,=600,-226), 52.2 %

Houdini_1.01_w32_1CPU         : 100 (+ 17,= 52,- 31), 43.0 %
IvanHoe_v81a_w32_bs           : 100 (+ 21,= 56,- 23), 49.0 %
Fire_131_w32_KLO              : 100 (+ 23,= 57,- 20), 51.5 %
Houdini_w32_1CPU              : 100 (+ 20,= 59,- 21), 49.5 %
Tankist 1.7 32-bit            : 100 (+ 19,= 61,- 20), 49.5 %
Fire_12_w32                   : 100 (+ 24,= 52,- 24), 50.0 %
DamirsRybkaKiller30           : 100 (+ 22,= 62,- 16), 53.0 %
MishasSwooper06               : 100 (+ 40,= 44,- 16), 62.0 %
Ippolit0080c_w32_bs           : 100 (+ 23,= 63,- 14), 54.5 %
Stockfish-171-32-ja           : 100 (+ 36,= 42,- 22), 57.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 29,= 52,- 19), 55.0 %

5 IvanHoe_v81a_w32_bs         :1100 (+250,=636,-214), 51.6 %

Houdini_1.01_w32_1CPU         : 100 (+ 14,= 59,- 27), 43.5 %
Fire_131_w32_KLO              : 100 (+ 20,= 65,- 15), 52.5 %
Houdini_w32_1CPU              : 100 (+ 15,= 64,- 21), 47.0 %
Tankist 1.7 32-bit            : 100 (+ 17,= 72,- 11), 53.0 %
Fire_12_w32                   : 100 (+ 23,= 56,- 21), 51.0 %
DamirsRybkaKiller30           : 100 (+ 26,= 59,- 15), 55.5 %
MishasSwooper06               : 100 (+ 30,= 49,- 21), 54.5 %
Ippolit0080c_w32_bs           : 100 (+ 21,= 59,- 20), 50.5 %
RobboLito_009_w32             : 100 (+ 23,= 56,- 21), 51.0 %
Stockfish-171-32-ja           : 100 (+ 39,= 38,- 23), 58.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 22,= 59,- 19), 51.5 %

6 Igorrit0.086v6w32SSE2timefix:1100 (+279,=531,-290), 49.5 %

Houdini_1.01_w32_1CPU         : 100 (+ 16,= 57,- 27), 44.5 %
IvanHoe_v81a_w32_bs           : 100 (+ 19,= 59,- 22), 48.5 %
Fire_131_w32_KLO              : 100 (+ 25,= 40,- 35), 45.0 %
Houdini_w32_1CPU              : 100 (+ 21,= 49,- 30), 45.5 %
Tankist 1.7 32-bit            : 100 (+ 16,= 61,- 23), 46.5 %
Fire_12_w32                   : 100 (+ 27,= 49,- 24), 51.5 %
DamirsRybkaKiller30           : 100 (+ 25,= 53,- 22), 51.5 %
MishasSwooper06               : 100 (+ 36,= 36,- 28), 54.0 %
Ippolit0080c_w32_bs           : 100 (+ 33,= 46,- 21), 56.0 %
RobboLito_009_w32             : 100 (+ 19,= 52,- 29), 45.0 %
Stockfish-171-32-ja           : 100 (+ 42,= 29,- 29), 56.5 %

7 Fire_12_w32                 :1000 (+230,=516,-254), 48.8 %

Houdini_1.01_w32_1CPU         : 100 (+ 15,= 52,- 33), 41.0 %
IvanHoe_v81a_w32_bs           : 100 (+ 21,= 56,- 23), 49.0 %
Houdini_w32_1CPU              : 100 (+ 15,= 57,- 28), 43.5 %
Tankist 1.7 32-bit            : 100 (+ 18,= 55,- 27), 45.5 %
DamirsRybkaKiller30           : 100 (+ 21,= 58,- 21), 50.0 %
MishasSwooper06               : 100 (+ 36,= 40,- 24), 56.0 %
Ippolit0080c_w32_bs           : 100 (+ 25,= 53,- 22), 51.5 %
RobboLito_009_w32             : 100 (+ 24,= 52,- 24), 50.0 %
Stockfish-171-32-ja           : 100 (+ 31,= 44,- 25), 53.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 24,= 49,- 27), 48.5 %

8 Fire_131_w32_KLO            :1000 (+235,=502,-263), 48.6 %

Houdini_1.01_w32_1CPU         : 100 (+ 11,= 51,- 38), 36.5 %
IvanHoe_v81a_w32_bs           : 100 (+ 15,= 65,- 20), 47.5 %
Houdini_w32_1CPU              : 100 (+ 18,= 60,- 22), 48.0 %
Tankist 1.7 32-bit            : 100 (+ 13,= 54,- 33), 40.0 %
DamirsRybkaKiller30           : 100 (+ 24,= 43,- 33), 45.5 %
MishasSwooper06               : 100 (+ 21,= 52,- 27), 47.0 %
Ippolit0080c_w32_bs           : 100 (+ 32,= 45,- 23), 54.5 %
RobboLito_009_w32             : 100 (+ 20,= 57,- 23), 48.5 %
Stockfish-171-32-ja           : 100 (+ 46,= 35,- 19), 63.5 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 35,= 40,- 25), 55.0 %

9 DamirsRybkaKiller30         :1100 (+247,=575,-278), 48.6 %

Houdini_1.01_w32_1CPU         : 100 (+ 12,= 52,- 36), 38.0 %
IvanHoe_v81a_w32_bs           : 100 (+ 15,= 59,- 26), 44.5 %
Fire_131_w32_KLO              : 100 (+ 33,= 43,- 24), 54.5 %
Houdini_w32_1CPU              : 100 (+ 22,= 50,- 28), 47.0 %
Tankist 1.7 32-bit            : 100 (+ 16,= 53,- 31), 42.5 %
Fire_12_w32                   : 100 (+ 21,= 58,- 21), 50.0 %
MishasSwooper06               : 100 (+ 32,= 53,- 15), 58.5 %
Ippolit0080c_w32_bs           : 100 (+ 17,= 59,- 24), 46.5 %
RobboLito_009_w32             : 100 (+ 16,= 62,- 22), 47.0 %
Stockfish-171-32-ja           : 100 (+ 41,= 33,- 26), 57.5 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 22,= 53,- 25), 48.5 %

10 Ippolit0080c_w32_bs        :1100 (+249,=559,-292), 48.0 %

Houdini_1.01_w32_1CPU         : 100 (+ 21,= 49,- 30), 45.5 %
IvanHoe_v81a_w32_bs           : 100 (+ 20,= 59,- 21), 49.5 %
Fire_131_w32_KLO              : 100 (+ 23,= 45,- 32), 45.5 %
Houdini_w32_1CPU              : 100 (+ 17,= 57,- 26), 45.5 %
Tankist 1.7 32-bit            : 100 (+ 22,= 55,- 23), 49.5 %
Fire_12_w32                   : 100 (+ 22,= 53,- 25), 48.5 %
DamirsRybkaKiller30           : 100 (+ 24,= 59,- 17), 53.5 %
MishasSwooper06               : 100 (+ 25,= 39,- 36), 44.5 %
RobboLito_009_w32             : 100 (+ 14,= 63,- 23), 45.5 %
Stockfish-171-32-ja           : 100 (+ 40,= 34,- 26), 57.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 21,= 46,- 33), 44.0 %

11 MishasSwooper06            :1100 (+259,=490,-351), 45.8 %

Houdini_1.01_w32_1CPU         : 100 (+ 16,= 52,- 32), 42.0 %
IvanHoe_v81a_w32_bs           : 100 (+ 21,= 49,- 30), 45.5 %
Fire_131_w32_KLO              : 100 (+ 27,= 52,- 21), 53.0 %
Houdini_w32_1CPU              : 100 (+ 20,= 39,- 41), 39.5 %
Tankist 1.7 32-bit            : 100 (+ 19,= 50,- 31), 44.0 %
Fire_12_w32                   : 100 (+ 24,= 40,- 36), 44.0 %
DamirsRybkaKiller30           : 100 (+ 15,= 53,- 32), 41.5 %
Ippolit0080c_w32_bs           : 100 (+ 36,= 39,- 25), 55.5 %
RobboLito_009_w32             : 100 (+ 16,= 44,- 40), 38.0 %
Stockfish-171-32-ja           : 100 (+ 37,= 36,- 27), 55.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 28,= 36,- 36), 46.0 %

12 Stockfish-171-32-ja        :1100 (+263,=404,-433), 42.3 %

Houdini_1.01_w32_1CPU         : 100 (+ 16,= 40,- 44), 36.0 %
IvanHoe_v81a_w32_bs           : 100 (+ 23,= 38,- 39), 42.0 %
Fire_131_w32_KLO              : 100 (+ 19,= 35,- 46), 36.5 %
Houdini_w32_1CPU              : 100 (+ 24,= 35,- 41), 41.5 %
Tankist 1.7 32-bit            : 100 (+ 26,= 38,- 36), 45.0 %
Fire_12_w32                   : 100 (+ 25,= 44,- 31), 47.0 %
DamirsRybkaKiller30           : 100 (+ 26,= 33,- 41), 42.5 %
MishasSwooper06               : 100 (+ 27,= 36,- 37), 45.0 %
Ippolit0080c_w32_bs           : 100 (+ 26,= 34,- 40), 43.0 %
RobboLito_009_w32             : 100 (+ 22,= 42,- 36), 43.0 %
Igorrit0.086v6w32SSE2timefix  : 100 (+ 29,= 29,- 42), 43.5 %

Code: Select all

Games        :   6400 (finished)

White Wins   :   1946 (30.4 %)
Black Wins   :   1212 (18.9 %)
Draws        :   3242 (50.7 %)
Unfinished   :      0

White Perf.  : 55.7 %
Black Perf.  : 44.3 %

ECO A =    967 Games (15.1 %)
ECO B =   1978 Games (30.9 %)
ECO C =   1393 Games (21.8 %)
ECO D =   1069 Games (16.7 %)
ECO E =    993 Games (15.5 %)
Games ( trimmed ): http://www.mediafire.com/?wyxmzmjw1mw (1.71 MB )
Games ( untrimmed) : http://www.mediafire.com/?q1mmyyumzjo (22.65 MB)

Here is the rating list with Ippolit's and Igorrit's time forfeits removed:

Code: Select all

Rank Name                           Elo    +    - games score oppo. draws 
   1 Houdini_1.01_w32_1CPU           37   16   16   992   57%    -5   52% 
   2 Tankist 1.7 32-bit              20   15   15  1096   54%    -2   56% 
   3 Houdini_w32_1CPU                16   15   15   992   54%    -5   54% 
   4 RobboLito_009_w32               11   15   15  1095   52%    -1   55% 
   5 IvanHoe_v81a_w32_bs              8   14   14  1095   51%    -1   58% 
   6 Igorrit0.086v6w32SSE2timefix     8   15   15  1057   51%    -1   50% 
   7 Ippolit0080c_w32_bs             -4   15   15  1070   49%     0   52% 
   8 Fire_12_w32                     -6   16   16   994   48%     1   52% 
   9 Fire_131_w32_KLO                -8   16   16   995   48%     1   50% 
  10 DamirsRybkaKiller30            -10   15   15  1089   48%     1   53% 
  11 MishasSwooper06                -26   15   15  1090   45%     2   45% 
  12 Stockfish-171-32-ja            -48   16   16  1095   42%     4   37% 

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 5:23 am
by Aloha
thank for your work, Adam !! :difus_19

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 10:58 am
by BTO7
Great job .....when you look at CEGT and others and see Stockfish second to Rybka you think wow ....then you put it in with all the big dogs and suddenly its bottom of the list ...and its a great program. Your seeing how much is censored at its finest. Thanks for this hard work and tests !!

Regards
BT

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 6:13 pm
by Stefan
This is the first test I see with sufficient number of games! Thanks. Could you test the newer Ivanhoe 63, too (www.chesslogik.com) ? From my tests it is around 50 points stronger than Fire 1.3.1. at time control 1/4' + 1/4''. But Houdini does not run on my Athlon. So I don't know what is the strongest free engine: Houdini 1.0.1 or Ivanhoe 63.

Regards
Stefan

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 6:29 pm
by 64x
How long did this tournament take to play out (how many hours/days)?

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 6:34 pm
by Aloha
Hi Stefan,

for my opinion its clearly Houdini 1.01 ... :difus_19

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 8:12 pm
by Taner Altinsoy
64x wrote:How long did this tournament take to play out (how many hours/days)?
I guess more than a week definitely maybe 2 weeks. I've been running my laptop for 2 weeks 7/24 for a 2'2" tournament of 3000 games. It's almost completed.

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 9:56 pm
by Adam Hair
64x wrote:How long did this tournament take to play out (how many hours/days)?
About one month.

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Wed Jun 16, 2010 10:45 pm
by 64x
That is a big time commitment. Congratulations on your dedication.

Re: 32-bit Ippolit family Round Robin ( 6400 games )

Posted: Thu Jun 17, 2010 3:22 am
by Adam Hair
I ran this tournament to find out something. I wondered about who really has been able to make improvements that
increase strength. I know that functionality has been improved with the help of several people, but I have not seen that
anybody but the comrades of the chess ship Ippolit actually have added strength. It seems that Alex Kutuzoff and
Robert Houdart have been able to do this also.

I also want to point out that if you want to determine if an engine is stronger than another engine, you need to do
more than run a head-to-head match. Tankist 1.7 beat both versions of Houdini and lost to Ivanhoe, which lost to
both versions of Houdini.