opening book vs experience file

As in chess tournaments and matches...
User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Thu Jul 06, 2023 4:42 am

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                              :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)       :      24     94    16.0      30  53.3    2   28    0  93.3       0     1
   2 Leschats14062023.bin (Eman 8.40)    :       0   ----    14.0      30  46.7    0   28    2  93.3      24     1

White advantage = 23.51 +/- 46.54
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Thu Jul 06, 2023 4:13 pm

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : 20 first legal moves

Code: Select all

   # PLAYER                              :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)       :      18     81    21.0      40  52.5    2   38    0  95.0       0     1
   2 Leschats14062023.bin (Eman 8.40)    :       0   ----    19.0      40  47.5    0   38    2  95.0      18     1

White advantage = -17.58 +/- 41.39
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Sat Jul 08, 2023 4:41 am

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Albert Silver's 25 gambit suit

Code: Select all

   # PLAYER                              :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)       :      49     69    28.5      50  57.0   11   35    4  70.0       0     1
   2 Leschats14062023.bin (Eman 8.40)    :       0   ----    21.5      50  43.0    4   35   11  70.0      49     1

White advantage = 7.15 +/- 35.50
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Mon Jul 10, 2023 8:21 pm

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                              :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)       :     131     57    66.0     100  66.0   33   66    1  66.0       0     1
   2 Leschats14062023.bin (Eman 8.40)    :       0   ----    34.0     100  34.0    1   66   33  66.0     131     1

White advantage = 123.71 +/- 29.79
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Mon Jul 17, 2023 7:03 am

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Agarta-040623.bin (Eman 8.40)    :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Mon Jul 17, 2023 7:23 pm

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 Agarta-040623.bin (Eman 8.40)    :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Tue Jul 18, 2023 7:34 am

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : 20 first legal moves

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :      27     81    21.5      40  53.8    4   35    1  87.5       0     1
   2 Agarta-040623.bin (Eman 8.40)    :       0   ----    18.5      40  46.3    1   35    4  87.5      27     1

White advantage = -44.29 +/- 41.53
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Wed Jul 19, 2023 6:42 am

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Albert Silver's 25 gambit suit

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :      35     69    27.5      50  55.0    9   37    4  74.0       0     1
   2 Agarta-040623.bin (Eman 8.40)    :       0   ----    22.5      50  45.0    4   37    9  74.0      35     1

White advantage = 7.08 +/- 35.50
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Sat Jul 22, 2023 4:42 am

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :     142     59    67.0     100  67.0   35   64    1  64.0       0     1
   2 Agarta-040623.bin (Eman 8.40)    :       0   ----    33.0     100  33.0    1   64   35  64.0     142     1

White advantage = 135.51 +/- 30.62
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

User avatar
deeds
Posts: 953
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds » Sat Jul 22, 2023 4:54 am

By grouping the engines with experience files VS the engines with opening books, we obtain this overall result :

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)    W     D    L  D(%)  OppAvg  OppN
   1 experience_files (Eman 8.xx)    :      41     11  1072.0    1920  55.8  264  1616   40  84.2       0     1
   2 opening_books (Eman 8.xx)       :       0   ----   848.0    1920  44.2   40  1616  264  84.2      41     1

White advantage = 28.18 +/- 5.52
Draw rate (equal opponents) = 50.00 % +/- 0.00
Some stats :

Code: Select all

experience_files (eman 8.xx) : avg. D31, 001 989 ms/move, 001 920 games, 00 101 367 moves
opening_books (eman 8.xx)    : avg. D33, 002 363 ms/move, 001 920 games, 00 085 018 moves

Averages :
210 sec/game (3 min/game)
114 plies/game (97 played plies/game)

Game stages :
- opening @ avg. D27, 003 385 ms/move
- middleg @ avg. D30, 001 839 ms/move
- endgame @ avg. D40, 001 289 ms/move

Post Reply