Fringe- Special Engine and Book Tests

[OrgZ]

Test book: UHO 2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 killfish190324                 30      35     140   54.3%   62.9% 
   2 Marauders 3.0_avx2             15      32     140   52.1%   68.6% 
   3 Brainlearn27-x86-64-avx2        5      38     140   50.7%   57.1% 
   4 Big-SF 210324-avx2              0      39     140   50.0%   54.3% 
   5 stockfish_24032015             -2      34     140   49.6%   65.0% 
   6 INCOGNITO 7-avx2              -10      34     140   48.6%   64.3% 
   7 corchess_x64_avx2             -15      36     140   47.9%   61.4% 
   8 Raid depth--                  -22      37     140   46.8%   57.9%  

PGN:https://pixeldrain.com/u/JrqXmsuU

[Homayoun]

Thanks, Cengiz Baba.

[Cengiz-Baba]

Test suit :UHO2024
Hash:64
Thread:1CPU
Time:1+1

Score of corchess220324 vs SF-PB-200324: 36 - 29 - 85 [0.523]
... corchess_x64_avx2 playing White: 35 - 0 - 40 [0.733] 75
... corchess_x64_avx2 playing Black: 1 - 29 - 45 [0.313] 75
... White vs Black: 64 - 1 - 85 [0.710] 150
Elo difference: 16.2 +/- 36.7, LOS: 80.7 %, DrawRatio: 56.7 %
SPRT: llr 0 (0.0%), lbound -inf, ubound inf
150 of 150 games finished.

pgn: https://pixeldrain.com/u/nCzcMEhp

[Cengiz-Baba]

Test book: UHO 2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Big-SF 220324-avx2             22      37     140   53.2%   57.9% 
   2 Light 26.3-avx2                15      38     140   52.1%   57.1% 
   3 HypnoS-190324_x64_AVX2         15      38     140   52.1%   57.1% 
   4 killfish190324                  7      35     140   51.1%   62.1% 
   5 TacticaL Gear 3.1_avx2          0      38     140   50.0%   55.7% 
   6 Marauders 3.0_avx2            -15      37     140   47.9%   58.6% 
   7 Deep Blue                     -15      40     140   47.9%   52.9% 
   8 stockfish16.1                 -30      42     140   45.7%   47.1%   

pgn: https://pixeldrain.com/u/NNfmA9ge

[Cengiz-Baba]

Test book: UHO 2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 corchess220324                 10      47     100   51.5%   53.0% 
   2 INCOGNITO 8                     7      45     100   51.0%   56.0% 
   3 HypnoS 240324                 -17      48     100   47.5%   51.0%    

pgn: https://pixeldrain.com/u/iDiPTXWm

[OrgZ]

Thanks

[Cengiz-Baba]

Thanks

You're welcome my friend

[Cengiz-Baba]

First test:
Test book: Balsa270423
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Light 26.3                     14      11     180   51.9%   95.0% 
   2 SF-PB-220324                   10      10     180   51.4%   96.1% 
   3 JigSaw v5.1                    10       8     180   51.4%   97.2% 
   4 stockfish_24032617              6       8     180   50.8%   97.2% 
   5 Big-SF 220324                   6      11     180   50.8%   95.0% 
   6 HypnoS 240324                   4       9     180   50.6%   96.7% 
   7 INCOGNITO 8                     2       7     180   50.3%   98.3% 
   8 TacticaL Gear 3.1               0       9     180   50.0%   96.7% 
   9 corchess220324                 -2      11     180   49.7%   95.0% 
  10 dragon-3.3                    -49      19     180   43.1%   85.0%
  

1. pgn: https://pixeldrain.com/u/9pvmYAEM


Second test:
Test book: UHO2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Big-SF 220324                  35      38     180   55.0%   45.6% 
   2 SF-PB-220324                   29      35     180   54.2%   52.8% 
   3 HypnoS 240324                  21      37     180   53.1%   47.2% 
   4 Light 26.3                     15      36     180   52.2%   51.1% 
   5 TacticaL Gear 3.1              15      35     180   52.2%   52.2% 
   6 stockfish_24032617             14      35     180   51.9%   51.7% 
   7 corchess220324                 14      35     180   51.9%   51.7% 
   8 INCOGNITO 8                    -2      37     180   49.7%   47.2% 
   9 JigSaw v5.1                    -6      38     180   49.2%   45.0% 
  10 dragon-3.3                   -143      34     180   30.6%   52.2%
  

2. pgn: https://pixeldrain.com/u/cE441CCJ


Dear friends

Here are two tournaments with the same engine but different books. With the UHO opening book, we ensured fewer draws, while the Balsa opening book was evaluated by offering higher draws.

Conclusion:

I think we need more games to evaluate the results of the tournament where no parameters changed. As my dear friend Sedat said, we cannot see a similarity in the results.

Best regards,
Fringe.

[OrgZ]

Thanks for the tests dear Fringe

[Sedat Canbaz]

First test:
Test book: Balsa270423
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Light 26.3                     14      11     180   51.9%   95.0% 
   2 SF-PB-220324                   10      10     180   51.4%   96.1% 
   3 JigSaw v5.1                    10       8     180   51.4%   97.2% 
   4 stockfish_24032617              6       8     180   50.8%   97.2% 
   5 Big-SF 220324                   6      11     180   50.8%   95.0% 
   6 HypnoS 240324                   4       9     180   50.6%   96.7% 
   7 INCOGNITO 8                     2       7     180   50.3%   98.3% 
   8 TacticaL Gear 3.1               0       9     180   50.0%   96.7% 
   9 corchess220324                 -2      11     180   49.7%   95.0% 
  10 dragon-3.3                    -49      19     180   43.1%   85.0%
  

1. pgn: https://pixeldrain.com/u/9pvmYAEM


Second test:
Test book: UHO2024
Time:1+1
Threads:1
Hash:64

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Big-SF 220324                  35      38     180   55.0%   45.6% 
   2 SF-PB-220324                   29      35     180   54.2%   52.8% 
   3 HypnoS 240324                  21      37     180   53.1%   47.2% 
   4 Light 26.3                     15      36     180   52.2%   51.1% 
   5 TacticaL Gear 3.1              15      35     180   52.2%   52.2% 
   6 stockfish_24032617             14      35     180   51.9%   51.7% 
   7 corchess220324                 14      35     180   51.9%   51.7% 
   8 INCOGNITO 8                    -2      37     180   49.7%   47.2% 
   9 JigSaw v5.1                    -6      38     180   49.2%   45.0% 
  10 dragon-3.3                   -143      34     180   30.6%   52.2%
  

2. pgn: https://pixeldrain.com/u/cE441CCJ


Dear friends

Here are two tournaments with the same engine but different books. With the UHO opening book, we ensured fewer draws, while the Balsa opening book was evaluated by offering higher draws.

Conclusion:

I think we need more games to evaluate the results of the tournament where no parameters changed. As my dear friend Sedat said, we cannot see a similarity in the results.

Best regards,
Fringe.

Dear Fringe,

Many thanks.. useful, reasonable test!
Now we have more data to compare...

Greetings )