Train your engine !

General discussion about computer chess...
User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Fri Mar 03, 2023 7:51 pm

Here is a summary of the "learning session 9" openings :

Image

You will find individual learning curves here.

learning session 9 :

Code: Select all

   # PLAYER                             :  RATING  ERROR   POINTS  PLAYED   (%)      W      D      L  D(%)  OppAvg  OppN
   1 brainlearn 19.2 nn-1e7ca356472e    :       1      4   7269.5   14500  50.1   3009   8521   2970  58.8       0     1
   2 Eman experience                    :       0   ----  29577.5   58000  51.0  12282  34591  11127  59.6      -7     4
   3 ShashChess 25.3 nn-1e7ca356472e    :      -6      4   7129.0   14500  49.2   2841   8576   3083  59.1       0     1
   4 HypnoS 051122 nn-1e7ca356472e      :      -8      4   7087.5   14500  48.9   2749   8677   3074  59.8       0     1
   5 Aurora 301022 nn-1e7ca356472e      :     -16      4   6936.5   14500  47.8   2528   8817   3155  60.8       0     1

White advantage = 72.64 +/- 1.00
Draw rate (equal opponents) = 50.00 % +/- 0.00

rulleeeee
Posts: 37
Joined: Wed Aug 06, 2014 6:33 pm
Real Name: Grzesiek

Re: Train your engine !

Post by rulleeeee » Fri May 05, 2023 7:18 pm

Hi. When I run pgnToScores.exe it shuts down immediately. Maybe I'm missing something? I have Windows 11

User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Fri May 05, 2023 7:29 pm

rulleeeee wrote:
Fri May 05, 2023 7:18 pm
Hi. When I run pgnToScores.exe it shuts down immediately. Maybe I'm missing something? I have Windows 11
Not sure what is the main problem (user rights, w11 incompatibility, missing file, etc.) but you have the source code here :
https://github.com/chris13300/pgnToScor ... modMain.vb

This tool contains less than 120 lines so it's not an heavy app.

You should ask people for help there :
https://outskirts.altervista.org/forum/ ... =41&t=3567

rulleeeee
Posts: 37
Joined: Wed Aug 06, 2014 6:33 pm
Real Name: Grzesiek

Re: Train your engine !

Post by rulleeeee » Fri May 05, 2023 7:32 pm

I know absolutely nothing about programming, but the fact that I downloaded one file that was there. WHAT else do I need?

User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Fri May 05, 2023 8:56 pm

rulleeeee wrote:
Fri May 05, 2023 7:32 pm
I know absolutely nothing about programming, but the fact that I downloaded one file that was there. WHAT else do I need?
The command line of this tool is :

pgnToScores.exe path_to_your_pgn_file.pgn

But you can also do a drag'n'drop of a pgn file onto the exe file.

ps : you have a PM at infinitychess forum

User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Thu Jun 01, 2023 6:29 am

LS11 preview : Eman's learning (LIVE)
https://www.youtube.com/watch?v=2wakDMiIC8A

User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Thu Jun 01, 2023 1:40 pm

Here is a summary of the "learning session 10" openings :

Image

You will find individual learning curves here.

learning session 10 :

Code: Select all

   # PLAYER                             :  RATING  ERROR   POINTS  PLAYED   (%)    W      D    L  D(%)  OppAvg  OppN
   1 brainlearn 19.2 nn-52471d67216a    :       0      4   8004.0   16000  50.0  148  15712  140  98.2       0     1
   2 Eman experience                    :       0   ----  32232.0   64000  50.4  739  62986  275  98.4      -3     4
   3 HypnoS 051122 nn-52471d67216a      :      -3      4   7936.5   16000  49.6   75  15723  202  98.3       0     1
   4 Aurora 301022 nn-52471d67216a      :      -3      4   7925.0   16000  49.5   27  15796  177  98.7       0     1
   5 ShashChess 25.3 nn-52471d67216a    :      -4      4   7902.5   16000  49.4   25  15755  220  98.5       0     1

White advantage = 4.92 +/- 0.96
Draw rate (equal opponents) = 50.00 % +/- 0.00

User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Fri Jun 02, 2023 10:07 am

Hi folk !

It seems incredible but in 2023, so after months/years of explanations, evidence, experiments, there are still daily testers who organize tournaments with engines set to training mode !? :o

:idea: In training mode (=default settings), the engines try some moves without knowing their efficiency like they did when they are learning an opening.
Main problem : these engines are playing in a tournament ! Normally, they are supposed to use the most effective moves they have learned.
Second problem : these testers publish the results of their tournaments as if they were representative of the experience data.

But since we know these testers will never figure out how to set up their engines in tournament mode (=played moves with a conformity with experience > 95%), we keep several endless sources of laughs. :lol: :lol: :lol:

If we use engine's releases newer than the Nov. 5, 2022 patch, all our databases and experience files become obsolete because the scores scale has changed.

Instead of an evaluation based on a pawn value, the new scores scale is a WDL model based on fishtest games, so on selfplay games, so it has nothing to do with the pawn value anymore.

Furthermore, this WDL model changes several times per year, it is no longer suitable for long-term training.

Don't update an old experience file with these new scores else you will corrupt it. :roll:
So you have to restart from scratch ! :shock:
Last edited by deeds on Fri Jun 02, 2023 10:12 am, edited 2 times in total.

User avatar
deeds
Posts: 934
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: Train your engine !

Post by deeds » Fri Jun 02, 2023 10:07 am

As in the past few months/years, I already did ten Eman's learning sessions (of which I have revealed to the public the results), I'm not going to restart from scratch. 8-)
:arrow: So i only use engine's releases using the old score scale.

As these engine releases are no longer compatible with the new sfnnv6 nets :arrow: i will avoid publishing the results of my next learning sessions in a general public area.
:idea: Out of respect for the enlightened, i will publish them on my personal website.

I thank the SF team for Stockfish and their nets, Khalid for EMAN, AMChess for BrainLearn and ShashChess, Sarona for Aurora.
The others invoked their right to be forgotten, no problem.

By uploading my source codes on github, I was able to pass on my tools to the new generation of engine trainers.
I wish good luck to them, i remain at your disposal on Skype and in PM if needed.

User avatar
sarona
Posts: 71
Joined: Sun Aug 29, 2021 8:59 pm
Real Name: Ron Doughie
Location: Canada

Re: Train your engine !

Post by sarona » Tue Jun 06, 2023 1:15 am

I will register over at Infinity in order to stay in touch. That seems to be the most logical course of action. I assume it is this forum?
https://cumnor-chess-server.com/phpbb/i ... 6a8e044778

OpenChess has no PMs. Talkchess may not even be an option with all political intrigue going on there at the moment. :evil: I know Outskirts is not a possibility either to keep in touch. Too bad, because I like what MZ has done there in dealing with trolls and leecher refugees from now defunct forums (a few of the Outskirts exiles are now at Talkchess getting on Guenther's nerves :lol: ). I like it there very much compared to the absolute zoo which were the Chess2U and ChessGod101 forums.

Post Reply