Lc0 net history:
https://github.com/LeelaChessZero/lc0/w ... ts-for-Lc0
2019-07-26 : 42850 : last T40 net 24x256 just before 1st T60 net started the same day
2019-07.26 ( 600001 : 1st T60 30x320 using random moves, est. -1200 Elo; same day as 42850)
2020-06-02 : LS15 : from jjosh 24x256 net while T60 was getting stronger
2021-08-26 : 609996 : recent T60 30x384 net (previously enlarged from the original)
Match conditions:
- G/3'+1" (~12 hours each match)
- Ryzen 7 2700X 16SMTthreads 2GB hash | RTX 2060 , Syzygy-6 (Sf:Sy50off) , all m.o.=50
- 100 games: DOTS2 50 openings colors reversed each match
Engines:
- Stockfish-21082721 recent net & patch (avx2: GCC 10.3, Ubuntu 21.04).
- Lc0-0.28.0 latest official release 2021-08-25 (Ubuntu 21.04), multi_stream=true
The last T40 net vs. the Stockfish commit (was before NNUE) for the same day, 2 years 1 month ago:
Code: Select all
Match #1 Elo + - Games Score Data
1 Stockfish_19072603 : 34 54 54 100 55.0% +36 -26 =38
2 Lc0-0.28.0_42850 : 0 54 54 100 45.0% Draws 38.0%
One year and 3 months ago the LeelaStein 15 was released. This net vs. the last 'classical' before NNUE Stockfish, 1 year 1 month ago:
Code: Select all
Match #2 Elo + - Games Score Data
1 Lc0-0.28.0_LS15 : 24 45 45 100 53.5% +25 -18 =57
2 SfLastClassical_20073110 : 0 45 45 100 46.5% Draws 57.0%
A very recent Stockfish vs. a very recent T60 net:
Code: Select all
Match #3 Elo + - Games Score Data
1 Stockfish-21082721 : 86 46 44 100 62.0% +34 -10 =56
2 Lc0-0.28.0_609996 : 0 44 46 100 38.0% Draws 56.0%
2+ years ago until now: Lc0 is 52 Elo further behind Stockfish than it was at the start of T60, comparing Match #1 with Match #3.
1+ years ago: Lc0 is 110 Elo further behind Stockfish than it was at the time of Stockfish's last 'classical', comparing Match #2 with Match #3.
Currently: Stockfish is 86 Elo ahead of Lc0.
Cross-checking:
Code: Select all
Match #4 Elo + - Games Score Data
1 Stockfish-21082721 : 190 53 49 100 75.0% +53 -3 =44
2 Lc0-0.28.0_42850 : 0 49 53 100 25.0% Draws 44%
Match #5 Elo + - Games Score Data
1 Lc0-0.28.0_609996 : 108 50 49 100 65.0% +41 -11 =48
2 Stockfish_19072603 : 0 49 50 100 35.0% Draws 48.0%
Recent Stockfish is 190 Elo stronger than the last T40 net, Match #4.
Recent Lc0 is 108 Elo stronger than Stockfish on the day of the last T40 net/start of T60, Match #5.
Difference is 82 Elo, but not to double count Match #1: 82 - 34* = 48 Elo, consistent with the above 2+ years 52 Elo gain in Stockfish vs. Lc0.
(* Match #4 relates to Match #1 with Stockfish 'then' version +34, but Match #5 relates to Match #1 with Lc0 at 0.)