opening book vs experience file

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : 20 first legal moves

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :       9     81    20.5      40  51.3    2   37    1  92.5       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    19.5      40  48.8    1   37    2  92.5       9     1

White advantage = -26.35 +/- 40.96
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

[Skynet]

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Hey Chris, what's up? If i understand correctly, you use 40 threads per engine, right? If so, how much Nps you are getting at the start position?

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Hey Chris, what's up? If i understand correctly, you use 40 threads per engine, right? If so, how much Nps you are getting at the start position?

Yes 40 threads/engine when training with books at TC 1m+1s to get the same average depths as 7-8 threads/engine when training with learning engines at TC 2m+2s. Look at ipmanchess for all my hosts speed, at the moment they are at training for days...

[Skynet]

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Hey Chris, what's up? If i understand correctly, you use 40 threads per engine, right? If so, how much Nps you are getting at the start position?

Yes 40 threads/engine when training with books at TC 1m+1s to get the same average depths as 7-8 threads/engine when training with learning engines at TC 2m+2s. Look at ipmanchess for all my hosts speed, at the moment they are at training for days...

Ok, got it, thanks.

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Albert Silver's 25 gambit suit

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :      50     70    28.5      50  57.0   12   33    5  66.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    21.5      50  43.0    5   33   12  66.0      50     1

White advantage = -21.47 +/- 36.46
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :     166     64    68.5     100  68.5   39   59    2  59.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    31.5     100  31.5    2   59   39  59.0     166     1

White advantage = 166.17 +/- 33.76
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

[deeds]

By grouping the engines with experience files VS the engines with opening books, we obtain this overall result :

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)    W     D    L  D(%)  OppAvg  OppN
   1 experience_files (Eman 8.xx)    :      43      9  1613.0    2880  56.0  416  2394   70  83.1       0     1
   2 opening_books (Eman 8.xx)       :       0   ----  1267.0    2880  44.0   70  2394  416  83.1      43     1

White advantage = 31.46 +/- 4.72
Draw rate (equal opponents) = 50.00 % +/- 0.00

Some stats :

Code: Select all

experience_files (eman 8.xx) : avg. D31, 001 984 ms/move, 002 880 games, 00 153 584 moves
opening_books (eman 8.xx)    : avg. D32, 002 353 ms/move, 002 880 games, 00 129 452 moves

Averages :
212 sec/game (4 min/game)
115 plies/game (098 played plies/game)

Game stages :
- opening @ avg. D27, 003 446 ms/move
- middleg @ avg. D29, 001 789 ms/move
- endgame @ avg. D39, 001 260 ms/move

[deeds]

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw