deeds_chess_system

As in chess tournaments and matches...
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :     166     64    68.5     100  68.5   39   59    2  59.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    31.5     100  31.5    2   59   39  59.0     166     1

White advantage = 166.17 +/- 33.76
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: pawn-value based exp file vs polyglot bin book

Post by deeds »

pawn-value based experience file : experience data purely trained by Eman engine until 8.40 release (before Nov 5, 2022 patch)

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : GHPPN's 15 most popular openings (Olisfish-040623's Opening Rate : 60%)

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : 20 first legal moves (Olisfish-040623's Opening Rate : 20%)

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :       9     81    20.5      40  51.3    2   37    1  92.5       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    19.5      40  48.8    1   37    2  92.5       9     1

White advantage = -26.35 +/- 40.96
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : Albert Silver's 25 gambit suit (Olisfish-040623's Opening Rate : 4%)

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :      50     70    28.5      50  57.0   12   33    5  66.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    21.5      50  43.0    5   33   12  66.0      50     1

White advantage = -21.47 +/- 36.46
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings (Olisfish-040623's Opening Rate : 0%)

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :     166     64    68.5     100  68.5   39   59    2  59.0       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----    31.5     100  31.5    2   59   39  59.0     166     1

White advantage = 166.17 +/- 33.76
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: pawn-value based exp file vs polyglot bin book

Post by deeds »

Overall :

Code: Select all

   # PLAYER                             :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)      :      50     27   182.5     320  57.0   53  259    8  80.9       0     1
   2 Olisfish-040623.bin (Eman 8.40)    :       0   ----   137.5     320  43.0    8  259   53  80.9      50     1

White advantage = 34.77 +/- 13.60
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

002 players                 : avg. D31, 002 120 ms/move, 000 320 games, 00 032 115 moves

depth4_190623 (eman 8.40)   : avg. D30, 002 012 ms/move, 000 320 games, 00 016 851 moves
olisfish-040623 (eman 8.40) : avg. D31, 002 238 ms/move, 000 320 games, 00 015 264 moves

Averages :
0 213 sec/game (4 min/game)
114 plies/game (100 played plies/game)

Game stages :
- opening @ avg. D27, 003 489 ms/move
- middleg @ avg. D28, 001 690 ms/move
- endgame @ avg. D37, 001 222 ms/move
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

By grouping the engines with experience files VS the engines with opening books, we obtain this overall result :

Code: Select all

   # PLAYER                          :  RATING  ERROR  POINTS  PLAYED   (%)    W     D    L  D(%)  OppAvg  OppN
   1 experience_files (Eman 8.xx)    :      43      9  1613.0    2880  56.0  416  2394   70  83.1       0     1
   2 opening_books (Eman 8.xx)       :       0   ----  1267.0    2880  44.0   70  2394  416  83.1      43     1

White advantage = 31.46 +/- 4.72
Draw rate (equal opponents) = 50.00 % +/- 0.00
Some stats :

Code: Select all

experience_files (eman 8.xx) : avg. D31, 001 984 ms/move, 002 880 games, 00 153 584 moves
opening_books (eman 8.xx)    : avg. D32, 002 353 ms/move, 002 880 games, 00 129 452 moves

Averages :
212 sec/game (4 min/game)
115 plies/game (098 played plies/game)

Game stages :
- opening @ avg. D27, 003 446 ms/move
- middleg @ avg. D29, 001 789 ms/move
- endgame @ avg. D39, 001 260 ms/move
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : 20 first legal moves

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       9     81    20.5      40  51.3    2   37    1  92.5       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    19.5      40  48.8    1   37    2  92.5       9     1

White advantage = -26.35 +/- 40.96
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Albert Silver's 25 gambit suit

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :      42     69    28.0      50  56.0   11   34    5  68.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    22.0      50  44.0    5   34   11  68.0      42     1

White advantage = -14.23 +/- 35.75
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :     192     70    70.0     100  70.0   43   54    3  54.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    30.0     100  30.0    3   54   43  54.0     192     1

White advantage = 192.38 +/- 35.84
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: pawn-value based exp file vs polyglot bin book

Post by deeds »

pawn-value based experience file : experience data purely trained by Eman engine until 8.40 release (before Nov 5, 2022 patch)

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : startpos

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       0     49    50.0     100  50.0    0  100    0  100.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    50.0     100  50.0    0  100    0  100.0       0     1

White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : GHPPN's 15 most popular openings (Chucaro 4 UPD2's Opening Rate : 20%)

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : 20 first legal moves (Chucaro 4 UPD2's Opening Rate : 5%)

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :       9     81    20.5      40  51.3    2   37    1  92.5       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    19.5      40  48.8    1   37    2  92.5       9     1

White advantage = -26.35 +/- 40.96
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : Albert Silver's 25 gambit suit (Chucaro 4 UPD2's Opening Rate : 4%)

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :      42     69    28.0      50  56.0   11   34    5  68.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    22.0      50  44.0    5   34   11  68.0      42     1

White advantage = -14.23 +/- 35.75
Draw rate (equal opponents) = 50.00 % +/- 0.00

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings (Chucaro 4 UPD2's Opening Rate : 0%)

Code: Select all

   # PLAYER                            :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)     :     192     70    70.0     100  70.0   43   54    3  54.0       0     1
   2 Chucaro 4 UPD2.bin (Eman 8.40)    :       0   ----    30.0     100  30.0    3   54   43  54.0     192     1

White advantage = 192.38 +/- 35.84
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
Post Reply