Deeds on Chess Engines Testing

General discussion about computer chess...
Post Reply
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------


Solidor wrote: I am sharing my version of the chess engine "Rybka 7 bmi2"...
source


Evidence (Rybka 7 is a clone) :
Image
source
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

Sedat Canbaz wrote: anyhow the Top books Are managed to win.. sure I refer in overall (not individually)
...
What I can add more, Really impressive points come by Top opening books!
source

Reality :

Code: Select all

   # PLAYER                               :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 MegaTron RevA (raubfish x48c3 sc)    :      15     59    36.5      70  52.1    5   63    2   90.0       0     1
   2 OPTIMUS 2409 (raubfish x48c3 sc)     :      15     58    36.5      70  52.1    3   67    0   95.7       0     1
   3 DON 130125 (raubfish x48c3 sc)       :       5     59    35.5      70  50.7    2   67    1   95.7       0     1
   4 DynamicS (raubfish x48c3 sc)         :       5     58    35.5      70  50.7    3   65    2   92.9       0     1
   5 Rulleeeee 041224 exp (eman 8.40)     :       0   ----   210.5     420  50.1   15  391   14   93.1      -1     6
   6 Esculapio (raubfish x48c3 sc)        :       0     56    35.0      70  50.0    0   70    0  100.0       0     1
   7 HCan 170125 (raubfish x48c3 sc)      :     -45     60    30.5      70  43.6    1   59   10   84.3       0     1

White advantage = 15.92 +/- 12.09
Draw rate (equal opponents) = 50.00 % +/- 0.00
Loser : Hcan 170125 opening book

Code: Select all

   # PLAYER                               :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 DynamicS (raubfish x48c3 sc)         :      15     59    36.5      70  52.1    3   67    0   95.7       0     1
   2 MegaTron RevA (raubfish x48c3 sc)    :       5     59    35.5      70  50.7    3   65    2   92.9       0     1
   3 DON 130125 (raubfish x48c3 sc)       :       0     59    35.0      70  50.0    0   70    0  100.0       0     1
   4 Esculapio (raubfish x48c3 sc)        :       0     56    35.0      70  50.0    1   68    1   97.1       0     1
   5 OPTIMUS 2409 (raubfish x48c3 sc)     :       0     58    35.0      70  50.0    0   70    0  100.0       0     1
   6 Spectral 041224 exp (eman 8.40)      :       0   ----   210.5     420  50.1   11  399   10   95.0      -1     6
   7 HCan 170125 (raubfish x48c3 sc)      :     -25     60    32.5      70  46.4    3   59    8   84.3       0     1

White advantage = 2.51 +/- 12.12
Draw rate (equal opponents) = 50.00 % +/- 0.00
Loser : Hcan 170125 opening book

Code: Select all

   # PLAYER                               :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 DynamicS (raubfish x48c3 sc)         :      30     59    38.0      70  54.3    6   64    0  91.4       0     1
   2 OPTIMUS 2409 (raubfish x48c3 sc)     :      20     57    37.0      70  52.9    4   66    0  94.3       0     1
   3 HCan 170125 (raubfish x48c3 sc)      :       0     60    35.0      70  50.0    5   60    5  85.7       0     1
   4 Raptora 010323 exp (eman 8.40)       :       0   ----   208.5     420  49.6   14  389   17  92.6       3     6
   5 DON 130125 (raubfish x48c3 sc)       :      -5     59    34.5      70  49.3    0   69    1  98.6       0     1
   6 MegaTron RevA (raubfish x48c3 sc)    :     -15     59    33.5      70  47.9    1   65    4  92.9       0     1
   7 Esculapio (raubfish x48c3 sc)        :     -15     57    33.5      70  47.9    1   65    4  92.9       0     1

White advantage = -4.18 +/- 12.22
Draw rate (equal opponents) = 50.00 % +/- 0.00
Winner : DynamicS opening book
User avatar
SOLIDOR
Posts: 32
Joined: Tue Apr 12, 2022 6:47 am
Real Name: EugeniuszOle

Re: when a daily tester should review his tests

Post by SOLIDOR »

My dear - I made a fish 7 on the strockfish code, I added tactical nets - what do you see as the problem? If you want, download it and have fun as much as you want!! I don't rip people off like you do by taking fees - best regards
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------

Sedat Canbaz wrote: Where Depth4 2015 book is tuned to Prefer both Depth 2025's Exp series..

Deeds, who seems to be Responsible for all the openings (played by Depth4..)
source


To get a good variety of experience data, I train Eman on several opening lists with several opening books as sparring-partners :

Image

Image

Image


How it works ?

For each opening of each opening list, the GUI (arena, cutechess, etc.) plays the opening moves then the engines start to play from the last position.

Let's take a training game played from the "1.b3 Nimzovich-Larsen" opening of the "20 first moves" list :

[Event "EXP VS BOOK"]
[Site "dual xeon e5-2660v3"]
[Date "2025.02.12"]
[Round "1"]
[White "Depth4_120824 (Eman 8.40)"]
[Black "Brain_110323 (Eman 8.40)"]
[Result "1/2-1/2"]
[ECO "A01"]
[GameDuration "00:02:48"]
[Opening "Nimzovich-Larsen attack"]
[PlyCount "55"]
[TimeControl "60+1"]
[Variation "Classical Variation"]

1. b3 {book} d5 2. Nf3 {0.00/29 4.1s} Bf5 3. Bb2 {-0.09/22 1.0s} e6
4. c4 {-0.05/29 10s} c6 {-0.13/31 12s} 5. e3 {-0.04/29 4.1s} Nd7 {-0.10/33 3.9s}
6. Nc3 {-0.08/26 1.8s} Ngf6 {-0.01/31 6.3s} 7. Nh4 {-0.07/26 1.5s}
Bg4 {-0.05/33 2.9s} 8. Be2 {-0.13/25 1.1s} Bxe2 {-0.02/30 1.0s}
9. Qxe2 {-0.15/27 5.1s} Nc5 {-0.02/31 2.1s} 10. cxd5 {-0.04/26 0.81s}
Nxd5 {-0.02/30 2.2s} 11. Nf3 {0.00/27 1.4s} Nxc3 {0.00/30 1.9s}
12. Bxc3 {+0.05/27 1.1s} f6 {0.00/28 1.7s} 13. Qc4 {+0.16/23 1.5s}
Qd5 {0.00/26 1.6s} 14. Ke2 {+0.01/23 1.3s} O-O-O {+0.13/20 1.3s}
15. g4 {0.00/24 2.6s} Qd7 {0.00/29 1.3s} 16. Bd4 {0.00/36 1.9s}
Kb8 {0.00/38 1.4s} 17. g5 {0.00/39 3.6s} e5 {0.00/46 1.9s}
18. Bxc5 {0.00/44 1.2s} Bxc5 {0.00/46 1.6s} 19. Qxc5 {0.00/48 3.4s}
Qd3+ {0.00/48 1.8s} 20. Kd1 {0.00/50 1.7s} Qe4 {0.00/48 1.6s}
21. Ke2 {0.00/53 3.7s} Qd3+ {0.00/52 10.0s} 22. Ke1 {0.00/55 5.2s}
Qe4 {0.00/56 2.4s} 23. gxf6 {0.00/58 16s} gxf6 {0.00/56 2.4s}
24. Ke2 {0.00/61 1.7s} Qd3+ {0.00/56 1.6s} 25. Kd1 {0.00/57 3.4s}
Qe4 {0.00/58 2.1s} 26. Ke2 {0.00/60 0.49s} Qd3+ {0.00/60 13s}
27. Kd1 {0.00/62 2.8s} Qe4 {0.00/64 4.9s}
28. Ke2 {0.00/61 0.64s, Draw by 3-fold repetition} 1/2-1/2

In this training game,

- the move "1. b3 {book}" is played by the GUI,
- the move "1. ... d5" comes from the "Brain_110323" BIN book,
- the move "2. Nf3 {0.00/29 4.1s}" is evaluated by the "Eman 8.40" engine which will update the "Depth4_120824" EXP file,
- the move "4. ... c6 {-0.13/31 12s}" is evaluated by the "Eman 8.40" engine because the "Brain_110323" BIN book is out-of-book,
-etc.


- no move played as white comes from the "Depth4_120824" EXP file because at training the "experience book" option is set to false. The moves are evaluated by the "Eman 8.40" engine based on the missing experience data in the "Depth4_120824" EXP file,
- only the moves played as black without evaluation represent the "Brain_110323" BIN book,


In sum :
- training games don't represent the accuracy of the EXP file,
- opening moves played by the GUI don't represent the EXP file,
- moves evaluated by the engine don't represent the EXP file,
- If a clown creates an opening book from training games, he alone is responsible for the good or bad performance of his own opening book.
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------

Sedat Canbaz wrote: ...I will create a book, which will be tuned to prefer Depth4 Exp Series, played in latest months of 2025 !...
source

Reality :
Image

Image

Image
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------

Sedat wrote: ...About MZ Chess Forum, which is closed too...
source

Evidence :
Image
source
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------


Now, let's talk about amateurism in learning engines / EXP files :

Image

Oops !
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------

Reminder :

Image

Try again !
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------


These games were shared :

Image
-
Image
-
Image
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: when a daily tester should review his tests

Post by deeds »

------------

:!: Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations will not be tolerated.

Thanks,

Best regards, Moderation.

------------


Reminder :
deeds wrote: Thu Mar 27, 2025 9:46 am Now, let's talk about (Sedat's) amateurism in learning engines / EXP files :

Image
Post Reply