deeds_chess_system

As in chess tournaments and matches...
Post Reply
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

Homayoun wrote: Mon Apr 10, 2023 9:07 pm I think when you publish your test and final results in a forum as an article ,you have made it a subject to judgment by others and unknown people.
99.99% of them don't train chess engines, they don't have their own experience files and even less reinforce them. They are not ready so no time to waste justifying myself.

Homayoun wrote: Mon Apr 10, 2023 9:07 pm I do not have the password now. I mean my mailbox is empty. It seems there is a problem with private messages in this forum.
I have already proposed several solutions to this problem.
Homayoun
Posts: 1723
Joined: Tue Mar 21, 2023 4:57 pm
Real Name: Homayoun

Re: deeds_chess_system

Post by Homayoun »

deeds wrote: Tue Apr 11, 2023 5:28 am
Homayoun wrote: Mon Apr 10, 2023 9:07 pm I think when you publish your test and final results in a forum as an article ,you have made it a subject to judgment by others and unknown people.
99.99% of them don't train chess engines, they don't have their own experience files and even less reinforce them. They are not ready so no time to waste justifying myself.

Homayoun wrote: Mon Apr 10, 2023 9:07 pm I do not have the password now. I mean my mailbox is empty. It seems there is a problem with private messages in this forum.
I have already proposed several solutions to this problem.
OK. Thanks deeds.
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 100 best 2017 openings

Code: Select all

   # PLAYER                :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 deeds_chess_system    :       0   ----   109.0     200  54.5   18  182    0  91.0     -32     1
   2 stockfish 15.1        :     -32     36    91.0     200  45.5    0  182   18  91.0       0     1

White advantage = 28.33 +/- 17.15
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
only for friends and family (request password and information by PM)
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : YHWH's 130 openings

Code: Select all

   # PLAYER                :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 deeds_chess_system    :       0   ----   136.5     260  52.5   13  247    0  95.0     -18     1
   2 stockfish 15.1        :     -18     31   123.5     260  47.5    0  247   13  95.0       0     1

White advantage = 17.58 +/- 15.22
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
only for friends and family (request password and information by PM)
Anton101
Posts: 787
Joined: Sat Jun 10, 2023 6:46 pm
Real Name: A. Ces
Location: México

Re: deeds_chess_system

Post by Anton101 »

Hi! P...of...St!

Still writing monkey bussiness?

:D
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 2017 selection 100 openings

Code: Select all

   # PLAYER                :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 deeds_chess_system    :       0   ----   106.5     200  53.3   15  183    2  91.5     -23     1
   2 stockfish 15.1        :     -23     36    93.5     200  46.8    2  183   15  91.5       0     1

White advantage = 26.45 +/- 17.34
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
only for friends and family (request password and information by PM)
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

After 8 opening's lists :

Code: Select all

   # PLAYER                :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 deeds_chess_system    :       0   ----   616.5    1080  57.1  163  907   10  84.0     -51     1
   2 stockfish 15.1        :     -51     14   463.5    1080  42.9   10  907  163  84.0       0     1

White advantage = 44.30 +/- 7.64
Draw rate (equal opponents) = 50.00 % +/- 0.00

Code: Select all

002 players        : avg. D34, 001 795 ms/move, 001 080 games, 00 107 088 moves

deeds_chess_system : avg. D33, 001 989 ms/move, 001 080 games, 00 052 826 moves
stockfish 15.1     : avg. D34, 001 606 ms/move, 001 080 games, 00 054 262 moves

Averages :
0 178 sec/game (3 min/game)
117 plies/game (099 played plies/game)

Game stages :
- opening @ avg. D28, 002 263 ms/move
- middleg @ avg. D31, 001 782 ms/move
- endgame @ avg. D41, 001 375 ms/move
Image

Now that the D.C.S. "proof-of-concept" phase is over, It's time to do a partial lifting on the NDA of the DeeDs Chess System :

*** Prerequisite knowledge ***

TRAINING MODE (=default settings)

- By default, engines with learning features are set to regularly try new moves.

- Unlike all amnesiac engines like Stockfish, LC0, Komodo Dragon, etc, the learning engines don't always play the moves with the best evaluated scores.

- Sometimes the new moves are more effective, sometimes they are worse but in all cases they contribute to update the experience data.

As it is unlikely that tournaments of daily testers will allow them to play 500 times each opening (=minimum required to learn an opening), without knowing their effectiveness, each move is risky. Whenever you see tournaments (e.g. : link #1, link #2, link #3) with learning engines set to their default settings, the tournament's result will represent more the engine's evaluation than the quality of its experience.

TOURNAMENT MODE (=experience file as book, deeds chess system, etc.)

- when the positions have experience data, the learning engines must play their most effective moves and above all not risk trying others.

- when the positions do not have experience data, the learning engines evaluate and then add new moves to their experience file.
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

*** Experience file as book ***

For those who want an overview of the quality of their engine's experience, you can activate the "Experience book" experimental feature.
Then, you have to configure some options :

Experience Book Min Depth
=> set a shallow depth to allow your engine to play silly moves (like do some unenlightened testers)
=> set a great depth to force your engine to respect the reinforced experience data

Experience Book Eval Importance
=> set a low value if you believe in the efficiency of your experience data
=> set a high value if you believe in the evaluation of your engine

Experience Book Max Moves
=> set a low value if you have trained your engine little (<500 games/opening)
=> set a high value if you have trained your engine a lot (>1000 games/opening)
User avatar
deeds
Posts: 1482
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

*** DeeDs Chess System ***

For all the positions of a game, the evaluation of the engine does not have the same precision.
The same goes for experience data, sometimes there are many, sometimes there are few.
Sometimes they are reinforced with refined scores at very great depths.
So with values fixed for all the positions of a game like those of the "Experience Book Min Depth / Eval Importance" options, it is not optimal.
Engine's moves are not always in conformity with its experience data.

D.C.S has been designed to make the best use of experience data in each position.
As i don't read the C/C++ language and i don't know anyone who can modify the source codes of the private engines,
i coded a tool which drives several engines simultaneous, which chooses the most efficient moves or the moves of the reinforced data or the moves from the opening book.
The move's choice depends on the position of the game, the among/quality of experience data, what contains the opening book, etc.

D.C.S passes UCI commands regarding opening book options to the "book_engine" configured to choose moves from the opening book.
D.C.S passes other UCI commands regarding engines settings to the "playing_engine" configured to analyze the positions, choose moves from the experience file, save new moves and update the experience data, etc.

D.C.S needs an INI file which looks like this :
Image

Throughout this "proof-of-concept" phase, i used Eman 8.40 as playing_engine, asmFish 291118 as book_engine and Depth4_180423.exp as the experience file.
The rest of the D.C.S. features/details remains under NDA...
Post Reply