opening book vs experience file
Re: opening book vs experience file
Why did you choose a TC 1m+1s ?
It favors better the engine with the opening book, examples :
- with a TC 1m+1s, if the engine plays 30 book's moves, it increments its clock by 30s => +50% more time.
- with a TC 4m+2s, if the engine plays 30 book's moves, it increments its clock by 60s => +25% more time.
You should know that :
- in chess, the perfect game is a draw so the more time you give the engines the less difference there will be between them.
- even if the engine was trained with a TC 1m+1s on 7 threads, its learned experience data is really very resilient.
It favors better the engine with the opening book, examples :
- with a TC 1m+1s, if the engine plays 30 book's moves, it increments its clock by 30s => +50% more time.
- with a TC 4m+2s, if the engine plays 30 book's moves, it increments its clock by 60s => +25% more time.
You should know that :
- in chess, the perfect game is a draw so the more time you give the engines the less difference there will be between them.
- even if the engine was trained with a TC 1m+1s on 7 threads, its learned experience data is really very resilient.
Last edited by deeds on Sun Mar 05, 2023 8:44 am, edited 1 time in total.
Re: opening book vs experience file
How was the experience file trained ?
Initially, i trained Eman on the openings where he had lost during my reference tournament (100 openings from salc_v3_10moves).
Then i trained Eman on the openings where the other engines did better (ex : eman drew when others won, eman lost when others drew, etc).
After each tournament, Eman analyzed its defeats at 10min/move then also the defeats of the other engines.
It's no longer a secret but learned data is better when an engine trains against several opponents because it faces different styles of play.
Since 2 years at 24/7 on few hosts, Eman trains until 4 sparring-partners who also have a learning feature so they don't repeat the same bad lines and try new ones.
Initially, i trained Eman on the openings where he had lost during my reference tournament (100 openings from salc_v3_10moves).
Then i trained Eman on the openings where the other engines did better (ex : eman drew when others won, eman lost when others drew, etc).
After each tournament, Eman analyzed its defeats at 10min/move then also the defeats of the other engines.
It's no longer a secret but learned data is better when an engine trains against several opponents because it faces different styles of play.
Since 2 years at 24/7 on few hosts, Eman trains until 4 sparring-partners who also have a learning feature so they don't repeat the same bad lines and try new ones.
Re: opening book vs experience file
What does reinforced experience data mean ?
reinforced = analyzed with greater depth / more time
When the engines train, they try several moves and depending on their efficiency, they forget them more or less quickly.
It generates some 'secondary' experience data which contains moves with shallow depth => imprecise evaluation.
In addition, depending on the TC and the threads number, the average depth is not very high so the resistance of the experience data is less important.
So it is necessary to reinforce this 'secondary' experience data by analyzing the moves which have a shallow depth.
For example, i analyzed at D40 all the moves of a hundred lines for each trained opening.
It improved the resilience of experience data.
reinforced = analyzed with greater depth / more time
When the engines train, they try several moves and depending on their efficiency, they forget them more or less quickly.
It generates some 'secondary' experience data which contains moves with shallow depth => imprecise evaluation.
In addition, depending on the TC and the threads number, the average depth is not very high so the resistance of the experience data is less important.
So it is necessary to reinforce this 'secondary' experience data by analyzing the moves which have a shallow depth.
For example, i analyzed at D40 all the moves of a hundred lines for each trained opening.
It improved the resilience of experience data.
Re: opening book vs experience file
hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men
Opening list : startpos
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men
Opening list : startpos
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) W D L D(%) OppAvg OppN
1 Depth4_190623.exp (Eman 8.40) : 0 49 50.0 100 50.0 0 100 0 100.0 0 1
2 hcanfree-upd.bin (Eman 8.40) : 0 ---- 50.0 100 50.0 0 100 0 100.0 0 1
White advantage = 0.00 +/- 25.05
Draw rate (equal opponents) = 50.00 % +/- 0.00
pass : 59Ef9tOGT1RCBGYgpMTuzw
-
- Posts: 1978
- Joined: Wed Jun 21, 2023 6:29 am
Re: opening book vs experience file
Sorry to say that,deeds wrote: ↑Tue Jun 20, 2023 8:55 pmhardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men
Opening list : startposlink : gamesCode: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) W D L D(%) OppAvg OppN 1 Depth4_190623.exp (Eman 8.40) : 0 49 50.0 100 50.0 0 100 0 100.0 0 1 2 hcanfree-upd.bin (Eman 8.40) : 0 ---- 50.0 100 50.0 0 100 0 100.0 0 1 White advantage = 0.00 +/- 25.05 Draw rate (equal opponents) = 50.00 % +/- 0.00
pass : 59Ef9tOGT1RCBGYgpMTuzw
On what kind of planet do you live ? if not so clear:
You are running via completely unfair conditions!
Private vs Public.. hehe ))
Come on SCCT conditions...and let's see
Under real Arena.. what is going on...!
Re: opening book vs experience file
And it was only a little "warmup" with Eman only set by default (=training mode).
I didn't even need to use the experience file as a book so Depth4_190623.exp often had less time to play.
But hey, I'm nice, the games are available...
For engine trainers :
Yes, you read well !
From the start position (=no opening moves or others), with only 80% of conformity with the experience data of Depth4_190623.exp, it was enough to draw it.
I didn't even need to use the experience file as a book so Depth4_190623.exp often had less time to play.
But hey, I'm nice, the games are available...
For engine trainers :
Yes, you read well !
From the start position (=no opening moves or others), with only 80% of conformity with the experience data of Depth4_190623.exp, it was enough to draw it.
-
- Posts: 1978
- Joined: Wed Jun 21, 2023 6:29 am
Re: opening book vs experience file
Game are available.. hehe...deeds wrote: ↑Wed Jun 21, 2023 7:22 pmAnd it was only a little "warmup" with Eman only set by default (=training mode).
I didn't even need to use the experience file as a book so Depth4_190623.exp often had less time to play.
But hey, I'm nice, the games are available...
For engine trainers :
Yes, you read well !
From the start position (=no opening moves or others), with only 80% of conformity with the experience data of Depth4_190623.exp, it was enough to draw it.
Please just do not try to FOOLl Me .. OK ?
The way, which I work since many years...
Believe Me...You even did not start!
Games ? you are really very funny...)))
Even if they are available...in PGN, CBH etc.
it does not mean that:
Your current played match conditions are fair....
Why you do not share your exp file ?
Where other chess friends may benefit...
Be generous at least once...
Re: opening book vs experience file
hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men
Opening list : GHPPN's 15 most popular openings
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men
Opening list : GHPPN's 15 most popular openings
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) W D L D(%) OppAvg OppN
1 Depth4_190623.exp (Eman 8.40) : 0 92 15.0 30 50.0 0 30 0 100.0 0 1
2 hcanfree-upd.bin (Eman 8.40) : 0 ---- 15.0 30 50.0 0 30 0 100.0 0 1
White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00
pass : 59Ef9tOGT1RCBGYgpMTuzw
Re: opening book vs experience file
But no one wants to steer results like you ! looolSedat Canbaz wrote: ↑Wed Jun 21, 2023 7:52 pmPlease just do not try to FOOLl Me .. OK ?
The way, which I work since many years...
Believe Me...You even did not start!
You don't even know how to measure which book has the best variety, you don't even know how many openings are covered or not by the books, you don't even know which book contains the most moves on a particular opening, etc.
Re: opening book vs experience file
People already know what you did several times :Sedat Canbaz wrote: ↑Wed Jun 21, 2023 7:52 pmGames ? you are really very funny...)))
Even if they are available...in PGN, CBH etc.
it does not mean that:
Your current played match conditions are fair....
So don't mess with me about fair conditions !
As long as you set learning engines in training mode (default settings) to make your unfair 1vs12 tourneys, you will never have any credibility in learning engines sphere.