deeds_chess_system

As in chess tournaments and matches...
Sedat Canbaz
Posts: 2289
Joined: Wed Jun 21, 2023 6:29 am

Re: opening book vs experience file

Post by Sedat Canbaz »

deeds wrote: Wed Jun 21, 2023 7:22 pm And it was only a little "warmup" with Eman only set by default (=training mode).
I didn't even need to use the experience file as a book so Depth4_190623.exp often had less time to play.

But hey, I'm nice, the games are available...

For engine trainers :
Image
Yes, you read well !
From the start position (=no opening moves or others), with only 80% of conformity with the experience data of Depth4_190623.exp, it was enough to draw it.
Game are available.. hehe...

Please just do not try to FOOLl Me .. OK ?
The way, which I work since many years...
Believe Me...You even did not start!

Games ? you are really very funny...)))
Even if they are available...in PGN, CBH etc.
it does not mean that:
Your current played match conditions are fair....

Why you do not share your exp file ?
Where other chess friends may benefit...

Be generous at least once...
hungtranvn
Posts: 21
Joined: Sun Jul 03, 2022 2:58 am
Real Name: Tran Hung

Re: deeds_chess_system

Post by hungtranvn »

Dear Deeds
Why are you using Eman 8.40 and not using a newer version, or another engine.
Can I use Little Beast 3 sl with Eman experience?
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

hungtranvn wrote: Thu Jun 22, 2023 5:01 am Dear Deeds
Why are you using Eman 8.40 and not using a newer version, or another engine.
Sorry but i'm training 5 different engines at the time and i trained until 6 different engines if i count JudaS...

hungtranvn wrote: Thu Jun 22, 2023 5:01 am Dear Deeds
Why are you using Eman 8.40 and not using a newer version, or another engine.
Because :
- since the Normalize evaluation patch of Nov 5, 2022, the scores of Eman 8.50 (and newer release) are based on a WDL model (based on fishtest's games = Stockfish selfplay)
- this WDL model is not very accurate
- this WDL model is modified several times/year
- at this period (November, 2022), i had already got between 14M to 17M "pawn-based" Eman scores and i don't want to pollule my Eman.exp file with "ephemeral wdl-based" scores from Stockfish selfplay games
- depending on the chosen opening list, learning engines showed gains from +50 to +200 elo and since there aren't +50 elo difference between Eman 8.40 and Eman 8.92, there wasn't urgency to loose the fruits of my 7 learning sessions
- i reinforced (and i'm reinforcing yet) at D40 the experience data of Eman 8.40 which has proven its fantastic resistance on odd TC and against books, here again, there wasn't urgency
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

hungtranvn wrote: Thu Jun 22, 2023 5:01 am Can I use Little Beast 3 sl with Eman experience?
I advise you to use a non-merged experience file trained by its own engine.

There are already too many unfair people like :
- Alex who merged igor.exp (eman engine) with sarona.exp (sarona engine) and renamed it to ProteusSF.exp
- Sedat who renamed Khalid's eman.exp to StockfishMZ.exp
- Sedat who renamed ProteusSF.exp to StockfishMZ.exp
- etc
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: opening book vs experience file

Post by deeds »

hardware : dual xeon e5-2660v3
software : cutechess 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : GHPPN's 15 most popular openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L   D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :       0     92    15.0      30  50.0    0   30    0  100.0       0     1
   2 hcanfree-upd.bin (Eman 8.40)     :       0   ----    15.0      30  50.0    0   30    0  100.0       0     1

White advantage = 0.00 +/- 46.89
Draw rate (equal opponents) = 50.00 % +/- 0.00
link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw
hungtranvn
Posts: 21
Joined: Sun Jul 03, 2022 2:58 am
Real Name: Tran Hung

Re: deeds_chess_system

Post by hungtranvn »

Thanks a lot.
But I use the Little Beast 3 SL with the new Experience File from the beginning, not Merged Experience File, according to you, is it good?
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

If your engine manages to learn, that's the basis.

Then :

- if your engine scores are based on an ephemeral WDL model, each new WDL model will pollute more and more your experience file.
I know at least one engine trainer in this situation => he no longer updates his engine at training.

- if your engine scores are based on the pawn value, as it is an international standard fixed value, no problem.
The pawn-based scores are intelligible, comparable between most databases/experience files/chess literature, editable by all the tools that I have already "generously shared at least 27 times" on github.

Good training !
hungtranvn
Posts: 21
Joined: Sun Jul 03, 2022 2:58 am
Real Name: Tran Hung

Re: deeds_chess_system

Post by hungtranvn »

Dear Deeds!
I decided to use Eman 8.40, but when I find it again, some old links are dead, can you send it to me?
Thank you very much
User avatar
deeds
Posts: 1493
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: deeds_chess_system

Post by deeds »

Known limitations with Eman 8.40 :

- [bug] moves like Ra1-b1, Ra1-c1, etc. are not always written in Eman.exp
- [net] latest compatible network is nn-e1fb1ade4432 (22-04-2023)
- [exp] "SugaR Experience version 2" file format. If the experience file is written under the old v1 format => Eman will convert it to v2 at startup
- [exp] max filesize checked until 10 GB, 450M moves, etc. (see 22pieces_d10.exp)
- [cutechess-cli] concurrency=1 (Eman only reads/writes an unique exp file at the time). Create a learning farm for several Eman's instances at the time.
- [hash] min hash 1 GB when engine has to load/save an exp file

If you agree with all that, here is the link.

Good training !
hungtranvn
Posts: 21
Joined: Sun Jul 03, 2022 2:58 am
Real Name: Tran Hung

Re: deeds_chess_system

Post by hungtranvn »

Unexpectedly, Eman 8.40 had so many errors, I didn't know how to fix it so I could consider using new versions.
I have Experience File Depth 43 of Sugar AI, update to November 2021, but do not know how to take advantage of it, because I don't use Sugar AI anymore
Thank you very much
Post Reply