deeds_chess_system

deeds · Post by **deeds** » Sat Jul 01, 2023 4:44 am

------------
Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations of the OpenChess Forum Rules will not be tolerated.

Thanks,

Best regards, Moderation.
------------

In conclusion, we therefore have Sedat :
- who renamed an experience file without seeing the problem
- who didn't know what proportion of data from Eman or from StockfishMZ is in the renamed experience file
- who didn't know experience files are constantly growing (that's why we give a date for a filesize for a same file)
- who didn't know where to find the updated version
- etc

Sedat Canbaz · Post by **Sedat Canbaz** » Sat Jul 01, 2023 5:48 am

------------
Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations of the OpenChess Forum Rules will not be tolerated.

Thanks,

Best regards, Moderation.
------------

1st of all, and once more:

...
SF based engines should be renamed as Stockfish A, B, C etc.

And believe me..If you'll follow...nothing bad with that..
You will gain, not Me...and sometimes it will be not so
Bad idea to look at yourself at the mirror as well !
Anyhow no BIG problem for my side, I can live with that !)

Bye, bye ))

deeds · Post by **deeds** » Sat Jul 01, 2023 6:51 am

------------
Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this topic or others in the Forum. Further recurrent violations of the OpenChess Forum Rules will not be tolerated.

Thanks,

Best regards, Moderation.
------------

.... when the evidence exists it's harder to dispute them. ... we still have files, screenshots, download links, and stats !

A good thing done.

Sedat Canbaz · Post by **Sedat Canbaz** » Sat Jul 01, 2023 7:52 am

------------
Notice:

This post in this topic has been reviewed and edited because it violated the OpenChess Forum Rules. This is a gentle reminder not to continue flaming this thread or others in the Forum. Further recurrent violations of the OpenChess Forum Rules will not be tolerated.

Thanks,

Best regards, Moderation.
------------

deeds wrote: Sat Jul 01, 2023 6:51 am ...we still have files, screenshots, download links, and stats !

A good thing done.

What is your goal ? just because exp file is lost to books...
And you've done your best for looking holes over my work..
But without any success so far...

deeds · Post by **deeds** » Sat Jul 01, 2023 11:10 am

As often, before making a match you have to study your opponent. Take for example, an engine trainer who wants to test his experience file against an opening book.

1°) Which openings are covered by the experience file ?
Normally, the trainer knows which openings he has trained but he rarely knows how many moves his experience file contains for each opening.
In this case, he can use expRate to get something like this (Depth4_180423.exp, 20 first moves) :

Code: Select all

a2a3 : ...97 480 moves, avg. D09, 015 counts/move
a2a4 : ...83 281 moves, avg. D09, 020 counts/move
b2b3 : 1 000 000 moves, avg. D33, 041 counts/move
b2b4 : ...58 264 moves, avg. D10, 020 counts/move
c2c3 : ..948 646 moves, avg. D20, 032 counts/move
c2c4 : 1 000 000 moves, avg. D30, 061 counts/move
d2d3 : ..318 084 moves, avg. D21, 041 counts/move
d2d4 : 1 000 000 moves, avg. D31, 060 counts/move
e2e3 : 1 000 000 moves, avg. D32, 066 counts/move
e2e4 : 1 000 000 moves, avg. D35, 070 counts/move
f2f3 : ..582 298 moves, avg. D26, 065 counts/move
f2f4 : ...94 344 moves, avg. D19, 048 counts/move
g2g3 : 1 000 000 moves, avg. D30, 066 counts/move
g2g4 : 1 000 000 moves, avg. D26, 070 counts/move
h2h3 : ...48 119 moves, avg. D15, 031 counts/move
h2h4 : 1 000 000 moves, avg. D33, 087 counts/move
b1a3 : ...30 255 moves, avg. D13, 038 counts/move
b1c3 : 1 000 000 moves, avg. D36, 076 counts/move
g1f3 : 1 000 000 moves, avg. D30, 060 counts/move
g1h3 : ...52 811 moves, avg. D20, 062 counts/move

Experience Rate : 100%

2°) Which openings are covered by the opening book ?
Normally, the book author who manually tunes his opening book knows which openings it contains.
I suspect it's not often the case for the book author who import moves from games.
In this case, he can use openingRate to get something like this (Leschats14062023.bin, 20 first moves) :

Code: Select all

a2a3 : 10 000 moves
a2a4 : 10 000 moves
b2b3 : 10 000 moves
b2b4 : 10 000 moves
c2c3 : 10 000 moves
c2c4 : 10 000 moves
d2d3 : 10 000 moves
d2d4 : 10 000 moves
e2e3 : 10 000 moves
e2e4 : 10 000 moves
f2f3 : .....5 moves
f2f4 : 10 000 moves
g2g3 : 10 000 moves
g2g4 : .....7 moves
h2h3 : 10 000 moves
h2h4 : 10 000 moves
b1a3 : ...225 moves
b1c3 : 10 000 moves
g1f3 : 10 000 moves
g1h3 : ....78 moves

Opening Rate : 80%

3°) Then he compares the 2 analyses :

The engine trainer immediately sees where his opponent's weak points are.
Then, it will be enough to make a few rounds to snatch a victory against the opening book.

deeds · Post by **deeds** » Sun Jul 02, 2023 9:16 am

cubail wrote: Fri Jun 30, 2023 7:06 pm https://pixeldrain.com/u/XGmN1eAF

ProteusSF JBE 007 (BrainLearn) = experience.bin (BIN experience file format)
ProteusSF RBE 008 (SugaR, StockfishMZ, etc.) = proteussf.exp ("SugaR Experience version 2" EXP experience file format)

deeds · Post by **deeds** » Sun Jul 02, 2023 1:50 pm

Here is a small experiment to confirm that experience data is lost with several Eman engines reading/writing at the same time on a single EXP file.

Part 1/2
D.C.S. Concurrent EXP set to false (=only one EXP file for all engines)
Concurrency 5 (10 x Eman's instances)

In order to reduce Eman's crashes with concurrency>1, i use these scripts/tools :

[engines.json]

Code: Select all

{
	"command" : "deeds_chess_system.exe",
	"name" : "deeds_chess_system1",
	"options" : [
		{
			"alias" : "",
			"default" : 0,
			"max" : 100,
			"min" : -100,
			"name" : "Contempt",
			"type" : "spin",
			"value" : 0
		},
		{
			"alias" : "",
			"default" : 1,
			"max" : 1024,
			"min" : 1,
			"name" : "Threads",
			"type" : "spin",
			"value" : 1
		},
		{
			"alias" : "",
			"default" : 16,
			"max" : 33554432,
			"min" : 1,
			"name" : "Hash",
			"type" : "spin",
			"value" : 16
		},
		{
			"alias" : "",
			"default" : false,
			"name" : "DCS Concurrent EXP",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : "Eman.exp",
			"name" : "Experience File",
			"type" : "file",
			"value" : "Eman.exp"
		},
		{
			"alias" : "",
			"default" : false,
			"name" : "Experience Read Only",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : true,
			"name" : "Experience MultiPV",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : false,
			"name" : "Experience Book",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : 16,
			"max" : 100,
			"min" : 1,
			"name" : "Experience Book Max Moves",
			"type" : "spin",
			"value" : 100
		},
		{
			"alias" : "",
			"default" : "<internal>",
			"name" : "NNUE Eval File",
			"type" : "file",
			"value" : "nn-e1fb1ade4432.nnue"
		},
		{
			"alias" : "",
			"default" : 10,
			"max" : 5000,
			"min" : 0,
			"name" : "Move Overhead (ms)",
			"type" : "spin",
			"value" : 1000
		},
		{
			"alias" : "",
			"default" : "Eman.bin",
			"name" : "Book 1 File",
			"type" : "file",
			"value" : "<empty>"
		},
		{
			"alias" : "",
			"default" : "<empty>",
			"name" : "SyzygyPath",
			"type" : "folder",
			"value" : "E:/JEUX/ARENA CHESS 3.5.1/TB/Syzygy;C:/Syzygy"
		}
	],
	"protocol" : "uci",
	"stderrFile" : "",
	"whitepov" : true,
	"variants" : [
		"standard",
		"fischerandom"
	],
	"workingDirectory" : "E:\\JEUX\\CUTECHESS GUI\\moteurs\\deeds_chess_system"
}

Code: Select all

{
	"command" : "deeds_chess_system.exe",
	"name" : "deeds_chess_system2",
	"options" : [
		{
			"alias" : "",
			"default" : 0,
			"max" : 100,
			"min" : -100,
			"name" : "Contempt",
			"type" : "spin",
			"value" : 0
		},
		{
			"alias" : "",
			"default" : 1,
			"max" : 1024,
			"min" : 1,
			"name" : "Threads",
			"type" : "spin",
			"value" : 1
		},
		{
			"alias" : "",
			"default" : 16,
			"max" : 33554432,
			"min" : 1,
			"name" : "Hash",
			"type" : "spin",
			"value" : 16
		},
		{
			"alias" : "",
			"default" : false,
			"name" : "DCS Concurrent EXP",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : "Eman.exp",
			"name" : "Experience File",
			"type" : "file",
			"value" : "Eman.exp"
		},
		{
			"alias" : "",
			"default" : false,
			"name" : "Experience Read Only",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : true,
			"name" : "Experience MultiPV",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : false,
			"name" : "Experience Book",
			"type" : "check",
			"value" : false
		},
		{
			"alias" : "",
			"default" : 16,
			"max" : 100,
			"min" : 1,
			"name" : "Experience Book Max Moves",
			"type" : "spin",
			"value" : 100
		},
		{
			"alias" : "",
			"default" : "<internal>",
			"name" : "NNUE Eval File",
			"type" : "file",
			"value" : "nn-e1fb1ade4432.nnue"
		},
		{
			"alias" : "",
			"default" : 10,
			"max" : 5000,
			"min" : 0,
			"name" : "Move Overhead (ms)",
			"type" : "spin",
			"value" : 1000
		},
		{
			"alias" : "",
			"default" : "Eman.bin",
			"name" : "Book 1 File",
			"type" : "file",
			"value" : "<empty>"
		},
		{
			"alias" : "",
			"default" : "<empty>",
			"name" : "SyzygyPath",
			"type" : "folder",
			"value" : "E:/JEUX/ARENA CHESS 3.5.1/TB/Syzygy;C:/Syzygy"
		}
	],
	"protocol" : "uci",
	"stderrFile" : "",
	"whitepov" : true,
	"variants" : [
		"standard",
		"fischerandom"
	],
	"workingDirectory" : "E:\\JEUX\\CUTECHESS GUI\\moteurs\\deeds_chess_system"

concurrency 5 x Eman vs Eman => 10 Eman's instances => 10 concurrent reads/writes on the same Eman.exp file

merging PGN file

Only one Eman's crash on instance #2 (1. c3 {book}) so 39 games on 40 expected.

About Eman.exp :

Who think this Eman.exp contains all the moves from all the 39 games ?

deeds · Post by **deeds** » Mon Jul 03, 2023 10:44 am

Part 2/2
D.C.S. Concurrent EXP set to true (=a distinct EXP file for each engine)
Concurrency 5 (10 x Eman's instances)

In order to reduce Eman's crashes with concurrency>1, i use these scripts/tools :

[engines.json]
sames as above

concurrency 5 x Eman vs Eman => 10 Eman's instances => 10 concurrent reads/writes on distinct Eman_xxxxx.exp files

merging PGN file

Only one Eman's crash on instance #5 (1. Na3 {book}) so 39 games on 40 expected.

merging distinct EXP files

About Eman.exp :

Who think this Eman.exp doesn't contain all the moves from all the 39 games ?

deeds · Post by **deeds** » Mon Jul 03, 2023 10:55 am

link : games, scripts, exp files
only for friends and family (request password and information by PM)

deeds · Post by **deeds** » Wed Jul 05, 2023 7:46 am

hardware : dual xeon e5-2660v3
software : cutechess-gui 1.2.0
settings : TC 60s+1s, 40 threads, hash 4096 MB, partial syzygy 7men

Opening list : Jeroen Noomen's 50 tcec season 22 superfinal openings

Code: Select all

   # PLAYER                           :  RATING  ERROR  POINTS  PLAYED   (%)    W    D    L  D(%)  OppAvg  OppN
   1 Depth4_190623.exp (Eman 8.40)    :     113     56    64.0     100  64.0   31   66    3  66.0       0     1
   2 hcanfree-upd.bin (Eman 8.40)     :       0   ----    36.0     100  36.0    3   66   31  66.0     113     1

White advantage = 119.59 +/- 29.37
Draw rate (equal opponents) = 50.00 % +/- 0.00

link : games
pass : 59Ef9tOGT1RCBGYgpMTuzw

OpenChess

OpenChess

deeds_chess_system

Re: opening book vs experience file

Re: opening book vs experience file

Re: opening book vs experience file

Re: opening book vs experience file

Re: opening book vs experience file

Re: opening book vs experience file

Re: deeds_chess_system

Re: deeds_chess_system

Re: deeds_chess_system

Re: opening book vs experience file