EN-Tournament

As in chess tournaments and matches...
Post Reply
Eduard Nemeth
Posts: 632
Joined: Thu Jun 10, 2010 12:50 am

EN-Tournament

Post by Eduard Nemeth » Wed Jul 05, 2023 9:42 am

NEW:

05. July 2023: EN-Tournament - Tournament mode engine test started!
This test makes it possible to estimate the tournament playing strength of an engine within one day. From various sources, I have selected 100 short variants of the most important openings, which also occur in the games on the well-known servers (Lichess, InfinityChess, PlayChess.com). I've even left out some of the most played lines, because 99% of the games end in a draw. At the last InfinityChess Engine-Masters tournament, only 12 variations were allowed, where White had an advantage of +0.80 each (Stockfish analysis). This advantage was enough to win 4 games out of 120 played (I didn't include losses due to operator error and disconnects). This is the trend today in computer chess on the servers! But as long as there are such tournaments there, as well as such engine game rooms where all possible opening books are allowed in freestyle mode, I will test the engines for such games!

Download 100 short variants (CBH and PGN format) as "EN-Tournament":
https://solistachess.jimdosite.com/testing/
Pixeldrain & Filehorst.de

My settings in tournament mode:

Threads - Either Ryzen 3900X or Ryzen 2700, 6 threads per engine.
GUI Fritz 18 - Offline I use Fritz 18 and play in ENG-ENG mode.
Hashtables - 128 MB (Bullet) to 1024 MB (Blitz 5 Min).
Ponder ON (Permanent Brain) - Ponder ON is also played on all 3 servers.
3456men Syzygy - All types of databases can be used on all servers.
Time control - 2 to 5 minutes, 0s to 3s bonus time, offline I use 0.1s bonus.
MoveOverhead - The engine should not lose on time forfeit - Offline I use 100ms for Stockfish.
Opening Book - Offline I use EN-Tournament.cbh with color swap, 200 games in total.

First test: Stockfish 16-avx2 vs Stockfish dev 010723-avx2
Hardware Ryzen 2700, hash 512 MB, time control 5m + 0.1s

Final result: +5 =191 -4 as seen by Stockfish 16.

Stockfish 16 narrowly won. If there is only one loss difference, the playing strength is equally good. SF 16 uses a smaller NNUE network otherwise the engines are identical.

Download all 200 games in PGN:
https://pixeldrain.com/u/SXEHBWHP

Live:
Image
Peace be with you!

User avatar
deeds
Posts: 1008
Joined: Wed Oct 20, 2021 9:24 pm
Location: France
Contact:

Re: EN-Tournament

Post by deeds » Wed Jul 05, 2023 12:02 pm

Eduard Nemeth wrote:
Wed Jul 05, 2023 9:42 am
...White had an advantage of +0.80 each (Stockfish analysis). This advantage was enough to win 4 games out of 120 played (I didn't include losses due to operator error and disconnects)...
As expected, +0.80 => 3% win rate when SF Team believes +1.00 => 50% win rate :lol:

Eduard Nemeth
Posts: 632
Joined: Thu Jun 10, 2010 12:50 am

Re: EN-Tournament

Post by Eduard Nemeth » Fri Jul 07, 2023 1:20 pm

Little Beast is my own SF Clone Engine which you can download on "Chess Engines Diary". Jorn Gronemann has used this engine several times in his tournaments on ChessEnginesDiary and Little Beast has even won several of these tournaments. So it's not only my tets that prove that this engine plays very well.

After Stockfish 16 won +1 against Stockfish 010723 (net size 1536 at SF 16 and 2048 at SF 010723), I wanted to know how a match against Little Beast would end. I implemented the new 2048 network at Little Beast, resulting in version 7.

07. May 2023: Stockfish 16 (use 1536 NNUE) vs Little Beast 7 sl (use now new 2048 NNUE)
Hardware Ryzen 2700, hash 512 MB, time control 5m + 0.1s

Final result: +3 =191 -6 as seen by Stockfish 16.
Download all 200 games in PGN:
https://pixeldrain.com/u/Y4MdG2YZ
Peace be with you!

Sedat Canbaz
Posts: 1978
Joined: Wed Jun 21, 2023 6:29 am

Re: EN-Tournament

Post by Sedat Canbaz » Fri Jul 07, 2023 3:49 pm

Hello Eduard,

Many thanks...

About LittleBeast,
I like it much...very very strong..
And fully deserves its name!!

Keep up the good work!

Best,
Sedat

Post Reply