SedatChess

[ZamChess]

Thank you Sedat !

[Sedat Canbaz]

Thank you Sedat !

My pleasure Zam

[Sedat Canbaz]

Unofficial Test

Due to request and respect to APOCALYPSE,
Former Champion: SF PRO2 290125 is played..

And now is more clear that,
Under current cond. Kookaburra seems to be best of best!

Code: Select all

Rank Name                Elo    +    - games score oppo. draws 
   1 Kookaburra 3.10    3825    4    4  1170   51%  3818   92% 
   2 Stockfish 020425   3824    4    4  1170   51%  3818   92% 
   3 Omega MPV          3823    4    4  1170   51%  3818   94% 
   4 KillfishPB 110425  3821    4    4  1170   51%  3818   92% 
   5 SF PRO2 290125     3821    4    4  1170   50%  3818   93% 
   6 Corchess 210325    3821    4    4  1170   50%  3818   93% 
   7 SF-X 130425        3820    4    4  1170   50%  3819   93% 
   8 SF PRO2 190325     3820    4    4  1170   50%  3819   92% 
   9 Artemis 12TR       3816    4    4  1170   50%  3819   93% 
  10 HypnoS++ 1.02      3796    4    4  1170   46%  3821   89% 

SF PRO2 290125's Games:
https://pixeldrain.com/u/xNmfxrLi

Greetings

[Sedat Canbaz]

Hello There,

As usual, I am very pleased to announce:
Here is just another New Unofficial Test!

What is New ?
Exactly same cond. as recent LXIII CS is used,
https://sites.google.com/site/computers ... nnue-cs-63
Exception this time UHO 2024 BIG +0.80 +0.99 openings is used!

Reason of running this new test is that,
-Simply to check again the influence of
UHO Openings, which are much less Drawish,
But In same time..they are much more critical,
And much weaker than Unique openings for sure!

Moreover, in the end... we'll have opportunity,
Chances again to check draw ratio, but with close
To +0.80 +0.99 Advantage/Disadvantage openings!

As other very important issue (at least for my side):
For example, if running about 1000+ games (per player)
Is enough or not enough regarding to see real strength ?!
E.g Kookaburra v3.10 via 1000+ games and Unique suite is
Performed as best of best!

Plus via ongoing unofficial test, we can check also
About what will be the Elo Difference e.g via Unique:
All players Elo were less than 10 Elo, exc. Hypnos which
Performed about 25-30 Elo worse than most Top engines!

And I wonder as well, for example, now:
Stockfish 020425 dev. will manage to be Champ?!
Since SF team is highly engaged on tuning etc.
Via various UHO suite series...

Btw (for anyone missed, interested too),
The previous test (via UHO 2022 8mvs +170-179 openings):
https://sites.google.com/site/computers ... t-nn-cs-56

And meanwhile, SCCT (from all independent organizers) seems to be
The World's 1st engine rating, which used to play via UHO openings:
https://sites.google.com/site/computers ... testings-1

And here are the latest results (after 140+ games per player):

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 SF-X 130425                    36      41     144   55.2%   47.9% 
   2 Omega MPV                      24      40     147   53.4%   49.7% 
   3 Kookaburra 3.10                21      39     146   53.1%   52.7% 
   4 Stockfish 020425               16      39     149   52.3%   52.3% 
   5 SF PRO2 190325                  7      36     147   51.0%   59.9% 
   6 Corchess 210325                 5      32     147   50.7%   67.3% 
   7 Artemis 12TR                    0      38     147   50.0%   53.7% 
   8 KillfishPB 110425             -19      35     146   47.3%   61.6% 
   9 HypnoS++ 1.02                 -93      38     145   36.9%   54.5% 

659 of 4680 games finished.

GOOD LUCK TO ALL )

[Sedat Canbaz]

UPDATE 2

And here latest standings after 390+ games per player, where
Omega MPV takes the lead, 2nd Kookaburra, 3rd SF-X 130425

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Omega MPV                      26      23     394   53.7%   55.1% 
   2 Kookaburra 3.10                22      23     397   53.1%   54.9% 
   3 SF-X 130425                    12      23     393   51.8%   53.7% 
   4 Stockfish 020425                9      24     392   51.3%   52.0% 
   5 Corchess 210325                 7      21     393   51.0%   61.8% 
   6 KillfishPB 110425              -4      22     395   49.5%   58.0% 
   7 Artemis 12TR                   -4      23     395   49.5%   56.5% 
   8 SF PRO2 190325                 -4      22     396   49.4%   59.3% 
   9 HypnoS++ 1.02                 -65      23     397   40.8%   55.9% 

1776 of 4680 games finished.

One thing more,
In the end, to see all Whites + Blacks performances..
I hope to create General statistics of both tours too!
E.g with Unique and UHO opening suites

Greetings

[Sedat Canbaz]

UPDATE 3

After 750+ games (per player),
Kookaburra 3.10 takes the lead, but with clear MARGIN!
2nd SF-X 130425 where 3rd belongs to Corchess 210325 and Omega MPV!

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Kookaburra 3.10                22      16     762   53.1%   56.2% 
   2 SF-X 130425                    14      17     759   52.0%   54.3% 
   3 Corchess 210325                11      15     758   51.6%   60.8% 
   4 Omega MPV                      11      16     761   51.6%   55.6% 
   5 Stockfish 020425                8      17     761   51.1%   53.9% 
   6 SF PRO2 190325                  4      16     763   50.6%   60.0% 
   7 KillfishPB 110425               0      17     761   50.0%   54.5% 
   8 Artemis 12TR                   -8      16     760   48.9%   59.1% 
   9 HypnoS++ 1.02                 -63      16     761   41.0%   55.5% 

3423 of 4680 games finished.

[Sedat Canbaz]

BREAKING NEWS
The Unofficial test (with UHO 2024 BIG +0.80 +0.99 openings) is ended..
Where even with more critical lines, Kookaburra is again NUMBER ONE!
But Stockfish 020425 dev performed below than expected..and who knows?
Maybe min 10.000+ games (per player) required, to see real SF dev strength?
Btw, with Unique suite: SF dev performed so good..almost same as Kookaburra!
On other hand, 2nd SF-X 130425, 3rd Corchess 210325 and if we are going to
Compare other stats, HypnoS is again in last place but as main difference is
80+ Elo diff. than 1st and last place, where the rest players about 20 Elo..
I mean there is much diff. if comparing official tour (with Unique suite)
Anyhow, UHO 2024 BIG +0.80 +0.99 seems to be not bad suite..besides
Not so Drawish, as we see, with av. 57% draw ratio, really not high!

The Winner: Kookaburra - My Congratulations to DorsZ, SF team too!

Code: Select all

Rank Name                          Elo     +/-   Games   Score    Draw 
   1 Kookaburra 3.10                21      14    1040   53.1%   55.4% 
   2 SF-X 130425                    17      14    1040   52.5%   53.5% 
   3 Corchess 210325                11      13    1040   51.6%   59.0% 
   4 Stockfish 020425                7      14    1040   51.0%   54.1% 
   5 Omega MPV                       6      14    1040   50.8%   55.3% 
   6 SF PRO2 190325                  3      14    1040   50.4%   58.3% 
   7 KillfishPB 110425               2      14    1040   50.2%   55.9% 
   8 Artemis 12TR                   -2      14    1040   49.7%   58.3% 
   9 HypnoS++ 1.02                 -66      14    1040   40.6%   55.1% 

4680 of 4680 games finished.

GAMES:
https://mega.nz/file/b0JWUJYT#N54m0qzm3 ... sodyaJzn7Q

Conditions:
2x Epyc 7B12, CuteChess, 1 Core, Ponder OFF, 30s+0.5s, 64 Hash, 4-MEN
As openings: UHO 2024 BIG +0.80 +0.99 used, each line re-played twice

And please stay tuned, more info soon as possible,
Plus I hope to create GENERAL STATS of both Tours!

Greetings

[Anton101]

Thank you very much, Sedat, for your incredible work.

However, without detracting from the work Dorsz has done, this contradicts the metrics on the following page.

Something doesn't add up.

No offense to anyone: https://nextchessmove.com/dev-builds

Best regards!

[Sedat Canbaz]

Thank you very much, Sedat, for your incredible work.

However, without detracting from the work Dorsz has done, this contradicts the metrics on the following page.

Something doesn't add up.

No offense to anyone: https://nextchessmove.com/dev-builds

Best regards!

Dear Anton,

You are welcome and nice to read your valuable comments!

On other hand,
If you are meaning regarding the test via UHO opening suite,
You've right such as SF dev improvements did not work much!

But in the Official tour (via Unique opening suite),
SF 020425 dev. improvement seems to be better...!
Otherwise I hardly doubt to be ranked in 2nd place!

By the way,
if you're going to ask my view: why SF performed worse via UHO?
It's hard to know the true but often SF team's pre Elo diagrams,
- Does not reflect much to reality...at least under SCCT's cond. !

And just a few more words about SCCT conditions,
Hyper-Threading disabled, Large-Pages disabled,
Almost daily speed benchmarks to see stability, plus
Hash-table tests done, e.g to see which is best etc.

In other words,
Instead of SF' Team Elo diagrams, I'd prefer to rely mainly on
SCCT Hardware, Tournament Conditions, Improvements etc. !

Greetings )

[Sedat Canbaz]

As FINAL Conclusion:

1st of all, it is ALWAYS your CHOICE and
You can appreciate any standıng which you like more !)

But anyhow, according to my experience:
Definitely the standings via Unique suites represent better, more
Useful data (than UHO suite) to our actual chess reality... and why?
Because no so HUGE Elo differences between these Top engines!
Note: Sure here I refer about the Elo diff. for the test via UHO suite..
Moreover, Chess is a game for two sides..fl not clear: not mainly for 'Whites'!
As clear proof, please check UHO's win. percentages...almost all by WHITES!

What I can say more,
-Via Unique openings: better quality, more correct, safer!
-Via UHO openings: more FUN, more exciting, but a mystery
Eng strength, especially if the number of games is small !
For this, it's required many thousands of games (per player)
Otherwise, just a waste of time...because 'time' is money!

That's all for now and thanks for your interest... )


Best,
Sedat