As in chess tournaments and matches...
deeds
Posts: 1482 Joined: Wed Oct 20, 2021 9:24 pmLocation: France
Contact:
Post
by deeds Sun Mar 05, 2023 9:40 am
original topic
nn depth + 6 plies
Code: Select all
.# PLAYER.............................. : RATING ERROR POINTS PLAYED .(%) ...W ...D ...L D(%) OppAvg OppN
.1 stockfish 210920 classical d24...... : ...714 ...26 .934.5 ..1600 58.4 .466 .937 .197 58.6 ...652 ...2
.2 stockfish 210920 nn-03744f8d56d8 d18 : ...700 ...24 2642.0 ..4800 55.0 1222 2840 .738 59.2 ...664 ...5
.3 stockfish 210920 classical d23...... : ...691 ...27 .779.0 ..1600 48.7 .288 .982 .330 61.4 ...700 ...1
.4 stockfish 210920 classical d22...... : ...659 ...26 .816.0 ..1600 51.0 .342 .948 .310 59.3 ...652 ...2
nn depth + 5 plies
Code: Select all
.5 stockfish 210920 classical d21...... : ...633 ...24 .890.5 ..1600 55.7 .465 .851 .284 53.2 ...588 ...2
.6 stockfish 210920 nn-03744f8d56d8 d16 : ...604 ...22 2638.5 ..4800 55.0 1422 2433 .945 50.7 ...565 ...6
.7 stockfish 210920 classical d20...... : ...594 ...26 .673.0 ..1600 42.1 .237 .872 .491 54.5 ...652 ...2
.8 stockfish 210920 classical d19...... : ...554 ...25 1110.5 ..1600 69.4 .844 .533 .223 33.3 ...302 ...2
nn depth + 4 plies
Code: Select all
.9 stockfish 210920 classical d18...... : ...503 ...22 1185.5 ..1600 74.1 .916 .539 .145 33.7 ...238 ...2
10 stockfish 210920 nn-03744f8d56d8 d14 : ...476 ...19 2649.0 ..4800 55.2 1527 2244 1029 46.8 ...436 ...6
11 stockfish 210920 classical d17...... : ...470 ...23 .650.5 ..1600 40.7 .257 .787 .556 49.2 ...540 ...2
12 stockfish 210920 classical d16...... : ...397 ...24 .504.0 ..1600 31.5 .178 .652 .770 40.8 ...540 ...2
nn depth + 3 plies
Code: Select all
13 stockfish 210920 classical d15...... : ...338 ...19 .709.5 ..1600 44.3 .352 .715 .533 44.7 ...382 ...2
14 stockfish 210920 nn-03744f8d56d8 d12 : ...287 ...14 3276.0 ..4800 68.3 2492 1568 .740 32.7 ...120 ...6
15 stockfish 210920 classical d14...... : ...276 ...20 .584.0 ..1600 36.5 .266 .636 .698 39.8 ...382 ...2
16 stockfish 210920 classical d13...... : ...189 ...16 .886.5 ..1600 55.4 .582 .609 .409 38.1 ...144 ...2
nn depth + 2 plies
Code: Select all
17 stockfish 210920 classical d12...... : ....97 ...15 .710.5 ..1600 44.4 .413 .595 .592 37.2 ...144 ...2
18 stockfish 210920 nn-03744f8d56d8 d10 : .....0 ----- 1567.0 ..4800 32.6 .858 1418 2524 29.5 ...194 ...6
19 stockfish 210920 classical d11...... : ...-11 ...15 .513.0 ..1600 32.1 .266 .494 .840 30.9 ...144 ...2
20 stockfish 210920 classical d10...... : ..-169 ...17 .280.5 ..1600 17.5 .104 .353 1143 22.1 ...144 ...2
Code: Select all
White advantage = 47.52 +/- 1.75
Draw rate (equal opponents) = 50.00 % +/- 0.00
The same tests with sf nn at fixed d20 to d26 against sf classical at fixed d25 to d39 are coming soon...
Last edited by
deeds on Sun Mar 05, 2023 9:44 am, edited 2 times in total.
deeds
Posts: 1482 Joined: Wed Oct 20, 2021 9:24 pmLocation: France
Contact:
Post
by deeds Sun Mar 05, 2023 9:43 am
nn depth + 11 plies
Code: Select all
.# PLAYER.............................. : RATING ERROR POINTS PLAYED .(%) ...W ...D ...L D(%) OppAvg OppN
.1 stockfish 210920 classical d39...... : ...135 ...28 .422.5 ...800 52.8 .117 .611 ..72 76.4 ...115 ...1
.2 stockfish 210920 classical d38...... : ...115 ...27 .400.5 ...800 50.1 ..89 .623 ..88 77.9 ...115 ...1
.3 stockfish 210920 classical d37...... : ...115 ...22 .828.5 ..1600 51.8 .225 1207 .168 75.4 ...102 ...2
.4 stockfish 210920 nn-03744f8d56d8 d26 : ...115 ...20 2876.5 ..5600 51.4 .755 4243 .602 75.8 ...105 ...7
.5 stockfish 210920 classical d36...... : ...103 ...22 .801.0 ..1600 50.1 .195 1212 .193 75.8 ...102 ...2
.6 stockfish 210920 classical d35...... : ....95 ...22 .783.0 ..1600 48.9 .192 1182 .226 73.9 ...102 ...2
nn depth + 10 plies
Code: Select all
.# PLAYER.............................. : RATING ERROR POINTS PLAYED .(%) ...W ...D ...L D(%) OppAvg OppN
.7 stockfish 210920 classical d34...... : ....94 ...21 .780.5 ..1600 48.8 .191 1179 .230 73.7 ...102 ...2
.8 stockfish 210920 nn-03744f8d56d8 d24 : ....90 ...17 2817.0 ..5600 50.3 .762 4110 .728 73.4 ....88 ...7
.9 stockfish 210920 classical d33...... : ....78 ...22 .746.0 ..1600 46.6 .146 1200 .254 75.0 ...102 ...2
10 stockfish 210920 classical d32...... : ....72 ...15 .860.0 ..1600 53.8 .308 1104 .188 69.0 ....45 ...2
nn depth + 9 plies
Code: Select all
.# PLAYER.............................. : RATING ERROR POINTS PLAYED .(%) ...W ...D ...L D(%) OppAvg OppN
11 stockfish 210920 classical d31...... : ....58 ...16 .765.0 ..1600 47.8 .197 1136 .267 71.0 ....73 ...2
12 stockfish 210920 nn-03744f8d56d8 d22 : ....57 ...10 3096.0 ..5600 55.3 1206 3780 .614 67.5 ....18 ...7
13 stockfish 210920 classical d30...... : ....46 ...13 .839.5 ..1600 52.5 .288 1103 .209 68.9 ....28 ...2
14 stockfish 210920 classical d29...... : ....38 ...13 .822.0 ..1600 51.4 .275 1094 .231 68.4 ....28 ...2
15 stockfish 210920 classical d28...... : ....12 ...14 .764.5 ..1600 47.8 .218 1093 .289 68.3 ....28 ...2
nn depth + 7 plies
Code: Select all
.# PLAYER.............................. : RATING ERROR POINTS PLAYED .(%) ...W ...D ...L D(%) OppAvg OppN
16 stockfish 210920 classical d27...... : ....11 ...13 .761.5 ..1600 47.6 .225 1073 .302 67.1 ....28 ...2
17 stockfish 210920 nn-03744f8d56d8 d20 : .....0 ----- 2641.0 ..5600 47.2 .760 3762 1078 67.2 ....21 ...7
18 stockfish 210920 classical d26...... : ....-9 ...13 .717.5 ..1600 44.8 .200 1035 .365 64.7 ....28 ...2
19 stockfish 210920 classical d25...... : ...-27 ...14 .677.5 ..1600 42.3 .156 1043 .401 65.2 ....28 ...2
Code: Select all
White advantage = 53.91 +/- 1.73
Draw rate (equal opponents) = 50.00 % +/- 0.00
One day i will try to connect the 2 testsets but at the moment i'm busy.
deeds
Posts: 1482 Joined: Wed Oct 20, 2021 9:24 pmLocation: France
Contact:
Post
by deeds Sun Mar 05, 2023 9:48 am
In order to connect the 2 previous tests :
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) W D L D(%) OppAvg OppN
1 stockfish 210920 nn-03744f8d56d8 d28 : 0 ---- 4413.0 5600 78.8 3382 2062 156 36.8 -339 7
2 stockfish 210920 classical d38 : -11 17 387.5 800 48.4 77 621 102 77.6 0 1
3 stockfish 210920 classical d39 : -14 17 384.5 800 48.1 76 617 107 77.1 0 1
4 stockfish 210920 nn-03744f8d56d8 d18 : -223 21 182.0 800 22.8 1 362 437 45.3 0 1
5 stockfish 210920 nn-03744f8d56d8 d16 : -312 24 121.5 800 15.2 2 239 559 29.9 0 1
6 stockfish 210920 nn-03744f8d56d8 d14 : -412 29 74.0 800 9.3 0 148 652 18.5 0 1
7 stockfish 210920 nn-03744f8d56d8 d12 : -589 47 29.0 800 3.6 0 58 742 7.3 0 1
8 stockfish 210920 nn-03744f8d56d8 d10 : -809 92 8.5 800 1.1 0 17 783 2.1 0 1
White advantage = 73.08 +/- 4.59
Draw rate (equal opponents) = 50.00 % +/- 0.00
So finally, it shows something like this :
Code: Select all
# PLAYER : RATING ERROR POINTS PLAYED (%) W D L D(%) OppAvg OppN
1 stockfish 210920 nn-03744f8d56d8 d28 : 895 22 4413.0 5600 78.8 3382 2062 156 36.8 544 7
2 stockfish 210920 classical d39 : 887 28 807.0 1600 50.4 193 1228 179 76.8 884 2
3 stockfish 210920 classical d38 : 878 28 788.0 1600 49.3 166 1244 190 77.8 884 2
4 stockfish 210920 classical d37 : 873 31 828.5 1600 51.8 225 1207 168 75.4 860 2
5 stockfish 210920 nn-03744f8d56d8 d26 : 872 29 2876.5 5600 51.4 755 4243 602 75.8 862 7
6 stockfish 210920 classical d36 : 860 32 801.0 1600 50.1 195 1212 193 75.8 860 2
7 stockfish 210920 classical d35 : 852 31 783.0 1600 48.9 192 1182 226 73.9 860 2
8 stockfish 210920 classical d34 : 851 32 780.5 1600 48.8 191 1179 230 73.7 860 2
9 stockfish 210920 nn-03744f8d56d8 d24 : 847 30 2817.0 5600 50.3 762 4110 728 73.4 845 7
10 stockfish 210920 classical d33 : 835 32 746.0 1600 46.6 146 1200 254 75.0 860 2
11 stockfish 210920 classical d32 : 830 34 860.0 1600 53.8 308 1104 188 69.0 802 2
12 stockfish 210920 classical d31 : 815 34 765.0 1600 47.8 197 1136 267 71.0 831 2
13 stockfish 210920 nn-03744f8d56d8 d22 : 814 36 3096.0 5600 55.3 1206 3780 614 67.5 776 7
14 stockfish 210920 classical d30 : 804 38 839.5 1600 52.5 288 1103 209 68.9 786 2
15 stockfish 210920 classical d29 : 796 37 822.0 1600 51.4 275 1094 231 68.4 786 2
16 stockfish 210920 classical d28 : 770 37 764.5 1600 47.8 218 1093 289 68.3 786 2
17 stockfish 210920 classical d27 : 769 37 761.5 1600 47.6 225 1073 302 67.1 786 2
18 stockfish 210920 nn-03744f8d56d8 d20 : 758 35 2641.0 5600 47.2 760 3762 1078 67.2 778 7
19 stockfish 210920 classical d26 : 749 37 717.5 1600 44.8 200 1035 365 64.7 786 2
20 stockfish 210920 classical d25 : 730 37 677.5 1600 42.3 156 1043 401 65.2 786 2
21 stockfish 210920 classical d24 : 703 24 934.5 1600 58.4 466 937 197 58.6 641 2
22 stockfish 210920 nn-03744f8d56d8 d18 : 688 22 2824.0 5600 50.4 1223 3202 1175 57.2 687 6
23 stockfish 210920 classical d23 : 679 25 779.0 1600 48.7 288 982 330 61.4 688 1
24 stockfish 210920 classical d22 : 649 24 816.0 1600 51.0 342 948 310 59.3 641 2
25 stockfish 210920 classical d21 : 625 23 890.5 1600 55.7 465 851 284 53.2 580 2
26 stockfish 210920 nn-03744f8d56d8 d16 : 594 21 2760.0 5600 49.3 1424 2672 1504 47.7 604 7
27 stockfish 210920 classical d20 : 583 24 673.0 1600 42.1 237 872 491 54.5 641 2
28 stockfish 210920 classical d19 : 546 23 1110.5 1600 69.4 844 533 223 33.3 297 2
29 stockfish 210920 classical d18 : 500 22 1185.5 1600 74.1 916 539 145 33.7 236 2
30 stockfish 210920 nn-03744f8d56d8 d14 : 473 18 2723.0 5600 48.6 1527 2392 1681 42.7 498 7
31 stockfish 210920 classical d17 : 464 23 650.5 1600 40.7 257 787 556 49.2 533 2
32 stockfish 210920 classical d16 : 391 22 504.0 1600 31.5 178 652 770 40.8 533 2
33 stockfish 210920 classical d15 : 337 19 709.5 1600 44.3 352 715 533 44.7 380 2
34 stockfish 210920 nn-03744f8d56d8 d12 : 288 13 3305.0 5600 59.0 2492 1626 1482 29.0 230 7
35 stockfish 210920 classical d14 : 275 19 584.0 1600 36.5 266 636 698 39.8 380 2
36 stockfish 210920 classical d13 : 189 15 886.5 1600 55.4 582 609 409 38.1 144 2
37 stockfish 210920 classical d12 : 97 15 710.5 1600 44.4 413 595 592 37.2 144 2
38 stockfish 210920 nn-03744f8d56d8 d10 : 0 ---- 1575.5 5600 28.1 858 1435 3307 25.6 292 7
39 stockfish 210920 classical d11 : -12 15 513.0 1600 32.1 266 494 840 30.9 144 2
40 stockfish 210920 classical d10 : -169 17 280.5 1600 17.5 104 353 1143 22.1 144 2
White advantage = 52.27 +/- 1.17
Draw rate (equal opponents) = 50.00 % +/- 0.00
To beat the net nn-03744f8d56d8 :
- at d10 we need 2 more plies (classsical d12)
- at d16 we need 5 more plies (classsical d21)
- at d22 we need 10 more plies (classsical d32)
- etc
About the net nn-03744f8d56d8 at d28, i expect 15 or 16 more plies (classical d43 or d44)...
elo gain vds depth+5 plies
