Houdini 2.0 Pro WTNP testing

[robbolito]

Intel(R) Core(TM) i7 Q- 960 3.20 GHz8x @ 4.00 GHz 18.00 MB Memory
Windows 7 Professional Professional (Build 7600)
Fritz Benchmarks:
Speed: 24.89
KNS: 11946
GUI: CB Rybka 3
Hash: 256
Book: Perfect 2011 -10 moves
GTB: ON
Ponder: OFF
Blitz:10' 0

Code: Select all

1   Houdini 2.0 Pro x64      3195  +17/-10/=33 55.83%   33.5/60
2   Critter 1.2 64-bit SSE4  3190  +10/-17/=33 44.17%   26.5/60

[robbolito]

Intel(R) Core(TM)2 Quad Q9550 2.83GHz4x @3.5 GHz 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 20.90
KNS: 10032
GUI: CB Rybka 3
Book: Perfect 2011-10 moves
Hash: 256
GTB and TB: ON
Ponder: OFF
Blitz:10' 0

Code: Select all

1   Houdini 2.0 Pro x64  3195  +54/-17/=49 65.42%   78.5/120
2   Deep Rybka 4.1 x64   3190  +17/-54/=49 34.58%   41.5/120

[robbolito]

AMD Phenom(tm) II X6 1090T Processor x6 @3.80 GHz 8.00 MB Memory
Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 28.33
KNS: 13599
GUI: CB Rybka 3
Book: Perfect 2011-10 moves
Hash: 256
GTB and TB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0 Pro x64L      3195  +144/-73/=201 58.49%  244.5/418
2   Deep Rybka 4.1 SSE42 x64  3190  +73/-144/=201 41.51%  173.5/418

[robbolito]

Intel(R) Core(TM) i5 Q- 750 @2.67 GHz 6.00 GB Memory
Windows 7.x64 Professional (Build 7600)
Fritz Benchmarks:
Speed:16.84
KNS: 8082
GUI: CB Rybka 3
Hash: 256
Book: Perfect 2011-10 moves
TB and GTB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0 Pro x64L      3195  +298/-112/=340 62.40%  468.0/750
2   Deep Rybka 4.1 SSE42 x64  3190  +112/-298/=340 37.60%  282.0/750

[robbolito]

Intel(R) Core(TM)2 Quad Q9550 2.83GHz4x @3.5 GHz 4,096 MB Memory
Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 20.90
KNS: 10032
GUI: CB Rybka 3
Book: Perfect 2011-10 moves
Hash: 256
TB and GTB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0 Pro x64L  3195  +352/-83/=301 68.27%  502.5/736
2   Deep Rybka 4.1 x64    3190  +83/-352/=301 31.73%  233.5/736

[kingliveson]

Thanks robbolito for the tests; you have always been kind to providing games whenever requested so personally, I dont need to see them -- just want to make some observations.

Elo difference amongst the different systems between Rybka 4.1 and Houdini 2.0:

AMD Phenom(tm) II X6 1090T: 60
Intel(R) Core(TM) i5 Q- 750: 88
Intel(R) Core(TM)2 Quad Q9550: 133

It is normal for one program to do better on certain architectures, but difference for the Q9550 is a bit high even given error margin, and considering it is being speculated the true Elo difference is ~64.

For 736 games, error bar is +/- 18, so 100 difference is normal.

Edit:
Looking at http://www.clemens-keck.de/base.htm, Houdini 2.0 is ranked 3023 (+/- 11), and Rybka 4.1, 2949 (+/- 9). If we factor in the errors, including the one for 736 games, you get 130 Elo difference. Now, I guess it doesn't look so abnormal after-all.

[robbolito]

Hi King,
thanks for your review of the scores.You made some sense out of it.
All the games played are posted with the scores on the Immortal chess for those who want to review them or use them for some other purposes.
It is interesting how the scores can vary from one computer to another.Rybka has usually done better on the faster computers.Q 9550 I use is my oldest MP computer so I don't know if that has to do something the way engines are playing .
Has been some time since I was in touch with you.Hope that things are OK and that you are doing fine.
Regards,
robbolito.

[robbolito]

AMD Phenom(tm) II X6 1090T Processor x6 @3.80 GHz 8.00 MB Memory
Windows XP 64 Bit Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 28.33
KNS: 13599
GUI: CB Rybka 3
Book: Various book openings
Hash: 256
GTB and TB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0b Pro x64      3195  +103/-38/=99 63.54%  152.5/240
2   Deep Rybka 4.1 SSE42 x64  3190  +38/-103/=99 36.46%   87.5/240

[robbolito]

Intel(R) Core(TM) i7 4CPU 960 3.20 GHz x8 @ 4.00 GHz with 17.9 MB Memory
Microsoft Windows XP 64 Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 24.98
KNS: 11988
GUI: CB Rybka 3
Hash: 256
GTB and RB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0c Pro x64      3195  +18/-4/=18 67.50%   27.0/40
2   Deep Rybka 4.1 SSE42 x64  3190  +4/-18/=18 32.50%   13.0/40

First 20 games played with Attacker 4 Ctg.
Last 20 games played with Perfect 2009 Ctg

[robbolito]

Intel(R) Core(TM) i7 4CPU 960 3.20 GHz x8 @ 4.00 GHz with 17.9 MB Memory
Microsoft Windows XP 64 Professional Service Pack 2 (Build 3790)
Fritz Benchmark:
Speed: 24.98
KNS: 11988
GUI: CB Rybka 3
Book: Perfect 2009-10 moves
Hash: 256
TB: ON
Ponder: OFF
Blitz:5' 0

Code: Select all

1   Houdini 2.0c Pro x64      3195  +32/-7/=41 65.63%   52.5/80
2   Deep Rybka 4.1 SSE42 x64  3190  +7/-32/=41 34.38%   27.5/80