Houdini 1.5 Tests

As in chess tournaments and matches...
Tomcass
Posts: 49
Joined: Fri Jun 11, 2010 10:24 am

Re: Houdini 1.5 Tests

Post by Tomcass »

TESTING PROGRESS OF HOUDINI 1.5.

Computer: i7 975 4 real cores + 4 Hyper Thread. (HT : Off)
Fritz Benchmark: Speed 26,73 KNS 12.828
Gui: Fritz 12
Time Control: 2' + 1
Book: H.S. Masterbook 3.1
Ponder: Off.
No Robbo, Triple or Nalimov.
No crashes.

Last test : Houdini 1.5 against a selection of strong Ivanhoes. (400 games)

Houdini 1.5 x64 - Ivanhoe B50kBx64p 55.0 - 45.0 55.00%
Houdini 1.5 x64 - IvanHoe 9.49b x64CNT_KLO 54.0 - 46.0 54.00%
Houdini 1.5 x64 - Ivanhoe B48vAx64a 53.0 - 47.0 53.00%
Houdini 1.5 x64 - IvanhoeB50tAX64p 50.5 - 49.5 50.50%

(What a great result for IvanHoeB50tAx64p!!)

Average Houdini 1.5: 53.12%

Houdini 1.03a x64 - Ivanhoe B50kBx64p 46.5 - 53.5 46.50%
Houdini 1.03a x64 - IvanHoe 9.49b x64PopCNT_KLO 45.0 - 55.0 45.00%
Houdini 1.03a x64 - Ivanhoe B48vAx64a 46.5 - 53.5 46.50%
Houdini 1.03a x64 - IvanhoeB50tAX64p 47.5 - 52.5 47.50%

Average Houdini 1.03a: 46.37%

Deep Rybka 4 - Ivanhoe B50kBx64p 43.0 - 57.0 43.00%
Deep Rybka 4 - IvanHoe 9.49b x64PopCNT_KLO 45.0 - 55.0 45.00%
Deep Rybka 4 - Ivanhoe B48vAx64a 45.5 - 54.5 45.50%
Deep Rybka 4 - IvanhoeB50tAX64p 43.5 - 56.5 43.50%

Average Deep Rybka 4: 44.25%

Currently I am testing Houdini 1.5 SD14 Contempt 2.

Regards,

Tom.
User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 1.5 Tests

Post by robbolito »

Intel(R) Core(TM) i7 CPU 870 @ 2.93GHz 8.0 GB Memory
Windows 7 Home Premium Edition (Build 7600) 64 bit
Fritz Benchmark:
Speed: 13.09
KNS: 6280
GUI: Rybka 3
Book: Masterbook 4-10 moves
Hash:256
TB and GTB: ON
Ponder: OFF
Blitz: 10.0

Code: Select all

1   Houdini 1.5 x64   3190  +25/-14/=31 57.86%   40.5/70
2   Deep Rybka 4 x64  3190  +14/-25/=31 42.14%   29.5/70

SD 14 Contempt 2
JackStraw
Posts: 61
Joined: Thu Jun 10, 2010 12:14 pm
Real Name: Tom Glenn

Re: Houdini 1.5 Tests

Post by JackStraw »

This was the closest match I've had for Houdini , so far.........( given : same # cores )

i7 (940) @ 3.75 / 2 cores ea / ponder off / 512 mb / Fritz 11 / klo_openings / both x64

IvanHoe using old Robbobases , Houdini not ......... everything else standard


Houdini 1.5 ................. 57.5 ......... +31 , -16 , =52

IH B50tAx64p .............. 42.5

Here's a fun game , if int........ IH had a marginal lead most of the game , then around mv 50 , Houdini just crushed him........ they were moving fast by then , and the evals seemed to be jumping every move or two.... I don't know what happened.....

Houdini 1.5 vs IH B50tAx64p
Round 98
White :Houdini 1.5 x64
Black : IvanhoeB50tAX64p
Result : 1-0
ECO : E43
TimeControl : 4 mins + 2 secs

1. d4 Nf6 2. c4 e6 3. Nf3 b6 4. Nc3 Bb4
{Both last book move} 5. e3 {0.20/19 10} Bxc3+ {0.18/21 20} 6. bxc3 {0.20/17 0}
O-O {(Bb7) 0.18/21 3} 7. Bd3 {0.18/19 6} Bb7 {0.19/20 4} 8. O-O {0.17/19 8} Be4
{(c5) 0.17/20 14} 9. Be2 {0.19/19 8} c5 {0.19/19 7} 10. Ne5 {(Nd2) 0.17/18 9}
d6 {0.04/18 2} 11. Ng4 {(Nd3) 0.08/19 13} Nxg4 {0.02/20 12} 12. Bxg4 {0.08/17 0
} Bb7 {0.00/21 43} 13. d5 {(Be2) 0.05/18 12} exd5 {0.00/21 8} 14. cxd5 {0.16/
21 12} Ba6 {0.04/21 4} 15. Be2 {(Re1) 0.17/22 6} Qh4 {-0.01/21 7} 16. Bb2 {0.
05/21 31} Qe4 {(f5) -0.02/23 13} 17. Bxa6 {0.04/21 5} Nxa6 {-0.02/21 0} 18. Qe2
{0.03/21 4} Nc7 {-0.05/21 3} 19. c4 {0.08/21 8} b5 {-0.05/20 2} 20. cxb5 {0.05/
20 5} Qa4 {-0.11/19 4} 21. e4 {0.01/19 4} f6 {(Rab8) -0.14/18 1} 22. Rac1 {0.
04/18 6} Qxa2 {(Rab8) -0.08/19 11} 23. Rc3 {(Ra1) -0.05/17 6} Qa4 {-0.51/18 7}
24. Ra3 {-0.21/18 22} Qxb5 {-0.58/18 1} 25. Qc2 {-0.35/19 13} Na6 {-0.57/18 4}
26. Qb1 {(Qd2) -0.32/17 8} Nb4 {(Rab8) -0.69/19 5} 27. Rh3 {-0.40/17 3} c4 {-0.
79/19 5} 28. Bd4 {-0.37/18 5} a5 {(Qa4) -0.83/19 3} 29. e5 {-0.42/18 5} g6 {-0.
72/18 2} 30. exf6 {-0.50/18 10} Qxd5 {-0.81/18 3} 31. Ba1 {(Rh4) -0.50/18 4}
Rae8 {(Rf7) -0.90/19 7} 32. Rg3 {(Rh4) -0.55/18 8} Nd3 {-0.82/18 5} 33. h3 {-0.
52/19 6} Rf7 {-0.76/19 10} 34. Qc2 {-0.35/18 14} Re4 {(Qb5) -0.64/18 19} 35.
Kh2 {-0.28/17 5} Qf5 {-0.54/18 13} 36. Rb1 {-0.19/18 3} Nb4 {-0.41/19 7} 37.
Qa4 {-0.20/19 8} h5 {-0.32/19 15} 38. Ra3 {-0.20/19 5} Rc7 {-0.32/18 1} 39. Rf3
{(f3) -0.20/18 3} Qc5 {-0.31/17 3} 40. Rf4 {(Rd1) -0.14/17 3} Re2 {(Rxf4) -0.
34/19 5} 41. Bd4 {-0.04/16 4} Qd5 {-0.32/20 12} 42. Rb2 {-0.06/18 8} Re6 {-0.
37/19 2} 43. Bc3 {-0.12/19 11} Kf7 {-0.39/18 1} 44. Rf3 {-0.11/18 2} Rb7 {-0.
28/17 5} 45. Kg1 {(Qa1) -0.16/18 3} Re4 {-0.27/19 9} 46. Qa1 {-0.09/18 4} g5 {
(Rd7) -0.38/18 5} 47. Qc1 {-0.13/17 6} Rb8 {(Rd7) -0.13/18 7} 48. Rg3 {(Re3) 0.
51/15 3} Kg6 {(Rb5) -0.01/17 5} 49. f4 {0.40/15 2} g4 {-0.01/15 0} 50. hxg4 {
0.40/13 0} h4 {0.00/15 1} 51. Rh3 {(Rf3) 1.02/15 2} Nd3 {1.20/17 5} 52. Rxd3 {
0.76/12 0} cxd3 {1.20/14 0} 53. Rxb8 {1.68/12 0} Re2 {2.36/17 5} 54. Qf1 {2.15/
15 3} Rc2 {(h3) 1.29/16 4} 55. Kh2 {2.77/14 3} d2 {1.29/14 0} 56. Bxd2 {(Rg8+)
2.77/13 0} Rxd2 {2.90/15 2} 57. g5 {2.76/12 0} h3 {(Rc2) 3.17/17 4} 58. Kxh3 {
5.65/14 3} Kf7 {(Qf5+) 3.63/16 4} 59. Qg1 {(Rh8) 5.49/13 0} Qc5 {(Rd4) 6.53/15
3} 60. Rb7+ {(Qb1) 15.07/12 1} Kg8 {(Kf8) 19.58/15 3} 61. Qb1 {15.29/11 0} Rc2
{18.45/13 0} 62. Rb8+ {16.07/10 0} 1-0
User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 1.5 Tests

Post by robbolito »

Houdini 1.5 vs IH B50tAx64p
Round 98
White :Houdini 1.5 x64
Black : IvanhoeB50tAX64p
Result : 1-0
ECO : E43
TimeControl : 4 mins + 2 secs



Same game much easier to follow.
To get the diagram highlight the moves and click on pgn.
JackStraw
Posts: 61
Joined: Thu Jun 10, 2010 12:14 pm
Real Name: Tom Glenn

Re: Houdini 1.5 Tests

Post by JackStraw »

i7 (940) @ 3.75 / 2 cores ea / ponder off / 512 mb / Fritz 11 / klo_openings / both x64

IvanHoe using old Robbobases , Houdini not ......... everything else standard

Time : 4 mins = 2 secs


Houdini 1.5 ................. 63 ......... +38 , -12 , = 50

IH B47cBx64 ................ 37


...........Even the Champ loses on occasion........

White : Ivanhoe B47cBx64
Black : Houdini 1.5 x64
Result : 1-0


** Thanks for the head's-up on how to make the windows....... another one of life's mysteries solved !! **
Tomcass
Posts: 49
Joined: Fri Jun 11, 2010 10:24 am

Re: Houdini 1.5 Tests

Post by Tomcass »

Computer: i7 975 4 real cores + 4 Hyper Thread. (HT : Off)
Fritz Benchmark: Speed 26,73 KNS 12.828
Gui: Fritz 12
Time Control: 2' + 1
Book: H.S. Masterbook 3.1
Ponder: Off.
No Robbo, Triple or Nalimov.
No crashes.

Latest test: Houdini 1.5 (14_2) against a selection of strong Ivanhoes. (400 games).

Houdini 1.5 x64(14_2)- Ivanhoe B50kBx64p 59.0 - 41.0 59.00%
Houdini 1.5 x64(14_2)- Ivanhoe B48vAx64a 55.5 - 44.5 55.50%
Houdini 1.5 x64(14_2)- IvanhoeB50tAX64p 53.0 - 47.0 53.00%
Houdini 1.5 x64(14_2)- IvanHoe 9.49b x64CNT_KLO 57.0 - 43.0 57.00%

Average Houdini 1.5 (14_2): 56.12%


Houdini 1.5 x64 - Ivanhoe B50kBx64p 55.0 - 45.0 55.00%
Houdini 1.5 x64 - IvanHoe 9.49b x64CNT_KLO 54.0 - 46.0 54.00%
Houdini 1.5 x64 - Ivanhoe B48vAx64a 53.0 - 47.0 53.00%
Houdini 1.5 x64 - IvanhoeB50tAX64p 50.5 - 49.5 50.50%
(What a great result for IvanHoeB50tAx64p!!)

Average Houdini 1.5: 53.12%

Houdini 1.03a x64 - Ivanhoe B50kBx64p 46.0 - 54.0 46.00%
Houdini 1.03a x64 - IvanHoe 9.49b x64PopCNT_KLO 45.0 - 55.0 45.00%
Houdini 1.03a x64 - Ivanhoe B48vAx64a 46.5 - 53.5 46.50%
Houdini 1.03a x64 - IvanhoeB50tAX64p 47.5 - 52.5 47.50%

Average Houdini 1.03a: 46.37%

Deep Rybka 4 - Ivanhoe B50kBx64p 43.0 - 57.0 43.00%
Deep Rybka 4 - IvanHoe 9.49b x64PopCNT_KLO 45.0 - 55.0 45.00%
Deep Rybka 4 - Ivanhoe B48vAx64a 45.5 - 54.5 45.50%
Deep Rybka 4 - IvanhoeB50tAX64p 43.5 - 56.5 43.50%

Average Deep Rybka 4: 44.25%

I think that my test with Houdini 1.5 SD14 Contempt 2 confirms the good results got by other serious testers. In my computer it seems to be somewhat stronger than the standard Houdini 1.5, at this time control and against IvanHoes. A bit more than 20 ELO points.

Regards,

Tom.
Howard E
Posts: 46
Joined: Fri Jun 11, 2010 3:57 am
Real Name: Howard Exner

Re: Houdini 1.5 Tests

Post by Howard E »

Thanks for the game post. It is quite remarkable that today we can view a a quality game at such a fast time control. Five years ago this would be inconceivable (pronounced if you like as in Princess Bride).
Houdini is the master of rook lifts.
JackStraw
Posts: 61
Joined: Thu Jun 10, 2010 12:14 pm
Real Name: Tom Glenn

Re: Houdini 1.5 Tests

Post by JackStraw »

Small samples , but , my data point .......

Tested Houdini 1.5 vs IvanHoe B50tAX64p , while changing a couple settings in Houdini

Houdini with sd = 14 scored slightly better than default

Houdini with sd = 14 + cont = 2 scored slightly worse than default

7 (940) @ 3.75 / 2 cores ea / ponder off / 512 mb / Fritz 11 / klo_openings / both x64

IvanHoe using old Robbobases , Houdini not

Time : 4 mins + 2 secs

Houdini (sd=14) ................... 60.5 ......... +36 , -15 , =49
IvanHoe ............................ 39.5

Houdini (default) .................. 57.5 .......... +31 , -16 , =52
IvanHoe .............................42.5

Houdini (sd=14 + c=2) .............53.5 ...........+29 , -22 , =49
IvanHoe .............................46.5
User avatar
robbolito
Posts: 601
Joined: Thu Jun 10, 2010 3:48 am

Re: Houdini 1.5 Tests

Post by robbolito »

Intel(R) Core(TM) i7 CPU 870 @ 2.93GHz 8.0 GB Memory
Windows 7 Home Premium Edition (Build 7600) 64 bit
Fritz Benchmark:
Speed: 13.09
KNS: 6280
GUI: Rybka 3
Book: PowerBook 2011-10 moves
Hash:256
TB and GTB: ON
Ponder: OFF
Blitz: 10.0

Code: Select all

1   Houdini 1.5 x64  3190  +24/-4/=12 75.00%   30.0/40
2   Rybka 3.x64      3190  +4/-24/=12 25.00%   10.0/40
Elo difference-+191
User avatar
notyetagm
Posts: 139
Joined: Thu Jun 10, 2010 6:12 pm

Re: Houdini 1.5 Tests

Post by notyetagm »

Howard E wrote:Thanks for the game post. It is quite remarkable that today we can view a a quality game at such a fast time control. Five years ago this would be inconceivable (pronounced if you like as in Princess Bride).
Houdini is the master of rook lifts.
I guess GM Larry Christiansen has a new fav chess engine. ;-)

That's an inside ICC joke, by the way.
Post Reply