IvanHoe54

[kingliveson]

999954-beta for Linux and Windows: http://chess.cygnitec.com/engine/ -- am trying different optimization now, and if it's positive, will note and re-upload.

...Large pages are disabled, as they are not supported using shmget() on OSX.

Are you sure about this?

edit: From Rybka Forums

> Try editing /etc/rc


I have no idea about Mac OS X, but the similar code in Crafty reads:

ERROR. shmget() failed, unable to allocate a shared memory segment.
Please verify that your /proc/sys/kernel/shmmax value is large enough to allow allocating the amount of memory you are requesting.

> echo 1000000000 > /proc/sys/kernel/shmmax


will allow a segment up to one billion bytes. I recall doing this when fooling with Crafty (it worked, and w/o re-booting).



From some postgresql installation notes

If You Get an Error About Shared Memory

In OS X 10.3.9 and later, create a file named /etc/sysctl.conf containing these variable assignments, and reboot:
kern.sysv.shmmax=4194304
kern.sysv.shmmin=1
kern.sysv.shmmni=32
kern.sysv.shmseg=8
kern.sysv.shmall=1024

I'm not sure that this is desired value of kern.sysv.shmmax in your case, though.

[benstoker]

It may be necessary to reboot to be able to allocate all the hugepages that is needed. This is because hugepages requires large areas of contiguous physical memory. Over time, physical memory may be mapped and allocated to pages, thus the physical memory can become fragmented. If the hugepages are allocated early in the boot process, fragmentation is unlikely to have occurred.

My guess is that this correct. Making 2GB (or even 4GB, depending on your Hugepagesize) of huge pages with "1024" (as they said) on a 4GB machine is not likely to do well if your machine has been up for awhile. You can look at /proc/buddyinfo (lists contiguous sections available) or /proc/meminfo (gives the amount of current allocated memory) to find out more (including your Hugepagesize).

Yes, it wasn't wise to simply echo it. I had to stick it in sysctl.conf and reboot. And it works fine. And I clearly see a rise in nps -- no doubt. Kind of like drinking a venti drip, bold roast.

[kingliveson]

999954-beta for Linux and Windows: http://chess.cygnitec.com/engine/ -- am trying different optimization now, and if it's positive, will note and re-upload.

Code: Select all

IvanHoe vs Rybka, Blitz:1'                             

1   IvanHoe 9.54b x64       +15/=29/-6 59.00%   29.5/50
2   Deep Rybka 4 SSE42 x64  +6/=29/-15 41.00%   20.5/50

Unfortunately this new build can't be uploaded yet! A tester reported back he could not run it.

[BB+]

If You Get an Error About Shared Memory

I think my post was about shared memory under Mac OS X (which is required by Rybka, at least under microwine), and my guess is that Jeremy is saying that shmget does not have a SHM_HUGETLB option with Mac OS X. I think the PowerPC has many more page-size options that just 4K/2M/1G, but I don't know how they are all made available to the user.

Some OSs, like Solaris and FreeBSD I think, automatically use huge pages in some contexts. With Linux, they are reserved by the OS, and then can be asked for by processes. This solves the fragmentation issue if you reserve them at boot time (and don't have many different programmes asking for them), though it does mean that you have a large chunk of memory that non-hugetlb processes can't utilise. The Windows way is to reserve large pages only when a VirtualAlloc call asks for it, which means that the overall memory must be sufficiently defragged at that instant for it to work.

[kingliveson]

999954-beta for Linux and Windows: http://chess.cygnitec.com/engine/ -- am trying different optimization now, and if it's positive, will note and re-upload.

Code: Select all

IvanHoe vs Houdini, Blitz:4'+2"                              

1   IvanHoe 9.54b x64              +11/=32/-7 54.00%   27.0/50
2   Houdini 1.03 x64 POPCNT 4_CPU  +7/=32/-11 46.00%   23.0/50

OK, using a different compiler, and testing some new flags, this build does OK against Houdini 1.03. The results must be taken with a grain of salt as error bar for 50 games is quite high. This is not the same build uploaded to the link above -- 32-bit and non-popcnt versions are unavailable. The test used no egtb, default settings for both engines except for pawnhash. Condition, games, and the build are all included in the attachment.

Further note, this popcnt build is at at least 5% slower against single-core version non-popcnt Houdini -- yet on 4 cores, it's a different story.

[Event "IvanHoe vs Houdini, Blitz:4'+2""]
[Site "W0111D0001"]
[Date "2010.07.16"]
[Round "21"]
[White "IvanHoe 9.54b x64"]
[Black "Houdini 1.03 x64 POPCNT 4_CPU"]
[Result "1/2-1/2"]
[ECO "B53"]
[Annotator "0.22;0.16"]
[PlyCount "113"]
[TimeControl "240+2"]

{AMD Phenom(tm) II X4 940 Processor W=21.3 plies; 6,101kN/s B=22.1 plies; 5,
910kN/s} 1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Qxd4 Nc6 {Both last book move} 5. Bb5
{0.22/20 18} Bd7 {0.16/20 6} 6. Bxc6 {0.18/20 13 (Qd3)} Bxc6 {0.14/20 6 (bxc6)}
7. Nc3 {0.16/21 13} Nf6 {0.13/20 5} 8. Bg5 {0.18/20 4} e6 {0.14/19 6 (Nd7)} 9.
Bxf6 {0.09/18 2} Qxf6 {0.11/21 7} 10. Qxf6 {0.12/19 2} gxf6 {0.10/20 0} 11. Nd4
{0.13/20 3} Rg8 {0.11/20 7 (a6)} 12. g3 {0.14/20 16} a6 {0.11/20 5 (0-0-0)} 13.
Nxc6 {0.21/19 3} bxc6 {0.11/18 0} 14. O-O-O {0.17/20 12} d5 {0.11/19 10 (0-0-0)
} 15. Rd3 {0.18/19 15 (f4)} Rb8 {0.08/18 5} 16. Re1 {0.21/18 2 (a3)} Kd7 {0.16/
19 30} 17. Nb1 {0.30/19 22} Bh6+ {0.17/18 9 (Kc7)} 18. Nd2 {0.33/19 7} Bxd2+ {
0.18/19 4 (Kc7)} 19. Rxd2 {0.28/19 2} Rb4 {0.21/19 10} 20. b3 {0.29/19 1} Kc7 {
0.17/20 4} 21. exd5 {0.33/19 8 (f3)} cxd5 {0.17/21 23} 22. a3 {0.32/20 1} Rbg4
{0.17/21 19} 23. Re3 {0.32/19 1 (f3)} a5 {0.15/20 5} 24. f3 {0.23/21 35 (Kb2)}
R4g5 {0.13/21 4} 25. Kb2 {0.25/21 3 (c4)} Kc6 {0.14/21 5 (Re5)} 26. Red3 {0.18/
20 8} Rf5 {0.14/21 4} 27. c4 {0.18/20 5} dxc4 {0.14/22 4} 28. Rc3 {0.16/20 2
(Rc2)} Rc5 {0.13/22 4} 29. Rdc2 {0.16/21 1} Kb6 {0.13/22 5 (Kb5)} 30. Rxc4 {0.
23/20 4} Rgg5 {0.13/23 4 (Rgc8)} 31. Rf4 {0.20/22 8} Rcf5 {0.06/23 5} 32. Rcc4
{0.11/22 5} Rh5 {0.04/23 4 (Rxf4)} 33. Rxf5 {0.04/23 8 (h4)} Rxf5 {0.03/22 6}
34. f4 {0.05/23 9} Rd5 {0.04/23 3} 35. Kc3 {0.01/22 5} f5 {0.01/24 4} 36. b4 {
0.00/22 1} axb4+ {0.01/24 18} 37. Rxb4+ {0.00/22 1} Kc7 {0.01/24 3 (Rb5)} 38.
Ra4 {0.05/22 4 (Rb2)} Kb7 {0.00/24 3} 39. Rb4+ {0.00/24 4 (Rc4)} Kc7 {0.00/29 4
} 40. Rb2 {0.02/23 6} f6 {0.00/22 4} 41. Rf2 {0.02/22 3 (Kc4)} Kb6 {0.00/23 4
(Rd1)} 42. a4 {0.00/21 2 (Rb2+)} Rc5+ {0.00/22 3} 43. Kb3 {0.00/22 2 (Kd4)} Rd5
{0.00/23 6} 44. Rb2 {0.00/22 7 (Kc4)} e5 {0.00/23 3} 45. Kc3+ {0.00/22 4 (Kc4+)
} Kc7 {0.00/23 3} 46. Ra2 {0.00/22 1 (h3)} Kb6 {0.00/23 3} 47. Rf2 {0.00/22 1
(Rb2+)} e4 {0.00/24 3} 48. Rb2+ {0.00/23 2} Kc6 {0.00/25 3} 49. Rb8 {0.00/23 1
(Kc4)} Rd3+ {0.00/23 3} 50. Kc4 {0.00/23 1} Ra3 {0.00/23 4} 51. Rc8+ {0.00/24 8
} Kb7 {0.00/25 3 (Kd7)} 52. Rf8 {0.00/24 3} Rxa4+ {0.00/23 0} 53. Kb5 {0.00/25
2} Rd4 {0.00/25 3} 54. Kc5 {0.00/25 1} Ra4 {0.00/26 3} 55. Kb5 {0.00/25 1} Rd4
{0.00/27 3} 56. Kc5 {0.00/27 2} Ra4 {0.00/28 3} 57. Kb5 {0.00/26 1 Draw
accepted} 1/2-1/2

[Event "IvanHoe vs Houdini, Blitz:4'+2""]
[Site "W0111D0001"]
[Date "2010.07.16"]
[Round "22"]
[White "Houdini 1.03 x64 POPCNT 4_CPU"]
[Black "IvanHoe 9.54b x64"]
[Result "1-0"]
[ECO "B53"]
[Annotator "0.10;0.06"]
[PlyCount "115"]
[TimeControl "240+2"]

{AMD Phenom(tm) II X4 940 Processor W=18.5 plies; 5,691kN/s B=20.5 plies; 5,
980kN/s} 1. e4 c5 2. Nf3 d6 3. d4 cxd4 4. Qxd4 Nc6 {Both last book move} 5. Qa4
{0.10/19 9} Nf6 {0.06/19 13} 6. Nc3 {0.08/19 5 (Bd3)} Bd7 {0.00/18 2} 7. Bd3 {
0.07/19 6 (Qb5)} Qb6 {0.09/20 12 (e6)} 8. O-O {0.10/19 8} Qb4 {0.23/19 20 (Ne5)
} 9. Qb3 {0.20/20 11 (Qxb4)} Qxb3 {0.27/20 8} 10. axb3 {0.17/20 6} a6 {0.23/20
2} 11. Bd2 {0.14/20 20} Bg4 {0.25/20 9 (Rc8)} 12. b4 {0.32/20 5 (Ne1)} Rc8 {0.
53/20 13 (Nxb4)} 13. b5 {0.40/19 6} axb5 {0.54/21 11} 14. Nxb5 {0.38/20 6} Nd7
{0.56/21 12 (Bxf3)} 15. Na7 {0.38/19 8} Rb8 {0.55/20 8} 16. Nxc6 {0.38/20 5
(Be2)} bxc6 {0.61/20 3} 17. Nd4 {0.41/21 11} Ne5 {0.53/20 2} 18. b4 {0.44/20 4}
g6 {0.62/20 7} 19. Bc3 {0.41/20 4} f6 {0.54/20 3} 20. Ba6 {0.41/21 5} Bd7 {0.
59/19 3} 21. Nb3 {0.41/20 8 (Be2)} g5 {0.68/20 16 (Nf7)} 22. Be2 {0.50/20 5}
Ng6 {0.65/20 28} 23. g3 {0.48/20 4 (Rfd1)} h5 {0.69/20 8 (g4)} 24. Ra7 {0.52/
20 4} Ne5 {0.78/20 8 (g4)} 25. Rfa1 {0.51/19 7} h4 {0.89/19 9 (g4)} 26. Rc7 {
1.03/18 4} Be6 {0.89/19 1 (Rh6)} 27. Nd4 {1.07/20 8} Bd7 {1.00/19 3} 28. Raa7 {
1.07/20 4} c5 {1.23/20 10} 29. Nb3 {1.07/18 0} Bg4 {1.22/20 8} 30. Bxg4 {1.02/
20 4} Nxg4 {1.28/20 10} 31. Na5 {1.20/20 7} hxg3 {1.31/20 9} 32. hxg3 {1.20/18
0} Kf7 {1.46/20 10} 33. Nc6 {1.48/19 6} Rb5 {1.48/20 4} 34. Ra5 {1.48/17 0} Rb6
{1.57/19 3} 35. b5 {1.69/19 5} Kg6 {1.57/19 1 (Kg7)} 36. Rc8 {1.94/20 5 (Nxe7+)
} Kg7 {2.17/18 6} 37. Rb8 {3.18/19 8 (Ba1)} Rxb8 {2.68/18 4} 38. Nxb8 {3.07/18
0} Rh2 {2.78/19 4} 39. Be1 {2.95/16 0} Rh7 {3.31/20 7} 40. Nd7 {3.82/19 4 (Nc6)
} Ne5 {4.14/20 10} 41. Nxe5 {3.82/17 0} dxe5 {4.41/21 6} 42. b6 {4.02/20 5} e6
{4.41/22 1} 43. b7 {4.02/20 0} Bd6 {4.57/23 8} 44. Rxc5 {4.02/18 0} Kg6 {4.69/
22 6} 45. Rb5 {4.02/16 0} Rd7 {4.75/21 4 (Bb8)} 46. Ba5 {4.60/21 5 (c4)} Bb8 {
4.89/21 2} 47. c4 {4.10/18 0} Rd1+ {5.05/22 5 (f5)} 48. Kg2 {4.62/16 0} Rc1 {
5.34/22 4} 49. c5 {4.62/14 0} Kf7 {5.56/22 4 (f5)} 50. Bb6 {4.84/12 0} Ke7 {6.
18/22 3 (Ra1)} 51. Ra5 {4.89/10 0} Kd7 {6.38/23 3 (g4)} 52. Ra8 {4.89/8 0} Kc6
{6.50/23 3 (g4)} 53. Rxb8 {4.88/8 0} Rc4 {6.56/23 3 (g4)} 54. Rf8 {6.06/22 4}
Kxb7 {6.48/22 0} 55. Rxf6 {5.39/20 0 (Rf7+)} Rxe4 {6.77/22 3} 56. Rxe6 {6.42/
22 8} g4 {6.77/23 1} 57. Ba5 {6.42/20 0} Rc4 {7.05/24 3} 58. Rxe5 {6.48/19 1}
1-0

[kingliveson]

IvanHoe999954 has been re-uploaded. Fixed RobboTripleBases bug, and enabled additional time management function which can be seen here: http://www.open-chess.org/viewtopic.php?p=4052#p4052. The re-uploaded file has nothing to do with previous post/attachment. That has to do with using thread Parallelization.

[BTO7]

IvanHoe999954 has been re-uploaded. Fixed RobboTripleBases bug, and enabled additional time management function which can be seen here: http://www.open-chess.org/viewtopic.php?p=4052#p4052. The re-uploaded file has nothing to do with previous post/attachment. That has to do with using thread Parallelization.

The new one king http://ippolit.wikispaces.com/file/deta ... 3-Beta.tar

[robbolito]

Best Engines-5 2010
Site/ Country: AMDX6-1090T, United States
Level: Blitz 10/0
Hardware: AMD Phenom(tm) II X6 1090T Processor6x 3895 MHz with 4,096 MB Memory
Operating system: Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)

Code: Select all

                                      1                2                3                
1   IvanHoe 9.54b x64KLO    3190   +32  **************** ½1½0½½½½½½½½1½½1 ½½½1½0½½½1½½½½½½  17.5/32
2   Deep Rybka 4 x64        3190     0  ½0½1½½½½½½½½0½½0 **************** 10½0011½½½1½1½½½  16.0/32
3   Houdini 1.03 x64 8_CPU  3190   -32  ½½½0½1½½½0½½½½½½ 01½1100½½½0½0½½½ ****************  14.5/32

On AMD 6 cores this is very nice score.The King has done excellent job with this version.

[kingliveson]

Best Engines-5 2010
Site/ Country: AMDX6-1090T, United States
Level: Blitz 10/0
Hardware: AMD Phenom(tm) II X6 1090T Processor6x 3895 MHz with 4,096 MB Memory
Operating system: Microsoft Windows XP 64 Bit Professional Service Pack 2 (Build 3790)

Code: Select all

                                      1                2                3                
1   IvanHoe 9.54b x64KLO    3190   +32  **************** ½1½0½½½½½½½½1½½1 ½½½1½0½½½1½½½½½½  17.5/32
2   Deep Rybka 4 x64        3190     0  ½0½1½½½½½½½½0½½0 **************** 10½0011½½½1½1½½½  16.0/32
3   Houdini 1.03 x64 8_CPU  3190   -32  ½½½0½1½½½0½½½½½½ 01½1100½½½0½0½½½ ****************  14.5/32

On AMD 6 cores this is very nice score.

Thanks for testing that build. I thought parallel threading which slows the nps down just a tad bit would have negative effect, but my test, your test, and that of our friend showed it to be doing good. Will investigate it a little more. It would have made more sense for me to rename the build to something that differentiates it from the others. Thanks for testing it.

[TPJR]

I believe that Houdini is not getting its full strength on this 6-core AMD - prozessor. It is strange that it is below Rybka, whereas in other tests it is above.