Houdini 3 Pro x64 - Rybka 4.1 SSE42 x64

1   Houdini 3 Pro x64          +52/=33/-15 68.50%   68.5/100
2   Rybka 4.1 SSE42 x64   +15/=33/-52 31.50%   31.5/100

Compare these results to the Houdini 2 Pro x64 - Rybka 4.1 SSE42 x64 match, where Houdini won by 12 points instead of 37.

Games here: http://goo.gl/QJmt2

Match: Houdini 3 Pro 6CPU - Critter 1.6a 6CPU

Houdini 3 Pro x64 6CPU is battling Critter 1.6a x64 6CPU in a 10-game match. Each side's playing White and Black in 5 openings I've chosen. Watch the live computer chess match here (or play over the games when the match is finished.)

Results
      Engine                                         Pts           Houdini    Critter
   1 Houdini 3 Pro x64 6CPU           7.5/10       ---------- =1=1=11101
   2 Critter 1.6a 64-bit 6CPU            2.5/10      =0=0=00010 ----------

Download the PGN here: http://goo.gl/kWCnY

Match Controls

• 20' + 20" increment (20 minutes per game + 20 seconds per move)
• 6 CPU with 64-bit engines and SSE4 technology where possible
• Ponder = Off
• Hash = 2,048 MBs
• Learning = Disabled
• 3-, 4-, and 5-man endgame bases on an internal SSD, using 64 MBs cache when applicable
• Book = My book

Hardware & Software

• AMD Phenom II 1100T 6 CPUs @ 3.7 GHz
• 16 GBs of memory @ 2,000 MHz
• OS = Windows 7 Pro 64-bit, SP1
• GUI = ChessGUI

ATOMICC Testing is back, with live broadcasts

I've decided to come back to computer chess, but not in such an organized way. To relieve some of the pressure (from keeping a current list) and have a little more fun, I'm going to test what I want, when I want, and how I want. There is one important change:
Now you can watch the testing live.

Click here to view the current live computer chess game.

:-)

No more ATOMICC testing

Hi, friends. I'm done with computer chess and I don't plan to ever return. There will be no more ATOMICC testing. Best wishes! :)

Houdini 2.0c Pro x64 - Vitruvius 1.11C HEM x64 Match Results

1   Houdini 2.0c Pro x64 1CPU          +37/=44/-19   59.0/100
2   Vitruvius 1.11C HEM x64 1CPU   +19/=44/-37   41.0/100

Download the games here: http://goo.gl/Ey6AO

Fritz 13 - Naum 4.2 Match Results

1   Fritz 13                  +27/=58/-15   56.0/100
2   Naum 4.2 1CPU   +15/=58/-27   44.0/100

Download the games here: http://goo.gl/144Nu

Fritz 13 - Saros 3 x64 Match Results

1   DeepSaros ver.3.0 x64   +42/=48/-10   66.0/100
2   Fritz 13                            +10/=48/-42   34.0/100

Download the games here: http://goo.gl/3QKMH

Junior 13 x64 - Naum 4.2 Match Results

1   Naum 4.2 1CPU            +40/=38/-22   59.0/100
2   Deep Junior 13 64-bit    +22/=38/-40   41.0/100

Download the games here: http://goo.gl/6wo8H

Naum 4.2 - Strelka 5.1 x64 Match Results

1 Strelka 5.1 x64                     79.5/100   +64/=31/-5
2 Naum 4.2 1CPU                  20.5/100   +5/=31/-64

Download the games here: http://goo.gl/K2r9n

Fritz 13 - Vitruvius 1.11C HEM x64 Match Results

1   Vitruvius 1.11C HEM x64 1CPU   +53/=40/-7   73.0/100
2   Fritz 13                                          +7/=40/-53   27.0/100

Download the games here: http://goo.gl/d0jZ1

Fritz 13 - Rybka 4.1 SSE42 x64

1   Rybka 4.1 SSE42 x64 1CPU   +45/=45/-10   67.5/100
2   Fritz 13                                     +10/=45/-45   32.5/100

Download the games here: http://goo.gl/oB1x6

Naum 4.2 - Stockfish 2.2.2 JA SSE42 x64 Match Results

1   Stockfish 2.2.2 JA SSE42 1CPU   +53/=41/-6   73.5/100
2   Naum 4.2 1CPU                             +6/=41/-53  26.5/100

Download the games here: http://goo.gl/rlhtl

Critter 1.4a 64-bit SSE4 - Vitruvius 1.11C HEM x64 Match Results

1   Vitruvius 1.11C HEM x64 1CPU    +25/=54/-21  52.0/100
2   Critter 1.4a 64-bit SSE4 1CPU     +21/=54/-25  48.0/100

Download the games here: http://goo.gl/b7hLQ

Houdini 2.0c Pro x64 - Naum 4.2 Match Results

1   Houdini 2.0c Pro x64 1CPU  +50/=45/-5   72.5/100
2   Naum 4.2 1CPU                    +5/=45/-50   27.5/100

Download the games here: http://goo.gl/KPzlT

Fritz 13 - Komodo64 SSE 4 Match Results

1   Komodo64 SSE Version 4 1CPU  +52/=42/-6   73.0/100
2   Fritz 13                                           +6/=42/-52   27.0/100

Download the games here: http://goo.gl/iO8ON

Junior 13 x64 - Vitruvius 1.11C HEM x64 Match Results

1   Vitruvius 1.11C HEM x64 1CPU    +64/=23/-13   75.5/100
2   Deep Junior 13 64-bit                    +13/=23/-64   24.5/100

Download the games here: http://goo.gl/VsQTF

Rybka 4.1 SSE42 x64 - Vitruvius 1.11C HEM x64 Match Results

1   Rybka 4.1 SSE42 x64 1CPU        +25/=59/-16   54.5/100
2   Vitruvius 1.11C HEM x64 1CPU    +16/=59/-25   45.5/100

Download the games here: http://goo.gl/hVv8A

Saros 3 x64 - Strelka 5.1 x64 Match Results

1 Strelka 5.1 x64                      64.5/100    +40/=49/-11
2 DeepSaros ver.3.0 x64         35.5/100    +11/=49/-40

Download the games here: http://goo.gl/Qf1gT

Fritz 13 - Stockfish 2.2.2 JA SSE42 x64 Match Results

1   Stockfish 2.2.2 JA SSE42 1CPU  +49/=45/-6  71.5/100
2   Fritz 13                                          +6/=45/-49  28.5/100

Download the games here: http://goo.gl/OOMfL

Komodo64 4 SSE - Vitruvius 1.11C HEM x64 Match Results

1   Komodo64 SSE Version 4 1CPU   +30/=53/-17   56.5/100
2   Vitruvius 1.11C HEM x64 1CPU     +17/=53/-30   43.5/100

Download the games here: http://goo.gl/MJLbQ

Critter 1.4a SSE4 x64 - Fritz 13 Match Results

1 Critter 1.4a 64-bit SSE4 1CPU   +52/=44/-4   74.0/100
2 Fritz 13                                        +4/=44/-52   26.0/100

Download the games here: http://goo.gl/oUNy5

Junior 13 x64 - Saros 3 x64 Match Results

1   DeepSaros ver.3.0 x64    +54/=31/-15  69.5/100
2   Deep Junior 13 64-bit      +15/=31/-54  30.5/100

Download the games here: http://goo.gl/vVC99

Fritz 13 - Houdini 2.0c Pro x64 Match Results

1   Houdini 2.0c Pro x64 1CPU  +61/=31/-8  76.5/100
2   Fritz 13                                  +8/=31/-61  23.5/100

Download the games here: http://goo.gl/PrVWd

Saros 3 x64 - Vitruvius 1.11C HEM x64 Match Results

1   Vitruvius 1.11C HEM x64 1CPU    +18/=68/-14  52.0/100
2   DeepSaros ver.3.0 x64                  +14/=68/-18  48.0/100

Download the games here: http://goo.gl/rERCK

Junior 13 x64 - Strelka 5.1 x64 Match Results

1 Strelka 5.1 x64                     83.5/100   +69/=29/-2
2 Deep Junior 13 64-bit           16.5/100   +2/=29/-69

Download the games here: http://goo.gl/En0dq

Strelka 5.1 x64 - Vitruvius 1.11C HEM x64 Match Results

1 Strelka 5.1 x64                                   62/100   +35/=54/-11
2 Vitruvius 1.11C HEM x64 1CPU        38/100   +11/=54/-35

Download the games here: http://goo.gl/SBeHL

Critter 1.4a SSE4 x64 - Saros 3 x64 Match Results

1   Critter 1.4a 64-bit SSE4 1CPU   +31/=55/-14  58.5/100
2   DeepSaros ver.3.0 x64               +14/=55/-31  41.5/100

Download the games here: http://goo.gl/TeFrU

Junior 13 x64 - Komodo64 4 SSE Match Results

1   Komodo64 SSE Version 4 1CPU  +62/=31/-7  77.5/100
2   Deep Junior 13 64-bit                     +7/=31/-62  22.5/100

Download the games here: http://goo.gl/YSXLF

Rybka 4.1 SSE42 x64 - Strelka 5.1 x64 Match Results

1 Strelka 5.1 x64                         56.0/100  +29/=54/-17
2 Rybka 4.1 SSE42 x64 1CPU   44.0/100  +17/=54/-29

As of round 89, Rybka was only 5 points behind. Strelka scored 7 more wins in the last 11 games.

Download the games here: http://goo.gl/YkxjO

Saros 3 x64 - Stockfish 2.2.2 JA SSE42 Match Results

1   Stockfish 2.2.2 JA SSE42 1CPU   +35/=48/-17   59.0/100
2   DeepSaros ver.3.0 x64                  +17/=48/-35   41.0/100

Download the games here: http://goo.gl/jykpP

Houdini 2.0c Pro x64 - Junior 13 x64 Match Results

1   Houdini 2.0c Pro x64 1CPU  +68/=27/-5   81.5/100
2   Deep Junior 13 64-bit            +5/=27/-68   18.5/100

Download the games here: http://goo.gl/nRS1m

Stockfish 2.2.2 JA SSE42 - Strelka 5.1 x64 Match Results

   1 Strelka 5.1 x64                                57.5/100   +29/=57/-14
   2 Stockfish 2.2.2 JA SSE42 1CPU    42.5/100   +14/=57/-29

Download the games here: http://goo.gl/SNTN6

Komodo64 4 SSE - Saros 3 x64 Match Results

1   Komodo64 SSE Version 4 1CPU   +39/=41/-20  59.5/100
2   DeepSaros ver.3.0 x64                   +20/=41/-39  40.5/100

Download the games here: http://goo.gl/Ar1ab

Junior 13 x64 - Rybka 4.1 SSE42 x64 Match Results

1   Rybka 4.1 SSE42 x64 1CPU  +64/=28/-8  78.0/100
2   Deep Junior 13 64-bit              +8/=28/-64  22.0/100

Download the games here: http://goo.gl/ieF4l

Rybka 4.1 SSE42 x64 - Saros 3 x64 Match Results

1   Rybka 4.1 SSE42 x64 1CPU   +39/=48/-13  63.0/100
2   DeepSaros ver.3.0 x64            +13/=48/-39  37.0/100

Download the games here: http://goo.gl/hZbDq

Junior 13 x64 - Stockfish 2.2.2 x64 SSE4 Match Results

1   Stockfish 2.2.2 JA SSE42 1CPU    +58/=34/-8   75.0/100
2   Deep Junior 13 64-bit                      +8/=34/-58   25.0/100

Download the games here: http://goo.gl/m39an

Critter 1.4a SSE4 x64 - Strelka 5.1 x64 Match Results

   1 Strelka 5.1 x64                                52.5/100   +16/=73/-11
   2 Critter 1.4a 64-bit SSE4 1CPU       47.5/100   +11/=73/-16

Download the games here: http://goo.gl/bPKHx

Houdini 2.0c Pro x64 - Saros 3 x64 Match Results

1   Houdini 2.0c Pro x64 1CPU    +53/=36/-11   71.0/100
2   DeepSaros ver.3.0 x64           +11/=36/-53   29.0/100

The power outage that affected the Critter-Junior 13 and Komodo-Strelka matches also affected this one. Games 27-100 are misnumbered, but are there and in order.

Download the games here: http://goo.gl/mhmU5

Komodo64 4 SSE4 - Strelka 5.1 x64 Match Results

 1 Komodo64 SSE Version 4 1CPU    50/100    +23/=54/-23
 1 Strelka 5.1 x64                                 50/100    +23/=54/-23

The power outage that affected the Critter-Junior 13 match also affected this one. Games 51-100 are misnumbered, but are there and in order.

Download the games here: http://goo.gl/ud96I

Critter 1.4a x64 SSE4 - Junior 13 x64 Match Results

1   Critter 1.4a 64-bit SSE4 1CPU    +56/=31/-13   71.5/100
2   Deep Junior 13 64-bit                   +13/=31/-56   28.5/100

The power went out after round 33 (game 66), so the rest of the games are misnumbered, but they are all there and in order.

Download the games here: http://goo.gl/rpfqY

Houdini 2.0c Pro x64 - Strelka 5.1 64-bit Match Results

1 Houdini 2.0c Pro x64 1CPU  52.5/100   +21/=63/-16
2 Strelka 5.1 x64                      47.5/100   +16/=63/-21

(All Strelka 5.1 matches use ChessGUI instead of Fritz 13, because Strelka 5.1 has problems with ponder=on in that interface.)

Download the games here: http://goo.gl/J2SWq

Critter 1.4a SSE4 - Rybka 4.1 SSE42 Match Results

1   Critter 1.4a 64-bit SSE4 1CPU      +29/=47/-24 52.50%   52.5/100
2   Rybka 4.1 SSE42 x64 1CPU         +24/=47/-29 47.50%   47.5/100

It's interesting to see which engines understand which positions. Rounds 99 and 100 are especially interesting for me. It's a King's Indian, Classical: 1. d4 Nf6 2. c4 g6 3. Nc3 Bg7 4. e4 d6 5. Nf3 O-O 6. Be2 e5 7. O-O Nc6 8. d5 Ne7 9. Ne1 Nd7 10. Be3 f5 11. f3 f4 12. Bf2 g5 *. In this match, it was Rybka who scored the full point as White and Black. Usually the win goes to White, but here, Rybka showed its understanding was superior.

Download the games here: http://goo.gl/LA15i

Rybka 4.1 SSE42 x64 - Stockfish 2.2.2 SSE42 x64 Match Results

1   Stockfish 2.2.2 JA SSE42 1CPU    +26/=51/-23 51.50%   51.5/100
2   Rybka 4.1 SSE42 x64 1CPU          +23/=51/-26 48.50%   48.5/100

Download the games here: http://goo.gl/u7xQV

Houdini 2.0c Pro x64 - Stockfish 2.2.2 JA SSE42 Match Results

1   Houdini 2.0c Pro x64 1CPU          +35/=51/-14 60.50%   60.5/100
2   Stockfish 2.2.2 JA SSE42 1CPU  +14/=51/-35 39.50%   39.5/100

Download the games here: http://goo.gl/S1CcM

Komodo64 4 SSE - Rybka 4.1 SSE42 x64 Match Results

1   Komodo64 SSE Version 4 1CPU   +29/=52/-19 55.00%   55.0/100
2   Rybka 4.1 SSE42 x64 1CPU          +19/=52/-29 45.00%   45.0/100

What was interesting to me is that Komodo was +9 over Rybka in the first 50 games and Houdini was drawn vs Rybka at that point. Even so, Houdini finished with the better score (+12 vs +10).

Download the games here: http://goo.gl/2zuoK

Critter 1.4a x64 SSE4 - Komodo64 4 SSE Match Results

1   Komodo64 SSE Version 4 1CPU    +28/=49/-23 52.50%   52.5/100
2   Critter 1.4a 64-bit SSE4 1CPU        +23/=49/-28 47.50%   47.5/100

This match went back and forth, and it was fun to watch.

Download the games here: http://goo.gl/ap4rq

Houdini 2.0c Pro x64 - Rybka 4.1 x64 SSE42 Match Results

1   Houdini 2.0c Pro x64 1CPU     +36/=40/-24 56.00%   56.0/100
2   Rybka 4.1 SSE42 x64 1CPU   +24/=40/-36 44.00%   44.0/100

If the match were to have stopped half way through, it would have been in a draw. Houdini got its +12 score in the final 50 rounds.

Download the games here: http://goo.gl/7I2f3

Houdini 2.0c Pro x64 - Komodo64 4 SSE Match Results

1   Houdini 2.0c Pro x64 1CPU           +32/=48/-20 56.00%   56.0/100
2   Komodo64 SSE Version 4 1CPU  +20/=48/-32 44.00%   44.0/100

Download the games here: http://goo.gl/ZdC86

Critter 1.4a SSE4 - Stockfish 2.2.2 JA Match Results

1   Critter 1.4 64-bit SSE4 1CPU        +25/=53/-22 51.50%   51.5/100
2   Stockfish 2.2.2 JA SSE42 1CPU   +22/=53/-25 48.50%   48.5/100

Stockfish won the last two rounds (99 & 100) as White and Black in the Kings Indian, Classical, to end with a -3 score. In game 99, around move 80, Stockfish had Black and was running only on increment time (compared to over 2:00 left for Critter, if I remember correctly), yet it was able to turn the game and pull out a win. It was fun to watch.

Download the games here: http://goo.gl/AB9Dl

Komodo64 4 SSE vs Stockfish 2.2.2 JA SSE42 Results

1   Komodo64 SSE Version 4 1CPU  +29/=54/-16 56.5%   56.5/100
2   Stockfish 2.2.2 JA SSE42 1CPU   +16/=54/-29 43.5%   43.5/100

Download the games here: http://goo.gl/sR4SU

Critter 1.4a SSE4 - Houdini 2.0c match results

1   Houdini 2.0c Pro x64 1CPU        +30/=47/-23 53.50%   53.5/100
2   Critter 1.4a 64-bit SSE4 1CPU   +23/=47/-30 46.50%   46.5/100

Download the games here: http://goo.gl/uds9p

Testing Control Change

I am changing my time control to 10' + 10" increment (10 minutes per game + 10 seconds per move) and starting a new ratings database. I am also giving each engine 64 MBs of endgame cache, instead of 32. I think this is a respectable time control and is long enough to produce quality games. The standard benchmark for other chess engine test groups is based on an AMD X2 4600+ @ 2.4 GHz. My machine benchmarks almost twice as fast as that, using Crafty Bench 19.17. My computer processes the same amount of data in 40/21 as a "standard" PC does in 40/40. The total thinking time each engine of mine will have in a typical 80-move game is 2,800 seconds, or about 47 minutes. If I were to participate in a 40/40 list, my computer's thinking time would be half of that, which is 21 minutes for 40 moves (or 42 minutes for 80 moves). Forty-two minutes = 2,520 seconds, which is still  about 300 seconds less than the 2,800 seconds my engines will think in 80 moves. If any game goes beyond 80 moves, the quality should not suffer much: There is still the left-over 300 seconds plus 10 seconds per move, which, usually in an endgame, is plenty of time as to not affect game quality. Also, ponder is on, so it could be as much as 20 seconds/move thinking time.

Critter 1.4a x64 SSE4 - Houdini 2.0c x64 Match Results

ATTENTION: This match was ran at the old time control of 5' + 5''. This entire match was ran again with the new time control, and none of these games are included in the ratings report.

1   Houdini 2.0c Pro x64 1CPU        +34/=52/-14 60.00%   60.0/100
2   Critter 1.4a 64-bit SSE4 1CPU   +14/=52/-34 40.00%   40.0/100

I am a bit surprised by this result: Houdini wins by 20. Critter beat Komodo by 1, and Houdini only beat Komodo by 3, so I am surprised, a bit, by the margin in this match. I mean no offense to either engine; I just expected it to be closer. Nothing seems amiss in the PGN file. All the controls were the same. The PC was unplugged from the Internet, and all extra processes were stopped, just like all the other games. I watched many games, and nothing seemed wrong; CPU utilization was the same, no strange processes were running, the anti-virus scan never launched, etc. I don't think it is because I am using Critter 1.4a (which I have used throughout these games that I am including in the rating and is meant to fix issues with engine matches with ponder = on), because IPON uses the same version and it's quite strong in their ratings.

Download the games here: http://goo.gl/naozd

Critter 1.4a x64 SSE4 - Houdini 2.0c x64

The Critter 1.4a x64 SSE4 vs. Houdini 2.0c x64 match just started. Updates will be on Twitter.

Critter 1.4a x64 SSE4 - Komodo64 4 SSE Results

ATTENTION: This match was ran at the old time control of 5' + 5''. This entire match was ran again with the new time control, and none of these games are included in the ratings report.

1   Critter 1.4a 64-bit SSE4 1CPU          +24/=53/-23 50.50%   50.5/100
2   Komodo64 SSE Version 4 1CPU      +23/=53/-24 49.50%   49.5/100

Critter was up by 3 early on, then it was down by 4, then it was up by 3, and finally the score was almost a dead-draw. Critter won by 1 game.

Download the games here: http://goo.gl/9JDgp

Critter 1.4a x64 SSE4 - Komodo64 4 SSE

The match of Critter 1.4 x64 SSE4 vs Stockfish 2.2.2 x64 JA SSE42 was stopped prematurely. It has come to my attention that Richard Vida, the maker of Critter, released a new version of Critter to fix issues for people running engine matches with ponder = on. See this.

Also, for rating purposes, I need to have the engines be able to measure themselves against something. So, Komodo will be the connector in this game, since it played Houdini in the last match. Critter 1.4a x64 SSE4 vs Komodo64 4 SSE just started. Updates as the match progresses will be on Twitter.

Happy chessing!

Critter 1.4 x64 SSE 4 - Stockfish 2.2.2 JA SSE42

The next match will begin this afternoon (Chicago time), and it will feature Critter 1.4 x64 SSE4 vs Stockfish 2.2.2 JA SSE42.

Houdini 2.0c x64 - Komodo64 4 SSE results

ATTENTION: This match was ran at the old time control of 5' + 5''. This entire match was ran again with the new time control, and none of these games are included in the ratings report.

 
1   Houdini 2.0c Pro x64 1CPU            +28/=47/-25 51.50%   51.5/100

2   Komodo64 SSE Version 4 1CPU   +25/=47/-28 48.50%   48.5/100

Very interesting match with 53 decisive games.

Download the games here: http://goo.gl/uymnn

ATOMICC Testing on Twitter

I am now on Twitter. I will be posting status updates as the games progress on Twitter, but not on my blog. Follow the games @ATOMICCTesting

Houdini 2.0c x64 vs Komodo64 4 SSE

A 100-game match between Houdini 2.0c x64 vs Komodo64 4 SSE is in progress. Results will be posted soon.

Welcome to ATOMICC testing

All The Options Matter In Computer Chess.

I do my best to create a level playing field in my engine tests, and take it quite seriously. Thanks for your interest.

All time-stamps are London time (GMT).

:)