Freeware Files: Five Punishing Game Benchmarks for your GPU!
Posted 09/28/09 at 01:00:00 PM by David Murphy
What's the first I did upon hearing the numbers for ATI's new HD Radeon 5870 graphics card? I scrambled for benchmarks, because that's the one thing an announcement and subsequent review of a smokin' new piece of hardware can do for a rabid enthusiast: inspire.
It's been a while since I've actually sat down and crunched the numbers for my killer custom PC (that's killer as in legendary, not NICs). I'm not lazy. Rather, I don't have access to the expensive system benchmarks that magazines and Web sites typically use to analyze the all the new hardware that comes out. I don't have all-in-one benchmarks like PCMark Vantage, GPU-punishing titles like Crysis, and--worst of all--preconfigured demo runs for any number of titles that would help ensure the validity and repeatability of the delivered scores.
In short, I have nothing. You might not have nothing, but odds are good that you are similarly ill-equipped to benchmark your graphics card (and any tweaks or modifications you make) in the style of a professional review. Nothing... until now.
This week's freeware roundup will show you five different games that you can use to punish your poor graphics card into frames-per-second submission. They might cost a grand total of zero dollars, but these tests are repeatable and easy to use--the perfect combination of characteristics for aspiring benchmarkers who might not want to get their hands dirty, but still want some kind of way to determine exactly how powerful their graphics card really is.
X3: Terran Conflict

This demo for the open-ended space simulation game X3: Terran Conflict is like having the Four Horsemen pay a visit to your house and kick your graphics card. It's a DirectX 9 benchmark, which isn't as ideal of a scenario as you'll find in some modern titles that support DirectX 10 functionality. Still, the point of a benchmark is to tax your system to its limits. To that extent, X3: Terran Conflict is a free, fire-starter of a test for your GPU
Download it here!
Resident Evil 5

Killing zombies is fun. Killing zombies at a maximum framerate is even more fun because, er, it accelerates the killing. Right. Although it was original designed, in-part, to test out the 3D capabilities of the game for those equipped with Nvidia-based graphics cards, the Resident Evil 5 benchmark demo is still a solid solution for testing your graphics card's capabilities regardless of manufacturer. Better yet, the RE 5 benchmark comes with the option to run in both DirectX 9 and DirectX 10 modes. It's the ideal solution for those looking to test on either a current or legacy architecture... or both.
Close your eyes and download it here!
BattleForge

Okay, everyone who's a DirectX 10-or-higher benchmark, raise your right hand.
*A number of different games raise their hands*
Now everyone who's a DirectX 11-compatible benchmark, raise your left hand.
*BattleForge shoots its second hand in the air and screams as if it was on a rollercoaster*
'nuff said. This game is as graphically punishing as it is future-proofed, for this is the only title on the market as of this article's writing that now supports DirectX 11 functionality. Of course, that's slightly hampered by the fact that there are only two DirectX 11-compatible graphics cards right now. But. Er. The benchmark is free, as BattleForge itself is one of EA's "Play4Free" titles--downloading the game itself costs nothing, as the various bits and pieces that flush out the title's main RTS experience come as microtransactions. Boo those, but yay for free DX11 benchmarks!
Download it here!
Tom Clancy's HAWX

You'll appreciate the GPU benchmark found in Tom Clancy's HAWX in part because the game is just so damn pretty. Watch as your death-from-above aircraft soars over beautifully rendered satellite-generated terrain... provided your graphics card can handle the punishment, that is. This DirectX 9- and DirectX 10-compatible benchmark isn't quite as challenging on the former as it could be, but it's a real killer if you crank the settings on the latter. Can your system handle this game's intense aerial combat? Or will you long for the days of the less graphically robust A-10 Tank Killer?
Download it here!
Crysis

This is the biggie. It's the age-old retort to any video card boast: "Yeah, but can it run Crysis?" There's only one way to find out, and this is it. Install the Crysis demo, then be sure to grab the third-party Crysis Benchmarking Tool. This helpful little utility auto-detects whether you're running the full game or the demo. It also opens up access to a wealth of configurable options that you can set prior to the run--and believe me, you'll be doing a lot of tweaking. This is the end-all be-all of current graphics benchmarks, save for the aforementioned BattleForge DirectX 11 test. But that game just uses the new APIs; Crysis bends your videocard over its knee and slaps it right on the bottom.
Download Crysis here!
Download the Crysis Benchmarking Tool here!
David Murphy (@ Acererak) is a technology journalist and former Maximum PC editor. He writes weekly columns about the wide world of open-source as well as weekly roundups of awesome, freebie software. Befriend him on Twitter, especially if you have an awesome app or game you're dying to recommend!
X3 teran Conflict
Submitted by Shckr57 on Sat, 12/26/2009 - 10:22am
overall average = 99.935
highest = 364
lowest = 52
i love my pc, might try the other benchmarks as well
OK Murph...
Submitted by K0BALT on Wed, 09/30/2009 - 6:59am
here's my results with my Phenom 955 @ 3.57ghz and my (2)GTX 260 Core 216's.....
Run #1- DX10 1900x1200 AA=16x, 64 bit test, Quality: VeryHigh ~~ Overall Average FPS: 30.35
... not too shabby. I'm pretty happy. Let me knowif I missed anything. Thanks!
Great game. Please buy
Submitted by StonedMagician99 on Wed, 09/30/2009 - 4:09am
Great game. Please buy Resident Evil 5 (not just the benchmark). Well worth $50.
Eh Very High setting, Phenom
Submitted by Xylogeist on Tue, 09/29/2009 - 7:30am
Eh Very High setting, Phenom II 3.2GHtz Dual 4890s....
Crysis Very High: 16 FPS... backto thedrawing board :cry:
Cooool.
Submitted by K0BALT on Mon, 09/28/2009 - 6:06pm
I always wondered how to get an "actual" FPS score for Crysis. I just ran the benchmark and got an average 32.14FPS with (2)GTX 260's on the Very High setting @ 1900x1200. I'm pretty stoked. Thanks!
Did you crank all the extra
Submitted by TheMurph on Mon, 09/28/2009 - 7:20pm
Did you crank all the extra settings too? I'd be curious to see your score after jacking up all the performance bits and pieces to their higest settings. :D
I like the benchmarking programs!
Submitted by bingojubes on Mon, 09/28/2009 - 5:58pm
i wish all games came out with on, especially when all i get are crappy screenshots full of game site logos n stuff. it's nice to be able to run it, and look at what the games really look like.
they really don't do justice SOMETIMES, but for the Resident evil 5 benchmark, it was really sweet to watch. i do still prefer game demos, but some games just have a benchmark, i guess, even if releasing these kinds of programs ends up being kinda like an unplayable demo, but i like them because they show me an idea of what it may or may not look like when i finally get to play.
i remember when the SF4 benchmark came out, and on wel-built PCs, at lowest res and lowest settings with every little detail OFF, players were getting funny FPS @ 200-300+ . i find that pretty funny, since i got up to 600 FPS on the SF4 benchmark at those lowest settings.
i found the RE5 bencher over @ Guru3D.com, but i didn't check to see if they had an extensive listing or not. I did find the SF4 benchmark utility, there.
That's actually why I didn't
Submitted by TheMurph on Mon, 09/28/2009 - 7:22pm
That's actually why I didn't include the SF4 benchmark -- although useful for comparison's sake, I suppose, I'd rather punish a system with a demanding game than try to make a comparison between card A's score of 280 FPS and card B's score of 290...
Oh man, The Murph is fired
Submitted by lunchbox73 on Mon, 09/28/2009 - 2:55pm
Oh man, The Murph is fired up today.
Nah, I just think it's
Submitted by TheMurph on Mon, 09/28/2009 - 3:08pm
Nah, I just think it's important to keep the discussion going about these things. : )
New benchmarks
Submitted by YoshiHNS on Mon, 09/28/2009 - 2:49pm
Thanks for the list. I was trying to find different games that would give a good benchmark for my graphics card.
A big +1 to TheMurph for sticking around.
Thanks! Let me know if you
Submitted by TheMurph on Mon, 09/28/2009 - 3:11pm
Thanks! Let me know if you see any other good ones online, and I'll be sure to include them in a future roundup!
What about Homeworld? Not
Submitted by nekollx on Mon, 09/28/2009 - 3:17pm
What about Homeworld?
Not sure it's viable in the demmo buuuuuuuuuuuuuuuuuuut
[IMG]http://i182.photobucket.com/albums/x202/NekoLLX/homeworldmission16.jpg[/IMG]
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
Fire & Ice
Submitted by Black Lable 69 on Mon, 09/28/2009 - 1:56pm
If I figure out a way to run one of those on a "First Gen" Eee 901 4G Surf do I win a prize?
Yes! Yes you do! I will
Submitted by TheMurph on Mon, 09/28/2009 - 2:31pm
Yes! Yes you do! I will make you a lolcat.
rwar! good article lol
Submitted by nsk chaos on Mon, 09/28/2009 - 1:17pm
rwar! good article lol
Bench marks are fun, not useful.
Submitted by Modred189 on Mon, 09/28/2009 - 12:49pm
This has been proven time and time again. Benchmarks do not accurately show how your game will actually play in real life. Sure, you ca run the crysis demo, but it's not running AI or physics. It may test your GPU, but your CPU is not nearly as loaded as in the real game.
Not to mention that green and red BOTH code for the most-used benchmarks in order to squeak out as many fps as possible during those particular scenes.
Benchmarks can be fun to watch, and are often great ways to show off the core capability of your computer, but, personally, I never hang my computer, and my $50, on a benchmark. I'll play the demo first, and if I really want to get scientific, I'll have FRAPS record my fps.
for reference, they put it best:
http://www.hardocp.com/article/2008/02/11/benchmarking_benchmarks
Sorry, but I would rather
Submitted by TheMurph on Mon, 09/28/2009 - 1:11pm
Sorry, but I would rather take a repeatable series of benchmarks spread across numerous games than one guy's estimation about how he came kind of close to running through a real level the same way.
"After a week of trials and a lot of practice, we finally got to a place where we could pull repeatable real world gameplay run throughs. You only get one shot at recording a “good” real world run through to later use as a demo. If you screw it up, you have to start over."
Not to make this a pissing match, but Hardocp also compares videocards running on completely different settings against each other. How is that, in any way, a true apples-to-apples comparison of what each card can deliver? Also, that tells me nothing.
Just to make sure, did you
Submitted by Modred189 on Mon, 09/28/2009 - 5:39pm
Just to make sure, did you look at the article?
I ask, not to be an intarwez jerk, but because you do not address the main point of the article- Benchmarks do not represent the performance you get from the game in real-world play. That alone means that using benchmarks to compare cards, ESPECIALLY between brands and drivers, is useless. If ATi codes a driver to pump out higher clocks for the 1.5 minutes of a given demo (short enough to not risk overheating) but not during the actual game, how does that represent the performance of the card in real gameplay?
Also, what about CPU load? It's not as big of an issue as it used to be, especially on Corei5/i7 systems, but on the systems that most of us use, it still has an impact, especially on dual-core systems (i.e. the majority of systems). Without physics, AI, pathing etc running, Benchmarks load the CPU and ram differently/less.
Furthermore, go peruse [H]ardOCP's graphs, you can see the different runs and how similar the loads are, marked by savepoints and in-game movies' effects on the fps (recorded by FRAPS, btw). And while I have never seen [H]ardOCP compare systems of different specs, it's a moot point, as the article I linked used one system for the whole test, and has no relevance to my point in general:
Benchmarks do not represent the experience you will have in actually playing the game. They remove too many variables and loads, and present too much of an opportunity for driver devs to cheat.
If you disagree, fine, but deal with these ideas, not whether you like the website or not...
Hardocp also compares
Submitted by nekollx on Mon, 09/28/2009 - 1:15pm
Hardocp also compares videocards
running on completely different settings against each other. How is
that, in any way, a true apples-to-apples comparison of what each card
can deliver?we may disagree on some aspects of the bench but this is totally +1
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
just for reference, [H] uses
Submitted by Modred189 on Mon, 09/28/2009 - 5:42pm
just for reference, [H] uses fraps to record their runs, and they are very consistent, see their graphs and my comment, above...
And I have never noticed them comparing runs from different systems.... I just don't think that's true...
that's what i was saying.
Submitted by nekollx on Mon, 09/28/2009 - 12:54pm
that's what i was saying. First Party Benches aren't unbiased, that why i like FRAPS
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
*Sigh*
Submitted by habuza on Mon, 09/28/2009 - 10:43am
I'm so tired of seeing crysis. It's old cheese. My rig runs it at 50 fps on max graphics. Next please.
Seeing as a single ATI HD
Submitted by TheMurph on Mon, 09/28/2009 - 11:00am
Seeing as a single ATI HD 5870 card can't even hit 40 fps by itself when Crysis is maxed out, uh, what benchmark would you prefer to use to test a videocard to its limits?
Heck, just look at the chart in the review -- no other game Maximum PC uses tests a graphics card as much as Crysis.
Just curious as to what
Submitted by lancethepants on Mon, 09/28/2009 - 12:34pm
Just curious as to what Resolution 'max' is. Do you run it at 1920 x 1200?
I should have specified --
Submitted by TheMurph on Mon, 09/28/2009 - 2:32pm
I should have specified -- maxed out, in this case, meant the 1920x1200 resolution that MPC uses for its benchmark. That said, the card wouldn't hit 40 FPS on the 2560x1600 of a 30-inch display with all the graphics settings cranked up.
one word
Submitted by nekollx on Mon, 09/28/2009 - 10:30am
FRAPS
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
...is shareware, with a
Submitted by TheMurph on Mon, 09/28/2009 - 10:38am
...is shareware, with a 30-second maximum limit for any recording. Plus, how are you going to go about constructing the actual benchmark run without a paid-for copy of the game, assuming you can even do that for some of the titles you might want to test (like a number of games on this list).
but you can get FPS for
Submitted by nekollx on Mon, 09/28/2009 - 10:41am
but you can get FPS for free and always on, no need to hunt aroud for some demo add on, run the demo. Run fraps. See FPS. no need for 13 different bench marking tools for each game. one FPS to rule them all.
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
Now why would you use all of
Submitted by Muerte on Mon, 09/28/2009 - 11:00am
Now why would you use all of these games to do basically the same test. If you really want to just do the benchmark choose the one that best fits the rig your testing and use it.
But if you want to check out how all these games look just for shits and giggles dl them all.
You're going to base the
Submitted by TheMurph on Mon, 09/28/2009 - 11:06am
You're going to base the performance of your rig on a single benchmark? In that case, you might as well use the Windows Experience Index number and save yourself the trouble of having to install anything.
Without getting too deep into things, a wide variety of benchmarks allows you to get a complete picture of how your system--or graphics card--is actually performing. Just running one benchmark isn't enough for accuracy's sake, as certain card and driver combinations might natively be able to handle one game beter than another. How will you know if your card Kicks Ass... or if it's just a factor of the game being better coded / a better fit for an individual GPU platform?
That's why Maximum PC runs many, many benchmarks on the items it tests -- and it's why you see five different games in this list instead of just one big "RUN CRYSIS" headline.
...you'll note that all of
Submitted by TheMurph on Mon, 09/28/2009 - 10:57am
...you'll note that all of the aforementioned programs *are* free. In fact, all you have to do is run the game then click on the subsequent "benchmark" or "performance test" mode.
In your situation, you'd have to run each game, fire up fraps, record your average FPS over a limited 30-second window... you're essentially doing the exact same thing that these games themselves do, only less of it. Plus, you'll have to create your own benchmark runs for whatever game you're using if you want valid, repeatable results -- since the benchmark runs are identical in the games listed above, this step has already been done for you as well.
I'm not knocking Fraps. However, it's a great deal more work than just clicking a button, sitting back, and letting the game take care of the benchmarking and FPS recording for you.
but in your case you have
Submitted by nekollx on Mon, 09/28/2009 - 11:04am
but in your case you have to run 5 diffenrt benches instead of one (which leads to inconsistency with multiple "versions")
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
What are you talking
Submitted by TheMurph on Mon, 09/28/2009 - 11:12am
What are you talking about? Inconsistency with what?
The point is that you're running five separate benchmarks to get a completely accurate picture of how your graphics card is performing. You can't just run a single benchmark and call it a day -- why do you think Maximum PC, or any site worth it's weight in reviewing, runs multiple tests with multiple pieces of software? To eliminate inconsistencies and verify that a card is going to deliver its performance across a wide range of scenarios.
It would sure be a real shame to find out that a card that rocked the RE 5 benchmark is actually an underperforming piece of hardware--especially if [manufacturer] tweaked the drivers to deliver better-than-expected performance in that single title.
see that's my concern. How
Submitted by nekollx on Mon, 09/28/2009 - 11:17am
see that's my concern. How am i to know the"offical RE5 Benchmark" doesnt fudge the number on RE5. Atleast FRAPS is multi programs so theirs no bias. Ideally id run several, 3rd party, benches alas...their aren't many.
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
That's the point -- you run
Submitted by TheMurph on Mon, 09/28/2009 - 11:19am
That's the point -- you run multiple benchmarks across multiple games to ensure that the numbers you're seeing are indicative of a card's performance, not a fluke. To your point, you could certainly run Fraps at the same time you run the RE 5 benchmark and see how the numbers compare.
Fraps is one way to go about benchmarking, but there's no way to record a timed demo in RE 5. You would thus lose that game as a benchmark.
yeah it's just the idea of
Submitted by nekollx on Mon, 09/28/2009 - 11:27am
yeah it's just the idea of trusting a first party bench i don't like. As for recording there is this thing called Paper they use to make. Besides whatgood id a recording? You need a average: Normal play, chaos zone/high lag, "idle"your still going to have to extrapoate the average from a recording.
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
Sigh. Record a timed demo
Submitted by TheMurph on Mon, 09/28/2009 - 11:48am
Sigh. Record a timed demo = you create a demo run, whereby your actions are repeated identically each and every time you run the benchmark. That way, you are eliminating the external variables that could impact the FPS result you obtain, which will give you a truer indication of the card's abilities and a stronger degree of confidence for your benchmark runs.
Simply put, you can't just fire up Fraps and play your favorite level over and over -- you'll be performing different actions and seeing different elements displayed on the screen each time, which will affect your FPS results when you go to make a final comparison. Apples-to-apples testing -- that's how it's done.
FRAPS...
Submitted by Airheadq on Mon, 09/28/2009 - 11:42am
I have to comment on this. FRAPS isn't a benchmark, its an FPS
monitor. To be blunt, it overlays the game and spits out your fps. It
doesn't stress your hardware in anyway.There is a need for multiple games since they are coded differently one my stress the CPU
harder than the GPU and vice-versa. FRAPS is just nice to have to
always show the fps and log it.
Ditto, Fraps is a nice
Submitted by lancethepants on Mon, 09/28/2009 - 12:17pm
Ditto, Fraps is a nice application to see real time fps. Sure you can setup your own benchmark, but getting it to run exactly the same each time would be difficult, and heavily mess up your stats if it doesn't, Why not run these premade benchmarks which ensure each run is taxing your system exactly the same. Plus these benchmarks are run by many people allowing for better comparison. It will also allure you to any inconsistencies that your system may have. For example, if it seems to be underperforming compared to comparable hardware running the same benchmark. Additionally, some benchmarks may be CPU bound, while others are GPU bound, or Memory Bound etc. So any one benchmark really can't assess the true performance of you PC.
i think you miss
Submitted by nekollx on Mon, 09/28/2009 - 11:46am
i think you miss understand. I'm advocating 5 Games + 3rd party bench vs 5 game+ 5 first party (potentially biased) benches.
------------------------------
Coming soon to Lulu.com --Tokusatsu Heroes--
Five teenagers, one alien ghost, a robot, and the fate of the world.
I think you miss the
Submitted by Jasker on Mon, 09/28/2009 - 2:43pm
I think you miss the point. Not the rest of us. How do you intend recreating a fraps clip more than once to come up with any kind of repeatable test? You make one 30s run at a single game and call it good? There isn't a practical way to FRAPS the excat same scene more than once, which you'd want to do. I think you're taking the "Damn The Man" approach too far.
We do realize that FRAPS for
Submitted by Modred189 on Mon, 09/28/2009 - 5:59pm
We do realize that FRAPS for a nominal fee ($40) you can unlimited recording, benchmarking etc. I know that for most of us that might seem like a lot, but for the average MaxPC reader who upgrades cards and buys games like crazy, it's a pittance for the information gleaned...?
Well
Submitted by Airheadq on Mon, 09/28/2009 - 12:15pm
Since these are quote benchmarks/Demos from the developer themselves, they do give an accurate level of how your PC will perform in the
actual game. Granted that the last level in Crysis will tax your
hardware more than the demo level, its still playable. If your PC
performs well in these demos, then that is a good indication that it
will perform similarly in the full version.
Feature
Review
Feature
Feature
Feature






