This whole industry bites at....
IEatApples said:
Benchmarking. It is pretty sad.
So, what's wrong with this benchmark?
1. The applications selected have very small gains from threading.
The major aspect of the Core Duo is that it is DUAL CORE. A significant part of the gain is from the TWO processing cores.
2. The 512MB of RAM in each system.
Look, almost everyone will admit that OS X itself runs sluggish under 512MB of RAM. Yeah, it's the default memory amount. But, everyone either upgrades from Apple or upgrades third party. So, instead of testing the two systems in a somewhat even manner, let's hamstring the Intel Mac by throwing it deep into swap for Rosetta performance testing.
Why not give this a try....
1. Load both the G5 and the Intel Mac with 2GB or RAM.
2. Instead of running each of these performance tests independently....how about running the iTunes, iMovie, iPhoto, iDVD, ZIP, iSquint, and BBEdit all at the same time.
I don't know about ya'll, but I tend to have 8-12 applications going at any one time. There are a couple of ways to test.
1. Specific application performance. This would be like photoshop testing. Where the performance of a specific application is critical.
2. Overall System Performance. This is where you run a number of applications all at once, simulating a high stress but realistic operating environment.
3. Component Performance Testing. This is like the SPEC benchmarking. This is where you attempt to isolate a specific component. These tend to be the most useless from the end user perspective. There are just to many component interactions in a system for this isolated data to be that useful.
So...to further make the case for testing with more RAM.....
1. If you are doing application performance testing, at least make sure the evironment is similar to the production evironment. If you are using Photoshop in a professional capacity, are you really going to run 512MB of RAM? I hope not. You will load up with 2GB most likely (especially at current pricing). This means the benchmarks for Photoshop running on 512MB of RAM are useless. Benchmarks at 2GB or RAM would provide a reasonable representation of what you can expect in the real world, which is where it all matters.
The same goes for general system testing. I care how it will perform in a real environment, not some contrived environment that is known to be resource constrained.
- Kelson