New CPU Benchmarking charts go live today

[David (PassMark)]

We are updating the CPU Benchmark charts today.

The new charts will be based on results from PerformanceTest V8

Changes from the previous set of charts include,

• New CPU benchmark tests with multiple changes, including
  • rebalanced set of instructions
  • use of the AES-NI instruction set
  
  
• Single threaded CPU test showing the performance when using only 1 core.
• Break down of the benchmark charts by socket type
• Separate benchmark chart for mobile CPUs
• A new chart showing power performance (CPUMark / TDP in watts)
• Max TDP & socket type is now included on the CPU details page for each CPU. Note that we don't have this infomation for all CPUs as yet
• Faster loading charts. Hit refresh in your browser if you don't initially see the new charts

[David (PassMark)]

We have had a couple of questions about the new charts and the number of CPU samples. So here is some additional background information.

The charts are made up of average results for each CPU type. For popular CPUs we might have upto 10,000 samples to average. For rare CPUs maybe only a few samples to make up an average.

At the time of writing PerformanceTest V8 has only been available for a few days. So we don't have a huge number of benchmark results collected as yet (only about 3000 submissions). For comparison, for PerformanceTest V7 we had around 600,000 submissions over the last few years.

We want the charts to have a comprehensive list of CPU types, so for the short term we'll be combining the results from PerformanceTest V7 and PerformanceTest V8 to make up the charts. Over time the PerformanceTest V8 result will start to dominate and displace the V7 results. The method for doing this will be to take the final average V7 result for each CPU and use this as 1 sample for each type of CPU. Then as more V8 samples arrive this single V7 result will be averaged with all the V8 results. Effectively diluting the V7 result into insignificance over time.

The consequence of this is that the sample count (which you can see via mouse over on the charts) will reflect the V8 sample count (+1 for the single V7 sample).