CPU Tests: Legacy and Web

In order to gather data to compare with older benchmarks, we are still keeping a number of tests under our ‘legacy’ section. This includes all the former major versions of CineBench (R15, R11.5, R10) as well as x264 HD 3.0 and the first very naïve version of 3DPM v2.1. We won’t be transferring the data over from the old testing into Bench, otherwise it would be populated with 200 CPUs with only one data point, so it will fill up as we test more CPUs like the others.

The other section here is our web tests.

Web Tests: Kraken, Octane, and Speedometer

Benchmarking using web tools is always a bit difficult. Browsers change almost daily, and the way the web is used changes even quicker. While there is some scope for advanced computational based benchmarks, most users care about responsiveness, which requires a strong back-end to work quickly to provide on the front-end. The benchmarks we chose for our web tests are essentially industry standards – at least once upon a time.

It should be noted that for each test, the browser is closed and re-opened a new with a fresh cache. We use a fixed Chromium version for our tests with the update capabilities removed to ensure consistency.

Mozilla Kraken 1.1

Kraken is a 2010 benchmark from Mozilla and does a series of JavaScript tests. These tests are a little more involved than previous tests, looking at artificial intelligence, audio manipulation, image manipulation, json parsing, and cryptographic functions. The benchmark starts with an initial download of data for the audio and imaging, and then runs through 10 times giving a timed result.

We loop through the 10-run test four times (so that’s a total of 40 runs), and average the four end-results. The result is given as time to complete the test, and we’re reaching a slow asymptotic limit with regards the highest IPC processors.

(7-1) Kraken 1.1 Web Test

Google Octane 2.0

Our second test is also JavaScript based, but uses a lot more variation of newer JS techniques, such as object-oriented programming, kernel simulation, object creation/destruction, garbage collection, array manipulations, compiler latency and code execution.

Octane was developed after the discontinuation of other tests, with the goal of being more web-like than previous tests. It has been a popular benchmark, making it an obvious target for optimizations in the JavaScript engines. Ultimately it was retired in early 2017 due to this, although it is still widely used as a tool to determine general CPU performance in a number of web tasks.

(7-2) Google Octane 2.0 Web Test

Speedometer 2: JavaScript Frameworks

Our newest web test is Speedometer 2, which is a test over a series of JavaScript frameworks to do three simple things: built a list, enable each item in the list, and remove the list. All the frameworks implement the same visual cues, but obviously apply them from different coding angles.

Our test goes through the list of frameworks, and produces a final score indicative of ‘rpm’, one of the benchmarks internal metrics.

We repeat over the benchmark for a dozen loops, taking the average of the last five.

(7-3) Speedometer 2.0 Web Test

Legacy Tests

(6-5a) x264 HD 3.0 Pass 1(6-5b) x264 HD 3.0 Pass 2(6-4a) 3DPM v1 ST(6-4b) 3DPM v1 MT(6-3a) CineBench R15 ST(6-3b) CineBench R15 MT

CPU Tests: Encoding CPU Tests: Synthetic and SPEC
Comments Locked

210 Comments

View All Comments

  • magreen - Friday, January 22, 2021 - link

    Man Spunji, you are diligent. I was just going to ignore the obvious troll
  • Spunjji - Monday, January 25, 2021 - link

    It's a sensible policy - I just like debunking FUD 👍
  • bji - Thursday, January 21, 2021 - link

    Ryzen 5 5600x at $299 is a lie right now than and has been for months. It's slowly coming down to $399 with general availability. It will be months before it's actually available at $299.

    Please no one respond with stories of one-off deals that they happened to get from some rare and hard to find vendor, where the deal was only available for 10 minutes anyway.

    The simple fact is that no Ryzen 3 processors have had general availability at anywhere near MSRP for months.
  • Golgatha777 - Thursday, January 21, 2021 - link

    I've personally purchased 2 5600X and 1 5800X for MSRP at Micro Center?
  • bji - Thursday, January 21, 2021 - link

    Micro Center is not "general availability" given that it's only accessible to a few million people who happen to be within driving distance of one of their stores so, you fail.
  • silverblue - Thursday, January 21, 2021 - link

    Well... one stockist (OCUK) in the UK has had the 5600X at £279 for at least the past 24 hours, whereas the average on Google seems to be about £310 to £320. Your mileage may obviously vary, I suppose.
  • bji - Thursday, January 21, 2021 - link

    The US MSRP is $299 which is 218 British Pounds. So the numbers you quote indicate a significant reseller mark-up which makes my point. So thanks for agreeing with me.

    I wouldn't mind paying AMD a fair price ($399 apparently) for a 5600X, but I will NOT give $100 or more to scalpers. AMD will use my money to make me more of what I want (faster chips). Scalpers will use my money to just scalp me harder in the future. I will never buy a scalped product.

    And so I continue to wait and wait to build a 5600X/RTX3080 gaming PC ... been waiting for months now ...
  • Calin - Friday, January 22, 2021 - link

    I think the UK price indicate about 20% of Value Added Tax - which is paid directly at the moment of sale. If I remember correctly, US prices do not contain "State Tax" and the like.
  • silverblue - Sunday, January 24, 2021 - link

    Exactly. Aside of any delivery costs from retailer to customer, we pay what's written on the price tag. That $299 isn't looking so cheap now. Funnily, the current conversion from dollars to pounds means a near 1:1 for comparison.
  • jimbo2779 - Friday, January 22, 2021 - link

    Everything is more expensive in the UK. Our MSRP is different to yours because of import duties. MSRP is still MSRP just that our MSRP is different from your MSRP.

    We would not be expecting to be paying US pricing just as we wouldn't expect to pay the going rate in Australia, that is the case for every saleable item.

Log in

Don't have an account? Sign up now