CPU Tests: Legacy and Web

In order to gather data to compare with older benchmarks, we are still keeping a number of tests under our ‘legacy’ section. This includes all the former major versions of CineBench (R15, R11.5, R10) as well as x264 HD 3.0 and the first very naïve version of 3DPM v2.1. We won’t be transferring the data over from the old testing into Bench, otherwise it would be populated with 200 CPUs with only one data point, so it will fill up as we test more CPUs like the others.

The other section here is our web tests.

Web Tests: Kraken, Octane, and Speedometer

Benchmarking using web tools is always a bit difficult. Browsers change almost daily, and the way the web is used changes even quicker. While there is some scope for advanced computational based benchmarks, most users care about responsiveness, which requires a strong back-end to work quickly to provide on the front-end. The benchmarks we chose for our web tests are essentially industry standards – at least once upon a time.

It should be noted that for each test, the browser is closed and re-opened a new with a fresh cache. We use a fixed Chromium version for our tests with the update capabilities removed to ensure consistency.

Mozilla Kraken 1.1

Kraken is a 2010 benchmark from Mozilla and does a series of JavaScript tests. These tests are a little more involved than previous tests, looking at artificial intelligence, audio manipulation, image manipulation, json parsing, and cryptographic functions. The benchmark starts with an initial download of data for the audio and imaging, and then runs through 10 times giving a timed result.

We loop through the 10-run test four times (so that’s a total of 40 runs), and average the four end-results. The result is given as time to complete the test, and we’re reaching a slow asymptotic limit with regards the highest IPC processors.

(7-1) Kraken 1.1 Web Test

Google Octane 2.0

Our second test is also JavaScript based, but uses a lot more variation of newer JS techniques, such as object-oriented programming, kernel simulation, object creation/destruction, garbage collection, array manipulations, compiler latency and code execution.

Octane was developed after the discontinuation of other tests, with the goal of being more web-like than previous tests. It has been a popular benchmark, making it an obvious target for optimizations in the JavaScript engines. Ultimately it was retired in early 2017 due to this, although it is still widely used as a tool to determine general CPU performance in a number of web tasks.

(7-2) Google Octane 2.0 Web Test

Speedometer 2: JavaScript Frameworks

Our newest web test is Speedometer 2, which is a test over a series of JavaScript frameworks to do three simple things: built a list, enable each item in the list, and remove the list. All the frameworks implement the same visual cues, but obviously apply them from different coding angles.

Our test goes through the list of frameworks, and produces a final score indicative of ‘rpm’, one of the benchmarks internal metrics.

We repeat over the benchmark for a dozen loops, taking the average of the last five.

(7-3) Speedometer 2.0 Web Test

Legacy Tests

(6-5a) x264 HD 3.0 Pass 1(6-5b) x264 HD 3.0 Pass 2(6-4a) 3DPM v1 ST(6-4b) 3DPM v1 MT(6-3a) CineBench R15 ST(6-3b) CineBench R15 MT

CPU Tests: Encoding CPU Tests: Synthetic and SPEC
Comments Locked

210 Comments

View All Comments

  • HarkPtooie - Saturday, January 30, 2021 - link

    Noteworthy points:
    It is an i7-10700F
    On a Gigabyte B460M
    Populated with 4x16 GB DDR-3000
    With an ancient Quadro K2000 and an NVMe SSD.
    Hyperthreading is disabled.
    I use it for running FEA simulations aside my Ryzen workstation, and it performs like a champ. The cheap&old wattmeter hoovers around 157 W or so during simulations. 100% CPU load.

    So I take it that if I got the Z490, the CPU would draw 60W more. Would it go faster?
  • Qasar - Saturday, January 30, 2021 - link

    as Spunjji said Harkptooie, practically every review out there, says the opposite of what you are.
    so, who is correct then ?
  • HarkPtooie - Sunday, January 31, 2021 - link

    Oh, they do? Be a sport and link me to all those reviews.

    TechPowerUp puts it at 2W above the 3700X at stress test.
    https://www.techpowerup.com/review/intel-core-i7-1...

    Annnnd... that's it. The rest I find are all "compare" sites listing numbers culled from manufacturer sites.
    And here comes Anandtech and tells me that my eyes are deceiving me and that my CPU is actually pulling twice as much as I am observing.
    The explanation of which would be that better mobos have a power setting that allows it to draw much more than default, with no obvious benefits? I don't get it.
  • Everett F Sargent - Sunday, January 31, 2021 - link

    Well, now you are almost there. Wherever there is. that is.

    Watts (power) * Time (seconds) = Energy (e. g. kWh) used

    Power (W) versus frequency (Hz) is highly nonlinear (concave up and more so the closer you get to the redline). Your cooling solution can only dissipate so much power per unit time in 247 continuous operation, at a low enough core temperature.

    This is all really basic stuff.

    So, it will take longer to complete a fixed task at 125W then that same fixed task at 250W (all other things being equal), wherein the first task is running at 4GHz and the 2nd task is running at 5Ghz. These are only example numbers btw.

    That TechPowerUp review has plenty of fixed task benchmarks (on the other pages) wherein the total time (in seconds) is given. You might want to check out those pages also.

    They use four settings on a Z490 MB. The one that is closest to the out-of-box MB tests mentioned here is their "The third data point (blue bar) sees us relaxing the power limits to enable the maximum turbo frequency available for this processor." or what those bar charts are labeled as "Core i7-10700 Max Turbo" ...

    It is a real shame that more sites don't do thorough enough reviews. So, for example, on this review on the 2nd page ...
    https://images.anandtech.com/doci/16343/10700KInte...
    That is a fixed time test and not a fixed task test. That should have been explained in this review.

    Maybe this site will do better next time, by using a low end out-of-the-box MB in addition to their high end out-of-the-box Z490 MB. Report frequency, power, energy and time for all tests/tasks. Use proper recording of all these to get a more complete picture of what the heck is going on (time series and integrals thereof even).

    My formal and informal (or on the job) training in doing scientific experiments goes back almost fifty years now. Not that that means anything on the internet. :/
  • Qasar - Sunday, January 31, 2021 - link

    HarkPtooie toms hardware, gamers nexus, redgamingtech, moores law is dead. all pretty much say intel uses more power then amd. in some cases, quite a bit more.

    so either you have your system set up differently, and are forcing it to use the power it does, and the rest, let the board run as it see's fit, as you said : The explanation of which would be that better mobos have a power setting that allows it to draw much more than default, with no obvious benefits? I don't get it. " actually there is a benefit, when intel's cpus are allowed to use as much power as it can and wants, the performance goes up.
    but what ever, you believe what you want.
  • HarkPtooie - Monday, February 1, 2021 - link

    Yes, they do - but they do not say that the i7-10700 non-K uses twice the power of an equivalent Ryzen. That is exclusive to this article, and the explanation is that here they use "boost max all the time" BIOS settings that are not quite the nominal default for this CPU.

    This is overclocking.

    Personally I turn it around and think "I am impressed at the performance Intel managed to squeeze out of this CPU at this power level, considering the process node disadvantage".

    I am no fanboy. I usually buy AMD because bang/buck. This time I needed AVX-2 without having to tinker with experimental settings, which is the case with AMD+ANSYS.
  • HarkPtooie - Monday, February 1, 2021 - link

    Ah - so the thing is that my CPU runs default as Intel intended it out of the box, whereas this review uses special motherboard settings that overdrives into a "use any power you need" zone where the max turbo runs all the time?

    Okay. That would explain things.

    That Intel uses more power than AMD is not surprising since there is a substantial difference between 10 nm and 7 nm. And I am well aware that they cheat the numbers to look better - but that does not change the fact that nominally my 10700 draws about as much as my 3700X - and performs more or less equally. A bit faster single-thread, a bit slower multi-thread.

    What this review amounts to is "If you reach inside your system and boost the shit out of your i7, it draws much more power than Ryzen." - why not go all the way and overclock them to 6 GHz and shriek about how the Intel draws 800W while the AMD only needs 600W?
  • Everett F Sargent - Monday, January 25, 2021 - link

    What MB are you using and/or can you set PL!/PL2 in your BIOS settings? The article is suggesting that on higher end MB's, or some such, the PL1/PL2 settings are set to infinity or can be changed in the BIOS settings (even on a non-K CPU). PL1 is 125W so it appears that your MB has that limit.
  • Everett F Sargent - Monday, January 25, 2021 - link

    OK, made a mistake, the i7-10700 has a PL1 value of 65W and a PL2 of 224W and a PL1 Tau of 28s (those appear to be nominal or default values). Still curious as to the MB and accessible BIOS settings. Also is there any system software to see these settings (e. g. like AIDA64). TIA
  • HarkPtooie - Tuesday, January 26, 2021 - link

    I did not set any PL. The systems are default except for the RAM speed with is set by XMP to 3000 and 3200 MHz respectively.

    Should I interpret it as "during certain settings, the i7 can be made to consume vastly more power than it does by default"? That seems contrived.

    All I know is that their power consumptions as measured for the whole system are roughly on par during conditions where incidentally the i7 also outperforms the Ryzen in single-thread applications. It is not a bad CPU.

Log in

Don't have an account? Sign up now