Shared publicly  - 
 
I wonder when +Vladimir Pantelic will make use of those to get my Archos tablet work faster.
1
Bernhard Rosenkränzer's profile photoDenys Dmytriyenko's profile photoMatt Porter's profile photoVladimir Pantelic's profile photo
7 comments
 
+Marcin Juszkiewicz actually, I am quite puzzled by this benchmark.

First of all it's all 3D stuff that should be handled by the SGX (and which is all done by the same SGX driver and hardware).

Then, it's claimed that the Linaro stuff runs twice faster (60fps vs 30fps) - which I find hard to believe if there are only toolchain improvements involved.

From our own experiences 30fps vs 60 fps is more a bug in the display chain making it miss every 2nd VSYNC or so...
 
 
To be completely honest, we didn't do any profiling on this yet, so we don't really know if the AOSP build is spending a lot of time waiting for a VSYNC that doesn't arrive or something.

What we do know, however, is that a real GPU-bound 3D benchmark such as GLMark2 is not all that much faster (Not much of a surprise, given we don't have the source for the SGX driver, so we can't fix it -- it's about 2% faster), but other CPU and memory intensive benchmarks (e.g. Sunspider) show an almost equal improvement on our builds, and some benchmarks (Dhrystone) show an even bigger improvement.

My suspicion (which should be taken as an educated guess) is that 0xbench's 3D benchmark ends up doing things on the CPU that it could also be doing in the GPU, including fairly heavy use of memcpy() and friends (given those are what we optimized most).

So why did we run a demo on what is likely a bogus benchmark?
First of all, because it looks good. Lots of non-tech people there - we could have run Sunspider or Dhrystone, but even though the numbers would have been more impressive, people would just have gone by without really looking - numbers are "boring", but seeing one box running circles around another is "impressive", even though both show the exact same thing.

Second, this is a repeat of an earlier demo - in last year's Connect at Cambourne, we did an identical "racing demo" (showing our build to be around 10% faster), and at the time, there just weren't that many benchmarks available to choose from.

Third, as bogus as the benchmark may be, its result pretty much matches what we're seeing in other benchmarks - and the results are consistent, so while it doesn't test what it probably intended to test (GPU performance), it does test something (probably a mix of calculations done in software, memcpy() performance and others, with a bit of GPU performance thrown in).
 
+Bernhard Rosenkränzer then it would be nice to see these other benchmarks.

I do not fully agree with "let's output a benchmark because it looks nice", I am now being asked by not just +Marcin Juszkiewicz whether and when we will make our stuff 100% faster by using Linaro...
Add a comment...