Benchmarking Test Is Just About Integrity

        Some reports have suggested that HTC may be cheating in benchmarks recently, when it comes to AnTuTu. The new Asian HTC One (M8) model scored differently in the AnTuTu 4.0 and the AnTuTu X app -- an alternative version to AnTuTu 4.0 specially designed to prevent devices from cheating. HTC has recognized this “special setting”. Antutu believe, we provide benchmarking app as not only a objective reference for testing the performance of mobile phones but also, a way for testing the manufacturers’ integrity.

Event Overview：

       It is reported from Phonearena, compared benchmarks in both the AnTuTu 4.0 and the AnTuTu X app , different results were found for the Asian HTC One (M8) model. The model scored 38,815 in AnTuTu, but just 27,171 in AnTuTu X. The site also tested the LG G Pro 2, the Galaxy S5 and the Xperia T2 finding similar scores for each device in the two benchmarks, like 32000,30000 and 35000.

Test results from media

After these reports, HTC made an announcement in an email as their response:

       "Thanks for your email about the HTC One (M8). Benchmarking tests look to determine maximum performance of the CPU and GPU and, similar to the engine in a high-performance sports car, our engineers optimize in certain scenarios to produce the best possible performance. If someone would like to get around this benchmarking optimization there are ways to do so, but we think most often this will not be the case."-HTC

      HTC acclaimed that“the High Performance mode”is available to anyone who wants it at any time. In this mode, the score could be “normal”. For now, only Asian HTC One (M8) has this the High Performance mode”.The mode is not available to U.S. devices for the time being, but it will arrive via a future software update.

The “optimizations”

      Upon detecting a white listed benchmark by APK identifier alone, most OEMs would enable a performance mode that would: Plug in all CPU cores, run all cores at max frequency and raise thermal limits to eliminate/reduce throttling. The short time of testing will not cause heating problem.

N: no cheating，Y: cheating（fr AnandTech）

Our view：Benchmarking test is just about integrity.

         The high benchmarking test results may draw more attention from customers in most cases. However, what HTC has done to customers by over-promising real-world performance is a kind of bully. Benchmark results are clearly important for customer, for the benchmark results represent high performance and better using experience. If HTC has no ability to provide all-round performance to users, they should not release false and misleading advertising. The so called “High Performance mode”is a remedial action after the cheating exposure. But, what if there was no “exposure”yet?

        Benchmarking is way to measure maximum performance . And this performance, at some point, is an important motivation of purchasing. We believe that consumers using Antutu app to test their mobile phones as a  way to verify the promotion advertising from the manufacturers, and it’s also a method to test their integrity. Less cheating, better performance, please.