AnTuTu wants to benchmark how smart our smartphones really are
Benchmarks are fun because they tell us how powerful our devices are. AnTuTu’s benchmark system has been used to benchmark many a flagship smartphone in the past, and sometimes even revealing phones that have yet to be officially announced. Now it seems that AnTuTu wants to try benchmarking something other than raw power; it wants to benchmark how smart our smartphones are.
The company has recently announced that they will be launching a new benchmarking suite called AI Review. As its name suggests, this is a benchmarking tool used to measure how smart is our phone’s AI. Right now the tool is currently in beta and consists of two tests: an image classification test and an object recognition test.
Unlike its other benchmarking tools, AnTuTu’s AI Review will actually favor accuracy over speed. This means that while a smartphone’s AI might be able to compute the data faster but it is wrong, then it will receive a penalty versus an AI that takes long but is accurate. The tests will be based on 200 images from the the Inception v3 neural network while the second test reviews 600-frame video taken from the MobileNet SSD neural network.
It will be interesting to see if AI benchmarks will play a role in customers deciding which phone to get. So far it seems like every other handset maker wants to develop their own AI system, however not all systems can be tested yet as not all companies have supplied a public AI SDK.
Also the tool is still very much in the early stages of beta which means that there is still quite a bit of work that needs to be done.
Source: AnTuTu (via VentureBeat)