“Unveiling AnTuTu’s Newest Benchmark: A Deep Dive into AI Chip Performance”
We can now examine manufacturers’ claims regarding AI chip performance enhancements with greater scrutiny, thanks to AnTuTu’s latest benchmarking tool.
If you’ve delved into in-depth smartphone reviews, the name AnTuTu is likely familiar. This company’s smartphone benchmarking system is widely recognized for evaluating and comparing the CPU and 3D capabilities of various devices.
With dedicated AI chips making their way into smartphones ranging from budget-friendly to top-of-the-line models, AnTuTu has stepped up to create a benchmark designed specifically for assessing their performance.
In a recent blog post, AnTuTu revealed that its benchmark consists of two main categories – ‘Image Classification’ and ‘Object Recognition’.
AI News put AnTuTu’s benchmark to the test on a Huawei Mate 20 Pro, which currently holds the second position on AnTuTu’s general performance leaderboard for Android devices. Huawei frequently boasts about the impressive AI capabilities of its flagship models.
The initial test involves classifying 200 images at the fastest possible rate using the Inception v3 neural network. AnTuTu subsequently provides an overall benchmark score along with individual scores for each category.
Here’s how our Mate 20 Pro performed:
Overall – 65,222
Image Classification – 41,717
Object Detection – 23,505
Each category score is further divided into metrics for ‘speed’ and ‘accuracy’. Should a device prioritize speed over accuracy, it would receive a lower score.
AnTuTu emphasizes that this method helps to deter companies from cheating by allowing devices to process data quickly without delivering accurate results. There have been past incidents where smartphone manufacturers have been caught artificially inflating their benchmark results; hence, this approach instills greater confidence in the reliability of the outcomes.
For a broader perspective on the AI functionalities within the Mate 20 Pro, check out our video below:
AnTuTu provides a comprehensive overall benchmark score along with detailed scores for each performance category.
Here’s how our Mate 20 Pro performed:
Overall – 65,222
Image Classification – 41,717
Object Detection – 23,505
Each category score is meticulously broken down into assessments for ‘speed’ and ‘accuracy’. If a device opts for speed at the expense of accuracy, a lower score is thus assigned.
AnTuTu reiterates that this structure aims to prevent falsification by ensuring devices that process data rapidly but inaccurately do not receive favorable scores. Previous instances of manufacturers artificially enhancing their benchmark results underscore the importance of this method, enhancing user trust in the findings.
