Google Assistant Wins IQ Test

Google Assistant performed the best over Siri and Amazon Alexa in an 800-question “IQ”test from Loup Ventures. In terms of how often the digital assistants answered the questions correctly, the results were as follows:

  • Google Assistant: 92.9%
  • Siri: 83.1%
  • Amazon Alexa: 79.8%

Related: The Best Home Security Cameras of 2019

while the assistants understood the queries the following percentage of times:

  • Google Assistant: 100%
  • Siri: 99.8%
  • Amazon Alexa: 99.9%
Google Home Hub
Google Home Hub

The test included questions regarding local information, like where is the nearest coffee shop, commerce, asking the assistant to buy more paper towels, navigation, information, and commands. Not only was Google Assistant the top performer overall in terms of correctness and comprehension, but it was also the top performer in all five categories except Command, which Siri won. As the digital assistant IQ test from Loup Ventures occurs annually, the company can track the assistant’s improvement over time. In the past 13 months, Google Assistant has improved by 7%, Alexa by 18% and Siri by 5%.

Related: 2019’s Best Password Managers

Gene Munster, Managing Partner of Loup Ventures, along with Associate Will Thompson were surprised that Alexa did not perform the best in Commerce, considering Amazon’s domination of online commerce. The largest disparity was in the Commerce section, with Google Assistant answering correctly 92% of the time while Alexa only answered correctly 71% of the time. In the test results, Munster and Thompson wrote,

“We believe, based on surveying consumers and our experience using digital assistants, that the number of consumers making purchases through voice commands is insignificant. We think commerce-related queries are more geared toward product and service research and local business discovery than actually purchasing something, and our question set reflects that.”

Munster and Thompson were impressed at how much these systems have improved in the past few years, and they expect more improvements in the future. They wrote, “New skills are hard to discover and, therefore, don’t get used. To become a habit, new use cases need to be well understood, simple to use, and solve a problem that voice is uniquely suited to solve. We will continue to refine our test to be sure it addresses these new use cases as they emerge.”

Aliza Vigderman

Aliza Vigderman

Aliza is a journalist living in Brooklyn, New York. Throughout her career, her work has spanned many intersections within the tech industry. At SquareFoot, a New York-based real estate technology company, she wrote about the ways in which technology has changed the real estate industry, as well as the challenges that business owners face when they want to invest in property. At Degreed.com, an education technology website, Aliza created digital content for lifelong learners, exploring the ways in which technology has democratized education. Additionally, she has written articles for The Huffington Post as well as her own content on Medium, the online publishing platform. Aliza’s love of journalism and research stems from the excellent Journalism program at Brandeis University. At Brandeis, Aliza interned as a research assistant at the Schuster Institute for Investigative Journalism, a non-profit “news room without walls”. There, Aliza was paired with an investigative journalist and used academic databases to obtain data on everything from the suicide rates in Bhutan to local Boston court cases. Her last position was as an account executive at Yelp, educating business owners on the power of technology to increase revenue. Throughout, however, her heart remained with tech journalism, and she’s thrilled to be writing for Security Baron. When she’s not keeping afloat of the latest tech trends, Aliza likes to cook, read, and write. A former high school “Class Clown,” Aliza has completed two feature-length screenplays, a pilot, and countless comedic sketches. On her days off you can find her relaxing in Prospect Park, trying the latest flavors at Ample Hills Ice Cream, and spending time with friends and family.

Leave a Comment

Trending News

Follow Us

Reviews