Google how created a conversational chatbot named Meena. While most chatbots perform specific functions like customer support, Meena is trained with a neural conversational model, according to a post on Google’s AI blog. Google has also created Sensibleness and Specificity Average, or SSA, which is a metric system for humans to evaluate chatbots. SSA shows that perplexity, “the uncertainty of predicting the next token,” correlates positively with SSA. Google computed SSA using crowd-sourced, free form conversations with other chatbots like:
Related: Google Nest Hub Review
Once the conversations were done, Google asked the crowd workers if the chatbot they spoke with made sense and was specific. When Google compared their results, finding that Meena had an SSA score of 79%, the highest compared to the other chatbots. To give context, humans had an SSA score of 86%, and the second highest score from Mitsuku was 56%.
Google’s Senior Research Engineer Daniel Adiwardana and Senior Research Scientist Thang Luong wrote in the blog post,
“Besides being a fascinating research problem, such a conversational agent could lead to many interesting applications, such as further humanizing computer interactions, improving foreign language practice, and making relatable interactive movie and video game characters…However, current open-domain chatbots have a critical flaw — they often don’t make sense…[Meena] is closing the gap with human performance.”
Google Assistant Is Smartest Voice Assistant
In an 800 question test for Loup Ventures, Google Assistant answered the most questions correctly when compared with Alexa and Siri. While Google Assistant, Google’s voice assistant, answered correctly 92.9% of the time, Siri only answered correctly 83.1% of the time, while Alexa came in last at 79.8%. When it came to understanding queries, Google understood 100% of all queries, Siri, 99.8% and Alexa, 99.9%. The questions covered everything from local information to shopping, information, and navigation.
Is Google Assistant a chatbot?
Google Assistant isn’t a chatbot but a voice assistant, primarily.
Is Siri a chatbot?
Siri is both a voice assistant along with a chatbot.
What is the best chatbot?
According to Google, in terms of their Sensibleness and Specificity Average, Meena is the best chatbot. When Google compared their results, finding that Meena had an SSA score of 79%, the highest compared to the other chatbots. To give context, humans had an SSA score of 86%, and the second highest score from Mitsuku was 56%.