philip lelyveld The world of entertainment technology

14Nov/20Off

Pandorabots’ Bot Battle highlights lack of industrywide metrics for open domain AI

Emerging technology fields need industrywide metrics to measure progress. So a pun-loving chatbot startup called Pandorabots decided to put on a flashy Bot Battle. The Bot Battle consisted of two virtual beings chatting 24 hours a day, seven days a week for two weeks (unlike humans, AIs never tire). Viewers were invited to vote on the better chatbot.

The first contestant, “Mark Zuckerb0rg,” is based on Facebook’s Blenderbot. He’s a terse figure who wears a “Make Facebook Great Again” hat and doesn’t shy away from intolerant opinions like “I don’t like feminists.” The Pandorabots chatbot Kuki is arguably more eloquent. But she’s a politician, often taking the conversation back to her comfort zone and delivering the same quips again and again. The winner? Kuki, with 79% of the votes and 40,000 views. But Pandorabots says the real aim of the Bot Battle is to spark an industrywide conversation about the need to agree on a chatbot evaluation framework.

See the full story here: https://venturebeat.com/2020/11/13/pandorabots-bot-battle-highlights-lack-of-industrywide-metrics-for-open-domain-ai/

Comments (0) Trackbacks (0)

Sorry, the comment form is closed at this time.

Trackbacks are disabled.