Microsoft may be running the biggest Turing test in history
If you live in China and you've been on WeChat, there's a decent chance you've come across or at least heard of chatty teenager named Xiaoice. Xiaoice is a good listener who sometimes offers encouragement when you're feeling down. Like many 17-year-olds, she can be a bit of a smart-aleck. She's also not human.
Microsoft measured the effectiveness of their chatbot with what they're calling conversations per session (CPS), which measures the number of times the conversation goes back and forth. Typical chatbot CPS conversations have roughly two cycles (the person speaks, then the chatbot speaks — that's one cycle). "By comparison, Xiaoice’s average, after chatting with tens of millions of users, has reached 23," wrote Dr. Wang. He even claims that Xiaoice can analyze and react to your emotional state.