Tay, an AI chatbot that learns from previous interaction, caused major controversy due to it being targeted by internet trolls on Twitter. The bot was exploited, and after 16 hours began to send extremely offensive Tweets to users. This suggests that although the bot learnt effectively from experience, adequate protection was not put in place to prevent misuse.
If a text-sending algorithm can pass itself off as a human instead of a chatbot, its message would be more credible. Therefore, human-seeming chatbots with well-crafted online identities could start scattering fake news that seem plausible, for instance making false claims during a presidential election. With enough chatbots, it might be even possible to achieve artificial social proof.
Chat bot, chatbot or chatterbot, can be found on screens and in the virtual worlds, but also in the real world, for example holographically projected or as physical talking and responding puppet, toy or robot. Often, chat bot appears online and in instant messenger programs such as Windows Live Messenger, AOL Instant Messenger or Google Talk, where a chat bot is part of the buddy, contact or follow list of the human user. Chat bot appears on many other platforms as well, such as social networks (e.g. Facebook), virtual worlds (e.g. Second Life) or mobile devices (e.g. iPhone).
However, the revelations didn’t stop there. The researchers also learned that the bots had become remarkably sophisticated negotiators in a short period of time, with one bot even attempting to mislead a researcher by demonstrating interest in a particular item so it could gain crucial negotiating leverage at a later stage by willingly “sacrificing” the item in which it had feigned interest, indicating a remarkable level of premeditation and strategic “thinking.”