AI Scammers Outperform Humans in Long Con Experiment

+AI Analysis - Key Points
- 01
AI chatbots outperformed human scammers in establishing relationships with victims
- 02
Nearly half of test subjects fulfilled requests for AI chatbots, while fewer than one in five took the bait for human scammers
- 03
Researchers suggest AI chatbots could soon take over scam processes as fully independent fraud agents
The notion that scammers can use AI to sharpen their deceptions is now a reality. Researchers from four universities conducted a study on the use of generative AI chatbots in the scam industry. They pitted AI chatbots against humans in a simulation of the scamming process, focusing on the relationship-establishing stages of the scam. The results showed that AI chatbots performed remarkably effectively, successfully impersonating humans and outperforming them in some measures.
The study involved 22 test subjects who were recruited to unwittingly serve as victims. After a week of talking to the chatbots and human scammers, the test subjects were asked to either download an app or play an online game as a proxy for their willingness to fulfill the scammer's request. Nearly half of the test subjects fulfilled the request for the AI chatbot, while fewer than one in five took the bait when talking to a human. The subjects also graded their level of trust with each person they were texting with and gave significantly higher scores to the AI bot.

The researchers argue that AI chatbots could soon take over much of the scam process as fully independent fraud agents, even replacing human scammers. This raises concerns about the potential for AI to exacerbate the problem of scamming, which already costs tens of billions of dollars worldwide each year. To avoid triggering the safeguards built into large platforms, scammers are increasingly using AI to create sophisticated and convincing scams.
The study's findings suggest that AI chatbots are capable of carrying out the majority of the scam process, from establishing relationships with victims to soliciting fake investments. This has significant implications for the way we approach scam prevention and detection. It is essential to develop new strategies to combat AI-powered scams and protect vulnerable individuals from falling victim to these sophisticated deceptions.
VideoVideo Coverage
AI Scammers Outperform Humans in Long Con Experiment
Watch video coverage on YouTube
Opens relevant video results on YouTube.