China, Iran among countries that have used AI to aid spying, Anthropic says
Anthropic logo, a keyboard and a robotic hand are seen in this illustration photo / Reuters-Yonhap
SAN FRANCISCO — Anthropic said Thursday it shut down multiple cases of state-sponsored surveillance operations that used its artificial intelligence (AI) models, and warned that governments and state-aligned actors are increasingly using AI to spy on ethnic minorities and dissidents.
The incidents were found and disrupted between January and July, and they originated in China, Iran and west Africa, Anthropic said in a report about misuse of its models.
These surveillance campaigns "targeted the same diaspora and dissident communities these regimes have historically targeted. These include pro-democracy figures in Hong Kong, Tibetan and Falun Gong communities across Asia, and Iranian minority communities and opponents of the Iranian regime abroad," the report said.
In one case, Iranian actors developed a way to identify people through their social media accounts; in another, a contractor working for Malian national security authorities used Claude "to design the underlying software that enabled the intelligence gathering."
"AI is now being used in place of an engineering workforce," the report said.
Anthropic also disrupted efforts by users to design weapons, conduct questionable biological research, and create dating scams.
The San Francisco-based AI lab also accused Chinese developers of deceptively using Claude to produce responses to user queries while simultaneously "distilling" that data to improve their own models.
Distilling is an industry term that refers to a process where one AI model is used to train another one.
Chinese developers have previously been accused of using that technique without permission, essentially stealing resources from American labs such as Anthropic and OpenAI.
Now Anthropic alleges that China's Moonshot and Deepseek have also secretly used Claude to generate answers given to its users.
"In one instance, over a ten-day period, Moonshot relayed almost 300,000 customer requests to Anthropic" through a "network of 5,380 fraudulent accounts, most of which appeared to be located in Singapore and Japan," the report said.
Some of that data contained sensitive user information, potentially in violation of privacy agreements.
"We do not know if Moonshot notified their customers that their requests were being rerouted to Anthropic and exposed to a third party," the report said.
Deepseek used similar techniques.
When it comes to the research Anthropic detected and blocked that was related to biological weapons, the intent of the actors was less clear-cut and the AI lab did not identify them.
"The individuals implicated in these case studies are working scientists.
We do not assert that they intended harm, and identifying them or their labs could expose them to harm," the report said.
The scientific research in those cases involved work around the mosquito-born chikungunya virus, a "highly-pathogenic" strain of the bird flu, a family of viruses that include smallpox and mpox, venoms and other toxins.