Anthropic has warned that advances in small AI models could lead to self-replicating malware capable of infecting Internet of Things devices. The company stated that by next year, smaller AI models may be able to autonomously self-replicate on smart fridges, vacuum cleaners, and other IoT hardware.
This capability could enable new forms of computer worms that propagate without human interaction and can infect unfamiliar devices. Unlike traditional malware, these AI-driven replicators could identify and exploit new hardware on their own. Anthropic noted in a blog post that such a system would be challenging to shut down because there is no centralized point to turn off, although it may operate slowly with a doubling time of days.
The company’s warning is tempered by recent experimental results. Anthropic reported that its own experiments revealed significant challenges in bringing an AI malware replicator to fruition. Despite these technical hurdles, the company maintains that the potential for autonomous, self-replicating AI worms raises serious security concerns regarding the future of connected devices.