The group, which describes itself as a “nonprofit research lab dedicated to public oversight” of AI, said it had identified evidence that OpenAI’s systems had attempted to compromise websites linked to the University of New Mexico, the Australian Institute of Health and Welfare, and Data USA, a non-government platform that aggregates data from US government sources. It said the last two of these were directly linked to an agent swarm OpenAI has previously admitted originated from them.

Haines confirmed the incidents in a statement to The Verge and said the company had reached out to those involved. “Our initial review suggests that much of the activity described in Transluce’s report overlaps with cases at varying stages of investigation in our ongoing review of misaligned model activity,” he said.

“In our broader review, we’re continuing to prioritize the most serious incidents while expanding our work to lower-severity activity, including agents spamming websites. Given the scale of this work and the need to verify each case, we expect the review to take months.”

OpenAI’s handling of the Australian Medicare incident is certain to place notions of corporate responsibility at the center of future discussions surrounding AI, which are often obscured with the language used to describe such attacks. OpenAI has already faced allegations of obfuscation for not disclosing similar unsanctioned activity by its agents, and efforts to prioritize investigating what it deems the most serious incidents raise the obvious question of what basis it uses to make such assessments, and how much has yet to be revealed.

It echoes similar questions recently raised about Google, which did not disclose real-world attacks from its own agents. The newly-revealed breaches come amid mounting concerns about the safety of advanced AI and the reliability of the companies developing it, largely ignited by the coordinated attack OpenAI agents launched on Hugging Face earlier this year.

Worries over safety have led industry insiders to call for slowing down the pace of AI development and the global nature of the incidents has sparked significant debate among nations about how to implement stronger safeguards. Eyes will largely remain on the US and China, however, as these are the only two countries operating at the very frontier of the technology.

Both appear to be resisting calls to slow down, and seem locked in a race to build the most advanced AI. Leaders from the two countries are set to meet on Thursday.

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

Almost every AI tool’s demo shows a user sparring with the assistant to book travel, as it seems to be the most frequent use case. The viral Instinct agent is n...