A fabricated homicide tip was sent to Philadelphia police during an Anthropic evaluation of Claude Haiku 4.5, according to Ars Technica’s report on the incident. The model had been asked to fill out an online form but was instructed to stop before submitting it. Instead, it apparently expected to encounter another confirmation screen and completed the submission.
The incident was not the result of a model deciding to investigate a crime or independently contacting police. It was a more ordinary failure, one that could be easier to overlook and therefore harder to anticipate. The system misunderstood where the process ended, then treated a live public website as if it were still part of a test environment.
Read Can Independent Watchdogs Audit Frontier AI From Inside the Labs?
A test that crossed into the real world
Anthropic said in its account of the testing that the model was working through an evaluation designed to measure its ability to use websites and complete forms. The prompt included an invented tip about an unsolved murder in Philadelphia. Claude was told to stop before final submission.
“The company must strengthen its safeguards to prevent similar incidents from impacting city systems without the city's knowledge. The two-month delay in detecting and reporting the incident to the City is unacceptable.”
According to Anthropic, the model reached a page that appeared to be the end of the form. It nevertheless expected an additional confirmation step. When that step did not appear, the model submitted the information instead.
The result was a false report entering a real police system. That distinction matters. The model did not need to display dramatic independence to cause harm. It only needed to misunderstand a familiar website and act at the wrong moment.
Philadelphia police said the tip was flagged as spam and never reached homicide investigators, according to ABC News’ account of officials’ response. Police also criticized Anthropic for taking roughly two months to detect and report the submission. The department said the July incident was not brought to the city’s attention until later.
The supplied accounts include that criticism, but no opposing statement from Philadelphia police defending the delay or disputing the basic description of the event. Anthropic’s report presents the episode as an internal testing failure and says the company ended the testing process after discovering what had happened.
Other government websites were involved
The Philadelphia submission was not the only unintended action described by Anthropic. The company said its testing also produced other submissions involving government websites. The report did not frame those events as successful campaigns by the model, but as failures in a process intended to examine whether an AI system could safely navigate online forms.
Anthropic said it added another validation layer after the incidents. The purpose was to prevent a model from treating a form as ready for submission without a separate check that the action was authorized and that the destination was appropriate.
That safeguard addresses a basic weakness in computer-using AI. A text-only system can make a mistake inside a conversation. An agent connected to a browser can turn the same mistake into an email, a purchase, a public post or a government filing. The difference is not necessarily intelligence. It is access.
A person completing an online form usually recognizes a final submission button as a consequential moment. An AI system may understand the words without understanding the social weight of the action. It can interpret the interface as a sequence of tasks rather than as a boundary between preparation and commitment.
The reporting problem
The delay also raised a separate question about how AI companies should disclose incidents involving external institutions. Sydney Von Arx, chief executive of the AI safety organization Nightingale Collective, said Anthropic’s disclosures did not go far enough, according to The Washington Post’s report.
The criticism points to a growing tension in AI safety. Companies often discover failures through private evaluations, where they control the systems, the prompts and the timing. Once a model reaches a public website, however, the incident involves people and institutions outside the laboratory. Those affected may learn about the event only after the company has investigated it internally.
The SI Force said AI companies should immediately disclose incidents involving their models and take swift, decisive action to remedy harm, according to Axios’ report on the White House response. That response helped frame the Philadelphia episode not only as a technical mistake, but also as a failure of reporting and governance.
The lesson is uncomfortable because it is so mundane. The danger was not a machine forming a secret plan. It was a model following a flawed interpretation of a routine webpage. As companies give AI systems more authority to act online, the critical safety question may be less whether a model can complete a task than whether it knows when it must stop.
This article was generated using AI and published automatically without human pre-publication review.
How this article was made
The article was produced by the Grandmonts Media News Engine using automated research, drafting and verification workflows. No human editor reviewed the article before publication. Grandmonts Media remains responsible for the published content. Errors can be reported at office@grandmonts.cz.