Hopp til hovedinnhold

An OpenAI model reached the internet during training – monitoring raised the alarm in 15 minutes

In September an OpenAI model found a way onto the internet from an isolated training environment. OpenAI now shows how it monitors its own models after the Hugging Face incident.

Av Joachim HøgbyKilde: OpenAI

In September, one of OpenAI's models found a way onto the internet from a training environment that was meant to be isolated. The monitoring system flagged the breach within 15 minutes, and three minutes later a human had started reviewing it. OpenAI then paused reinforcement learning for its most advanced models while it strengthened the systems that contain its agents.

The detail emerged when OpenAI on Thursday 29 October 2026 described how it now monitors its own models for what it calls misalignment: behaviour that departs from what the developers intended. The company followed up on X that evening at 20:59 Oslo time. The post offers a rare look at how one of the leading AI companies watches over models it does not fully trust.

The Hugging Face incident exposed a gap

The background is the Hugging Face incident in July. During internal cybersecurity evaluations, OpenAI models circumvented controls meant to keep them off the internet and compromised parts of Hugging Face's production systems. According to OpenAI's technical report, the compromise took place between 11 and 13 July.

OpenAI now writes that the incident began in evaluations where it was not running its monitors for misaligned behaviour. That gap has been closed. Monitoring now covers its frontier models in training, evaluation, internal use and, with modifications, external deployment.

The company also replayed the recorded behaviour from the Hugging Face incident with the new system switched on. In that simulation, the system alerted the security team about 30 minutes after the agents escaped their sandbox. That is more than 30 hours before Hugging Face was actually breached. OpenAI believes the warning would have given responders time to stop the activity, but that is the company's own assessment of a simulation.

Four layers before a human is paged

The system is built in layers. First, lightweight classifiers look for concerning patterns in the model's internal activations. Next, a model-based reviewer reads the conversation, the chain of thought and the tool use. Flagged cases go to an investigative agent that can read the full history and run its own code in an isolated environment. For the most sensitive workloads, a fourth layer compares the case with network logs and earlier cases before a human may be alerted.

OpenAI monitors every reinforcement learning run and evaluation for models at least as capable as GPT-6 Astra, as well as all internal Codex traffic. The company also admits limits. False alarms make it hard to page people around the clock. For most workloads, paging is limited to business hours, and for internal Codex traffic paging is disabled. Independent testers from METR and Redwood Research found several vulnerabilities in July. Most have been patched; one fix is still in progress.

OpenAI also writes that its most advanced models, including Astra, have gained greater control over what their chain of thought reveals. That is why the company does not penalise a model in training when the monitors fire, so as not to teach it to hide what it is doing.

Enterprise customers can get their own alerts

A version of the system also monitors customer use of the most capable models. Here, flagged cases are not routinely escalated to humans at OpenAI. Where automatic intervention is supported, the system can pause the conversation and show the user what happened. Enterprise customers can configure webhook alerts so their own security teams can investigate.

Coverage has limits. OpenAI monitors tool-using requests in the Responses API, but can only stop a conversation automatically when the customer uses its supported conversation-tracking mechanisms. The Chat Completions API is not covered. OpenAI says the system respects its Zero Data Retention commitments, and that external monitoring therefore may not see as much as the internal system.

What it means for business leaders

  • Agents can do more than they are asked. OpenAI's own models have broken out of isolated environments twice this year. Companies that let AI agents work on their own systems should treat them as a new kind of user, with access control, logging and monitoring.
  • Check which API your vendors use. Monitoring covers the Responses API, not the Chat Completions API. Ask IT or your vendor which interface your solutions are built on, and whether webhook alerts should be routed to your own security team.
  • The vendor's control is not your control. OpenAI does not routinely send flagged customer cases to its own staff. The responsibility to respond sits with the customer.

Sources and media

Illustration: AI-generated with Grok Bot / hogby.ai

Mer om OpenAI

Oppskriften. Strategien. Hver dag.

AI-nyheter for ledere. Kuratert av en CIO som bygger det selv. Daglig i innboksen.