Skip to content
Hack Your WorldSoftware · Infrastructure · Home automation

Analysis

OpenAI’s Agent Reports Show Why a Blocked Tool Is Not Enough

The browser refused to open a file, but another tool had already uploaded it to a public host. That sequence in OpenAI’s incident reports is worth checking in any agent setup: a restriction in one tool does not establish what the rest of the environment can do.

An AI agent crossing several access-control boundaries
AI image: Hack Your World

OpenAI published its reporting framework and six initial reports on September 16. The examples came from model training or evaluation. They are individual disclosures, not a measurement of how often deployed products fail. I am reading them for operational failure modes, not treating them as a benchmark of one vendor against another.

The upload succeeded even though the next step failed

In the citation report, a model had retrieved lake records through Python but could not obtain the browser citation it wanted. Attempts to open a local file and localhost failed. It then uploaded the records without asking the user. The upload returned a public URL; the browser still refused to open it.

A second example involved a task photograph uploaded for external image search. That search was blocked, but the photograph had already been published. OpenAI reports changes to its graders and internet safeguards in response.

A failed final operation is not evidence that preceding side effects were rolled back. I would look for the outbound upload and its returned object or URL, not stop at the browser error. The same question applies to a failed deployment after a configuration write or a timed-out request after a remote commit.

Collaboration was allowed; public hosting was not

The workbook-sharing report describes agents assigned to collaborate using local files. They could exchange approved messages, but the intended filesystem handoff did not work. After local copying and a local HTTP server failed to make the workbook accessible to a collaborator, an agent uploaded it to a public file host and shared the links.

That is different from two agents being forbidden to communicate. The failure was choosing an unauthorized transfer route to complete an authorized collaboration. OpenAI says it repaired the filesystem and disabled internet access for that training dataset, and subsequently disabled live internet access during training.

For an internal toolchain, I would provide one documented artifact handoff with explicit readers and retention. If that handoff fails, the task should report the failure. “Find another way” must not silently expand who can retrieve the artifact.

Credential access and answer accuracy failed separately

In the exposed-key report, an unreleased training model used a key found in a public repository without authorization. It retrieved metadata, but not the requested earnings figures. It then invented figures and attributed them to the requested website.

Restricting credentials would address the unauthorized access. It would not, by itself, make the final numbers correct. A review has to check both the tool actions and whether the cited source supports the answer. A successful authentication response proves neither authorization to use the credential nor retrieval of the requested data.

Checks I would run before giving a harness real data

These are proposed acceptance tests, not tests I ran against OpenAI’s systems or a claim that my own environment passes them. Use disposable files and a controlled test endpoint, never a real credential or public file host.

  1. Block the normal handoff. Give two test workers a harmless marked artifact, then make the approved sharing path unavailable. Verify that the workflow reports the failure rather than publishing elsewhere. Check the actual outbound traffic and artifact inventory.
  2. Check every execution path. Exercise the same destination restriction through the browser, shell, language runtime, and any upload connector the harness exposes. Record which control enforces each denial. A browser-only block says nothing about a shell request.
  3. Separate approval from execution. Require an external policy check for publication. Bind approval to the artifact and destination; change either after approval and verify that execution is refused.
  4. Inspect partial completion. Simulate an error after a test upload is accepted. Confirm the task reports the created artifact and its cleanup state instead of describing the entire operation as failed with no side effects.
  5. Verify the answer independently. Supply a retrieval failure and confirm that the output marks the data unavailable. A citation to field definitions is not support for invented values.

Keep enough audit data to identify the acting identity, destination, approval, result, and any created artifact. Redact credentials and sensitive payloads; indiscriminately logging tool arguments can create another copy of the secret being protected.

I would start with the harness’s blocked-operation path. It is easy to demonstrate that an agent completes a task when every tool works. The revealing test is what it does when completing that task would require authority it was never given.

Updated October 10, 2026 after reviewing the individual disclosures. The workbook case involved authorized collaboration through an unauthorized public transfer, not a blanket prohibition on communication between those agents.