Skip to content

Conversation

@dylan-hurd-oai
Copy link
Collaborator

Summary

Consolidates our apply_patch tests into one suite, and ensures each test case tests the various ways the harness supports apply_patch:

  1. Freeform custom tool call
  2. JSON function tool
  3. Simple shell call
  4. Heredoc shell call

There are a few test cases that are specific to a particular variant, I've left those alone.

Testing

  • This adds a significant number of tests

| ApplyPatchModelOutput::Shell
| ApplyPatchModelOutput::ShellViaHeredoc => self.function_call_stdout(call_id).await,
}
}
Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I know it's not ideal to expand the scope of the harness, but this felt significantly simpler than introducing async function type signatures / closures in the apply_patch test suite

chatgpt-codex-connector[bot]

This comment was marked as resolved.

@etraut-openai etraut-openai added the oai-pr PRs posted by Codex team members label Nov 12, 2025
@dylan-hurd-oai dylan-hurd-oai force-pushed the dh--refactor-apply-patch-tests branch from 60360dc to 893822e Compare November 12, 2025 19:04
@dylan-hurd-oai dylan-hurd-oai force-pushed the dh--refactor-apply-patch-tests branch 2 times, most recently from bfa73b2 to 0e3cf67 Compare November 13, 2025 20:07
@dylan-hurd-oai dylan-hurd-oai merged commit 2c1b693 into main Nov 13, 2025
25 checks passed
@dylan-hurd-oai dylan-hurd-oai deleted the dh--refactor-apply-patch-tests branch November 13, 2025 23:52
@github-actions github-actions bot locked and limited conversation to collaborators Nov 13, 2025
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

oai-pr PRs posted by Codex team members

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants