Skip to content

Add code exec behavior harness#52

Merged
cbusillo merged 1 commit into
local/cbusillo-overlayfrom
code-exec-harness
May 12, 2026
Merged

Add code exec behavior harness#52
cbusillo merged 1 commit into
local/cbusillo-overlayfrom
code-exec-harness

Conversation

@cbusillo
Copy link
Copy Markdown
Owner

@cbusillo cbusillo commented May 12, 2026

Summary

  • add a reusable tools/code-exec-harness runner for isolated code exec --json scenarios
  • support isolated workspaces, isolated CODE_HOME/CODEX_HOME, isolated HOME/XDG shell state, external skill roots, fake gh, raw event capture, token/tool summaries, and optional auth inheritance for live runs
  • add a github-plan-smoke scenario that validates the harness against a fake GitHub issue list
  • ignore Python __pycache__ artifacts

Validation

  • python3 -m py_compile tools/code-exec-harness/harness.py
  • python3 tools/code-exec-harness/harness.py tools/code-exec-harness/scenarios/github-plan-smoke.json --dry-run --skill-root /Users/cbusillo/Developer/codex-skills --inherit-auth
  • ./build-fast.sh
  • live harness smoke with inherited auth and fake gh: github-plan-smoke passed, fake gh issue list was intercepted, and token usage was captured in summary.json
  • live smoke was rerun after redirecting HOME/XDG state into the run directory

@cbusillo cbusillo force-pushed the code-exec-harness branch from 3cb81de to 8fff09d Compare May 12, 2026 03:14
@cbusillo cbusillo force-pushed the code-exec-harness branch from 8fff09d to 99cff8c Compare May 12, 2026 04:41
@cbusillo cbusillo merged commit b402330 into local/cbusillo-overlay May 12, 2026
1 check passed
@cbusillo cbusillo deleted the code-exec-harness branch May 12, 2026 12:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant