Skip to content

fix: sandbox allowlist, no verdict for provider failures - #102

Merged
abhishekgahlot2 merged 9 commits into
mainfrom
fix/sandbox-allowlist
Oct 23, 2026
Merged

abhishekgahlot2 merged 9 commits into
mainfrom
fix/sandbox-allowlist

Conversation

@abhishekgahlot2

@abhishekgahlot2 abhishekgahlot2 commented Oct 23, 2026 •

Copy link
Copy Markdown
Contributor
  • Local sandbox (sandbox-exec, bwrap) reads only the operating system, the software trees a Python links against, the Python installation and its own run. Files under /tmp and $TMPDIR, including another DeepGym process's verifier copies, are no longer readable. Every deepgym package on the import path stays hidden. Runs roots left by a killed process are removed by the next one.
  • macOS: a script run with allow_subprocess=True has every process left in its sandbox killed when it ends, including one that called setsid().
  • No working sandbox: local runs raise SandboxError unless DEEPGYM_ALLOW_UNSANDBOXED=1.
  • Agent episodes ended by the model provider or network (provider_error) or by a harness that never started the model (setup_error) get no verdict instead of a 0. httpx2 and SDK connection errors count as infrastructure failures.
  • CLI agents accept the tested release or a later compatible one.
  • CI installs bubblewrap and the anthropic/openai extras, so the Linux sandbox and API agent tests run.

View with [code]smith Autofix with [code]smith
Need help on this PR? Tag @codesmith-bot with what you need.

@blacksmith-sh

This comment has been minimized.

@abhishekgahlot2
abhishekgahlot2 marked this pull request as ready for review October 23, 2026 13:52
…t classification, output bounds, failed openai responses, cli_task git checks
…o verdict, abnormal judge exit after the solution ran, whole git trees, cloud auth errors, python aliases under bwrap
@abhishekgahlot2
abhishekgahlot2 merged commit 1b5ec60 into main Oct 23, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant