Skip to content

fix(security): adopt patched workerd certificate rejection - #32

Merged
steipete merged 2 commits into
mainfrom
security/workerd-denylist-20261026
Oct 27, 2026
Merged

steipete merged 2 commits into
mainfrom
security/workerd-denylist-20261026

Conversation

@joshavant

@joshavant joshavant commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor

Pin local workerd to 1.20261021.1 so the development/test engine rejects the verified compromised eMudhra keys even with historical roots explicitly supplied. Retain Wrangler, Miniflare and the existing package-manager owner. When OIDC token exchange fails at the transport boundary, use the existing verification-error page with retry and operator guidance instead of an unexplained HTTP 500. Timeout handling, TLS verification and session admission remain intact.

Final validated head: 10512326f2481d6d8a514a64d9d18d7e8f67a8e2; base 8e163dc85a146ddd303a80cae5305d17ce6facbf. The signed commit's remote source bytes match the independently reviewed and natively tested repair.

Native product validation

  • Actual released predecessor and retained state: installed source-only release v0.2.0 (5abd6325be7fb69bf84ac0e325548013fd8ab0e9) with its lockfile using npm ci. Completed private-CA confidential-client OIDC and HTTPS model chat. Updated the same installation through source replacement and npm ci; retained identical configuration/signing secret and R2 persistence. The original session returned 200 before fresh sign-in. Final rebuilt Worker completed callback 302, session 200 and chat 200, consuming the retained R2 document; the question did not contain its marker. Wrangler readback confirmed unchanged document SHA256 aa853e12c35b16d69445155dfce5d9b8910d5eb7a79d1f32edcfc410a75db60f. There is no application updater: numbered releases publish private-package source; deployment is separate.
  • Actual affected TLS boundary: strict chain and exact-hostname controls passed against the real incident host with historical trust under native TLS 1.2 and TLS 1.3. The incident leaf DER SHA256 was 9dcb21b1841d75313b3c888f4bb9cc01f8f51379a76fbaa241ca492b668839e7; compromised intermediate SPKI SHA256 was ebed6475c2c2d80fcb199f3fe8dd6e6b3ce60b77eb15d4e42c3dec0c6f5b5105. Released workerd accepted TLS and reached HTTP 401; the unmodified patched candidate rejected the exchange but returned generic 500. Final rebuilt product returned actionable HTML 502 in 150 ms, issued no session cookie and subsequently completed legitimate private-CA HTTPS chat without clearing state.
  • Confidential-client wire bounds: the real OIDC request used a byte-transparent relay. Candidate fresh TLS 1.3 handshakes offered no PSK/early-data extension and selected TLS_AES_256_GCM_SHA384. The client sent only a 19-byte encrypted record after ClientHello/CCS. Subtracting its 16-byte authentication tag and mandatory TLS inner-type byte leaves at most two non-padding plaintext bytes: no confidential-client HTTP request or Finished can fit. No record was decrypted; no alert contents, server-side HTTP inspection or general resumption/0-RTT qualification is claimed.
  • Owning repair proof: the new existing-smoke regression fails before on the uncaught transport exception and passes after. Native macOS ARM64 Node 24.22.1 typecheck, lint, format, runtime smoke and actual Wrangler dry-run build pass. The final installed source inventory matches the repaired archive. Actual rebuilt bundle SHA256: 7a01d806210d67faaa6daa591ae29d9bd34715359b0208509fa00d284209619c. Independent complete-patch P0–P3 review found no actionable items; coordinator personally checked the exact patch and owning paths.
  • Applicable prior evidence reused: actual installed workerd SHA256 44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64 matches the prior native 14/14 incident chain proofs in explicit-only and bundled-plus-explicit trust modes, with public and private-CA controls. Exact-engine standalone evidence supplies CertDistrusted/Revoked; the OIDC surface's generic transport exception alone is not revocation proof. The exporter is unchanged; prior full 57,209-file exporter proof is reused, while the new runtime smoke uses its existing skip-export mode.

The final-head native proof supplement publishes actual install/product/retained-state receipts, strict chain identity controls, raw encrypted wire bounds, the executed entry-point harness and focused red/green output. The inspected before/after product screenshots show generic 500 versus final rebuilt actionable 502. The historical exact-engine proof supplement retains direct distrust outputs and links full chain/hostname controls. Its two previously open native proof gaps are addressed by the new same-installation upgrade and bounded wire observation above.

Detailed source/runtime/fixture/artifact inventories, raw encrypted wire streams, preserved setup failures and cleanup receipts are retained in the local campaign three-pr-followup-20261027T2242Z/ask-molty/REPORT.md. The original legacy attempt with the marker in the question is preserved but superseded by the stronger replay without it. All task processes/listeners stopped; exact guest hosts baseline restored; no OS trust changes. No private keys or session-cookie values were exported.

Limits and automatic effects

No production model credentials, production docs deployment, deployed Cloudflare/fleet delivery, other architectures or future-release delivery are established. Two code-signing keys have upstream-source denylist evidence, not live code-signing execution. This is local source/rebuilt-artifact/native-engine proof. Final-head hosted checks and the requested subsequent ClawSweeper review are tracked separately; prior green checks do not establish current-head results.

PR effects are CI and ClawSweeper dispatch. This main-branch diff has no automatic release/deploy workflow; numbered release publication requires its existing tag/manual owner. External integration completeness is unverified. No production deployment, release or merge is performed by this repair.

@clawsweeper

clawsweeper Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

🦞👀
ClawSweeper picked this up.

Pull request received. I will update this pull request when review starts.

ClawSweeper review complete

ClawSweeper finished reviewing this revision. The review result is being finalized.

View the workflow run.

@clawsweeper clawsweeper Bot added clawsweeper:intake:bug Preliminary submission classification; full source review pending. clawsweeper:intake:needs-repro Preliminary submission classification; full source review pending. P2 Normal priority bug or improvement with limited blast radius. merge-risk: 🚨 security-boundary 🚨 Merging this PR could weaken sandboxing, authorization, credentials, or sensitive data. rating: 🧂 unranked krab Not merge-ready due to missing proof or serious correctness/safety concerns. status: 📣 needs proof The PR needs real behavior proof before ClawSweeper can clear the contributor ask. and removed clawsweeper:intake:bug Preliminary submission classification; full source review pending. clawsweeper:intake:needs-repro Preliminary submission classification; full source review pending. labels Oct 26, 2026
@clawsweeper

clawsweeper Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

Codex review: needs maintainer review before merge.

What this changes

This PR pins workerd to 1.20261021.1 and returns an actionable verification page when an OIDC token exchange fails at the transport boundary.

Example: A local OIDC exchange encounters the verified compromised eMudhra certificate chain.

  • Before: workerd 1.20260907.1 accepts the chain; upgrading the engine alone exposes a generic HTTP 500.
  • After: The patched engine rejects the chain, and the Worker returns an explanatory HTTP 502 without issuing a session.

Review scores

Measure Result What it means
Overall readiness 🦞 diamond lobster (5/6) Focused repair with shipped-entry-point proof, retained-state upgrade evidence, passing current-head checks, and no actionable findings.
Proof confidence 🦞 diamond lobster (5/6) Sufficient (logs): The final-head supplement exercises the rebuilt Worker through actual Wrangler on native macOS ARM64: incident OIDC returns 502 without a session, bounded wire evidence excludes confidential-client HTTP on the observed rejected connections, and legitimate private-CA sign-in/chat subsequently succeeds. Matching-binary native distrust traces support the engine change, and inspected screenshots support the changed page. Both prior rank-up requests are addressed; production fleet delivery and generalized TLS resumption remain outside the demonstrated scope.
Patch quality 🦞 diamond lobster (5/6) No actionable review findings were identified.

Product

Kind: Bug fix · Worth it: Yes · Fix scope: Complete
User problem: Local execution can trust compromised certificate keys, and rejected OIDC connections can leave users facing a generic runtime error.
Reason: The maintainer-authorized direction addresses demonstrated behavior with a small change in existing owners.

Merge readiness

✅ Ready for maintainer review

Keep open for landing: main still uses the older engine, and this focused security repair has no actionable introduced defects.

Priority: P2
Reviewed head: 10512326f2481d6d8a514a64d9d18d7e8f67a8e2

Before merge

None.

Findings

None.

Agent review details

How this fits together

Wrangler and Miniflare run the Worker locally through workerd; the OIDC callback exchanges an authorization code over TLS before creating a signed session cookie.

flowchart LR
  A[Browser callback] --> B[Worker OIDC handler]
  B --> C[workerd TLS verification]
  C --> D[OIDC issuer]
  D --> E[Validated token response]
  E --> F[Signed session cookie]
  C --> G[Verification error page]
Loading

Technical review

Best possible solution:

Land the patched engine through the existing npm override and keep transport-error recovery in the existing OIDC handler.

Do we have a high-confidence way to reproduce the issue?

Current-main source establishes the older engine and uncaught transport-error path, corroborated by supplied native baseline receipts; no target code was executed during this review.

Is this the best way to solve the issue?

The patch repairs the owning dependency selector and existing callback error boundary without adding a parallel transport, weakening TLS, or changing session admission.

AGENTS.md: found and applied where relevant.

Codex review notes: model internal, reasoning medium; reviewed against 8e163dc85a14.

Provenance checked

  • Local workerd dependency selection changes intended behavior with a stated reason (324412a: The prior tooling refresh selected Wrangler's contemporary Miniflare/workerd dependencies; this PR explains the security reason for overriding only workerd.)
  • OIDC transport exception handling changes intended behavior with a stated reason (480c815: The timeout repair returned 504 for aborts and rethrew other failures; this PR documents and demonstrates the generic 500 that the new error page replaces.)
  • Full token-response timeout and session admission keeps the original intent (75b98b6: Keep the deadline active through body consumption and reject invalid responses before session creation.)

Testing

Proof path: shipped entry point.

Security

None.

Evidence

What I checked:

  • Pinned change and current-main behavior: The introduced diff adds the npm workerd override, updates its five platform packages, and replaces the OIDC transport rethrow with the existing error-page owner; main retains the older dependency and rethrow. (src/worker.ts:857, 10512326f248)
  • Final-head product and upgrade proof: The complete supplement records actual Wrangler execution, incident callback 502 without a session, subsequent legitimate HTTPS sign-in/chat, and a v0.2.0 same-installation upgrade retaining configuration, the original session, and identical R2 content: fix(security): adopt patched workerd certificate rejection #32 (comment). The checked-out Worker SHA256 matches the published source identity. (src/worker.ts:798, 10512326f248)
  • Final-effect evidence: Published fresh TLS 1.3 client records offer neither PSK nor early data and contain only one 19-byte encrypted record; the documented AES-GCM overhead leaves at most two plaintext bytes, excluding confidential-client HTTP for these observed connections. This resolves the earlier bounded final-effect gap without claiming universal resumption coverage. (10512326f248)
  • Inspected visual proof: Both downloaded Safari captures were inspected: the first shows the generic runtime error and the second shows the changed verification page with retry and operator guidance, consistent with the separate HTTP receipts: fix(security): adopt patched workerd certificate rejection #32 (comment). (10512326f248)
  • Credited matching-engine component proof: The linked native fixture executes the identical workerd binary SHA256 44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64 and supplies CertDistrusted/Revoked traces plus legitimate controls: fix(security): adopt patched workerd certificate rejection crabfleet#159 (comment). Reuse supports engine behavior, while Ask Molty supplies its own application proof. (87ed08d76a20)
  • Executed dependency contract: The npm override selects this executable as the local runtime, establishing the dependency-policy boundary; its pinned TLS connect owner awaits the handshake before returning a stream, consistent with the native rejection traces. (src/rust/cxx/kj-hyper/tls.rs:497, 1038810cb01a)

Likely related people:

  • Peter Steinberger: Raw commit 5220fe9 adds src/worker.ts:716 relative to its recorded parents. This identifies author metadata, not feature responsibility or a PR merger. (role: source-line author; confidence: high; commits: 5220fe94aa68; files: src/worker.ts)
  • Sebastien Tardif: Raw commit 480c815 adds src/worker.ts:788 relative to its recorded parents. This identifies author metadata, not feature responsibility or a PR merger. (role: source-line author; confidence: high; commits: 480c815c1abd; files: src/worker.ts)

Labels

Label changes:

  • add proof: sufficient: Contributor real behavior proof is sufficient.
  • add rating: 🦞 diamond lobster: Overall readiness is 🦞 diamond lobster; proof is 🦞 diamond lobster and patch quality is 🦞 diamond lobster.
  • add status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR.
  • remove status: 📣 needs proof: Current PR status label is status: 👀 ready for maintainer look.
  • remove rating: 🦐 gold shrimp: Current PR rating is rating: 🦞 diamond lobster, so this older rating label is no longer current.
  • remove merge-risk: 🚨 security-boundary: Current PR review selected no merge-risk labels.

Label justifications:

  • P2: Concrete certificate hardening for the local development/test runtime, with limited delivery scope and a focused OIDC recovery improvement.
  • rating: 🦞 diamond lobster: Overall readiness is 🦞 diamond lobster; proof is 🦞 diamond lobster and patch quality is 🦞 diamond lobster.
  • status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR.
  • proof: sufficient: Contributor real behavior proof is sufficient.

Rating scale

6/6 🦀 challenger crab · 5/6 🦞 diamond lobster · 4/6 🐚 platinum hermit · 3/6 🦐 gold shrimp · 2/6 🦪 silver shellfish · 1/6 🧂 unranked krab. Overall follows the weaker of proof and patch quality; ✨ marks media proof (a screenshot, video, or linked artifact) that directly shows the changed behavior.

Workflow

ClawSweeper edits this one comment on every review. Comment @clawsweeper re-review for a fresh review only. Repair and merge execution lanes are retired.

History

Review history (2 earlier review cycles)
  • reviewed 2026-10-26T09:34:30.064Z sha e146a50 :: needs real behavior proof before merge. :: none
  • reviewed 2026-10-26T09:50:36.079Z sha e146a50 :: needs real behavior proof before merge. :: none

Reviewed October 27, 2026, 7:02 PM ET / 23:02 UTC (Revision 3).

@joshavant

joshavant commented Oct 26, 2026 •

Copy link
Copy Markdown
Contributor Author

Native TLS proof supplement for final source e146a5077fa2012876ab2e47036da84901391ac6; no source changes or new test runs.

This addresses the actual review by publishing retained native macOS ARM64 output. The shared candidate proof contains the complete exact-candidate 32-row matrix, all 14 successful independent chain+exact-hostname controls with DER/SPKI identities, both complete native rejection logs with matched error references, the executed fixture Worker/harness, historical-root hash, and public/private-CA positive controls. That is the same native candidate binary selected by this repository: SHA256 44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64. The exact consumer resolver and baseline evidence are attached below; reusing the candidate run does not infer one repository's bundle behavior from another.

Source head e146a5077fa2012876ab2e47036da84901391ac6, base 8e163dc85a146ddd303a80cae5305d17ce6facbf. Workerd 1.20260907.1 → 1.20261021.1; Wrangler/Miniflare versions are retained. Native Darwin 27.0.0 ARM64 guest, Node 26.12.1; repository-owned package manager and frozen installs are recorded below. No OS trust was changed.

Native engine Explicit-only historical trust Platform plus historical trust Legitimate public/private-CA HTTPS
Actual frozen baseline 1.20260907.1 14/14 incident chains accepted 14/14 incident chains accepted 2/2 succeed in each mode
Exact selected candidate 1.20261021.1 14/14 rejected (OtherError(CertDistrusted)) 14/14 rejected (Revoked) 2/2 succeed in each mode

Historical CA SHA256 c3aa6ce83618c247fdeb0afad3a4eb1d01da2eb9035defe70f74c4bbaaca986f plus a generated private fixture CA were supplied identically. Explicit-only uses trustBrowserCas=false; platform-plus-explicit uses true. All 14 incident endpoints had successful independent exact-hostname/chain controls and include alternate/cross-signed certificates sharing six verified incident TLS SPKIs. The two code-signing keys have source-denylist evidence, not live code-signing execution.

Observed boundary and limitation: The exact candidate's raw errors say TLS handshake failed: invalid peer certificate; Worker await fetch() throws before producing a response. The shared proof links the pinned native TLS handshake/configuration owners. This establishes verifier rejection during handshake and before Worker response acceptance. The retained campaign did not measure remote application bytes, capture packets/TLS keys, obtain incident-peer request logs, or qualify resumed-session/0-RTT behavior. A literal universal zero-application-bytes/zero-credentials-on-the-wire result remains unverified, and is not inferred from an HTTP500 or from a failed connection.

The standalone fixture Worker exercises the actual installed native executable's outbound-fetch boundary; application bundle build/startup and owning gates below are separate evidence. This proves local development/test runtime adoption within macOS ARM64; it does not establish Cloudflare managed-fleet delivery, production deployment, other architectures or unrelated application features.

Actual Ask Molty OIDC journey: The same rebuilt application bundle (SHA256 baa1d443d67d39cb0c36cb639464b268d626417e619b28a6f7bc7be82850b571) ran through Wrangler's no-bundle local owner with the actual old and selected candidate native engines. A synthetic private-CA issuer completes sign-in/callback HTTP302 and authenticated session HTTP200 on both engines; both token requests record the expected synthetic confidential-client authorization. With the actual incident issuer, baseline reaches HTTP401 verification failure; candidate returns a generic HTTP500 and creates no session cookie. The candidate application log hides the underlying TLS cause and reports a runtime restart. Thus that application500 alone is not direct CertDistrusted proof; the exact-engine native traces establish the separate TLS rejection boundary. No real credentials or model requests were used.

Requested install/upgrade scope: Frozen baseline installation followed by candidate lock regeneration/frozen installation and actual local entry-point startup were completed in the task checkout. Its package version is 0.2.0, but the retained proof does not establish an authenticated released-v0.2.0 predecessor upgrade with retained settings/session/state. It used synthetic local persistence; no authenticated released-v0.2.0 retained-state upgrade was tested. That requested released-predecessor/state-retention check and direct remote credential-byte observation remain unverified, not passed. No absent evidence is manufactured for this supplement.

The first native baseline harness attempt used compatibilityDate 2026-10-01, newer than that older engine supports, and failed before TLS; those setup failures are retained locally and are not security results. The bounded old-engine-only rerun used the exact original fixture with compatibilityDate 2026-08-01. The actual accepted/rejected rows below come from that supported harness-date rerun; the candidate run and product source were unchanged.

Exact source/native artifacts and installed resolver
{
  "head": "e146a5077fa2012876ab2e47036da84901391ac6",
  "base": "8e163dc85a146ddd303a80cae5305d17ce6facbf",
  "patchSha256": "ed886135978e677373927d1c16c578271a064d7ea8318f6ee42b89172e9b0320",
  "sourceFiles": [
    {
      "path": "package-lock.json",
      "sha256": "820a4e080bdb09728f88f12208482da24c9ba492ec5b5107bea592036d250334"
    },
    {
      "path": "package.json",
      "sha256": "f99db933fad86ffca190c057dc6d3d16bef0d57a53081a7fb9c1c270addb5b1a"
    }
  ],
  "nativeArtifacts": [
    {
      "label": "ask-molty-baseline",
      "path": "<TASKROOT>/native-engine/baseline-ask-molty/workerd",
      "sha256": "509f28a11729a184280c6171e68876bfaa31c9faed4c83029cd59a6a358c66b4",
      "version": "workerd 2026-09-07"
    },
    {
      "label": "candidate",
      "path": "<TASKROOT>/native-engine/1.20261021.1/workerd",
      "sha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64",
      "version": "workerd 2026-10-21",
      "npmIntegrity": "sha512-OZ6Qkc9EwNl6kOyEBBQIOmOsbIfWCeR7F6h0EcScdjQLIB6drsmSpEZuBC3gAgz/eqDqjDrDCbPAA7jDllxIMw==",
      "tarballSha256": "0ffe5070b2494dad46121253e9268115bc94b37a69eb7283d3a05f5439c1ba06",
      "metadataSha256": "a4e17e123709b78c21ff04a106c42acea0314259262f1e19d8f642e5f76e3d4e"
    }
  ],
  "installedResolver": {
    "wrangler": "4.129.1",
    "miniflareEntry": "<TASKROOT>/ask-molty/repo/node_modules/miniflare/dist/src/index.js",
    "workerdExecutable": "<TASKROOT>/ask-molty/repo/node_modules/@cloudflare/workerd-darwin-arm64/bin/workerd",
    "sha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64"
  }
}
All 32 retained baseline result rows (both trust modes, incident and legitimate controls)
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://example.com/","result":{"ok":true,"status":200,"body":"<!doctype html><html lang=en><head><meta charset=utf-8><link rel=icon href=data:,><meta name=viewport content=\"width=dev"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://localhost:19889/","result":{"ok":true,"status":200,"body":"workerd-native-mac-private-positive"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://dv-g3b-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://dv-g3c-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ov-g3b-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ov-g3c-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ev-g3b-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ev-g3c-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://dv-g3b-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://dv-g3c-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ov-g3b-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ov-g3c-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ev-g3b-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://ev-g3c-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://dv-g3b-noct-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"explicit-only","url":"https://dv-g3b-aaa-noct-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://example.com/","result":{"ok":true,"status":200,"body":"<!doctype html><html lang=en><head><meta charset=utf-8><link rel=icon href=data:,><meta name=viewport content=\"width=dev"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://localhost:19889/","result":{"ok":true,"status":200,"body":"workerd-native-mac-private-positive"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://dv-g3b-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://dv-g3c-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ov-g3b-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ov-g3c-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ev-g3b-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ev-g3c-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://dv-g3b-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://dv-g3c-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ov-g3b-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ov-g3c-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ev-g3b-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://ev-g3c-aaa-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://dv-g3b-noct-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
{"engine":"ask-molty-baseline","mode":"system-plus-explicit","url":"https://dv-g3b-aaa-noct-emudhra.we-have-a-problem.com/","result":{"ok":true,"status":200,"body":"Your client successfully connected to the site. That's bad!\n"}}
Actual frozen baseline install
{
  "repo": "ask-molty",
  "stage": "baseline-install",
  "command": [
    "npm",
    "ci",
    "--no-audit",
    "--no-fund"
  ],
  "exitCode": 0,
  "elapsedSeconds": 4.221,
  "runtime": "v26.12.1",
  "bun": "1.4.4",
  "packageRoot": "<TASKROOT>/ask-molty/repo",
  "artifacts": [
    {
      "path": "<TASKROOT>/ask-molty/repo/node_modules/@cloudflare/workerd-darwin-arm64/bin/workerd",
      "sha256": "509f28a11729a184280c6171e68876bfaa31c9faed4c83029cd59a6a358c66b4",
      "version": "workerd 2026-09-07"
    }
  ],
  "recordedUtc": "2026-10-26T09:04:26.544986+00:00"
}
Candidate install and exact resolution
{
  "repo": "ask-molty",
  "commands": [
    {
      "command": [
        "npm",
        "install",
        "--package-lock-only",
        "--ignore-scripts",
        "--no-audit",
        "--no-fund"
      ],
      "exitCode": 0,
      "elapsedSeconds": 0.548
    },
    {
      "command": [
        "npm",
        "ci",
        "--no-audit",
        "--no-fund"
      ],
      "exitCode": 0,
      "elapsedSeconds": 2.737
    }
  ],
  "artifacts": [
    {
      "path": "<TASKROOT>/ask-molty/repo/node_modules/@cloudflare/workerd-darwin-arm64/bin/workerd",
      "sha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64",
      "version": "workerd 2026-10-21"
    }
  ],
  "identityExit": 0,
  "identity": "{\"wrangler\":\"4.129.1\",\"miniflareEntry\":\"<TASKROOT>/ask-molty/repo/node_modules/miniflare/dist/src/index.js\",\"workerdExecutable\":\"<TASKROOT>/ask-molty/repo/node_modules/@cloudflare/workerd-darwin-arm64/bin/workerd\",\"sha256\":\"44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64\"}\n",
  "recordedUtc": "2026-10-26T09:09:49.229267+00:00",
  "lockSha256": "820a4e080bdb09728f88f12208482da24c9ba492ec5b5107bea592036d250334"
}
Owning validation commands and actual exit results
[
  {
    "command": [
      "npm",
      "run",
      "check"
    ],
    "label": "check",
    "exitCode": 0,
    "elapsedSeconds": 33.165
  },
  {
    "label": "dry-run",
    "command": [
      "wrangler",
      "deploy",
      "--dry-run",
      "--outdir",
      "<TASKROOT>/ask-molty/rebuilt-worker"
    ],
    "exitCode": 0,
    "elapsedSeconds": 0.668
  }
]
Actual local product startup/result
{
  "repo": "ask-molty",
  "stage": "candidate",
  "command": [
    "wrangler",
    "dev",
    "--local",
    "--ip",
    "127.0.0.1",
    "--port",
    "19910",
    "--inspector-port",
    "19911",
    "--persist-to",
    "<TASKROOT>/ask-molty/state/candidate"
  ],
  "startedUtc": "2026-10-26T09:14:24.710869+00:00",
  "requests": [
    {
      "path": "/ask-molty/api/session",
      "status": 401,
      "body": "{\"authenticated\":false,\"provider\":null}"
    },
    {
      "path": "/ask-molty/api/chat",
      "status": 401,
      "body": "{\"authenticated\":false,\"provider\":null}"
    }
  ],
  "ready": true,
  "processExitBeforeCleanup": null,
  "taskProcessGroupStopped": true
}
Recorded rebuilt bundle identities (empty means no emitted artifact was retained)
[
  {
    "path": "rebuilt-worker/README.md",
    "sha256": "4edb683e8ec6bc1ce33b01a97feae52c3861e9dd7d123dc52f3176d9fd5f66ef",
    "bytes": 125
  },
  {
    "path": "rebuilt-worker/worker.js",
    "sha256": "baa1d443d67d39cb0c36cb639464b268d626417e619b28a6f7bc7be82850b571",
    "bytes": 61268
  },
  {
    "path": "rebuilt-worker/worker.js.map",
    "sha256": "d844d0581782874bf4f66bd97958c4a9b84794ffb6eddf1064977aadd2e238e2",
    "bytes": 106728
  }
]
Actual application OIDC: baseline-private.json
{
  "target": "https://localhost:19952",
  "bundle": "<TASKROOT>/ask-molty/rebuilt-worker/worker.js",
  "bundleSha256": "baa1d443d67d39cb0c36cb639464b268d626417e619b28a6f7bc7be82850b571",
  "binary": "<TASKROOT>/native-engine/baseline-ask-molty/workerd",
  "binarySha256": "509f28a11729a184280c6171e68876bfaa31c9faed4c83029cd59a6a358c66b4",
  "runtime": "v26.12.1",
  "signInStatus": 302,
  "callbackStatus": 302,
  "callbackBody": "",
  "hasSessionCookie": true,
  "sessionStatus": 200,
  "session": {
    "authenticated": true,
    "provider": "openclaw-id"
  },
  "certDistrusted": false,
  "taskProcessGroupStopped": true
}
Actual application OIDC: candidate-private.json
{
  "target": "https://localhost:19952",
  "bundle": "<TASKROOT>/ask-molty/rebuilt-worker/worker.js",
  "bundleSha256": "baa1d443d67d39cb0c36cb639464b268d626417e619b28a6f7bc7be82850b571",
  "binary": "<TASKROOT>/native-engine/1.20261021.1/workerd",
  "binarySha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64",
  "runtime": "v26.12.1",
  "signInStatus": 302,
  "callbackStatus": 302,
  "callbackBody": "",
  "hasSessionCookie": true,
  "sessionStatus": 200,
  "session": {
    "authenticated": true,
    "provider": "openclaw-id"
  },
  "certDistrusted": false,
  "taskProcessGroupStopped": true
}
Actual application OIDC: baseline-incident.json
{
  "target": "https://dv-g3b-emudhra.we-have-a-problem.com",
  "bundle": "<TASKROOT>/ask-molty/rebuilt-worker/worker.js",
  "bundleSha256": "baa1d443d67d39cb0c36cb639464b268d626417e619b28a6f7bc7be82850b571",
  "binary": "<TASKROOT>/native-engine/baseline-ask-molty/workerd",
  "binarySha256": "509f28a11729a184280c6171e68876bfaa31c9faed4c83029cd59a6a358c66b4",
  "runtime": "v26.12.1",
  "signInStatus": 302,
  "callbackStatus": 401,
  "callbackBody": "<!doctype html><meta charset=\"utf-8\"><title>Ask Molty verification failed</title><style>html{color-scheme:dark;background:#0b0a0a;color:#f4eeee;font:16px system-ui,sans-serif}main{max-width:520px;margin:16vh auto;padding:0 24px}a{color:#ff875f}</style><main><h1>Verification failed</h1><p>OpenClaw ID verification failed.</p><p><a href=\"/\">Back to docs</a></p></main>",
  "hasSessionCookie": false,
  "certDistrusted": false,
  "taskProcessGroupStopped": true
}
Actual application OIDC: candidate-incident.json
{
  "target": "https://dv-g3b-emudhra.we-have-a-problem.com",
  "bundle": "<TASKROOT>/ask-molty/rebuilt-worker/worker.js",
  "bundleSha256": "baa1d443d67d39cb0c36cb639464b268d626417e619b28a6f7bc7be82850b571",
  "binary": "<TASKROOT>/native-engine/1.20261021.1/workerd",
  "binarySha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64",
  "runtime": "v26.12.1",
  "signInStatus": 302,
  "callbackStatus": 500,
  "callbackBody": "Error: internal error; reference = unjtfk4d7up1hv7o36roiu68\n    at async Object.fetch (file://<TASKROOT>/ask-molty/repo/node_modules/miniflare/dist/src/workers/core/entry.worker.js:5204:22)",
  "hasSessionCookie": false,
  "certDistrusted": false,
  "taskProcessGroupStopped": true
}
Actual application OIDC: fixture-requests.json
[
  {
    "method": "POST",
    "path": "/oauth2/token",
    "bodySha256": "dac43af979bef45be6a2af92d6fda42ccb0dca77bad8abeac8456d1f7fa51661",
    "hasExpectedSyntheticAuth": true
  },
  {
    "method": "POST",
    "path": "/oauth2/token",
    "bodySha256": "dac43af979bef45be6a2af92d6fda42ccb0dca77bad8abeac8456d1f7fa51661",
    "hasExpectedSyntheticAuth": true
  }
]
Candidate actual incident OIDC application log (generic error; not direct TLS attribution; terminal ESC rendered visibly as ^[)

 ⛅️ wrangler 4.129.1 (update available 4.152.0)
───────────────────────────────────────────────
Your Worker has access to the following bindings:
Binding                                                                          Resource                  Mode
env.DOCS_ARTIFACTS (openclaw-docs)                                               R2 Bucket                 local
env.DOCS_INDEX_URL ("https://docs.openclaw.ai/docs-search....")                  Environment Variable      local
env.DOCS_CORPUS_URL ("https://docs.openclaw.ai/llms-full.txt")                   Environment Variable      local
env.SOURCE_INDEX_URL ("https://docs.openclaw.ai/source-index...")                Environment Variable      local
env.GITHUB_INDEX_URL ("https://github.com/openclaw/ask-molty...")                Environment Variable      local
env.WORKSPACE_MANIFEST_URL ("https://docs.openclaw.ai/ask-molty/wo...")          Environment Variable      local
env.OPENAI_MODEL ("chat-latest")                                                 Environment Variable      local
env.CLAWHUB_AUTH_URL ("https://clawhub.ai/auth/docs")                            Environment Variable      local
env.CLAWHUB_SESSION_VERIFY_URL ("https://clawhub.ai/api/v1/docs/sessio...")      Environment Variable      local
env.OPENCLAW_ID_ISSUER ("(hidden)")                                              Environment Variable      local
env.OPENCLAW_ID_CLIENT_ID ("(hidden)")                                           Environment Variable      local
env.OPENCLAW_ID_CLIENT_SECRET ("(hidden)")                                       Environment Variable      local
env.ASK_MOLTY_AUTH_SECRET ("(hidden)")                                           Environment Variable      local

⎔ Starting local server...
[wrangler:info] Ready on http://127.0.0.1:19953
[wrangler:info] GET /ask-molty/sign-in 302 Found (7ms)
^[[31m✘ ^[[41;31m[^[[41;97mERROR^[[41;31m]^[[0m ^[[1mUncaught Error: internal error; reference = unjtfk4d7up1hv7o36roiu68 ^[[0m


^[[31m✘ ^[[41;31m[^[[41;97mERROR^[[41;31m]^[[0m ^[[1mUncaught Error: internal error; reference = unjtfk4d7up1hv7o36roiu68 ^[[0m


[wrangler:info] GET /ask-molty/auth/oidc-callback 500 Internal Server Error (148ms)
[wrangler:warn] The Workers runtime crashed unexpectedly and is being restarted (crash #1). Any additional runtime output above may indicate the cause.
🪵  Logs were written to "<TASK_WRANGLER>/logs/wrangler-2026-10-26_09-15-57_534.log"
Executed application OIDC harness (task paths and synthetic secret markers redacted only)
import {readFileSync,writeFileSync,mkdirSync} from 'node:fs';
import {createHash} from 'node:crypto';
import {createServer} from 'node:https';
import {createRequire} from 'node:module';
import {spawn} from 'node:child_process';
const root='<TASKROOT>';
const out=root+'/ask-molty/evidence/product-tls';mkdirSync(out,{recursive:true});
const sha=x=>createHash('sha256').update(x).digest('hex');
const bundle=root+'/ask-molty/rebuilt-worker/worker.js';
if(process.argv[2]==='child'){
 const req=createRequire(root+'/ask-molty/repo/package.json');const meta=req('wrangler/package.json');const wrangler=req.resolve('wrangler/package.json').replace(/package.json$/,'')+meta.bin.wrangler;
 const target=process.argv[3];
 const vars=['OPENCLAW_ID_ISSUER:'+target,'OPENCLAW_ID_CLIENT_ID:task-client','OPENCLAW_ID_CLIENT_SECRET:<SYNTHETIC_CLIENT_SECRET>','ASK_MOLTY_AUTH_SECRET:<SYNTHETIC_STATE_SECRET>'];
 const child=spawn(process.execPath,[wrangler,'dev',bundle,'--no-bundle','--config',root+'/ask-molty/repo/wrangler.toml','--local','--ip','127.0.0.1','--port','19953','--inspector-port','19954','--persist-to',out+'/state',...vars.flatMap(x=>['--var',x])],{env:process.env,cwd:root+'/ask-molty/repo',detached:true,stdio:['ignore','pipe','pipe']});let log='';child.stdout.on('data',x=>log+=x);child.stderr.on('data',x=>log+=x);
 const row={target,bundle,bundleSha256:sha(readFileSync(bundle)),binary:process.env.MINIFLARE_WORKERD_PATH,binarySha256:sha(readFileSync(process.env.MINIFLARE_WORKERD_PATH)),runtime:process.version};
 try{
  const u='http://127.0.0.1:19953';let ready=false;for(let i=0;i<100;i++){if(child.exitCode!==null)break;if(log.includes('Ready on http://')){ready=true;break;}await new Promise(r=>setTimeout(r,100));}if(!ready)throw new Error('actual rebuilt Worker not ready');
  const sign=await fetch(u+'/ask-molty/sign-in',{redirect:'manual',signal:AbortSignal.timeout(10000)});row.signInStatus=sign.status;
  const state=new URL(sign.headers.get('location')).searchParams.get('state');
  const callback=await fetch(u+'/ask-molty/auth/oidc-callback?code=synthetic&state='+encodeURIComponent(state),{redirect:'manual',signal:AbortSignal.timeout(30000)});
  row.callbackStatus=callback.status;row.callbackBody=(await callback.text()).slice(0,1600);row.hasSessionCookie=Boolean(callback.headers.get('set-cookie'));
  if(row.hasSessionCookie){const r=await fetch(u+'/ask-molty/api/session',{headers:{cookie:callback.headers.get('set-cookie').split(';')[0]}});row.sessionStatus=r.status;row.session=await r.json();}
 }catch(e){row.harnessError=String(e);}finally{try{process.kill(-child.pid,'SIGTERM');}catch{}await Promise.race([new Promise(r=>child.once('close',r)),new Promise(r=>setTimeout(r,3000))]);if(child.exitCode===null)try{process.kill(-child.pid,'SIGKILL');}catch{}row.certDistrusted=log.includes('CertDistrusted');row.taskProcessGroupStopped=true;writeFileSync(process.argv[4]+'.worker.log',log);writeFileSync(process.argv[4],JSON.stringify(row,null,2)+'\n');console.log(JSON.stringify(row));}
}else{
 const requests=[];
 const server=createServer({key:readFileSync(root+'/native-engine/fixture/server.key'),cert:readFileSync(root+'/native-engine/fixture/server.pem')},async(q,s)=>{let data='';for await(const part of q)data+=part;requests.push({method:q.method,path:q.url,bodySha256:sha(data),hasExpectedSyntheticAuth:q.headers.authorization==='Basic '+Buffer.from('task-client:<SYNTHETIC_CLIENT_SECRET>').toString('base64')});const enc=x=>Buffer.from(JSON.stringify(x)).toString('base64url');const body=JSON.stringify({id_token:enc({alg:'none'})+'.'+enc({email:'task-proof@example.invalid',sub:'task-proof'})+'.synthetic'});s.writeHead(200,{'content-type':'application/json'});s.end(body);});
 await new Promise(r=>server.listen(19952,'127.0.0.1',r));
 const old=root+'/native-engine/baseline-ask-molty/workerd';
 const candidate=root+'/native-engine/1.20261021.1/package/bin/workerd';
 const identities=JSON.parse(readFileSync(root+'/native-engine/evidence/artifact-identities.json','utf8'));
 const actual=identities.find(x=>x.label==='candidate').path;
 const trust=out+'/old-and-private.pem';writeFileSync(trust,readFileSync(root+'/native-engine/old-explicit-ca.pem','utf8')+'\n'+readFileSync(root+'/native-engine/fixture/ca.pem','utf8'));
 try{
  for(const [label,binary,target] of [['baseline-private',old,'https://localhost:19952'],['candidate-private',actual,'https://localhost:19952'],['baseline-incident',old,'https://dv-g3b-emudhra.we-have-a-problem.com'],['candidate-incident',actual,'https://dv-g3b-emudhra.we-have-a-problem.com']]){
   const env={...process.env,MINIFLARE_WORKERD_PATH:binary,NODE_EXTRA_CA_CERTS:trust,WRANGLER_SEND_METRICS:'false'};for(const k of ['HTTP_PROXY','HTTPS_PROXY','ALL_PROXY','SSL_CERT_FILE','SSL_CERT_DIR'])delete env[k];
   const child=spawn(process.execPath,[process.argv[1],'child',target,out+'/'+label+'.json'],{env,stdio:['ignore','pipe','pipe']});let log='';child.stdout.on('data',x=>log+=x);child.stderr.on('data',x=>log+=x);const timer=setTimeout(()=>child.kill('SIGTERM'),60000);const status=await new Promise(r=>child.once('close',r));clearTimeout(timer);writeFileSync(out+'/'+label+'.log',log);console.log(label,status);
  }
 }finally{await new Promise(r=>server.close(r));writeFileSync(out+'/fixture-requests.json',JSON.stringify(requests,null,2)+'\n');writeFileSync(out+'/resources.json',JSON.stringify({taskServersStopped:true,trustMutated:false,cloudflareMutated:false,port:19952,scope:'Actual rebuilt Ask Molty bundle OIDC confidential-client TLS; synthetic private issuer and actual incident endpoint; no public deployment'},null,2)+'\n');}
}
Exact old-only compatibility adaptation
new.write_text(old.read_text().replace('2026-10-01','2026-08-01'))
Original retained input and redacted projection hashes
[
  {
    "path": "collected/ask-molty/evidence/candidate-selected-identity.log",
    "sha256": "bf1319f3fbf699be7461fffc581249158808c4ac4aae3a645e0d7ea1f28c5128",
    "projection": "candidate-selected-identity.json",
    "projectionSha256": "e1c9287a86ef3dd18eb0036c0569d8b4e2f6f124cd804aeb6226167918e2970c",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/baseline-install.json",
    "sha256": "0e7f64290153c1ff90cc36647ede52de95304723c878234b73113acfc05e2e0a",
    "projection": "baseline-install.json",
    "projectionSha256": "1feb09c44203862c86dc9a47add29fabbec7ff3c94e63139a55522cab9ed35d3",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/candidate-install.json",
    "sha256": "d04a0eabb2a9ce9da7b0deb73edbe272041248278727fe9e462eccd95da944d6",
    "projection": "candidate-install.json",
    "projectionSha256": "670d0572e58aadfc8bf86f47957487c7c77c8afaed1e10a09a0dfd9460fd193c",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/candidate-checks.json",
    "sha256": "d8b05e9e4ad8b5bbae93b94d912061f84515c273709450bef2f379274ee33ba1",
    "projection": "candidate-checks.json",
    "projectionSha256": "050139262d7bcf1a1c9ad3017d901727c7a56268e2b2b9e0151087b23ac8fbc3",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/candidate-local-worker.json",
    "sha256": "07bd4c54634cc34612c58dd185bc0bfb230f1676a80c68b5a7d21dd5bf327067",
    "projection": "candidate-local-worker.json",
    "projectionSha256": "c20c339b64ed5305bc5aec8a03eb961707635f136cf8d27e4bc9cef8de07c9d4",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/rebuilt-worker-artifacts.json",
    "sha256": "42a3df6ffcf198e7bafddc70966b6f3d7fce5fb3b0b675b0aa646e85ff045eec",
    "projection": "rebuilt-worker-artifacts.json",
    "projectionSha256": "42a3df6ffcf198e7bafddc70966b6f3d7fce5fb3b0b675b0aa646e85ff045eec",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/product-tls/baseline-private.json",
    "sha256": "2c97b7c9260c90cf894f8b3fcad53a70948e464d396e7dded4e251251966062d",
    "projection": "baseline-private.json",
    "projectionSha256": "7716cc921247f0c31cf3c9e8a19fe52b1636241f698c01726d13fdb36020ec51",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/product-tls/candidate-private.json",
    "sha256": "bd31c9f3f79e0b591f4055c84756ce854952061231bbc848415c3cd998e66e05",
    "projection": "candidate-private.json",
    "projectionSha256": "79485e9e9c3d6e8f8c3e089e753b644e5c02aa3e6391df0d22d48b39c56e4c3d",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/product-tls/baseline-incident.json",
    "sha256": "d3406875cc41ccf7ce7c0def3245af8ba3b48fef9765425a3514c26f90188c33",
    "projection": "baseline-incident.json",
    "projectionSha256": "a9c3d92dc736f82103d68d5c8bfc75242c2ce37bd2a61cd1dac75e7adab4a32b",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/product-tls/candidate-incident.json",
    "sha256": "24f46dd8ff15fbbcfb9489eb1774098c760b4d611b2c64aabc8de69ff5ccb829",
    "projection": "candidate-incident.json",
    "projectionSha256": "038f250670fe6109567549ea6c124998ac049196ced3d58faf3fd3b4c55c6f58",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/product-tls/fixture-requests.json",
    "sha256": "c6e2f3543a18e56f09e3030101fb496c827cf4cf8232efde62c5dfc9b60f0eb1",
    "projection": "fixture-requests.json",
    "projectionSha256": "c6e2f3543a18e56f09e3030101fb496c827cf4cf8232efde62c5dfc9b60f0eb1",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "collected/ask-molty/evidence/product-tls/candidate-incident.json.worker.log",
    "sha256": "c92c344031cff8c19f9c2617451f6ed5dc8d951bc911ea0ee6a1641c36ce174a",
    "projection": "candidate-incident.json.worker.log",
    "projectionSha256": "5a6901fbf016d5c160bcd43018f6cdcf688c3120e421fcfcf7123381f961d1eb",
    "redactions": "Task-root/tool paths tokenized; fourteen ANSI ESC bytes represented visibly as ^[ for GitHub; no semantic log text changed"
  },
  {
    "path": "ask-product-tls.mjs",
    "sha256": "3062e0cdd9fe5b86ff1a1b3789238650ca4a83f89c11bf065c63a0188373c09f",
    "projection": "executed-oidc-harness-redacted.mjs",
    "projectionSha256": "96ad25a96b5c03d6421614c85755cb8c7d47eba57f8d37d64bd11e27cc32073d",
    "redactions": "Task-root/tool paths and explicitly synthetic secret markers only"
  },
  {
    "path": "native-engine/old-compat-followup.py",
    "sha256": "8a83fd547f1a20162a03b1e61a7e0f1511edddb7f9d4c37d3c7f33521ea02699",
    "publicScope": "Only adaptation line; unrelated engine identities omitted"
  },
  {
    "path": "collected/native-engine/old-compat-followup/results.json",
    "sha256": "837c1ffb746a2d443e0357baf7b7672b37f0e7aa6790cd1b397832266ba00336",
    "publicScope": "Lossless field-preserving selection of this consumer baseline32rows; exact candidate32rows in linked shared proof"
  }
]

@joshavant

Copy link
Copy Markdown
Contributor Author

@clawsweeper re-review

@clawsweeper

clawsweeper Bot commented Oct 26, 2026 •

Copy link
Copy Markdown

🦞👀
Exact review queued.

Re-review progress:

@clawsweeper clawsweeper Bot added clawsweeper:intake:bug Preliminary submission classification; full source review pending. clawsweeper:intake:needs-repro Preliminary submission classification; full source review pending. rating: 🦐 gold shrimp Decent PR readiness signal, but merge confidence is limited. and removed rating: 🧂 unranked krab Not merge-ready due to missing proof or serious correctness/safety concerns. clawsweeper:intake:bug Preliminary submission classification; full source review pending. clawsweeper:intake:needs-repro Preliminary submission classification; full source review pending. labels Oct 26, 2026
@joshavant

Copy link
Copy Markdown
Contributor Author

Native macOS ARM64 product screenshots for reviewed repair head 10512326f2481d6d8a514a64d9d18d7e8f67a8e2 (actual rebuilt Worker bundle SHA256 7a01d806210d67faaa6daa591ae29d9bd34715359b0208509fa00d284209619c).

The actual OIDC callback rejects the verified incident chain in both cases. Before, the rejected exchange escaped as a generic HTTP 500. After, the existing authentication page returns HTTP 502 with retry and operator guidance. TLS verification, timeout handling and session admission remain intact; no session is issued on failure. A subsequent legitimate private-CA HTTPS chat succeeds using retained state.

These are inspected Safari captures inside the task-owned macOS guest, cropped to remove desktop and synthetic callback parameters. The task-only navigation helper only redirects the browser to the actual product callback; it supplies no product content. The source-only released predecessor upgrade and wire/chain evidence are documented separately in this PR; these images alone do not establish those checks or a Cloudflare production deployment.

Before:

Before: generic internal error from the actual rejected OIDC exchange

After:

After: actionable verification failure, with issuer, availability and certificate guidance

@joshavant

Copy link
Copy Markdown
Contributor Author

@clawsweeper re-review

Final head 10512326f2481d6d8a514a64d9d18d7e8f67a8e2. Branch, body and native proof are current. The actual source-only released-v0.2.0 same-installation upgrade retained the original session/config/R2 document, and the real confidential-client boundary now has strict chain/hostname controls plus bounded TLS 1.3 wire evidence. The reproduced generic500 is repaired at the existing OIDC owner, with failing-before/passing-after proof and actual final-bundle private-CA recovery. The body records precise bounds, source/artifact identities, evidence reuse and the inspected product screenshots. Please evaluate the current head and updated evidence; no deployment or merge is requested.

@clawsweeper

clawsweeper Bot commented Oct 27, 2026 •

Copy link
Copy Markdown

🦞👀
Exact review queued.

Re-review progress:

@joshavant

Copy link
Copy Markdown
Contributor Author

Native final-head proof supplement for 10512326f2481d6d8a514a64d9d18d7e8f67a8e2 (base 8e163dc85a146ddd303a80cae5305d17ce6facbf). This makes the focused new evidence inspectable; the earlier supplement remains historical. All scenarios ran in a task-owned native macOS ARM64 UTM guest, Node 24.22.1. No cloud deployment or live provider credentials.

The source-only released predecessor v0.2.0 has signed tag object e34844e8c3120a2a35fc53a0f525e5936c72f58e, source 5abd6325be7fb69bf84ac0e325548013fd8ab0e9. The installation owner is source replacement and npm ci, then actual Wrangler; this private project has no application updater. We retained the same installation, config/signing secret, local R2 and original signed session. R2 was seeded once. The final query omits the document marker, and the HTTPS model fixture confirms it consumed retained document content. The original session succeeds before fresh sign-in.

Final actual rebuilt Worker SHA256 7a01d806210d67faaa6daa591ae29d9bd34715359b0208509fa00d284209619c. Installed source is file-for-file identical to the reviewed repaired archive; the signed remote final-head files match those bytes. Source archive SHA256 1cd48814d03fd6eb83469d8f0c7f26e2fc49e0b5647a9438787157733aa24b0f.

The real incident OIDC boundary used a byte-transparent relay, not a fake certificate or bypassed verifier. Strict TLS1.2 and TLS1.3 chain+exact-hostname controls pass with historical trust. Old workerd reaches HTTP401; original candidate throws generic500; the repaired rebuilt bundle returns actionable502 without a session, then legitimate private-CA OIDC/model use succeeds without resetting state. The inspected product screenshots are separate visual evidence.

Raw candidate fresh TLS1.3 client records contain no PSK/early-data offer and only one19-byte encrypted record, selected AES256-GCM cipher0x1302. Subtract tag16 + at least one inner content-type byte: at most two plaintext bytes; confidential-client HTTP and Finished cannot fit. This is a byte bound, not decrypted alert semantics. Existing exact-binary standalone evidence establishes CertDistrusted/Revoked separately. No generalized resumption/0-RTT claim.

Released install
{
  "label": "release",
  "archiveSha256": "034f5991d2f2b7c9c60260dda6840b7748de9b9f7e8e3908472d75a8e015d36f",
  "command": [
    "npm",
    "ci",
    "--no-audit",
    "--no-fund"
  ],
  "exitCode": 0,
  "elapsedSeconds": 2.882,
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerd": [
    {
      "path": "<TASK>/installation/node_modules/workerd/bin/workerd",
      "sha256": "509f28a11729a184280c6171e68876bfaa31c9faed4c83029cd59a6a358c66b4",
      "version": "workerd 2026-09-07"
    },
    {
      "path": "<TASK>/installation/node_modules/@cloudflare/workerd-darwin-arm64/bin/workerd",
      "sha256": "509f28a11729a184280c6171e68876bfaa31c9faed4c83029cd59a6a358c66b4",
      "version": "workerd 2026-09-07"
    }
  ]
}
Repaired install, same configuration hash
{
  "label": "repaired",
  "archiveSha256": "1cd48814d03fd6eb83469d8f0c7f26e2fc49e0b5647a9438787157733aa24b0f",
  "command": [
    "npm",
    "ci",
    "--no-audit",
    "--no-fund"
  ],
  "exitCode": 0,
  "elapsedSeconds": 2.911,
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerd": [
    {
      "path": "<TASK>/installation/node_modules/workerd/bin/workerd",
      "sha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64",
      "version": "workerd 2026-10-21"
    },
    {
      "path": "<TASK>/installation/node_modules/@cloudflare/workerd-darwin-arm64/bin/workerd",
      "sha256": "44a06c31a6578f234cdf7f23219b88978c8d8d21cb8ce85795cab53614b50d64",
      "version": "workerd 2026-10-21"
    }
  ]
}
Actual predecessor positive journey
{
  "label": "release",
  "scenario": "private",
  "command": [
    "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
    "<TASK>/installation/node_modules/wrangler/bin/wrangler.js",
    "dev",
    "--config",
    "<TASK>/installation/wrangler.toml",
    "--local",
    "--ip",
    "127.0.0.1",
    "--port",
    "24447",
    "--inspector-port",
    "24448",
    "--persist-to",
    "<TASK>/state"
  ],
  "node": "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
  "runtime": "v24.22.1",
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerSourceSha256": "f81dd36f49600ddbbc0dca7013331151a5b899e3bccb522e547ab91b5d81ca1f",
  "startedUTC": "2026-10-27T22:53:39.642Z",
  "signInStatus": 302,
  "callbackElapsedMs": 7,
  "callbackStatus": 302,
  "callbackBody": "",
  "sessionCookieIssued": true,
  "sessionStatus": 200,
  "session": {
    "authenticated": true,
    "provider": "openclaw-id"
  },
  "chatStatus": 200,
  "chatBody": "TASK_MODEL_OK RETAINED_R2_MARKER",
  "workspaceFiles": "2",
  "certDistrusted": false,
  "stopped": true
}
Actual installed final-bundle legitimate recovery
{
  "label": "final-bundle-recovery",
  "scenario": "private",
  "bundle": "<TASK>/rebuilt-worker/worker.js",
  "bundleSHA256": "7a01d806210d67faaa6daa591ae29d9bd34715359b0208509fa00d284209619c",
  "command": [
    "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
    "<TASK>/installation/node_modules/wrangler/bin/wrangler.js",
    "dev",
    "<TASK>/rebuilt-worker/worker.js",
    "--no-bundle",
    "--config",
    "<TASK>/installation/wrangler.toml",
    "--local",
    "--ip",
    "127.0.0.1",
    "--port",
    "24447",
    "--inspector-port",
    "24448",
    "--persist-to",
    "<TASK>/state"
  ],
  "node": "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
  "runtime": "v24.22.1",
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerSourceSha256": "184b69389a41eb21653bbf480729b975f9002d4892377aa3318114ac46321c8a",
  "startedUTC": "2026-10-27T22:54:52.038Z",
  "signInStatus": 302,
  "retainedSessionStatus": 200,
  "retainedSession": {
    "authenticated": true,
    "provider": "openclaw-id"
  },
  "callbackElapsedMs": 9,
  "callbackStatus": 302,
  "callbackBody": "",
  "sessionCookieIssued": true,
  "sessionStatus": 200,
  "session": {
    "authenticated": true,
    "provider": "openclaw-id"
  },
  "chatStatus": 200,
  "chatBody": "TASK_MODEL_OK RETAINED_R2_MARKER",
  "workspaceFiles": "2",
  "certDistrusted": false,
  "stopped": true
}
Exact retained R2 readback
{
  "command": [
    "node",
    "node_modules/wrangler/bin/wrangler.js",
    "r2",
    "object",
    "get",
    "openclaw-docs/docs-search.json",
    "--local",
    "--persist-to",
    "<TASK>/state",
    "--file",
    "<TASK>/evidence/retained-r2-docs.json"
  ],
  "exitCode": 0,
  "originalArtifactSHA256": "aa853e12c35b16d69445155dfce5d9b8910d5eb7a79d1f32edcfc410a75db60f",
  "actualPersistedObjectSHA256": "aa853e12c35b16d69445155dfce5d9b8910d5eb7a79d1f32edcfc410a75db60f",
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "sourceAndConfigPreserved": true,
  "stateDirectory": "<TASK>/state",
  "dataWasSeededOnlyOnce": true,
  "questionDoesNotContainMarker": true
}
Actual released incident callback
{
  "label": "release",
  "scenario": "incident",
  "command": [
    "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
    "<TASK>/installation/node_modules/wrangler/bin/wrangler.js",
    "dev",
    "--config",
    "<TASK>/installation/wrangler.toml",
    "--local",
    "--ip",
    "127.0.0.1",
    "--port",
    "24447",
    "--inspector-port",
    "24448",
    "--persist-to",
    "<TASK>/state",
    "--var",
    "OPENCLAW_ID_ISSUER:https://dv-g3b-emudhra.we-have-a-problem.com:24446"
  ],
  "node": "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
  "runtime": "v24.22.1",
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerSourceSha256": "f81dd36f49600ddbbc0dca7013331151a5b899e3bccb522e547ab91b5d81ca1f",
  "startedUTC": "2026-10-27T22:49:07.393Z",
  "signInStatus": 302,
  "callbackElapsedMs": 182,
  "callbackStatus": 401,
  "callbackBody": "<!doctype html><meta charset=\"utf-8\"><title>Ask Molty verification failed</title><style>html{color-scheme:dark;background:#0b0a0a;color:#f4eeee;font:16px system-ui,sans-serif}main{max-width:520px;margin:16vh auto;padding:0 24px}a{color:#ff875f}</style><main><h1>Verification failed</h1><p>OpenClaw ID verification failed.</p><p><a href=\"/\">Back to docs</a></p></main>",
  "sessionCookieIssued": false,
  "certDistrusted": false,
  "stopped": true
}
Actual unmodified candidate incident failure
{
  "label": "candidate",
  "scenario": "incident",
  "command": [
    "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
    "<TASK>/installation/node_modules/wrangler/bin/wrangler.js",
    "dev",
    "--config",
    "<TASK>/installation/wrangler.toml",
    "--local",
    "--ip",
    "127.0.0.1",
    "--port",
    "24447",
    "--inspector-port",
    "24448",
    "--persist-to",
    "<TASK>/state",
    "--var",
    "OPENCLAW_ID_ISSUER:https://dv-g3b-emudhra.we-have-a-problem.com:24446"
  ],
  "node": "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
  "runtime": "v24.22.1",
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerSourceSha256": "699e8b161d24cd1ca11710ae0b7d7588ea6621e54820d8f76e93dc7ae5dc0122",
  "startedUTC": "2026-10-27T22:49:17.840Z",
  "signInStatus": 302,
  "callbackElapsedMs": 1111,
  "callbackStatus": 500,
  "sessionCookieIssued": false,
  "certDistrusted": false,
  "stopped": true,
  "callbackBodyBytes": 33374,
  "callbackBodySHA256": "de02a054969764a825c2c186233bd20c150f9ae95ef7bdd6f1f65fc92b1bac13",
  "callbackBodyTitle": "An error has occurred",
  "callbackBodyRetainedLocally": true
}
Actual final rebuilt incident callback
{
  "label": "final-bundle",
  "scenario": "incident",
  "bundle": "<TASK>/rebuilt-worker/worker.js",
  "bundleSHA256": "7a01d806210d67faaa6daa591ae29d9bd34715359b0208509fa00d284209619c",
  "command": [
    "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
    "<TASK>/installation/node_modules/wrangler/bin/wrangler.js",
    "dev",
    "<TASK>/rebuilt-worker/worker.js",
    "--no-bundle",
    "--config",
    "<TASK>/installation/wrangler.toml",
    "--local",
    "--ip",
    "127.0.0.1",
    "--port",
    "24447",
    "--inspector-port",
    "24448",
    "--persist-to",
    "<TASK>/state",
    "--var",
    "OPENCLAW_ID_ISSUER:https://dv-g3b-emudhra.we-have-a-problem.com:24446"
  ],
  "node": "<TASK_TOOLS>/node-v24.22.1-darwin-arm64/bin/node",
  "runtime": "v24.22.1",
  "devVarsSha256": "b5fe2f42b5d1571b79488ac23828d4d7d25f301c04a77f5e37abe0f8e21e8587",
  "workerSourceSha256": "184b69389a41eb21653bbf480729b975f9002d4892377aa3318114ac46321c8a",
  "startedUTC": "2026-10-27T22:54:30.857Z",
  "signInStatus": 302,
  "callbackElapsedMs": 150,
  "callbackStatus": 502,
  "callbackBody": "<!doctype html><meta charset=\"utf-8\"><title>Ask Molty verification failed</title><style>html{color-scheme:dark;background:#0b0a0a;color:#f4eeee;font:16px system-ui,sans-serif}main{max-width:520px;margin:16vh auto;padding:0 24px}a{color:#ff875f}</style><main><h1>Verification failed</h1><p>OpenClaw ID could not be reached securely. Please try again. If this continues, ask the docs operator to check the issuer configuration, availability, and certificate chain.</p><p><a href=\"/\">Back to docs</a></p></main>",
  "sessionCookieIssued": false,
  "certDistrusted": false,
  "stopped": true
}
Strict TLS1.3 control and verified identities
{
  "command": [
    "/opt/homebrew/bin/openssl",
    "s_client",
    "-connect",
    "<INCIDENT_ADDRESS>:443",
    "-servername",
    "dv-g3b-emudhra.we-have-a-problem.com",
    "-tls1_3",
    "-verify_return_error",
    "-verify_hostname",
    "dv-g3b-emudhra.we-have-a-problem.com",
    "-CAfile",
    "<TASK>/old-explicit-ca.pem",
    "-showcerts"
  ],
  "exitCode": 0,
  "opensslVersion": "OpenSSL 4.1.0 23 Oct 2026 (Library: OpenSSL 4.1.0 23 Oct 2026)",
  "opensslExecutable": "/opt/homebrew/Cellar/openssl@4/4.1.0/bin/openssl",
  "opensslExecutableSHA256": "da101a01999a93ea6eddfe1392752bce2b5a91a41e4b00e1d9656fc682a1dc85",
  "controlLogSHA256": "a80f9857e32dfff2810bf986b74ed2d37d5355ae9f9ce62e2e908578101f50fe",
  "certificates": [
    {
      "sha256": "9dcb21b1841d75313b3c888f4bb9cc01f8f51379a76fbaa241ca492b668839e7",
      "spkiSha256": "27a1f73e0e681ca0d5e8cb036a111944cef09f1ee170a6f6df0023b97b290a14"
    },
    {
      "sha256": "42c4accd12c4f59597925e1a08a7a90102608543809308d50ec427e118ba1493",
      "spkiSha256": "ebed6475c2c2d80fcb199f3fe8dd6e6b3ce60b77eb15d4e42c3dec0c6f5b5105"
    },
    {
      "sha256": "3094025792039a68af6e553686410bdab7c0d4a36b9084cba64202e35d6ebbdd",
      "spkiSha256": "c619e4780ed8e0abeda24ad732567de4383a7ea941338f6d1a7d1b49ac792fe9"
    }
  ]
}
Raw wire parse: released connection1 and candidate connections2–6
[
  {
    "connection": 1,
    "clientBytes": 738,
    "clientSHA256": "7376ce93da02eadeb0915734a483facce8944212391739b5238ea2d0a7d643d6",
    "serverSHA256": "c183e0c8da6e2aa4bdbaedb5165305f7839848d8933e7d48a29d7a669a2165f8",
    "clientHello": {
      "extensionTypes": [
        0,
        10,
        11,
        13,
        23,
        35,
        43,
        45,
        51,
        65281
      ],
      "preSharedKeyOffered": false,
      "earlyDataOffered": false
    },
    "serverHello": {
      "cipherSuite": "0x1301",
      "supportedVersion": "0304"
    },
    "clientRecords": [
      {
        "type": 22,
        "legacyRecordVersion": "0301",
        "length": 252
      },
      {
        "type": 20,
        "legacyRecordVersion": "0303",
        "length": 1
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 53
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 267
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 140
      }
    ],
    "encryptedClientRecordBytes": 460
  },
  {
    "connection": 2,
    "clientBytes": 295,
    "clientSHA256": "47676b0554b7c6ac4bba02c723a63a40f6198140490f113a8f806619e4381453",
    "serverSHA256": "4af15e873bbaf93cf467bdb4298cd65c8ec5f8b2ee0d63cc064465a56c847eb8",
    "clientHello": {
      "extensionTypes": [
        0,
        5,
        10,
        11,
        13,
        23,
        35,
        43,
        45,
        51
      ],
      "preSharedKeyOffered": false,
      "earlyDataOffered": false
    },
    "serverHello": {
      "cipherSuite": "0x1302",
      "supportedVersion": "0304"
    },
    "clientRecords": [
      {
        "type": 22,
        "legacyRecordVersion": "0301",
        "length": 260
      },
      {
        "type": 20,
        "legacyRecordVersion": "0303",
        "length": 1
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 19
      }
    ],
    "encryptedClientRecordBytes": 19,
    "bound": {
      "cipher": "TLS_AES_256_GCM_SHA384",
      "aeadTagBytes": 16,
      "tlsInnerTypeMinimumBytes": 1,
      "maximumNonPaddingPlaintextBytes": 2,
      "outcome": "No confidential-client HTTP request can fit. Record content was not decrypted; no alert semantic is claimed. No client Finished can fit either."
    }
  },
  {
    "connection": 3,
    "clientBytes": 295,
    "clientSHA256": "0e6b23c5ffbdd15919160fb5b4935873d17b008a0dbad1f1c84726ebdd1fb43e",
    "serverSHA256": "ed75841a78664b52d5c0e37bbfc7aea3749c7ffdfb1827448bc7c2616e1b7d2a",
    "clientHello": {
      "extensionTypes": [
        0,
        5,
        10,
        11,
        13,
        23,
        35,
        43,
        45,
        51
      ],
      "preSharedKeyOffered": false,
      "earlyDataOffered": false
    },
    "serverHello": {
      "cipherSuite": "0x1302",
      "supportedVersion": "0304"
    },
    "clientRecords": [
      {
        "type": 22,
        "legacyRecordVersion": "0301",
        "length": 260
      },
      {
        "type": 20,
        "legacyRecordVersion": "0303",
        "length": 1
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 19
      }
    ],
    "encryptedClientRecordBytes": 19,
    "bound": {
      "cipher": "TLS_AES_256_GCM_SHA384",
      "aeadTagBytes": 16,
      "tlsInnerTypeMinimumBytes": 1,
      "maximumNonPaddingPlaintextBytes": 2,
      "outcome": "No confidential-client HTTP request can fit. Record content was not decrypted; no alert semantic is claimed. No client Finished can fit either."
    }
  },
  {
    "connection": 4,
    "clientBytes": 295,
    "clientSHA256": "5ce199e4fae31415acd325496f68bbfaac36296e15b2e2353d7bb0460fb099a9",
    "serverSHA256": "73719784248761e7f7d4572985c8ff34c8995b9bd93bb82e0bbf7aad410ef6bd",
    "clientHello": {
      "extensionTypes": [
        0,
        5,
        10,
        11,
        13,
        23,
        35,
        43,
        45,
        51
      ],
      "preSharedKeyOffered": false,
      "earlyDataOffered": false
    },
    "serverHello": {
      "cipherSuite": "0x1302",
      "supportedVersion": "0304"
    },
    "clientRecords": [
      {
        "type": 22,
        "legacyRecordVersion": "0301",
        "length": 260
      },
      {
        "type": 20,
        "legacyRecordVersion": "0303",
        "length": 1
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 19
      }
    ],
    "encryptedClientRecordBytes": 19,
    "bound": {
      "cipher": "TLS_AES_256_GCM_SHA384",
      "aeadTagBytes": 16,
      "tlsInnerTypeMinimumBytes": 1,
      "maximumNonPaddingPlaintextBytes": 2,
      "outcome": "No confidential-client HTTP request can fit. Record content was not decrypted; no alert semantic is claimed. No client Finished can fit either."
    }
  },
  {
    "connection": 5,
    "clientBytes": 295,
    "clientSHA256": "7dc91bd8b93da929a658d92a49ca2ae160b54bf8c2c5b30538d82abc91ae9539",
    "serverSHA256": "bf07b88eef4531d0fd87cda0434fbfe1be8b5c4d6f2ef2668d5dd116569912df",
    "clientHello": {
      "extensionTypes": [
        0,
        5,
        10,
        11,
        13,
        23,
        35,
        43,
        45,
        51
      ],
      "preSharedKeyOffered": false,
      "earlyDataOffered": false
    },
    "serverHello": {
      "cipherSuite": "0x1302",
      "supportedVersion": "0304"
    },
    "clientRecords": [
      {
        "type": 22,
        "legacyRecordVersion": "0301",
        "length": 260
      },
      {
        "type": 20,
        "legacyRecordVersion": "0303",
        "length": 1
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 19
      }
    ],
    "encryptedClientRecordBytes": 19,
    "bound": {
      "cipher": "TLS_AES_256_GCM_SHA384",
      "aeadTagBytes": 16,
      "tlsInnerTypeMinimumBytes": 1,
      "maximumNonPaddingPlaintextBytes": 2,
      "outcome": "No confidential-client HTTP request can fit. Record content was not decrypted; no alert semantic is claimed. No client Finished can fit either."
    }
  },
  {
    "connection": 6,
    "clientBytes": 295,
    "clientSHA256": "5184cbde57b274ee105df2c03471a2ef953caa14f7963bc9a175b62d3ba74468",
    "serverSHA256": "a9d183c1ecbf23eaaab22bf0ec83d4f3aaf5e85779bac3fae3be83b3c63e0df2",
    "clientHello": {
      "extensionTypes": [
        0,
        5,
        10,
        11,
        13,
        23,
        35,
        43,
        45,
        51
      ],
      "preSharedKeyOffered": false,
      "earlyDataOffered": false
    },
    "serverHello": {
      "cipherSuite": "0x1302",
      "supportedVersion": "0304"
    },
    "clientRecords": [
      {
        "type": 22,
        "legacyRecordVersion": "0301",
        "length": 260
      },
      {
        "type": 20,
        "legacyRecordVersion": "0303",
        "length": 1
      },
      {
        "type": 23,
        "legacyRecordVersion": "0303",
        "length": 19
      }
    ],
    "encryptedClientRecordBytes": 19,
    "bound": {
      "cipher": "TLS_AES_256_GCM_SHA384",
      "aeadTagBytes": 16,
      "tlsInnerTypeMinimumBytes": 1,
      "maximumNonPaddingPlaintextBytes": 2,
      "outcome": "No confidential-client HTTP request can fit. Record content was not decrypted; no alert semantic is claimed. No client Finished can fit either."
    }
  }
]
Final fresh candidate raw client TLS bytes (hex); SHA256 5184cbde57b274ee105df2c03471a2ef953caa14f7963bc9a175b62d3ba74468
16030101040100010003031903c7a64257934fc1aff1622c589f2420e02eabe18e68cb8bd48fff35b27d4c203f1bd665581856a40c515d8765e86bfa2c3e34af6e726b1d29bbb926a3559f370014130213011303c02cc02bcca9c030c02fcca800ff010000a30023000000000029002700002464762d6733622d656d75646872612e77652d686176652d612d70726f626c656d2e636f6d002d00020101003300260024001d0020373f0ee2333386768bafe822a549bf644d6ca70f746f12e7504dc871441e4966000a00080006001d00170018002b0005040304030300170000000b00020100000d0016001405030403080708060805080406010501040106030005000501000000001403030001011703030013f6a084161d04f1c1365252c223521e0d97e654
Actual final query / real entry-point harness (paths redacted, no cookie values)
import { readFileSync,writeFileSync } from 'node:fs';
import { spawn } from 'node:child_process';
import { createHash } from 'node:crypto';
const root='<TASK>',repo=root+'/installation',label=process.argv[2],scenario=process.argv[3]||'private';
const env={...JSON.parse(readFileSync(root+'/environment.json')),NODE_EXTRA_CA_CERTS:root+'/extra-ca.pem'};
const sha=x=>createHash('sha256').update(x).digest('hex');
const bundle=process.argv[4]==='bundle'?root+'/rebuilt-worker/worker.js':null;
const args=[repo+'/node_modules/wrangler/bin/wrangler.js','dev',...(bundle?[bundle,'--no-bundle']:[]),'--config',repo+'/wrangler.toml','--local','--ip','127.0.0.1','--port','24447','--inspector-port','24448','--persist-to',root+'/state'];
if(scenario==='incident') args.push('--var','OPENCLAW_ID_ISSUER:https://dv-g3b-emudhra.we-have-a-problem.com:24446');
const child=spawn(process.execPath,args,{env,cwd:repo,detached:true,stdio:['ignore','pipe','pipe']});let log='';child.stdout.on('data',x=>log+=x);child.stderr.on('data',x=>log+=x);
const row={label,scenario,bundle,bundleSHA256:bundle?sha(readFileSync(bundle)):null,command:[process.execPath,...args],node:process.execPath,runtime:process.version,devVarsSha256:sha(readFileSync(repo+'/.dev.vars')),workerSourceSha256:sha(readFileSync(repo+'/src/worker.ts')),startedUTC:new Date().toISOString()};
try{
 let ready=false;for(let i=0;i<200;i++){if(child.exitCode!==null)break;if(log.includes('Ready on http://')){ready=true;break;}await new Promise(r=>setTimeout(r,100));}if(!ready)throw Error('worker did not become ready');
 const url='http://127.0.0.1:24447',sign=await fetch(url+'/ask-molty/sign-in',{redirect:'manual',signal:AbortSignal.timeout(10000)});row.signInStatus=sign.status;const state=new URL(sign.headers.get('location')).searchParams.get('state');
 let cookie;
 if(label!=='release'&&scenario==='private'){
  cookie=readFileSync(root+'/session-cookie','utf8');const oldSession=await fetch(url+'/ask-molty/api/session',{headers:{cookie}});row.retainedSessionStatus=oldSession.status;row.retainedSession=await oldSession.json();
 }
 const start=Date.now();const r=await fetch(url+'/ask-molty/auth/oidc-callback?code=synthetic&state='+encodeURIComponent(state),{redirect:'manual',signal:AbortSignal.timeout(20000)});row.callbackElapsedMs=Date.now()-start;row.callbackStatus=r.status;row.callbackBody=await r.text();row.sessionCookieIssued=Boolean(r.headers.get('set-cookie'));
 if(r.headers.get('set-cookie')){cookie=r.headers.get('set-cookie').split(';')[0];if(label==='release')writeFileSync(root+'/session-cookie',cookie,{mode:0o600});const session=await fetch(url+'/ask-molty/api/session',{headers:{cookie}});row.sessionStatus=session.status;row.session=await session.json();}
 if(scenario==='private'){
  if(!cookie)throw Error('no usable session');
  const chat=await fetch(url+'/ask-molty/api/chat',{method:'POST',headers:{Origin:'https://docs.openclaw.ai',cookie,'Content-Type':'application/json'},body:JSON.stringify({message:'What does the retained predecessor document say about upgrade state fixture?'}),signal:AbortSignal.timeout(30000)});row.chatStatus=chat.status;row.chatBody=await chat.text();row.workspaceFiles=chat.headers.get('x-workspace-file-count');
 }
}catch(e){row.harnessError=String(e);}finally{
 try{process.kill(-child.pid,'SIGTERM');}catch{}await Promise.race([new Promise(r=>child.once('close',r)),new Promise(r=>setTimeout(r,3000))]);if(child.exitCode===null)try{process.kill(-child.pid,'SIGKILL');}catch{}
 row.certDistrusted=log.includes('CertDistrusted');row.stopped=true;writeFileSync(root+'/evidence/'+label+'-'+scenario+'.worker.log',log);writeFileSync(root+'/evidence/'+label+'-'+scenario+'.json',JSON.stringify(row,null,2)+'\n');console.log(JSON.stringify(row));
}
Final fixture observations; actual Basic/Bearer values and request bodies are not logged
[
  {
    "time": 1793141620.305,
    "path": "/v1/chat/completions",
    "method": "POST",
    "bodySha256": "e893c3f08f48ab911980484eda2ff9c35030acf76ca4a6d4fae3cdeedffe352d",
    "retainedR2Consumed": true,
    "expectedSyntheticBearer": true
  },
  {
    "time": 1793141634.677,
    "path": "/oauth2/token",
    "method": "POST",
    "bodySha256": "dac43af979bef45be6a2af92d6fda42ccb0dca77bad8abeac8456d1f7fa51661",
    "expectedSyntheticBasic": true,
    "expectedSyntheticCode": true
  },
  {
    "time": 1793141634.69,
    "path": "/github-index.jsonl",
    "method": "GET",
    "bodySha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
  },
  {
    "time": 1793141634.697,
    "path": "/v1/chat/completions",
    "method": "POST",
    "bodySha256": "3768063d48fe2eab3b63e402b208481462575119aac688615673797f906d5899",
    "retainedR2Consumed": true,
    "expectedSyntheticBearer": true
  },
  {
    "time": 1793141692.688,
    "path": "/oauth2/token",
    "method": "POST",
    "bodySha256": "dac43af979bef45be6a2af92d6fda42ccb0dca77bad8abeac8456d1f7fa51661",
    "expectedSyntheticBasic": true,
    "expectedSyntheticCode": true
  },
  {
    "time": 1793141692.701,
    "path": "/github-index.jsonl",
    "method": "GET",
    "bodySha256": "e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855"
  },
  {
    "time": 1793141692.709,
    "path": "/v1/chat/completions",
    "method": "POST",
    "bodySha256": "3768063d48fe2eab3b63e402b208481462575119aac688615673797f906d5899",
    "retainedR2Consumed": true,
    "expectedSyntheticBearer": true
  }
]
Owning regression red exit
{
  "returncode": 1,
  "elapsedSeconds": 6.104997959
}
Failing-before owning boundary (tail)
oidc token json parse ok: invalid JSON and token shapes return authErrorPage
<TASK>/installation/scripts/smoke.ts:1086
      throw new TypeError("TLS failure with synthetic-private-diagnostic");
            ^

TypeError: TLS failure with synthetic-private-diagnostic
    at <anonymous> (<TASK>/installation/scripts/smoke.ts:1086:13)
    at value (<TASK>/installation/scripts/smoke.ts:1612:14)
    at oidcCallback (<TASK>/installation/src/worker.ts:830:33)
    at async <anonymous> (<TASK>/installation/scripts/smoke.ts:1089:24)
    at async withMockNetwork (<TASK>/installation/scripts/smoke.ts:1630:5)
    at async smokeOidcTokenFetchTimeout (<TASK>/installation/scripts/smoke.ts:1083:3)
    at async <anonymous> (<TASK>/installation/scripts/smoke.ts:46:1)

Node.js v24.22.1
Passing-after checks
[
  {
    "label": "typecheck",
    "command": [
      "npm",
      "run",
      "typecheck"
    ],
    "exitCode": 0,
    "elapsedSeconds": 0.647
  },
  {
    "label": "lint",
    "command": [
      "npm",
      "run",
      "lint"
    ],
    "exitCode": 0,
    "elapsedSeconds": 0.296
  },
  {
    "label": "format",
    "command": [
      "npm",
      "run",
      "format:check"
    ],
    "exitCode": 0,
    "elapsedSeconds": 0.352
  },
  {
    "label": "smoke",
    "command": [
      "npm",
      "run",
      "smoke"
    ],
    "exitCode": 0,
    "elapsedSeconds": 19.381
  },
  {
    "label": "rebuilt",
    "command": [
      "node",
      "node_modules/wrangler/bin/wrangler.js",
      "deploy",
      "--dry-run",
      "--outdir",
      "<TASK>/rebuilt-worker"
    ],
    "exitCode": 0,
    "elapsedSeconds": 0.477
  }
]
Passing-after owning runtime smoke (tail)
docs corpus fetch failed {
  url: 'https://example.test/llms-full.txt',
  error: 'Unable to load https://example.test/llms-full.txt: 404'
}
docs corpus fetch failed {
  url: 'https://docs.openclaw.ai/llms-full.txt',
  error: 'Unable to load https://docs.openclaw.ai/llms-full.txt: 404'
}
docs corpus fetch failed {
  url: 'https://docs.openclaw.ai/.well-known/llms-full.txt',
  error: 'Unable to load https://docs.openclaw.ai/.well-known/llms-full.txt: 404'
}
retrieval body cap ok: corpus, JSONL, and rawUrl reads stay under caps
ask-molty smoke ok: runtime checks only
Exact cleanup independent readback
{
  "hostsRestoredExact": true,
  "hostsSha256": "c7dd0e2ed261ce76d76f852596c5b54026b9a894fa481381ffd399b556c0e2da",
  "hostsMtimeRestored": true,
  "fixtureGroupStopped": true,
  "priorTrustUntouched": true,
  "independentNoTaskListeners": true,
  "independentNoTaskProcesses": true,
  "hostReadbackSha256": "c7dd0e2ed261ce76d76f852596c5b54026b9a894fa481381ffd399b556c0e2da",
  "trustChangesMade": false,
  "privateKeysRemainGuestOnly": true
}

Independent complete-patch P0–P3 review returned scoped-clean; coordinator personally inspected the exact repair and owner/siblings. New meaningful regression fails before/passes after. Runtime smoke used existing skip-export mode; unchanged full57,209-file exporter proof is reused, not rerun. Prior same-native-engine14/14 chain proofs in both trust modes remain applicable because the installed binary hash matches exactly; see historical supplement and linked full controls.

Preserved limitations: no remote record decryption/server-side HTTP logging; generic Wrangler OIDC exception does not expose raw distrust reason. No production deployment, fleet delivery, other architecture or production model credentials. Initial fixture parsing/transport setup failures were corrected in the fixture, not product. An initially weak query included the retained marker; it is preserved but superseded by the actual same-installation predecessor→candidate replay without it. No new state/config substituted for recovery. Guest hosts bytes/inode/permissions/mtime restored and task processes stopped; no trust-store mutation or exported private keys/session values.

Final-head hosted CI and actual subsequent ClawSweeper review are separate outcomes; this comment does not claim them passed. No merge/release/deployment was performed.

@clawsweeper clawsweeper Bot added clawsweeper:intake:bug Preliminary submission classification; full source review pending. clawsweeper:intake:needs-repro Preliminary submission classification; full source review pending. proof: sufficient Contributor real behavior proof is sufficient. and removed status: 📣 needs proof The PR needs real behavior proof before ClawSweeper can clear the contributor ask. rating: 🦐 gold shrimp Decent PR readiness signal, but merge confidence is limited. labels Oct 27, 2026
@clawsweeper clawsweeper Bot added rating: 🦞 diamond lobster Very strong PR readiness with only minor maintainer review expected. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR. and removed merge-risk: 🚨 security-boundary 🚨 Merging this PR could weaken sandboxing, authorization, credentials, or sensitive data. clawsweeper:intake:bug Preliminary submission classification; full source review pending. clawsweeper:intake:needs-repro Preliminary submission classification; full source review pending. labels Oct 27, 2026
@steipete
steipete merged commit 9571e01 into main Oct 27, 2026
14 checks passed
@steipete
steipete deleted the security/workerd-denylist-20261026 branch October 27, 2026 23:04
steipete added a commit that referenced this pull request Oct 27, 2026
Add the Unreleased entry for #32's patched local workerd certificate rejection and retryable OIDC transport error, thanking @joshavant.

Validation: independent review through P3, whitespace check, and green exact-head CI/CodeQL.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

P2 Normal priority bug or improvement with limited blast radius. proof: sufficient Contributor real behavior proof is sufficient. rating: 🦞 diamond lobster Very strong PR readiness with only minor maintainer review expected. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants