Skip to content
View JakPot42's full-sized avatar

Block or report JakPot42

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
JakPot42/README.md

Jak Potvin

I build checks that sit between an automated system and a consequential action. One rule runs through all of it:

Nothing automated should file, deny or pay unless the facts are in the source and the rule is the one in force.

If either part fails, the action stops, and the stop says what is missing or what is present but out of date. I'm starting with US public benefits, where the rules are written down and a maintained rules engine already exists.

Everything below runs on public or synthetic data. None of it is in production use, and none of it is peer-reviewed.

I design these projects and direct their build. The code is written with Claude Code; I review the specifications, the results and the READMEs.

Projects

  • asof-gate (demonstration): stops a SNAP case or a tax return when a fact does not trace to its documents or a legal figure is not in force.
  • redtape (published, headline result retracted): evaluation environments that score whether a model knows when it cannot answer a benefits question from the facts it was given.
  • snap-qc-analysis (finished analysis): in USDA's FY 2024 SNAP quality-control file, 15 to 36 percent of payment error dollars are errors such a check could catch in principle.
  • logchain (working tool): a log journal in Rust in which a later edit to any entry is detectable.
  • sentinel-ledger (first build on a simulated machine; not a safety system): signs a record of each machine command, and the actuator's gate passes only commands inside a signed record.
  • filing-check (working tool, on public data): reports where NHTSA vehicle-incident filings and independent public records about the same event differ, never a verdict about a company.

Each repository states its licence.

Reports to other projects

Places where I found a correct answer graded as wrong, or a rule encoded differently from the law, and one place where I was the one who was wrong.

  • prime-envs #825 and #826. In the livecodebench environment, a correct solution is recorded as failing when a test input is larger than the command-line limit, and verdicts change with the number of cores on the grading machine. Both are open.
  • human-eval PR #23, comment. The tests for HumanEval problem 116 pass in negative numbers, which its own specification excludes.
  • PolicyEngine #9374. I reported two places where the rules engine differed from the law. Half of that report was my mistake: my probe had hardcoded one state. I retracted that half on the issue. The other half stands, and a fix is open as a draft pull request, #9610.

Earlier work

Between June and August 2026 I built more than eighty smaller tools, mostly defense and national-security demonstrations. The rule above came out of them. Glassbox is the library and specification I distilled from that work. Most of those repositories have no licence. The index is in EARLIER_WORK.md.

Pinned Loading

  1. asof-gate asof-gate Public

    A check that stops an automated benefits or tax action unless each fact traces to the source documents and each legal figure is the one in force on the decision date. Demonstration on synthetic SNA…

    Python

  2. redtape redtape Public

    Evaluation environments for US public-benefits work: does a model know when a benefits question cannot be answered from the facts it was given? Answer keys are computed by PolicyEngine when the tas…

    Python 1 1

  3. snap-qc-analysis snap-qc-analysis Public

    Pre-registered analysis of USDA SNAP quality-control data: what share of payment error dollars could a deterministic check catch?

    Python

  4. logchain logchain Public

    Tamper-evident log journal in Rust. Each entry is hashed into an RFC 6962 Merkle tree, so a later edit to any entry is detectable. A second verifier in Python, written from the format specification…

    Rust

  5. sentinel-ledger sentinel-ledger Public

    A recorder for a machine's command path, an actuator-side gate, a witness and an independent verifier, producing tamper-evident command records. A first build on a simulated machine. Not certified …

    Python 1

  6. filing-check filing-check Public

    Checkable differences between public vehicle-incident filings and independent public records, never a verdict about a company. Structural framing guard and a match rate that cannot be reported with…

    Python