Skip to content

test(conformance): a case can have more than one valid output - #23

Merged
lejmr merged 1 commit into
agent/newline-bracefrom
agent/also-valid
Oct 19, 2026
Merged

lejmr merged 1 commit into
agent/newline-bracefrom
agent/also-valid

Conversation

@lejmr

@lejmr lejmr commented Oct 19, 2026

Copy link
Copy Markdown
Owner

Stacked on #21.

Where the spec allows several answers, a case lists the others in also_valid: an output matching expect or any of them passes, and "rejected" in the list lets an error pass. conformance/README.md describes it under the sidecar.

self-referential-examples/014 is the first such case. HOCON.md L866–890 allows both a and b to be 1, both 2, or an error, as long as they agree. It was an open question only because one expected tree could not say that:

"expect": {"a": 1, "b": 1},
"also_valid": [{"a": 2, "b": 2}, "rejected"]

🤖 Generated with Claude Code

https://claude.ai/code/session_01CbBo1aotFTDLY2gery7qYD

Where the spec allows several answers, `also_valid` lists the others and an
output matching `expect` or any of them passes; "rejected" in it lets an
error pass. self-referential-examples/014 is the first: a and b resolve in an
undefined order, so both 1, both 2 or an error are all allowed, as long as
they agree. It was an open question only because one expected tree could not
say that; every report gains it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01CbBo1aotFTDLY2gery7qYD
@lejmr
lejmr merged commit 34e49aa into agent/newline-brace Oct 19, 2026
42 checks passed
@lejmr
lejmr deleted the agent/also-valid branch October 19, 2026 16:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant