Skip to content

Add random_labels negative control - #22

Merged
rcannood merged 5 commits into
mainfrom
feat/random-labels
Aug 18, 2026
Merged

Add random_labels negative control#22
rcannood merged 5 commits into
mainfrom
feat/random-labels

Conversation

@rcannood

Copy link
Copy Markdown
Member

Describe your changes

  • Add a random_labels negative control (predicts labels by sampling from the training label distribution) so the template demonstrates both sides of the control bracket, and register it in the run_benchmark workflow.
  • process_dataset: --seed only seeded random, not np.random, so the random split method was not reproducible. Also treat seed 0 as a valid seed.
  • accuracy: write metric_values as a list to match metric_ids, as the comment above it already suggested.

All three components pass viash test.

Checklist before requesting a review

  • I have performed a self-review of my code

  • Check the correct box. Does this PR contain:

    • Breaking changes
    • New functionality
    • Major changes
    • Minor changes
    • Bug fixes
  • Proposed changes are described in the CHANGELOG.md

  • CI Tests succeed and look good!

@rcannood
rcannood merged commit fe6dd11 into main Aug 18, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant