Skip to content

Preserve counters when replaying stateless iterable checkpoints - #1568

Open
AryanRG wants to merge 1 commit into
meta-pytorch:mainfrom
AryanRG:fix/repeated-stateless-restore
Open

AryanRG wants to merge 1 commit into
meta-pytorch:mainfrom
AryanRG:fix/repeated-stateless-restore

Conversation

@AryanRG

@AryanRG AryanRG commented Oct 26, 2026

Copy link
Copy Markdown

Fixes #1567

Changes

Preserve loader counters while replaying a stateless iterable checkpoint with num_workers=0. Previously, restoring, saving another checkpoint and restoring again skipped unconsumed samples.

Added regressions for repeated restores, batching, drop_last and consumption between checkpoints. Focused restore, sampler and incremental-state tests pass.

@meta-cla meta-cla Bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Oct 26, 2026

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Stateless iterable checkpoints skip samples after a second StatefulDataLoader restore

1 participant