Issues

• Increase in start-up time with the starting step number

  bugdatasetshpc_prep
  VLR-CVC/torchtitan#33 · Filter by author tomiock opened on Oct 4, 2025

• Crash with final checkpoint (finished the number of steps)

  bug
  VLR-CVC/torchtitan#32 · Filter by author tomiock opened on Oct 4, 2025

• apply_fsdp is not applied to the VLM projector

  bughpc_preptraining
  VLR-CVC/torchtitan#31 · Filter by author tomiock opened on Oct 3, 2025
  1

• See torch._dynamo.config.activation_memory_budget for AC

  hpc_preplow_prio
  VLR-CVC/torchtitan#28 · Filter by author tomiock opened on Sep 21, 2025

• See data prefetcher for image loading

  hpc_preplow_priotraining
  VLR-CVC/torchtitan#27 · Filter by author tomiock opened on Sep 21, 2025

• Log global batch size in tokens

  VLR-CVC/torchtitan#26 · Filter by author tomiock opened on Sep 17, 2025
  2

• Report non-embedding FLOPs

  question
  VLR-CVC/torchtitan#25 · Filter by author tomiock opened on Sep 15, 2025
  1

• Scaling up dataset management

  hpc_preplow_priotraining
  VLR-CVC/torchtitan#24 · Filter by author tomiock opened on Sep 13, 2025

• Separate metrics by module

  VLR-CVC/torchtitan#22 · Filter by author tomiock opened on Sep 12, 2025

• Multiple LR support

  hpc_preptraining
  Feature

  VLR-CVC/torchtitan#21 · Filter by author tomiock opened on Sep 12, 2025
  1

• W&B run name/project included in config

  good first issue
  VLR-CVC/torchtitan#18 · Filter by author tomiock opened on Sep 11, 2025

• Metric for "token seen" in VLMs

  low_prioquestiontraining
  VLR-CVC/torchtitan#17 · Filter by author tomiock opened on Sep 11, 2025
  1

• Log mesh

  good first issue
  VLR-CVC/torchtitan#16 · Filter by author tomiock opened on Sep 11, 2025

• Develop Tests

  low_prio
  Feature

  VLR-CVC/torchtitan#15 · Filter by author tomiock opened on Sep 11, 2025

• Experiment with hardcoded grad_acc

  low_prioquestiontraining
  VLR-CVC/torchtitan#14 · Filter by author tomiock opened on Sep 11, 2025

• Finetune Llama 3.2 1B and Evaluate

  training
  Task

  VLR-CVC/torchtitan#13 · Filter by author tomiock opened on Sep 10, 2025

• Final checkpoint saves everything

  low_prio
  VLR-CVC/torchtitan#12 · Filter by author tomiock opened on Sep 10, 2025

• Add validation metrics

  Feature

  VLR-CVC/torchtitan#10 · Filter by author tomiock opened on Sep 9, 2025

• Different dataset repo

  low_prio
  Feature

  VLR-CVC/torchtitan#8 · Filter by author tomiock opened on Sep 9, 2025

• More W&B logs

  low_prio
  Task

  VLR-CVC/torchtitan#5 · Filter by author tomiock opened on Sep 8, 2025

• Cluster Problems

  VLR-CVC/torchtitan#4 · Filter by author tomiock opened on Sep 8, 2025

• add flops for our GPUs

  Task

  VLR-CVC/torchtitan#3 · Filter by author tomiock opened on Sep 8, 2025
  4