Issues

• Mask while decoding in _sample_top_p

  hkproj/pytorch-llama#16 · Filter by author ovshake opened on Jan 26, 2025

• causal attention mask

  hkproj/pytorch-llama#15 · Filter by author itera-del opened on Dec 23, 2024

• Some questions about your source code

  hkproj/pytorch-llama#14 · Filter by author shawnnjupt opened on Dec 13, 2024

• No need to use forward method?

  hkproj/pytorch-llama#11 · Filter by author nkkbr opened on Jun 18, 2024

• Can I turn off KV cache?

  hkproj/pytorch-llama#10 · Filter by author purejomo opened on May 25, 2024
  2

• Error in rotary matrix multiplication formula of slide 25

  hkproj/pytorch-llama#9 · Filter by author sanzgadea opened on Apr 23, 2024

• what is minimal computer can be used for only inference

  hkproj/pytorch-llama#6 · Filter by author Sandy4321 opened on Jan 22, 2024

• will it work on windows OS with only CPU?

  hkproj/pytorch-llama#5 · Filter by author Sandy4321 opened on Jan 21, 2024