Issues

• 使用FMOE设置了随机种子较难复现实验结果

  laekov/fastmoe#217 · Filter by author sky836 opened on Jul 12, 2025
  1

• 有支持华为昇腾芯片的计划吗

  laekov/fastmoe#216 · Filter by author guoqijun opened on Apr 2, 2025
  1

• Detailed documentation about model parallelism

  laekov/fastmoe#214 · Filter by author ZSL98 opened on Oct 28, 2024

• how to run transformer-xl with parallel experts with single gpu?

  laekov/fastmoe#211 · Filter by author HudashiNeo opened on Sep 10, 2024
  6

• Do We support DeepSpeed training? Thanks.

  laekov/fastmoe#210 · Filter by author lzl-mt opened on Sep 9, 2024
  1

• 前向传播返回值缺少bal_loss

  laekov/fastmoe#209 · Filter by author tisgotos opened on Sep 7, 2024
  2

• CUDA memory increases after each loss.backward()

  laekov/fastmoe#201 · Filter by author sreetamasarkar opened on Mar 22, 2024
  6

• A bug in switch_gate

  laekov/fastmoe#199 · Filter by author Heihaierr opened on Mar 7, 2024
  6

• About switch_gate

  laekov/fastmoe#198 · Filter by author Heihaierr opened on Mar 6, 2024
  1

• multi-node problem

  laekov/fastmoe#197 · Filter by author Qianshaowei opened on Mar 4, 2024
  1

• Example to run Megatron

  laekov/fastmoe#196 · Filter by author Juanhui28 opened on Feb 26, 2024
  3

• [BUG] AttributeError: module 'fmoe_cuda' has no attribute 'assign_pos_'

  laekov/fastmoe#195 · Filter by author pangsg opened on Feb 17, 2024
  3

• fastmoe是否支持微调，page-attention，flasahattention和kvcache，混合精度等

  laekov/fastmoe#192 · Filter by author PowerDispatch opened on Feb 5, 2024
  4

• 请问fastmoe能被集成到VLLM里吗

  laekov/fastmoe#191 · Filter by author pangsg opened on Feb 4, 2024
  4

• 我们有线上沟通的群吗

  laekov/fastmoe#189 · Filter by author PowerDispatch opened on Feb 4, 2024
  1

• 开启Smart schedule时报错Segmentation fault

  bug
  laekov/fastmoe#184 · Filter by author Xingzhi107 opened on Dec 30, 2023
  8

  

• pytest error

  laekov/fastmoe#183 · Filter by author R-QinQ opened on Dec 29, 2023
  3

• ImportError: cannot import name 'get_args' from 'megatron'

  laekov/fastmoe#181 · Filter by author peter-fei opened on Dec 14, 2023
  5

• During inference, the output of noisy gate is nan.

  laekov/fastmoe#180 · Filter by author zqhang opened on Dec 3, 2023
  5

• ModuleNotFoundError: No module named 'fmoe_cuda'

  laekov/fastmoe#177 · Filter by author Taskii-Lei opened on Nov 6, 2023
  3

• how to use balance loss?

  laekov/fastmoe#176 · Filter by author Heihaierr opened on Oct 26, 2023
  1

• No overlapping observed when enabling Smart Scheduling

  laekov/fastmoe#168 · Filter by author chenyu-jiang opened on Aug 4, 2023
  8

  

• Only 204 unique tokens (vocabulary size) in enwik8 (transformer-XL example)

  laekov/fastmoe#163 · Filter by author chenwydj opened on Jul 7, 2023
  3

• Mixture of Expert in Vison Task (Segmentation )

  laekov/fastmoe#161 · Filter by author deep-matter opened on Jun 7, 2023
  2

• Adding Expert Prototyping to FastMoE

  enhancement
  laekov/fastmoe#69 · Filter by author JustinLin610 opened on Aug 23, 2021
  1