Issues

• OutOfMemoryError

  microsoft/Tutel#329 · Filter by author squirrelfish opened on Jul 2, 2026
  10

• BUG: system.init_data_model_parallel() Prevents Nsight Systems (nsys) from Tracing GPU Hardware in Distributed Mode

  microsoft/Tutel#315 · Filter by author ziyuhuang123 opened on Nov 16, 2025
  1

• Tutel as an MoE backend in Nanotron for Qwen3-MoE 15B (128 experts, top-k=8)

  microsoft/Tutel#310 · Filter by author hahahaahaa opened on Sep 17, 2025
  3

• How to install tutel on Huawei Ascend

  microsoft/Tutel#306 · Filter by author mmzhou-cyber opened on Sep 2, 2025
  1

• How to set dp MoE

  microsoft/Tutel#304 · Filter by author zhaozheng09 opened on Aug 24, 2025
  1

• Login Open Web UI

  microsoft/Tutel#301 · Filter by author kimysub opened on Aug 8, 2025
  1

• Support for Blackwell?

  microsoft/Tutel#298 · Filter by author ec-jt opened on Jul 28, 2025
  20

• does it support Qwen3-235B-A22B-Instruct-2507-FP4

  microsoft/Tutel#297 · Filter by author squirrelfish opened on Jul 24, 2025
  8

• [Question] How can I set the max tokens with tutelgroup/deepseek-671b

  microsoft/Tutel#294 · Filter by author heraclex12 opened on Jul 15, 2025
  4

• About adapting Tutel in fairseq

  microsoft/Tutel#293 · Filter by author chaufanglin opened on Jul 15, 2025
  11

• where can I find the source code for specific mod file?

  microsoft/Tutel#290 · Filter by author xiaof99 opened on Jul 5, 2025
  3

• Examples integrated with Megatron-LM

  microsoft/Tutel#288 · Filter by author learner321 opened on Jun 20, 2025
  1

• [Question] How does the gate coordinate across ranks in expert parallelism?

  microsoft/Tutel#278 · Filter by author wangyaojlu opened on Apr 27, 2025
  3

• RuntimeError: (true) == (fp != nullptr) INTERNAL ASSERT FAILED at "/home/xxx/tutel/tutel/custom/custom_kernel.cpp":33, please report a bug to PyTorch. CHECK_EQ fails.

  microsoft/Tutel#271 · Filter by author numliu opened on Mar 27, 2025
  5

• custom_kernel.o: No such file or directory

  microsoft/Tutel#263 · Filter by author InfLoop111 opened on Mar 4, 2025
  1

• How to define a custom gate function in moe_layer

  microsoft/Tutel#256 · Filter by author lihuanihao opened on Jan 17, 2025
  2

• Inference code for 2 models evaluated in the paper

  microsoft/Tutel#255 · Filter by author bigwatergun opened on Dec 3, 2024
  3

• How expert parameters are distributed in the cluster when using the Tutel framework?

  microsoft/Tutel#251 · Filter by author luuck opened on Oct 30, 2024
  1

• How to load 32-experts Swin-transformer-moe on a 2-GPU machine.

  microsoft/Tutel#248 · Filter by author ywxsuperstar opened on Oct 27, 2024
  8

• How to convert checkpoint files that adapt to different distributed world sizes

  microsoft/Tutel#246 · Filter by author swjtulinxi opened on Aug 27, 2024
  1

• Question regarding the load importance loss calculation

  microsoft/Tutel#240 · Filter by author wangyirui opened on Jun 15, 2024
  1

• How about the cost of TUTEL features?

  microsoft/Tutel#239 · Filter by author fyang064 opened on Jun 6, 2024
  1

• How to use Megablocks in MoE training

  microsoft/Tutel#236 · Filter by author CSCYQJ opened on Jun 5, 2024
  1

• [Question] Comparison to FasterMoE

  microsoft/Tutel#232 · Filter by author Guodanding opened on Apr 17, 2024
  4

• Qs

  microsoft/Tutel#230 · Filter by author zws98 opened on Apr 16, 2024
  3