Issues

• [Bug] KDA prefill dispatch sends packed one-token batches with FP32 state into BF16-only FlashInfer recurrence

  sgl-project/sglang#43615 · Filter by author StarDuster opened on Oct 10, 2026
  1

• Opt-in request security middleware for the HTTP server (rate limiting, IP lists, payload screening)

  sgl-project/sglang#43609 · Filter by author rennf93 opened on Oct 10, 2026

• [Bug] PP>1 (GLM-5.3/DSA): intermittent runtime crash in RotaryEmbedding.forward_cuda — query.view(positions.size(0), -1, head_size) with a shorter positions tensor

  sgl-project/sglang#43588 · Filter by author yy-fighting opened on Oct 10, 2026

• [Bug] PP>1 + DSA skip-topk stage boundary: 'OwedOutput' object has no attribute 'shape' during decode CUDA-graph capture

  sgl-project/sglang#43580 · Filter by author yy-fighting opened on Oct 10, 2026

• [PD] Runtime role switch: engine launched with --disaggregation-mode decode crashes with illegal memory access after decode -> prefill -> decode

  sgl-project/sglang#43557 · Filter by author athrael-soju opened on Oct 10, 2026

• [Bug] OTEL to Perfetto converter rejects whitespace-prefixed arrays and SMG spans

  sgl-project/sglang#43540 · Filter by author PuppyLu opened on Oct 10, 2026

• [AMD][Bug] Accuracy issue with gfx942 block-FP8 linear AITER CK blockscale GEMM

  sgl-project/sglang#43526 · Filter by author HaiShaw opened on Oct 10, 2026
  3

• [Bug] DeepSeekV3Detector streaming drops the first tool call when two complete calls arrive in one increment

  sgl-project/sglang#43523 · Filter by author chrikrah opened on Oct 10, 2026
  2

• [Feature] π0.5 completion-boundary batching for heterogeneous denoising budgets

  sgl-project/sglang#43522 · Filter by author dadiaokua opened on Oct 10, 2026

• [Roadmap][NPU][Multimodal] Model support and serving features (2026 Q4)

  sgl-project/sglang#43519 · Filter by author cx22757 opened on Oct 10, 2026

• [Bug] DFlash + Qwen3.8-27B: speculative decoding accept rate drops to 0 during serving

  sgl-project/sglang#43514 · Filter by author enternal111 opened on Oct 10, 2026

• [Bug] [diffusion] FluxAdapter crashes on latent sizes not divisible by patch size

  sgl-project/sglang#43489 · Filter by author OnePunchMonk opened on Oct 10, 2026
  1

• [Bug] [diffusion] FluxAdapter silently drops Kontext ref_latents and ControlNet control

  sgl-project/sglang#43488 · Filter by author OnePunchMonk opened on Oct 10, 2026
  1

• [Bug] DSV4.1 Flash + DSPARK: CUDA caching allocator exhausts GPU memory under sustained max-batch decode (OOM crash every 15–25 min), KV pool only 29% used

  sgl-project/sglang#43486 · Filter by author elain opened on Oct 10, 2026

• [Bug] Gemma4ForCausalLM loader ignores global_head_dim for full-attention layers — text-only Gemma‑4 A4B checkpoints fail to load (same weights load fine as Gemma4ForConditionalGeneration)

  sgl-project/sglang#43434 · Filter by author samidh opened on Oct 9, 2026

• [Feature] Add native SmolLM3 support

  sgl-project/sglang#43428 · Filter by author RachitSharma2001 opened on Oct 9, 2026

• Batch image outputs in server mode

  sgl-project/sglang#43418 · Filter by author OnePunchMonk opened on Oct 9, 2026
  1

• [Bug] --enable-deterministic-inference does not make hybrid Mamba2 models (granite-4.0-h) batch-invariant

  sgl-project/sglang#43413 · Filter by author Yunzez opened on Oct 9, 2026
  2

• Speculative decoding crashes server on first non-greedy request: flashinfer verify-sampling op JIT fails (bundled cccl vs pip cu13 toolkit) and kills the process tree

  sgl-project/sglang#43412 · Filter by author santanu20 opened on Oct 9, 2026

• [RFC] Native worker batching for ComfyUI diffusion requests

  sgl-project/sglang#43411 · Filter by author OnePunchMonk opened on Oct 9, 2026

• [Bug] [diffusion] /v1/images/edits accepts a mask upload but silently ignores it

  sgl-project/sglang#43409 · Filter by author Shreyasg13 opened on Oct 9, 2026

• [Bug] CUDA VMM multimodal transport slice leaks when a request is aborted while still queued

  sgl-project/sglang#43402 · Filter by author StarDuster opened on Oct 9, 2026
  2

• ComfyUI-mode cannot load FLUX.1-schnell single-file checkpoints

  sgl-project/sglang#43395 · Filter by author OnePunchMonk opened on Oct 9, 2026
  1

• [Feature] [Diffusion] Support LingBot-VLA 2.0

  sgl-project/sglang#43379 · Filter by author 0xtoward opened on Oct 9, 2026
  1

• [Bug] runai_streamer: CPU-path tensors alias the streamer's staging buffers, so loaders that hold a tensor read overwritten bytes

  sgl-project/sglang#43352 · Filter by author fergusfinn opened on Oct 9, 2026