Issues

• Fix exact-fit cached-prefix admission stalling on a two-block target pool

  microsoft/onnxruntime-genai#2717 · Filter by author bmehta001 opened on Oct 12, 2026

• [Model Support] poolside Laguna 2.1 (LagunaForCausalLM / laguna)

  microsoft/onnxruntime-genai#2704 · Filter by author haozhiii opened on Oct 10, 2026

• [Model Support] StepFun Step-3.5-Flash (Step3p5ForCausalLM / step3p5)

  microsoft/onnxruntime-genai#2703 · Filter by author zoe226 opened on Oct 10, 2026

• [Model Support] NVIDIA Nemotron 3 Super 120B A12B (NemotronHForCausalLM / nemotron_h)

  microsoft/onnxruntime-genai#2702 · Filter by author zoe226 opened on Oct 10, 2026

• Track hybrid prefix-cache qualification and performance follow-ups after #2669

  microsoft/onnxruntime-genai#2698 · Filter by author bmehta001 opened on Oct 9, 2026
  6

  

• [Feature Request] Ability to call set_provider_option for non-decoder sessions

  microsoft/onnxruntime-genai#2693 · Filter by author RyanMetcalfeInt8 opened on Oct 8, 2026

• Allow hybrid prefixes to rebuild after their last checkpoint is evicted

  microsoft/onnxruntime-genai#2661 · Filter by author bmehta001 opened on Oct 1, 2026

• Design: Whisper-compatible timestamp decoding primitives for ORT GenAI

  microsoft/onnxruntime-genai#2659 · Filter by author joelst opened on Sep 30, 2026

• Allow comments in genai_config.json

  enhancement
  microsoft/onnxruntime-genai#2653 · Filter by author baijumeswani opened on Sep 30, 2026

• Engine::Run hangs on the second uncached request with DFlash2 + CUDA graphs + max_scheduled_tokens=512

  bugep:CUDA
  microsoft/onnxruntime-genai#2640 · Filter by author tianleiwu opened on Sep 28, 2026
  1

• Feature request: grammar fast-forward support in Engine

  microsoft/onnxruntime-genai#2636 · Filter by author ShahVandit opened on Sep 28, 2026
  1

• OnnxRuntimeGenAIChatClient duplicates the last token when JSON-schema guidance completes the generation

  microsoft/onnxruntime-genai#2633 · Filter by author juanluelguerre opened on Sep 26, 2026

• [Bug] Models with tied embeddings, such as LFM2, fail to load when built with is_symmetric=false

  microsoft/onnxruntime-genai#2632 · Filter by author ykhrustalev opened on Sep 26, 2026

• Support Qwen3.8-Flash-Next (Qwen4ExpForConditionalGeneration) in Model Builder

  microsoft/onnxruntime-genai#2598 · Filter by author zoe226 opened on Sep 20, 2026
  2

• PagedAttention: CUDA illegal memory access on a full-context request when max_batch_size>=2 and max_scheduled_tokens=2048

  ep:CUDA
  microsoft/onnxruntime-genai#2583 · Filter by author tianleiwu opened on Sep 16, 2026
  1

  

• Any plans for a WebAssembly build?

  microsoft/onnxruntime-genai#2536 · Filter by author dariyooo opened on Sep 5, 2026

• Eliminate per-step allocations from Engine-hosted MTP chaining

  microsoft/onnxruntime-genai#2517 · Filter by author tianleiwu opened on Sep 2, 2026
  

• [Feature request]: Add C++ multimodal benchmark (VLM perf testing without Python)

  platform:mobile
  microsoft/onnxruntime-genai#2373 · Filter by author amd-mingw opened on Aug 5, 2026
  

• [CUDA] Deterministic token-doubling / corrupted output on H200 (Hopper sm_90); CPU clean

  ep:CUDA
  microsoft/onnxruntime-genai#2291 · Filter by author justinchuby opened on Jul 12, 2026
  3

• Gemma-4 E2B multimodal (ORT-GenAI) eval vs HF PyTorch: quality-parity findings + per_layer_inputs release note

  microsoft/onnxruntime-genai#2288 · Filter by author justinchuby opened on Jul 9, 2026
  

• Running in nvidia agx orin jetpack7.2

  microsoft/onnxruntime-genai#2283 · Filter by author BenjeKi opened on Jul 9, 2026

• Gemma3ForCausalLM ONNX export produces garbage output for certain prompts (Persian, and any prompt triggering Gemma3's known "massive activation" pattern) - divergence traced to layer 0 (sliding-attention) output

  microsoft/onnxruntime-genai#2277 · Filter by author ehsanrs2 opened on Jul 7, 2026
  2

  

• Crash on Android: Ort::InitApi() aborts because libonnxruntime.so resolves to the Linux build, not the Android AAR

  platform:mobile
  microsoft/onnxruntime-genai#2243 · Filter by author ihassantariq opened on Jun 26, 2026

• Building with WinML on Windows

  platform:windows
  microsoft/onnxruntime-genai#2231 · Filter by author RyanMetcalfeInt8 opened on Jun 16, 2026
  6

• ModelBuilder support use_cache=False and hidden_states_layers

  microsoft/onnxruntime-genai#2217 · Filter by author huisunCompiler opened on Jun 11, 2026