Issues

• ci: add automated test coverage for llmapi (PyTorch backend) path

  triton-inference-server/tensorrtllm_backend#854 · Filter by author faradawn opened on Apr 16, 2026

• Qwen2-VL SFT with extended vocab generates only vocab_size-1 (168063) tokens in TensorRT-LLM 0.17, while HF works fine

  bug
  triton-inference-server/tensorrtllm_backend#849 · Filter by author lhh0916 opened on Mar 4, 2026

• Question to optimize build

  triton-inference-server/tensorrtllm_backend#843 · Filter by author geraldstanje opened on Feb 12, 2026

• build error

  triton-inference-server/tensorrtllm_backend#810 · Filter by author geraldstanje1 opened on Oct 16, 2025
  5

• Batching documentation confusing - can you update the docs of main repository please

  bug
  triton-inference-server/tensorrtllm_backend#809 · Filter by author protonicage opened on Oct 10, 2025

• Is it possible to obtain scores from the TRT-LLM model?

  triton-inference-server/tensorrtllm_backend#806 · Filter by author otvall opened on Oct 2, 2025

• Whisper one-shot enc+dec path treats mel frames (3000) as “encoder length”, causing length assertion at 1500 and internal broadcast shape errors

  bug
  triton-inference-server/tensorrtllm_backend#804 · Filter by author YuBeomGon opened on Sep 29, 2025
  1

• LoRa weights not applied without warnings/errors when mismatch in type

  bug
  triton-inference-server/tensorrtllm_backend#791 · Filter by author rahchuenmonroe opened on Aug 21, 2025

• Encoder-Decoder example doesn't actually use encoder?

  triton-inference-server/tensorrtllm_backend#786 · Filter by author srinath2022 opened on Aug 8, 2025

• Quick start has outdated instructions

  triton-inference-server/tensorrtllm_backend#770 · Filter by author juanpabloguerra16 opened on Jun 30, 2025

• Question about increased Docker image size in recent version

  triton-inference-server/tensorrtllm_backend#754 · Filter by author fclearner opened on May 28, 2025
  1

• lora_config shape mismatch when using converted LoRA at runtime

  bug
  triton-inference-server/tensorrtllm_backend#750 · Filter by author paulhendricks opened on May 16, 2025

• How can I deploy qwen2.5vl using tritonserver?

  triton-inference-server/tensorrtllm_backend#747 · Filter by author HPUedCSLearner opened on May 8, 2025
  2

• max request capped at 228 while load testing using locust

  triton-inference-server/tensorrtllm_backend#740 · Filter by author adityarajsahu opened on Apr 23, 2025

• no /app folder in container nvcr.io/nvidia/tritonserver:24.12-trtllm-python-py3

  bug
  triton-inference-server/tensorrtllm_backend#739 · Filter by author smennes opened on Apr 22, 2025

• Vision Preprocessor Not Initialized for LLaVA in Triton Workflow

  triton-inference-server/tensorrtllm_backend#737 · Filter by author oschleic opened on Apr 18, 2025

• Failed to build TensorRT-LLM backend for Triton server.

  triton-inference-server/tensorrtllm_backend#728 · Filter by author sdecoder opened on Mar 24, 2025
  1

• tensorrtllm_backend doesn't work with remote repos

  bug
  triton-inference-server/tensorrtllm_backend#727 · Filter by author ShuaiShao93 opened on Mar 19, 2025
  1

• Failed to launch triton server with Qwen2-VL

  triton-inference-server/tensorrtllm_backend#724 · Filter by author shjas94 opened on Mar 16, 2025

• build.sh not able to run due to python dependency issues

  triton-inference-server/tensorrtllm_backend#723 · Filter by author BenjaminBraunDev opened on Mar 11, 2025

• Fail to test DraftTarget model with triton server tensorrtllm backend

  bug
  triton-inference-server/tensorrtllm_backend#720 · Filter by author gloritygithub11 opened on Mar 10, 2025
  2

• I want the dll version for Windows of tensorrt_llmbackend

  triton-inference-server/tensorrtllm_backend#719 · Filter by author dhkdnduq opened on Mar 8, 2025

• How to load lora weights when launching tritonserver

  triton-inference-server/tensorrtllm_backend#718 · Filter by author shinesmilels opened on Mar 7, 2025
  5

• TensorRT-LLM Backend with multiple LLMs (not to be confused with multi-model)

  triton-inference-server/tensorrtllm_backend#714 · Filter by author dduck999 opened on Feb 27, 2025
  5

• Missing lookAheadRuntimeConfig in Triton Server with TensorRT-LLM backend HTTP Request

  bug
  triton-inference-server/tensorrtllm_backend#711 · Filter by author shaylapid opened on Feb 18, 2025
  2