Skip to content

@LMCache LMCache

All

    Repositories list

    25 repositories

    • LMCache

      Public
      LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
      fastamdcuda
      fastamdcudainferencepytorchspeedrocmkv-cachellmvllm
      Python
      •
      Apache License 2.0
      •2k•12k•233•524•Updated Sep 27, 2026Sep 27, 2026

    • kvcache-view

      Public
      KV cache visualizations
      HTML
      •
      Other
      •1•10•0•0•Updated Sep 21, 2026Sep 21, 2026

    • LMCache-Ascend

      Public
      LMCache-Ascend is a plugin for running LMCache on the Ascend NPU.
      Python
      •
      Apache License 2.0
      •59•89•34•12•Updated Sep 17, 2026Sep 17, 2026

    • lmcache_device_plugins

      Public
      Upstream-maintained home for vendor device plugins for LMCache
      acceleratordevice-pluginkv-cache
      acceleratordevice-pluginkv-cachelmcache
      Apache License 2.0
      •0•0•0•0•Updated Sep 4, 2026Sep 4, 2026

    • lmcache_l2_plugins

      Public
      Upstream-maintained home for vendor L2 adapter plugins for LMCache
      storage-pluginkv-cachel2-cache
      storage-pluginkv-cachel2-cachelmcache
      Apache License 2.0
      •0•1•0•0•Updated Sep 4, 2026Sep 4, 2026

    • lmcache-mini

      Public
      LMCache mini
      Python
      •0•5•0•0•Updated Aug 15, 2026Aug 15, 2026

    • vllm-cpu

      Public
      CPU only nightly vllm wheels
      Shell
      •0•0•0•1•Updated Aug 4, 2026Aug 4, 2026

    • opt-125m

      Public
      Other
      •0•0•0•0•Updated Jun 17, 2026Jun 17, 2026

    • lmcache_frontend

      Public
      the frontend of lmcache
      Python
      •6•18•5•0•Updated Apr 22, 2026Apr 22, 2026

    • lmcache-agent-trace

      Public
      Agent application/benchmark/workload traces should be placed here.
      Python
      •
      Apache License 2.0
      •6•17•0•1•Updated Apr 13, 2026Apr 13, 2026

    • LMBenchmark

      Public
      Systematic and comprehensive benchmarks for LLM systems.
      Python
      •
      Apache License 2.0
      •26•61•2•0•Updated Jan 28, 2026Jan 28, 2026

    • lmcache_redis

      Public
      zero copy python sdk
      Python
      •1•1•0•1•Updated Jan 21, 2026Jan 21, 2026

    • LMBench

      Public
      Modular Serving Engine x Workload Generator Benchmarking Tool
      Python
      •
      Apache License 2.0
      •3•11•5•0•Updated Nov 19, 2025Nov 19, 2025

    • lmcache.github.io

      Public
      LMCache official blog
      HTML
      •
      MIT License
      •6•1•0•0•Updated Oct 29, 2025Oct 29, 2025

    • demo-baseline-benchmarking

      Public
      JavaScript
      •0•1•0•0•Updated Sep 26, 2025Sep 26, 2025

    • lmcache-agentic

      Public
      Python
      •0•5•0•0•Updated Sep 8, 2025Sep 8, 2025

    • LMIgnite

      Public
      Shell
      •
      Apache License 2.0
      •5•28•0•0•Updated Jul 29, 2025Jul 29, 2025

    • hardware-diagnostic

      Public
      View Information about hardware
      Python
      •0•4•0•0•Updated Jul 25, 2025Jul 25, 2025

    • LMCache-Examples

      Public
      Jupyter Notebook
      •2•6•0•0•Updated Jul 9, 2025Jul 9, 2025

    • inference-engine-arena

      Public
      Postman & Chatbot Arena for inference benchmarking.
      Python
      •
      Apache License 2.0
      •1•1•0•0•Updated May 14, 2025May 14, 2025

    • demo

      Public
      Python
      •
      Apache License 2.0
      •11•33•5•1•Updated Apr 17, 2025Apr 17, 2025

    • lmcache-tests

      Public
      Python
      •
      Apache License 2.0
      •8•10•8•2•Updated Apr 2, 2025Apr 2, 2025

    • lmcache-vllm

      Public
      The driver for LMCache core to run in vLLM
      Python
      •
      Apache License 2.0
      •39•69•5•6•Updated Feb 4, 2025Feb 4, 2025

    • torchac_cuda

      Public
      Cuda
      •
      Apache License 2.0
      •7•5•2•4•Updated Jan 30, 2025Jan 30, 2025

    • lmcache-server

      Public
      Python
      •
      Apache License 2.0
      •6•7•0•0•Updated Sep 17, 2024Sep 17, 2024
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.