Skip to content

@LMCache LMCache

Change the repository type filter

All

    Repositories list

    20 repositories

    • LMCache

      Public
      Supercharge Your LLM with the Fastest KV Cache Layer
      fastamdcudainferencepytorchspeedrocmkv-cachellmvllm
      Python
      •
      Apache License 2.0
      •888•6.8k•138•118•Updated Feb 5, 2026Feb 5, 2026

    • LMCache-Ascend

      Public
      LMCache on Ascend
      Python
      •
      Apache License 2.0
      •21•48•36•2•Updated Feb 5, 2026Feb 5, 2026

    • lmcache-agent-trace

      Public
      Agent application/benchmark/workload traces should be placed here.
      Python
      •
      Apache License 2.0
      •3•3•0•2•Updated Feb 3, 2026Feb 3, 2026

    • LMBenchmark

      Public
      Systematic and comprehensive benchmarks for LLM systems.
      Python
      •
      Apache License 2.0
      •22•50•2•0•Updated Jan 28, 2026Jan 28, 2026

    • lmcache_redis

      Public
      zero copy python sdk
      Python
      •1•1•0•1•Updated Jan 21, 2026Jan 21, 2026

    • kvcache-view

      Public
      KV cache visualizations
      JavaScript
      •
      Other
      •0•6•0•0•Updated Jan 21, 2026Jan 21, 2026

    • lmcache_frontend

      Public
      the frontend of lmcache
      Python
      •7•18•5•1•Updated Dec 31, 2025Dec 31, 2025

    • LMBench

      Public
      Modular Serving Engine x Workload Generator Benchmarking Tool
      Python
      •
      Apache License 2.0
      •3•8•5•0•Updated Nov 19, 2025Nov 19, 2025

    • lmcache.github.io

      Public
      LMCache official blog
      HTML
      •
      MIT License
      •6•1•0•0•Updated Oct 29, 2025Oct 29, 2025

    • demo-baseline-benchmarking

      Public
      JavaScript
      •0•1•0•0•Updated Sep 26, 2025Sep 26, 2025

    • lmcache-agentic

      Public
      Python
      •1•4•0•0•Updated Sep 8, 2025Sep 8, 2025

    • LMIgnite

      Public
      Shell
      •
      Apache License 2.0
      •4•28•0•0•Updated Jul 29, 2025Jul 29, 2025

    • hardware-diagnostic

      Public
      View Information about hardware
      Python
      •0•4•0•0•Updated Jul 25, 2025Jul 25, 2025

    • LMCache-Examples

      Public
      Jupyter Notebook
      •1•7•0•0•Updated Jul 9, 2025Jul 9, 2025

    • inference-engine-arena

      Public
      Postman & Chatbot Arena for inference benchmarking.
      Python
      •
      Apache License 2.0
      •0•1•0•0•Updated May 14, 2025May 14, 2025

    • demo

      Public
      Python
      •
      Apache License 2.0
      •12•27•5•1•Updated Apr 17, 2025Apr 17, 2025

    • lmcache-tests

      Public
      Python
      •
      Apache License 2.0
      •8•9•8•2•Updated Apr 2, 2025Apr 2, 2025

    • lmcache-vllm

      Public
      The driver for LMCache core to run in vLLM
      Python
      •
      Apache License 2.0
      •32•60•5•6•Updated Feb 4, 2025Feb 4, 2025

    • torchac_cuda

      Public
      Cuda
      •
      Apache License 2.0
      •6•4•2•4•Updated Jan 30, 2025Jan 30, 2025

    • lmcache-server

      Public
      Python
      •
      Apache License 2.0
      •4•6•0•0•Updated Sep 17, 2024Sep 17, 2024