Popular repositories Loading

1. prometheus-simulator prometheus-simulator Public

   Python prometheus simulator

2. workload-variant-autoscaler workload-variant-autoscaler Public

   Forked from llm-d/llm-d-autoscaling

   Variant optimization autoscaler for distributed inference workloads

   Go

3. llm-scaling-manager llm-scaling-manager Public

   Go 2

4. llm-d-fast-model-actuation llm-d-fast-model-actuation Public

   Forked from llm-d-incubation/llm-d-fast-model-actuation

   Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping

   Go

5. vllm-conf vllm-conf Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. llm-d llm-d Public

   Forked from llm-d/llm-d

   State of the art inference performance with modern accelerators on Kubernetes

   Python