Explore Topics Trending Collections Events GitHub Sponsors

kvcached

Here are 2 public repositories matching this topic...

Language: All

ovg-project / kvcached

Virtualized Elastic KV Cache for Dynamic GPU Sharing and Beyond

serverless inference-engine llm llm-serving vllm llm-inference ollama llm-framework sglang kvcache gpu-sharing kvcached gpu-mutiplexing kvcache-optimization elastic-kvcache online-offline-coserve

Updated Aug 23, 2026
Python

rh-aiservices-bu / sardeenz

Star

Sardeenz is a proof-of-concept application that allows you to load more than one model on a given GPU. It allows you to add more and more models onto a GPU, until it is fully utilized.

vllm kvcache kvcached

Updated Aug 14, 2026
TypeScript

Improve this page

Add a description, image, and links to the kvcached topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the kvcached topic, visit your repo's landing page and select "manage topics."