Popular repositories Loading

1. vllm-fork vllm-fork Public

   Forked from HabanaAI/vllm-fork

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. awesome-neovim awesome-neovim Public

   Forked from bernardassan/awesome-neovim

   Awesome Configurations for C/C++, Zig, Rust, Python, Shell, Web and Lua development in NeoVim

   Lua

3. GenAIExamples GenAIExamples Public

   Forked from opea-project/GenAIExamples

   Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open Platform for Enterprise AI (OPEA) project.

   Shell

4. inference inference Public

   Forked from v-shobhit/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python

5. RULER RULER Public

   Forked from NVIDIA/RULER

   This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

   Python

6. llm-compressor llm-compressor Public

   Forked from vllm-project/llm-compressor

   Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

   Python