Popular repositories Loading

1. AITemplate AITemplate Public

   Forked from ROCm/AITemplate

   AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

   Python

2. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

3. benchmark benchmark Public

   Forked from pytorch/benchmark

   TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

   Python

4. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

5. v-shobhit--inference v-shobhit--inference Public

   Forked from v-shobhit/inference

   Reference implementations of MLPerf™ inference benchmarks

   Python

6. endpoints endpoints Public

   Forked from mlcommons/endpoints

   MLCommons Inference Endpoints repository

   Python