FazBrowse GitHub Viewer | Trending |
URL:
| Home
Tools: [Download Repo ZIP]   [Original HTTPS Page]

multi-gpu-inference · GitHub Topics · GitHub

Explore Topics Trending Collections Events GitHub Sponsors
#

multi-gpu-inference

Star

Here are 7 public repositories matching this topic...

Language: All
Filter by language
All 7 Python 5 C++ 1 Dockerfile 1

inferflow / inferflow

Star 251

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

bloom falcon moe gemma mistral mixture-of-experts model-quantization multi-gpu-inference m2m100 llamacpp llm-inference internlm llama2 qwen baichuan2 mixtral phi-2 deepseek minicpm
  • Updated Mar 15, 2024
  • C++

JingyunLiang / PyTorch-Multi-GPU-Multi-Process-Testing

Star 24

A script for PyTorch multi-GPU multi-process testing

pytorch multi-gpu-testing multi-gpu-inference multi-gpu-multi-process
  • Updated Apr 29, 2024
  • Python

BY571 / DistRL-LLM

Star 22

Distributed Reinforcement Learning for LLM Fine-Tuning with multi-GPU utilization

reinforcement-learning pg r1 multi-gpu-training multi-gpu-inference llm llm-training llm-finetuning llm-fine-tuning grpo reinforcement-learning-fine-tuning
  • Updated Mar 12, 2025
  • Python

buqi-code / buqi-minimax-h3-multigpu

Star 12

MiniMax-H3 multi-GPU parallel inference for ComfyUI | 多卡并行加速节点:2-8 GPU Ulysses sequence parallel, bit-identical video+audio generation

h3 ulysses minimax multi-gpu multigpu video-generation image-to-video video-audio text-to-video multi-gpu-inference comfyui sequence-parallelism distributed-inference comfyui-custom-node minimax-h3
  • Updated Aug 14, 2026
  • Python

ibrar-syed / DL-Docker-pipeline

Star 2

A reproducible Docker-based pipeline for running machine learning experiments with GPU support. This repository provides pre-configured Docker images, environment files, and scripts for: - Setting up GPU-enabled containers - Running training and inference - Managing environments reproducibly

docker docker-image cuda devops-tools nvidia-docker containerization dockercompose dockercontainers containerized-dev-tools research-reproducibility environment-management multi-gpu-inference mlops-project distributed-training-of-high-efficient-models reproducible-ai cuda-reproducibility multi-gpu-containerization
  • Updated Nov 14, 2025
  • Dockerfile

ElenaViewSynthesis / Post-training-LLMs-N-RLVR

Star 0

Nemotron-3-Ultra-550B, Gemma4-31B on 8xA100 40GB GPUs as production AWS SageMaker endpoint with tensor-parallel inference, Gemma4-12B-it on Lambda GPU, Megatron-Bridge w vLLM or SGLang,

deployment tgi aws-sagemaker multi-gpu-inference tensor-parallelism endpoint-engineering llm-inference reasoning-models gemma-4
  • Updated Jul 29, 2026
  • Python

Git-er-done-son / Maya_llama_server_launcher

Star 0

Lightweight terminal launcher and auto-optimizer for llm models using llama.cpp with hardware detection, tensor sharding, benchmarks, presets, context tuning, and OpenAI-compatible serving.

cuda openapi tensor multi-gpu multi-gpus multi-gpu-inference tensor-parallelism llm llms llama-cpp local-llm llm-inference llm-tools local-ai llama-cpp-python gguf llm-agents openclaw tensor-parallel
  • Updated Aug 11, 2026
  • Python

Improve this page

Add a description, image, and links to the multi-gpu-inference topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the multi-gpu-inference topic, visit your repo's landing page and select "manage topics."

Learn more

Back | FazBrowse Home | New Git URL