Rhubarb Lip Sync is a command-line tool that automatically creates 2D mouth animation from voice recordings. You can use it for characters in computer games, in animated cartoons, or in any other project that requires animating mouths based on existing recordings.

cli command-line animation game-development lip-sync

Updated Jun 16, 2026
C++

hecomi / uLipSync

Star

MFCC-based LipSync plug-in for Unity using Job System and Burst Compiler

webgl timeline unity microphone vrm lip-sync job-system burst-compiler

Updated Jan 6, 2026
C#

Lynpoint / CyberVerse

Star

Self hosted, real-time digital human agent platform. Build voice-first AI agents with WebRTC, persona memory, tools, RAG, and optional digital-human video.

streaming webrtc lip-sync digital-life voice-assistant ai-agents talking-head voice-agent jarvis-assistant digital-human talking-avatar ai-companion

Updated Aug 5, 2026
Python

met4citizen / TalkingHead

Star

Talking Head (3D): A JavaScript class for real-time lip-sync using full-body 3D avatars.

text-to-speech lip-sync talking-head 3d-avatar talking-avatar

Updated Jun 2, 2026
JavaScript

numz / sd-wav2lip-uhq

Sponsor

Star

Wav2Lip UHQ extension for Automatic1111

faceswap lip-sync image-animation lipsync face-swapping deep-fakes deep-fake talking-head wav2lip talking-face talking-face-generation audio-driven-talking-face stable-diffusion-webui stable-diffusion-web-ui stable-diffusion-webui-plugin meta-human-creator

Updated Jun 14, 2024
Python

Henry-23 / VideoChat

Star

实时交互数字人，可自定义形象与音色，支持音色克隆，对话延迟低至3s。Real-time voice interactive digital human, customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

streaming real-time end-to-end tts lip-sync dialogue-systems asr talking-head digital-human multimodal-large-language-models musetalk gradio-python-app

Updated Dec 18, 2025
Python

timoncool / videosos

Star

AI video production in the browser — text-to-video, image-to-video, lip sync, 100+ models. Google Veo 3.1, FLUX, Gemini, Imagen 4. Free, open-source, private.

flux open-source nextjs lip-sync video-editor browser-based image-to-video remotion text-to-video ai-video fal-ai runware google-veo

Updated Aug 17, 2026
TypeScript

wladradchenko / wunjo.wladradchenko.ru

Star

Wunjo CE: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.

free face-swap photo-editing video-editing lip-sync public-api remover restyle video-generation deepfake face-animation diffusion-models remove-background voice-clone controlnet segment-anything txt2video wunjo img2video

Updated Aug 19, 2026
JavaScript

jdh-algo / JoyVASA

Star

Diffusion-based Portrait and Animal Animation

lip-sync image-animation talking-head audio-driven-talking-face generative-ai portrait-anination

Updated Apr 16, 2026
Python

facefusion / facefusion-docker

Star

Industry leading face manipulation platform

docker ai faceswap face-swap lip-sync lipsync deepfake deep-fake

Updated Aug 5, 2026

Markfryazino / wav2lip-hq

Star

Extension of Wav2Lip repository for processing high-quality videos.

deep-learning lip-sync

Updated Feb 7, 2023
Python

deepbrainai-research / float

Star

[ICCV 2025] Official Pytorch Implementation of FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portrait.

lip-sync video-generation audio-driven-portrait-animations

Updated Nov 10, 2025
Python

asanchezyali / talking-avatar-with-ai

Star

This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

lip-sync whisper visemes lipsync rhubarb-lip-sync openai-api digital-human llms ai-avatars elevenlabs

Updated May 11, 2026
JavaScript

PunithVT / ai-avatar-system

Star

🎭 AI Avatar / digital human platform — upload a photo, clone a voice, talk to any face in real time with lip-sync video. Open-source, self-hosted. Claude · Whisper · Chatterbox · MuseTalk.