Repo

TalkLikeYou-Streaming-RealTime-Demo

Streams talking-head animation in a browser from audio, mic, video dubbing, or chat. Reuses cached avatar features and supports preset speaking habits.

GitHub ↗Oct 4, 2026Paper ↗

  • multimodal
  • talking-head
  • real-time-inference
  • video-dubbing

What it is

Browser demo for real-time talking-head generation from audio, video dubbing, or chat. Streams avatar animation at 30+ FPS on an RTX 3090 using under 12 GB VRAM. Generate and stream talking-head video in the browser from uploaded audio, live mic, source video, or chat responses, with cached avatar registration and preset speaking styles.

Key results

  • 30+ FPS on RTX 3090 with under 12 GB GPU memory
  • Video dubbing keeps source pose and timing; no motion-reference file needed
  • Chat mode streams reply text, TTS audio, and avatar frames incrementally

Shows that browser-based, real-time talking-head generation can unify audio, dubbing, and chat-driven animation in one streaming pipeline.

One useful ML email a week.

Worth your time, not all of your time.

We track new ML work across papers, code, and data, then keep only the pieces worth a closer look. Selected, not collected.

Papers.Data.Code

The Weekly ML Signal

Selected, not collected.

One useful ML email a week: the papers, repos and datasets worth your attention.

Worth your time, not all of your time.