WebRTC avatar container
The video layer accepts a HeyGen Interactive Avatar stream or a Tavus CVI conversation room. Session tokens are minted server-side so keys never reach the browser.
Live AI session
Open the chord libraryFaceTime your Iron Man coach
Hop on the call, play something, and the HUD does the rest — chord shapes appear in your field of view and the coach hears every note you strum.
Connecting…
Now playing
Em
Minor0 2 2 0 0 0
Live audio feedbackLISTENING
–
Strum whenever you're ready…
EBG
What's running under the hood
Everything on this screen is wired for a live interactive avatar — drop in a provider key and the same layout streams a real person-like coach.
AR-ready HUD canvas
A transparent canvas sits over the video and renders the 3D fretboard. It follows a swappable renderer interface, so Three.js or MindAR.js can take over without touching the UI.
On-device pitch detection
Autocorrelation runs on the raw mic signal at 30fps to name the note you played and measure how sharp or flat it is. Your audio never leaves the device.
Synthesised chord playback
Every demo strum is generated with a Karplus-Strong string model, so 240 chords cost zero audio downloads and work offline.