yedianyang studio
Interactive

AI script supervisor assistant2026Lead Developer

Soundspeed

An offline AI assistant for film production sound teams, running on a single Mac mini.

About

Soundspeed is an AI assistant for production sound on film sets. It transcribes actors' dialogue, identifies each speaker, and passes the results to a locally running Gemma 4 E4B agent. The agent organizes the dialogue into a script supervisor's report that sound mixers, directors, and script supervisors can search on set. All processing stays local to protect confidential production material.

Approach

On set, script supervisors and sound teams track scenes, setups, and takes on paper. They also note improvised lines and spoken instructions from the director. A scene may require dozens, sometimes hundreds, of takes, making handwritten notes easy to miss. Scripts and recordings are confidential production material, so sending them to a cloud service creates a risk of disclosure. The entire workflow runs offline on an M4 Mac mini. Fun-ASR or Whisper transcribes recordings word for word and identifies speakers. A Gemma 4 E4B agent compares the recorded dialogue with the script line by line, flagging omissions and changed lines. Production sound mixers can dictate or type notes and attach them to the corresponding take. The agent can also analyze photos of script pages and answer questions about what happened on set. At the end of the day, the team can export a script supervisor's report. I led the project with one teammate for GDG Shanghai's Gemma 4 developer competition.

Soundspeed

1 / 1


Numbers

200ms

Speech-to-text latency

1s

Agent response time


Architecture

Gemma 4 E4Bllama.cppFun-ASRwhisper.cpppyannote.audioFastAPISQLiteReact