Senior interview questionAsked at Luma AI · interview write-up
Design a production text-to-speech platform for both interactive streaming synthesis and long asynchronous jobs, including quality evaluation and voice authorization.
Model answer
Two paths over one model fleet. Streaming: normalise the text, then generate and vocode audio in small chunks so playback starts fast; these requests get priority on warm GPUs. Batch: split long text at sentence boundaries, synthesise in parallel on spare capacity, stitch with consistent prosody, and return through a job API and storage.
Quality: human listening ratings plus automatic checks, such as word error rate from speech recognition and speaker similarity. Voice authorization: clone a voice only with the speaker's recorded consent, bind voices to accounts, and watermark output.
Practise the rest
12 Multimodal questions, 492 in all, each with a model answer. Free.
More from Luma AI interview questions.
More Multimodal interview questions
- What has driven each generation of LLM improvements, how do multimodal LLMs work, and what role does normalisation play in LLMs?
- You need to deploy multimodal models under tight GPU and latency limits, and also support fast retrieval over video. How do you approach it?
- How does a vision encoder feed images into a multimodal LLM, and where are the bottlenecks?
- Design the training of a multimodal embedding model: architecture, supervision and losses, evaluation metrics and deployment.
- Turn a multimodal model that captions videos into a production service under tight compute and GPU memory limits.
- Design a classifier that assigns genres to games using text, images and tabular metadata, from label quality to serving and monitoring.