All Blogs
What is a Voice AI Engineer?
A Voice AI Engineer is an engineer who builds real-time voice agents that listen to a person, think with an LLM, and speak back at the natural pace of a conversation.
How do Decision Trees and Random Forests work?
Decision Trees and Random Forests are Machine Learning models that make a decision by asking a series of simple yes-or-no questions about the data. A Decision Tree is one such flowchart of questions, and a Random Forest is a team of many slightly different Decision Trees that vote together to give a more reliable answer.
What is a Markov Decision Process (MDP)?
A Markov Decision Process (MDP) is a way to describe a problem where an agent makes decisions step by step, each decision changes the situation, and each step brings a reward. It is the standard way to write down a reinforcement learning problem.
How does a voice agent stop speaking instantly when interrupted?
A voice agent stops speaking instantly when interrupted by throwing away every piece of audio that is waiting to be played, at every step between the agent and our ear, and by cancelling the work that would create more audio.
What are backchannels, and why should "mm-hmm" not stop the agent?
Backchannels are the short sounds like "mm-hmm", "yeah", and "okay" that a listener makes to tell the speaker "I am following you, please continue". A voice agent must not stop for them, because the person is asking the agent to keep going, not asking to speak.
How do a Generative AI Engineer and an AI Engineer differ?
A Generative AI Engineer and an AI Engineer do the same job in practice, which is building products on top of existing AI models. The Generative AI Engineer title stresses models that generate text, image, audio, and video, while the AI Engineer title is the broader umbrella that also covers classification, recommendation, and vision features built on existing models.
What is jailbreaking in LLMs?
Jailbreaking in LLMs is a trick where a user writes a clever message to make an AI model break its own safety rules and say or do something it was trained to refuse.
What are Log Probabilities (Logprobs) in LLMs?
Log Probabilities (Logprobs) in LLMs are the log of the probability (the chance) that the model gives to each token it can write next. They tell us how sure the LLM was about every token it picked.
How does the Context Window work?
A Context Window is the total amount of text, measured in tokens, that a Large Language Model can read and remember at one time. It is the model's short-term memory.