Pipecat 1.16.0 adds diarization speakers and drops soxr
Updated Pipecat
Summary
Pipecat 1.16.0 (Nov 12, 2026) adds a speaker field for diarization, Gemini Interactions and Zoom AI services, and drops resampy and soxr from core.
- Tool
- Pipecat
- Category
- Voice agents
- Date
- Open source
- Yes
- License
- BSD-2-Clause
- Pricing
- Not stated in the sources we cited.
Pipecat v1.16.0 was published on November 12, 2026 (03:45 Istanbul time), two weeks after 1.15.0, and reached PyPI a minute earlier. The notes run to more than 240 entries. Three things matter most: diarization now has its own speaker field on transcription frames, the default install is roughly half the size because resampy and soxr left the core dependencies, and Hume's TTS service is deprecated because Hume shuts its TTS API down on November 13, 2026.
Release facts
| Fact | Detail |
|---|---|
| Product | Pipecat, open-source Python framework for voice and multimodal agents |
| Version | v1.16.0 |
| Release date | November 12, 2026 (GitHub release and PyPI upload) |
| Previous release | 1.15.0, October 29, 2026 |
| License | BSD-2-Clause, per the GitHub API |
| Python | >=3.11, per PyPI |
| Install | uv add pipecat-ai==1.16.0 |
Check before upgrading
- Diarization moved to
speaker.AssemblyAISTTService,SpeechmaticsSTTServiceandNvidiaSTTServicenow put the speaker inframe.speakerand leaveuser_idas the transport participant id. Code that read the speaker fromuser_idneeds to change. - Speechmatics prefix gone. With the deprecated
InputParamsandenable_diarization=True, transcripts no longer start with@{speaker_id}:. Setspeaker_format="@{speaker}: {text}"to keep it. resampyandsoxrare no longer core dependencies. Installpipecat-ai[resampy]orpipecat-ai[soxr]if you still useResampyResampleror the SOXR resamplers, all now deprecated. The default resamplers are the newSincStreamAudioResamplerandSincAudioResamplerfrom thepipecat-resamplerpackage.audioop-ltsdropped on Python 3.13+. Add it yourself if your own code importsaudioop. Thelocal-smart-turnextra also stops installingtorchaudio.- Function call results. A function call that returns
"",{}orFalsenow runs the LLM. ReturnNoneto finish a call without a reply. - Hume TTS stops working on November 13, 2026.
HumeTTSServiceis deprecated with no replacement andpipecat initno longer offers it. - Model defaults moved.
SonioxSTTServicedefaults tostt-rt-v6.GeminiTTSServiceusesgemini-3.8-flash-lite-ttson the Gemini API, ahead ofgemini-3.1-flash-tts-previewretiring there on November 17. Theaicextra needsaic-sdk~=3.4.0, which cannot download older model files. - Expressive conversation imports moved (still alpha).
PipecatToneReaderandPipecatToneTaggernow live underpipecat.expressive.processors, andpipecat.processors.toneis removed. Thetoneextra is deprecated in favour ofexpressivity. - Nested
!includepaths in eval scenarios andFlowConfignow resolve relative to the file that names them.
What's new
- Speaker diarization across STT services. New support in ElevenLabs, AWS Transcribe and OpenAI diarization models such as
gpt-4o-transcribe-diarize; Deepgram, Soniox, xAI, Smallest, Meta and Zoom AI now report the speaker too. Aspeaker_formatsetting writes it into the transcript text, and RTVI messages carry it to clients. - New services.
GoogleInteractionsLLMServicefor the Gemini Interactions API (sent withstore=False, so Google keeps no conversation state), a Vertex AI variant,ZoomAIRealtimeLLMServicefor speech-to-speech with the Zoom AI Voice Agent,RimeSTTService,SarvamHttpSTTServiceand HeyGen Voice TTS. - Telephony. A
JambonzFrameSerializerfor jambonz'slistenverb,audio_in_sample_rate/audio_out_sample_rateon every serializer, synchronous G.711 helpers inpipecat.audio.g711, and Genesys AudioHook pause and resume. - Perception for expressive conversation (alpha).
PerceptionReaderasks classifiers how a user turn was said. Sources include Pipecat Tone, the new on-CPU Pipecat Voice Reader (tone of voice, arousal, laughter, speech rate), Hume Audio Decisions and Google's Decisions API. Classifiers now accept audio and files throughinputs=. - Soniox echo cancellation.
enable_echo_cancellationsends the bot's words as they play so Soniox does not transcribe the bot as the user. - Evals.
EvalRubricjudges a conversation the harness did not drive, such as a recorded production call.
Notable fixes
GoogleSTTServiceno longer drops the user's last utterance each time it restarts at Google's four-minute streaming limit.LiveKitTransportno longer leaks memory queuing audio whenaudio_in_enabledisFalse.SentenceAggregatorandIVRProcessorclear partial text on interruption, so cut-off words no longer start the next reply.- Wake phrases with punctuation, or Chinese and Japanese wake phrases inside longer speech, now match.
Questions
Will upgrading break my bot?
It can if you read diarization speakers from user_id, rely on soxr or resampy being installed, return "" or {} from a function call to stay silent, or use Hume TTS. Check those four first.
Why is the install smaller?
resampy, which pulls in numba and llvmlite, is no longer a core dependency. The release says this roughly halves the default install.
What Python version does Pipecat 1.16.0 need?
PyPI lists >=3.11.
More on the Pipecat hub, the previous Pipecat 1.15.0 launch and the voice agents category. For other options, read Pipecat alternatives and Pipecat vs LiveKit Agents.
Alternatives
| Tool | License | Pricing note |
|---|---|---|
PipecatThis launchOpen-source BSD-2-Clause Python framework from Daily and the community for real-time voice and multimodal agents, built from composable pipelines. | BSD-2-Clause | Not stated |
LiveKit AgentsOpen-source Apache-2.0 framework for realtime voice AI agents in Python and Node.js. Version 1.8.11 (November 5, 2026) adds inference.responses.LLM and new STT/TTS plugins. | Apache-2.0 | The framework is Apache-2.0. LiveKit Cloud and third-party speech/LLM providers bill separately; this page does not quote those prices. |
More from Pipecat
Pipecat 1.15.0 adds expressive TTS and turn strategy modes
PipecatPipecat 1.15.0 (Oct 29, 2026) adds alpha expressive TTS tags, classifier turn ending and AssemblyAI TTS; multiple stop strategies now must agree.
Category: Voice agents
Pricing: Open source
Pipecat 1.14.0 adds Perplexity Agent and NVIDIA Omni
PipecatPipecat 1.14.0 (October 24, 2026) adds Perplexity Agent API, NVIDIA Omni and Zoom Scribe services and deprecates the Sonar-based Perplexity service.
Category: Voice agents
Pricing: Open source
Pipecat 1.13.0 lets clients send files and images to bots
PipecatPipecat 1.13.0, released October 19, 2026, lets clients send files and images to bots through a new RTVI send-file message.
Category: Voice agents
Pricing: Open source
Questions
What is Pipecat?
The GitHub repository describes it as an "Open Source framework for voice agents, multimodal apps, and realtime AI. Maintained by Daily and the community."
Is Pipecat open source?
The GitHub API reports a BSD-2-Clause license for the repository.
Filed on Agent Radar. Claims in this note are limited to the sources above.