Skip to content

ElevenLabs New York Summit: what changed

Original illustration of a large conference stage in New York at night, with a giant screen showing abstract glowing blue sound waves and a city skyline through tall windows

ElevenLabs held its New York Summit on November 11, 2026, and unveiled a package of new products and upgrades that move the company beyond voice generation into an enterprise AI platform. One report put the total at 13 new products and upgrades, covering custom models, ElevenAI, agent upgrades, a partner Marketplace, and an expanded NVIDIA deal. CEO Mati Staniszewski said conversational agents would become “critical infrastructure for every enterprise, as essential as cloud or payments” within a few years. Several of the most important pieces are still previews or roadmap items, so this article separates what is live now from what is coming.

ElevenLabs Summit at a glance: what changed

ElevenLabs held its New York Summit on November 11, 2026, and unveiled a package of new products and upgrades that move the company beyond voice generation into an enterprise AI platform. One report put the total at 13 new products and upgrades. The package covers custom models, an ElevenAI app, agent upgrades, a partner Marketplace, and an expanded NVIDIA partnership.

Original illustration of glowing blue sound waves flowing from a microphone into a laptop screen showing a simple waveform chart

The summit marked a shift in how ElevenLabs presents itself. The company started as a voice generation tool, and it is now pitching a full enterprise stack, from the models underneath to the marketplace where partners sell finished applications. InspireViralTimes reported the package as 13 new products and upgrades, and the announcement was covered the same day by Unite.AI, Blockchain.News, Crypto Briefing, and The Agent Times. Staniszewski said, “Our mission at ElevenLabs is to solve human-technology interaction, and for the first time, it’s solvable.” ElevenLabs was founded in 2022 and was reported to be valued at approximately $22 billion following a strategic investment from NVIDIA in 2025.

Custom models: fine-tuning for selected enterprises

In the coming months, selected enterprises will work directly with ElevenLabs researchers to fine-tune selected open-source language models and ElevenLabs voice models using data from their live deployments. Businesses can optimize for metrics such as customer satisfaction or reliability. Pricing has not been disclosed, and the program is a roadmap item for selected enterprises first.

Original illustration of two researchers at a desk tuning a large language model on a monitor, with dials, sliders and a waveform graph on screen

Model customization was the most consequential item at the summit. A generic model does not know a company’s customers, products, or rules: a bank’s voice agent needs different behavior from a hospital’s, and a retailer answering support calls needs different phrasing from an insurer qualifying claims. Because the tuning data comes from live deployments, the models can keep improving as interactions accumulate. The TechNewsNest guide to Google Gemini 3 covers another recent model release that enterprises are weighing for similar agent work. The program is rolling out to selected enterprises first, and pricing has not been disclosed.

ElevenAI: an app that turns spoken meetings into notes

ElevenAI is a new app for employees that listens to spoken conversations, including in-person meetings, and turns them into notes, summaries and action items. It can also provide live assistance and pass context between people and agents. Free early access opened with the announcement, and meeting notes use Scribe v3, which covers 102 languages.

Original illustration of a meeting room where a laptop on a table records a discussion and shows simple notes and a checklist on its screen

ElevenAI is aimed at employees rather than customers. It can also provide live assistance during a call and pass context between people and agents, so a note taken in a meeting can feed into the work that follows. Unite.AI reported the early access opening and the app’s features. Dictation and meeting notes use Scribe v3, which ElevenLabs describes as its recorded-audio transcription model covering 102 languages, and a separate Scribe v3 Live variant is built for low-latency, real-time audio. ElevenLabs says the app takes meeting notes with participants’ consent and includes notice and consent mechanisms.

Scribe v3 and domain-specific transcription

Dictation and meeting notes in ElevenAI use Scribe v3, which ElevenLabs describes as its recorded-audio transcription model covering 102 languages. A separate Scribe v3 Live variant is built for low-latency, real-time audio. Scribe v3 Medical is optimized for healthcare terminology, and a financial-services model is also in development.

Original illustration of a doctor's stethoscope and a headset beside a laptop showing a sound waveform turning into lines of notes

Scribe v3 is the transcription layer under much of the summit package. ElevenLabs describes it as its recorded-audio transcription model, covering 102 languages. The same model powers dictation and meeting notes in ElevenAI. The company is also tuning Scribe for specific industries. Scribe v3 Medical is optimized for healthcare terminology, so it should handle drug names, procedures, and clinical terms that a general model would miss. A domain-optimized financial-services model is also in development, according to Unite.AI. The TechNewsNest guide to Claude Opus 4.5 covers another recent model release aimed at demanding professional work.

Interaction Engine: managing turn-taking and interruptions

The Interaction Engine is a previewed system that orchestrates a conversation by managing turn-taking, interruptions, and the selection of the appropriate language model. It can assign a cheaper model to routine triage and a frontier model to complex tasks. The design aims to limit token use while keeping quality high.

Original illustration of two abstract speech bubbles in a conversation, with small arrows showing turn-taking between a person icon and a robot icon

That routing is as much about cost as quality. Running a frontier model for every second of every call is expensive, and most of a routine exchange does not need it. By matching the model to the moment, ElevenLabs aims to keep routine exchanges cheap while still bringing in the stronger model when the conversation gets hard. The TechNewsNest guide to OpenAI GPT-5 covers a frontier model that the Interaction Engine could call on for the complex part of a task.

ElevenAgents: Memory and Routines

ElevenAgents, the platform for deploying voice and chat agents across sales, support, recruitment and operations, will add Memory and Routines. Memory lets agents remember past conversations, and Routines lets them run structured, repeatable tasks. Both features move agents from answering questions toward completing work around a conversation.

Original illustration of a customer support agent wearing a headset at a desk with a computer showing a friendly voice assistant interface and a simple calendar

Memory will recognize returning authenticated customers and distill each conversation into a structured record of preferences, constraints, and future occasions. A customer who prefers Spanish and can only talk after 5 p.m., for example, would not need to repeat those details on the next call. The customer relationship management system remains the primary customer record, and Memory is the conversational layer on top of it. Routines, also forthcoming, is designed to automate multi-step work before, during, and after conversations, connecting with a company’s existing tools and systems. The examples ElevenLabs gave are concrete: pre-screening a mortgage applicant and calling back within minutes, reminding patients about visits and offering canceled slots to waitlisted patients, emailing reports, writing to a CRM, or initiating calls. The TechNewsNest guide to Claude Sonnet 4.5 covers another recent model built for agentic work.

NVIDIA partnership: Nemotron models and new compute

ElevenLabs and NVIDIA expanded their partnership on November 11, 2026. NVIDIA Nemotron 3.5 Super VL models are now available in ElevenAgents, and ElevenLabs plans to add 15 MW of NVIDIA Vera Rubin compute capacity on top of its existing Blackwell Ultra systems. The flagship deployment is a sovereign voice agent for Poland’s national e-Health appointment platform.

Original illustration of a large modern data center hall with rows of server racks glowing green and blue, with a sound wave pattern flowing above them

The added capacity is intended for large deployments with security or data-residency requirements, and to give ElevenLabs researchers access to optimized compute. ElevenLabs says Nemotron 3.5 Super VL achieved leading end-to-end task-completion accuracy, including strong performance in financial calculations and billing analysis, at 70 percent lower costs compared with other leading open models. That cost figure is company-reported, not independently verified, and readers should treat it that way.

The flagship deployment is a sovereign one. An on-premises voice agent will serve Centralna e-Rejestracja, the central appointment system in Poland’s national e-Health platform, with EasyCall supporting delivery. The agent calls patients who only have landlines to remind them about appointments and help them reschedule. ElevenLabs says the central system handles 40 million appointments a year with no-show rates of 10 to 20 percent, and the deployment uses NVIDIA Confidential Computing to keep citizen data and audio within government infrastructure.

Partners and Marketplace: scale of the program

ElevenLabs reports more than 550 partners across 44 countries, including Google Cloud, IBM, Deloitte, DXC and Genesys. Its Partner Program lets consultancies, systems integrators, software vendors and agencies integrate ElevenAgents into enterprise technology stacks. The Marketplace offers a curated catalog of partner-built applications for five industries.

Original illustration of a world map made of small connected dots and lines, with small building and shop icons at different points

Its new Partner Program lets consultancies, systems integrators, software vendors, and agencies integrate ElevenAgents into enterprise technology stacks or work with ElevenLabs’ forward-deployed engineers on complex deployments. An alliance with McKinsey and QuantumBlack, AI by McKinsey, pairs the platform with McKinsey’s enterprise-transformation work. Launch partners include Salient, which automates borrower servicing calls, Gail by Lula, which handles and qualifies insurance inquiries around the clock, and Zendesk, whose agent resolves customer service requests from start to finish, according to ElevenLabs.

What this means for enterprises, and what stays limited

The summit package is broad, but several of its most important pieces are previews, roadmap items, or limited to selected enterprises. Custom models begin with selected enterprises, the Interaction Engine is in preview, and Marketplace purchases through existing commitments are planned for 2027. Buyers should ask what is available to them now before judging the full package.

Original illustration of a modern office meeting with a large screen showing a voice waveform and a checklist

The summit package makes ElevenLabs’ enterprise strategy dependent on more than model performance. Tuning and Memory draw on data accumulated in live use, Routines connects conversations to business systems, and the partner program and Marketplace create routes into enterprises that a voice API alone could not reach. For businesses evaluating voice AI, the questions to ask are practical ones. Is model customization available to you, or only to selected enterprises? Does Memory’s consent and data handling fit your privacy rules? And does the Interaction Engine actually cut token costs on your call mix, or only on paper? Watch for three signals in the next few months: the custom models program opening beyond selected enterprises, the Interaction Engine moving from preview to general availability, and the first Marketplace purchases through existing commitments. No SEMrush metrics are reported here, as search volume and keyword difficulty data are unavailable.

Frequently asked questions

The questions below cover what was announced at the summit, when each product is available, how ElevenAI handles meeting consent, what the NVIDIA deal adds, and how the partner Marketplace works. The answers use only facts from the summit coverage linked in the sources, and they separate what is live today from what is still in preview or planned.

Original illustration of a person at a desk with a laptop and headphones asking a question, with a large question mark shape made of sound waves above

When was the ElevenLabs New York Summit held?

ElevenLabs held its New York Summit on November 11, 2026, and unveiled a package of new products and upgrades, including custom models, the ElevenAI app, ElevenAgents upgrades, a partner Marketplace, and an expanded NVIDIA partnership. NVIDIA CEO Jensen Huang appeared on the summit lineup.

What is ElevenAI?

ElevenAI is a new app for employees that listens to spoken conversations, including in-person meetings, and turns them into notes, summaries, and action items. It can also provide live assistance and pass context between people and agents. Free early access opened with the announcement.

Can any business sign up for custom model tuning today?

No. The customization program is rolling out to selected enterprises first, and the work begins in the coming months. Selected enterprises will work directly with ElevenLabs researchers to fine-tune models using data from their live deployments. Pricing has not been disclosed.

What is Scribe v3 Medical?

Scribe v3 Medical is a speech-to-text model optimized for healthcare terminology. It is part of ElevenLabs’ domain-specific transcription work, and a financial-services model is also in development. The base Scribe v3 model covers 102 languages for recorded audio, and a separate Scribe v3 Live variant is built for low-latency, real-time audio.

What does the Interaction Engine do?

The Interaction Engine is a previewed system that orchestrates a conversation by managing turn-taking, interruptions, and the selection of the appropriate language model. It can assign a cheaper model to routine triage and a frontier model to complex tasks, which is intended to limit token use.

What did ElevenLabs announce with NVIDIA?

ElevenLabs and NVIDIA expanded their partnership on November 11, 2026. NVIDIA Nemotron 3.5 Super VL models are now available in ElevenAgents, and ElevenLabs plans to add 15 MW of NVIDIA Vera Rubin compute capacity on top of its existing Blackwell Ultra systems. The flagship deployment is a sovereign voice agent for Poland’s national e-Health appointment platform.

How many partners does ElevenLabs have, and what is the Marketplace?

ElevenLabs reports more than 550 partners across 44 countries, including Google Cloud, IBM, Deloitte, DXC, and Genesys. The Marketplace offers a curated catalog of partner-built applications for healthcare, financial services, insurance, education, and retail. Enterprises can browse and contact developers today, and purchasing through existing commitments is planned for 2027.

Sources

Leave a Reply

Your email address will not be published. Required fields are marked *