gpt-realtime-2.1
OpenAI's speech-to-speech model for live conversation, taking audio in and producing audio out with tool use.
- Weights
- Not released
- API
- Yes
- Commercial use
- Vendor states commercial use is permitted
A mini variant trades quality for roughly a third of the cost. A separate gpt-realtime-translate model does streaming speech-to-speech translation.
OpenAI API terms; commercial use permitted.
Specification
- What it takes in
- audio, text
- What it makes
- audio, text
- Controls
- streaming-low-latency, style-prompting, emotion-control
- Weights
- Not released
- API
- Yes
- Pricing
- Audio tokens: gpt-realtime-2.1 $32.00/1M input, $0.40/1M cached input, $64.00/1M output. gpt-realtime-2.1-mini $10.00/1M input, $0.30/1M cached, $20.00/1M output. gpt-realtime-translate $0.034/minute. gpt-audio-1.5 $32.00/$64.00 per 1M; gpt-audio-mini $10.00/$20.00 per 1M.
- Released or updated
- not established
- Languages
- not established
Strengths
- True speech-to-speech, preserving prosody rather than round-tripping through text
- Very cheap cached input pricing ($0.40/1M) rewards long system prompts
- Tool use and reasoning in the same model
- Dedicated streaming translation variant
Weaknesses
- Audio output at $64/1M tokens is expensive for long sessions
- No voice cloning
- gpt-realtime mini (the earlier one) is already deprecated - fast churn
- Little direct application to non-interactive video production
Best for
- live interactive voice
- realtime translation demos
- interactive installations
Where the sources disagree
Recorded rather than resolved. Picking the tidier number would hide the fact that the vendor's own pages do not agree.
- Third-party analyses convert this to roughly $0.06-$0.11/min for gpt-realtime-2.1 and $0.02-$0.05/min for the mini, assuming 1 token per 100ms of user audio and 1 per 50ms of assistant audio. Those per-minute figures are third-party derivations, not vendor-published.
What to understand before using it
Explainers naming the mechanisms this model's own documentation mentions.
MCP servers that front OpenAI
Servers in the media MCP directory whose own description or homepage names this vendor. Absence of a server here is not evidence that none exists: most publish no tool list at all.
-
370.ai, AI Gateway: Video (Seedance 2.0, Wan, HappyHorse), Image, Speech + 100+ Chat Models
One key, 100+ models, chat with any LLM and generate video, images, speech. Free trial at 370.ai.
-
Adclip
Ad creative generation via MCP, copy and static images from a JSON brief. Keyless.
-
Aetherwave
Music, image, video and audio generation across top AI providers - one key, one credit pool.
-
Aidemo
Narrated, captioned product-demo MP4 from a storyboard.json; re-renders itself in CI at ~$0.
-
ArkRoute, Visual AI API Gateway
Generate images and videos using 28+ visual AI models from OpenAI (GPT Image 2, DALL-E 3), Google (Imagen 4, Veo 3.1), ByteDance (Seedream, Seedance 2.0), and Kuaishou (K
-
Avocado AI
Generate AI images, videos, music, SFX & speech in any AI assistant. Results appear inline in chat.
See it from the vendor
Shotcraft hosts no sample output. Judging a model means watching its own showreel with your own eyes, and a clip re-hosted here would be a clip we chose.
Nearby in the directory
gpt-4o-mini-tts
OpenAI's current text-to-speech model, steerable with natural-language instructions about how a line should be delivered. It replaces the older tts-1
Voice and speech
OpenAI transcription (gpt-4o-transcribe, gpt-transcribe, Whisper)
A family of speech-to-text models spanning batch and realtime use: Whisper and gpt-4o-transcribe for files, gpt-4o-transcribe-diarize for speaker-sepa
Voice and speech
Azure AI Speech text-to-speech (Neural, Neural HD, MAI voices)
Microsoft's enterprise speech synthesis service, with 200+ prebuilt neural voices across 80+ locales plus tiers for HD voices, multilingual voices, mu
Voice and speech