Skip to content

GPT-Realtime-Whisper

openai/gpt-realtime-whisper

Streaming speech-to-text model released May 2026 for live captions and notes, emitting low-latency transcript deltas in Realtime transcription sessions at $0.017 per minute. Not available on the file transcription endpoint; GPT-Live-Transcribe followed in July 2026.

API
import WebSocket from "ws";
import { readFile } from "node:fs/promises";

// Use mono, 16 kHz, signed 16-bit little-endian PCM.
const audio = await readFile("recording.pcm");
const url = new URL("/v1/audio/transcriptions/stream", process.env.AUDIOLAB_API_URL);
url.protocol = url.protocol === "https:" ? "wss:" : "ws:";
const socket = new WebSocket(url, {
  headers: { Authorization: `Bearer ${process.env.AUDIOLAB_API_KEY}` },
});
socket.on("open", () => socket.send(JSON.stringify({
  type: "session.start", model: "openai/gpt-realtime-whisper",
  encoding: "pcm_s16le", sample_rate: 16000, channels: 1,
})));
socket.on("message", (data) => {
  const event = JSON.parse(data.toString());
  console.log(event);
  if (event.type === "session.started") {
    for (let offset = 0; offset < audio.length; offset += 3200)
      socket.send(audio.subarray(offset, offset + 3200));
    socket.send(JSON.stringify({ type: "session.finish" }));
  }
});
Input Price
$0.0145 / minute
Output Price
—
Input
Audio
Output
Text

Capabilities

Explore what GPT-Realtime-Whisper supports, then use the API section for a request tailored to this model.

StreamConfidence

Languages

Multilingual

Model Information

Provider
OpenAI
Product
Speech-to-Text
Release Date
May 7, 2026
Data Policy
No training
Region
Global
Input
Audio
Output
Text
Provider Documentation

Playground

Try GPT-Realtime-Whisper by OpenAI. Requests use the selected workspace’s credits and API pricing.

GPT-Realtime-WhisperCredits —
GPT-Realtime-Whisper
This model uses a dedicated input format. Explore its API example or open the supported playground.

Providers

Compare available endpoints, pricing, and context limits for GPT-Realtime-Whisper.

ProviderContextOutputInput PriceOutput PriceEndpoint
OpenAINot specifiedText$0.0145 / minute—
openai/gpt-realtime-whisper:openai

Prices are catalog rates. Your workspace’s estimate and endpoint pricing determine the final charge.

Input and Output Limits

Formats and limits AudioLab enforces on each request.

LimitValue
Max bytesNot specified
Max secondsNot specified
Formats

Provider Notes

Whisper 1 alone supports translation plus SRT/VTT and word/segment timestamp granularities. GPT-4o Transcribe and GPT-4o Mini Transcribe support JSON/text, prompting, logprobs, and completed-audio SSE. GPT-4o Transcribe Diarize is the only diarization model and uses chunking plus optional known-speaker references; it does not accept prompt or timestamp granularities. GPT-Realtime-Whisper is a separate realtime-only model fixed to mono 24 kHz PCM16.

Performance

Status

Current catalog availability. Your workspace’s access is checked separately before a request runs.

Getting Started

Use your workspace API key and the exact model identifier below. Set the API URL to the endpoint shown in your workspace and keep credentials on your server.

API
import WebSocket from "ws";
import { readFile } from "node:fs/promises";

// Use mono, 16 kHz, signed 16-bit little-endian PCM.
const audio = await readFile("recording.pcm");
const url = new URL("/v1/audio/transcriptions/stream", process.env.AUDIOLAB_API_URL);
url.protocol = url.protocol === "https:" ? "wss:" : "ws:";
const socket = new WebSocket(url, {
  headers: { Authorization: `Bearer ${process.env.AUDIOLAB_API_KEY}` },
});
socket.on("open", () => socket.send(JSON.stringify({
  type: "session.start", model: "openai/gpt-realtime-whisper",
  encoding: "pcm_s16le", sample_rate: 16000, channels: 1,
})));
socket.on("message", (data) => {
  const event = JSON.parse(data.toString());
  console.log(event);
  if (event.type === "session.started") {
    for (let offset = 0; offset < audio.length; offset += 3200)
      socket.send(audio.subarray(offset, offset + 3200));
    socket.send(JSON.stringify({ type: "session.finish" }));
  }
});
Read the Endpoint Reference

Request Parameters

Available parameters depend on the provider and request format. The endpoint reference explains accepted values and required fields.

ParameterDetails
modelopenai/gpt-realtime-whisper — Required model identifier.
chunking_strategy (auto or server_vad)View Accepted Values
include: [logprobs] (GPT-4o batch models)View Accepted Values
known_speaker_names / known_speaker_references (diarize model)View Accepted Values
stream (completed-audio SSE; GPT-4o batch models)View Accepted Values
delay / include item.input_audio_transcription.logprobs (gpt-realtime-whisper)View Accepted Values

Input and Output Limits

Formats and limits AudioLab enforces on each request.

LimitValue
Max bytesNot specified
Max secondsNot specified
Formats

Similar Models

Explore more speech-to-text and compare their capabilities.

ModelContextInput PriceOutput Price
GPT-TranscribeOpenAINot specified$0.0038 / minute—
GPT-4o Mini Transcribe (2025-12-15)OpenAINot specified$0.0026 / minute—
GPT-4o Transcribe DiarizeOpenAINot specified$0.0051 / minute—
GPT-4o Mini TranscribeOpenAINot specified$0.0026 / minute—
GPT-4o TranscribeOpenAINot specified$0.0051 / minute—
Whisper 1OpenAINot specified$0.0051 / minute—
View All Speech-to-Text