What is speech to text?

Azure Speech service offers advanced speech to text capabilities. This feature supports both real-time and batch transcription, providing versatile solutions for converting audio streams into text.

Core features of speech to text

The speech to text service offers the following core features:

Real-time transcription

Real-time speech to text transcribes audio as it's recognized from a microphone or file. It's ideal for applications requiring immediate transcription, such as:

  • Real-time audio transcription for accessibility and record-keeping.
  • Evaluating and providing feedback on pronunciation accuracy.
  • Providing real-time transcription to assist customer service representatives.
  • Transcribing spoken words into written text for documentation purposes.
  • Enabling interactive voice response systems to transcribe user queries and commands.

Real-time speech to text can be accessed via the Speech SDK, Speech CLI, and REST API, allowing integration into various applications and workflows. Real-time speech to text is available via the Speech SDK, the Speech CLI, and Speech to text REST API for short audio.

Fast transcription

Use the fast transcription API to transcribe audio files and return results synchronously and faster than real-time audio. Use fast transcription in scenarios where you need the transcript of an audio recording as quickly as possible with predictable latency, such as:

  • Quick audio file transcription, captions, and edit
  • Meeting notes
  • Voicemail

For more information, see use the fast transcription API.

Batch transcription

Batch transcription is designed for transcribing large amounts of audio stored in files. This method processes audio asynchronously and is suited for:

  • Transcriptions, captions, or subtitles for large volumes of audio files
  • Analyzing call center recorded calls to extract valuable insights.

You can access batch transcription through:

Custom speech

By using custom speech, you can evaluate and improve the accuracy of speech recognition for your applications and products. Use a custom speech model for real-time speech to text, speech translation, and batch transcription.

Tip

To use custom speech with the Batch transcription API, you don't need a hosted deployment endpoint. If you only use the custom speech model for batch transcription, you can conserve resources. For more information, see Speech service pricing.

Out of the box, speech recognition uses a Universal Language Model as a base model. Azure trains the base model with data it owns, so it reflects commonly used spoken language. The base model is pretrained with dialects and phonetics that represent various common domains. When you make a speech recognition request, the most recent base model for each supported language is used by default. The base model works well in most speech recognition scenarios.

By using custom speech, you can tailor the speech recognition model to better suit your application's specific needs. This tailoring is particularly useful for:

  • Improving recognition of domain-specific vocabulary: Train the model with text data relevant to your field.
  • Enhancing accuracy for specific audio conditions: Use audio data with reference transcriptions to refine the model.

For more information about custom speech, see the custom speech overview and the speech to text REST API documentation.

For details about customization options per language and locale, see the language and voice support for the Speech service documentation.

Usage examples

Here are some practical examples of how you can utilize Azure Speech to text:

Use case Scenario Solution
Live meeting transcriptions and captions A virtual event platform needs to provide real-time captions for webinars. Integrate real-time speech to text using the Speech SDK to transcribe spoken content into captions displayed live during the event.
Customer service enhancement A call center wants to assist agents by providing real-time transcriptions of customer calls. Use real-time speech to text via the Speech CLI to transcribe calls, enabling agents to better understand and respond to customer queries.
Video subtitling A video-hosting platform wants to quickly generate a set of subtitles for a video. Use fast transcription to quickly get a set of subtitles for the entire video.
Educational tools An e-learning platform aims to provide transcriptions for video lectures. Apply batch transcription through the speech to text REST API to process prerecorded lecture videos, generating text transcripts for students.
Healthcare documentation A healthcare provider needs to document patient consultations. Use real-time speech to text for dictation, allowing healthcare professionals to speak their notes and have them transcribed instantly. Use a custom model to enhance recognition of specific medical terms.
Media and entertainment A media company wants to create subtitles for a large archive of videos. Use batch transcription to process the video files in bulk, generating accurate subtitles for each video.
Market research A market research firm needs to analyze customer feedback from audio recordings. Employ batch transcription to convert audio feedback into text, enabling easier analysis and insights extraction.

Related content

  • Last updated on