Large speech languages and models

The IBM Watson® Speech to Text service supports a growing collection of Large Speech Models (LSMs) that improve the speech recognition capabilities of the service's previous-generation models. The model name is the locale, which consists of the language code and the region or country code that is separated by a dash. For example, en-US is for English that is spoken in the United states. LSMs are large models. They have a large number of trainable parameters and are trained on large amounts of audio. Because of their large size, the large amounts of training material they are built on, and the state-of-the-art architecture and training recipe that is used to build them, these models deliver more transcription accuracy compared to the previous models available.

You can use these models for both Telephony use cases and Broadband use cases.

Supported large speech model languages

The table lists the large speech models that are available for each language. Unless otherwise labeled as IBM Cloud, IBM Cloud Pak for Data or IBM Software Hub, a model is supported for all versions of the service.

Large speech models
Language Model name Status
Dutch (Netherlands) nl-NL IBM Cloud 10 April 2026
IBM Software Hub 10 April 2026
English (Australian) en-AU IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
English (Indian) en-IN IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
English (United Kingdom) en-GB IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
English (United States) en-US IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
French (Canadian) fr-CA IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
French (France) fr-FR IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
German de-DE IBM Cloud 19 November 2024
Italian (Italy) it-IT IBM Cloud 15 May 2026
IBM Software Hub 15 May 2026
Japanese ja-JP IBM Cloud 20 May 2024
IBM Cloud Pak for Data 12 June 2024
Portuguese (Brazilian) pt-BR IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024
Portuguese (Portugal) pt-PT IBM Cloud 23 August 2024
IBM Cloud Pak for Data 23 August 2024
Spanish (Castilian) es-ES IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024
Spanish (Argentinian) es-AR IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024
Spanish (Chilean) es-CL IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024
Spanish (Colombian) es-CO IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024
Spanish (Mexican) es-MX IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024
Spanish (Peruvian) es-PE IBM Cloud 18 June 2024
IBM Cloud Pak for Data 23 August 2024

Supported features for large speech models

The large speech models are supported for use with a large subset of the service's speech recognition features. In cases where a supported feature is restricted to certain languages, the same language restrictions usually apply to large speech models, previous-generation, and next-generation models.

  • For more information about the parameters that you can use with large speech models, including their language support and whether the parameters are GA or beta, see the Parameter summary.
  • For more information about large speech models' support for customization, see Customization support for large speech models.

Large speech models support all speech recognition parameters and headers except:

  • acoustic_customization_id (Large speech models do not support acoustic model customization.)
  • keywords and keywords_threshold
  • word_alternatives_threshold
  • grammar_name (Large speech models do not support grammar customization.)
  • character_insertion_bias

en-US large speech model now supports low_latency.

Large speech models also differ from previous-generation models with respect to the following additional feature:

The parameter_set request parameter

Large speech models support a parameter_set request parameter that applies a curated set of tuned values in a single call. You can pass parameter_set=enhanced to opt in to improved recognition quality without setting individual parameters manually.

When parameter_set is omitted or set to default, the service behaves exactly as it did before this parameter existed. No values are overridden.

Supported values

The table lists the supported values that can be used with the parameter_set request parameter.

Supported values for the parameter_set request parameter
Value Behavior
(Omitted) Default behavior. No tuned values are applied.
default Same as omitted.
enhanced Applies the recommended tuning per language.

Combining parameter_set with other parameters

When you specify parameter_set=enhanced, the preset values take precedence over any values you set individually for the parameters that the preset tunes. To set the parameters individually, omit parameter_set (or set parameter_set=default) and configure them directly.

The enhanced preset tunes the following parameters:

  • sad_module
  • speech_detector_sensitivity
  • background_audio_suppression
  • character_insertion_bias
  • end_of_phrase_silence_time

Use parameter_set=enhanced to apply recommendations for the specified language in a single setting rather than configuring each parameter individually. For more information on recommended parameter configurations and general parameter tuning guidance, see Recommended parameter configurations and Recommended query parameters for large speech models.

Availability and usage

The table lists the availability based on model and Websocket usage.

Availability and usage support for the parameter_set request parameter
Description Support
Previous-generation models Not available
Next-generation models Not available
WebSocket Parameter of JSON start message

Example WebSocket start message

{
  "action": "start",
  "content-type": "audio/wav",
  "parameter_set": "enhanced"
}

Notes

Consider the following when you use parameter_set request parameter:

  • Only large speech models support parameter_set. Sending it to a non-LSM model is silently ignored.
  • Five base models cover thirteen locale codes through Watson language alias chain:
    • English: en-AU, en-GB, en-IN
    • Spanish: es-AR, es-CL, es-CO, es-ES, es-MX, es-PE
    • French: fr-CA, fr-FR
    • Portuguese: pt-BR, pt-PT
    • German: de-DE

Parameter guidelines

The following guidelines provide recommended parameter values and tuning strategies to help you achieve better speech recognition accuracy, reduce timeout issues, and improve overall model performance.

  1. sad_module

    • Recommended: 2 (default is 1)
    • Provides improved speech/silence segmentation compared to the default CNN-based SAD
    • Helps reduce timeout issues caused by misclassification of noise as speech
  2. speech_detector_sensitivity

    • Higher values lead to more aggressive speech detection
    • Large speech models generally benefit from higher sensitivity
    • Recommended range: 0.6 to 0.8 depending on language and noise conditions
  3. end_of_phrase_silence_time

    • Recommended: 0.7 to 0.8 (default is 0.0)
    • Improves segmentation for conversational applications
    • Particularly beneficial for short structured utterances
  4. background_audio_suppression

    • Helps improve recognition accuracy for speech in background noise
    • Should be tuned conservatively to avoid suppressing speech energy
    • Example: 0.1 for moderate noise environments
  5. character_insertion_bias

    • Default: -0.22
    • Slight increase (for example, -0.1 to 0.0) can help reduce deletion errors
    • Use caution: Positive values may introduce insertion errors