Large speech languages and models
The IBM Watson® Speech to Text service supports a growing collection of Large Speech Models (LSMs) that improve the speech recognition capabilities of the service's previous-generation models. The model name is the locale, which consists of the
language code and the region or country code that is separated by a dash. For example, en-US is for English that is spoken in the United states. LSMs are large models. They have a large number of trainable parameters and are trained
on large amounts of audio. Because of their large size, the large amounts of training material they are built on, and the state-of-the-art architecture and training recipe that is used to build them, these models deliver more transcription accuracy
compared to the previous models available.
You can use these models for both Telephony use cases and Broadband use cases.
Supported large speech model languages
The table lists the large speech models that are available for each language. Unless otherwise labeled as IBM Cloud, IBM Cloud Pak for Data or IBM Software Hub, a model is supported for all versions of the service.
| Language | Model name | Status |
|---|---|---|
| Dutch (Netherlands) | nl-NL |
IBM Cloud 10 April 2026 IBM Software Hub 10 April 2026 |
| English (Australian) | en-AU |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| English (Indian) | en-IN |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| English (United Kingdom) | en-GB |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| English (United States) | en-US |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| French (Canadian) | fr-CA |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| French (France) | fr-FR |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| German | de-DE |
IBM Cloud 19 November 2024 |
| Italian (Italy) | it-IT |
IBM Cloud 15 May 2026 IBM Software Hub 15 May 2026 |
| Japanese | ja-JP |
IBM Cloud 20 May 2024 IBM Cloud Pak for Data 12 June 2024 |
| Portuguese (Brazilian) | pt-BR |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
| Portuguese (Portugal) | pt-PT |
IBM Cloud 23 August 2024 IBM Cloud Pak for Data 23 August 2024 |
| Spanish (Castilian) | es-ES |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
| Spanish (Argentinian) | es-AR |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
| Spanish (Chilean) | es-CL |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
| Spanish (Colombian) | es-CO |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
| Spanish (Mexican) | es-MX |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
| Spanish (Peruvian) | es-PE |
IBM Cloud 18 June 2024 IBM Cloud Pak for Data 23 August 2024 |
Supported features for large speech models
The large speech models are supported for use with a large subset of the service's speech recognition features. In cases where a supported feature is restricted to certain languages, the same language restrictions usually apply to large speech models, previous-generation, and next-generation models.
- For more information about the parameters that you can use with large speech models, including their language support and whether the parameters are GA or beta, see the Parameter summary.
- For more information about large speech models' support for customization, see Customization support for large speech models.
Large speech models support all speech recognition parameters and headers except:
acoustic_customization_id(Large speech models do not support acoustic model customization.)keywordsandkeywords_thresholdword_alternatives_thresholdgrammar_name(Large speech models do not support grammar customization.)character_insertion_bias
en-US large speech model now supports low_latency.
Large speech models also differ from previous-generation models with respect to the following additional feature:
- Large speech models do not produce hesitation markers. They instead include the actual hesitations in transcription results. For more information, see Speech hesitations and hesitation markers.
The parameter_set request parameter
Large speech models support a parameter_set request parameter that applies a curated set of tuned values in a single call. You can pass parameter_set=enhanced to opt in to improved recognition quality without setting
individual parameters manually.
When parameter_set is omitted or set to default, the service behaves exactly as it did before this parameter existed. No values are overridden.
Supported values
The table lists the supported values that can be used with the parameter_set request parameter.
| Value | Behavior |
|---|---|
| (Omitted) | Default behavior. No tuned values are applied. |
default |
Same as omitted. |
enhanced |
Applies the recommended tuning per language. |
Combining parameter_set with other parameters
When you specify parameter_set=enhanced, the preset values take precedence over any values you set individually for the parameters that the preset tunes. To set the parameters individually, omit parameter_set (or
set parameter_set=default) and configure them directly.
The enhanced preset tunes the following parameters:
sad_modulespeech_detector_sensitivitybackground_audio_suppressioncharacter_insertion_biasend_of_phrase_silence_time
Use parameter_set=enhanced to apply recommendations for the specified language in a single setting rather than configuring each parameter individually. For more information on recommended parameter configurations and general parameter
tuning guidance, see Recommended parameter configurations and Recommended query parameters for large speech models.
Availability and usage
The table lists the availability based on model and Websocket usage.
| Description | Support |
|---|---|
| Previous-generation models | Not available |
| Next-generation models | Not available |
| WebSocket | Parameter of JSON start message |
Example WebSocket start message
{
"action": "start",
"content-type": "audio/wav",
"parameter_set": "enhanced"
}
Notes
Consider the following when you use parameter_set request parameter:
- Only large speech models support
parameter_set. Sending it to a non-LSM model is silently ignored. - Five base models cover thirteen locale codes through Watson language alias chain:
- English:
en-AU,en-GB,en-IN - Spanish:
es-AR,es-CL,es-CO,es-ES,es-MX,es-PE - French:
fr-CA,fr-FR - Portuguese:
pt-BR,pt-PT - German:
de-DE
- English:
Recommended parameter configurations
The following configurations provide recommended baseline settings across supported languages.
- English (en-*)
{
"sad_module": 2,
"speech_detector_sensitivity": 0.9,
"background_audio_suppression": 0.1,
"character_insertion_bias": -1.0,
"end_of_phrase_silence_time": 1.0
}
- French (fr-FR)
{
"sad_module": 2,
"speech_detector_sensitivity": 0.8,
"background_audio_suppression": 0.0,
"character_insertion_bias": 0.0,
"end_of_phrase_silence_time": 1.0
}
- Spanish (es-*)
{
"sad_module": 1,
"speech_detector_sensitivity": 0.2,
"background_audio_suppression": 0.0,
"character_insertion_bias": 0.0,
"end_of_phrase_silence_time": 1.0
}
- Brazilian Portuguese (pt-BR)
{
"sad_module": 2,
"speech_detector_sensitivity": 0.8,
"background_audio_suppression": 0.0,
"character_insertion_bias": -0.3,
"end_of_phrase_silence_time": 1.0
}
- German (de-DE)
{
"sad_module": 1,
"speech_detector_sensitivity": 0.5,
"background_audio_suppression": 0.0,
"character_insertion_bias": -0.2,
"end_of_phrase_silence_time": 1.0
}
Parameter guidelines
The following guidelines provide recommended parameter values and tuning strategies to help you achieve better speech recognition accuracy, reduce timeout issues, and improve overall model performance.
-
sad_module
- Recommended:
2(default is1) - Provides improved speech/silence segmentation compared to the default CNN-based SAD
- Helps reduce timeout issues caused by misclassification of noise as speech
- Recommended:
-
speech_detector_sensitivity
- Higher values lead to more aggressive speech detection
- Large speech models generally benefit from higher sensitivity
- Recommended range:
0.6to0.8depending on language and noise conditions
-
end_of_phrase_silence_time
- Recommended:
0.7to0.8(default is0.0) - Improves segmentation for conversational applications
- Particularly beneficial for short structured utterances
- Recommended:
-
background_audio_suppression
- Helps improve recognition accuracy for speech in background noise
- Should be tuned conservatively to avoid suppressing speech energy
- Example:
0.1for moderate noise environments
-
character_insertion_bias
- Default:
-0.22 - Slight increase (for example,
-0.1to0.0) can help reduce deletion errors - Use caution: Positive values may introduce insertion errors
- Default:
Recommended query parameters for large speech models
Large speech models support a wide range of configurable query parameters that can be tuned to optimize performance across different languages and use cases. While default parameter values provide strong baseline performance, adjusting specific parameters can significantly improve:
- transcription stability
- speech segmentation and endpointing behavior
- recognition accuracy, especially in noisy or variable environments
Use this approach if you want to customize the parameters individually instead of using the preset values set by parameter_set=enhanced.
Target use cases
The following recommendations are designed for conversational and interactive applications, including:
- Virtual assistants
- Healthcare voice interfaces
- Banking and insurance systems
- Customer support and contact center automation
These use cases typically involve short to medium-length utterances, frequent turn-taking interactions, and variable background noise conditions.
Supported parameters
The following parameters are commonly tuned with large speech models:
sad_module- Selects the Speech Activity Detection (SAD) module.speech_detector_sensitivity- Controls how aggressively speech is detected. Higher values increase sensitivity to speech onset.background_audio_suppression- Controls noise suppression.character_insertion_bias- Controls the balance between insertion and deletion errors.end_of_phrase_silence_time- Defines the duration of silence (in seconds) required to finalize an utterance.
For more information about these parameters, see the Parameter summary.