How to use voice models

Selecting, Downloading, and Packaging Models

The plugin supports multiple languages, voices, and qualities. You can easily download and manage the voice models you need via the plugin settings in the editor. Follow these steps to select, download, and stage the voice models:

1. Open the project settings in the editor and navigate to Plugins -> Runtime Text To Speech.
2. In the Available Voice Models to Download list, click the Download button next to the voice model you want to download. You can download multiple voice models simultaneously.
3. After the download completes, the models will appear in the Downloaded Voice Models section at the top of the list, and they will be available for use in your project.
4. Optionally, you can preview the downloaded voice models by entering text into the text field and clicking the Play button. This will synthesize and play the text using the selected voice model. This feature is useful for testing within the editor to ensure the voice model sounds as expected.

To delete any downloaded voice models, click the Delete button next to the model you want to remove.

All downloaded voice models will be packaged with your project, so to reduce the project size, delete any voice models you no longer need.

Importing Custom Voice Models

In addition to the pre-configured voice models, you can import your own custom voice models. The plugin supports both Piper and Kokoro voice model formats:

1. In the plugin settings, click the Import Custom Voice Model button at the top of the screen.
2. In the dialog that appears, select the model type (Piper or Kokoro).
3. Browse and select your model file:
   • For Piper: Select an ONNX format model file (*.onnx)
   • For Kokoro: Select a BIN format style file (*.bin)
4. Browse and select the corresponding configuration file (*.json):
   • For Piper: This contains settings like sample rate, phoneme mappings, and inference parameters
   • For Kokoro: This contains the tokenizer configuration
5. For Kokoro models, specify the language code (e.g., en-us, en-gb-x-rp, fr, es, etc.)
6. Click Import to add the custom voice model to your project.

Notes on Custom Voice Models

• Piper Models: You can use custom-trained Piper voice models, which are particularly useful if you've trained your own voice or need a specific voice not available in the pre-configured list. The ONNX model and JSON config file must be compatible with the Piper format.

• Kokoro Models: These models use a two-part system: style files (BIN format) and a shared ONNX model. When you import a Kokoro style file for the first time, the plugin will offer to download the required ONNX model automatically.

• Language Codes: For Kokoro models, the language code is important for proper phoneme conversion. Common codes include:

  • English (US): en-us
  • English (UK): en-gb-x-rp
  • Spanish: es
  • French: fr
  • Italian: it
  • Portuguese (Brazil): pt-br
  • Chinese (Mandarin): cmn
  • Hindi: hi
  • German: de

Custom voice models are treated the same as downloaded models and will be packaged with your project.