Runtime Speech Recognizer
Documentation for the Runtime Speech Recognizer plugin.
- Get it on Fab
- Product website
- Download Demo (Windows)
- Video tutorial (older video)
- Plugin Support & Custom Development: [email protected] (tailored solutions for teams & organizations)
Overview
Runtime Speech Recognizer Documentation
How to use the plugin
The Runtime Speech Recognizer plugin is designed to recognize words from incoming audio data. It uses a slightly modified version of whisper.cpp to work with the engine. To use the plugin, follow these steps:
Selecting and Downloading Language Models
Currently, the plugin is designed to support a single language model, selected in the editor beforehand, to be packaged and used with the project. Follow these steps to select, download, and stage a specific language model:
Recognition Parameter List
These parameters can only be set while the recognizer is not running.
Supported languages
This is the complete list of languages supported by the available language models.
Commands Recognition
Compute Levenshtein Similarity
Troubleshooting
Language Model Staging Issues
Demo Project
Packaged Demo Project for Windows.
How to Improve Performance
The plugin uses different GPU acceleration methods depending on the platform
Vosk Extension
By default, the Runtime Speech Recognizer plugin uses whisper.cpp for recognition. On platforms without GPU acceleration support in whisper.cpp, most notably Android and Android-based platforms such as Meta Quest, recognition falls back to CPU + intrinsics, which is slower and heavier on battery life. The Vosk extension plugin adds an alternative provider based on Vosk, a lightweight speech recognition toolkit that works well on constrained hardware and performs especially well on Meta Quest.