Skip to main content

Overview

Runtime AI Chatbot Integrator Documentation

Runtime AI Chatbot Integrator is a cross-platform Unreal Engine plugin that enables seamless integration of AI chatbots and text-to-speech services directly into your projects. The plugin supports multiple leading AI providers, offering flexible chat interactions with both streaming and non-streaming response modes, as well as high-quality text-to-speech conversion with streaming capabilities.

Supported Features​

Text-to-Text Chat​

Integrate AI-powered conversational capabilities with multiple leading providers.

OpenAI​

  • GPT-3.5 Turbo
  • GPT-4o
  • GPT-4o Mini
  • GPT-4-32k
  • GPT-4 Turbo
  • GPT-4-1
  • ChatGPT-4o Latest
  • O1 Pro
  • O1
  • O3
  • O3 Mini
  • O4 Mini

Claude (Anthropic)​

  • Claude 3.7 Sonnet
  • Claude 3.5 Sonnet
  • Claude 3.5 Haiku
  • Claude 3 Opus

DeepSeek​

  • DeepSeek Chat
  • DeepSeek Reasoner (with dedicated reasoning output)

Text-to-Speech (TTS)​

Convert text to natural-sounding speech using leading TTS providers, with both standard and streaming options.

OpenAI TTS​

Multiple voice options with regular and streaming support:

  • Alloy
  • Ash
  • Ballad
  • Coral
  • Echo
  • Fable
  • Onyx
  • Nova
  • Sage
  • Shimmer
  • Verse

ElevenLabs TTS​

Multiple models with regular and streaming support:

  • Eleven V3 (Latest model with human-like and expressive speech generation, supports 70+ languages)
  • Eleven TTV V3 (Text to Voice design model with human-like and expressive speech, supports 70+ languages)
  • Eleven Multilingual V2 (Most lifelike model with rich emotional expression)
  • Eleven Turbo V2 (High quality, low-latency model optimized for English)
  • Eleven Turbo V2.5 (High quality, low-latency model with multilingual support)
  • Eleven Flash V2 (Ultra-fast model optimized for real-time use in English)
  • Eleven Flash V2.5 (Ultra-fast model optimized for real-time use with multilingual support)

Key Features​

  • Cross-platform compatibility (Windows, Mac, Android, etc.)
  • Support for multiple AI and TTS providers
  • Streaming and non-streaming chat responses
  • Streaming TTS for real-time audio synthesis and processing
  • High-quality voice synthesis with minimal latency
  • Easy integration with Unreal Engine Blueprints and C++
  • Flexible configuration options
  • Support for 70+ languages with ElevenLabs V3 models

Prerequisites​

To use the plugin, you'll need API access credentials from one of the supported providers:

For audio processing, you can implement your own solution or use the Runtime Audio Importer plugin, which can import audio data in various formats (MP3, WAV, FLAC, OGG VORBIS, OGG OPUS, BINK, RAW (PCM)). For more information, see here.

Additional Resources​