Skip to main content

Overview

Runtime AI Chatbot Integrator Documentation

Runtime AI Chatbot Integrator is a cross-platform Unreal Engine plugin that enables seamless integration of AI chatbots and text-to-speech services directly into your projects. The plugin supports multiple leading AI providers, offering flexible chat interactions with both streaming and non-streaming response modes, as well as high-quality text-to-speech conversion with streaming capabilities.

Supported Features​

Text-to-Text Chat​

Integrate AI-powered conversational capabilities with multiple leading providers.

OpenAI​

  • GPT-3.5 Turbo
  • GPT-4o
  • GPT-4o Mini
  • GPT-4-32k
  • GPT-4 Turbo
  • O1
  • O1 Mini
  • O3 Mini

Claude (Anthropic)​

  • Claude 3.7 Sonnet
  • Claude 3.5 Sonnet
  • Claude 3.5 Haiku
  • Claude 3 Opus

DeepSeek​

  • DeepSeek Chat
  • DeepSeek Reasoner (with dedicated reasoning output)

Text-to-Speech (TTS)​

Convert text to natural-sounding speech using leading TTS providers, with both standard and streaming options.

OpenAI TTS​

Multiple voice options with regular and streaming support:

  • Alloy
  • Ash
  • Ballad
  • Coral
  • Echo
  • Fable
  • Onyx
  • Nova
  • Sage
  • Shimmer
  • Verse

ElevenLabs TTS​

Multiple models with regular and streaming support:

  • Eleven Multilingual V2
  • Eleven Monolingual V1
  • Eleven Turbo V2
  • Eleven Turbo V2.5
  • Eleven Flash V2.5

Key Features​

  • Cross-platform compatibility (Windows, Mac, Android, etc.)
  • Support for multiple AI and TTS providers
  • Streaming and non-streaming chat responses
  • Streaming TTS for real-time audio synthesis and processing
  • High-quality voice synthesis with minimal latency
  • Easy integration with Unreal Engine Blueprints and C++
  • Flexible configuration options

Prerequisites​

To use the plugin, you'll need API access credentials from one of the supported providers:

For audio processing, you can implement your own solution or use the Runtime Audio Importer plugin, which can import audio data in various formats (MP3, WAV, FLAC, OGG VORBIS, OGG OPUS, BINK, RAW (PCM)). For more information, see here.

Additional Resources​