AI · AI Bot · Interactive
FireBot Voice AI & Generative Sketch-to-AI Event Platform
An end-to-end interactive AI platform engineered completely from scratch in Unity 3D, combining a real-time conversational voice agent with RAG knowledge retrieval alongside a high-precision sketch-to-AI generation pipeline.
- Client
- TheHangingHouse
- Studio
- TheHangingHouse (Codebrew)
- Platform
- Desktop
A multi-system AI event installation platform architected and developed completely from scratch in Unity 3D to deliver real-time interactive experiences. The primary system powers FireBot, a low-latency conversational voice agent: live audio input is captured and transcribed via Azure Speech-to-Text, processed through a custom Retrieval-Augmented Generation (RAG) module to extract factual context regarding "The Hanging House," and routed into streaming OpenAI GPT models. Response tokens feed directly into ElevenLabs via stream-chunking for instant audio playback, eliminating speech turnaround delay. Operating alongside the voice agent within the activation suite is a high-precision Sketch-to-AI engine, which streams user touch canvas brushstrokes to a cloud-hosted Automatic1111 / Stable Diffusion backend to render structural image-to-image AI artwork in real time.
