Back
Explore the Neocortex VR demo voice chat with AI NPCs in Unity using XR Toolkit

Neocortex VR Demo - Smart Voice Enabled NPCs in Unity VR

Neocortex has just released an open-source VR demo on GitHub, letting developers and VR enthusiasts experience smart NPC interactions in immersive 3D environments. Built with Unity XR Interaction Toolkit and the Neocortex Unity SDK, this demo includes a fully-functional Chat UI that you can reposition in virtual space, plus real-time voice chat with a responsive NPC, no typing required!

Why It Matters for Your VR & AI Use Cases

  • Voice-activated smart NPCs: Talk naturally using your voice, powered by Neocortex's conversational AI, ideal for AI companions and training simulations.
  • 3D Chat UI: Drag and drop the chat interface anywhere in your VR scene—enhancing immersion and usability.
  • Fully open-source: Clone and customize the demo from GitHub, built on Unity XR Interaction Toolkit and Neocortex SDK.
  • Seamless integration: Demonstrates how to integrate ChatGPT style NPCs into VR games and apps using Unity.

What You Can Do With It?

Imagine walking through a virtual art gallery and asking an AI curator about each painting's history. That's the power of Neocortex. Or Explore a haunted mansion and interrogate a spectral butler for hidden clues. And maybe practice language skills by conversing with an AI tutor in a simulated classroom. It is all up to your imagination and all the possibilities VR and Neocortex with Smart NPCs provide to you.

How to Try It Now

The demo comes with Neocortex Unity SDK and Unity XR Interaction Toolkit already installed.

  1. Get the repo at https://github.com/neocortex-link/neocortex-vr-demo
  2. Open the scene at Assets/Scenes/Neocortex Test Scene
  3. Go to Neocortex and create a character and an API key
  4. Go to Tools/Neocortex Settings and set your API Key
  5. Paste your Project ID on Neocortex Smart Agent component
  6. Press Play, walk, talk, and interact with your smart NPC!

Tailored for Developers Who Love:

  • VR, XR, and immersive experiences
  • AI companions and ChatGPT-powered interactions
  • Unity based VR development using XR Interaction Toolkit
  • Smart NPCs driven by voice and context-aware intelligence

Ready to Build Your AI-Powered VR?

Bring voice-enabled AI to your VR projects, whether you're building games, training simulations, or virtual companions.

Star ⭐ the repo, explore the samples, and share your creations with the community!

https://github.com/neocortex-link/neocortex-vr-demo

Written by

Neocortex

Date

Thu, 26 Jun 2025