Neocortex Logo

Meta Quest via Unity

AI NPCs for Meta Quest

Players talk to characters instead of picking lines with a controller. Design the character in the browser and bring it into your Unity XR project with the Neocortex Unity SDK. The model runs on Neocortex servers, not on the headset.

  • Free plan
  • No credit card
  • Unity, Unreal, Godot, Web SDK and Web API
Cora, the Neocortex AI character, waving hello
  • 5

    ways to integrate

    Unity, Unreal, Godot, Web SDK, Web API

  • 20+

    languages

    set per character

  • 10 s

    to clone a voice

    or design one from text

  • €0

    to start

    free plan and editor testing

Powered by Industry Leaders

CDG Booster ProgramTehnopol AI AcceleratorNvidia Inception ProgramMicrosoft Partner | Microsoft for StartupsAWS Partner | AWS StartupsCloudflare Startup ProgramFal AI Startup ProgramElevenLabs Grants
CDG Booster ProgramTehnopol AI AcceleratorNvidia Inception ProgramMicrosoft Partner | Microsoft for StartupsAWS Partner | AWS StartupsCloudflare Startup ProgramFal AI Startup ProgramElevenLabs Grants

Get started

From zero to a talking character in Meta Quest

  1. 1

    Design your character

    Build personality, knowledge, voice and actions in the visual editor, and test it in the browser.

  2. 2

    Install the Unity SDK

    In your XR project, open Package Manager, choose Add package from git URL and paste:

    https://github.com/neocortex-link/neocortex-unity-sdk.git
  3. 3

    Put it in the headset

    Paste your API key in Tools > Neocortex > Settings, add a Smart Agent, an Audio Source and an Audio Receiver to the character, pick it and build to the Quest.

Requirements

  • Unity 6 (6000.0) or later with the Android build target
  • An XR setup such as the XR Interaction Toolkit
  • A free Neocortex account and API key
Read the Meta Quest docs

What you get

Built for Meta Quest developers

01

Hands-free voice

Voice detection by default, or push-to-talk on a controller button, with the Android microphone permission handled.

02

Light on the headset

The Quest records the player and plays the reply. The character's model runs on Neocortex servers.

03

Open-source VR demo

A scene on GitHub built with the XR Interaction Toolkit, with voice chat and a chat panel you can move.

04

Objects it can act on

Mark objects as Interactable, and the character can talk about them and target them with actions.

05

Lip sync and emotion

The Face Animator moves the mouth as the character speaks, and every line carries an emotion for expressions.

06

Same character everywhere

The character you build also works in Unreal, Godot and on the web.

07

Voice starts sooner

Characters start speaking as the voice arrives instead of waiting for the whole clip.

08

Remembers the player

The SDK saves a session per character, so the NPC picks up the conversation next time the headset is on.

09

Several NPCs at once

NeocortexGroupDirector puts several characters in one conversation and decides who answers, on a Pro or Team plan.

How it works

Characters you design, not prompts you babysit

  • Personality, emotion, knowledge and world are nodes you connect, not prompts you rewrite.
  • Intents and actions turn what a player says into something your game does.
  • Test every character in the browser for free before it reaches your engine.
neocortex.link/dashboard/characters
Neocortex visual character editor: emotion, personality, knowledge, language and voice nodes connected to an agent in a world, with intents mapped to in-game actions

What Our Customers Say

Discover what creators are saying about building with Neocortex.

After trying several Smart NPC providers, I came across Neocortex while looking for a stateful conversational AI solution for our Virtual Education platform. Neocortex stood out and topped all our key considerations.

Vallikat Peethamber
Managing Director

Neocortex opened scalable solutions for our VR platform, letting us create scenarios that make training more immersive. Keeping AI agents within clear boundaries is hard, but Neocortex handles it very well and makes customization easy.

Ottó Farkas
IT Specialist / Project Manager

In classroom practice, Neocortex and its action-based mechanism provide students with an out-of-the-box way to bridge conversational agents into software and hardware-based interaction design workflows.

Hongming Li
Lecturer / Instructor

I found out about Neocortex while I was working on my final-year project, and the platform's ease of integration and accessibility enabled me to seamlessly implement smart NPCs in my application. Highly recommend it!

Angela Pellillo
Backend Developer

Neocortex was the first step in bringing LLM-powered NPCs into a real Unity3D prototype, fast-tracking development and growing my TikTok account from 0 to 4000 followers within a month!

Brandan Chen
Associate Game Producer

After trying several Smart NPC providers, I came across Neocortex while looking for a stateful conversational AI solution for our Virtual Education platform. Neocortex stood out and topped all our key considerations.

Vallikat Peethamber
Managing Director

Neocortex opened scalable solutions for our VR platform, letting us create scenarios that make training more immersive. Keeping AI agents within clear boundaries is hard, but Neocortex handles it very well and makes customization easy.

Ottó Farkas
IT Specialist / Project Manager

In classroom practice, Neocortex and its action-based mechanism provide students with an out-of-the-box way to bridge conversational agents into software and hardware-based interaction design workflows.

Hongming Li
Lecturer / Instructor

I found out about Neocortex while I was working on my final-year project, and the platform's ease of integration and accessibility enabled me to seamlessly implement smart NPCs in my application. Highly recommend it!

Angela Pellillo
Backend Developer

Neocortex was the first step in bringing LLM-powered NPCs into a real Unity3D prototype, fast-tracking development and growing my TikTok account from 0 to 4000 followers within a month!

Brandan Chen
Associate Game Producer

From idea to playable character in a weekend

Game-jam teams use Neocortex to put talking, acting AI characters into playable games within a single weekend.

Read a game jam story

FAQ

Neocortex for Meta Quest: common questions

Is there a Neocortex SDK for Meta Quest?

Not a separate one. Meta Quest apps use the Neocortex Unity SDK in a Unity XR project, for example with the XR Interaction Toolkit.

Does it work offline on the headset?

No. Characters run on Neocortex servers, so the headset needs an internet connection. Studios can also run the Neocortex platform on their own infrastructure.

Is there a VR demo to start from?

Yes. Our open-source VR demo on GitHub pairs the Neocortex Unity SDK with the XR Interaction Toolkit for voice chat with an NPC.

Can players talk without pressing a button?

Yes. The Audio Receiver listens with voice detection by default. Switch to push-to-talk if players prefer holding a trigger.

Can I run a quiz show in VR?

Yes. The Unity SDK's NeocortexQuizAgent runs on Meta Quest like the rest of the SDK, so a character can host a spoken quiz in the headset from a question set you write in the dashboard. Quizzes need a Team plan.

Can I limit how much each player uses?

Yes. The Unity SDK sends each device's id as the player id, so per-player credit limits set in the dashboard apply per headset. NeocortexUsageGate checks them before a message is sent.

Can the character speak in a custom voice?

Yes. A character can speak in a basic, cloned or designed voice, set in the editor and used the same way in the headset. Cloned voices need a Pro or Team plan.

Comparing tools?

How Neocortex compares for Meta Quest teams

Talk to your NPC in VR

Free plan, no credit card. Build a character in the browser and talk to it in minutes.