AI Characters for VR Escape Rooms: Hints You Ask For Out Loud

Escape room hints usually come from a button that flashes a line of text, or from a staff member's voice crackling through a speaker, and both break the spell. Neocortex lets the hint giver live inside the room: a character the players talk to, who knows every object around them, notices what they just did, and decides how much to give away.

What it looks like

Station Kelda is an original underwater research lab, built as a VR escape room for Meta Quest. Two players have forty minutes to restore power before the pressure doors seal. On the other side of a cracked observation window floats Dr. Ilse Marrow, the station's lead biologist, trapped in the flooded specimen bay and running out of patience.

The players are stuck at the control desk. One of them turns to the glass:

Player: Doctor, which of these valves do we open first? Dr. Marrow: Not the red one, unless you want to meet the octopus. Read the tags on the pipes. One of them still has my handwriting on it. Player: Found it. It says "B before C". Dr. Marrow: Good. Now you're thinking like a biologist. Try the drawer under the desk.

Her last reply carries an OPEN_DRAWER action aimed at the desk drawer, and the game plays the click of the latch. Inside is a fuse. When a player drops it and it rolls under the console, the game sends an event, and Dr. Marrow sighs at them through the glass.

If the players go quiet for too long, the game sends another event ("the players have been stuck on the fuse box for four minutes"), and her next line offers a nudge without being asked. When they finally restore power, the reply comes with FLICKER_LIGHTS, and the whole lab stutters back to life around them.

She was never given a hint tree. The designer wrote what she knows about the station, the puzzle solutions, and a rule: help, but make them work for it.

How Neocortex makes it work

• AI characters. Dr. Marrow is designed in the Neocortex visual node editor: personality, backstory, the puzzle solutions, how stingy she is with hints, her voice and her actions. Designers can play the room against her in the browser dashboard before the level is built.
• Interactables. The game sends the room's objects as metadata: valves, the fuse box, the drawer, the octopus tank, each with an ID, a name, a position and properties such as "locked" or "open". She refers to them by name and aims actions at their IDs.
• Events. Puzzle progress, dropped items, long silences and wrong attempts arrive as events, so her lines follow the players' actual run.
• Actions. OPEN_DRAWER, FLICKER_LIGHTS and OPEN_HATCH are Action nodes on the character. Several can come back in one reply, each with a target, and your game decides what they do.
• Voices, speech-to-text and lip sync. Players simply talk to the glass. Neocortex turns their speech into text, Dr. Marrow replies in a streamed voice, and the Unity SDK drives her facial blendshapes so her lips match her words.
• Emotions. Each line has an emotion tag: amused at a wrong guess, tense as the timer runs down, delighted when the power returns.
• Group chat. Add a second character, such as the station's sarcastic maintenance AI, and the two can argue about the right answer in one conversation (Pro and Team plans).
• Session memory. Keep the returned sessionId for the run, so the whole run is one continuous conversation and she can bring up what the players tried earlier.

Ideas to build

The haunted manor. A ghost called Lady Agatha haunts the library and wants her stolen locket found. She only gives hints in riddles, and when a player picks up the wrong portrait she returns FLICKER_LIGHTS and a chill line about manners. Events from the room tell her which bookshelves are already searched.

The spaceship AI. The players are the last crew awake on a drifting freighter, and the ship's computer, ORLA, talks them through the reboot. She knows every panel from metadata. Pair her with a hologram of the captain in group chat on the Pro or Team plan, and the two disagree about whether to vent the cargo bay while the players decide who to trust.

The heist room. A vault-cracking puzzle with an inside contact called Nico in the players' earpiece. He knows the guard rotation and the alarm layout, panics when an event reports a tripped laser, and returns CUT_CAMERAS when the players ask nicely and have earned it.

The co-op room. Two players in separate halves of a ruined observatory, each with their own character to talk to. Each character is sent only the objects in its own half, so the players have to swap what they learn to solve the final puzzle together.

Building it

VR escape rooms run on Meta Quest through Unity with the XR Interaction Toolkit and the Unity SDK. Our open-source VR demo already has the headset, microphone and character pieces wired up.

1. Design the puzzles first. Write down every step, the solution and what a good hint for each step looks like.
2. Create the character in the visual editor with the solutions in its knowledge, a personality that sets how freely it helps, a voice, and Action nodes for each effect the room can trigger.
3. Tag the room's objects as interactables with IDs, names and state properties, and send them as metadata with each message.
4. Send events for puzzle steps, mistakes and long pauses, so hints arrive when players need them.
5. Map actions to the room: latches, lights, hatches and sounds.
6. Playtest with people who haven't seen the room, and adjust how stingy the character is until the hints feel earned.

Give the character a clear limit on what it will reveal, like "never state a code outright, only where to find it." Players should feel clever, not carried.

Escape room characters are one entry in our AI NPC, ambient AI and voice command use cases. For other headset ideas read VR soft skills training with AI and voice commands in VR. The VR experiences page, the spatial awareness feature page and the interactables docs cover the rest. Start with one room, one puzzle and one character behind the glass.

Checked October 2026.

Frequently Asked Questions