Ambient NPC Conversations: Game Worlds That Talk Without You

Walk into most game taverns and the regulars stare at their mugs until you click on one of them. Ambient NPC conversations change that: the blacksmith complains to the innkeeper about prices, the guards argue about the night shift, and the room keeps living whether or not the player says a word. Neocortex lets a group of AI characters hold that conversation on their own, react when someone walks in, and turn to the player the moment they speak.

What it looks like

The Copper Kettle is a roadside inn in an original fantasy game. Three characters sit near the fire: Maren, the innkeeper, tired and practical; Osric, a caravan guard who exaggerates everything; and Tilde, a young cartographer who has just come back from the northern pass.

The player walks in and sits down. Nobody speaks to them yet. The game requests an ambient turn, and the room picks up where it left off:

Osric: Twelve wolves. Maybe fifteen. I stopped counting after the first dozen. Tilde: There were four, Osric. I drew them. You can see the map. Maren: Whatever it was, the road is closed until spring, and my cellar is half empty.

A minute later the game adds a merchant character to the scene. The others notice: Maren asks if he brought salt, and Osric goes quiet when the merchant mentions the wolves. Then the player asks Tilde about the pass. She answers them directly, unrolls her map with an action the game plays as an animation, and Osric interrupts to correct a detail he got wrong.

Nothing in that scene was scripted line by line. The writer defined three characters, what each one knows and what they can do.

How Neocortex makes it work

• Group chat puts up to six characters in one shared conversation (Pro and Team plans). Each character keeps its own personality, voice and knowledge.
• Ambient turns are a chat request with no player message. The characters talk among themselves and the response lists each line, who said it and with which emotion.
• An AI director decides who speaks next. When a beat needs a specific character, you force a speaker with speakerCharacterId.
• A dynamic cast comes from the list of characters you send. Add a character and the others greet them; remove one and the others acknowledge they left. Late joiners only hear the talk from the moment they arrived, like a real person walking in.
• Events tell the room what just happened in your world ("a storm started", "the player is wounded"), so ambient talk follows the game instead of drifting.
• Actions come back with each line, so a character can pour a drink, open a door or point at a map while it speaks.
• Voices and emotions come with every reply: streamed audio per character, plus an emotion tag your animation system can use.

Ideas to build

The market square. Two stallholders compete for customers and trade insults about each other's fruit. When the player walks past, one calls out an offer. When the player buys from the rival, the next ambient turn is about that.

A ship's crew between missions. A pilot, an engineer and a medic chat on the bridge during the long flight to the next system. Feed in events from the last mission ("the engineer's repair failed", "the player saved the medic") and the crew talks about what actually happened in this playthrough, not a generic script.

Guards on a wall. Two guards pass the time on patrol. A stealth player who stays hidden hears useful details about the shift change. Raise an event when a noise is heard, and the next ambient turn turns suspicious.

A radio drama in the background. In a driving or survival game, two hosts on an in-world radio station discuss the news of the day, drawn from events in your world, while the player does something else.

Building it

Ambient conversations work anywhere you can make an HTTPS request. The Unity SDK wraps them in a group director component with a Continue() call. Unreal, Godot and web games call the Web API directly.

1. Create the characters in the Neocortex visual editor: personality, backstory, what they know about the place and the others, a voice, and the actions they may return.
2. Test the scene in the dashboard's group preview with the "Start scene" and "Continue" buttons, before writing any game code.
3. Request ambient turns on a timer or when the player enters a zone. Keep the returned sessionId and send it with every turn.
4. Play each line with its voice and emotion, and run any actions it carries.
5. Send player speech into the same session when the player talks, so the characters answer and then carry on.
6. Change the cast as characters enter and leave, by adding or removing them from the list you send.

An ambient turn from any engine:

const res = await fetch("https://api.neocortex.link/v3/chat", {
  method: "POST",
  headers: {
    "x-api-key": apiKey, // load from your own config, never hard-code it
    "Content-Type": "application/json",
  },
  body: JSON.stringify({
    characterIds: [maren, osric, tilde], // the cast in the room right now
    sessionId,                            // empty on the first turn
    maxTurns: 3,
    events: [{ priority: 1, content: "A storm has just started outside" }],
    // no "message": the characters talk among themselves
  }),
});
const { sessionId: next, messages } = await res.json();
// messages: [{ name, lines: [{ text, emotion }], actions }] in speaking order

Keep ambient turns short and spaced out. Two or three lines every so often feels like a living room; a constant stream feels like a podcast the player can't turn off.

Ambient conversations are one part of our AI NPC, ambient AI and voice command use cases. For worlds that react to the player, read NPCs that react to world events, and for browser worlds see AI residents for metaverse worlds. The dynamic characters page and the group chat docs cover the rest. Start with two characters at one table and listen.

Checked October 2026.

Frequently Asked Questions