Minecraft AI NPC Mod: Talking Villagers and Voice Commands

Minecraft villagers grunt, shuffle and trade through a fixed menu. Modders have been trying to make them talk for years. A Minecraft AI NPC mod built with Neocortex gives each villager a personality, a memory of the player and a voice, and lets them act on what is said. Add Conversation Flows, a quiz engine and on-device voice commands, and the same mod can run a classroom lesson or a helper who follows spoken orders.

Screenshot: Minecraft © Mojang Studios

What you could build with Neocortex in Minecraft

Villagers who talk and trade by conversation

A librarian who remembers you saved the village from a raid, and gives you a better price on that enchanted book because of it. A farmer who complains about the creeper hole in his wheat field and asks you to fix it before he sells you carrots.

Your mod sends the facts with each message: the villager's profession, the player's emeralds, reputation, nearby blocks and recent events like "raid defeated". The character answers with text, an emotion tag and actions like { "name": "OFFER_TRADE", "targetId": "enchanted_book" }. Your mod opens the trade screen with that offer, so the conversation and the economy stay linked.

A teacher NPC for the classroom

On a class's Java server, a teacher NPC stands at the front of a build and explains a topic in plain words. Upload the lesson notes as a PDF to the character's Knowledge node and it answers from them.

Then it runs a quiz: redstone logic gates, biomes and climates, or vocabulary for a language class, in any of 20+ languages. The quiz engine (Team plan) handles the questions, scoring and a leaderboard, and your mod hands out a reward block or opens a door when a student passes. Conversation Flows fit guided lessons too: the teacher walks students through checkpoints and your mod opens the next room on each flowState keyword.

Voice commands for a helper NPC

Give your mod a helper NPC, call it Pip, and design a command set with actors ("Pip", "everyone"), actions ("follow", "wait", "chop", "mine", "bring") and objects ("me", "oak logs", "iron", "that tree").

"Bring me sixteen oak logs" arrives as one command with the quantity attached. "Chop that tree and then follow me" arrives as two. Matching happens on the player's PC, so Pip reacts the moment you stop talking, even mid-fight.

How Minecraft modding works

Java Edition mods are Java jars loaded by a mod loader. The two main loaders in October 2026:

• Fabric: a lightweight, modular loader with the Fabric API library and developer docs, including a mod template generator.
• NeoForge: a full-featured loader with its own documentation and a mod generator.

Both track new releases closely. Minecraft 26.1 and newer run on Java 25, and since 26.1 the game ships without obfuscation, so mods work against Mojang's own names. Mods are usually published on Modrinth or CurseForge.

Where code runs matters. Server-side code owns villagers, inventories and trades, and is the natural place to call a web API. Client-side code owns the microphone, subtitles (a chat line or a HUD overlay) and audio playback, which can use Java's own audio APIs for a WAV reply. Java's built-in HttpClient handles the network calls, and Gson already ships with the game for JSON.

Community mods already add chat-based AI companions to Minecraft; the pieces below are what a Neocortex mod looks like.

Screenshot: Minecraft © Mojang Studios

How Neocortex fits in

• Dialogue. The mod reads game state, sends it to a Neocortex character through /v3/chat, shows the reply as subtitles, plays the voice from /v3/audio/generate or /v3/audio/stream, and runs the actions the character returns.
• Conversation Flows. Flows steer story beats or lesson steps and return checkpoint keywords the mod reacts to.
• Quizzes. The quiz engine runs question-and-answer games through /v3/quiz.
• Voice commands. The Neocortex Voice Commands library on the player's machine turns spoken phrases into game actions without a cloud round trip.

A minimal chat call from a Fabric or NeoForge mod, sent off the main thread:

JsonObject body = new JsonObject();
JsonArray ids = new JsonArray();
ids.add(config.characterId());
body.add("characterIds", ids);
body.addProperty("message", playerText);
body.addProperty("playerId", player.getStringUUID());
body.addProperty("sessionId", sessionId); // "" on the first call

HttpRequest req = HttpRequest.newBuilder(URI.create("https://api.neocortex.link/v3/chat"))
    .header("x-api-key", config.apiKey())
    .header("Content-Type", "application/json")
    .POST(HttpRequest.BodyPublishers.ofString(body.toString()))
    .build();

HTTP.sendAsync(req, HttpResponse.BodyHandlers.ofString()).thenAccept(res -> {
    JsonObject reply = JsonParser.parseString(res.body()).getAsJsonObject();
    sessionId = reply.get("sessionId").getAsString();
    // messages[0].lines -> subtitles; actions -> run them back on the server thread
});

Characters are built in a visual node editor with personality, emotion, knowledge, language and voice nodes. Up to six characters can share one conversation on Pro and Team plans, enough for a village council. For how this compares with other AI character platforms, see our comparison page.

Getting started

1. Pick a loader. Set up a Fabric or NeoForge mod project from the official generator.
2. Design the characters in the Neocortex dashboard: one per villager profession, a teacher with lesson notes, a question set for the quiz. Test them in the browser.
3. Design a command set for your helper NPC, with a few example phrases per action.
4. Connect from the mod. Call /v3/chat asynchronously, reuse the sessionId, and map returned actions to game code.
5. Keep the API key in a config file the player or server admin fills in, never hard-coded in a shared mod.
6. Test in a single-player world first, with push-to-talk, before inviting a class.

Voice Commands is a licensed SDK: contact us for a Voice Commands license.

Mod policy and fair play

Keep the mod free and follow Mojang's Minecraft Usage Guidelines and EULA. Use it in single-player worlds or on private servers where every player has opted in, never on public servers against their rules. For classrooms, check your school's rules on student data before connecting any online service. Each player or server uses its own Neocortex API key.

For the voice side in more depth, read on-device voice commands for game mods. Building for a cozier game? See our Stardew Valley AI villager mod guide, or browse every game in our AI NPC and voice command mods index.

Tool versions and links checked October 2026. Modding tools change often; check each project's page for the latest release.

Frequently Asked Questions