MSFS AI Copilot: Voice Commands and an AI First Officer

Flying a long leg alone in Microsoft Flight Simulator means running every checklist, every switch and every callout yourself. An MSFS AI copilot takes half of that work: a first officer who reads the checklist, checks the gear is actually down, answers "what is our fuel at destination?", and moves the flaps when you say so. Neocortex gives your SimConnect app the AI character, Conversation Flows, a quiz engine and on-device voice commands to build it, for both MSFS 2020 and MSFS 2024.

Screenshot: Microsoft Flight Simulator 2024 © Xbox Game Studios

SimConnect app or WASM module?

MSFS add-ons that need custom code use the SDK, which you download from inside the sim after turning on Developer Mode. Code runs in one of two places, and the choice decides how your copilot is built.

A SimConnect client is a standalone app that connects to the running sim, written in C, C++ or any .NET language through the managed wrapper. The SDK docs recommend this route, because a crash in your app typically does not take the sim down with it. It reads SimVars, sends key events with SimConnect_TransmitClientEvent, calls web APIs, uses the microphone and plays audio like any Windows app.

A WASM module is C++ compiled to WebAssembly that runs inside the sim. Its Network API can make HTTPS requests, with a small limit on requests in flight at once.

For an AI copilot, the external SimConnect app is the natural home. Show subtitles in a small window on a second screen or an overlay. The same app works with MSFS 2020, documented in the MSFS 2020 SimConnect SDK, and the 2024 SDK keeps modules built for 2020 running.

Voice commands mapped to SimConnect key events

Short cockpit commands need to be instant. You design a command set with actors ("first officer", "copilot"), actions ("gear up", "gear down", "flaps", "lights on", "engage") and objects ("landing lights", "strobes", "nav lights", "autopilot"), and your app maps each matched command to a key event:

"Gear up, flaps up" arrives as two commands. Matching runs on the player's PC with no cloud round trip, so it works offline on a five-hour crossing.

Study-level add-on aircraft often run their own systems, so check how each one exposes its switches before mapping commands.

Voice Commands is a licensed SDK: contact us for a Voice Commands license.

Screenshot: Microsoft Flight Simulator 2024 © Xbox Game Studios

A flight with your AI first officer

A Conversation Flow keeps the flight on rails, from before start to shutdown, returning checkpoint keywords like TAXI_CHECK_DONE or APPROACH_BRIEFED your app reacts to.

In cruise, each message carries live flight data as events: altitude, airspeed, fuel, flap position, next waypoint. Ask "how much fuel will we have on arrival?" or "what is the field elevation?" and the first officer answers from the numbers and the aircraft notes you uploaded to its Knowledge node.

Before landing, the first officer calls "Landing checklist" and works through it challenge and response. Your app checks each answer against SimVars, so "Gear down, three green" only passes when the gear really is down. When the character returns an action such as { "name": "LANDING_LIGHTS_ON", "targetId": "landing_lights" }, your app sends the matching event to the sim.

Study time at cruise

Turn the cruise into study time. A flight instructor character runs a quiz on phraseology, airspace classes and METAR decoding: "What does squawk 7600 mean?" "What does BKN mean in a METAR?" The quiz engine (Team plan) runs the questions, scoring and a leaderboard for your virtual flight school, and the instructor explains each answer. Treat it as a study aid, not a replacement for real training.

AI-driven voice ATC add-ons already exist for the sim; this guide focuses on the cockpit side.

The Neocortex side of an MSFS AI copilot

• Dialogue. The app reads flight state, sends it to a Neocortex character through /v3/chat, shows the reply as subtitles, plays the voice from /v3/audio/generate or /v3/audio/stream, and runs the actions the character returns through SimConnect.
• Conversation Flows. Flows steer the flight phases and return checkpoint keywords the app reacts to.
• Quizzes. The quiz engine runs the training questions through /v3/quiz.
• Voice commands. Neocortex Voice Commands runs on the player's machine and turns spoken phrases into cockpit actions without a cloud round trip.

Characters are built in a visual node editor with personality, emotion, knowledge, language and voice nodes, in 20+ languages with accents, so your first officer can brief in French or Spanish. Up to six characters can share one conversation on Pro and Team plans: captain's banter with the first officer and a cabin crew member. For how Neocortex compares with other AI character platforms, see our comparison page.

Shared cockpits and online networks

Follow the license terms that come with the MSFS SDK and Microsoft's Game Content Usage Rules, and keep a free, non-commercial project free. Fly with it solo; in shared cockpits, multiplayer or online ATC networks, use it only where their rules allow. Each player uses their own Neocortex API key.

Start with one aircraft

1. Install the SDK from the sim's Developer Mode and build a basic SimConnect app in C# or C++.
2. Design the first officer in the Neocortex dashboard, with your aircraft notes as knowledge, a flight-phase flow and a training question set. Test them in the browser.
3. Design a cockpit command set for gear, flaps, lights and autopilot, with a few example phrases per action.
4. Connect from the app. Call /v3/chat off the SimConnect thread, reuse the sessionId for the whole flight, and map returned actions to key events.
5. Keep the API key in a config file the player fills in, never hard-coded in a shared add-on.
6. Test offline in a default aircraft with push-to-talk before moving to add-on aircraft.

A default aircraft and the landing checklist are enough for a first flight with a Neocortex first officer. For the voice side in more depth, read on-device voice commands for game mods. Prefer the road to the sky? See our Euro Truck Simulator 2 AI co-driver mod guide or the full AI NPC and voice command mods index.

Tool versions and links checked October 2026. Modding tools change often; check each project's page for the latest release.

Frequently Asked Questions