From Concept to Product - The Journey of Neocortex

Neocortex began with a straightforward goal: to simplify the development of smart NPCs (Non-Player Characters) with intelligent interactions in video games, and virtual assistants. This journey started roughly 2 years ago with curiosity and experimentation, driven by the rapid advancements in large language models (LLMs) and their accessibility via APIs.

When the AI boom accelerated, with LLMs becoming widely available through APIs, one question stood out: how could these technologies be used in video games? To explore this, we created an OpenAI-Unity SDK to connect their API with Oculus LipSync and Amazon Polly SDKs. This made it possible to put smart NPCs into games, marking the initial step in bringing this vision to life.

After proving the concept, we shared what we learned through YouTube tutorials, teaching others how to create smart NPCs in Unity. The open-source OpenAI Unity package gained significant traction, leading to requests for advisory support, contract work, and further assistance. While the tutorials covered the technical pipeline, it became clear that many developers still found the process challenging to implement.

Taking this feedback to heart, we envisioned a solution that would simplify, accelerate, and streamline the entire process. This led to the idea of developing a Unity SDK covering all functionalities and a node-based smart agent creation system to eliminate the need for extensive, manual prompt writing for character interactions.

Fueled by community interest and the desire to make an impact, we dedicated evenings and weekends to building an MVP. After a month of effort, we announced the project and began laying the groundwork for what would become Neocortex.

With a clear vision, we focused on tying up loose ends and refining the platform. Demos and SDKs were developed, tested extensively with early adopters and trusted friends. This iterative process helped ensure that Neocortex was both functional and developer-friendly.

Today, Neocortex is a reality. The platform combines a project dashboard, a node editor, and Unity SDKs to enable efficient and accessible creation of smart agents, intelligent NPCs, and virtual assistants. For Unity developers, Neocortex provides a powerful toolkit to integrate advanced AI-driven characters directly into their games, removing many of the technical hurdles associated with these systems.

This is just the beginning. As we move forward, new features and improvements are already in the works. Future plans include:

• Expanding compatibility with more game engines and environments, while continuing to prioritize Unity support.
• Enhancing support for a broader range of AI models, making it easier to build sophisticated virtual assistants and smart NPCs.
• Continuously refining the user experience based on community feedback, ensuring Neocortex stays at the forefront of smart agent development.

Neocortex is a platform built to evolve, and we are excited to grow alongside its users. Whether you're an experienced Unity developer or just getting started with smart NPCs and virtual assistant design, we invite you to explore Neocortex and see how it can transform your workflow.

Please join us on this journey and be part of what's next.