From Concept to Product - The Journey of Neocortex

Neocortex began with a straightforward goal: to simplify the development of smart NPCs (Non-Player Characters) with intelligent interactions in video games, and virtual assistants. This journey started roughly 2 years ago with curiosity and experimentation, driven by the rapid advancements in large language models (LLMs) and their accessibility via APIs.

When the AI boom accelerated, with LLMs becoming widely available through APIs, one question stood out: how could these technologies be used in video games? To explore this, I created an OpenAI-Unity SDK to connect their API with Oculus LipSync and Amazon Polly SDKs. This enabled seamless integration of smart NPCs into games, marking the initial step in bringing this vision to life.

After proving the concept, I shared my insights through YouTube tutorials, teaching others how to create smart NPCs in Unity. The OpenAI Unity package I developed as open-source gained significant traction, leading to requests for advisory support, contract work, and further assistance. While my tutorials covered the technical pipeline, it became clear that many developers still found the process challenging to implement.

Taking this feedback to heart, I envisioned a solution that would simplify, accelerate, and streamline the entire process. This led to the idea of developing a Unity SDK covering all functionalities and a node-based smart agent creation system to eliminate the need for extensive, manual prompt writing for character interactions.

Fueled by community interest and the desire to make an impact, I dedicated my evenings and weekends to building an MVP. After a month of effort, I successfully announced the project and began laying the groundwork for what would become Neocortex.

With a clear vision, I focused on tying up loose ends and refining the platform. Demos and SDKs were developed, tested extensively with early adopters and trusted friends. This iterative process helped ensure that Neocortex was both functional and developer-friendly.

Today, Neocortex is a reality. The platform combines a project dashboard, a node editor, and Unity SDKs to enable efficient and accessible creation of smart agents, intelligent NPCs, and virtual assistants. For Unity developers, Neocortex provides a powerful toolkit to integrate advanced AI-driven characters directly into their games, removing many of the technical hurdles associated with these systems.

This is just the beginning. As I move forward, new features and improvements are already in the works. Future plans include:

• Expanding compatibility with more game engines and environments, while continuing to prioritize Unity support.
• Enhancing support for a broader range of AI models, making it easier to build sophisticated virtual assistants and smart NPCs.
• Continuously refining the user experience based on community feedback, ensuring Neocortex stays at the forefront of smart agent development.

Neocortex is a platform built to evolve, and I am excited to grow alongside it's users. Whether you're an experienced Unity developer or just getting started with smart NPCs and virtual assistant design, I invite you to explore Neocortex and see how it can transform your workflow.

Please join me in this journey and be part of what's next.