Open-ended conversations with NPCs open up a world of possibilities for interactivity in games. However, conversation should have consequences that could lead to potential actions. To carry out actions from NPCs, they need to be aware of the world around them and be able to interact dynamically. With our partner Convai and their latest releases, we take our collaborative demo to the next level, enabling these AI NPCs with the following new features:
- Spatial Awareness - enables game characters to identify and interact with objects and engage in conversations about their surroundings. For example, the player can point at items, and the character will talk about the item intelligently.
- Actions - enable game characters to interact with items in the game world based on the conversation. For example, delivering a bottle of sake when requested.
- NPC-to-NPC Interaction - enables game characters to interact with each other, bringing the world alive even when the player is idle.
In addition, Convai has integrated the new NVIDIA ACE microservices: Audio2Face and Riva ASR. With the addition of the new ACE microservices in Convai’s pipeline, game characters will have improved lip sync, better expression, and accurate speech detection when listening to the player.