This week, NVIDIA introduced the Avatar Cloud Engine (ACE) technology, which allows users to communicate normally with NPCs (Non-Player Characters) and receive responses in the same way as conversations with other chatbots. The company broke the news during Computex 2023 with a demo called Kairos in which the user is talking to an NPC named Jin.

The setting is a ramen shop with a very dystopian feel. In the demo, we see a simulated conversation with the NPC Jin. While the user asks “Hi Jin, how are you?”. An NPC with ACE AI replies, “Unfortunately, I’m unwell.” When asked why, the NPC replies, “I’m worried about the crime here. The situation has been getting worse lately. My ramen shop got caught in the crossfire.” You can check out the demo in the video below.

Chat with AI-based NPCs

The conversation itself is quite general, but what is interesting is that the idea of ​​the demonstration is to show what it was generated automatically by generative AI. The dialogue is even a little bland, with a very poor presentation of what players are used to in games, but it opens up new opportunities for the development of AI technologies. NVIDIA is investing in artificial intelligence and held a demo using Unreal Engine 5, the world’s most popular game engine.

According to the company, AI ACE uses NVIDIA NeMo to create, customize and deployment of large language models that can be customized with character knowledge and stories, protecting from inappropriate conversations. It also implements a speech-to-text and speech recognition tool called Riva, as well as NVIDIA’s Omniverse Audio2Face.instantly create expressive facial animation of a game character for any speech track“.

The technology is pretty impressive, even though it’s just a demo. It’s still too early to see a full implementation of something like this in a game, but it’s certainly the rapid development of AI in various areas of technology that never ceases to impress and, in some cases, worry.

NVIDIA and MediaTek bring artificial intelligence to every type of car
The chip will feature enhanced performance for the Dimensity Auto system

Source: Engadget

…..