One of the industry giants spearheading the AI arms race, Nvidia, never stops coming up with novel applications for AI. The business today revealed that ACE, an AI-powered technology, will launch as a game the following year.
Nvidia stated in a blog post that the first game to take advantage of this new AI-powered system will be Mecha BREAK, an action game by Seasun Games. Nvidia CEO and co-founder Jensen Huang unveiled Nvidia ACE at Computex 2023. It will combine AI and gaming in a novel way by employing generative AI (GenAI) in NPCs to make them as interactive as possible.
Mecha BREAK players can now “interact using natural language” with the in-game NPCs, as stated by Nvidia in the blog post. You can see ACE in action in Mecha BREAK in an Nvidia demo. Using your webcam and OpenAI’s ChatGPT-4o large language model (LLM), the NPCs will be able to “see gamers and identify people and objects in the real environment.”
Fascinatingly, Nvidia disclosed that OpenAI’s auto-speech recognition model and Nvidia’s Audio2Face-3D NIM and Whisper would be used by Mecha BREAK to enable face animation and voice recognition. The cloud will be used by Elevenlabs to power the characters’ voices. On the other hand, the NPCs’ responses in the video demo were monotone. Naturally, Mecha BREAK will not be out until later in the year, giving developers more time to polish the technology before it launches.
