Nvidia CEO Jensen Huang showcased an immersive glimpse into the future of gaming at Computex 2023 in Taipei. The demonstration exhibited the collision of gaming and AI through a visually stunning rendering of a cyberpunk ramen shop, where players can engage in real-time conversations with video game characters using their own voices.
The concept envisions a departure from traditional dialogue options, allowing players to simply hold a button, speak with their own voice, and receive responses from the in-game character. While the showcased dialogue left room for improvement, Nvidia's innovative approach to natural speech recognition opens up exciting possibilities for immersive gaming experiences.
The conversation revolved around a concerned player interacting with Jin, the shop proprietor, discussing rising crime rates and a notorious crime lord named Kumon Aoki. The AI-generated dialogue responded to the player's inquiries, providing information on where to find the crime lord and urging caution.
While the showcased chatbot dialogue may not have been groundbreaking, the remarkable aspect was the generative AI's ability to process and respond to natural speech. Nvidia's demo left viewers eager for a hands-on experience to explore the potential for diverse outcomes and more engaging interactions.
The demo was created in collaboration between Nvidia and Convai, aimed at promoting their tools, including the Nvidia ACE (Avatar Cloud Engine) for Games middleware. The ACE suite comprises various components, such as NeMo tools for deploying large language models, Riva for speech-to-text and text-to-speech capabilities, among others.
Beyond the chatbot conversation, the demo showcased the visual prowess of Unreal Engine 5, incorporating ray-tracing technology to deliver stunning graphics. While the chatbot aspect may have felt underwhelming in comparison, the demo highlighted the potential for combining realistic visuals with AI-driven dialogue.
During a Computex pre-briefing, Nvidia's VP of GeForce Platform, Jason Paul, confirmed that the technology could scale to multiple characters and potentially enable NPC interactions. However, such advanced capabilities have yet to be thoroughly tested.
While it remains to be seen if developers will fully embrace Nvidia's ACE toolkit, notable upcoming games like S.T.A.L.K.E.R. 2: Heart of Chernobyl and Fort Solis have already adopted elements such as "Omniverse Audio2Face." This feature aims to synchronize facial animations of 3D characters with the speech of their voice actors, enhancing the overall immersion in gaming narratives.
Nvidia's demonstration at Computex 2023 offered a tantalizing glimpse of the future where gaming and AI seamlessly converge, promising more dynamic and interactive gameplay experiences for players worldwide.
No comments:
Post a Comment