On Sunday at Computex 2024, Nvidia unveiled Project G-Assist, an artificial intelligence (AI) assistant based on the Ray Tracing Texel eXtreme (RTX) platform. The tech giant introduced it as a personal gaming assistant for PC that can answer any video request. game, including game strategies and analysis of multiplayer replays. Artificial intelligence is equipped with natural language and computer vision capabilities, allowing it to accept text, speech and information from the screen as input. There is currently no product launch date. Notably, Microsoft also demonstrated a similar use case for Copilot during its Build event.
Nvidia presents the G-Assist project
Project G-Assist is part of Nvidia’s RTX AI toolkit, which also witnessed several other announcements on June 2. Specifically, AI Assistant is the company’s attempt to provide players with gaming knowledge through generative AI. Interestingly, in 2017, Nvidia posted a video on X (formerly known as Twitter) about the GeForce GTX G-Assist, a tool that can play games on behalf of the player, as an April Fool’s joke.
Now, seven years later, Nvidia is making that dream a reality. So what can an AI assistant do? Sharing a tech demo of Studio Wildcard’s ARK: Survival Ascended, the company highlighted a wide range of areas where Project G-Assist can help players. Primarily intended as a tool to quickly find the best weapon in the game or a solution when you’re stuck on a mission, the AI assistant can also handle much more complex tasks.
During the demo, Project G-Assist helps you create a game strategy for early game survival, offers analysis of multiplayer replays, helps you find the best settings for the game, and finds the best way to optimize the game for a given PC. Notably, the AI assistant gets the capabilities of both a large language model (LLM) and computer vision, so it can understand natural language and pick up context by analyzing the screen in real time.
Project G-Assist can run both through servers and locally on devices with Nvidia GeForce RTX GPUs, providing flexibility for gamers. Based on the demo, it seems that the AI assistant can access the Internet in both cases, as it may need to search the Internet to find answers to certain questions.
Currently, Project G-Assist only exists as a demo, and Nvidia hasn’t provided any details on its launch date.