NVIDIA has been working on the integration of AI and games, such as their previous NVIDIA ACE: using AI to create more vivid game NPCs. At Computex 2024, NVIDIA has brought gamers another AI assistant developed for gaming, called G-Assist.
Players can communicate with G-Assist via text or voice, and G-Assist can understand the current game through screenshots and APIs. This content is then fed into a large model that is linked to the game's knowledge base (e.g., a wiki) to make recommendations for the player and the game.
NVIDIA offers two demos of the game: In ARK: Survival Ascension, players can ask G-Assist how to start a game and deal with enemies. G-Assist can also give suggestions on how to add skills and equipment. In Cyberpunk 2077, G-Assist is powerful in tracking game performance metrics, such as graphing frame rates, and even optimizing performance based on system configurations, such as overclocking, depressing, etc.
Presentation of ARK: Survival Ascension
Cyberpunk 2077 demo
So where will this G-Assist run? NVIDIA says it can run in the cloud or run locally accelerated in devices equipped with RTX graphics cards. Developers can customize the large model to better suit a specific game genre.
G-Assist hasn't been implemented in any games yet, but stay tuned. On a side note, at Microsoft's May 21 conference, Microsoft also announced that it would integrate Copilot into Xbox games, using Minecraft as a demo. It can be seen that game assistants are also a development direction of AI in the future.