Microsoft Xbox Unveils Ambitious AI Model for ‘Gameplay Ideation’

Yesterday, Microsoft Xbox introduced Muse, a new tool they’re promoting as a “generative AI model designed for gameplay ideation.” They accompanied this launch with a detailed article on Nature.com, a blog post, and a YouTube video. If you’re scratching your head over “gameplay ideation,” you’re not alone. Microsoft uses this term to mean generating game visuals, simulating controller actions, or both. However, in its current state, Muse doesn’t revolutionize game development—it’s more of an intriguing concept than a practical breakthrough.

One compelling aspect of this endeavor is how it was trained. Microsoft used high-powered H100 GPUs, and it took about a million training updates just to extend a single second of real gameplay into nine extra seconds of simulated content. Most of the training data came from existing multiplayer sessions, which makes the process even more fascinating.

To build Muse, Microsoft didn’t run things on just one computer. They had to use a hefty setup of 100 Nvidia H100 GPUs. This approach is far pricier and guzzles much more electricity, managing to produce a mere nine seconds of extra gameplay at a low resolution of 300×180 pixels.

The standout demonstration of Muse’s capabilities shows it can duplicate props and enemies in a game environment, replicating how they function. But it’s hard to overlook the irony here—investing so much in AI and resources when traditional development tools could do the job more efficiently.

Though Muse can maintain object permanence and mimic the game’s original behavior, its applications are underwhelming compared to standard game development methods. It feels like a novel, yet ultimately inefficient, attempt to sidestep conventional processes.

Future versions might surprise us with more impressive capabilities, but for now, Muse adds to a growing list of projects aiming to recreate gameplay purely through AI. Among enthusiasts and developers, it raises the question of why we need such a tool when it seems far from optimal for creating, testing, or enjoying video games. Even after diving deep into the details, it’s tough to see why anyone would choose this method.

Would you like the latest in-depth reviews and news? Subscribe to Tom’s Hardware to stay updated with the best in gaming.