Data used by the team to train the “Muse” model came from a closed partnership in 2022 with Theory, from Xbox Game Studios


All about Artificial intelligence
Microsoft published The research details on The first general artificial intelligence model of a video game that can generate game visuals, control actions or both. Technology is known as World and Human Action Model (Wham) and was baptized “Muse”.
The company says that focused on exploring capacities what models like this need to effectively support human developers in gaming creation – SIGNALIZATION THAT There are no plans to replace real breeders with the new tool. The results are in an article published in the scientific journal Nature.

Read more:
Microsoft took years to complete research
- The data used by the team to train the AI model came from CLOSED PARTNERSHIP IN 2022 with Theory, from Xbox Game Studioswhich is headquartered in Cambridge (United Kingdom), where are also the employees of Microsoft who participate in the project;
- Were collected Bleeding Edge gameplay information2020 Xbox Game;
- “Bleeding Edge” is an online game four against four in which all matches are recorded if the player agrees with the terms;
- From there, the company opted to hackathon (event that brings together professionals to develop innovative solutions in a short time)explore new paradigms of interaction and creative uses that the muse could unlock”;
- The result was a prototype called WHAM Demonstratoropen for interactions with other users.

One of the main improvements came with higher resolution image coders: Until then, the models generated images of 128 x 128 pixels; Now, they are 300 × 180 – Still below 1080p (1920 x 1080)common among PC players, and even less than the 4K (3840 x 2160)which is already reality in many gamers setups.
One of my favorite model capabilities is how it can be requested with gameplay sequence modifications and persist newly produced elements.
For example, in a demonstration, we added a character to the original look of the game. Asking the model the modified look, we can see how the ‘persists’ model added and generates plausible variants of how the gameplay sequence could have evolved from that modified starting point.
Katja Hofmann, senior research manager at Microsoft
See below a demonstration of the new method: