Google’s latest AI agent is learning how to navigate a familiar space: gaming.
The tech giant released new research on its Scalable Instructable Multiworld Agent, or SIMA, on Wednesday.
“Seeing positive transfer between games is a key milestone for research.”
But SIMA isn’t perfect.
“All the errors we see are around more of the fine-grained understanding,” Harley said.
He’s reluctant to call SIMA’s imperfections “hallucinations.”
“Often what we see when the agent fails …
But it’s not just about human-agent communication in gaming.
That’s in part because games are an approximation of the real world.
They have visual diversity, along with diverse options, mechanics and graphical styles.
But they also share common themes, like navigating complicated spaces and interacting with objects, characters and players.
