Roblox’s new AI model can generate 3D objects

Roblox is launching and open-sourcing Cube 3D, the first version of its foundational AI model for generating 3D objects.

“With Cube, we intend to make 3D creation more efficient,” Roblox says in a press release. “With 3D mesh generation, developers can quickly explore new creative directions and increase their productivity by deciding rapidly which to move forward with.”

The model is trained on 3D objects, as Roblox explains in its press release:

To achieve this, we’ve taken inspiration from state-of-the-art models trained on text tokens (or sets of characters) so they can predict the next token to form a sentence. Our innovation builds on the same core idea. We’ve built the ability to tokenize 3D objects and understand shapes as tokens and trained Cube 3D to predict the next shape token to build a complete 3D object.

The actual data used to train the model includes “a combination of licensed and publicly available datasets, as well as experience data from the Roblox ecosystem,” spokesperson Samantha Spielman tells The Verge.

Down the line, Cube 3D will be able to generate objects using images as inputs, too. “It will ultimately be a multimodal model, trained on text, images, video, and other types of input – and will integrate with our existing AI creation tools,” according to Roblox.