Roblox AI Model: Create 3D Objects with Open Source AI

Roblox Introduces "Cube" – A Generative AI 3D Modeling Tool

Roblox announced on Monday the initial release of its 3D model, named “Cube.” This innovative tool empowers creators to design 3D objects utilizing generative artificial intelligence.

Furthermore, an open-source version has been launched, enabling development and customization by users outside of the Roblox platform.

Cube's Core Functionality: Mesh Generation

First unveiled at Roblox’s developer conference last year, Cube is being showcased at the Game Developers Conference (GDC) this afternoon.

Access to Cube will be granted to creators later this week, beginning with its primary feature: mesh generation.

Currently in beta, Cube’s 3D mesh generation allows creators to produce “meshes” – essentially 3D representations of objects – from a single text prompt.

For example, a user could input “generate an orange racing car with black stripes” and receive a corresponding 3D model.

These in-game items can then be refined and adjusted within Roblox Studio.

Open Source Availability and Future AI Tools

The open-source iteration of Cube 3D permits users to modify the tool, develop plugins, or train the model using their own datasets to meet specific requirements.

Roblox has also revealed three additional AI-powered tools slated for release in the coming months: text generation, text-to-speech, and speech-to-text.

The text generation tool will enable developers to integrate text-based AI functionalities into their games, including interactive conversations with non-player characters (NPCs).

With text-to-speech, developers can add narration, give NPCs voices, or incorporate spoken captions into their gaming experiences.

Conversely, speech-to-text will allow players to utilize voice commands to control characters and actions within the game.

Expanding Capabilities and the Vision of "4D Creation"

Roblox’s future development plans include expanding mesh generation to encompass more “complex” objects and introducing scene generation capabilities.

The scene generation tool will allow creators to prompt the AI to construct entire scenes, such as a forest, and dynamically alter elements like changing leaf colors to reflect seasonal shifts.

The company’s long-term objective, as previously stated, is to achieve “4D creation,” where 3D objects and scenes are fully interactive.

According to Nick Tornow, Vice President of Engineering at Roblox, the “fourth dimension” represents the interaction between objects, environments, and players.

Impact on Game Development and Industry Concerns

Roblox anticipates that Cube will accelerate the creative process, enabling independent developers to undertake larger and more ambitious projects.

The company has already released several AI tools, including those for texture generation and avatar creation.

The integration of AI tools in gaming is currently a significant trend, with numerous companies making advancements in this area.

Recently, Tencent launched its own open-source 3D generation model, designed to create 3D models from text prompts or 2D images.

However, the adoption of AI also raises concerns within the gaming industry.

A recent GDC report indicated that 30% of game developers believe generative AI has a detrimental effect on the gaming landscape.

Furthermore, a study by CVL Economics projects that AI could impact or replace 13.4% of gaming jobs by the year 2026.