404—GEN leverages decentralized AI to transform your words into detailed 3D models, bringing your ideas to life in just a few seconds
Project Repo | Website | X
3D Gaussian Splatting is a technique used for efficient representation and rendering of three-dimensional objects by leveraging Gaussian distributions. This technique renders high fidelity objects using lots of tiny translucent ellipsoids or "splats." Each splat carries information about its color, size, position, and opacity.
- With this package, users can:
- Enter Text or Image Prompts to generate 3D Gaussian Splats (3DGS) and Mesh FBX Models.
- Display 3D Gaussian Splat assets inside Unity.
- Apply cutouts, colliders and shadows to 3D Gaussian Splats.
- Import and Export .ply files.
- Convert 3DGS to Mesh.
Unity 2022.3+
Previous Release must be Removed before Installing Latest Release.
- From the Unity Asset Store, click "Add to My Assets".
- In Unity, create a new 3D Project or open and existing one.
- Go to My Assets.
- Select 404—GEN from the list.
- Click Download.
- After the package has been downloaded click Import. When the import Window Appears, keep all files selected and click Import.
- Please restart Unity before using the Plugin.
Make sure the rendering backend is now set to
- Directx 12 on Windows.
- Metal on Mac OS.
- Vulkan on Linux.
- Go to Window > 404-GEN 3D Generator to open the generation window.
- Type your Text Prompt or Import your 3D Image Prompt and click Generate. Each generation should take 1 to 2 minutes.
The 404-GEN 3D Generator window tracks the progress of generating the models for prompts. Once the prompt has been enqueued, it waits on the backend to complete the generation.
For help with prompts please refer to our Prompt Guide
For questions or help troubleshooting, visit the Help Forum in our Discord Server
In addition to the Position, Rotation, and Scale values in the Inspector, there are two easily adjustable values.
- Splat Scale: Controls the size of the points, represented by ellipsoids, in the Gaussian Splat
- Opacity Scale: Points within Gaussian Splats have varying degrees of opacity. This increases or decreases the opacity of all points.
The cutouts feature can be used to hide a selection of points within the Gaussian Splat, defined by either a box or ellipsoid.
Create a cutout for a selected Gaussian Splat by clicking Add Cutout under the Cutouts heading of the Inspector.
Select a shape and move/scale/rotate as needed.
By default, only the points inside the cutout will be rendered. Select invert to render the points outside the cutout.
The Add Mesh Collider button in the Inspector will add a convex hull mesh collider.
Like the mesh collider, the Add Shadow button in the inspector adds an invisible convex hull mesh to the Gaussian Splat. The shadow it casts lacks any fine details, however the convex hull's low poly count makes it very lightweight.
The Convert to Mesh button will open a Mesh Conversion window with input field (for Gaussian Splat component), file output folder location, conversion settings, reference fields for files that are created in the process (.ply and .mesh files), as well as the reference field for the game object that will be created and placed in current scene (Instance).
The sliders adjust the level of detail on the mesh output.
Once the Start conversion to Mesh button is used the process will start populating the object fields as they are created. The process takes approximately one minute to convert the Gaussian Splat (PLY) to mesh (FBX).
The Gaussian Splat can be exported in .ply format using the Export PLY button.
.ply files can be imported by adding them to the project's Assets folder and the scene.
A large collection of Gaussian Splatting .ply files is available in the 404 Dataset.
For questions or help troubleshooting, visit the Help Forum in our Discord Server