Meshroom

Meshroom is a free, open-source 3D Reconstruction Software based on the AliceVision framework. Photogrammetry is the science of making measurements from photographs.



It infers the geometry of a scene from a set of unordered photographs or videos. Photography is the projection of a 3D scene onto a 2D plane, losing depth information. The goal of photogrammetry is to reverse this process.

• 3D Reconstruction
• Photomodeling
• Camera Tracking

Meshroom for PC, developed by AliceVision, is an open-source 3D reconstruction software that leverages photogrammetry techniques to create 3D models from a series of 2D images.

This tool is widely used in industries such as gaming, film, and virtual reality to produce high-quality 3D assets with minimal effort. By using advanced algorithms, this program processes multiple images of an object or environment, stitches them together, and generates detailed 3D meshes that can be further refined or directly integrated into projects.



Key Features

Photogrammetry-Based 3D Reconstruction: It uses a powerful photogrammetry pipeline that converts 2D images into 3D models. This feature is particularly valuable for professionals in need of accurate and realistic 3D representations of real-world objects.

Node-Based Workflow: Meshroom's interface is built around a node-based system, allowing users to visually manage and adjust the reconstruction pipeline. This modular approach provides flexibility in tweaking specific steps, such as image matching, structure-from-motion (SfM), and texture generation.

Customizable Pipelines: Users can create custom workflows tailored to their specific needs, including adding or removing steps in the pipeline, adjusting settings, and automating processes.

Support for Various Formats: It supports a wide range of input and output formats, including JPEG, PNG, and EXR for images, and OBJ, FBX, and Alembic for 3D models. This ensures compatibility with other software in a typical production pipeline.

GPU Acceleration: The app utilizes the power of NVIDIA GPUs to accelerate the processing time, making it feasible to work on large datasets and complex models without long wait times.



More Features

• High Quality 3D Models
• Use GPUs to combine High Quality with Performance
• Scalable solution (>1K Images)
• Nodal Editor with Caching Mechanism
• Augment a solved Structure-From-Motion with new images
• Decimate your mesh
• Retexture your mesh in this program after retopology in Blender, ZBrush, Maya, ...
• Use Custom UVs or automatically generate them
• Fusion of Multi-bracketing LDR images into HDR
• Alignment of panorama images
• Support for fisheye optics
• Automatically estimate fisheye circle or manually edit it
• Take advantage of motorized-head file
• Easy to integrate in your Renderfarm System
• Add specific rules to select the most suitable machines regarding CPU, RAM, GPU requirements of each Node
• You can create custom pipelines and use it as a default template
• It is a fully Open Source nodal workflow, so you can enter into the code and customize some steps to specific needs without re-creating a full pipeline

Software Integrations

Blender Plugins
Setup Blender from your Meshroom scene

Import the result of your reconstruction in Blender for retopology and import your optimized model back into this app for Texturing.

Houdini Plugin
AliceVision in Game Development Toolset

This plugin, created by SideFX, allows you to perform 3D reconstruction with AliceVision engine directly in Houdini.

User Interface

Meshroom's user interface is clean and intuitive, designed with both beginners and advanced users in mind. The main window is divided into several sections:



Graph Editor: This is the heart of this software, where users can manage and customize the node-based pipeline. Each node represents a step in the 3D reconstruction process, and users can easily connect, rearrange, or modify them to suit their needs.

3D Viewer: The 3D Viewer allows users to preview the reconstructed model in real-time. It supports various viewing modes, including wireframe, shaded, and textured views, providing a comprehensive look at the model during different stages of reconstruction.

Image Gallery: Users can browse through the imported images, review them, and even remove any that might be affecting the reconstruction quality.

Installation and Setup

Download: It can be downloaded from the official AliceVision GitHub repository or FileHorse. The software is provided as a precompiled package, so no additional compilation is needed.

Unzip: Once downloaded, unzip the package to a desired location on your computer.

Run: To start this app, simply run the executable file (Meshroom.exe for Windows). No installation wizard is required, and the software is ready to use out of the box.

Requirements: Ensure that your system meets the minimum requirements, particularly an NVIDIA GPU, which is necessary for GPU-accelerated processing.

How to Use

Import Images: Begin by importing a series of photos of the object or scene you want to reconstruct. Ensure the images are taken from different angles and have good lighting to achieve the best results.

Configure Nodes: The imported images will automatically connect to the first node in the pipeline. Users can adjust the settings of each node in the graph editor to optimize the reconstruction process.



Run the Pipeline: Once the nodes are configured, click the start button to run the pipeline. It will process the images through various stages, including feature extraction, image matching, and 3D mesh generation.

Preview and Export: After the reconstruction is complete, preview the model in the 3D Viewer. If satisfied, export the model in your desired format for use in other applications.

FAQ

Can I use Meshroom without an NVIDIA GPU?
While it is possible to use this program without an NVIDIA GPU, the processing time will be significantly longer. The software is optimized for CUDA, which requires an NVIDIA GPU.

What kind of images work best for Meshroom?
High-resolution images with good lighting and minimal motion blur work best. It's important to capture the object or scene from multiple angles to ensure complete coverage.

Can I use video footage in Meshroom?
The app primarily works with still images, but you can extract frames from video footage and use those images in the software.

How accurate are the 3D models generated by Meshroom?
The accuracy of the 3D models depends on the quality of the input images and the settings used in the pipeline. With high-quality images and proper configuration, it can produce highly accurate models.

Is Meshroom suitable for beginners?
Yes, this program is suitable for beginners due to its intuitive interface. However, some understanding of photogrammetry and 3D modeling principles can be beneficial.

Alternatives

Agisoft Metashape: Another popular photogrammetry tool that offers robust features and extensive support for different workflows, suitable for professionals who need more control over the reconstruction process.

Pricing

This program is completely FREE and open-source, making it an attractive option for hobbyists, educators, and professionals who need a cost-effective 3D reconstruction tool.

System Requirements

• Operating System: Windows 11/10/8/7
• Processor: Quad-core CPU (Intel or AMD)
• Memory: 16GB RAM or higher
• Graphics Card: NVIDIA GPU with CUDA capability (Recommended: GTX 1070 or higher)
• Storage: SSD with at least 50GB free space for large projects

To fully leverage Meshroom's capabilities, it's recommended to use an NVIDIA CUDA-enabled GPU. The binaries are built with CUDA-11 and are compatible with GPUs that have a compute capability of 3.5 or higher. Without a supported NVIDIA GPU, you will be limited to using only the "Draft Meshing" option for 3D reconstruction.

PROS

• Free and open-source
• Intuitive node-based interface
• High-quality 3D reconstruction
• Supports multiple file formats
• GPU acceleration

CONS

• Requires an NVIDIA GPU for optimal performance
• Processing can be slow without proper hardware

Conclusion

Meshroom by AliceVision is an exceptional tool for anyone looking to create high-quality 3D models from 2D images. Its open-source nature, coupled with a user-friendly interface and powerful features, makes it a top choice for both beginners and professionals.

Although it requires specific hardware to run efficiently, the results it produces are well worth the investment. Whether you're a game developer, a film producer, or simply a 3D enthusiast, it offers a robust solution for your 3D reconstruction needs.