The world of 3D digitisation has historically been reserved for specialists using equipment costing tens of thousands of euros. Today, various types of scanners coexist, designed to capture everything from small mechanical parts to large infrastructure like bridges or dams. However, techniques for generating three-dimensional models – mainly divided between active sensors (such as high-precision LiDAR or structured light) and passive sensors (such as photogrammetry and videogrammetry) – have taken a massive democratic leap forward.
The great news is that you no longer need expensive specialised hardware or advanced technical skills to generate high-quality 3D models: the smartphone in your pocket has become an extremely capable scanning tool.
2freedom Videogrammetry: Innovation within Everyone's Reach
Integrated into the MOTIVATE XR platform, the videogrammetry technology developed by 2freedom allows anyone, without prior knowledge of 3D modeling or traditional photogrammetry, to scan objects of various sizes simply using their mobile phone camera.
What sets 2freedom’s videogrammetry apart from other alternatives on the market?
- Smart Image Selection: Unlike conventional photogrammetry, which requires taking dozens of individual photos from calculated angles, here you only need to record a continuous video. The system automatically extracts the ideal frames for processing.
- Advanced Bundle Adjustment: Its algorithm optimises camera orientation and position in every frame, ensuring precise geometric reconstruction without the user having to worry about the underlying mathematics.
Benefits and Limitations of Using a Smartphone vs. 3D Scanners
Benefits of Using a Smartphone vs. Dedicated 3D Scanners
Adopting a smartphone as a 3D scanning device brings key competitive advantages over industrial or dedicated portable scanners:
- Drastic Cost Savings: A professional industrial 3D scanner (structured light or portable laser) can cost anywhere from €5,000 to over €50,000, plus the cost of specialised software licenses. A smartphone leverages hardware the user already owns.
- Extreme Portability and Convenience: A smartphone fits in your pocket and eliminates the need to carry rigid flight cases, power cables, high-performance laptops for field processing, or heavy external batteries.
- Minimal Learning Curve: Capturing data by recording a video is an intuitive, everyday gesture. Any field operator or technician can perform a quality scan without needing days of specialised training.
- Continuously Evolving Ecosystem: Smartphones update their optical sensors, processors (NPU/GPU), and computing capabilities on an annual basis. Software improvements and algorithmic enhancements are deployed instantly through app updates.
- Photorealistic Texture Capture: Modern smartphones feature advanced ISP processing (HDR, automatic white balance, high color resolution), enabling extremely realistic visual textures.
Limitations and Drawbacks of Smartphones vs. Professional 3D Scanners
Despite their significant advantages, it is important to understand the current limitations of mobile phones compared to dedicated scanners:
- Metric Precision and Sub-millimeter Tolerances: Industrial 3D scanners (laser or structured light) are metrologically calibrated to guarantee micron-level tolerances (essential for strict quality control or legal metrology). Mobile sensors may experience slight dimensional or scale deviations.
- Dependence on Lighting Conditions: As a passive (RGB) sensor, videogrammetry on a mobile phone relies heavily on ambient lighting. Active scanners project their own light patterns or lasers, making them immune to shadows or low-light environments.
- Thermal Management and Battery Drain: Continuous high-resolution video processing and frame computing can lead to accelerated battery consumption and smartphone overheating during prolonged scanning sessions.
- Optical Noise and Compression: Mobile videos typically use lossy compression (H.264/H.265) and image smoothing algorithms, which can blur or eliminate deep geometric micro-details.
The Essential Role of AI: Solving Videogrammetry Challenges
One of the most fascinating aspects of today’s technology landscape is that the traditional drawbacks of videogrammetry are being progressively solved thanks to Artificial Intelligence:
- Overcoming Motion Blur and Motion Artifacts: Deep learning algorithms can detect, and correct motion-blurred frames caused by hand movement, filtering or restoring image sharpness before feeding the data into the 3D reconstruction engine.
- Revolution with NeRFs and Gaussian Splatting: AI-driven techniques like Neural Radiance Fields (NeRF) and 3D Gaussian Splatting are transforming 3D rendering. They allow for the synthesis of complex scenes with reflections, transparencies, and lighting changes that previously broke traditional photogrammetric meshes.
- Monocular Depth Estimation via AI: AI models trained on millions of images can predict accurate depth maps from a single RGB frame, helping resolve areas with insufficient overlap or visual texture.
- Handling Difficult Surfaces (Glares and Transparencies): AI learns to identify specular highlights (reflections that change based on viewing angle) and virtually remove them, enabling the reconstruction of polished or metallic objects without needing physical matting agents.
- Automatic Segmentation and Cleanup: Using advanced segmentation models (such as SAM – Segment Anything Model), AI can automatically isolate the object of interest and remove background elements, walking pedestrians, or unwanted scene clutter.
Practical Applications: From Industry to Cultural Preservation
The ease of 3D capture with a smartphone opens a broad range of immediate applications:
- Industry and Quality Control: Enables digitising mechanical components for reverse engineering or direct dimensional checking on the factory floor.
- Cultural Heritage and Museums: Fast 3D documentation of sculptures, archaeological sites, and high-value artifacts. Facilitates the creation of interactive digital catalogs and virtual replicas.
- Construction and Infrastructure: Visual inspection and site monitoring for buildings, bridges, tunnels, or dams, integrating directly into BIM (Building Information Modeling) workflows.
- Security and Forensics: Rapid 3D reconstruction of accident scenes or forensic analysis before clearing or reopening an area.
Key Tips for Reflective or Complex Textures
Although the system simplifies the process as much as possible, if you are going to scan objects with heterogeneous, highly homogeneous, or reflective textures (such as glossy plastics, metals, or glass), apply these two professional solutions:
- Use Reference Targets: They help algorithms identify unique geometric control points in space, facilitating precise model alignment.
- Sublimating Scanning Sprays: Apply a thin matte layer over the object. These sprays evaporate on their own after a few hours, transforming reflective surfaces into easily recognisable targets for the camera.
Recording a video with your mobile phone and allowing the videogrammetry and Artificial Intelligence algorithms of platforms like MOTIVATE XR to do the heavy lifting is today’s fastest and most accessible path to bringing the physical world into the digital 3D space.
Thanks to the integration of 2freedom’s videogrammetry in MOTIVATE XR, converting any real-world object or environment into a high-quality 3D digital asset is as simple as pressing record on your mobile phone.
Author
2freedom Imaging
Pedro Ortiz-Coder, PhD in Geotechnologies, is co-founder, CEO and CTO of 2Freedom Imaging Software & Hardware S.L. An expert in videogrammetry, Visual SLAM and intelligent 3D digitisation, he leads the development of innovative hardware and software for surveying, construction and heritage. He combines academic and industrial experience, driving disruptive solutions in spatial data capture and analysis.
