Written by 
Imagine recreating a busy urban street or the detailed patterns of a forest so accurately that it can be transported to a film set. This is the magic called photogrammetry: a revolutionary technique that is totally changing the landscape of film making. From enhancing the visual elements of films like Pirates of the Caribbean to even low budget films, you’ll see this technology being used even more in the future.
To put it simply, photogrammetry is sophisticated digital photography that goes beyond just taking pictures. It takes dozens, perhaps hundreds, of pictures from every angle imaginable and builds a three-dimensional (3D) model of the object.
Throughout this guide, we will define photogrammetry, outline how it works, and explain its importance in the 21st century film industry. From jaw-dropping set designs to intricate character creations, let’s dive into the world of 3D mapping and see how it’s reshaping the movies we love.
What is photogrammetry? A simple breakdown
Although the term “photogrammetry” may sound intimidating, it is actually a simple process that can produce impressive results. This term refers to the process of taking pictures of real objects or environments and creating 3D models from them.
Turning photos into 3D models
The process involves capturing several images of an object, place, or even a person from all possible angles. The goal being to capture every visible detail.
These photos are then taken into specific software applications like RealityCapture, Agisoft Metashape, or Autodesk ReCap, where the software performs a 3D reconstruction of the object by determining and computing the overlapping regions of the photographs.
How does it work? The magic of geometry
Photogrammetry relies on principles of geometry and computer vision to reconstruct objects in 3D space. By identifying common points (like the corner of a building or the edge of a prop) in overlapping photos, the software calculates the exact location of these points.
This process, called triangulation, maps out the object’s structure by connecting these points in 3D space, much like drawing lines between dots. The result is a precise digital replica that mirrors the real-world object with stunning accuracy.
Why filmmakers love photogrammetry
Filmmakers are embracing photogrammetry because it allows them to create detailed digital assets quickly and accurately. From scanning locations in the real world for virtual sets to capturing an actor’s likeness for digital doubles, photogrammetry offers a versatile, cost-effective solution that elevates visual storytelling. Not only is the procedure quicker, but it also enables a degree of realism difficult for traditional techniques to achieve.
How photogrammetry works: From photos to 3D models
Let’s take a look at the steps that turn simple photos into detailed 3D models.
Step 1: Capturing the images
The process starts with taking multiple photos of the subject, whether it’s a prop, a set location, or even a character. The more photos taken, the better, as capturing every angle and detail is crucial.
Photographers often use high-resolution cameras to ensure that every tiny feature, texture, and shadow is accurately recorded. These images need to overlap significantly (usually around 60% to 80%) so that the software has enough data to work with.
For example, when capturing a statue, photographers might take dozens or even hundreds of shots from different angles: above, below, up close, and from a distance. This extensive coverage ensures that the software can map out every inch of the subject in 3D space.
Step 2: Processing the data with software
Once the photos are taken, they’re uploaded into photogrammetry software like Agisoft Metashape, RealityCapture, or Autodesk ReCap. This software is where the real magic happens. It begins by analyzing each image to identify common points (features like edges, textures, and distinct shapes) that appear across multiple photos. These points are critical for aligning the photos and reconstructing the object in 3D.
The software then uses triangulation to calculate the exact position of each point in space. By measuring the angles between matching points in different photos, it creates a network of coordinates that form the backbone of the 3D model. This stage can take time, depending on the number of photos and the complexity of the subject, but the result is a highly accurate point cloud (a collection of data points in 3D space that maps out the shape of the object).
Step 3: Building the 3D model
With the point cloud established, the software moves on to creating a mesh, which is a digital structure that connects the dots into a continuous surface. Imagine a virtual net draped over the point cloud, forming the basic shape of the object. This mesh is then refined, smoothed, and optimized to resemble the original subject as closely as possible.
Finally, the software applies textures and colors directly from the photographs to the 3D model. This step brings the model to life, adding realistic surface details like shadows and reflections. The result is a 3D replica that looks strikingly similar to the real thing, ready to be used in a film production.
Case studies: Photogrammetry in blockbuster films
Photogrammetry has quietly become a star behind the scenes of many blockbuster films and television shows, helping to create stunning visuals that captivate audiences. Let’s look at a few notable case studies where photogrammetry played a key role in bringing cinematic worlds to life.
The Mandalorian: Creating realistic sets in a galaxy far, far away
The Mandalorian, the hit series set in the Star Wars universe, is a prime example of photogrammetry’s impact on modern filmmaking. The show’s creators used photogrammetry extensively to scan real-world environments, rocks, and props, which were then transformed into highly detailed 3D models. These models were used within the ground breaking “Volume” which is a 360-degree LED screen that projected these digital environments around the actors, allowing them to perform against realistic, immersive backdrops.
One of the key advantages of using photogrammetry in The Mandalorian was its impact on environment lighting. By capturing the real-world lighting conditions along with the physical details, photogrammetry allowed the digital environments to project accurate light and shadow effects onto the actors and set pieces. This meant that lighting from the digital backdrop interacted naturally with the live-action elements, creating realistic reflections and consistent shadows that matched the virtual scenery.
Blade Runner 2049: Reviving a dystopian future
In Blade Runner 2049, photogrammetry was used to bring the film’s dystopian world to life with extraordinary detail. The production team scanned real-life locations, including abandoned buildings and industrial sites, to create the film’s gritty, futuristic cityscapes. This approach allowed the filmmakers to capture the textures and complexities of these locations, from rust-streaked metal to crumbling concrete, adding layers of authenticity to the visual effects.
One standout example is the recreation of the Wallace Corporation headquarters. By scanning large-scale physical models of the set, the team was able to digitally expand the environment, blending real-world textures with digital effects to create a breathtakingly realistic and immersive world. Photogrammetry enabled the seamless integration of practical and digital elements, enhancing the film’s atmospheric and moody aesthetic.
The Jungle Book: Bringing the animal kingdom to life
In Disney’s The Jungle Book, photogrammetry was essential in creating the lush, realistic jungle and its animal inhabitants. The film’s visual effects team used photogrammetry to scan natural elements like trees, rocks, and plants from real jungles, bringing a new level of authenticity to the film’s digital environments. These scans were then used to build the movie’s intricate sets, creating a rich and believable backdrop for the story.
Additionally, photogrammetry was used in character creation, allowing artists to add realistic textures to the CGI animals. This attention to detail helped make creatures like Bagheera and Shere Khan appear lifelike and convincing, blending seamlessly with the natural surroundings.
Avengers: Endgame: Digital doubles and epic battles
In Avengers: Endgame, photogrammetry played a crucial role in the film’s epic battle scenes and digital doubles of the actors. The technology was used to scan the actors in full costume, capturing every detail of their appearance, down to the stitching on their suits and the texture of their skin. These scans were then used to create digital doubles that could be seamlessly integrated into the action-heavy scenes.
Photogrammetry also helped build the battle environments, including the ruined landscape where the final showdown takes place. By scanning real debris and rubble, the filmmakers could create highly detailed digital sets that enhanced the intensity and realism of the scenes, making the massive clash feel grounded and impactful.
House of the Dragon: Recreating ancient Westeros with stunning detail
House of the Dragon, the prequel to Game of Thrones, employed photogrammetry to recreate the richly detailed world of Westeros, enhancing the show’s epic and immersive feel. The production team used photogrammetry to scan historical architecture, castles, and various real-world landscapes, transforming these scans into digital assets that brought the Targaryen’s ancient world to life.
Photogrammetry played a critical role in capturing the lighting conditions of the coastal setting, allowing the digital environment to reflect the dramatic interplay of light and shadow seen on the rugged cliffs. This level of detail made Dragonstone feel like a living, breathing part of the world, providing a visually stunning backdrop that matched the dark and powerful themes of the series.
Challenges and limitations of using photogrammetry in film
While photogrammetry is an incredibly powerful tool in filmmaking, it’s not without its challenges and limitations. From technical hurdles to practical considerations, there are several factors that filmmakers need to navigate when using this technology.
Reflective and transparent surfaces
One of the biggest challenges in photogrammetry is dealing with reflective or transparent surfaces. Shiny objects like metal, glass, or water can confuse the software because reflections and transparency can distort how the surface appears in photos. For example, a car with a glossy finish or a glass sculpture can create reflections and glare that make it difficult for the software to accurately capture the object’s true shape and texture.
Lighting inconsistencies
Lighting plays a critical role in photogrammetry, and inconsistencies in lighting can create problems when processing photos into 3D models. Changes in lighting, shadows, or weather conditions during an outdoor shoot can affect the quality and accuracy of the scans. This means that capturing images in controlled lighting conditions is essential, which isn’t always practical on set, especially for large or outdoor environments.
High data requirements and processing power
Photogrammetry generates large amounts of data, especially when capturing complex objects or expansive environments. High-resolution images, dense point clouds, and detailed textures require significant storage and processing power, which can slow down production workflows. Processing this data into a usable 3D model can be time-consuming, particularly for large-scale projects, and often requires powerful computers with specialized graphics hardware.
Conclusion: The impact of photogrammetry on cinematic storytelling
So as you can see, photogrammetry is shaking up the world of filmmaking, turning the art of storytelling into something truly spectacular! By capturing real-world objects, places, and textures in incredible detail, it allows filmmakers to bring scenes to life with a level of realism that feels almost magical.
What’s really exciting is how this tech lets creators push the boundaries of their imagination without breaking the bank. Want to build a fantastical landscape or a historical set without leaving the studio? Photogrammetry makes it happen, blending real and digital worlds in a way that can feel effortless and fun. As this technology keeps evolving, it’s setting the stage for even more mind-blowing visuals, giving filmmakers the tools to tell stories that look and feel truly unforgettable.