Planet X FX

Planet X FX

visual effectsvirtual productiontitle designreadyset studiossetellitedeepspace

introduction

On November 14, 2023, a team of 25 people set out to digitally capture one of Amsterdam’s most iconic locations: the Leidseplein in the city's centre. The scan was part of a research pilot led by ReadySet Studios, in collaboration with the Netherlands Film Fund, the City of Amsterdam, and Planet X Technologies. The goal: to explore how existing urban locations could be virtualized for film and television production, reducing pressure on crowded areas in the city.

While the scan was initiated independently from any specific production, it soon proved its value. When the Netflix thriller iHostage needed a detailed and controllable version of Leidseplein for key scenes, the recently scanned data offered the perfect solution. The filmmakers were able to recreate the location as a 3D virtual location on a massive LED volume, without the need to shoot on-site.

Watch this in-depth look at the meticulous process of capturing a real-world location for Virtual Production. The resulting scan is a fully 3D, real-time environment that allows live adjustments to camera angles, lighting, weather, and individual elements like vehicles, street furniture, and virtual crowds.

creating a digital twin

To bring this vision to life, Planet X partnered with Leap3D, a company specializing in high-accuracy 3D laser scanning. For this operation, Leap3D deployed a terrestrial laser scanner capable of capturing environments with impressive speed and precision.

Working alongside a ground photography team and drone pilots from Zero Gravity Drone, the crew collected over 40,000 images in a single day. These were combined and processed into an interactive 3D model that accurately reflects every detail of the square, from building facades and street surfaces to the spatial layout of sidewalks and tram lines.

Results from the drone scan: each dot in the sky represents a capture moment and unveiling a very systematic flying pattern to capture the area, as can be seen by the repeating zig-zag structure in the overlay. Preprogrammed drones were used for consistent results.
Results from the LiDAR source after the scan, showing a dense and detailed spatial representation of the square. The precision is around 0.3mm of accuracy, and serving as the ground truth for the space.

Once processed, the digital data became a virtual set. Using a massive 60-meter-wide LED wall, the scanned environment was displayed in real-time as an immersive backdrop. This allowed the production team to control everything: lighting conditions, camera angles, and even virtual elements like vehicles and crowds.

For productions like iHostage, this meant being able to recreate a complex urban setting without needing to navigate the logistical hurdles and public disruption that would come with filming in the real Leidseplein.

A 7 meter wide curb between the set and the LED-wall allowed for extras to walk and bike outside the store, adding movement, realism and the crucial 'mid-ground' layer.
DOP Daan Nieuwenhuis in the set with the LED-wall in the background, holding the A-unit camera with Stype RedSpy tracking system mounted on the body.
the future of virtualising locations

The success of this pilot has opened up possibilities for using similar techniques across other locations in the Netherlands. In cities like Amsterdam, where iconic spots such as De Dam and De Wallen face constant pressure from tourism and infrastructure demands, virtualization offers a compelling alternative for filmmakers.

The Leidseplein project is one of the largest urban scans of its kind in Europe. It has drawn international attention, earning ReadySet Studios a nomination for the 2024 Global Production Award in Virtual Production Innovation, to be presented during the 77th Cannes Film Festival.

From day to night, trams to extras, every element of iHostage’s city square was directable in real time.