A groundbreaking digital preservation venture has created essentially the most complete 3D map of Alcatraz Island ever produced, combining cutting-edge drone know-how, synthetic intelligence, and actuality seize techniques to doc one in every of America’s most infamous historic websites. Pete Kelsey, founding father of VCTO Labs, introduced the outstanding achievements of this formidable venture at Intergeo 2025 in Frankfurt, Germany, the place he detailed how his worldwide crew of over 20 volunteers accomplished what represents one of many largest-scale digital twin initiatives of an American landmark.
The venture, accomplished in December 2023 in partnership with the Nationwide Park Service, represents a brand new frontier in cultural heritage preservation. Throughout his presentation, Kelsey mentioned the technical challenges and groundbreaking conclusions from what he described as probably the most complete conservation initiatives ever carried out in the USA. Rising sea ranges, seismic exercise from the San Andreas Fault, and the influence of over a million annual guests have created urgent considerations for the 22.5-acre island’s structural integrity.
Residing and Working in America’s Most Well-known Jail
Kelsey’s crew spent three weeks dwelling within the precise jail cells on Alcatraz, working across the clock to seize 4 terabytes of information utilizing terrestrial laser scanning, drone-based LiDAR, multispectral scanning, photogrammetry, and robotic techniques. The weird dwelling preparations grew to become a part of the venture’s distinctive character.
“I used to be in D-block, third tier, cell quantity 31. Residence candy dwelling!” joked Kelsey throughout his presentation. Regardless of considerations in regards to the island’s reported paranormal exercise, Kelsey stated his sleep was glorious, although he needed to relocate as soon as when a retired police officer on the crew’s loud night breathing grew to become disruptive. His unnamed colleague’s non permanent transfer to the mugshot room beneath the previous hospital proved short-lived attributable to unexplained sounds from upstairs, together with what appeared like a piano participant and crowds of 50-100 individuals.
The cruel working circumstances prolonged past ghostly encounters. The crew needed to carry all their very own provides, together with sleeping luggage and meals, whereas sharing a single lavatory and brushing their enamel at ingesting fountains. Working primarily throughout the early morning hours earlier than vacationers arrived, the crew had solely two to three-hour home windows to seize knowledge with out disrupting the customer expertise.
Superior Know-how Arsenal
The venture’s success trusted an unprecedented mixture of actuality seize applied sciences. With a background in building and surveying, Kelsey emphasised the significance of creating a complicated survey management community that achieved 6mm precision. This baseline made the in any other case practically unattainable process of mixing and reconciling knowledge from totally different sources manageable, making a basis from which the crew might work.
“Beginning with a survey management community helped quite a bit – there isn’t a endgame with out that,” Kelsey defined.
Drone Know-how at Work
The venture’s aerial knowledge assortment represented probably the most refined multi-platform drone operations ever carried out at a Nationwide Park Service website, the place flights are normally banned. The crew deployed a number of specialised unmanned aerial automobiles, every chosen for particular mission necessities throughout Alcatraz’s numerous terrain and structural challenges.
The Impressed Flight 1200i served as the first heavy-lift platform, able to carrying bigger sensor payloads for prolonged flight occasions across the island’s perimeter and elevated buildings. For precision mapping of the island’s advanced topography, the crew utilized the EagleNXT eBee fixed-wing drone, which supplied environment friendly protection of huge areas whereas sustaining the accuracy required for survey-grade documentation.
Maybe most important to the venture’s success was the deployment of the Elios 3 collision-resistant drone for confined inside areas. This specialised platform allowed the crew to soundly navigate the slim corridors, cells, and utility areas throughout the jail buildings the place conventional drones would have been unattainable to function. The Elios 3’s protecting cage and superior collision-avoidance techniques enabled detailed scanning of inaccessible areas that had by no means been comprehensively documented.
ESRI performed an important function within the Alcatraz venture, offering each photogrammetry experience and superior processing capabilities by means of their ArcGIS Actuality suite of software program merchandise. The photogrammetry part represented one in every of three essential aerial knowledge assortment flights, alongside the LiDAR and multispectral scanning operations. ESRI’s contribution was important for creating the photorealistic texture mapping that might later be built-in with the LiDAR level cloud knowledge to supply the ultimate digital twin.
Phoenix LiDAR Methods supplied the RANGER-U120 high-precision, long-range LiDAR scanner, which grew to become the cornerstone of the aerial mapping operations. This survey-grade system delivered the centimeter-level accuracy required for creating baseline documentation that would help a long time of future monitoring. The RANGER-U120’s potential to penetrate vegetation and seize exact measurements of deteriorating concrete and metal buildings proved important for documenting the island’s present structural situation.
The aerial operations required cautious coordination with Federal Aviation Administration rules and Nationwide Park Service necessities, significantly given Alcatraz’s location in restricted San Francisco Bay airspace. Flight operations have been additional difficult by the island’s seabird nesting seasons, which restricted entry to sure areas throughout essential breeding intervals. The crew needed to work inside slim time home windows, sometimes throughout early morning hours earlier than vacationer operations started, maximizing their transient alternatives to gather complete aerial knowledge with out disrupting customer experiences.
For areas with environmental hazards containing lead and asbestos, (the place the usage of drones risked spreading poisonous mud) the crew deployed a Boston Dynamics robotic canine nicknamed “Spot”, geared up with Emesent’s Hovermap LiDAR system. This robotic answer prevented human publicity to poisonous supplies whereas sustaining knowledge assortment capabilities. The Hovermap system might seize steady scans at Spot’s most strolling tempo, making it considerably quicker than typical terrestrial laser scanning strategies.
RIEGL USA contributed terrestrial laser scanning tools, together with the VZ-600i for inside scans and the VZ-2000i for long-range exterior scanning able to reaching 2.5 kilometers distance, capturing parts of the San Francisco shoreline.
Processing Energy Challenges
One of many venture’s most vital technical challenges got here from Alcatraz’s restricted web connectivity, which dominated out cloud-based knowledge processing. The answer got here from AMD, which supplied a prototype workstation geared up with a 96-core Threadripper PRO processor and half a terabyte of RAM.
“The workplace on Alcatraz was actually chilly, however that machine saved us heat,” Kelsey famous.
Epic Video games Integration and Digital Actuality Functions
Epic Video games performed a major function in creating the ultimate digital twin expertise utilizing their RealityScan, Twinmotion, and Unreal Engine applied sciences. The RealityScan 2.0 software program was used to generate an in depth digital reproduction from aerial LiDAR, photographs, and Bentley’s Cesium tiles, whereas Unreal Engine supplied the framework for creating immersive, interactive experiences.
The Epic Video games integration permits a number of functions past easy documentation. In future, the mannequin might help digital tourism capabilities, permitting guests to discover areas usually restricted to the general public. “What about all of the individuals who need to go behind the velvet ropes? With a pair of goggles, I can present that world to you,” Kelsey defined.
Historic Discoveries and Documentation
The excellent scanning revealed beforehand unknown historic options and documented well-known parts of Alcatraz’s previous. The crew efficiently mapped the whole escape route used within the notorious 1962 breakout by Frank Morris and brothers Clarence and John Anglin. Their scans captured the upstairs workshop the place the escapees constructed their rafts and the routes they used to succeed in the water.
Multi-spectral scanning strategies revealed the stays of a helipad added throughout the Nineteen Sixties, uncovering island historical past that even Nationwide Park Service employees had forgotten. The crew additionally documented graffiti all through the power, together with notes written by guards and pictures created by rioting inmates, although Kelsey famous wryly that some prisoner art work was too specific for public show.
Maybe most importantly, the venture revealed the unique Civil Warfare-era sallyport, or secured entrance, on the jap aspect of the island – a characteristic that had not been seen for over a century. This discovery supplied new insights into Alcatraz’s army historical past earlier than its well-known jail years.
Conservation and Local weather Change Functions
The digital twin serves a number of conservation functions, offering baseline documentation to observe the consequences of local weather change, seismic exercise, and customer influence on deteriorating buildings. The Nationwide Park Service can now evaluate future surveys towards this complete dataset to trace modifications over time.
“On the very least, we’ve created a baseline knowledge set that future surveys will be primarily based on. Whether or not it’s sea stage rise or erosion, or San Francisco’s seismic exercise, we’ll have the ability to observe the modifications and be part of the way forward for the island,” Kelsey defined.
Future Income and Instructional Functions of Digital Twins
Past conservation, the digital twin might create new income alternatives for the Nationwide Park Service by means of digital tourism and academic functions. The know-how permits immersive experiences for individuals unable to go to the island bodily and offers academic establishments with unprecedented entry to historic websites.
Kelsey envisions the venture contributing to his “BHAG” (Massive Furry Audacious Purpose): creating the world’s first digital nationwide park. The filming and digital actuality know-how might grow to be a major income driver for the park service whereas increasing entry to historic schooling.
“Actuality seize is educating the consumer in regards to the asset they now have, and the way it might be used for something, from upkeep to licensing,” Kelsey famous. The excellent documentation additionally helps upkeep planning by offering detailed structural info for preservation specialists.
Technical Classes and Business Affect
The Alcatraz venture demonstrated a number of key ideas for large-scale actuality seize initiatives. Kelsey emphasised the significance of thorough planning, noting that 9 months of preparation preceded the three-week knowledge assortment part. Acquiring permits for drone operations in a nationwide park and coordinating round seabird nesting seasons required intensive advance work.
The venture’s success depended closely on collaboration between a number of know-how corporations and volunteers who contributed tools and experience. Phoenix LiDAR Methods, Emesent, RIEGL USA, Boston Dynamics, AMD, Epic Video games, and quite a few different companions supplied important elements of the great answer.
For drone professionals planning comparable initiatives, Kelsey advisable beginning with a exact survey management community and calling on skilled companions. “Having achieved massive strategic initiatives like this earlier than, I had a way of find out how to do it. I relied on individuals quite a bit smarter than me – I known as in each favor anybody ever owed me,” he defined.
Advancing Digital Preservation Requirements
The Alcatraz digital twin venture units new requirements for cultural heritage preservation, demonstrating how superior geospatial applied sciences can defend America’s historic landmarks for future generations. As rising sea ranges and excessive climate occasions more and more threaten coastal historic websites, Kelsey’s work offers a replicable mannequin for complete digital documentation.
“We make the invisible seen. We make individuals see views and factors of view which have by no means been seen earlier than,” Kelsey stated, referring to actuality seize professionals. The venture’s mixture of a number of applied sciences, robotic techniques, and superior processing capabilities creates a template for preserving different important historic websites dealing with comparable environmental and structural challenges.
The excellent dataset now serves as a everlasting document of Alcatraz Island’s situation in 2023, making certain that future researchers and conservationists can have exact documentation of this iconic American landmark no matter how local weather change and time might alter its bodily construction.
Extra info on VCTO Labs and Pete’s different initiatives can be found right here.
Learn Extra
Ian McNabb is a journalist specializing in drone know-how and life-style content material at Dronelife. He’s primarily based between Boston and NH and, when not writing, enjoys mountaineering and Boston space sports activities.
