Cloud computing continues to boost photogrammetry services

Two decades ago, SimActive introduced a gamechanger in photogrammetry processing when it transformed methods from the video and gaming industry for use in the geoinformatics sector. Today, the company is still at the forefront of innovation, developing efficient ways to process remote sensing data into fit-for-use geospatial information.

In early 2024, SimActive, the respected Canadian developer of photogrammetry software, released its upgraded cloud capabilities for Correlator3D. The new distributed processing capabilities mean that wasted waiting time is becoming a thing of the past. In the latest version of Correlator3D, point clouds and digital surface models (DSMs) are generated at twice the speed of previous versions.

This is the latest addition in a very long line of improvements since the brothers Philippe and Louis Simard started SimActive 20 years ago in Montreal. They introduced the first image processing engines in the photogrammetry industry based on a graphic processing unit (GPU) – which until then was only used in gaming – for aerial triangulation and DSM generation. This enabled a manyfold increase in processing speed and convenience. Today, for example, a point cloud can be produced from 300 drone images in less than eight minutes on a single standard PC. This has led to an exponential increase in the sales of the company’s software in the last few years. “This is great recognition for all the hard work we have done,” observes CEO Philippe Simard.

“Autocorrelation innovations in Version 10.1 allow users to expedite project delivery, as DSM and point cloud generation represent about 50% of the total processing time,” comments CTO Louis Simard when asked about the latest challenges they have tackled. Autocorrelation is a highly complex process and is often the bottleneck in any photogrammetric workflow. Regarding the role of artificial intelligence in the recent innovations, he states: “AI was not a part of the solution in that version, but we are doing R&D on its use at different levels, even though it tends to be less helpful for basic photogrammetric calculations. We redesigned our DSM generation module to work more efficiently on more images concurrently, which sped up the overall processing. We also developed a task management system that optimizes the use of the different system components during processing.”

Cloud computing

In SimActive’s view, cloud computing has transformed information-driven operations. “Cloud computing is beneficial for users that may not have the capital to invest in the hardware needed to process mapping projects currently, or those who are operating off-site but have stable internet access,” explains Philippe. “This is often the case with operators who are just starting their business or who work in remote locations. The cloud is also helpful for sporadic needs, such as users that need to process a huge project within a couple of weeks and need the additional power for a short period of time only.”

Needless to say, SimActive’s solution is not only for uncrewed aerial vehicle (UAV or ‘drone’) operations. The GPU technology and multi-core central processing units (CPUs) also power Correlator3D software to rapidly process large mapping projects that are based on aircraft and satellite imagery. It generates dense DSMs, precise digital terrain models (DTMs), point clouds, 3D models and vectorized features. In fact, SimActive positions itself as ‘the technical standard the photogrammetry industry is measured against’. The CTO underpins this statement: “We originally developed the software for processing large-format imagery collected with metric cameras. Clients using such advanced hardware must deliver results with very high quality and accuracy, which are always validated against control. This means our Correlator3D software had to be designed from the beginning to meet the highest mapping standards. The software was later adapted for drone imagery, which means any data processed will lead to highly accurate results.”

Last year, Microsoft announced a collaboration with SimActive. The tech giant chose Correlator3D software on the Microsoft cloud platform to deliver a cloud-based solution for real-time data processing, analysis and decision-making for global defence and intelligence. “Microsoft provides one of the best cloud solutions out there,” says Philippe proudly. “As we have a growing number of clients using the Azure platform, our goal was to make sure the integration of our software in that cloud environment would be optimal. As this is a Windows-based solution with a vast choice of hardware options, our clients can get the most out of their investment when using the cloud.”

Market development

SimActive has thousands of clients in over 100 countries. They include government entities like the United States Army Corps of Engineers, Fortune Global 500 companies like BHP Billiton, and national organizations such as the French railway SNCF. Clients turn to SimActive when they need to manage huge projects while needing fast processing and fast turnarounds. “The professional user can have full control of our processing capabilities using a hands-on, step-by-step processing approach. Furthermore, they can run the software in script mode for batch processing,” comments Louis. On the other hand, the company also explicitly offers access to high-end processing software for clients with no photogrammetry experience. For instance, drones becoming more performant has opened up the market to many smaller users. He adds: “Our software is designed to work for both novices and professionals. The novice user can run automated processing workflows without having an in-depth knowledge of photogrammetry. Clients can even upload full projects and have our photogrammetry specialists generate optimal results from their imagery, including quality control.”

Looking ahead, SimActive’s success will continue to be driven by the ability to process even larger datasets, as acquisition platforms fly farther and longer. A client’s definition of ‘reasonable processing time’ moves with any available innovation on the market. The CEO states: “We position our software as a higher-end photogrammetric solution, which means our challenge is to stay ahead of the competition. That’s complicated by the fact that also the number of different sensors used for mapping keeps rising, so we must constantly adapt our algorithms to work with new ones. The use of Correlator3D has recently been extended to multi-camera drone payloads. For instance, the software allows users to import oblique and nadir camera configurations to develop better 3D mapping products, enabling drone mappers to texturize the sides of buildings and other infrastructure. Correlator3D’s project setup and aerial triangulation modules take the guesswork out of importing these complex multi-camera configurations; customers are capturing five times the number of images as would be acquired with a traditional single camera setup.”

Conflicts and climate

The defence market has always been a natural fit for the company, since satellites and drones have become extremely important in conflicts. Against this backdrop, military needs have shaped some of SimActive’s products. For example, the development of the Correlator3D software was initially supported by the Canadian Forces. Recent advances, such as cameras being able to collect high-resolution imagery very quickly, have led to faster data acquisition for mapping applications by defence organizations around the world. This was also one of the reasons for Microsoft to decide to work with SimActive. “We are already witnessing a rapid increase in the number of intelligence data points, and multiples of sensor feeds needing to be processed,” says Jonathon Beesley, Director Business Strategy, Worldwide Public Sector Defence and Intelligence at Microsoft. “With SimActive, we can demonstrate the integration of feeds from multiple remote and autonomous sensors.”

The continuous improvement of Correlator3D in terms of its ability to rapidly process very large projects is beneficial for civilian applications as well, of course. For example, in November 2023 the Alabama Department of Transportation (ALDOT) used the software to process drone imagery for damage assessment after a powerful tornado ripped through the city of Selma. ALDOT quickly collected more than 18,000 images of the area, and was able to process the data and deliver DSMs and orthomosaics within 24 hours. The ability to crunch such a massive dataset allowed first responders to have the necessary information as fast as currently possible. Louis is convinced that the collaboration between ALDOT and SimActive not only underscores the critical role of technology in disaster recovery, but also highlights the growing significance of drone data in rapidly assessing and responding in the aftermath of natural disasters. “As climate-related events become more frequent and severe, the use of advanced photogrammetry software emerges as an invaluable tool for informed decision-making and efficient recovery efforts,” he concludes.