Frank Wroblewski

Major: Geology

Faculty Advisor: Jean-Marc Gauthier (Project-PI) and Erika Rader (Ph.D. Advisor)

Project Title:

Augmenting Virtual Lunar Terrain with Procedural and Machine Learned Models in Real-Time

Abstract

Our goal is to generate a 3D map of the lunar surface that can be updated in real-time. These 3D maps will combine preexisting remotely sensed data with new images in real-time. The virtual environments will be updated with new content multiple times a second, rather than taking days or weeks when done manually. The lunar environments will include realistic lighting, textures, physical properties, and collisions. Crews can use the environment to train - experiencing craters (cm- to km-scale), rock outcrops, dust, and ice.

The location and shapes of craters on the lunar surface have been determined using computer vision and machine learning. This process will create data for the generation of large quantities of craters and boulders from elevation models and near-angle camera images. We created datasets using two-dimensional satellite images (m-scale) processed with machine learning. We used the resulting datasets to generate 3D maps (cm-scale) in Unreal Engine. As a result of these steps, the virtual lunar surface shows accurate locations, scientific classes, and distribution of craters and boulders. We plan to apply the same process to unmapped science targets at the Artemis III landing sites. As a result of feeding live-data into the virtual environment, the 3D mapping project also provides ways to capture 3D memories of the mission. Historic documentation about the lunar surface will be saved as a virtual environment for future missions.

NASA is rapidly developing virtual environments for the Artemis mission crewed landings taking place in 2025. Our project provides important training for astronauts regarding geological field methods and traverse safety. Through our work, we seek to assist the Artemis mission to virtually design traverses, locate accessible science targets, and facilitate communication between astronauts, surface instruments, and ground control. 

Funding: NASA-EPSCoR, Idaho Space Grant Consortium