Creating Artificial Worlds with AI to Improve Energy Access Data (2021-2022)
Energy infrastructure mapping is vital for well-informed policy decisions around energy access expansion, but data on existing infrastructure can be scarce. Previous work has shown that these information gaps can be filled by applying machine learning techniques to satellite and aerial imagery. However, computer vision techniques struggle when applied across satellite imagery from diverse geographies. More scalable and versatile techniques are needed to assess infrastructure relevant for sustainable energy transitions.
This team set out to develop a better way to detect and map multiple energy infrastructures through publicly available satellite imagery globally by applying synthetic data generation techniques, including generative models and style transfer, for creating synthetic overhead imagery; comparing these techniques with traditional, high-effort techniques for training data collection and recent 3D modeling approaches; and sharing these tools and generated data in an open-source repository to encourage use by other researchers and decision makers.
Ultimately, the team found that their proposed solution using synthetic data generation significantly improves energy infrastructure detection when collection of real data is cost-prohibitive. They hope that their technique will aid efforts to expand sustainable energy.
Learn more about this project team by viewing the team's video.
Fall 2021 – Spring 2022
Energy Infrastructure Mapping Using AI (2022 Fortin Foundation Bass Connections Virtual Showcase)
Domain Adaptable Deep Learning Models for Energy Infrastructure Detection using Synthetic Data Generation (poster by Madeleine Jones, Caleb Kornfein, Alex Kumar, Aya Lahlou, Jaden Long, Madeline Rubin, Caroline Tang, Frankie Willard, Alena Zhang, Saksham Jain, Kyle Bradbury, Jordan Malof and Simiao Ren, presented at Fortin Foundation Bass Connections Showcase, Duke University, April 13, 2022)
Self-Supervised Encoders Are Better Transfer Learners in Remote Sensing Applications. Zachary D. Calhoun, Saad Lahrichi, Simiao Ren, Jordan M. Malof, Kyle Bradbury. 2022. Remote Sensing 14, no. 21: 5500.
This Team in the News
Two Faculty Recognized for Exceptional Co-Leadership of Bass Connections Team
See related teams, Tracking Climate Change with Satellites and Artificial Intelligence (2022-2023) and Deep Learning for Rare Energy Infrastructure in Satellite Imagery (2020-2021), and Data+ summer project, Tracking Climate Change Impacts with Satellites and AI (2022).
Image: Wind farm, by pfly, licensed under CC BY 2.0
- Kyle Bradbury, Pratt School of Engineering-Electrical & Computer Engineering|Energy Initiative
- Jordan Malof, Pratt School of Engineering-Electrical & Computer Engineering
/graduate Team Members
Saksham Jain, Electrical/Computer Engg-MS
Ben Ren, Electrical/Computer Engg-PHD
Boya Sun, Interdisciplinary Data Science - Masters
Katherine Wu, Master of Engineering Mgmt-MEG
/undergraduate Team Members
Caleb Kornfein, Statistical Science (BS), Computer Science (BS2)
Alexander Kumar, Computer Science (BS)
Caroline Tang, Mathematics (BS), Statistical Science (BS2)
/yfaculty/staff Team Members
Leslie Collins, Pratt School of Engineering-Electrical & Computer Engineering
T. Robert Fetter, Nicholas Institute for Environmental Policy Solutions
Marc Jeuland, Sanford School of Public Policy
Luana Lima, Nicholas School of the Environment-Environmental Sciences and Policy
Robyn Meeks, Sanford School of Public Policy