Institute for Artificial Intelligence

Satellite Imagery

Remote sensing can help to understand different aspects of our planet: land use, weather, human behavior, natural disasters and so on. Due to the massive data throughput of satellites, computer vision and machine learning algorithms are essential for taking full advantage of this source of knowledge. Otherwise, it would be impractical to produce results within an acceptable time frame. This line of research focuses on the automatic extraction of meaningful information from satellite imagery, while taking the computational cost into careful account.

Projects

Title: Resource-Constrained Geospatial Land Use Classification and Object Detection

Description: Land use classification and vehicle detection are critical pieces of information for a widerange of applications, from humanitarian to military purposes. Applying computer vision and machine learning algorithms to perform such tasks autonomously requires the ability to overcome different challenges, such as occlusions, varying perspectives, fine-grained discrimination, and class imbalance. This project explores ensembles of deep neural networks and test augmentation to tackle these problems.

Publications:

R. Minetto, M. Pamplona Segundo, S. Sarkar (2019). "Hydra: An Ensemble of Convolutional Neural Networks for Geospatial Land Classification", IEEE Transactions on Geoscience and Remote Sensing.

G. Rotich, S. Aakur, R. Minetto, M. Pamplona Segundo, S. Sarkar (2018). "Using Semantic Relationships among Objects for Geospatial Land Use Classification", IEEE Applied Imagery Pattern Recognition Workshop.

G. Rotich, R. Minetto, S. Sarkar (2018). "Resource-Constrained Simultaneous Detection and Labeling of Objects in High-Resolution Satellite Images", arXiv.

 

Title: Economic Recovery Markers from Satellite Imagery to help with City-scale Decisions during COVID-19 Recovery

Description: Lockdowns and quarantines implemented worldwide due to the COVID-19 outbreak can be noticed even from space. Remote sensing can help to understand their effects on human and economic activities by recording changes in human behavior over time. This project focuses on the use of satellite imagery to support decisions concerning: (1) traffic issues, to ensure citizens' mobility but at the same time to avoid traffic jams that block the exchange of essential supplies; (2) facilities activity, to safely and economically maximize resources availability; and (3) social distancing, to appraise whether people are following health and safety directives issued by the government.

Publications:

R. Minetto, M. Pamplona Segundo, G. Rotich, S. Sarkar (2020). "Measuring Human and Economic Activity from Satellite Imagery to Support City-Scale Decision-Making during COVID-19 Pandemic", arXiv.