Object Classification in Thermal Images using Convolutional Neural Networks for Search and Rescue Missions with Unmanned Aerial Systems
Rodin, Christopher D; de Lima, L. N.; Andrade, Fabio; Haddad, D. B.; Johansen, Tor Arne; Storvold, Rune
Journal article, Peer reviewed
Accepted version
View/ Open
Date
2018Metadata
Show full item recordCollections
Original version
10.1109/IJCNN.2018.8489465Abstract
In recent years, the use of Unmanned Aerial Systems (UAS) has become commonplace in a wide variety of tasks due to their relatively low cost and ease of operation. In this paper, we explore the use of UAS in maritime Search And Rescue (SAR) missions by using experimental data to detect and classify objects at the sea surface. The objects are chosen as common objects present in maritime SAR missions: a boat, a pallet, a human, and a buoy. The data consists of thermal images and a Gaussian Mixture Model (GMM) is used to discriminate foreground objects from the background. Then, bounding boxes containing the object are defined and used to train a Convolutional Neural Network (CNN). The CNN achieves the average accuracy of 92.5% when evaluating a testing dataset.