Share Email Print

Proceedings Paper

Evaluation of deep neural networks for single image super-resolution in a maritime context
Author(s): Robert P. J. Nieuwenhuizen; Maarten Kruithof; Klamer Schutte
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

High resolution imagery is of crucial importance for the performance on visual recognition tasks. Super-resolution (SR) reconstruction algorithms aim to enhance the image resolution beyond the capability of the image sensor being used. Traditional SR algorithms approach this inverse problem using physical models for the image formation combined with a regularization function to prevent instabilities in the solution. Recently deep neural networks have been put forward as an alternative approach to the SR reconstruction problem. They learn a mapping from low resolution images to their high resolution counterparts from pairs of training images, which allows them to capture more specific information about the space of possible solutions than traditional regularization functions. These networks have achieved state-of-the-art performance on single image SR for sets of generic test images. Here we investigate whether the same performance can be realized when these neural networks for single image SR are applied specifically in the maritime domain. In particular we investigate their ability to reconstruct undersampled images of ships at sea, and demonstrate that the performance is similar to what is achieved on generic test images. In addition we quantify the gain in performance that is achieved when the networks are trained specifically on images of ships, which allows the networks to capture more prior knowledge about the space of possible solutions. Finally we show that the performance deteriorates when the resolution of test images is limited by image blur, for example due to diffraction, rather than undersampling. This highlights the importance of using representative training data that account for the part of the image formation process that limits the resolution in the sensor data.

Paper Details

Date Published: 6 October 2017
PDF: 11 pages
Proc. SPIE 10433, Electro-Optical and Infrared Systems: Technology and Applications XIV, 104330T (6 October 2017); doi: 10.1117/12.2277842
Show Author Affiliations
Robert P. J. Nieuwenhuizen, TNO (Netherlands)
Maarten Kruithof, TNO (Netherlands)
Klamer Schutte, TNO (Netherlands)

Published in SPIE Proceedings Vol. 10433:
Electro-Optical and Infrared Systems: Technology and Applications XIV
David A. Huckridge; Reinhard Ebert; Helge Bürsing, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?