Share Email Print

Proceedings Paper

Initial investigations into using an ensemble of deep neural networks for building façade image semantic segmentation
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Due to now outdated construction technology, houses which have not been retrofitted since construction typically fail to meet modern energy performance levels. However, identifying at a city scale which houses could benefit the most from retrofit solutions is currently a labour intensive process. In this paper, a system that uses a vehicle mounted camera to capture pictures of residential buildings and then performs semantic segmentation to differentiate components of captured buildings is presented. An ensemble of U-Net semantic segmentation models are trained to identify walls, roofs, chimneys, windows and doors from building façade images and differentiate between window and door instances which are partially visible or obscured. Results show that the ensemble of U-Net models achieved high accuracy in identifying walls, roofs and chimneys, moderate accuracy in identifying windows and low accuracy in identifying doors and instances of windows and doors which were partially visible or obscured. When U-Net models were retrained to identify doors or windows, irrespective of partially visible and obscured instances, a significant rise in door and window identification accuracy was observed. It is believed that a larger training dataset would produce significantly improved results across all classes. The results presented here prove the operational feasibility in the first part of a process to combine this model with high-resolution thermography and GPS for automating building retrofitting evaluations.

Paper Details

Date Published: 2 October 2019
PDF: 11 pages
Proc. SPIE 11157, Remote Sensing Technologies and Applications in Urban Environments IV, 1115708 (2 October 2019); doi: 10.1117/12.2532828
Show Author Affiliations
Menglin Dai, The Univ. of Sheffield (United Kingdom)
Gregory Meyers, The Univ. of Sheffield (United Kingdom)
Danielle Densley Tingley, The Univ. of Sheffield (United Kingdom)
Martin Mayfield, The Univ. of Sheffield (United Kingdom)

Published in SPIE Proceedings Vol. 11157:
Remote Sensing Technologies and Applications in Urban Environments IV
Thilo Erbertseder; Nektarios Chrysoulakis; Ying Zhang; Frank Baier, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?