Share Email Print

Proceedings Paper

Genetic algorithm for automatic tuning of neural network hyperparameters
Author(s): Jakub Safarik; Jakub Jalowiczor; Erik Gresak; Jan Rozhon
Format Member Price Non-Member Price
PDF $17.00 $21.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

Artificial neural networks affect our everyday life. But every neural network depends on the appropriate training set and setting of internal properties with hyperparameters. Even accurate and complete training set doesnt imply high performance of neural network algorithm. Tuning of hyperparameters is crucial for correct functionality, fast learning and high accuracy of neural networks. The hyperparameter selection relies on manual fine-tuning based on multiple full training trials. There are a lot of neural network implementation available for public and commercial use, but the setting of hyperparameters is often a neglected problem. Choosing the best structure and hyperparameters is the primary challenge in designing a neural network. This article describes a genetic algorithm for automatic selection of hyperparameters and their tuning for increasing the performance of neural networks without human interaction. The optimization algorithm accelerates the discovery of configuration, which is otherwise a time-consuming task. We evaluate the results of optimizations in comparison to naïve approach and compare pro and cons of different techniques.

Paper Details

Date Published: 3 May 2018
PDF: 7 pages
Proc. SPIE 10643, Autonomous Systems: Sensors, Vehicles, Security, and the Internet of Everything, 106430Q (3 May 2018); doi: 10.1117/12.2304955
Show Author Affiliations
Jakub Safarik, CESNET z.s.p.o. (Czech Republic)
Jakub Jalowiczor, CESNET z.s.p.o. (Czech Republic)
Erik Gresak, CESNET z.s.p.o. (Czech Republic)
Jan Rozhon, CESNET z.s.p.o. (Czech Republic)

Published in SPIE Proceedings Vol. 10643:
Autonomous Systems: Sensors, Vehicles, Security, and the Internet of Everything
Michael C. Dudzik; Jennifer C. Ricklin, Editor(s)

© SPIE. Terms of Use
Back to Top