Share Email Print

Proceedings Paper

Scene analysis with structural prototypes for content-based image retrieval in medicine
Author(s): Benedikt Fischer; Michael Sauren; Mark O. Güld; Thomas M. Deserno
Format Member Price Non-Member Price
PDF $14.40 $18.00
cover GOOD NEWS! Your organization subscribes to the SPIE Digital Library. You may be able to download this paper for free. Check Access

Paper Abstract

The content of medical images can often be described as a composition of relevant objects with distinct relationships. Each single object can then be represented as a graph node, and local features of the objects are associated as node attributes, e.g. the centroid coordinates. The relations between these objects are represented as graph edges with annotated relational features, e.g. their relative size. Nodes and edges build an attributed relational graph (ARG). For a given setting, e.g. a hand radiograph, a generalization of the relevant objects, e.g. individual bone segments, can be obtained by the statistical distributions of all attributes computed from training images. These yield a structural prototype graph consisting of one attributed node per relevant object and of their relations represented as attributed edges. In contrast to the ARG, the mean and standard deviation of each local or relational feature are used to annotate the prototype nodes or edges, respectively. The prototype graph can then be used to identify the generalized objects in new images. As new image content is represented by hierarchical attributed region adjacency graphs (HARAGs) which are obtained by region-growing, the task of object or scene identification corresponds to the problem of inexact sub-graph matching between a small prototype and the current HARAG. For this purpose, five approaches are evaluated in an example application of bone-identification in 96 radiographs: Nested Earth Mover's Distance, Graph Edit Distance, a Hopfield Neural Network, Pott's Mean Field Annealing and Similarity Flooding. The discriminative power of 34 local and 12 relational features is judged for each object by sequential forward selection. The structural prototypes improve recall by up to 17% in comparison to the approach without relational information.

Paper Details

Date Published: 11 March 2008
PDF: 9 pages
Proc. SPIE 6914, Medical Imaging 2008: Image Processing, 69141X (11 March 2008); doi: 10.1117/12.770541
Show Author Affiliations
Benedikt Fischer, RWTH Aachen Univ. of Technology (Germany)
Michael Sauren, RWTH Aachen Univ. of Technology (Germany)
Mark O. Güld, RWTH Aachen Univ. of Technology (Germany)
Thomas M. Deserno, RWTH Aachen Univ. of Technology (Germany)

Published in SPIE Proceedings Vol. 6914:
Medical Imaging 2008: Image Processing
Joseph M. Reinhardt; Josien P. W. Pluim, Editor(s)

© SPIE. Terms of Use
Back to Top