Share Email Print

Proceedings Paper

International evaluation collaboration: developing and managing infrastructure for research and development programs
Author(s): Rachel Bowers; Dennis Moellman; John Garofolo
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

The most innovative technology can potentially meet any goals of research sponsors: however, this potential may never materialize if the program lacks infrastructure. Although most new programs address basic contractual and managerial components, often few funds are remaining to address other critical elements such as data for training and testing, evaluation infrastructure development, and data reference annotations. For instance, if a program starts without proper data to support development of the research, progress tends to be slow due to theories being tested on anecdotal amounts data, or worse, the researcher relies on his/her own data, that may give an unrealistic measure of performance on real data. The former situation tends to underestimate researcher ability, which could lead to a de-scoping or termination of the program. The latter, may overestimate the researcher's ability, while potentially harming funding for subsequent program cycles as new data raises challenges. This paper describes a management philosophy that mitigates such risk by adhering to rigorous evaluation principles and illustrates how evaluation collaboration positively addresses many of these challenges. This example is embodied in the management and execution of the Video Analysis and Content Extraction (VACE) program.

Paper Details

Date Published:
PDF: 12 pages
Proc. SPIE 6402, Optics and Photonics for Counterterrorism and Crime Fighting II, 640202; doi: 10.1117/12.691386
Show Author Affiliations
Rachel Bowers, National Institute of Standards and Technology (United States)
Dennis Moellman, Disruptive Technology Office (United States)
John Garofolo, National Institute of Standards and Technology (United States)

Published in SPIE Proceedings Vol. 6402:
Optics and Photonics for Counterterrorism and Crime Fighting II
Colin Lewis; Gari P. Owen, Editor(s)

© SPIE. Terms of Use
Back to Top