Share Email Print
cover

Proceedings Paper • new

Reasoning and learning services for coalition situational understanding
Author(s): Dan Harborne; Ramya Raghavendra; Chris Willis; Supriyo Chakraborty; Pranita Dewan; Mudhakar Srivatsa; Richard Tomsett; Alun Preece
Format Member Price Non-Member Price
PDF $14.40 $18.00

Paper Abstract

Situational understanding requires an ability to assess the current situation and anticipate future situations, requiring both pattern recognition and inference. A coalition involves multiple agencies sharing information and analytics. This paper considers how to harness distributed information sources, including multimodal sensors, together with machine learning and reasoning services, to perform situational understanding in a coalition context. To exemplify the approach we focus on a technology integration experiment in which multimodal data — including video and still imagery, geospatial and weather data — is processed and fused in a service-oriented architecture by heterogeneous pattern recognition and inference components. We show how the architecture: (i) provides awareness of the current situation and prediction of future states, (ii) is robust to individual service failure, (iii) supports the generation of ‘why’ explanations for human analysts (including from components based on ‘black box’ deep neural networks which pose particular challenges to explanation generation), and (iv) allows for the imposition of information sharing constraints in a coalition context where there is varying levels of trust between partner agencies.

Paper Details

Date Published: 4 May 2018
PDF: 9 pages
Proc. SPIE 10635, Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX, 106350V (4 May 2018); doi: 10.1117/12.2307009
Show Author Affiliations
Dan Harborne, Cardiff Univ. (United Kingdom)
Ramya Raghavendra, IBM Thomas J. Watson Research Ctr. (United States)
Chris Willis, BAE Systems (United Kingdom)
Supriyo Chakraborty, IBM Thomas J. Watson Research Ctr. (United States)
Pranita Dewan, IBM Thomas J. Watson Research Ctr. (United States)
Mudhakar Srivatsa, IBM Thomas J. Watson Research Ctr. (United States)
Richard Tomsett, IBM Emerging Technology (United Kingdom)
Alun Preece, Cardiff Univ. (United Kingdom)


Published in SPIE Proceedings Vol. 10635:
Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX
Michael A. Kolodny; Dietrich M. Wiegmann; Tien Pham, Editor(s)

© SPIE. Terms of Use
Back to Top