21 - 25 April 2024
National Harbor, Maryland, US
Conference 13051 > Paper 13051-33
Paper 13051-33

MLOps at the edge in DDIL environments

On demand | Presented live 24 April 2024

Abstract

Military operations invariably involve devices at the edge (e.g. sensors, drones, handsets of soldiers, etc.) In edge environments, good network connectivity cannot be assumed due to Denied, Degraded, Intermittent, or Low-bandwidth (DDIL) conditions. A DDIL environment poses unique challenges for deploying AI applications at the edge, particularly in the execution of Machine Learning Operations (MLOps). In this paper, we present a framework to address these challenges by considering three important dimensions: (i)the ML model lifecycle activities, (ii) specific DDIL induced challenges at the edge and (iii) the application stack. We discuss three realistic use cases in detail to explain the use of this approach to identify the underlying design patterns. We believe that use of this framework can lead to a responsive and reliable AI deployment under varying operational conditions.

Presenter

IBM Thomas J. Watson Research Ctr. (United States)
Dinesh C. Verma is an IEEE Fellow, IBM Fellow, AAIA Fellow and Fellow of UK Royal Academy of Engineering. He has authored 11 books, 200+ technical papers and 200+ U.S. patents. He has chaired/vice-chaired IEEE technical committee on computer communications and vice-chaired IEEE Internet technical committee. He has led several multi-national multi-organizational research programs. He has contributed to several IBM products and service offerings including significant contributions to server networking stack, network management products and cellular network analytics. He is currently leading exploratory science projects in the area of futuristic networks and distributed systems at IBM Research.
Application tracks: AI/ML
Presenter/Author
IBM Thomas J. Watson Research Ctr. (United States)
Author
Peter Santhanam
IBM Thomas J. Watson Research Ctr. (United States)