Share Email Print

Proceedings Paper

Deep-learning based automated instrument tracking and adaptive-sampling of intraoperative OCT for video-rate volumetric imaging of ophthalmic surgical maneuvers
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Intraoperative optical coherence tomography (iOCT) enables volumetric imaging of surgical maneuvers. While previous studies have demonstrated the utility of iOCT for verifying completion of surgical goals, images were acquired over static field-of-views (FOVs) or required manual tracking of regions-of-interest (ROIs). The lack of automated instrument-tracking remains a critical barrier to real-time surgical feedback and iOCT-guided surgery. Previously presented approaches to address this include active stereo-vision based instrument tracking, which was limited to imaging in the anterior segment; and instrument-tracking using volumetric OCT data, which was limited by OCT acquisition speeds and fundamental trade-offs between sampling density and FOV. We previously presented spectrally-encoded coherence tomography and reflectometry (SECTR), which provides simultaneous imaging of spatiotemporally coregistered orthogonal imaging planes (en face and cross-sectional) at several gigapixels-persecond. Here, we demonstrate automated surgical instrument-tracking and adaptive-sampling of OCT using a combination of deep-learning and SECTR. A GPU-accelerated deep neural network was trained using SER images for detection and localization of 25G internal limiting membrane (ILM) forceps at up to 50 Hz. Positional information was used for acquisition of adaptivelysampled SER frames and OCT volumes, which were densely-sampled at the instrument tip and sparsely-sampled elsewhere to retain tracking features over a large field-of-view. We believe this method overcomes critical barriers to clinical translation of iOCT and offers advantages over previous approaches by 1) reducing the instrument-tracking problem to 2D space, which is more efficient than 3D tracking or pose-estimation, and allows direct leveraging of the recent advances in computer-vision software and hardware; and 2) decoupling tracking speed and performance from OCT system and acquisition parameters.

Paper Details

Date Published: 22 February 2019
PDF: 6 pages
Proc. SPIE 10867, Optical Coherence Tomography and Coherence Domain Optical Methods in Biomedicine XXIII, 108671M (22 February 2019); doi: 10.1117/12.2511827
Show Author Affiliations
Mohamed T. El-Haddad, Vanderbilt Univ. (United States)
Joseph D. Malone, Vanderbilt Univ. (United States)
Nancy T. Hoang, Vanderbilt Univ. (United States)
Yuankai K. Tao, Vanderbilt Univ. (United States)

Published in SPIE Proceedings Vol. 10867:
Optical Coherence Tomography and Coherence Domain Optical Methods in Biomedicine XXIII
James G. Fujimoto; Joseph A. Izatt, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?