Share Email Print

Proceedings Paper • new

Multiscale deep desmoking for laparoscopic surgery
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

In minimally invasive surgery, smoke generated by such as electrocautery and laser ablation deteriorates image quality severely. This creates discomfortable view for the surgeon which may increase surgical risk and degrade the performance of computer assisted surgery algorithms such as segmentation, reconstruction, tracking, etc. Therefore, real-time smoke removal is required to keep a clear field of view. In this paper, we propose a real-time smoke removal approach based on Convolutional Neural Network (CNN). An encoder-decoder architecture with Laplacian image pyramid decomposition input strategy is proposed. This is an end-to-end network which takes the smoke image and its Laplacian image pyramid decomposition as inputs, and outputs a smoke free image directly without relying on any physical models or estimation of intermediate parameters. This design can be further embedded to deep learning based follow-up image guided surgery processes such as segmentation and tracking tasks easily. A dataset with synthetic smoke images generated from Blender and Adobe Photoshop is employed for training the network. The result is evaluated quantitatively on synthetic images and qualitatively on a laparoscopic dataset degraded with real smoke. Our proposed method can eliminate smoke effectively while preserving the original colors and reaches 26 fps for a video of size 512 × 512 on our training machine. The obtained results not only demonstrate the efficiency and effectiveness of the proposed CNN structure, but also prove the potency of training the network on synthetic dataset.

Paper Details

Date Published: 15 March 2019
PDF: 9 pages
Proc. SPIE 10949, Medical Imaging 2019: Image Processing, 109491Y (15 March 2019); doi: 10.1117/12.2507822
Show Author Affiliations
Congcong Wang, Norwegian Univ. of Science and Technology (Norway)
Ahmed Kedir Mohammed, Norwegian Univ. of Science and Technology (Norway)
Faouzi Alaya Cheikh, Norwegian Univ. of Science and Technology (Norway)
Azeddine Beghdadi, Univ. Paris 13 (France)
Ole Jacob Elle, Oslo Univ. Hospital (Norway)

Published in SPIE Proceedings Vol. 10949:
Medical Imaging 2019: Image Processing
Elsa D. Angelini; Bennett A. Landman, Editor(s)

© SPIE. Terms of Use
Back to Top