Share Email Print
cover

Proceedings Paper

WeLineation: crowdsourcing delineations for reliable ground truth estimation
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

Crowdsourcing is a concept to encourage humans all over the world to generate ground truth for classification data such as images. While frameworks for binary and multi-label classification exist, crowdsourcing of medical image segmentation is covered only by few work. In this paper, we present a web-based platform supporting scientists of various domains to obtain segmentations, which are close to ground-truth references. The system is composed of frontend, authentication, management, processing, and persistence layers which are implemented combining various javascript tools, the django web framework, an asynchronous celery task, and a PostgreSQL database, respectively. It is deployed on a kubernetes cluster. A set of image data accompanied by a task instruction can be uploaded. Users can be invited or subscribe to join in. After passing a guided tutorial of pre- segmented example images, segmentations can be obtained from non-expert users from all over the world. The Simultaneous Truth and Performance Level Estimation (STAPLE) algorithm generates estimated ground truth segmentation masks and evaluates the users performance continuously in the backend. As a proof of concept, a test-study with 75 photographs of human eyes was performed by 44 users. In just a few days, 2,060 segmentation masks with a total of 52,826 vertices along the mask contour have been collected.

Paper Details

Date Published: 2 March 2020
PDF: 8 pages
Proc. SPIE 11318, Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications, 113180C (2 March 2020); doi: 10.1117/12.2551279
Show Author Affiliations
Saksham Goel, Indian Institute of Technology Bombay (India)
Yash Sharma, Indian Institute of Technology Bombay (India)
Malte-Levin Jauer, Peter L. Reichertz Institut für Medizinische Informatik, Medizinischen Hochschule Hannover (Germany)
Thomas M. Deserno, Peter L. Reichertz Institut für Medizinische Informatik, Medizinischen Hochschule Hannover (Germany)


Published in SPIE Proceedings Vol. 11318:
Medical Imaging 2020: Imaging Informatics for Healthcare, Research, and Applications
Po-Hao Chen; Thomas M. Deserno, Editor(s)

© SPIE. Terms of Use
Back to Top
PREMIUM CONTENT
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?
close_icon_gray