Integrated multi-modal image fusion and quantification for advanced visualization in mitral valve surgery

Minimally invasive surgery is the state-of-the-art approach for mitral valve repair, but altered pressure conditions during surgery deform the anatomy, complicating visualization and measurement. We developed a technique combining stereo-endoscopic video with 3D transesophageal echocardiography (3D TEE) to enhance anatomic visualization and measurement accuracy. Our method includes stereo camera calibration, image segmentation, and 3D model reconstruction, aligning imaging modalities with anatomical landmarks. Validation showed high precision within an error range of 0.5 ± 0.1 mm. Integrating stereoscopic and 3D TEE offers improved precision in mitral valve repairs, with potential future applications in visualizing tissue properties and implant placement.