C2P-Net: Reconstructing Hidden Anatomy in Middle Ear Imaging Using Novel Complete-to-Partial Non-Rigid 3D Registration Methodology
ISEF · 2026 Software Design
Overview
Middle ear disorders are common but hard to diagnose without structural imaging. Optical Coherence Tomography (OCT) offers an accessible alternative to CT, yet it produces noisy and partial 3D observations, making clinical interpretation time-consuming and challenging. Complete-to-partial registration can reconstruct hidden anatomy by aligning incomplete 3D observations with a complete reference model, analogous to placing a puzzle piece into a full picture; however, existing methods including my previous C2P-Net version fail to generalize to noisy and incomplete real-world clinical data. To address this challenge, I have advanced and validated C2P-Net to accurately reconstruct patient-derived middle ears from partial OCT scans by incorporating several fundamental innovations. The approach reformulates non-rigid registration into a two-stage optimization consisting of an initial global linear alignment, followed by a non-linear deformation. Inspired by the observation that point correspondences remain consistent under geometric transformations, the search for the non-linear deformation is guided using point-to-point correspondences, improving convergence behavior significantly. In order to avoid time-consuming correspondence search, C2P-Net identifies point-to-point correspondences using a breakthrough transformer-based neural network. The proposed approach was validated on the clinically verified DIOME OCT middle ear dataset; despite being trained in simulation, it achieved a mean deviation of 0.8 mm, illustrating strong sim-to-real abilities. Additional experiments demonstrate generalization to tumor localization and multi-view aggregation, indicating the potential of C2P-Net as a broadly applicable approach for accurate and robust complete-to-partial registration.
Awards (1)
- Third Award of $1,200 $1,200
Competition history
- ISEF 2026
Resources
Related projects
ISEF · 2023
OtoScan: A Novel, Inexpensive System for Comprehensive Diagnosis of Middle Ear Infections With an Intelligent Mobile Otoscope
ISEF · 2026
Revolutionizing Tympanoplasty: A Personalized Surgical Process Using Three-Dimensional High-Resolution Scanning and Modeling, Bio Printed Tympanic Grafts, and an Automated Autonomous Robotic Surgical Procedure With Reinforcement Learning
ISEF · 2021
Intra-procedural Prostate MRI Registration: A Data-efficient Siamese Neural Network (SNN) Design
ISEF · 2024
SAAR: Surgical Aid for Anatomical Reconstructions Using Projector-Based Augmented Reality and Computer Vision Systems
Closest projects by meaning, across every fair and year in the corpus.
Source: Regeneron International Science and Engineering Fair