Generative Deep Learning-Based Data Augmentation Techniques via Adversarial and Diffusive Models for Enhanced Squamous Cell Carcinoma Histopathological Scan Diagnosis
ISEF · 2024 Robotics and Intelligent Machines Third Award
Overview
Cutaneous Squamous Cell Carcinoma (SCC) is the second most common form of skin cancer. Moreover, accurate, early diagnosis for pre-metastatic SCC is imperative; post-metastasis patient survival rate plummets from 99% to <50%. However, clinician-based interpretation of whole slide images is often inefficient and extensively time-consuming. Prior research has illustrated the efficacy of deep-learning approaches for autonomous classification of squamous cells for efficient SCC diagnosis; however, false negatives remain prominent due to bias against underrepresented, scarce malignant data. To circumvent the ramifications of imbalanced classes within datasets, research employed data augmentation techniques, but most fail to introduce new seed information and lead to model overfitting. This study developed two extensively fine-tuned novel generative machine learning architectures for SCC data augmentation and eventual classification enhancement: SquaGAN, a Conditional Generative Adversarial Network, and SquaDIFF, a Denoising Diffusion Probabilistic Model. Both models were trained on a SCC whole slide image patch dataset with severe malignant underrepresentation. To evaluate the success of the techniques, a VGG16 baseline metric classifier was developed and trained on three sets: the raw non-augmented dataset, a dataset amplified with existing data augmentation techniques, and finally a dataset amplified with the proposed generative data augmentation techniques. Both SquaGAN and SquaDIFF increased performance, with class-specific model accuracy jumps of +21% and +27%, respectively. Both models additionally demonstrated efficacy in a truncated evaluation, outperforming all existing counterparts. These results are promising in feasible autonomous diagnosis approaches in clinics.
Awards (1)
- Third Award of $1,000 $1,000
Competition history
- ISEF 2024
Resources
Related projects
ISEF · 2021
Improved Classification and Prediction of Head and Neck Squamous Cell Carcinomas Using a Novel Generative Adversarial Network Model
ISEF · 2025
Deep High-Resolution U-Net Latent Diffusion Model for Histopathological Image Synthesis
ISEF · 2024
Rapid Screening for Major Skin Cancers with M-SCAHN: Multimodal Hierarchical CNN-Transformer Hybrid Networks with Advanced Interpretability, Lesion Evolution Tracking, Trait Identification, and Color Constancy for Improved Generalization in Diverse Populations
ISEF · 2023
SquidNet: A Novel GAN-based Algorithm for the Color Normalization of Histopathological Images
Closest projects by meaning, across every fair and year in the corpus.
Source: Regeneron International Science and Engineering Fair