Deep High-Resolution U-Net Latent Diffusion Model for Histopathological Image Synthesis

Overview

Oral Squamous Cell Carcinoma (OSCC) is a highly invasive malignant tumor with significant health risks worldwide. Following the success of deep learning models over the past decade. Some studies demonstrate that deep learning-based models achieve 80%–90% accuracy in classifying OSCC. However, training deep learning models for classification requires large amounts of annotated data, which is expensive to collect and label. Our project introduces a novel Deep High-Resolution U-Net Latent Diffusion Model to generate high-quality histopathological images to enhance OSCC classification. By leveraging a ChatGPT-4o-based generator-discriminator framework, which generates detailed text prompts from unlabeled images. We integrate advanced conditioning embeddings by concatenating the CLIP text encoder and the PLIP text encoder outputs with HIPT-generated attention masks. The proposed HR-UNet architecture, adapted from the UNet design of Stable Diffusion 2.1, captures cellular details while maintaining multi-scale contextual information. We also fine-tuned the VAE decoder using a novel LPPIPS (Learned PLIP-image-encoder-based Perceptual Image Patch Similarity) loss function for better adapted medical images. Our approach improves the Fr ´echet Inception Distance (FID) from 111.7 to 24.7, and the OSCC classification accuracy from 91.17% to 96.25% by adding synthetic images.

Competition history

ISEF 2025 Robotics and Intelligent Machines · Entry ROBO018T

Resources

ISEF abstract page

Related projects

ISEF · 2024

Generative Deep Learning-Based Data Augmentation Techniques via Adversarial and Diffusive Models for Enhanced Squamous Cell Carcinoma Histopathological Scan Diagnosis

ISEF · 2021

Improved Classification and Prediction of Head and Neck Squamous Cell Carcinomas Using a Novel Generative Adversarial Network Model

ISEF · 2026

Spatial Transcriptomics-Conditioned Latent Diffusion Models for Synthetic Histopathology Tissue Patch Generation

ISEF · 2026

Deep Learning-Based Oral Lesion Classification Leveraging Real-Time 3D Gradient-Weighted Class Activation Mapping (Grad-CAM) Imaging

Closest projects by meaning, across every fair and year in the corpus.