PanOculus: A Novel, Multifaceted Diagnostic Tool for Skin Cancer, Diabetic Retinopathy, and Otitis Media Powered by Deep Learning
Overview
Isolated from the reach of Western medicine, many developing nations lack access to skilled physicians and expensive equipment such as otoscopes, skin biopsy tools, and ophthalmoscopes. As a result, preventable diseases including otitis media— with half a billion cases annually — melanoma— the most lethal skin cancer in the world— and diabetic retinopathy— affecting 93 million people worldwide— are allowed to pass undiagnosed and untreated. The tragic ramifications of such diseases, including permanent hearing loss, permanent blindness, and death, go down by as much as 75% with early diagnosis (NCBI), and thus the solution of PanOculus is formulating an inexpensive solution to diagnose and facilitate treatment for otitis media, skin cancer, and diabetic retinopathy in developing countries. The project consists of two parts. First is an inexpensive, lightweight physical phone attachment designed in autoCAD and 3D printed, working in conjunction with a compact 20D condensing lens. Second is a mobile application enabled with machine learning diagnostics and cloud compatibility to contact doctors remotely for treatment plans. The diagnostic algorithm used is a neural network, specifically an Inception-V3 model retrained on three image datasets, and the accuracy was optimized using data augmentation, regularization with label smoothing, and datasets with a diverse diagnostic portfolio, yielding up to a 97.4% accuracy when exposed to new image data. PanOculus circumvents the infrastructural and economic impediments that prevent accessible medical diagnosis in the developing world, and through a syncretism of medicine, computer science, and engineering, attempts to pioneer a new forefront of change.
Awards (1)
- ASU Rob and Melani Walton Sustainability Solutions Service: Award of $1,000 $1,000
Competition history
- ISEF 2019
Resources
Related projects
ISEF · 2020
PanOculus: A Novel, Multifaceted Diagnostic Tool for Ocular Disease Powered by a Variable Focus Liquid Lens, Deep Learning, and Telemedicine Technology
ISEF · 2022
Detecting Glaucoma From Retinal Fundus Images Using Machine Learning
ISEF · 2023
EyePal: A Novel Multimodal Diagnosis & Prevention System to Enable Accessible and Individualized Glaucoma Detection
ISEF · 2022
Speculor: A Comprehensive Teleophthalmology Platform for People Centered Eyecare
ISEF · 2021
OCULI: Smartphone-based Screening Application and Low-Cost Lens that Identifies the Risk for Cataracts
ISEF · 2019
Developing a Novel, Accurate, and Rapid Computer Vision and Machine Learning Based Skin Disease Diagnosis Pipeline, Hardware Apparatus, and Mobile Application
ISEF · 2020
The iSpy Platform: A Multi-Faceted Suite of Affordable Smartphone Imaging and Sensor-Based Utilities for the Non-Invasive Detection of Parkinsonian Tremor and Skin Cancer via Machine Learning
ISEF · 2023
Development of a Low-Cost Machine Learning Diagnostic Device and Medical IoT Application as a Novel Approach to Combating Retinal Diseases
Closest projects by meaning, across every fair and year in the corpus.
Browse more like this
Source: Regeneron International Science and Engineering Fair