Kintsugi 4D: Image-Based Kintsugi-Aware Framework for Fragment-Level 3D Point-Cloud Reconstruction and Chronicle Integration
ISEF · 2026 Technology Enhances the Arts
Overview
Kintsugi is a traditional Japanese restoration technique for repairing broken objects, making them more beautiful and cherished over time. Rather than hiding damage, kintsugi highlights repair traces as a new aesthetic and cultural value.Inspired by this concept, this project developed Kintsugi 4D, positing that not only the 3D geometry of kintsugi works but also elements previously difficult to preserve, such as the kintsugi artist’s intentions and the owner’s memories, could be digitally integrated into a chronicle.This project proposes Kintsugi-Splitter, a kintsugi-aware framework that processes two inputs—a single photo and a narrative—and generates paired outputs: fragment-level 3D point clouds and a structured chronicle. This process unifies geometric reconstruction and narrative integration into a 4D representation of kintsugi works.Experiments on 14 diverse kintsugi works demonstrated that fragment-level 3D point clouds can be generated from a single smartphone image without the need for specialized equipment, showing robustness across various repair styles and compositions. By publicly releasing Kintsugi-Splitter on GitHub, this project promotes reproducibility and extensibility, enabling others to apply and expand both the framework and dataset. Through this open and AI-driven approach, Kintsugi 4D disseminates the concept of kintsugi globally.
Awards (1)
- Fourth Award of $600 $600
Competition history
- ISEF 2026
Resources
Related projects
ISEF · 2025
RestART: An AI-Driven Restoration System for High-Fidelity in Artwork Revival Across Multiple Surfaces, Damage Types, and Eras Through Metadata-Enriched, Style-Conscious, Explainable, and Interactive Artist Approaches
ISEF · 2019
Recovering History: A Multifaceted System to Enhance, Classify and Reconstruct Broken Parts of Artifacts by Using a Custom Machine Learning Ensemble
ISEF · 2024
Revival and Restoration of Chinese Traditional Puppetry Videos Using Motion Video and Action Recognition Technology
ISEF · 2023
The Story of the Stone: A Novel Rubbing Restoration Method Using Generative Adversarial Network
Closest projects by meaning, across every fair and year in the corpus.
Source: Regeneron International Science and Engineering Fair