Simulation-aided Learning from Demonstration for Robotic LEGO Construction
JSHS · 2024
Overview
Recent advancements in manufacturing have a growing demand for fast, automatic prototyping (i.e. assembly and disassembly) capabilities to meet users’ needs. This paper studies automatic rapid LEGO prototyping, which is devoted to constructing target LEGO objects that satisfy individual customization needs and allow users to freely construct their novel designs. A construction plan is needed in order to automatically construct the user -specified LEGO design. However, a freely designed LEGO object might not have an existing construction plan, and generating such a LEGO construction plan requires a non-trivial effort since it requires accounting for numerous constraints (e.g. object shape, colors, stability, etc.). In addition, programming the prototyping skil l for the robot requires the users to have expert programming skills, which makes the task beyond the reach of the general public. To address the challenges, this paper presents a simulation -aided learning from demonstration (SaLfD) framework for easily de ploying LEGO prototyping capability to robots. In particular, the user demonstrates constructing the customized novel LEGO object. The robot extracts the task information by observing the human operation and generates the construction plan. A simulation is developed to verify the correctness of the learned construction plan and the resulting LEGO prototype. The proposed system is deployed to a FANUC LR -mate 200id/7L robot. Experiments demonstrate that the proposed SaLfD framework can effectively correct and learn the prototyping (i.e. assembly and disassembly) tasks from human demonstrations. And the learned prototyping tasks are realized by the FANUC robot.
Competition history
- JSHS 2024
Resources
Related projects
ISEF · 2025
AssemblyComplete: 3D Combinatorial Construction With Deep Reinforcement Learning
ISEF · 2026
Safer Hands in Hazardous Environments: Object-Centric Reinforcement Learning for Sim-to-Real Dexterous Manipulation
ISEF · 2016
ANSME: Robot Learning 3 Dimensional Actions by Watching 2 Dimensional YouTube Video
ISEF · 2021
Use of Collaborative Robotics in Mass Production of Freehand Components
CWSF · 2026
From Single-Task Imitation to Real-World Generalization: A Hierarchical Reason-Act Robot System
ISEF · 2019
Robotic Revolution in the Construction Industry: An Autonomous Roof Shingling Robot
ISEF · 2022
Development and Construction of a Low-Cost Six-Axis Robot Arm
ISEF · 2017
The Two-Stage Cognitive System for Teaching Robots
Closest projects by meaning, across every fair and year in the corpus.