Talk to The Hand: Voice Controlled Robotic Hand

Overview

Purpose/Design Goal and Background: I did the Talk to the Hand: Voice Controlled Robotic Hand project because I wanted to learn more about coding and working with the affordable Raspberry Pi computer. My device will help disabled people by letting them interact with what is around them using voice control and servos. Design-Redesign Test Description: I did my experiment by modifying code and sending it to a Raspberry Pi to evaluate the correctness of speech to movement and making a variety of gestures. During the first tests, the OpenAI Whisper software would make mistakes with speech-to-text like thinking the number "one" was the word "won", which I fixed. I also designed, created and assembled the prototype. Results of redesign tests and analysis: I have developed a device that can easily detect speech and interact with the world through gestures. The device still has room for improvement in the amount of gestures, so it could benefit from adding to my library with more gestures. Goal Achievement: This project was created to help disabled people interact with what is around them. The engineering side involved integrating the hardware components and getting them to work cohesively in the design. In the software, I improved the accuracy of the speech to text and integrated the servo control software with gestures. I successfully got the hardware and software working for my initial prototype. Further improvements could include a smaller or larger design, a modified gesture library, and a robotic arm for more usage options.

Competition history

• CSEF 2026 Electronics & Electromagnetics (Junior Division) · Entry J-10-10

Related projects

Closest projects by meaning, across every fair and year in the corpus.

Browse more like this

• All Physics and Astronomy projects
• CSEF Physics and Astronomy projects
• Every CSEF 2026 project