Smart Mirror with Voice and Gesture Control
by RPi Admin · November 9, 2016
This is how it looks like! Video here: https://www.youtube.com/watch?v=8swdfbnZn9E
I built a smart mirror that does voice recognition with a built-in microphone and gesture recognition with two distance sensors on each side of the frame. I also made a small operating system that you can install apps on and it’s really easy for developers to build apps for. The software I built runs on Electron (a web app engine) and provides APIs for developers to access the sensors and the microphones. However I have not published it yet because it needs some refinements. Features: – Voice control: When you clap your hands a microphone detects it and the voice recognition starts. You can say commands to launch apps such as “shakira video” to launch YouTube with a video of shakira, “play the radio” to launch the radio app, “show me the news” for the news app or “weather” for the weather.
- Gesture control: You can use gesture control in apps to navigate through the content or to play games. For example if you search for “pictures of cats” you can navigate through the pictures.
- Smartphone remote control: With a smartphone app I made you can see the list of all the installed apps and launch and interact with them. The whole project cost about 400€.
Here you can see some slides with more info: https://docs.google.com/presentation/d/1g7epekWB7_d-9sFHxVkCuLePXaNvUdDchLt7i3u3QNQ/edit?usp=sharing
I borrowed the one-way mirror from my University so I had to design the hardware to be easy to take apart. I made two parts: the frame, which holds the glass and the sesnors¡, and the back support, which holds the TV, the microphone, the Raspberry Pi and the power adapters. The back is hung on to a wall and then the frame is hung on to the back.
Building the frame and back
For the back support I used a wooden square and I cut a hole in the middle to put the TV support. Luckily , for the frame, we found an old wooden frame which had a nice size for our glass. We only had to paint it and drill four holes for the sensors.
I used an LG 24″ TV