Voice Activity
We developed six voice command to control devices and perform specific interactions. Slides are used as an example to demonstrate our product’s functionality.
Our project is powered by ElevenLabs for speech-to-text and PyAutoGUI for sending real keyboard shortcuts to applications like Google Slides/PowerPoint and Youtube.
Broader Use-Cases
Here we demonstrate our voice activity feature with presentation slides as an example task. Beyond this, voice activities is a perfect use-case for professors, as they can say "next slide" in their clipped microphone to their shirt, which can increase lecture effectiveness by 20% through unnecessary slide navigation and increase student engagement in classes.
As well, for every day uses, you can easily pause, play, rewind, and forward with basic voice commands without a need for a remote.
Review
Our application, Touchless for Voice, is about 30% complete due to time restraints. Although having a microphone pinned on your shirt can catch all the words, our accuracy with the eleven labs model is inaccurate by about 40%. Although it catches words, it won't register if some phrases are said. For example "Back ten" can be heard "Back then", causing a repetition of words.