# Will Programming by Voice Be the Next Frontier in Software Development?

**URL:** <https://onehack.st/t/will-programming-by-voice-be-the-next-frontier-in-software-development/176878>\
**Category:** News & Articles\
**Tags:** ebook, tools, programming, freebies\
**Created:** [March 28, 2021, 4:11pm UTC](https://onehack.st/t/will-programming-by-voice-be-the-next-frontier-in-software-development/176878 "2021-03-28T16:11:12Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![TheStrength](https://onehack.st/user_avatar/onehack.st/thestrength/32/46753_2.png) [@TheStrength](https://onehack.st/u/TheStrength)\
**Post date:** [March 28, 2021, 4:11pm UTC](https://onehack.st/t/will-programming-by-voice-be-the-next-frontier-in-software-development/176878/1 "2021-03-28T16:11:12Z")

</div>

[![](https://spectrum.ieee.org/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNjc4NjY2OC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY2OTE0Njk0NX0.CnFFF_DFsNeOClyQKMYeq8Pj303wFM0tSuqXBTDTS-g/image.jpg) ](https://spectrum.ieee.org/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNjc4NjY2OC9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY2OTE0Njk0NX0.CnFFF_DFsNeOClyQKMYeq8Pj303wFM0tSuqXBTDTS-g/image.jpg)

Two software engineers with injuries or chronic pain conditions have both started voice-coding platforms, reports _IEEE Spectrum._ “[Programmers utter commands to manipulate code](https://spectrum.ieee.org/computing/software/programming-by-voice-may-be-the-next-frontier-in-software-development) and create custom commands that cater to and automate their workflows.”

_The voice-coding app [Serenade](https://serenade.ai/), for instance, has a speech-to-text engine developed specifically for code, unlike [Google’s speech-to-text API](https://cloud.google.com/speech-to-text), which is designed for conversational speech. Once a software engineer speaks the code, Serenade’s engine feeds that into its natural-language processing layer, whose machine-learning models are trained to identify and translate common programming constructs to syntactically valid code…_

 

[Talon](https://talonvoice.com/) has several components to it: speech recognition, eye tracking, and noise recognition. Talon’s speech-recognition engine is based on Facebook’s [Wav2letter](https://ai.facebook.com/tools/wav2letter/) automatic speech-recognition system, which [founder Ryan] Hileman extended to accommodate commands for voice coding. Meanwhile, Talon’s eye tracking and noise-recognition capabilities simulate navigating with a mouse, moving a cursor around the screen [based on eye movements and making clicks based on mouth pops](https://www.joshwcomeau.com/blog/hands-free-coding/). “That sound is easy to make. It’s low effort and takes low latency to recognize, so it’s a much faster, nonverbal way of clicking the mouse that doesn’t cause vocal strain,” Hileman says…

_Open-source voice-coding platforms such as [Aenea](https://github.com/dictation-toolbox/aenea) and [Caster](https://github.com/dictation-toolbox/Caster) are free, but both rely on the [Dragon](https://www.nuance.com/dragon.html) speech-recognition engine, which users will have to purchase themselves. That said, Caster offers support for [Kaldi](http://kaldi-asr.org/), an open-source speech-recognition tool kit, and Windows Speech Recognition, which comes preinstalled in Windows._

---

<div class="post-metadata">

**Author:** ![Emi](https://onehack.st/user_avatar/onehack.st/emi/32/82979_2.png) [@Emi](https://onehack.st/u/Emi)\
**Post date:** [March 28, 2021, 6:41pm UTC](https://onehack.st/t/will-programming-by-voice-be-the-next-frontier-in-software-development/176878/2 "2021-03-28T18:41:26Z")

</div>

I’m pretty sure it will. The possibilities are huge as we could already see on many of the other uses of voice recognition nowadays.  
I’ll be paying attention to some of the projects you shared with us in this article.

---

<div class="post-metadata">

**Author:** ![aidatainside](https://onehack.st/user_avatar/onehack.st/aidatainside/32/23955_2.png) [@aidatainside](https://onehack.st/u/aidatainside)\
**Post date:** [March 29, 2021, 8:38pm UTC](https://onehack.st/t/will-programming-by-voice-be-the-next-frontier-in-software-development/176878/3 "2021-03-29T20:38:01Z")

</div>

Yes and no…voice recognition is great and all, but it goes back to the same reason why we still choose typing over “speak to type” solutions. Sometimes “speak to type” is good for things such as live broadcasting for closed captioning, but even those solutions fall short. The issue with voice input comes mainly down to the trained model and also the outside variables that could take place. For example if I’m in a close environment then I know for a fact that the microphone is more than likely going to pick up what I am saying correctly and display/record it correctly.
