Silent speech with ultrasound
60 points
3 days ago
| 11 comments
| alephneuro.com
| HN
mike_hock
5 minutes ago
[-]
I find it annoying to try and talk completely silently. I'm always whispering at least a bit. I can't imagine doing this for the entirety of a call.
reply
gblargg
5 hours ago
[-]
I remember a story decades ago about "subvocal" speech, similar to this: https://spacenews.com/nasa-develops-system-to-computerize-si...
reply
willwade
4 hours ago
[-]
Sony presented a simpler solution to this at CHI https://dl.acm.org/doi/10.1145/3772318.3791397 - check video in that. Also it seems every Cornell student is working on this. Just search on YouTube Cornell silent speech
reply
hdjrudni
3 days ago
[-]
> The two biggest hardware challenges are reducing the size and weight of the ultrasound probe and replacing ultrasound gel with a more practical coupling material, such as hydrogel. We think both are solvable, making it possible for the probe to eventually become a lightweight wearable or adhesive patch.

Not sure I'd want to put an adhesive patch on my neck every morning so I can silently talk to an LLM in the cubicle farm. I hope this is not our future.

Very cool tech though and surprisingly good results for so little training.

I think time might be better spent improving a lip reading model (no adhesive required), assuming we're unable to read brainwaves directly.

reply
delichon
7 hours ago
[-]
Keeping a camera focused on the lips could get awkward. A hands free throat patch may be more ergonomic.
reply
eviluncle
5 hours ago
[-]
Interesting. This seems similar to (though using different methods/techniques) what q.ai (that was sold to Apple for $2b) is developing.

See this hn thread about it: https://news.ycombinator.com/item?id=46816228

reply
paufernandez
1 hour ago
[-]
I had thought of this, so nice to see it done!
reply
stanislavzza
1 hour ago
[-]
Straight out of Life Artificial...
reply
nine_k
5 hours ago
[-]
That could be immensely helpful for people who cannot speak due to vocal chord problems.

It could also be the ultimate, always-on remote control for everything around, with a near-zero error rate.

reply
ubedan
2 days ago
[-]
Wonderful tech, and video example. I think there may also be a special forces application, but I don't know enough about how well their current solution works.

In the office, a non-contact video solution (lip reading) is likely to be far more popular, but a lot depends on which is more accurate.

reply
ehead
5 hours ago
[-]
These guys are on a roll!
reply
readthenotes1
7 hours ago
[-]
I wonder if, like with lip reading, they switch from American English to a different language that's not so peculiar they would have and much less error rate
reply
nine_k
6 hours ago
[-]
I suppose Spanish or German would be easier to recognize than English, due to the more distinct sounds, but Chinese would be much harder, due to the tones.
reply
m463
7 hours ago
[-]
reminds me of the handwriting recognition language Graffiti from palm/handspring days.

It ended up altering my handwriting even after I stopped using it.

reply