Exploratorium_8.1.1
Sensing (by device)
- Biological

AI + RF imaging of Lips improves Hearing Aids

Description

In noisy situations such as cocktail parties, a conventional hearing aids’ broad spectrum of amplification can make it difficult for users to focus on specific sounds, like conversation with a particular person. One potential solution to the cocktail party effect is to make ‘smart’ hearing aids, which combine conventional audio amplification with a second device to collect additional data for improved performance. Cameras are one, but they have privacy concerns and don’t work through masks. This system circumvents those issues by using radio frequency data (such as from wifi) with no video, running it through an AI to get vowel recognition data, and feeding it back to a ‘smart’ hearing aid.

Website(s)

https://www.gla.ac.uk/news/headline_876513_en.html

https://www.nature.com/articles/s41467-022-32231-1.epdf