Sensor Translates Sign Language to Audio
With the help of machine learning, a skin-like sensor internalizes different stimuli, allowing it to read and interpret hand movement. Image from Advanced Science News.
Video of how the sign to audio application works.
With the help of machine learning, a skin-like sensor internalizes different stimuli, allowing it to read and interpret hand movement. Image from Advanced Science News.
Video of how the sign to audio application works.
Description
Researchers have developed a sensor that can translate sign language into audio, allowing people who are deaf or hard of hearing to communicate more easily with those who do not understand sign language. The sensor is worn on the wrist and uses motion-sensing technology to detect hand movements associated with sign language and then translates them into audio. “The sensor develops a positive and negative charge separation and potential after adsorbing water in air, like the spontaneously bioelectrical potential generation in human skin,” explained Qu. “When stimulated by ambient humidity, temperature, pressure, and light, the device produces electrical charges that induce a potential variation, producing distinct response signals to these stimuli.” This technology could enable better communication between those who are deaf and those who do not understand sign language, as well as provide better access to hearing aid-related therapies.
Website(s)
For More Information Contact
Bibliography
Corless, V. (2022, October 18). Sensor translates sign language into audio. Advanced Science News. https://www.advancedsciencenews.com/sensor-translates-sign-language-into-audio
Yang, C., Wang, H., Yang, J., Yao, H., He, T., Bai, J., Guang, T., Cheng, H., Yan, J., & Qu, L. (2022). A Machine‐Learning‐Enhanced Simultaneous and Multimodal Sensor Based on Moist‐Electric Powered Graphene Oxide. Advanced Materials, 34(41), 2205249. https://doi.org/10.1002/adma.202205249