Search
Close this search box.
Search

New platform for health diagnostics based on your voice?

Technology to recognise emotions in voice excists for many years, but is it possible to use this technology to diagnose health issues such as stress, depression or heart failure using the sound of your voice? That is the question Beyond Verbal is looking into, in collaboration with researchers from leading global medical institutions, including the Mayo Clinic. Their answer is YES.

Beyond Verbal has gathered an impressive database of 2.5 million emotion-tagged voices in upwards of 40 different languages over the past 21 years. Its purpose is to use machine learning and big data to investigate, with their medical partners, whether connections can be made between vocal intonations and health issues.

Your voice sounds different

“We are not calling what we’re doing right now diagnostics,” says Yuval Mor, CEO of Beyond Verbal. “Instead, it’s about long-term monitoring and decision support systems. The diagnostic tools that a doctor can use right now can do a better job than we can with vocal markers. However, what we’re doing is to use voice abnormalities observed over time to say that your voice is significantly different from how it sounded yesterday, a week ago, or two months ago — and then to correlate those changes with specific things we can identify.”

The ability to recognise certain health issues based on a voice is not new, and you don’t always need a machine for that. By listening to a voice one can identify diseases such as dementia or Parkinson’s. But machine learning will be used to go beyond that, by zooming in on data difficult observable to the human ear.

In particular, Beyond Verbal hopes to expand recognition to medical and physiological conditions which are not associated with the brain. “That’s where this work is becoming very fascinating, and that’s what we’ve been working with the Mayo Clinic over the past two years to do”, Mor says. This may include the diagnosis of coronary artery disease, for example, which Mor said is something that is being looked at very closely.

Your own guardian angel

Right now the Beyond Health Research Platform is still rolling out, but Mor stresses that the researchers are thinking big on this project. “The long-term vision is that everyone will have their own companion, a guardian angel, which could be anything from your mobile phone to your Amazon Echo,” he said.

“It might be that it monitors your phone conversations, or that you speak to an app for 30 seconds every morning — and from that it gives you high-level indications. You either get a green light saying everything is okay, a yellow light saying it’s worth monitoring closely, or a red light telling you that something is significantly different and it can be mapped to a specific condition, so you should go see your doctor.”

Whixx

ICT&health World Conference 2024

Experience the future of healthcare at the ICT&health World Conference from May 14th to 16th, 2024!
Secure your ticket now and immerse yourself in groundbreaking technologies and innovative solutions.
Engage with fellow experts and explore the power of global collaborations.

Share this article!

Read also
Balancing regulatory compliance with seamless adoption, healthcare navigates the integration of AI solutions.
A guide to implementing AI in healthcare amid the EU AI Act
AmyWebb-Stephen-Olker
Futurist Amy Webb claims that wearables will evolve into "connectables"
Digital health solutions empower patients to better manage their health and integrate care into their daily lives.
How to improve Digital Patient Engagement to streamline workflows
For people with diabetes, inaccurate blood glucose measurements can lead to errors in diabetes management, including taking the wrong dose of insulin, sulfonylureas, or other medications that can rapidly lower blood glucose.
Smartwatches measuring glucose level: Harmful but easy to buy fake innovations
How to introduce innovation and AI in healthcare organizations if there is no business model for prevention and quality – Our interview with Professor Ran Balicer, the Chief Innovation Officer at Clalit Health Services and founding Director of Clalit Research Institute.
I see no legitimate rationale for delaying the digital transformation in healthcare
Pioneering Cardiac Arrest Detection for Enhanced Survival.
CardioWatch Revolutionizes Cardiac Arrest Detection
Dr. Oscar Díaz-Cambronero, Head of Perioperative Medicine Department at La Fe Hospital, spearheads innovative telemonitoring initiatives revolutionizing patient care
Smartwatches Saving Lives Inside and Outside the Hospital
EIT 2024
EIT Awards 2024. Two European startups are revolutionizing the treatment of cardiovascular diseases
Bertrand Piccard, Swiss explorer and founder of the Solar Impulse Foundation
EIT Summit 2024. What are the trigger points that drive or inhibit innovation?
MMC pioneers wireless monitoring for premature infants with the innovative Bambi Belt, revolutionizing care with improved comfort and mobility.
Wireless Monitoring of Vital Signs in Premature Infants at Máxima MC
Follow us