[论文解读] EchoWear: Smartwatch Technology for Voice and Speech Treatments of Patients with Parkinson's Disease

Harishchandra Dubey, Jon C. Goldberg+3 more|arXiv (Cornell University)|Jan 1, 2015

Voice and Speech Disorders参考文献 32被引用 4

一句话总结

EchoWear 是一种基于智能手表的系统，可实现对帕金森病（PD）患者语音和言语训练的远程监测，利用智能手表的麦克风捕获的语音数据可与临床级音频设备相媲美。该系统在测量响度和基频（F0）等关键语音指标方面表现出高可靠性，支持其在临床外环境中的远程监测和提高治疗依从性。

ABSTRACT

About 90 percent of people with Parkinson's disease (PD) experience decreased functional communication due to the presence of voice and speech disorders associated with dysarthria that can be characterized by monotony of pitch (or fundamental frequency), reduced loudness, irregular rate of speech, imprecise consonants, and changes in voice quality. Speech-language pathologists (SLPs) work with patients with PD to improve speech intelligibility using various intensive in-clinic speech treatments. SLPs also prescribe home exercises to enhance generalization of speech strategies outside of the treatment room. Even though speech therapies are found to be highly effective in improving vocal loudness and speech quality, patients with PD find it difficult to follow the prescribed exercise regimes outside the clinic and to continue exercises once the treatment is completed. SLPs need techniques to monitor compliance and accuracy of their patients exercises at home and in ecologically valid communication situations. We have designed EchoWear, a smartwatch-based system, to remotely monitor speech and voice exercises as prescribed by SLPs. We conducted a study of 6 individuals; three with PD and three healthy controls. To assess the performance of EchoWear technology compared with high quality audio equipment obtained in a speech laboratory. Our preliminary analysis shows promising outcomes for using EchoWear in speech therapies for people with PD. Keywords: Dysarthria; knowledge-based speech processing; Parkinson's disease; smartwatch; speech therapy; wearable system.

研究动机与目标

• 为解决帕金森病（PD）患者在家庭中言语治疗训练依从性差的挑战。
• 开发一种可穿戴的远程监测解决方案，使言语语言病理学家（SLPs）能够在临床环境外评估患者的治疗依从性和言语质量。
• 验证智能手表录制的语音数据与语音实验室中使用的高保真音频设备相比的准确性。
• 通过实时、生态有效的语音训练监测，支持言语治疗效果的长期泛化。

提出的方法

• 部署基于智能手表的系统（EchoWear），使用单通道麦克风记录PD患者和健康对照者的语音训练数据。
• 在受控环境中，同时使用智能手表（SW）和双通道临床麦克风（BL）采集语音数据。
• 采用SWIPE算法进行基频（F0）估计，并使用ERB（等效矩形带宽）尺度以提高音高跟踪的准确性。
• 从语音信号中计算平均F0和响度，排除非浊音段以确保分析的相关性。
• 在参与者之间比较SW与BL数据，评估关键语音质量指标的相关性和偏差。
• 使用统计分析评估EchoWear数据相对于金标准临床录音的可靠性。

实验结果

研究问题

• RQ1 智能手表系统能否可靠地捕获与高保真临床音频设备相当的PD患者语音数据？
• RQ2 与传统语音录音方法相比，智能手表在测量基频（F0）和响度方面的准确性如何？
• RQ3 EchoWear在生态有效环境中支持远程监测言语治疗训练的程度如何？
• RQ4 智能手表数据是否具备足够的稳定性，以支持PD疾病进展和治疗效果的纵向追踪？

主要发现

• EchoWear在测量平均基频（F0）方面与临床级音频设备具有高度相关性，智能手表与基线录音之间的最大偏差为9.35%。
• 智能手表测得的响度和F0与双通道临床麦克风的结果相当，表明数据具有强可靠性。
• 结合ERB尺度变换的SWIPE算法在低振幅非浊音段中也能提供准确的F0估计。
• 该系统成功地从平均F0计算中排除了非浊音语音，确保了相关且有意义的指标。
• EchoWear的单通道音频输出与双通道临床系统相比性能下降极小，验证了其在真实世界环境中的适用性。
• 结果支持使用消费级智能手表进行PD患者言语治疗的远程监测，实现远程SLP随访。