La Trobe

Smartphone automated motor and speech analysis for early detection of Alzheimer's disease and Parkinson's disease: Validation of TapTalk across 20 different devices

Download (1.95 MB)
journal contribution
posted on 2024-10-30, 23:25 authored by Renjie Li, Guan Huang, Xinyi Wang, Katherine LawlerKatherine Lawler, Lynette R Goldberg, Eddy Roccati, Rebecca J St George, Mimieveshiofuo Aiyede, Anna E King, Aidan D Bindoff, James C Vickers, Quan Bai, Jane Alty

INTRODUCTION: Smartphones are proving useful in assessing movement and speech function in Alzheimer's disease and other neurodegenerative conditions. Valid outcomes across different smartphones are needed before population-level tests are deployed. This study introduces the TapTalk protocol, a novel app designed to capture hand and speech function and validate it in smartphones against gold-standard measures.

METHODS: Twenty different smartphones collected video data from motor tests and audio data from speech tests. Features were extracted using Google Mediapipe (movement) and Python audio analysis packages (speech). Electromagnetic sensors (60 Hz) and a microphone acquired simultaneous movement and voice data, respectively.

RESULTS: TapTalk video and audio outcomes were comparable to gold-standard data: 90.3% of video, and 98.3% of audio, data recorded tapping/speech frequencies within ± 1 Hz of the gold-standard measures.

DISCUSSION: Validation of TapTalk across a range of devices is an important step in the development of smartphone-based telemedicine and was achieved in this study.

Funding

This study was funded through the National Health and Medical Research Council grant (2004051) and the Royal Hobart Hospital Research Foundation.

History

Publication Date

2024-10-23

Journal

Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring

Volume

16

Issue

4

Article Number

e70025

Pagination

11p.

Publisher

Wiley

ISSN

2352-8729

Rights Statement

© 2024 The Author(s). Alzheimer’s & Dementia: Diagnosis, Assessment & Disease Monitoring published by Wiley Periodicals LLC on behalf of Alzheimer’s Association. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Usage metrics

    Journal Articles

    Licence

    Exports

    RefWorks
    BibTeX
    Ref. manager
    Endnote
    DataCite
    NLM
    DC