CODECHECK Certificate 2024-019
Paper details
Authors: Mohammadamin Sinichi, Martin Gevonden, Lydia Krabbendam
Abstract: Obtained from CrossRef
Heart rate (HR) and heart rate variability (HRV) are two key measures with significant relevance in psychophysiological studies, and their measurement has become more convenient due to advances in wearable technology. However, photoplethysmography(PPG)-based wearables pose critical validity concerns. In this study, we validated four PPG wearables to measure inter-beat intervals: three consumer-grade devices (Kyto2935, Schone Rhythm 24, and HeartMath Inner Balance Bluetooth) and one research-grade device (Empatica EmbracePlus). All devices were worn simultaneously by 40 healthy participants who underwent conditions commonly used in laboratory research (seated rest, arithmetic task, recovery, slow-paced breathing, a neuropsychological task, posture manipulation by standing up) and encountered in ambulatory-like settings (slow walking and stationary biking), compared against a criterion electrocardiography device, the Vrije Universiteit Ambulatory Monitoring System (VU-AMS). We determined the signal quality, the linear strength through regression analysis, the bias through Bland-Altman analysis, and the measurement error through mean arctangent absolute percentage error for each condition against the criterion device. We found that the research-grade device did not outperform the consumer-grade devices in laboratory conditions. It also did not show acceptable accuracy in ambulatory-like conditions. In general, devices captured HR more accurately compared to HRV. Finally, conditions that deviated from baseline settings and involved slight to high movement, negatively impacted the agreement between PPG devices and the criterion. We conclude that PPG devices, even those advertised and designed for research purposes, may pose validity concerns for HRV measurement in conditions other than those similar to resting states.
Codecheck details
Certificate identifier: 2024-019
Codechecker names: Yasel Quintero, Tornike Skhirtladze, Joslyn Sun, Gabriella Low Chew Tung, Roel Janssen
Time of codecheck: 2024-12-04 14:00:00
Repository: https://github.com/codecheckers/wearable-hrv
Codecheck report: https://doi.org/10.5281/zenodo.14279041
Summary:
The codecheckers were able to reproduce most of the figures in the manuscript and its supplementary documentation.
https://codecheck.org.uk/ | codecheckers
Published under CC BY-SA 4.0
CODECHECK is a process for independent execution of computations underlying scholarly research articles.