measuring-kinematics-daily-living-movements-with-motion-capture

Measuring the Kinematics of Daily Living Movements with Motion Capture Systems in Virtual Reality

The inability to complete instrumental activities of daily living (IADL) is a precursor to various neuropsychological diseases. Questionnaire-based ...

Hanyang University

Virtual reality (VR) is not commonly used in clinical rehabilitation, and commercial VR gaming systems may have mixed effects in patients with stroke. Therefore, we developed RehabMaster™, a task-specific interactive game-based VR system for post-stroke rehabilitation of the upper extremities, and assessed its usability and clinical efficacy.

A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments.

The growing popularity of gaming applications and ever-faster mobile carrier networks have called attention to an intriguing issue that is closely related to command input performance. A challenging mirroring game service, which simultaneously provides game service to both PC and mobile phone users, allows them to play games against each other with very different control interfaces. Thus, for efficient mobile game design, it is essential to apply a new predictive model for measuring how potential touch input compares to the PC interfaces. The present study empirically tests the keystroke-level model (KLM) for predicting the time performance of basic interaction controls on the touch-sensitive smartphone interface (i.e., tapping, pointing, dragging, and flicking). A modified KLM, tentatively called the fingerstroke-level model (FLM), is proposed using time estimates on regression models.

Fingerstroke time estimates for touchscreen-based mobile gaming interaction.

Different working memory (WM) mechanisms that underlie words, tones, and timbres have been proposed in previous studies. In this regard, the present study developed a WM test with nonverbal sounds and compared it to the conventional verbal WM test. A total of twenty-five, non-music major, right-handed college students were presented with four different types of sounds (words, syllables, pitches, timbres) that varied from two to eight digits in length. Both accuracy and oxygenated hemoglobin (oxyHb) were measured. The results showed significant effects of number of targets on accuracy and sound type on oxyHb. A further analysis showed prefrontal asymmetry with pitch being processed by the right hemisphere (RH) and timbre by the left hemisphere (LH). These findings suggest a potential for employing musical sounds (i.e., pitch and timbre) as a complementary stimuli for conventional nonverbal WM tests, which can additionally examine its asymmetrical roles in the prefrontal regions.

Nonverbal auditory working memory: Can music indicate the capacity?

Cognitive decline is a natural phenomenon of aging. Although there exists a consensus that sensitivity to acoustic features of music is associated with such decline, no solid evidence has yet shown that structural elements and contexts of music explain this loss of cognitive performance. This study examined the extent and the type of cognitive decline that is related to the contour identification task (CIT) using tones with different pitches (i.e., melodic contours). Both younger and older adult groups participated in the CIT given in three listening conditions (i.e., focused, selective, and alternating). Behavioral data (accuracy and response times) and hemodynamic reactions were measured using functional near-infrared spectroscopy (fNIRS). Our findings showed cognitive declines in the older adult group but with a subtle difference from the younger adult group. The accuracy of the melodic CITs given in the target-like distraction task (CIT2) was significantly lower than that in the environmental noise (CIT1) condition in the older adult group, indicating that CIT2 may be a benchmark test for age-specific cognitive decline. The fNIRS findings also agreed with this interpretation, revealing significant increases in oxygenated hemoglobin (oxyHb) concentration in the younger (p < 0.05 for Δpre - on task; p < 0.01 for Δon - post task) rather than the older adult group (n.s for Δpre - on task; n.s for Δon - post task). We further concluded that the oxyHb difference was present in the brain regions near the right dorsolateral prefrontal cortex. Taken together, these findings suggest that CIT2 (i.e., the melodic contour task in the target-like distraction) is an optimized task that could indicate the degree and type of age-related cognitive decline.

Melodic Contour Identification Reflects the Cognitive Threshold of Aging.

Questionnaires or computer-based tests for assessing activities of daily living are well-known approaches to screen for mild cognitive impairment (MCI). However, questionnaires are subjective and computerized tests only collect simple performance data with conventional input devices such as a mouse and keyboard. This study explored the validity and discriminative power of a virtual daily living test as a new diagnostic approach to assess MCI. Twenty-two healthy controls and 20 patients with MCI were recruited. The virtual daily living test presents two complex daily living tasks in an immersive virtual reality environment. The tasks were conducted based on subject body movements and detailed behavioral data (i.e., kinematic measures) were collected. Performance in both the proposed virtual daily living test and conventional neuropsychological tests for patients with MCI was compared to healthy controls. Kinematic measures considered in this study, such as body movement trajectory, time to completion, and speed, classified patients with MCI from healthy controls, F(8, 33) = 5.648, p < 0.001, η2 = 0.578. When both hand and head speed were employed in conjunction with the immediate free-recall test, a conventional neuropsychological test, the discrimination power for screening MCI was significantly improved to 90% sensitivity and 95.5% specificity (cf. the immediate free-recall test alone has 80% sensitivity and 77.3% specificity). Inclusion of the kinematic measures in screening for MCI significantly improved the classification of patients with MCI compared to the healthy control group, Wilks' Lambda = 0.451, p < 0.001.

Virtual daily living test to screen for mild cognitive impairment using kinematic movement analysis.

Object permanence and the development of attention capacity in preterm and term infants: an eye-tracking study.

Paper-and-pencil-based psychometric tests are the gold standard for diagnosis of cognitive dysfunction in liver disease. However, they take time, can be affected by demographic factors, and lack ecological validity. This study explored multi-sensory integration ability to discriminate cognitive dysfunction in cirrhosis. Thirty-two healthy controls and 30 cirrhotic patients were recruited. The sensory integration test presents stimuli from two different modalities (e.g., image/sound) with a short time lag, and subjects judge which stimuli appeared first. Repetitive tests reveal the sensory integration capability. Performance in the sensory integration test, psychometric tests, and functional near-infrared spectroscopy for patients was compared to controls. Sensory integration capability, the perceptual threshold to discriminate the time gap between an image and sound stimulus, was significantly impaired in cirrhotic patients with minimal hepatic encephalopathy (MHE) compared to controls (p < 0.01) and non-MHE patients (p < 0.01). Sensory integration test showed good correlation with psychometric tests (NCT-A, r = 0.383, p = 0.002; NCT-B, r = 0.450, p < 0.01; DST-F, r = -0.322, p = 0.011; DST- B, r = -0.384, p = 0.002; ACPT, r = -0.467, p < 0.01). Psychometric tests were dependent on age and education level, while the sensory integration test was not affected. The sensory integration test, where a cut-off value for the perceptual threshold was 133.3ms, recognized MHE patients at 90% sensitivity and 86.5% specificity.

Article	Year
A task-specific interactive game-based virtual reality rehabilitation system for patients with stroke: a usability test and two clinical experiments. Journal of neuroengineering and rehabilitation\| PubMed ID: 24597650	2014
Fingerstroke time estimates for touchscreen-based mobile gaming interaction. Human movement science\| PubMed ID: 26401615	2015
Nonverbal auditory working memory: Can music indicate the capacity? Brain and cognition\| PubMed ID: 27031677	2016
Melodic Contour Identification Reflects the Cognitive Threshold of Aging. Frontiers in aging neuroscience\| PubMed ID: 27378907	2016
Virtual daily living test to screen for mild cognitive impairment using kinematic movement analysis. PloS one\| PubMed ID: 28738088	2017
Object permanence and the development of attention capacity in preterm and term infants: an eye-tracking study. Italian journal of pediatrics\| PubMed ID: 28969661	2017
Multi-Sensory Integration Impairment in Patients with Minimal Hepatic Encephalopathy. Scientific reports\| PubMed ID: 29097814	2017

Hokyoung Ryu

Biography

JoVE Journal Publications

Other Publications