JoVE Science Education
Neuropsychology
A subscription to JoVE is required to view this content.  Sign in or start your free trial.
JoVE Science Education Neuropsychology
Physiological Correlates of Emotion Recognition
  • 00:00Overview
  • 01:53Experimental Design
  • 04:35Running the Experiment
  • 06:38Data Analysis and Representative Results
  • 08:56Applications
  • 11:19Summary

감정 인식의 생리학적 상관 관계

English

Share

Overview

출처: 조나스 T. 카플란과 사라 I. 짐벨의 연구소 – 서던 캘리포니아 대학

자율 신경계 (ANS)는 신체의 내부 장기의 활동을 제어하고 현재 환경에 따라 활동 변화를 조절합니다. 많은 내부 장기를 내면에 가두는 미주 신경은 시스템의 중요한 부분입니다. 우리의 뇌가 위험을 감지할 때, vagal 톤은 억제되어 우리가 싸우거나 달아날 준비를 더 하도록 설계된 신체의 변화 집합으로 이어집니다. 예를 들어, 심박수가 증가하고, 학생이 팽창하며, 더 빨리 숨을 들이쉬고 있습니다. 반대로, 질 시스템이 활성화될 때, 이러한 생리적 반응은 억제되어 차분한 상태로 이어집니다. 미주 신경은 우리의 각성에 일종의 “브레이크”역할을합니다. 이 차분한 상태의 한 가지 흥미로운 결과는 우리가 긴장하지 않고 우리의 즉각적인 환경을 두려워하지 않을 때 사회적 상호 작용을 촉진하는 경향이 있다는 것입니다. 따라서 이러한 규제 메커니즘의 부실한 기능은 사회적 행동의 어려움과 관련이 있을 수 있습니다.

자율 조절의 한 지수는 심박수 변동성(HRV)입니다. HRV는 한 비트와 다음 비트 사이의 격차가 시간이 지남에 따라 얼마나 달라지는지를 측정합니다. HRV가 높으면 시간이 지남에 따라 심박수의 지속적인 변동이 있으며, 이는 성공적인 자율 규제를 반영합니다. HRV가 낮을수록 시간이 지남에 따라 심박수의 일관성이 있음을 의미하며, 이는 자율 조절이 좋지 않은 상태입니다.

이 연구에서 는 증가 HRV 정서적 자극의 더 정확한 분류와 관련 된 가설을 테스트 합니다. 1,2외의연구에 따라, 우리는 HRV를 측정하고 얼굴 감정을 인식하는 기술을 측정하는 작업에 협회를 테스트합니다. 3

Procedure

1. 40명의 참가자를 모집합니다. 참가자는 자극을 제대로 볼 수 있도록 정상 또는 수정- 정상 시력을 가져야합니다. 참가자는 실험 전에 적어도 6 시간 동안 알코올, 카페인, 또는 다른 약물을 소비 해서는 안 됩니다. 참가자는 신경학상, 정신의학, 또는 심장 무질서의 역사가 없어야 합니다. 2. 실험 전 절차 …

Results

Performance on the facial emotion recognition task is typically very high; in our data overall accuracy was 92.5%. Participants were more accurate in identifying neutral faces (94.1%) compared with fearful faces (90.9%). Importantly, high frequency HRV power correlated significantly with accuracy in identifying fearful faces (Figure 2). Individuals with high HRV were more accurate in identifying fearful faces (r = 0.36). HRV power did not correlate with accuracy in identifying neutral faces, indicating that the association is emotion-specific.

Figure 2
Figure 2: HRV correlates with facial emotion accuracy. HRV high frequency power correlated with accuracy for fearful faces (left) but not for neutral faces (right). Please click here to view a larger version of this figure.

These data demonstrate an association between individual differences related to activity in the autonomic nervous system and skill for identifying socially relevant emotions in visual stimuli. This finding confirms the link between successful autonomic self-regulation and social behavior; individuals who are more successful in pumping the brakes on their physiological arousal appear to be better at tasks requiring emotional regulation and social interaction.

Applications and Summary

This experiment demonstrates the power of physiological data to provide insight into human cognition. The finding that measurements from the heart can be used to understand psychological functioning reminds us of the intimate connection between the brain and the body. An index of healthy cognitive control and emotion regulation, heart rate variability may serve as a relatively non-invasive biomarker for mental health. For example, low HRV is associated with anxiety disorders4 and depression,5 and also correlates with depression severity. Low HRV may also predict susceptibility to PTSD.6 This simple measure of the autonomic nervous system therefore serves as a window into the emotional health of the brain and body.

References

  1. Appelhans, B.M. & Luecken, L.J. Heart rate variability as an index of regulated emotional responding. Rev Gen Psychol 10, 229-240 (2006).
  2. Thayer, J.F. & Lane, R.D. A model of neurovisceral integration in emotion regulation and dysregulation. J Affect Disord 61, 201-216 (2000).
  3. Park, G., Van Bavel, J.J., Vasey, M.W., Egan, E.J. & Thayer, J.F. From the heart to the mind's eye: cardiac vagal tone is related to visual perception of fearful faces at high spatial frequency. Biol Psychol 90, 171-178 (2012).
  4. Chalmers, J.A., Quintana, D.S., Abbott, M.J. & Kemp, A.H. Anxiety Disorders are Associated with Reduced Heart Rate Variability: A Meta-Analysis. Front Psychiatry 5, 80 (2014).
  5. Kemp, A.H., et al. Impact of depression and antidepressant treatment on heart rate variability: a review and meta-analysis. Biol Psychiatry 67, 1067-1074 (2010).
  6. Gillie, B.L. & Thayer, J.F. Individual differences in resting heart rate variability and cognitive control in posttraumatic stress disorder. Front Psychol 5, 758 (2014).

Transcript

Physiological measurements can be used to understand psychological functioning, revealing an interactive relationship between the body and mind.

How fast a person’s heart beats can change depend on their surroundings, and—by extension—their emotional state. For example, someone who senses a shadowy figure following them at night may demonstrate an elevated heart rate due to fear, as well as the physical exertion from running away.

In contrast, when the same individual enters a comfortable environment, such as a gathering at a friend’s house, relatively no danger—except maybe spilling wine on the white carpet—is perceived.

Interestingly, although the speed of the heart can change automatically in response to their own feelings, it can also be influenced by the emotions they distinguish in others—like terror in a man who just broke the host’s favorite lamp.

Here, the very observation of signs of dread in the face of the guilty party—wide eyes, bared teeth, and raised eyebrows—can briefly escalate the heart rate of the observer. Throughout all of these experiences, the individual displayed high heart rate variability, or HRV, representing effective regulation.

In this video, we explore how ranges in cardiovascular capacity—low to high HRV—can be used to predict an individual’s ability to recognize feelings in other people.

We demonstrate how to design and perform an experiment to analyze both heart rate and emotional recognition data.

In this experiment, participants are first outfitted with electrodes around the heart, asked to rest while baseline recordings are taken, and then shown pictures of human faces expressing different emotions, which they must identify as their cardiac signals are continuously recorded.

During the task, a small fixation cross is displayed in the center of a computer screen, followed by a picture of a single human face.

The trick is that this facial image can be of either a calm, neutral expression—for example, someone with a relaxed mouth, eyebrows, and forehead—or one of fear.

When each visual is presented, participants must indicate which feeling it depicts. The idea here is that the overall accuracy of their responses provides a measure of emotional recognition ability.

Every trial ends with the presentation of a final fixation symbol to clearly separate the dependent variables: emotional and cardiac responses across trials types that are shown equally but in random order.

While monitoring heart rate, emphasis is placed on a critical component of the cardiac cycle called the R wave, which corresponds to the large peak during every beat. Heart rate variability—the HRV—is calculated, corresponding to the time between each peak and how it varies over a period of time.

The calculations are processed through a number of mathematical operations, such as fast Fourier transformation, and result in frequency information. Within this whole power spectrum, a certain band, the high frequency range, is of interest since it reflects the state of autonomic regulation.

Specifically, high HRV means that a participant’s heart rate changes continuously, which suggests an index of successful control. In contrast, low HRV equates to consistent values and therefore an association with poor regulation.

Importantly, the HRV measures are compared to the emotion recognition results. Based on previous experience, it is expected that accuracy of identifying feelings will correlate with HRV.

In other words, a participant whose heart rate fluctuates as pictures of different emotions are shown is more likely to correctly distinguish them, suggesting that HRV is a physiological correlate of this identification process.

To begin, greet the participant when they arrive. Verify that they have normal vision, have not consumed any substances, such as caffeine or alcohol, in the last 6 hrs, which could affect their heart rate, and have no history of psychiatric or cardiac disorders.

Then, direct the participant to sit in front of a computer monitor and keyboard. Gather three pre-gelled electrodes, and check that they have not dried out, to ensure that electrical signals from the heart are properly conducted.

Now instruct the participant to affix these electrodes on their chest using an established configuration. Attach the leads, and confirm that they are properly connected to the equipment that will amplify and relay information to the recording computer.

At this point, in the software monitor the cardiac signal to ensure that it’s devoid of noise and artifacts. In addition, verify that the acquisition parameters are correct, and start collecting a resting heart rate for 5 min.

Proceed to explain that pictures of human faces will be shown on the monitor. Emphasize that the participant should quickly push ‘F’ on the keyboard if they interpret an image as being fearful. In contrast, if the face appears neutral and devoid of emotion, stress that the ‘J’ key must be used.

Also confirm that the very first fixation cross appears onscreen for 500 ms, and for each trial, the facial image for 200 ms, followed by the final fixation symbol for 2 s. Now, leave the room and continue to record their cardiac signal as they perform 120 emotion recognition trials.

With all of the heart-derived data collected, first navigate the graphical user interface and isolate the R-waves to calculate the time between these identified peaks.

Further process these measures to generate the power spectrum of frequencies, and in particular, record the values in the high-frequency range, which represents the degree of fluctuation within 0.15-0.4 Hz.

Finally, compute the emotion recognition ability of each individual. To do this, first import the data recorded from the key presses, and calculate the average percentage of fearful faces that were correctly identified. Then, repeat this process for neutral images.

To analyze the data, begin by creating a scatter plot where accuracy of fearful face identification is graphed on the y-axis, and HRV values on the x-axis. Include data from all participants in this figure. Then, create a similar plot for neutral face data.

In each, determine the line of best fit and the correlation coefficient. Importantly, the nearer the data points are to this line, the stronger the linear correlation is between emotion recognition and HRV.

Notice that data points were more tightly clustered around the best fit line in the fear recognition graph, compared to its neutral counterpart.

This suggests a positive correlation between HRV and an individual’s ability to distinguish fright; however, no correlation existed between HRV and participants’ capacity to recognize neutral faces, indicating that this relationship is emotion-specific.

Collectively, these results imply a link between the physiological phenomenon of heart rate and social behavior. Specifically, an individual with high HRV may be more likely to recognize emotions in others, and thus excel with social interactions.

Now that you understand how to explore the correlation between autonomic self-regulation and social behavior, let’s look at how researchers are investigating the variability of physiological arousal at a young age and in other cognitive and mental health contexts.

Up until now, we’ve focused on the identification of emotions in adults. However, similar work is being performed in children to investigate factors related to early cardiovascular variation that may predict later health conditions.

For example, researchers measured heart rate while subjecting toddlers to a number of behavioral conditions, including a lullaby during rest, an active jack-in-the-box, tasting sour lemon juice, and audio of an infant crying.

Such experiences resulted in different heart rate outcomes, suggesting that variability can be elicited in young children. Additional research is needed to assess the developmental trajectory of cardiovascular measures and ultimately predict future health outcomes.

In terms of the relationship between HRV and working memory, research has shown that a person with low HRV—whose heart beats at a continuous, even pace despite even frightening surroundings—is more likely to demonstrate poor working memory, and forget the address they are told.

Interestingly, repeated aerobic exercise—like running—can actually improve HRV and memory retention, emphasizing the relationship between body and mind.

Lastly, other work has looked at the whether there is an association between HRV and certain mental health disorders, such as depression.

Specifically, an individual with similarly low HRV may be more likely to exhibit depressive symptoms, like disinterest in activities or withdrawal from social settings. Thus, HRV may serve as a useful, non-invasive biomarker for this social disorder.

You’ve just watched JoVE’s video on the physiological correlates of emotion recognition. By now, you should know how to present socially relevant visual stimuli to patients, and collect and interpret both behavioral and HRV data. In addition, you should understand how scientists are applying HRV to additional contexts, such as how it relates to other cognitive processes like memory.

Thanks for watching!

Tags

Cite This
JoVE Science Education Database. JoVE Science Education. Physiological Correlates of Emotion Recognition. JoVE, Cambridge, MA, (2023).