Name: Visualization Method for Proprioceptive Drift on a 2D Plane Using Support Vector Machine (Video) | JoVE Journal
Uploaded: 2016-10-27T13:00:00.000+00:00
Duration: 7 min 5 s
Description: Discover a novel method to estimate proprioceptive drift in 2D using the mirror illusion and machine learning analysis. This technique bridges psychophysics and engineering for rehabilitation research.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

This research was supported by the Center of Innovation Program from the Japan Science and Technology Agency, JST.

All aspects of the experiment were approved by the Ethical Committee of Tokyo Institute of Technology.
1. Experimental Setup
<ol>
	<li>Material and Setup for Measuring Proprioceptive Drift.
	<ol>
		<li>Obtain a stand that can hold a 100 x 100 cm plate vertically (Figure 1).</li>
		<li>Obtain a chair on which the participant can sit comfortably during the experiment.</li>
		<li>Obtain a 100 x 100 cm acrylic mirror and matte blackboard.</li>
		<li>Obtain the position tracker (for example, SLC-C02, Cyverse) to track the participant&#39;s right hand position. Spatial resolution should be about 1.5 mm to allow sufficient number of samplings to be used for the machine learning.</li>
		<li>Obtain an infrared LED and retroreflective markers that will be used to indicate the position of the stand and the participant&#39;s right hand, respectively (see steps 1.1.11 and 3.2.6).</li>
		<li>Obtain the foot pedal for the participant&#39;s response.</li>
		<li>Create the custom-made program, which can record and simultaneously display the participant&#39;s response and right hand position and play a beep as feedback of the participant&#39;s response when the foot pedal is pressed. In these experiments, the participant&#39;s right hand position was collected using the motor capture device and its custom-made program according to manufacturer instructions. 
		NOTE: According to a previous paper16, the program was developed with a software development toolkit. The custom-made program developed by the software development toolkit can be adapted for other brands of motion capture devices.</li>
		<li>Use a metronome to provide timing signals for the training of the hand movement, that is, tapping the surface of the mirror or blackboard. See step 3.1.1 for precise training instructions.</li>
		<li>Use noise-cancelling headphones to reduce the possibility that the participant can hear sound cues for the hand position.</li>
		<li>For the visual feedback condition, attach the mirror to the stand. For the condition without visual feedback, attach the blackboard to the stand.</li>
		<li>Place the infrared LED at the top-left of the mirror or blackboard.</li>
	</ol>
	</li>
	<li>Material and Setup for Measuring Sense of Ownership and Agency.
	<ol>
		<li>Repeat the procedure from step 1.1.1 to step 1.1.11.</li>
		<li>Create or obtain the questionnaire assessing sense of ownership and agency (e.g.,10,13,16). Table 1 shows examples from this questionnaire used in the previous study15.</li>
		<li>Use a monitor or tablet PC to display the questionnaire to the participant.</li>
	</ol>
	</li>
</ol>
2. Participants
<ol>
	<li>Recruit about 10 right-handed participants with normal or corrected-to-normal vision. 
	Note: The number of participants can be adjusted according to the experimental goals and the number of repeated trials per participant.</li>
	<li>Obtain written informed consent for participation prior to the start of the experiment.</li>
</ol>
3. Experiment Procedure
<ol>
	<li>Training Phase for the Hand Movement.
	<ol>
		<li>Train the participants to synchronously tap with both hands on the mirror or blackboard at a certain tempo using the metronome. Instruct the participants to perform the tapping movement by keeping the heel of the hand in contact with the mirror or board. At the beginning of training, start the metronome at a tempo of 60 beats per min and then instruct the participant to move both hands synchronously according to the sound of the metronome.</li>
		<li>Ensure that the timing of the participant&#39;s hand movement is close to one cycle per sec (approximately 1 Hz) by comparing it to the sound of the metronome several minutes after the beginning of tapping.</li>
	</ol>
	</li>
	<li>Estimation of Proprioceptive Drift in the Participant&#39;s Midsagittal Plane.
	<ol>
		<li>Use a counter-balanced order of conditions across participants.</li>
		<li>Mount the mirror or blackboard on the stand based on the conditions: with visual feedback, mount the mirror; without visual feedback, mount the blackboard.</li>
		<li>Ensure that participant is sitting very close to the mirror or blackboard, which is positioned along the midsagittal plane of the participant (Figure 1).</li>
		<li>Make sure that participant can see the mirror image of the left hand but cannot see the real right hand.</li>
		<li>Instruct participant to pay attention to the image of the left hand in the mirror during the experiment.</li>
		<li>Put the retroreflective markers on the participant&#39;s right index fingertip and wrist.
		<ol>
			<li>Since the markers are only put on the participant&#39;s right hand, make sure that the haptic sensation of the participant&#39;s right hand due to the attached markers is not altered substantially compared to the left hand by querying the participant orally.</li>
		</ol>
		</li>
		<li>Put the noise-cancelling headphones over the participant&#39;s ears.</li>
		<li>Instruct the participant to move the left hand approximately 30 cm vertically and 30 cm horizontally from the lower right corner of the mirror and to maintain this left hand position during the experiment. This position is set as the origin of the surface of the 2D plane.</li>
		<li>Instruct the participant to place the right hand at will on the other side of the mirror or blackboard and to maintain its position until the end of the trial.</li>
		<li>Instruct the participant about the task as follows:
		<ol>
			<li>At the beginning of each trial, instruct the participant to push the middle button of the foot pedal. At this time, the system will sound a beep through the headphone as feedback of the pedal press.</li>
			<li>After hearing the beep, instruct the participant to start tapping with both hands synchronously at 1 Hz on the board, which is the mirror in the condition with visual feedback or the blackboard in the condition without visual feedback.</li>
			<li>After more than six hand movements, instruct the participant to stop the movement at the preferred time and answer the question about the right hand position by pressing the right or left button on the foot pedal. The right button is a yes and the left is a no. The question is, &#34;Do you feel that the right and left hand are in the same position?&#34; At this moment, the participant will hear a beep as feedback for the pedal press again. 
			NOTE: If the participants ask about the meaning of the &#34;the same position,&#34; tell them that &#34;same position&#34; means that the subjective height and depth of the right hand are equivalent to that of the left hand.</li>
			<li>Instruct the participant to move their right hand to another position of their choice. Then, start the trial again. This cycle will continue for up to 200 trials per condition.</li>
		</ol>
		</li>
		<li>Ensure that the participant can understand the task and ask the participant to restart the task.</li>
		<li>During the task, check that the timing of the participant&#39;s tapping stays at approximately 1 Hz by viewing the movement compared to the metronome. 
		Note: The sound of the metronome can be heard only by the experimenter.</li>
		<li>After finishing about 100 trials, let the participant take a break.</li>
		<li>Perform the experiment for the other conditions (with or without visual feedback) on separate days.</li>
	</ol>
	</li>
	<li>Estimation of Sense of Ownership and Agency in the Mirror Condition.
	<ol>
		<li>Define the right hand&#39;s positions for collecting the participant&#39;s responses on the questionnaire about sense of ownership and agency. For example, in a previous publication16, there were 13 prefixed right hand positions. These points were arranged every 7 cm up to &#177; 21 cm from the origin.</li>
		<li>Carry out the same procedure for the above estimation as listed from step 3.2.2 to step 3.2.7.</li>
		<li>Instruct the participant to place the right hand following the experimenter&#39;s guide and maintain its position until finishing one trial.</li>
		<li>Instruct the participant about the task as follows:
		<ol>
			<li>At the beginning of the trial, push the middle button of the foot pedal. At this time, the participant will hear the beep as feedback of the pedal press.</li>
			<li>Then, start to tap the right and left hands synchronously at 1 Hz.</li>
			<li>After more than six times of tapping, stop tapping when the experimenter indicates. Then, answer the questions about sense of ownership and agency displayed on the monitor using a 7-point Likert scale with ratings ranging from -3 (&#34;totally disagree&#34;) to +3 (&#34;totally agree&#34;) with 0 indicating neither agreement nor disagreement (&#34;uncertain&#34;).</li>
			<li>Move the right hand to the position that the experimenter indicates. Then, start the trial again. This cycle will continue up to the number of right-hand positions that the experimenter defines.</li>
		</ol>
		</li>
		<li>Ensure that the participant can understand the task and ask the participant to start the task.</li>
	</ol>
	</li>
</ol>
4. Data Analysis
<ol>
	<li>The Analysis of Proprioceptive Drift in the Participant&#39;s Midsagittal Plane.
	<ol>
		<li>Obtain the statistical tool that contains the machine learning application, especially support vector machine (e.g., R, MATLAB). Use support vector machine (SVM) as the classifier to extract the borders of the participant&#39;s responses. A previous publication provides an explanation for the algorithms of the classifier (see Chapter 7)20. In this article, we explain the method using R (version 3.1.2).</li>
		<li>Install the package named &#34;kernlab&#34;21, which contains the analysis using SVM in the R application.</li>
		<li>Mark the area that shows proprioceptive drift of the hand as follows (Figure 2 describes the schematic representation of the data analysis flow). See Supplemental software code and data sample for further explanation of this data analysis.
		<ol>
			<li>Calculate the relative right hand positions from the origin. Discard data with errors (e.g., missing position data or participant&#39;s responses) from the analysis.</li>
			<li>Make a probabilistic model of the participant&#39;s &#34;yes&#34; responses in 2D space using the SVM. Use the data from the responses as a symbolic description of the model. Use the data of the right hand position as the parameters of the model. Use the commonly used radial basis function kernel as the kernel for the SVM. In order to avoid the arbitrary analysis, calculate sigma (i.e., parameter used for changing the weight of each data point) by automatic sigma estimation.</li>
			<li>Ensure that the model is correctly fitted by checking that the training errors of the model are under 0.2. Using the probabilistic model, define the area in which the p-value of the participant&#39;s &#34;yes&#34; responses was estimated to be over 0.5.</li>
		</ol>
		</li>
		<li>Average each participant&#39;s data to make an area that shows proprioceptive drift. 
		NOTE: As it is difficult to average the border of the &#34;yes&#34; and &#34;no&#34; response area estimated by the p-values of the responses in 2D space, two types of average are recommended. One method is to average the p-values for the participant&#39;s responses in 2D space, which is the method used prior to estimating the border. The other method is to average the area size, which is used after estimating the border.</li>
	</ol>
	</li>
	<li>Analysis of the Questionnaire Data and Area Size.
	<ol>
		<li>Obtain the statistical tool to assess the significance of the position and the categories of the questionnaire (e.g., SPSS or R).</li>
		<li>Assess normal distribution of all data using the Shapiro-Wilk test, and apply the appropriate non-parametric test when one or more of the corresponding data sets failed to meet the criteria for normal distribution (e.g., Wilcoxon signed-rank test, Friedman test). 
		Note: If a non-parametric method that suits the experiment is lacking, use a parametric method and explain the reasoning. In a previous study16, a two-way repeated-measures ANOVA analyzed the questionnaire data, as there was no non-parametric substitute for this analysis.</li>
	</ol>
	</li>
</ol>

<ol><li>Alimardani, M., Nishio, S., Ishiguro, H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Humanlike+robot+hands+controlled+by+brain+activity+arouse+illusion+of+ownership+in+operators%5BTitle%5D)+AND+%22Sci.+Rep%22%5BJournal%5D)">Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators.</a> Sci. Rep. 3, 2396(2013).</li>
<li>Fernando, C. L., et al. Design of TELESAR V for transferring bodily consciousness in telexistence. Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference, Vilamoura, , 5112-5118 (2012).</li>
<li>Ramachandran, V. S., Rogers-Ramachandran, D. C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Synaesthesia+in+phantom+limbs+induced+with+mirrors%5BTitle%5D)+AND+%22Proc.+Biol.+Sci%22%5BJournal%5D)">Synaesthesia in phantom limbs induced with mirrors.</a> Proc. Biol. Sci. 263, 377-386 (1996).</li>
<li>Chan, B. L., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Mirror+therapy+for+phantom+limb+pain%5BTitle%5D)+AND+%22N.Engl.J.Med%22%5BJournal%5D)">Mirror therapy for phantom limb pain.</a> N.Engl.J.Med. 357 (21), 2206-2207 (2007).</li>
<li>Michielsen, M. E., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Motor+recovery+and+cortical+reorganization+after+mirror+therapy+in+chronic+stroke+patients%3A+a+phase+II+randomized+controlled+trial%5BTitle%5D)+AND+%22Neurorehabil.+Neural+Repair%22%5BJournal%5D)">Motor recovery and cortical reorganization after mirror therapy in chronic stroke patients: a phase II randomized controlled trial.</a> Neurorehabil. Neural Repair. 25 (3), 223-233 (2010).</li>
<li>Lamont, K., Chin, M., Kogan, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Mirror+box+therapy%3A+seeing+is+believing%5BTitle%5D)+AND+%22Explore+%28NY%29%22%5BJournal%5D)">Mirror box therapy: seeing is believing.</a> Explore (NY). 7 (6), 369-372 (2011).</li>
<li>Becker-Asano, C., Gustorff, S., Arras, K. O., Nebel, B. On the effect of operator modality on social and spatial presence during teleoperation of a human-like robot. Third Intl. Symposium on New Frontiers in Human-Robot Interaction at AISB50, , (2014).</li>
<li>Rosén, B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Referral+of+sensation+to+an+advanced+humanoid+robotic+hand+prosthesis%5BTitle%5D)+AND+%22Scand.+J.+Plast.+Reconstr.+Surg.+Hand+Surg%22%5BJournal%5D)">Referral of sensation to an advanced humanoid robotic hand prosthesis.</a> Scand. J. Plast. Reconstr. Surg. Hand Surg. 43 (5), 260-266 (2009).</li>
<li>Limerick, H., Coyle, D., Moore, J. W. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+experience+of+agency+in+human-computer+interactions%3A+a+review%5BTitle%5D)+AND+%22Frontiers+Hum.+Neurosci%22%5BJournal%5D)">The experience of agency in human-computer interactions: a review.</a> Frontiers Hum. Neurosci. 8, 643(2014).</li>
<li>Botvinick, M., Cohen, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Rubber+hands+%27feel%27+touch+that+eyes+see%5BTitle%5D)+AND+%22Nature%22%5BJournal%5D)">Rubber hands 'feel' touch that eyes see.</a> Nature. 391 (6669), 756-756 (1998).</li>
<li>Tsakiris, M., Haggard, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+rubber+hand+illusion+revisited%3A+visuotactile+integration+and+self-attribution%5BTitle%5D)+AND+%22J.+Exp.+Psychol.+Hum.+Percept.+Perform%22%5BJournal%5D)">The rubber hand illusion revisited: visuotactile integration and self-attribution.</a> J. Exp. Psychol. Hum. Percept. Perform. 31 (1), 80-91 (2005).</li>
<li>Rohde, M., Di Luca, M., Ernst, M. O. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+rubber+hand+illusion%3A+feeling+of+ownership+and+proprioceptive+drift+do+not+go+hand+in+hand%5BTitle%5D)+AND+%22PloS+One%22%5BJournal%5D)">The rubber hand illusion: feeling of ownership and proprioceptive drift do not go hand in hand.</a> PloS One. 6 (6), e21659(2011).</li>
<li>Kalckert, A., Ehrsson, H. H. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Moving+a+rubber+hand+that+feels+like+your+own%3A+a+dissociation+of+ownership+and+agency%5BTitle%5D)+AND+%22Frontiers+Hum.+Neurosci%22%5BJournal%5D)">Moving a rubber hand that feels like your own: a dissociation of ownership and agency.</a> Frontiers Hum. Neurosci. 6, 40(2012).</li>
<li>Holmes, N. P., Crozier, G., Spence, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((When+mirrors+lie%3A+%27visual+capture%27+of+arm+position+impairs+reaching+performance%5BTitle%5D)+AND+%22Cog.+Affect.+Behav.+Neurosci%22%5BJournal%5D)">When mirrors lie: 'visual capture' of arm position impairs reaching performance.</a> Cog. Affect. Behav. Neurosci. 4 (2), 193-200 (2004).</li>
<li>Snijders, H. J., Holmes, N. P., Spence, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Direction-dependent+integration+of+vision+and+proprioception+in+reaching+under+the+influence+of+the+mirror+illusion%5BTitle%5D)+AND+%22Neuropsychologia%22%5BJournal%5D)">Direction-dependent integration of vision and proprioception in reaching under the influence of the mirror illusion.</a> Neuropsychologia. 45 (3), 496-505 (2007).</li>
<li>Tajima, D., Mizuno, T., Kume, Y., Yoshida, T. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((The+mirror+illusion%3A+does+proprioceptive+drift+go+hand+in+hand+with+sense+of+agency%5BTitle%5D)+AND+%22Front.+Psychol%22%5BJournal%5D)">The mirror illusion: does proprioceptive drift go hand in hand with sense of agency.</a> Front. Psychol. 6, 200(2015).</li>
<li>Gallagher, S. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Philosophical+conceptions+of+the+self%3A+implications+for+cognitive+science%5BTitle%5D)+AND+%22Trends+Cog.+Sci%22%5BJournal%5D)">Philosophical conceptions of the self: implications for cognitive science.</a> Trends Cog. Sci. 4 (1), 14-21 (2000).</li>
<li>Farmer, H., Tajadura-Jiménez, A., Tsakiris, M. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Beyond+the+colour+of+my+skin%3A+how+skin+colour+affects+the+sense+of+body-ownership%5BTitle%5D)+AND+%22Conscious.+Cogn%22%5BJournal%5D)">Beyond the colour of my skin: how skin colour affects the sense of body-ownership.</a> Conscious. Cogn. 21 (3), 1242-1256 (2012).</li>
<li>Boucsein, W. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aBoucsein%2C+W+%22Electrodermal+Activity%22">Electrodermal Activity</a>. , Springer. New York. (2012).</li>
<li>Bishop, C. M. <a target="_blank" href="http://scholar.google.com/scholar?hl=en&safe=off&q=author%3aBishop%2C+CM+%22Pattern+recognition+and+machine+learning%22">Pattern recognition and machine learning</a>. , Springer. New York. (2006).</li>
<li>Karatzoglou, A., Smola, A., Hornik, K., Zeileis, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((kernlab+-+An+S4+Package+for+Kernel+Methods+in+R%5BTitle%5D)+AND+%22J.+Stat.+Software%22%5BJournal%5D)">kernlab - An S4 Package for Kernel Methods in R.</a> J. Stat. Software. 11 (9), 1-2 (2004).</li>
<li>Jenkinson, P. M., Haggard, P., Ferreira, N. C., Fotopoulou, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Body+ownership+and+attention+in+the+mirror%3A+insights+from+somatoparaphrenia+and+the+rubber+hand+illusion%5BTitle%5D)+AND+%22Neuropsychologia%22%5BJournal%5D)">Body ownership and attention in the mirror: insights from somatoparaphrenia and the rubber hand illusion.</a> Neuropsychologia. 51 (8), 1453-1462 (2013).</li>
</ol>

The authors declare that they have no competing financial interest.

We demonstrate a method to estimate proprioceptive drift in a 2D plane during the mirror illusion using SVM and to compare the result with questionnaire responses for sense of ownership and agency. This novel method revealed that the required offset between visual and proprioceptive feedback to maintain proprioceptive drift is approximately 10 cm and that this offset closely overlaps with the offset required to maintain the feeling of ownership and agency.
Note that the most critical step of t...

In recent years, research about the sense or experience of the self-body, that is, one&#39;s own body, has increased in the context of embodiment. Embodiment refers to the idea or concept of having a physical or virtual body that can interact with the environment, such as reaching, grasping, and touching. For instance, humans can touch an object or another human positioned in the environment by moving their own body, in this case their own arm and hand. Nowadays, this interaction or communication is not limited to using one&#39;s own natural body. Due to inventions and development of human-like robots or avatars in the virtual world, the natural human body can be substituted by an artificial body, such as a humanoid, remote control robot, electric prosthesis, or computer-graphics avatar in virtual reality. For example, researchers developed a robot whose operator can &#34;grasp&#34; an object placed in front of the robot via its mechanical body, even if the robot is placed far away from the operator&#39;s body position1,2. Similar to this example, if a human could perform an action via an artificial body, which body would hold the attribution of the operator&#39;s self-body?
We can easily find topics related to this discussion on the attribution or projection of &#34;self&#34; from our own natural body to an artificial, non-flesh-and-bone body. One example can be found in the medical field; for example, in the field of medical rehabilitation, treatments that &#34;trick&#34; the patient&#39;s self-body sensation using mirrors are being explored for reducing pain and improving motor function of a missing or paralyzed limb, called mirror therapy3-6. In this therapy, the mirrored image of the unaffected body part or limb can mislead the patient&#39;s brain into believing that the missing or paralyzed limb corresponds to the one displayed in the mirror and lead to the feeling that it is still in its former condition (i.e., before the accident). It is still under discussion how this illusion affects the brain&#39;s resilience related to body representation. In addition to this type of discussion on our natural body, we can find similar discussions on embodiment, especially of human-system interaction design issues in the field of engineering. The sense of self for an artificial or virtual body has been well investigated in the context of telepresence, brain-machine interface, and brain-computer interface1,2,7-9. Some researchers reported that a humanlike robot, which can transfer the tactile sensation from its robot hand to the operator&#39;s hand, can capture the operator&#39;s sense of self-body to the robot as well as the sense of being at a place where the robot is positioned rather than where the operator actually exists, called tele-existence1. Other researchers reported that a virtual avatar reflecting the operator&#39;s body movements strongly transfers the operator&#39;s sense of self-body from the operator&#39;s own body to the virtual body9. These findings indicate how users can project their sense of self-body into an artificial body, such as a humanoid, remote control robot, electric prosthesis, or computer-graphics avatar in virtual reality, even if the artificial body is not directly connected to their brain and body.
Basic scientific research on this type of self-body sensation for non-flesh-and-blood, artificial body-like objects examined the underlying brain mechanisms for the experience of self-body using the rubber hand illusion (RHI)10-13 and mirror illusion (MI)14-16 in the medical and engineering fields as well as in psychophysics and neuropsychology. The RHI is the sensation that a rubber hand belongs to one&#39;s own body and is evoked by simultaneously stroking a visible rubber hand and the participant&#39;s obscured hand. In the MI, a hand image in a mirror positioned along the midsagittal axis visually captures the participant&#39;s perceived position of the unseen opposite hand. Moreover, synchronous movements of the reflected and unseen hand evoke the strong sensation as if the reflected hand image were the unseen opposite hand. According to the research on these illusions, the consistency between multimodal information and the prediction and sensory feedback about body movements seems to play an important role for the judgment of self-body attribution. Thus, these two illusions can be simple but powerful evidence and tools for scientists to investigate the brain mechanisms underlying our sensation of being tricked or believing that some artificial object or image can subjectively be our own body part, and that our self-body sensation does not have to be tied to our natural physical body.
In all these studies listed above, the discussion has been based on the concept of &#34;self&#34; consisting of two types of sensation proposed by the philosopher Gallagher17: the sense of ownership and the sense of agency. The sense of ownership refers to the sensation that an observed body part is one&#39;s own. The sense of agency corresponds to the sensation that body movement is self-caused. These two sensations are defined as the minimal self, that is, an immediate sense of the self16. According to this concept, the attribution of the &#34;self&#34; for the natural, damaged, virtual, and mechanical bodies can be evaluated by the same indexes: the sense of ownership and agency. In order to use this sensation for scientific evaluation, the question arises of how to measure the sense of ownership and agency robustly. Currently, the estimation of the sense of ownership and agency mainly relies on questionnaires, originally proposed by Botvinick9. In addition to questionnaires, we can attempt to measure them in quantitative ways. For instance, the skin conductance response (SCR) has been used as a physiological index of ownership in cases where the rubber hand is suddenly cut by a knife18. The SCR is calculated by measuring the electrical characteristics of the skin and is a sensitive and valid indicator for arousal19. Since this method is typically applied for single trials per participant, measuring SCR is not suitable as a physical index during psychophysics experiments that require repetitive measurements within participants. One of the most successful behavioral indexes for the sense of ownership is proprioceptive drift. Proprioceptive drift is the change in the perceived position of the unseen real hand toward the position of an object that looks like a hand, such as the rubber-made prosthesis or computer graphics10-13. Since this change can be estimated repetitively and robustly by measuring the distance between the unseen real hand and the visual image of the hand, proprioceptive drift is a suitable physical index for psychophysical measurements. However, this usage needs to be evaluated carefully, because recent discussions have questioned whether proprioceptive drift can always be used as a behavioral index of ownership12.
Typically, proprioceptive drift is measured in only one of the three directions, such as height, width, or depth. Proprioceptive drift has rarely been measured in multiple directions due to the difficulty of estimating and visualizing multi-dimensional data. This metrological limitation is not critical for basic research exploring the mechanisms that process multisensory information, because experimental conditions can be easily designed and controlled to limit the measured dimensions. However, in daily life, our hands move freely in 3D to follow our intentions. In this situation, it is difficult and inadequate to measure a participant&#39;s behavior with questionnaires, which severely limits movement and positions of the hands. Thus, considering the potential applications for sense of ownership and agency in engineering and rehabilitation, a measurement that includes multiple directions and allows free hand movement is needed to evaluate the spatial relationship between visual and proprioceptive feedback in daily life situations. If such measurement were possible, the measured distance between real and observed hands could be utilized as a guideline for the sense of self-body. This could not only become an indicator for the progress of rehabilitation but also a criterion for the spatial offset between the manipulated target in the display and the operating hand. The question remains as to how this measurement can be implemented reliably and effectively.
To address this question, we introduce a novel method to estimate proprioceptive drift, which corresponds to the shift from the position of the participant&#39;s unseen real hand to that of a visible hand-like object, on a 2D plane using the mirror illusion by combining a psychophysical procedure and an analysis using machine learning. Compared to a rubber hand, the hand image in a mirror strongly captures the participant&#39;s perceived position of the unseen real hand. Moreover, a mirrored image immediately reflects voluntary hand movements for hand placement. Thus, a mirror image was selected as the visual feedback of the participant&#39;s hand. In addition, to measure proprioceptive drift similar to daily life situations, the participants positioned their hidden hand trial-by-trial at their will, and the number of trials was increased. Although any combination of directions could have been used, the combination of height and depth was chosen due to the ease of placing the mirror vertically. To check consistency between our method and previous research13, two visual conditions were implemented: with and without visual feedback. In the condition with visual feedback, the mirror was positioned along the midsagittal plane to create a reflected image of the left hand, as if it were seen as the right hand. In the condition without visual feedback, a matte blackboard was used in order to hide the participant&#39;s real right hand. We assessed the effectiveness of this novel method by comparing the results to those obtained with a questionnaire on the sense of ownership and agency.

<table><tbody><tr><td>Acric mirror</td><td></td><td></td><td></td></tr><tr><td>Matte blackboard</td><td></td><td></td><td></td></tr><tr><td>custom-made stand</td><td></td><td></td><td>&lt;i&gt;e.g.&lt;/i&gt; wood pole or PVC(poly vinyl chloride) pipe&amp;nbsp;</td></tr><tr><td>Chair</td><td></td><td></td><td></td></tr><tr><td>Foot pedal</td><td>P.I. Engineering</td><td>Classic X-keys USB, and PS/2 Foot Pedals</td><td>Other response device can be avaliable.</td></tr><tr><td>Position sensor</td><td>CyVerse</td><td>SLC-C02</td><td>Other position sensor can be avaliable.</td></tr><tr><td>Custom-made retroreflectivemarker</td><td></td><td>The marker provided by the motion capture vendor can be available.</td><td></td></tr><tr><td>Noise canselling head phone</td><td>bose</td><td>Quiet Comfort 3</td><td>Other head phone can be avaliable.</td></tr><tr><td>PC</td><td>Mouse computer</td><td>NG-N-i300GA</td><td>Other PC can be available.</td></tr></tbody></table>

visualization method for proprioceptive drift on a 2d plane using support vector machine

Visualization Method for Proprioceptive Drift on a 2D Plane Using Support Vector Machine

Proprioceptive drift, which is a perceptual shift in body-part position from the unseen real body to a visible body-like image, has been measured as the behavioral correlate for the sense of ownership. Previously, the estimation of proprioceptive drift was limited to one spatial dimension, such as height, width, or depth. As the hand can move freely in 3D, measuring proprioceptive drift in only one dimension is not sufficient for the estimation of the drift in real life situations. In this article, we provide a novel method to estimate proprioceptive drift on a 2D plane using the mirror illusion by combining an objective behavioral measurement (hand position tracking) and subjective, phenomenological assessment (subjective assessment of hand position and questionnaire) with a sophisticated machine learning approach. This technique permits not only an investigation of the underlying mechanisms of the sense of ownership and agency but also assists in the rehabilitation of a missing or paralyzed limb and in the design rules of real-time control systems with a self-body-like usability, in which the operator controls the system as if it were part of his/her own body.

Representative results from a previous study are presented to illustrate the method16. Figure 3A shows that the area shapes where the participant could not detect the spatial offset between left and right hand position differed between the conditions with (mirror) and without (blackboard) visual feedback. Figure 3B shows that area sizes in the condition with visual feedback are significantly larger than in the condition without visual feedback ...

This article describes a novel method to estimate proprioceptive drift on a 2D plane using the mirror illusion and combining a psychophysical procedure with an analysis using machine learning.

Proprioceptive drift, which is a perceptual shift in body-part position from the unseen real body to a visible body-like image, has been measured as the ...

The overall goal of this procedure is to estimate and visualize proprioceptive drift in 2D with free selection of the participant's hand position. This method can help answer key questions in psychophysics, engineering, and rehabilitation health, by exploring the method to operate a sense of self body. The main advantage of this technique is to estimate and visualize proprioceptive drift in 2D under the situation where the participant can select their hand locations.Sense of self is originally discussed in the body rehabilitation research field. But now it's expanded to the engineering in the context of embodiment, such as virtual avatar and the artificial bodies. Begin by instructing the participant to perform a tapping movement by keeping the heel of their hand in contact with the mirror.Then start the metronome at a tempo of 60 beats per minute. Instruct the participant to move both hands synchronously according to the sound of the metronome. Ensure that the timing of the participant's hand movements are close to one cycle per second by comparing it to the sound of the metronome several minutes after the tapping begins.Begin by mounting a mirror or blackboard on the stand based on the condition. Use a mirror for the visual feedback condition and a blackboard for a counterbalanced condition without visual feedback. Sit the participant close to the mirror that is positioned along their mid-sagittal plane.Ensure that the participant can only see the mirror image of their left hand and cannot see their real right hand. Next, instruct the participant to pay attention to the image of their left hand in the mirror during the experiment. Put retroreflective markers on the participant's right index fingertip and wrist.Confirm with the participant that the haptic sensation of their right hand is not substantially altered by the markers compared to the left. Next, place noise canceling headphones over the participant's ears so that they will not hear the metronome. Instruct the participant to move their left hand 30 centimeters vertically and 30 centimeters horizontally from the lower right corner of the mirror, and to maintain this left hand position during the experiment.Set this position as the origin of the surface of the 2D plane. Finally, instruct the participant to place their right hand on the other side of the mirror at any position and maintain its position until the end of the trial. At the beginning of a trial, instruct the participant to push the middle button of the foot pedal, which causes a beep through the headphone as feedback of the pedal press.After the beep, instruct the participant to start tapping with both hands synchronously at one hertz on the mirror. After the participant completes six hand movements, instruct them to stop and answer a question about whether they feel the right and left hand are in the same position. Use the right foot pedal for yes, and the left foot pedal for no.Then instruct the participant to move their right hand to another position of their choice. Then start the trial again as practiced. Ensure the participant understands the task, then begin the experiment.Throughout the experiment, check that the timing of the participant's tapping stays at approximately one hertz by viewing the movements compared to the metronome. Allow a break after 100 trials and complete the experiment for the other condition on a separate day. Begin by defining 13 right hand positions for response collection on a questionnaire about sense of ownership and agency.Inform the participant that they will complete the same procedure as before. After synchronously tapping the right and left hands six times, instruct them to orally answer questions about sense of ownership and agency using a seven-point Likert scale. Fill out the questionnaire's scores based on their responses.Show ratings from negative three, meaning totally disagree, to positive three, meaning totally agree, with zero indicating neither agreement nor disagreement or uncertain. Ensure that the participant understands the task. Finally, move the participant's right hand to the next position and have them complete the trial again.The area shapes where the participant could not detect the spacial offset between left and right hand position differ between the conditions. Furthermore, the area sizes and the condition with visual feedback are significantly larger than in the condition without visual feedback, suggesting that the required offset between visual and proprioceptive feedback to maintain proprioceptive drift is approximately 10 centimeters. Here the comparison between visualization of proprioceptive drift and questionnaire results for sense of ownership and agency shows that the offset areas to maintain these phenomena are concentric and almost overlap.This technique can be completed in one hour if it is performed properly. Why attempting this procedure it is important to remember to check whether the participant's performed the task correctly. After it's development this technique pave the way for researchers in the field of psychophysics, engineering, and rehabilitation to explore this dimension method for sense of ownership and agency in multiple dimensions.After watching this video you should have a good idea of how to estimate and human behavior during this experiment of the participant's right hand movement.

visualization-method-for-proprioceptive-drift-on-2d-plane-using

Research

JoVE Journal

Behavior

An efficient way to gain insight into how humans navigate themselves in three dimensions is described. The method takes advantage of a motion simulator capable of moving observers in ways unattainable by traditional simulators. Results confirm that movement in the horizontal plane is underestimated, while vertical movement is overestimated.

MPI CyberMotion Simulator: Implementation of a Novel Motion Simulator to Investigate Multisensory Path Integration in Three Dimensions

A method is described to measure three-dimensional vestibulo ocular reflexes (3D VOR) in humans using a six degrees of freedom (6DF) motion simulator. The gain and misalignment of the 3D angular VOR provide a direct measure of the quality of vestibular function. Representative data on healthy subjects are...

Three Dimensional Vestibular Ocular Reflex Testing Using a Six Degrees of Freedom Motion Platform

It is unclear how top-down signals from the ventral visual stream affect movement. We developed a paradigm to test motor behavior towards a target on a 3D depth inversion illusion. Significant differences are reported in both deliberate, goal-directed movements and automatic actions under illusory and veridical viewing conditions.

Methods to Explore the Influence of Top-down Visual Processes on Motor Behavior

The controlled physical rotation of a human observer is desirable for certain experimental, recreational, and educational applications. This paper outlines a method for converting an office swivel chair into a medium for controlled physical rotation in a virtual reality environment.

Controlled Rotation of Human Observers in a Virtual Reality Environment

We have developed a simple, customizable, and efficient method for recording quantitative processual data from interactive spatial tasks and mapping these rotation data with eye-tracking data.

Three-Dimensional Mapping of the Rotation of Interactive Virtual Objects with Eye-Tracking Data

The methodology explored visual and vestibular contributions to gaze stabilization during optokinetic and whole-body rotations. Stimulations were carried out through visual, vestibular, and visuovestibular trials. Torsional eye-movement gain and nystagmus frequencies served as indicators for the subcortical relay of sensory-specific motion information towards the reflexive brainstem response for each trial.

Using Eye-tracking to Assess the Relative Importance of Visual and Vestibular Input to Subcortical Motion Processing in the Roll Plane

This method creates a tangible, familiar environment for the mouse to navigate and explore during microscopic imaging or single-cell electrophysiological recordings, which require firm fixation of the animal’s head.

Flat-floored Air-lifted Platform: A New Method for Combining Behavior with Microscopy or Electrophysiology on Awake Freely Moving Rodents

Previous research on the social dimension of stress has focused on two important variables: social identity and social support. This protocol introduces an effective experimental manipulation of these two social variables and describes their implementation in a standard stress induction paradigm (Trier Social Stress Test).

The Social Dimension of Stress: Experimental Manipulations of Social Support and Social Identity in the Trier Social Stress Test

This article describes the delivery of intracranial electrical stimulation that is temporally and spatially separate from the drug-use environment for the treatment of IV methamphetamine dependence.

A General Method for Evaluating Deep Brain Stimulation Effects on Intravenous Methamphetamine Self-Administration

This protocol describes a novel and efficient method to quickly initiate operant responding for ethanol in rats that, contrary to standard methods, does not require water deprivation or saccharin/sucrose fading to initiate responding.

A Method for Evaluating the Reinforcing Properties of Ethanol in Rats without Water Deprivation, Saccharin Fading or Extended Access Training

Discover a novel method to estimate proprioceptive drift in 2D using the mirror illusion and machine learning analysis. This technique bridges psychophysics and engineering for rehabilitation research.

Visualization Method for Proprioceptive Drift on a 2D Plane Using Support Vector Machine

Explore More Videos