Name: Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research (Video) | JoVE Journal
Uploaded: 2020-12-18T14:00:00.000+00:00
Duration: 7 min 15 s
Description: Explore a tactile vibrating toolkit and driving simulation platform for investigating in-vehicle warning systems. This method enables researchers to study driver responses to wearable vibrotactile devices.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

This project has been sponsored by Beijing Talents Foundation.

The authors declared no financial disclosure or conflicts of interest.

The driving simulation platform&#160;and vibrating toolkit&#160;reasonably mimicked the application of potential wearable vibrotactile devices in real life, providing an effective technique in investigating driving-related research. With the use of this technology, a safe experimental environment with high configurability and affordability is now available for conducting research that is comparable to real-world driving.
There are several steps that require more attention. Firstly, during the ...

An erratum was issued for:&#160;<a href="https://www.jove.com/t/61408">Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research</a>. The Authors section was&#160;updated.
Ao Zhu1 
Annebella Tsz Ho Choi1 
Ko-Hsuan Ma1 
Shi Cao2 
Han Yao1 
Jian Wu3 
Jibo He4,1 
1Psychology Department, School of Social Sciences, Tsinghua University 
2Department of Systems Design Engineering, University of Waterloo 
3Haier Innovation Design Center, Haier Company 
4Psychology Department, School of Education and Psychological Sciences, Sichuan University of Science and Engineering
to:
Ao Zhu1 
Annebella Tsz Ho Choi1 
Ko-Hsuan Ma1 
Shi Cao2 
Han Yao1 
Jian Wu3 
Jibo He1 
1Psychology Department, School of Social Sciences, Tsinghua University 
2Department of Systems Design Engineering, University of Waterloo 
3Haier Innovation Design Center, Haier Company

An erratum was issued for:&#160;<a href="https://www.jove.com/t/61408">Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research</a>. The Authors section was&#160;updated.

Erratum: Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research

According to the data revealed by the Global Health Estimates in 2016, traffic injury is the eighth cause of global deaths, leading to 1.4 million deaths worldwide1. In the year 2018, 39.2% of the traffic accidents were collisions with motor vehicles in transport, and 7.2% of which were rear-end collisions. A solution to increase vehicle and road safety is the development of an advanced driving assistance system (ADAS) to warn drivers with potential hazards. Data has shown that ADAS can greatly reduce the rate of rear-end collisions, and it is even more effective when equipped with an auto brake system2. In addition, with the development of autonomous vehicles, less human involvement will be required to control the vehicle, making a take-over request (TOR) warning system a necessity when the autonomous vehicle fails to regulate itself. The design of ADAS and TOR warning system is now an important piece of technology for drivers to avoid imminent accidents within a few seconds. The exemplar experiment used a vibrating toolkit along with a driving simulation platform to investigate which location would generate the best outcome when a vibrotactile warning system has been used as a potential ADAS and TOR warning system.
Categorized by perceptual channels, there are generally three types of warning modalities, that is visual, auditory, and tactile. Each warning modality has its own merits and limitations. When visual warning systems are in use, drivers can suffer from visual overload3, impairing driving performances due to inattentional blindness4,5. Although an auditory warning system does not influence drivers' visual field, its effectiveness greatly depends on the surroundings such as background music and other noises in the driving environment6,7. Thus, situations that contain other external auditory information or significant noise may lead to inattentional deafness8,9, reducing the effectiveness of an auditory warning system. In comparison, tactile warning systems do not compete with drivers’ visual or auditory processing. By sending vibrotactile warnings to drivers, tactile warning systems overcome the limitations of visual and auditory warning systems.
Previous studies showed that tactile warnings can benefit drivers by shortening their brake response time. It was also found that tactile warning systems yield a more effective result over visual10,11 and auditory12,13,14 warning systems in certain situations. However, limited research has focused on investigating the optimal location for placing a tactile warning device. According to sensory cortex hypothesis15 and sensory distance hypothesis16, the exemplar study chose the finger, wrist, and temple areas as the experimental locations for placing a tactile warning device. With the introduced protocol, the frequency and delivering time of a vibrating warning, and intervals between vibrations of the vibrating toolkit, can be configured to fit the experimental requirements. This vibrating toolkit consisted of a master chip, a voltage regulator chip, a multiplexer, a USB to Transistor-Transistor-Logic (TTL) adapter, a Metal-Oxide-Semiconductor Field-Effect Transistor (MOSFET), and a Bluetooth module. The number of vibrating modules can also vary according to researchers’ needs, with up to four modules vibrating at the same time. When implementing the vibrating toolkit in the driving-related experiments, it can be configured to fit the experimental settings as well as synchronized with driving performance data by revising the codes of the driving simulation.
While for researchers, conducting a driving experiment on a virtual platform is more feasible than in the real world due to the risk and cost involved. For instance, collecting performance indicators can be difficult, and it is hard to control the environmental factors involved when experiments are being conducted in the real-world. As a result, many studies have used fixed-base driving simulators running on PCs in recent years as an alternative to conduct on-road driving studies. After learning, developing, and researching for over 11 years in the driving research community, we established a driving simulation platform with a real car that consists of an open-source driving simulation software and a hardware kit, including a steering wheel and gearbox, three pedals, three mounted projectors, and three projector screens. With the driving simulation software supports only a single screen, the presented protocol used only the central projector and projector screen to conduct the experiment.
There are two major advantages of using the presented driving simulation platform. One advantage of this platform is that it uses an open-source software. Using the user-friendly open-source platform, researchers can customize the simulation and vibrating toolkit for their unique research needs by making simple software configuration without any code development . By revising the codes, researchers can create driving simulations that provide relative fidelity to the reality with plenty of options available on car types, road types, resistance of the steering wheel, lateral and longitudinal wind turbulence, time and brake event application program interfaces (APIs) for external software synchronization, and implementation of the behavioral paradigms such as car-following task and N-Back task. Although conducting driving-related research in a driving simulator cannot fully replicate driving in the real world, data collected through a driving simulator is reasonable and has been widely adopted by researchers17,18.
Another advantage of the proposed driving simulator is its low cost. As mentioned previously, the introduced driving simulation software is an open-source software that is available to users free of charge. In addition, the total cost of the whole hardware setup in this protocol is lower compare to typical high-fidelity commercial driving simulators. Figure 1 a and b show the complete setup of two driving simulators with the cost ranging from $3000 to $30000. In contrast, typical high-fidelity commercial driving simulators (fixed-base) usually cost around $10,000 to $100,000. With its highly affordable price, this driving simulator can be a popular choice not only for academic research purposes, but also for conducting driving classes19 and for demonstration of driving-related technologies20,21.
<img alt="a) Autonomous driving simulation setup, digital dashboard, virtual road visualization.

b) Classroom electric car demonstration, educational projection screens, smart mobility learning." class="xfigimg" src="/files/ftp_upload/61408/61408fig1v2.jpg" data-altupdatedat="1788250015000" data-alt="Figure 1"> 
Figure 1: An image of the driving simulators. Both driving simulators consisted of a steering wheel and gearbox, three pedals, and a vehicle. (a) A $3000 driving simulator setup that used an 80-inch LCD screen with a resolution of 3840 × 2160. (b) A $30000 driving simulator setup that used three mounted projectors and three projector screens with a dimension of 223 x 126 cm each. The projection screens were placed 60 cm above ground and 22 cm away from the front of the vehicle. Only the central projector and projector screen were used for the current experiment. <a href="https://www.jove.com/files/ftp_upload/61408/61408fig1v2large.jpg" target="_blank">Please click here to view a larger version of this figure.</a>
The driving simulation software and vibrating toolkit in the proposed method have already been used in previous studies by our researchers22,23,24,25,26,27,28,29. This self-developed vibrating toolkit following the ISO standard30 can be applied in different fields31,32 by adjusting the vibration frequency and intensity. It is important to note that a newer version of the vibrating toolkit has been developed and is introduced in the following protocol. Instead of adjusting the vibration frequency using an adjustable voltage adapter, the newer version is equipped with five different vibration frequencies and can be easier adjusted using the codes provided in Supplemental Coding File 1. Moreover, the presented driving simulator provides researchers with a safe, inexpensive, and effective way to investigate various kinds of driving-related research. Thus, this protocol is suitable for research laboratories that have a limited budget and have a strong need to customize experimental driving environments.

<table><tbody><tr><td>Logitech G29</td><td>Logitech</td><td>941-000114</td><td>Steering wheel and pedals</td></tr><tr><td>Projector screens</td><td>-</td><td>-</td><td>The projector screen for showing the simulation enivronemnt.</td></tr><tr><td>Epson CB-700U Laser WUXGA Education Ultra Short Focus Interactive Projector</td><td>EPSON</td><td>V11H878520W</td><td>The projector model for generating the display of the simlution enivronment.</td></tr><tr><td>The Open Racing Car Simulator (TORCS)</td><td>-</td><td>None</td><td>Driving simulation software. The original creators are Eric Espi&amp;eacute; and Christophe Guionneau, and the version used in experiment is modified by Cao, Shi.</td></tr><tr><td>Tactile toolkit</td><td>Hao Xing Tech.</td><td>None</td><td>This is used to initiate warnings to the participants.</td></tr><tr><td>Connecting program (Python)</td><td>-</td><td>-</td><td>This is used to connect the TORCS with the tactile toolkit to send the vibrating instruction.</td></tr><tr><td>G*power</td><td>Heinrich-Heine-Universit&amp;auml;t D&amp;uuml;sseldorf</td><td>None</td><td>This software is used to calculate the required number of participants.</td></tr></tbody></table>

tactile vibrating toolkit and driving simulation platform for driving-related research

Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research

Collision warning system plays a key role in the prevention of driving distractions and drowsy driving. Previous studies have proven the advantages of tactile warnings in reducing driver&#8217;s brake response time. At the same time, tactile warnings have been proved effective in take-over request (TOR) for partially autonomous vehicles.
How the performance of tactile warnings can be optimized is an ongoing hot research topic in this field. Thus, the presented low-cost driving simulation software and methods are introduced to attract more researchers to take part in the investigation. The presented protocol has been divided into five sections: 1) participants, 2) driving simulation software configuration, 3) driving simulator preparation, 4) vibrating toolkit configuration and preparation, and 5) conducting the experiment.
In the exemplar study, participants wore the tactile vibrating toolkit and performed an established car-following task using the customized driving simulation software. The front vehicle braked intermittently, and vibrating warnings were delivered whenever the front vehicle was braking. Participants were instructed to respond as quickly as possible to the sudden brakes of the front vehicle. Driving dynamics, such as the brake response time and brake response rate, were recorded by the simulation software for data analysis.
The presented protocol offers insight into the exploration of the effectiveness of tactile warnings on different body locations. In addition to the car-following task that is demonstrated in the exemplar experiment, this protocol also provides options&#160;to apply other paradigms to the driving simulation studies by making simple software configuration without any code development. However, it is important to note that due to its affordable price, the driving simulation software and hardware introduced here may not be able to fully compete with other high-fidelity commercial driving simulators. Nevertheless, this protocol can act as an affordable and user-friendly alternative to the general high-fidelity commercial driving simulators.

The exemplar study reported in this paper conducted the car-following task using the driving simulator and vibrating toolkit, which has also been published previously in an academic journal22. It is noteworthy that the older version of the vibrating toolkit was used when conducting the exemplar study, while a new version of the vibrating toolkit was introduced in the above protocol. The study was a within-subject design experiment with vibrating warning location as the only factor: finger, wrist, ...

This protocol describes a driving simulation platform and a tactile vibrating toolkit for the investigation of driving-related research. An exemplar experiment exploring the effectiveness of tactile warnings is also presented.&#160;

Collision warning system plays a key role in the prevention of driving distractions and drowsy driving. Previous studies have proven the advantages of ...

tactile-vibrating-toolkit-driving-simulation-platform-for-driving

Research

JoVE Journal

Behavior

We describe a computer-controlled device for investigating the sense of touch: the Tactile Automated Passive-finger Stimulator (TAPS). We describe the components of TAPS, and show how TAPS is used to administer a two-interval forced-choice tactile grating orientation test.

A Tactile Automated Passive-Finger Stimulator (TAPS)

Recently, a vast amount of prospects have come available for human-robot interactive systems. In this paper we outline the integration of a new robotic device with open source software that can rapidly make possible a library of interactive functionality. We then outline a clinical application for a neurorehabilitation application.

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Patients with visual deficits after stroke report about different constraints in daily life most likely due to variable compensatory strategies, which are difficult to differentiate in clinical routine. We present a clinical set-up which allows measurement of different compensatory head- and eye-movement-strategies and evaluating their effects on driving performance.

Driving Simulation in the Clinic: Testing Visual Exploratory Behavior in Daily Life Activities in Patients with Visual Field Defects

A protocol is presented for the characterization of the in-field pedestrian behavior and the simulation of the resulting structural response. Field-tests demonstrate that the in situ identified pacing rate and synchronization rate among the participants constitute an essential input for the simulation and verification of the human-induced loads.

Simulation of Human-induced Vibrations Based on the Characterized In-field Pedestrian Behavior

This article describes a technique for applying vibrotactile stimuli to the thigh of a human participant, and measuring the accuracy and reaction time of the participant's volitional response for various combinations of stimulation location and frequency.

A Method for Evaluating Timeliness and Accuracy of Volitional Motor Responses to Vibrotactile Stimuli

The goal of this protocol is to demonstrate a practical method to temporarily interfere with proprioception in the upper limb of healthy humans.

A Simple Non-invasive Method for Temporary Knockdown of Upper Limb Proprioception

A sitting platform has been developed and assembled that passively destabilizes sitting posture in humans. During the user's stabilizing task, an inertial measurement unit records the device's motion, and vibrating elements deliver performance-based feedback to the seat. The portable, versatile device may be used in rehabilitation, assessment, and training paradigms.

A Vibrotactile Feedback Device for Seated Balance Assessment and Training

We present a protocol to apply incongruent visual-tactile stimuli during an object transfer task. Specifically, during block transfers, performed while the hand is hidden, a virtual presentation of the block shows random occurrences of false block drops. The protocol also describes adding vibrotactile feedback while performing the motor task.

Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

WheelCon is a novel, free and open-source platform to design video games that noninvasively simulates mountain biking down a steep, twisting, bumpy trail. It contains components presenting in human sensorimotor control (delay, quantization, noise, disturbance, and multiple feedback loops) and allows researchers to study the layered architecture in sensorimotor control.

WheelCon: A Wheel Control-Based Gaming Platform for Studying Human Sensorimotor Control

Objective and easy measurement of sensory processing is extremely difficult in nonverbal or vulnerable pediatric patients. We developed a new methodology to quantitatively assess infants and children's cortical processing of light touch, speech sounds, and the multisensory processing of the 2 stimuli, without requiring active subject participation or causing discomfort in vulnerable patients.

Quantitative Assessment of Cortical Auditory-tactile Processing in Children with Disabilities

Explore a tactile vibrating toolkit and driving simulation platform for investigating in-vehicle warning systems. This method enables researchers to study driver responses to wearable vibrotactile devices.

Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research

Explore More Videos