Name: Enabling High Grayscale Resolution Displays and Accurate Response Time Measurements on Conventional Computers (Video) | JoVE Journal
Uploaded: 2012-02-29T12:00:00.000+00:00
Duration: 6 min 50 s
Description: Learn to enable high-resolution grayscale displays and accurate response time measurements on conventional computers using a video switcher and RT box. These affordable devices enhance neuroscience experiments.

ai_agent_IP

ai_agent

maintenance

instantTrialDurationMinutes

isBiopharma

enableNewMyJoveSectionDesign

educationFeatures

seoMetaApi

ai_copilot_institution_blacklist

ai_chat_institution_blacklist

freeAccessWindow

ssoRoleCapture

scheduledMaintenanceBanner

joveLabsFeatures

disable_autoplay_for_bots

extended_trial_duration

5 minutes

playerTrialDesktop

This work was funded by NEI and NIMH.

1. VideoSwitcher
1.1. Connect VideoSwitcher to a computer
The VideoSwitcher (Figure 1) receives analog video (VGA) inputs and is used to drive cathode ray tube (CRT) color monitors. Before using the VideoSwitcher, make sure the computer graphics card has either a VGA port (Figure 2A) or a Digital Visual Interface (DVI-I) port (Figure 2B) that transmits both digital and analog video signals. A DVI-to-VGA adaptor (Figure 2C) is necessary to connect the DVI-I port to the VideoSwitcher.
Turn off the computer and monitor and disconnect the monitor from the computer graphics card.
Connect the VGA or the DVI-I port of the computer graphics card to the input port of the VideoSwitcher using the provided VGA cable. Use a small screw driver to secure the connections. 
Connect the monitor's VGA cable to the output port of the VideoSwitcher and secure the connections. 
Connect the VideoSwitcher to a power source using the provided power adaptor.
Turn on the computer and the monitor.
1.2. Two display modes of the video switcher
The switch button on the VideoSwitcher allows the user to switch back-and-forth in two display modes. In the color mode, the VideoSwitcher does not alter the video signal from the computer graphics card. In the grayscale mode, the display becomes monochromatic, with its luminance determined mostly by the video signal from the blue channel of the graphics card, slightly affected by the signal from the red channel, and no contribution from the green channel. This is because the resister network inside the VideoSwitcher attenuates the signal from the red channel by a factor of about 128, and the signal from the green channel doesn't contribute at all. The ratio of the contributions of the blue and red channels to the output of the VideoSwitcher is called blue-to-red ratio (BRratio). The BRratio is property of a Video Switcher, independent of the display setup. It can be determined experimentally for each VideoSwitcher (see 1.3). 
The display mode can also be switched by sending a special signal through the green channel of the graphics card using a function call in Matlab:
PsychVideoSwitcher('SwitchMode', whichScreen, ToGrayMode);
where ToGrayMode of 1 or 0 means to switch to grayscale or color mode.
Figure 3 shows the schematic of a VideoSwitcher. 
1.3. Measure BRratio
The BRratio can be measured for each VideoSwitcher using a square wave grating detection task. The two levels of the square wave are assigned RGB values such as (0, 0, 40) and (x, 0, 39). One can adjust the value of x until the square wave grating disappears, at which point the x value is the BRratio --- the magnitude of the signal in the R-channel that leads to the intensity produced by one unit of signal in the B-channel. Although one can measure the BRratio electronically, for example to measure the ratio of the voltage outputs of a VideoSwitcher at RGB values of (0, 0, 255) and (255, 0, 0), the psychophysical method described here is very simple and accurate.
1.4. Display Calibration
For most monitors, display luminance doesn't increase linearly with the pixel gray level specified by the computer graphics card. The relationship can be described as: 
<img src="/files/ftp_upload/3312/3312eq1.jpg" alt="Gamma correction formula L(U)=Lmin+(Lmax-Lmin)(U/255)^γ, mathematical formula." data-altupdatedat="1788235205000" data-alt="Equation 1"> 
where Lmax, Lmin and γ are determined with a Gamma correction procedure, either by using photometers or by a combination of psychophysical procedures and photometric measurements 7,8. Gamma calibration is important to produce accurate contrasts on a display; it must be performed for each display device.
With a photometer, one can simply display a large uniform square at different pixel graylevels (e.g., from 0 to 255), measure the luminance of the center of the square, and fit the results with Equation 1 to obtain γ. 
The psychophysical procedure involves creating, in one area of the viewing surface, as uniform as possible a mixture (in space and time) of equal quantities of zero- and full-intensity pixels and determining the graylevel value of pixels in an adjacent homogeneous area (in which all the pixels have the same intensity) that produces a psychophysical match to the luminance of the mixed-pixel area. The first match determines the graylevel value for 1/2 of maximum luminance. A mixture of pixels with luminance intensities 1/2 and 1 is used to determine the 3⁄4 value, and this procedure is repeated until seven values from 1⁄8 to 7⁄8 have been determined. These matches are repeated, and various checks for consistency are made, such as verifying that a mixture of 3⁄4 and 1⁄4 matches 1/2. In this procedure, both the B and R levels of the homogeneous area are adjusted, and U=B+R/BRratio. The results can be fit with Equation 1 to obtain γ.
After we obtain values of Lmin, Lmax and γ, we can set the background luminance L0 = (Lmax +Lmin)/2, The relationship between pixel contrast c(U) and pixel gray level U is: 
<img src="/files/ftp_upload/3312/3312eq2.jpg" alt="Static equilibrium equation; formula c(U)=(L(U)-L0)/L0; educational math concept." data-altupdatedat="1788235205000" data-alt="Equation 2">
We can rewrite the equation to solve for the required gray level for a given contrast: 
<img src="/files/ftp_upload/3312/3312eq3.jpg" alt="Equation for calculating visual luminance; U=255(Lmax+Lmin)/(Lmax-Lmin × c)^1/γ; formula." data-altupdatedat="1788235205000" data-alt="Equation 3"> 
where U is normally a non-integer number. The RGB value of the corresponding pixel is: R=BRratio*[U-int(U)], G=0, B=int(U), where int() takes the integer value of its input.
1.5. Demo of a sine wave grating
The effect of increased grayscale resolution can be shown by comparing two sine wave gratings. The grating on the left uses the full capacity of the VideoSwitcher with each pixel intensity specified by the appropriate R and B values. The grating on the right is the same as the left one except that only the rounded U is used as B value of each pixel, mimicking the output of an 8-bit display device. 
2. RTbox
2.1. Connect the RTbox to a computer
Connect the RTbox (Figure 4) to a USB port of a computer with the provided cable. If needed, download the driver of the device from <a href="http://www.ftdichip.com/Drivers/VCP.htm">http://www.ftdichip.com/Drivers/VCP.htm</a>. Install the driver following the instructions on the website.
2.2. Use the RTbox to measure response time
The RTbox can be used in two different ways.
If the user's program can return reliable stimulus onset times, such as the time returned by Screen('Flip') and PsychPortAudio in Psychtoolbox [8], the RTbox can be used just like a keyboard. Because stimulus onset times and RTbox button times are based the clocks of the host computer and the RTbox, respectively, we must synchronize the two clocks. This is done with a function call RTBox('clear') prior to each stimulus onset to clear unwanted events in the buffer. The response time can be simply measured as tresp= t - tonset, where tonset is the stimulus returned from the user program, and t is the button time returned by the function call [t, button]=RTBox(timeout). This is because the RTBox driver automatically converts the button time from the RTbox time to host computer time. 
If the user's program can't return reliable stimulus onset times, trigger signals indicating stimulus onsets must be provided to the RTbox. One solution is to use a light sensor to detect the onset of the stimulus or a light patch that is synchronized to the stimulus. The output of the light sensor is connected to the light port of the RTbox. A second solution is to use the trigger output of the VideoSwitcher. The trigger can be directly connected to the pulse port of the RTbox. A third solution is to connect the audio signal of the host computer to the sound port of the RTbox. 
To generate a stimulus onset trigger from the VideoSwitcher, we "turn on" the green channel of the pixels in the central portion of the first frame of the visual stimulus. Because it does not contribute to the resistor network, the signal in the green channel is invisible to the subject. A function call [t, button]=RTBox('pulse', timeout) returns the response time, where 'pulse' instructs the RTbox to compute the response time relative to the trigger. The same function call is used for sound trigger. For light sensor triggers, the function call is [t, button]=RTBox('light', timeout).
3. Integrate VideoSwitcher and RTbox
We have programmed a demonstration program that uses the VideoSwitcher to control the display, the RTbox to collect accurate response time, and the RTbox to send event code and responses to an ERP system. The program can be downloaded from <a href="http://lobes.usc.edu/videoswitcher/VideoSwitcherRTBoxERP_demo.m">http://lobes.usc.edu/videoswitcher/VideoSwitcherRTBoxERP_demo.m</a>.
4. Representative Results
<img src="/files/ftp_upload/3312/3312fig1.jpg" alt="VGA video switcher device, data collection output port, input-output controls, electronic equipment." data-altupdatedat="1788235205000" data-alt="Figure 1"> 
Figure 1. Picture of a video switcher. It has VGA input and output ports (both female), a button to switch between two display modes, and a trigger output port.
<img src="/files/ftp_upload/3312/3312fig2.jpg" alt="VGA, DVI connectors diagram; computer interface comparison; hardware connection study." data-altupdatedat="1788235205000" data-alt="Figure 2"> 
Figure 2. Pictures of VGA (A) and DVI-I (B) ports and a DVI-I to VGA adaptor (C). 
<img src="/files/ftp_upload/3312/3312fig3.jpg" alt="RGB signal multiplexer diagram with comparator and CPLD setup; circuit analysis method." data-altupdatedat="1788235205000" data-alt="Figure 3"> 
Figure 3. The schematic of a video switcher. The multiplexer has two input modes, controlled by a voltage level. When it is in the mode shown in the schematic, the RGB channels of a monitor receive the same signal, so the display is in grayscale mode. The switching voltage is generated by a CPLD chip, controlled by signals in the G-channel and the switch button. The trigger is also controlled by the input in the G-channel.
<img src="/files/ftp_upload/3312/3312fig4.jpg" alt="Response time measurement equipment; cognitive experiment; psychology research; reaction time testing." data-altupdatedat="1788235205000" data-alt="Figure 4"> 
Figure 4. Picture of an RTbox. It has a USB-B port, a light input port, a pulse/sound input port, an external button input port, and a TTL output port.

<ol><li>Bits# Stimulus Processor with integrated Data Acquisition. , Cambridge Research Systems Ltd. United Kingdom. Available from: 
 
 <a target="_blank" href="http://www.crsltd.com/tools-for-vision-science/visual-stimulation/bits-sharp/">http://www.crsltd.com/tools-for-vision-science/visual-stimulation/bits-sharp/</a> (2011).</li>
<li>Visual Stimulators. , VPixx Technologies Inc. Canada. Available from: 
 
 <a target="_blank" href="http://www.vpixx.com/products/visual-stimulators/datapixx.html">http://www.vpixx.com/products/visual-stimulators/datapixx.html</a> (2011).</li>
<li>Li, X., Lu, Z. -L., Xu, P., Jin, J., Zhou, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Generating+high+gray-level+resolution+monochrome+displays+with+conventional+computer+graphics+cards+and+color+monitors%5BTitle%5D)+AND+%22Journal+of+Neuroscience+Methods%22%5BJournal%5D)">Generating high gray-level resolution monochrome displays with conventional computer graphics cards and color monitors.</a> Journal of Neuroscience Methods. 130 (1), 9-18 (2003).</li>
<li>Pelli, D. G., Zhang, L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Accurate+control+of+contrast+on+microcomputer+displays%5BTitle%5D)+AND+%22Vision+Research%22%5BJournal%5D)">Accurate control of contrast on microcomputer displays.</a> Vision Research. 31, 1337-1350 (1991).</li>
<li>Li, X., Liang, Z., Kleiner, M., Lu, Z. -L. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((RTbox%3A+A+device+for+highly+accurate+response+time+measurements%5BTitle%5D)+AND+%22Behavior+Research+Methods%22%5BJournal%5D)">RTbox: A device for highly accurate response time measurements.</a> Behavior Research Methods. 42 (1), 212-225 (2010).</li>
<li>Psychtoolbox-3. , United States. Available from: 
 
 <a target="_blank" href="http://psychtoolbox.org/">http://psychtoolbox.org/</a> (2012).</li>
<li>Lu, Z. L., Sperling, G. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Second-order+reversed+phi%5BTitle%5D)+AND+%22Perception+Psychophysics%22%5BJournal%5D)">Second-order reversed phi.</a> Perception Psychophysics. 61, 1075-1088 (1999).</li>
<li>Colombo, E., Derrington, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/pubmed?term=((Visual+calibration+of+CRT+monitors%5BTitle%5D)+AND+%22Displays%22%5BJournal%5D)">Visual calibration of CRT monitors.</a> Displays. 22, 87-95 (2001).</li>
</ol>

No conflicts of interest declared.

The video switcher provides a compact, inexpensive, and easy-to-use method to generate high luminance resolution displays using conventional computer graphics cards and analog color monitors. It is connected between the analog outputs of the graphics card and the monitor. It can also switch between monochromatic and chromatic display modes, providing additional convenience. Its trigger channel allows researchers to synchronize other equipment to visual displays.
The RTbox is a compact, inexpen...

enabling high grayscale resolution displays and accurate response time measurements on conventional computers

Enabling High Grayscale Resolution Displays and Accurate Response Time Measurements on Conventional Computers

Display systems based on conventional computer graphics cards are capable of generating images with 8-bit gray level resolution. However, most experiments in vision research require displays with more than 12 bits of luminance resolution. Several solutions are available. Bit++ 1 and DataPixx 2 use the Digital Visual Interface (DVI) output from graphics cards and high resolution (14 or 16-bit) digital-to-analog converters to drive analog display devices. The VideoSwitcher 3 described here combines analog video signals from the red and blue channels of graphics cards with different weights using a passive resister network 4 and an active circuit to deliver identical video signals to the three channels of color monitors. The method provides an inexpensive way to enable high-resolution monochromatic displays using conventional graphics cards and analog monitors. It can also provide trigger signals that can be used to mark stimulus onsets, making it easy to synchronize visual displays with physiological recordings or response time measurements.
Although computer keyboards and mice are frequently used in measuring response times (RT), the accuracy of these measurements is quite low. The RTbox is a specialized hardware and software solution for accurate RT measurements. Connected to the host computer through a USB connection, the driver of the RTbox is compatible with all conventional operating systems. It uses a microprocessor and high-resolution clock to record the identities and timing of button events, which are buffered until the host computer retrieves them. The recorded button events are not affected by potential timing uncertainties or biases associated with data transmission and processing in the host computer. The asynchronous storage greatly simplifies the design of user programs. Several methods are available to synchronize the clocks of the RTbox and the host computer. The RTbox can also receive external triggers and be used to measure RT with respect to external events. 
Both VideoSwitcher and RTbox are available for users to purchase. The relevant information and many demonstration programs can be found at <a href="http://lobes.usc.edu/">http://lobes.usc.edu/</a>.

Conventional computer hardware can not generate visual stimuli with sufficiently high grayscale resolution and measure response times with sufficient accuracy. We describe how to use the VideoSwitcher to produce high-resolution monochromatic displays, and the RTbox to measure response times with high accuracy on conventional computer hardware.

Display systems based on conventional computer graphics cards are capable of generating images with 8-bit gray level resolution. However, most experiments ...

This video demonstrates how to enable high resolution gray scale displays and perform accurate response time measurements on conventional computers. This is achieved using two affordable devices, a video switcher and an RT box, which are connected to the computer. Next, the display is calibrated to ensure image intensities are accurate.A sign wave grading with and without increased gray scale resolution is used to demonstrate the improved gray scale resolution. Simulated button responses from a light signal are used to demonstrate the accuracy of the response time measurements. The main advantage of the video switcher over existing methods like b plus plus and data pex is that it enables researchers to generate monochromatic displays with high grade level resolution using conventional computer hardware.It can also provide trigger signals to synchronize visual displays with physiological recordings or response time measurements. The RT box enables measurements of response times with high accuracy. The advantage of the RT box over a computer keyboard is that it uses a microprocessor and high resolution clock to record the identities and timing of button events.So the measured respons

enabling-high-grayscale-resolution-displays-accurate-response-time

Research

JoVE Journal

Neuroscience

This protocol illustrates how voltage-sensitive dyes enable optical recording of electrical activity from intact neural networks such as the plexuses of the guinea-pig enteric nervous system, with an adjustable resolution that ranges from single-cells to multi-ganglionic circuitry.

Optical Recording of Electrical Activity in Guinea-pig Enteric Networks using Voltage-sensitive Dyes

Source: Maruoka, H., et. al. Simultaneous Imaging of Microglial Dynamics and Neuronal Activity in Awake Mice. J. Vis. Exp. (2022)     This video shows a two-photon microscopy procedure for imaging neuronal activity and microglial dynamics in an awake mouse during visual stimulation, highlighting calcium transients and cellular interactions.

Simultaneous Imaging of Microglial Dynamics and Neuronal Activity in an Awake Mouse

This paper describes a novel dual task procedure combined with Rapid Serial Visual Presentation to look at attentional blink at varied stimulus onset asynchronies. This experimental procedure differed from others in that it tested attentional blink for nontargets.

A Dual Task Procedure Combined with Rapid Serial Visual Presentation to Test Attentional Blink for Nontargets

This method uses a dynamic visual display to index costs of distraction during visual search, including both "contingent attentional capture" and "set-specific capture," which is a cost of distraction that occurs when the participants maintain multiple search goals simultaneously. This method has revealed basic mechanisms and limitations of visual attention.

Using Rapid Serial Visual Presentation to Measure Set-Specific Capture, a Consequence of Distraction While Multitasking

Cerebral injury can damage both ocular and somatic motor systems. Characterization of motor control post-injury affords biomarkers that assist in disease detection, monitoring, and prognosis. We review a method to measure eye-hand movement control in health and in pathologic incoordination, with look-and-reach paradigms to assess coordination between eye and hand.

Efficiently Recording the Eye-Hand Coordination to Incoordination Spectrum

This experimental protocol combined eye tracking and the assessment of presaccadic visual sensitivity in a dual task paradigm, consisting of a free choice saccade task and a visual discrimination task, to investigate the deployment of visual spatial attention before both, accurate and averaging saccades.

Investigating the Deployment of Visual Attention Before Accurate and Averaging Saccades via Eye Tracking and Assessment of Visual Sensitivity

To examine mouse vision, we conducted a looming test. Mice were placed in a large square arena with a monitor on its ceiling. The looming visual stimulus consistently evoked freezing or flight reactions in the mice.

Using Looming Visual Stimuli to Evaluate Mouse Vision

We present a protocol to record a set of ultra-realistic full-color analog holograms, showing the same brightness, transparency, and homogeneous colors, on ultra-fine-grain silver-halide holographic emulsions for the fabrication of a dynamic holographic 3D display.

Recording Ultra-Realistic Full-Color Analog Holograms for Use in a Moving Hologram Display

VisualEyes2020 (VE2020) is a custom scripting language that presents, records, and synchronizes visual eye movement stimuli. VE2020 provides stimuli for conjugate eye movements (saccades and smooth pursuit), disconjugate eye movements (vergence), accommodation, and combinations of each. Two analysis programs unify the data processing from the eye tracking and accommodation recording systems.

Quantification of Oculomotor Responses and Accommodation Through Instrumentation and Analysis Toolboxes

We present development of a gaze-contingent display framework designed for perceptual and oculomotor research simulating central vision loss. This framework is particularly adaptable for studying compensatory behavioral and oculomotor strategies in individuals experiencing both simulated and pathological central vision loss.

A Gaze-Contingent Display Framework for Perceptual Learning Research with Simulated Central Vision Loss

Learn to enable high-resolution grayscale displays and accurate response time measurements on conventional computers using a video switcher and RT box. These affordable devices enhance neuroscience experiments.

Enabling High Grayscale Resolution Displays and Accurate Response Time Measurements on Conventional Computers

Explore More Videos