A Fully Automated Rodent Conditioning Protocol for Sensorimotor Integration and Cognitive Control Experiments

Summary

A fully automated protocol for rodent operant conditioning is proposed. The protocol relies on precise temporal control of behavioral events to investigate the extent to which this control influences neural activity underlying sensorimotor integration and cognitive control experiments.

Abstract

Rodents have been traditionally used as a standard animal model in laboratory experiments involving a myriad of sensory, cognitive, and motor tasks. Higher cognitive functions that require precise control over sensorimotor responses such as decision-making and attentional modulation, however, are typically assessed in nonhuman primates. Despite the richness of primate behavior that allows multiple variants of these functions to be studied, the rodent model remains an attractive, cost-effective alternative to primate models. Furthermore, the ability to fully automate operant conditioning in rodents adds unique advantages over the labor intensive training of nonhuman primates while studying a broad range of these complex functions.

Here, we introduce a protocol for operantly conditioning rats on performing working memory tasks. During critical epochs of the task, the protocol ensures that the animal's overt movement is minimized by requiring the animal to 'fixate' until a Go cue is delivered, akin to nonhuman primate experimental design. A simple two alternative forced choice task is implemented to demonstrate the performance. We discuss the application of this paradigm to other tasks.

Introduction

Studying the relation between neurophysiology and behavior is the ultimate goal in systems neuroscience. Historically, there has been a tradeoff between animal model choice and behavioral repertoire^1-5. While simple organisms like sea slugs⁶ or squids⁷ have been used extensively to study properties of single ion channels, neurons and simple neural circuits, higher order species are needed to study more complex functions such as spatial navigation, decision making^8-11 and cognitive control^12-14. Despite being a standard animal model for human like behavior, use of nonhuman primates prompts cost and ethical considerations that precludes their use across a wide range of experiments in a single laboratory setting^15-18. Simpler animal models such as rodents are generally preferred¹⁹, provided they have similar neural substrates underlying the behaviors of interest.

There's ample evidence suggesting that rodents share similar cortical and subcortical structures as those found in primates^20-22. Rodents are also known to integrate information across multiple sensory modalities to guide their action^23-25, for example, by coordinating whisking and sniffing during exploratory behavior²⁶ or by integrating auditory and visual/olfactory events^25,27.

Here we describe a framework for operant conditioning of rodents used to test cognitive tasks^28-32. In this framework, subjects are required to fixate inside a nosepoke hole and maintain their snout inside the hole until the presentation of a go cue. The behavioral task is a five-hole nosepoke design that is conventionally used for 5-choice serial reaction time task studies. During the delay period, a range of instruction cues is presented to guide the subject to perform an action. This framework can easily be modified to suit a wide range of experiments in which training the subject to minimize its overt movement over a brief interval is needed. This permits studying the extent to which spiking activity of individual neurons is affected by specific cues during this interval. The protocol can minimize the training time and can reduce across-subject learning variability. A schematic flowchart of the task is shown in Figure 1.

Protocol

All procedures involving animals were approved by the Michigan State University Institutional Animal Care and Use Committee (IACUC).

1. Experimental Setup

1. Use an operant conditioning box which consists of a five-hole nosepoke wall on one side and a food delivery trough on the opposite side.
   1. The center nosepoke hole is considered as a "fixation" hole and the four other holes (two on each side of the fixation hole) are considered motor target holes. Each hole is equipped with a tri-color LED and an infrared beam emitter-detector system that detects when the animal enters and retracts from the fixation hole.
   2. Use a programmable tone generator to generate single frequency tones with millisecond precision and connect it to a speaker mounted inside the operant box. Control the tone generator and nosepokes through the behavioral tracking system using the appropriate software. Use a hardware and software system that provides millisecond timescale monitoring of behavioral events and control of cues and responses.
      Note: The amplitude of both tone and noise cues should be kept around 60 ± 3 dB SPL.

2. Early Habituation

1. Restrict the subject's food intake gradually to ~5 g per 100 g of the subject's normal weight (e.g. over the course of 3 days). The subject should maintain 85-90% of their ad libitum weight.
2. Habituate the subject to handling by the experimenter and familiarize the subject with the apparatus from the first day of starting the food deprivation protocol. Start handling the animal and place it in the operant conditioning box while providing food pellets in the pellet trough to encourage the subject to explore the cage and get familiar with the reward delivery location.

3. Subject Training

1. General notes
   1. The task suggested here needs precise coordination between perception of an auditory cue, minimizing movements during the delay period and movement execution.
   2. Gradually train the subject step-by-step to prepare them for the final desired behavior.
   3. Make sure that at the end of each step, the subject maintains >75% behavioral performance for at least three consecutive sessions before progressing to the next stage.
   4. Once the final stage is reached, keep the subject on the protocol for a week to ensure the performance is maintained at the desirable level.
2. Start: Familiarize the subject with the nosepoke holes, food delivery port and the association between the flashing holes and reward.
   1. Select one out of the four targets on a random schedule.
   2. Play the Go cue (a white auditory noise) and keep the LED inside the hole flashing (0.3 sec pulse duration).
   3. Set the software to reward the subject upon visits to the hole.
   4. Time-out the trial after 30 sec if the hole is not visited and start a new trial.
   5. Do not reward any visits to the incorrect holes.
3. Target Selection: Punish erroneous visits to the nonselected holes.
   1. Upon visits to incorrect holes, terminate the trial followed by 5 sec of black-out.
      Note: During a black-out epoch, the fixation hole LED is turned off in the cage. This means that the subject cannot initiate a trial and needs to wait until the fixation hole LED starts flashing.
   2. Select a new hole and start a new trial.
4. Nosepoke: Train the subject to poke inside the fixation hole to start a trial.
   1. Flash a yellow LED inside the fixation hole.
   2. Upon visiting the fixation hole immediately play the Go cue and start a new trial.
   3. Penalize incorrect visits by 5 sec of black-out.
5. Delay: Teach the subject to maintain their nose inside the fixation hole for a set period of time (delay period) that is increased gradually as training progresses.
   1. Wait for the subject to visit the fixation hole.
   2. Terminate the trial if the subject retracts within 500 msec. Otherwise, play the Go cue.
   3. Penalize premature retractions by a black-out period for 7 sec.
   4. Reward the correct visits by delivering a food pellet.
6. Two Cues (with Light): Increase and randomize the delay period length and introduce the auditory instruction cue.
   1. Increase the length of the delay period to an average of 1.5 sec.
   2. Choose a random delay period length at each trial based on a uniform density between 1.3-1.8 sec.
   3. Introduce the instruction cue as a single frequency auditory tone pulsed in triplets, with a pulse duration of 150 msec and interpulse interval of 100 msec.
      1. Play the instruction cue immediately after the subject enters the fixation hole.
      2. Assign two instruction cues to each of the targets.
      3. Only use one cue associated for each target at this stage.
   4. Let the subject use both auditory and visual cues to select the target hole.
7. Two Cues (without Light): Train the subject to only use auditory cues.
   1. Turn off the flashing LEDs inside the target holes so that the subject would only use auditory instruction cues.
8. Four Cues: Introduce the two other cues to the sequence of randomly presented instruction cues and repeat sections 3.5.3-3.6.1.

4. Behavioral Data Analysis

1. Success Rate: Define success rate as the percentage of correct visits to the targets divided by the total number of trials.
   1. Measure the success rate at each stage of training.
2. Error types:
   1. Premature retraction: measure the percentage of trials timed-out due to early retractions from the fixation hole.
   2. Comission error: Calculate the percentage of failed trials when the subject visits an uninstructed target
   3. Omission Error: Calculate the percentage of errors when the subject does not visit any of the targets after trial initiation.
3. Measured variables:
   1. Reaction Time (RT): For each trial, measure the delay between the onset of the Go cue and the subject retracting from the fixation hole.
   2. Time to Target (TT): Measure the duration between the subject retraction from the fixation hole and entering the target hole.

Results

The suggested framework enables training the subject on a range of cognitive tasks. Here we implemented an instructed delay task designed to investigate the mechanisms of goal-directed actions in the rodent prefrontal cortex. Figure 1 shows a flowchart of the experimental design.

To ensure that the subject understands the task requirement at every step, performance measures should be continuously assessed. Figure 2 shows an example performance of one subject a...

Discussion

Rats have been widely used in neuroscience research for over a century. Since Thorndike's introduction of the concept of the law of effect in cats³⁴, operant conditioning has been the standard approach to test different aspects of animal behavior. Many neuroscience experiments involving decision making and motor preparation include a delay period between the instruction cues and the action interval. It is desirable to minimize movements during these delay periods to reduce any confounds to the neural data ...

Materials

List of materials used in this article

Name	Company	Catalog Number	Comments
5-holed Nose Poke with 3 Stim Cue Light Rat Cage	Coulbourn	H21-06M/R
Test cage	Coulbourn	H10-11R-TC
Graphic State Software	Coulbourn
Programmable tone/noise generator	Coulbourn	A12-33
Dustless precision pellets	Bio-Serv	F0165
Speaker module	Coulbourn	H12-01R