$$\rightleftharpoonup{xx}$$
$$\longleftharp{xx}$$,
$$\longrightharp{xx}$$,
Many features of brain function are currently impossible to replicate in an artificial system. The brain’s ability to quickly process complex sensory information and to generate, in response, precise motor commands is by itself already beyond the current state-of-the-art. But its ability to adapt to different conditions by learning from past experience makes it so vastly superior to human-developed control systems. So far, attempts to replicate or exploit this plasticity have met little success, and the comprehension of the inner workings of the brain has eluded the grasp of researchers. One of the main issues while investigating the relationship between brain and behavior is the inability to properly access all of the variables in the system: ideally, an optimal experimental setup would allow simultaneous recording and stimulation to a large numbers of neurons, long-term stability, monitoring of synapses positions and weights, and controllable bi-directional interaction with the environment. The difficulty in tracking all those variables simultaneously led to the study of the brain-behavior relationship at two very different scales: either with behaving animals, with no fine control over experimental conditions 1-7 or with small, isolated parts, such as portions of neuronal tissue, with no overall view of the system 8. In the latter case, while no devised experimental setup allows the complete monitoring of all the parameters involved in the workings of even a simple neural network, a good trade-off is provided by dissociated neurons grown over Micro-Electrode Arrays (MEAs) 9. Those devices, born at the end of the 70's 10, have several advantages over traditional electrophysiology techniques: firstly, the possibility of recording and stimulating a neural network in many different locations at once (usually 60 electrodes). Furthermore, the coupling of MEAs with cells is almost non-invasive, allowing the observation of the same network for long periods of time, up to several months 11. The physiological effects of electrical stimulation on dissociated cultures have been extensively studied thanks to those devices, revealing that many properties observed at higher scales (such as, for example, plasticity and simple memory processes 12-14) are conserved despite the loss of architecture. During culture growth, those networks start showing spontaneous activity at about 7 days in vitro (DIV) 15,16. Network activity tends to change radically with further growth; first as single spikes gather into bursts (towards the end of the second week) 17, later as it changes into a highly complex pattern of synchronized, non-periodic network bursts 18, which represents the mature state of a network. It has been suggested 19 that this synchronous behavior, somewhat similar to that observed in in vivo recordings on sleeping animals, is caused by the lack of sensory input.
A different approach attempted to gain a better understanding of information coding has been taken by performing closed-loop experiments, in which different types of signals were used to control the stimulation of the neuronal network itself 11,20-23. In these experiments, an external agent capable of interaction with the environment has been used to generate sensory information fed to the neural network, which, in turn, produced motor commands for an effector mechanism. This allowed observations of how dynamic and adaptive properties of neural systems evolved in response to induced changes in the environment.
A setup to perform ‘embodied neurophysiology’ experiments was developed, where a wheeled sensor platform (a physical robot or its virtual model) moves about in an arena and its speed profiles are determined by the activity of a neuronal system (i.e., a population of rat neurons cultured over a MEA). The robot is characterized by the speed profiles of its two independently-controlled wheels and by the current readings of the distance sensors. The exact nature of the distance sensors is not relevant; they may be active or passive optical sensors or ultrasound sensors. Clearly, this issue does not apply in the case of virtual robots, in which sensors may be designed with any desired feature.
In the experiments herein described, the robot used is always the virtual implementation, with 6 distance sensors pointing at 30°, 60° and 90° from the robot heading in both directions. The activity of the three left and right sensors is averaged and the activity of the biological culture is driven by the information collected by such ‘super-sensors’ (which will just be referred to as ‘left’ and ‘right’ sensors in the rest of this work). The protocol described may actually be applied to the physical robot with fairly minor adjustments. The information collected by the robot (either physical or virtual) is encoded in a series of stimuli that are used to manipulate the activity of the biological neural network, which is physically separated by the robot. The stimuli themselves are all identical and thus do not code any information. What is relevant is their frequency: stimulation rate increases when the robot approaches an obstacle, with different delivery sites coding sensory information from the left and right ‘eyes’ of the robot. The neural network will present different responses to the incoming train of stimulations: the task of the decoding algorithm is to translate the resulting network activity into commands used to control the wheels of the robot. Given a ‘perfect’ network behavior (i.e., with reliable and totally separated responses to stimuli from different electrodes), this would result in the robot driving in its arena without hitting any obstacle. Most networks present a behavior very different from ideality, therefore a simple learning protocol is introduced: when activated, tetanic stimulation (brief spells of high-frequency stimulation, 20 Hz stimulation for 2 sec, inspired by protocols described in 24,25) following a collision with an obstacle is delivered. If the tetanic stimulation results in a local strengthening of network connectivity, this will result in a progressive increase in the navigational capabilities of the robot.
HyBrainWare2, an improved version of the custom software published in 26, is the core architecture developed to handle the control of the different devices of the system (stimulator, data acquisition, processing and visualization, robot communication or simulation). This software has been developed at our lab and is freely available on request. This software provides the interface with the data acquisition board: once the user starts data acquisition from the GUI, the software controls the acquisition board to start the sampling and A/D conversion of data coming from the recording electrodes. This data can then be recorded, displayed to screen or analyzed in real-time to detect spikes, according to the options set by the user (see Procedure section for details). Furthermore, within the software, the definition of coding (translation of sensory information into an electrical stimulation) and decoding (translation of recorded activity into motor commands for the robot) algorithms must be specified. In particular, our setup is relatively user-friendly compared to similar systems designed in the past 27, since almost all variables can be accessed by the user right before starting the actual experiment, while all the recorded information is automatically saved in a format compatible with a neural data analysis toolbox 28.
The following Procedure section describes a learning experiment on dissociated rat hippocampal cultures: all the culturing and experimental parameters are provided for this particular preparation and may need to be modified if a different biological substrate is to be used. Similarly, the described experiment takes advantage of the closed-loop architecture to investigate the learning effect of tetanic stimulation, but the architecture itself is flexible enough to be used in the study of different features of dissociated neural networks. Major variants of the proposed experiment are further explained in the Discussion section.