Individual differences |
Methods | Statistics | Clinical | Educational | Industrial | Professional items | World psychology |
A brain-computer interface (BCI) or direct neural interface is literally a direct technological interface between a brain and a computer not requiring any motor output from the user. That is, neural impulses in the brain are intercepted and used to control an electronic device. This is a rather broad, ill-defined term used to describe many versions of conventional and theoretical interfaces. For purposes of this term, the word 'brain' is understood to imply the physical brain of an organic life form and 'computer' is understood to imply a mechanical/technological processing/computational device. These semantic notations are crucial in the contemplation of a direct brain-computer interface, as there is great debate in the philosophy of mind regarding the reduction of consciousness and mind to the physical qualities of the brain. Because of cortical plasticity, the brain is likely to adapt during learning to operate a BCI.
- Main article: neuroprosthetics
Simple brain-computer interfaces already exist in the form of neuroprosthetics, with a great deal of neuroscience, robotics, and computer science research currently dedicated to furthering these technologies. Recent achievements demonstrate that it is currently possible to implement crude brain-computer interfaces (brain dishes) that allow in vitro neuronal clusters to directly control computers. Laboratories led by investigators Andrew Schwartz (U. Pittsburgh), Richard Andersen (Caltech), Miguel Nicolelis (Duke), and John Donoghue (Brown University) have all successfully used a variety of algorithms, including the vector sum of motor cortical neuron spiking, to record directly from the cortex of monkeys - as a BCI. This design allowed a monkey to navigate a computer cursor on screen, as well as command a robotic arm to perform simple tasks, simply by thinking about moving the cursor, without any motor output from the monkey.
BCIs in monkeys
Studies that developed algorithms for reconstruction of movements from the activity of motor cortex neurons date back to the 1980s. Work by groups led by Schmidt, Fetz, and Baker in the 1970s established that monkeys could quickly achieve voluntary control over the firing rate of individual neurons in primary motor cortex using a closed-loop operant conditioning paradigm. Phil Kennedy and colleagues had success in building the first wireless, intracortical brain-computer interface by implanting neurotrophic cone electrodes first into monkeys and then into the brains of paralyzed patients. Real-time reconstruction of more complex motor parameters using recordings from neural ensembles has been explored by several groups including research groups lead by Miguel Nicolelis, John Donoghue, Andrew Schwartz, Richard Andersen and more recently Krishna Shenoy, Nicho Hatsopoulos, Ad Aertsen, Eilon Vaadia, Lee Miller, Dawn Taylor, and Eric Leuthardt.
During the last 10 years of explosive development of BCIs, Miguel Nicolelis was the most prominent proponent of multiunit, multiarea recordings from neural ensembles as the recording technique to obtain the high-quality neuronal signals to drive a BCI. After conducting initial studies in rats during the 90s, Nicolelis and his colleagues started to develop BCIs that decoded brain activity in monkeys and used it to reproduce monkey movements in artificial actuators. Monkeys have advanced reaching and grasping abilities and good hand manipulation skills. Nicolelis' group conducted experiments in owl monkeys. By 2000, they accumulated experience in implanting owl monkeys with electrode arrays in multiple brain areas and were able to construct a BCI that reproduced monkey movements during operating a joystick or reaching for food (Wessberg et al., 2000). The BCI operated in real time and could control a robot. However, that was an open-loop BCI because the monkeys did not receive any feedback about the BCI performance.
Other leading labs that develop neuroprosthetic decoding algorithms include John Donoghue from Brown University, Andrew Schwartz from the University of Pittsburg and Richard Andersen from Caltech. These researchers conducted experiments in rhesus macaques which are considered to be better models for human neurophysiology than owl monkeys. Although these researchers initially could not record from as many neurons as Nicolelis and coworkers (15-30 neurons versus 50-200 neurons), they were able to make important advances by expanding the BCI capabilities. A study from Donoghue group (Serruya et al., 2002) reported a BCI in which monkeys, without any training on the BCI, tracked visual targets on a computer screen (closed-loop BCI). Schwartz' group created a BCI for three dimensional tracking (Taylor et al., 2002). Andersen's group incorporated in their BMI design cognitive signals recorded in posterior parietal cortex, such as encoding of reach target and anticipated reward (Mussalam et al., 2004). John Donoghue and Nicho Hatsopoulos also took this research to the business arena by starting Cyberkinetics, the company that puts development of practical BCIs for humans as its major goal.
The group of Miguel Nicolelis also started experiments in rhesus monkeys. In 2003, Jose Carmena and Mikhail Lebedev in Nicolelis lab conducted experiments in the monkeys that were trained to reach and grasp objects on a computer screen by manipulating a joystick (Carmena et al., 2003; Lebedev et al., 2005). Their BCI used velocity predictions to control reaching movements. The BCI simultaneously predicted hand gripping force. Reaching and grasping was produced by a robot, which remained invisible to the monkeys (direct interaction with the robot still needs to be demonstrated), and the feedback of the robot's performance was provided by a visual display.
In addition to predicting kinematic and kinetic parameters of limb movements, BCIs that predict electromyographic activity of muscles are being developed (Santucci et al. 2005). Such BCIs could be used in neuroprosthetic devices that restore mobility in paralyzed limbs by electrical stimulation of muscles.
- Carmena, J.M., Lebedev, M.A., Crist, R.E., O’Doherty, J.E., Santucci, D.M., Dimitrov, D.F., Patil, P.G., Henriquez, C.S., Nicolelis, M.A.L. (2003) Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biology, 1: 193-208.
- Fetz E.E., Baker M.A. (1973) Operantly conditioned patterns on precentral unit activity and correlated responses in adjacent cells and contralateral muscles. J Neurophysiol. Mar;36(2):179-204.
- Kennedy, P.R., Bakay R.A. (1998) Restoration of neural output from a paralyzed patient by a direct brain connection. Neuroreport. Jun 1;9(8):1707-11.
- Lebedev, M.A., Carmena, J.M., O’Doherty, J.E., Zacksenhouse, M., Henriquez, C.S., Principe, J.C., Nicolelis, M.A.L. (2005) Cortical ensemble adaptation to represent actuators controlled by a brain machine interface. J. Neurosci. 25: 4681-4693.
- Musallam S, Corneil BD, Greger B, Scherberger H, Andersen RA (2004) Cognitive control signals for neural prosthetics. Science 305: 258-262.
- Santucci, D.M., Kralik, J.D., Lebedev , M.A., Nicolelis, M.A.L. (2005) Frontal and parietal cortical ensembles predict single-trial muscle activity during reaching movements. Eur. J. Neurosci., 22: 1529-1540.
- Serruya MD, Hatsopoulos NG, Paninski L, Fellows MR, Donoghue JP (2002) Instant neural control of a movement signal. Nature 416: 141-142.
- Taylor DM, Tillery SI, Schwartz AB (2002) Direct cortical control of 3D neuroprosthetic devices. Science 296: 1829-1832.
- Wessberg J, Stambaugh CR, Kralik JD, Beck PD, Laubach M, Chapin JK, Kim J, Biggs SJ, Srinivasan MA, Nicolelis MA. (2000) Real-time prediction of hand trajectory by ensembles of cortical neurons in primates. Nature 16: 361-365.
Human BCI research
There have also been experiments in humans utilizing modern invasive and non-invasive neuroimaging technologies as interfaces. The most commonly studied potential interface for humans has been electroencephalography (EEG), mainly due to its fine temporal resolution, ease of use, portability, and cost of set-up. However practical use of EEG as a BCI requires a great deal of user training and is highly susceptible to noise. In 2004 scientists of the Fraunhofer Society utilized neural networks to shift the learning phase from the user to the computer and thus recorded noticeable results within 30 minutes of training. Magnetoencephalography (MEG) and even functional magnetic resonance imaging (fMRI) have both been used successfully as rudimentary BCIs, in the latter case allowing two users being scanned in real-time to play Pong against one another by altering their haemodynamic response through various biofeedback techniques.
Matt Nagle is one of the first people to use a direct brain-computer interface to restore functionality lost due to paralysis.
There has been great success in using cochlear implants in humans as a treatment for non-congenital deafness. There is also promising research in vision science indicating retinal implants may some day prove to be similarly successful in treating non-congenital blindness. Outside the realm of treatment, there has also been success in reconstructing an individual's view of a visual scene from the electrical impulses recorded from that person's visual cortex. One purpose of motor neuroprosthetics would be to restore independent control of the body and assistive devices to individuals with paralysis due to a variety of causes including spinal cord injury, amyotrophic lateral sclerosis, muscular dystrophy, multiple sclerosis, spinal muscular atrophy, certain cerebellar disorders and certain types of stroke.
Theme in fiction
Direct neural interface devices were the prominent feature of the popular Matrix film series, wherein humanity was enslaved by artificially intelligent robots in a virtual world piped directly into people's brains by true Immersive Virtual Reality apparatus. These interfaces are an extremely common element of cyberpunk fiction, often characterised as "control of hardware at speed of thought". In the meme wars novels of John Barnes, direct mind-computer interface permits the emergence of a hegemonic collective mind called One True.
Brain-computer interfacing is a particularly notable feature of these science fiction stories:
- Gridlinked by Neal Asher
- the "Culture" novels and stories of Iain M. Banks
- Eon by Greg Bear (and sequels)
- "Learning to Be Me" (short story) by Greg Egan
- This Alien Shore by C.S. Friedman
- Neuromancer by William Gibson, and other Cyberpunk novels
- The Night's Dawn Trilogy by Peter F. Hamilton
- Altered Carbon by Richard Morgan
- Accelerando by Charles Stross (see also exocortex)
- Aristoi by Walter Jon Williams
and these anime stories:
- Angelic Layer
- The Ghost in the Shell manga and related anime
- Neon Genesis Evangelion
- Serial Experiments Lain
- Technologies: Brain implant, Cyberware, Neuroprosthetics, Neurotechnology
- Scientific Phenomena: Cortical plasticity, Frey effect, Neural ensemble
- Disciplines: Cognitive Science, NBIC, Neural engineering, Neuroscience
- Researchers: Joseph O'Doherty, Mikhail Lebedev, Miguel Nicolelis, List of scientists developing brain-computer interfaces
- Speculative: Exocortex, Mind transfer, Whole-body transplant
- Other: Human enhancement, Mind control, Neurohacking
- R.T.Mihran, F.S.Barnes, H.Wachtel: Temporally-Specific Modification of Myelinated Axon Excitability in vitro Following A Single Ultrasound Pulse, Ultrasound in Medicine & Biology, Vol.16, No.3, pp.297-309, 1990
- J.Edrich and T.Zhang: Ultrasonically Focused Neuromagnetic Stimulation, Proceeding of the Annual Conference on Engineering in Medicine and Biology, v15. pt3, pp.1253-1254,1993
- D.Dalecki, S.Z.Child, C.H.Raemanand E.Carlstensen: Tactile perception of ultrasound, Journal of acoustical society of America, pp3165-3170,1995
- L.R.Gavrilov, E.M.Tsirulnikov, I.AB.I.Davies ：Application of Focused Ultrasound for The Stimulation of Neural Structures, Ultrasound in Medicine & Biology,Vol.22,No2, pp.179-192,1996
- Ginsberg, K.S., J.C. Lin, S. Murphy, and M.F. Lin, Microwave Effect On Input Resistance And Action Potential Firing Of Snail Neurons, IEEE Trans. Biomed. Eng., Vol. 39, pp. 1011-1021, 1992.
- Lin, J.C. and Charles C. Thomas, Microwave Auditory Effects And Applications, Publisher, Springfield, IL 1978, 221 pp.
- Guy, A.W. and J.C. Lin and F.A. Harris, The Effect of Microwave Radiation on Evoked Tactile and Auditory CNS Responses in Cats, International Microwave Symp., Ottawa, Canada, May 1972.
- Taylor, E.M., A.W. Guy, B. Ashleman and J.C. Lin, Microwave Effects on Central Nervous System Attributed to Thermal Factors, IEEE G-MTT Int. Microwave Symp., Univ. of Colo., Boulder, CO, June 1973.
- Guy, A.W., E.M. Taylor, B. Ashleman and J.C. Lin, Microwave Interaction with the Auditory Systems of Humans and Cats, IEEE G-MTT Int. Microwave Symp., Univ. of Colo., Boulder, CO, June 1973.
- Guy, A.W., C.K. Chou, J.C. Lin and D. Christensen, Microwave Induced Acoustic Effects in Mammalian Auditory Systems and Physical Materials, N.Y. Acad. Sci. Conf. Biol. Effects of Nonionizing Radiation, New York, Feb. 1974.
- Caldwell, L.R., J.C. Lin and A.W. Guy, Behavioral Changes of Rats Exposed to Microwave Radiation, IEEE S-MTT International Symp., Atlanta, GA, June 1974.
- Lin, J.C. and J. Salinger, Microwave Measurement of Respiration, IEEE S-MTT International Microwave Symp., Palo Alto, CA, May 1975.
- Lin, J.C. and C.K. Lam, A Theoretical Study of Microwave Generated Auditory Phenomena in Mammalian Cranial Structures, USNC/URSI - Biological Effects Series, Boulder, CO, Oct. 1975.
- Wu, C.L. and J.C. Lin, Interaction of Modulated Electromagnetic Fields with Nervous Structures, USNC/URSI - Biological Effects Series, Boulder, CO, Oct. 1975.
- Lin, J.C., Predicted Frequency and Threshold of Microwave-Induced Auditory Sensation, USNC/URSI - Biological Effects Series, Amherst, MA, Oct. 1976.
- Lin, J.C., E. Dawe and J. Majcherek, A Noninvasive Microwave Apnea Detector, San Diego Biomedical Symp., San Diego, CA, Feb 1977.
- Lin, J.C., R.J. Meltzer and F.K. Redding, Microwave Evoked Potentials in Cats, San Diego Biomedical Symposium, San Diego, CA, Feb. 1978.
- Lin, J.C., R.J. Meltzer and F.K. Redding, Characteristics of Microwave Auditory Effects: Theory and Experiments, URSI Open Symp. on Biological Effects of Electromagnetic Waves, Helsinki, Finland, August 1978.
- Nefcy, P.M. and J.C. Lin, A Model for Auditory Evoked Potentials, Annual Conf. on Engg. in Medicine and Biology, Atlanta, Georgia, Oct. 1978.
- Arber, S.L., J.C. Lin, Microwave Effects on Helix Asperse Neurons, Fourth Ann. Mtg. Bioelectromagnetics Soc., Los Angeles, CA, June 1982.
- Lin, J.C., S.L. Arber, Response of Snail Nerve Cells to Noise Modulated Microwave Field, Fourth Ann. Mtg. Bioelectromagnetic Soc., Los Angeles, CA, 1982.
- Arber, S.L. and J.C. Lin, Role of External Calcium in Microwave-Induced Snail Neuron Response, Fifth Ann. Scientific Session Bioelectromagnetic Soc., Boulder, CO, June 1983.
- Neilly, J.P., V. Kriho, S.L. Arber and J.C. Lin, Ultrastructural Studies of Microwave Irradiated Snail Nerve Cells, Fifth Ann. Scientific Session Bioelectromagnetics Soc., Boulder, CO, June 1983.
- Ma, Y.C., J.C. Lin, W.D. O'Neill and S. Arber, Real Time Processing of Neuronal Response to Microwave, IEEE Engg. Medicine Biol. Conf., Los Angeles, CA, September 1984.
- Popovic, M.A., K.H. Chan and J.C. Lin, Microprocessor Based Non-Contact Heart Rate/Respiration Monitor, IEEE Eng. Medicine Biol. Conf., Los Angeles, CA, September 1984.
- Lin, J.C., Electromagnetic Interaction with Nervous System Structure and Function, IEEE Engg. in Biology Conf., Chicago, IL, September 1985.
- Lin, J.C., J.L. Su and Y. Wang, Measurement of Microwave-Induced Thermoelastic Pressure Wave Propagation in Cat Brains, Ann. Meeting of the Bioelectromagnetic Society, Madison, WI June 1986.
- Lin, J.C. W.D. O'Neill, A. Field and K. Ginsburg, Pulsed High Power Microwave Effects on Spontaneous Firing Activities of Snail Neurons, BEMS Ninth Annual Meeting, Portland, Oregon, June 1987.
- Ginsburg, K., J.C. Lin and W.D. O'Neill, Microwave Effects on Spiking Statistics of Single Neurons, BEMS Ninth Annual Meeting Program, Portland, Oregon, June 1987.
- BCI work on Humans
- International BCI platform
- An article about a non-invasive device that allows crude vision without use of the eyes
- Non-invasive BCI for seeing through the ears
- Article regarding Nicolelis' work on BCIs in monkeys
- Article about a rat brain in a dish flying a flight simulator
- Article about fMRI Pong
- PDF file from Dr. Yang Dan's website on her work reconstructing natural scenes from LGN impulses
- Lymnaea stagnalis and the development of neuroelectronic technologies
- Constraining the connectivity of neuronal networks cultured on microelectrode arrays with microfluidic techniques: A step towards neuron-based functional chips.
- Brain Computer Interface Lab at Purdue University
|This page uses Creative Commons Licensed content from Wikipedia (view authors).|