• We are sorry, but NCBI web applications do not support your browser and may not function properly. More information
Logo of transbhomepageaboutsubmitalertseditorial board
Philos Trans R Soc Lond B Biol Sci. Aug 29, 2002; 357(1424): 987–1001.
PMCID: PMC1693013

The temporal resolution of neural codes: does response latency have a unique role?


This article reviews the nature of the neural code in non-human primate cortex and assesses the potential for neurons to carry two or more signals simultaneously. Neurophysiological recordings from visual and motor systems indicate that the evidence for a role for precisely timed spikes relative to other spike times (ca. 1-10 ms resolution) is inconclusive. This indicates that the visual system does not carry a signal that identifies whether the responses were elicited when the stimulus was attended or not. Simulations show that the absence of such a signal reduces, but does not eliminate, the increased discrimination between stimuli that are attended compared with when the stimuli are unattended. The increased accuracy asymptotes with increased gain control, indicating limited benefit from increasing attention. The absence of a signal identifying the attentional state under which stimuli were viewed can produce the greatest discrimination between attended and unattended stimuli. Furthermore, the greatest reduction in discrimination errors occurs for a limited range of gain control, again indicating that attention effects are limited. By contrast to precisely timed patterns of spikes where the timing is relative to other spikes, response latency provides a fine temporal resolution signal (ca. 10 ms resolution) that carries information that is unavailable from coarse temporal response measures. Changes in response latency and changes in response magnitude can give rise to different predictions for the patterns of reaction times. The predictions are verified, and it is shown that the standard method for distinguishing executive and slave processes is only valid if the representations of interest, as evidenced by the neural code, are known. Overall, the data indicate that the signalling evident in neural signals is restricted to the spike count and the precise times of spikes relative to stimulus onset (response latency). These coding issues have implications for our understanding of cognitive models of attention and the roles of executive and slave systems.

Full Text

The Full Text of this article is available as a PDF (486K).

Selected References

These references are in PubMed. This may not be the complete list of references from this article.
  • Abbott LF, Dayan P. The effect of correlated variability on the accuracy of a population code. Neural Comput. 1999 Jan 1;11(1):91–101. [PubMed]
  • Abeles M, Gerstein GL. Detecting spatiotemporal firing patterns among simultaneously recorded single neurons. J Neurophysiol. 1988 Sep;60(3):909–924. [PubMed]
  • Abeles M, Bergman H, Margalit E, Vaadia E. Spatiotemporal firing patterns in the frontal cortex of behaving monkeys. J Neurophysiol. 1993 Oct;70(4):1629–1638. [PubMed]
  • Aertsen AM, Gerstein GL, Habib MK, Palm G. Dynamics of neuronal firing correlation: modulation of "effective connectivity". J Neurophysiol. 1989 May;61(5):900–917. [PubMed]
  • Baddeley R, Abbott LF, Booth MC, Sengpiel F, Freeman T, Wakeman EA, Rolls ET. Responses of neurons in primary and inferior temporal visual cortices to natural scenes. Proc Biol Sci. 1997 Dec 22;264(1389):1775–1783. [PMC free article] [PubMed]
  • Baker SN, Lemon RN. Precise spatiotemporal repeating patterns in monkey primary and supplementary motor areas occur at chance levels. J Neurophysiol. 2000 Oct;84(4):1770–1780. [PubMed]
  • Baker SN, Spinks R, Jackson A, Lemon RN. Synchronization in monkey motor cortex during a precision grip task. I. Task-dependent modulation in single-unit synchrony. J Neurophysiol. 2001 Feb;85(2):869–885. [PubMed]
  • Berry MJ, 2nd, Meister M. Refractoriness and neural precision. J Neurosci. 1998 Mar 15;18(6):2200–2211. [PubMed]
  • Berry MJ, Warland DK, Meister M. The structure and precision of retinal spike trains. Proc Natl Acad Sci U S A. 1997 May 13;94(10):5411–5416. [PMC free article] [PubMed]
  • Bradley A, Skottun BC, Ohzawa I, Sclar G, Freeman RD. Visual orientation and spatial frequency discrimination: a comparison of single neurons and behavior. J Neurophysiol. 1987 Mar;57(3):755–772. [PubMed]
  • Britten KH, Shadlen MN, Newsome WT, Movshon JA. Responses of neurons in macaque MT to stochastic motion signals. Vis Neurosci. 1993 Nov-Dec;10(6):1157–1169. [PubMed]
  • Brody CD. Disambiguating different covariation types. Neural Comput. 1999 Oct 1;11(7):1527–1535. [PubMed]
  • Brody CD. Correlations without synchrony. Neural Comput. 1999 Oct 1;11(7):1537–1551. [PubMed]
  • Buracas GT, Zador AM, DeWeese MR, Albright TD. Efficient discrimination of temporal patterns by motion-sensitive neurons in primate visual cortex. Neuron. 1998 May;20(5):959–969. [PubMed]
  • Busey TA, Loftus GR. Sensory and cognitive components of visual information acquisition. Psychol Rev. 1994 Jul;101(3):446–469. [PubMed]
  • Chelazzi L, Miller EK, Duncan J, Desimone R. A neural basis for visual search in inferior temporal cortex. Nature. 1993 May 27;363(6427):345–347. [PubMed]
  • Dayhoff JE, Gerstein GL. Favored patterns in spike trains. I. Detection. J Neurophysiol. 1983 Jun;49(6):1334–1348. [PubMed]
  • Dayhoff JE, Gerstein GL. Favored patterns in spike trains. II. Application. J Neurophysiol. 1983 Jun;49(6):1349–1363. [PubMed]
  • Desimone R, Duncan J. Neural mechanisms of selective visual attention. Annu Rev Neurosci. 1995;18:193–222. [PubMed]
  • Engel AK, König P, Kreiter AK, Schillen TB, Singer W. Temporal coding in the visual cortex: new vistas on integration in the nervous system. Trends Neurosci. 1992 Jun;15(6):218–226. [PubMed]
  • Eskandar EN, Richmond BJ, Optican LM. Role of inferior temporal neurons in visual memory. I. Temporal encoding of information about visual images, recalled images, and behavioral context. J Neurophysiol. 1992 Oct;68(4):1277–1295. [PubMed]
  • Eskandar EN, Optican LM, Richmond BJ. Role of inferior temporal neurons in visual memory. II. Multiplying temporal waveforms related to vision and memory. J Neurophysiol. 1992 Oct;68(4):1296–1306. [PubMed]
  • Fuster JM. Inferotemporal units in selective visual attention and short-term memory. J Neurophysiol. 1990 Sep;64(3):681–697. [PubMed]
  • Gawne TJ, Kjaer TW, Richmond BJ. Latency: another potential code for feature binding in striate cortex. J Neurophysiol. 1996 Aug;76(2):1356–1360. [PubMed]
  • Gershon ED, Wiener MC, Latham PE, Richmond BJ. Coding strategies in monkey V1 and inferior temporal cortices. J Neurophysiol. 1998 Mar;79(3):1135–1144. [PubMed]
  • Hanes DP, Schall JD. Neural control of voluntary movement initiation. Science. 1996 Oct 18;274(5286):427–430. [PubMed]
  • Heller J, Hertz JA, Kjaer TW, Richmond BJ. Information flow and temporal coding in primate pattern vision. J Comput Neurosci. 1995 Sep;2(3):175–193. [PubMed]
  • Lee D, Port NL, Kruse W, Georgopoulos AP. Variability and correlated noise in the discharge of neurons in motor and parietal areas of the primate cortex. J Neurosci. 1998 Feb 1;18(3):1161–1170. [PubMed]
  • Lestienne R, Strehler BL. Time structure and stimulus dependence of precisely replicating patterns present in monkey cortical neuronal spike trains. Brain Res. 1987 Dec 29;437(2):214–238. [PubMed]
  • Lestienne R, Tuckwell HC. The significance of precisely replicating patterns in mammalian CNS spike trains. Neuroscience. 1998 Jan;82(2):315–336. [PubMed]
  • Levine MW, Troy JB. The variability of the maintained discharge of cat dorsal lateral geniculate cells. J Physiol. 1986 Jun;375:339–359. [PMC free article] [PubMed]
  • Loftus GR, Ruthruff E. A theory of visual information acquisition and visual memory with special application to intensity-duration trade-offs. J Exp Psychol Hum Percept Perform. 1994 Feb;20(1):33–49. [PubMed]
  • Lueschow A, Miller EK, Desimone R. Inferior temporal mechanisms for invariant object recognition. Cereb Cortex. 1994 Sep-Oct;4(5):523–531. [PubMed]
  • McClurkin JW, Optican LM, Richmond BJ, Gawne TJ. Concurrent processing and complexity of temporally encoded neuronal messages in visual perception. Science. 1991 Aug 9;253(5020):675–677. [PubMed]
  • McClurkin JW, Gawne TJ, Optican LM, Richmond BJ. Lateral geniculate neurons in behaving primates. II. Encoding of visual information in the temporal shape of the response. J Neurophysiol. 1991 Sep;66(3):794–808. [PubMed]
  • McClurkin JW, Gawne TJ, Richmond BJ, Optican LM, Robinson DL. Lateral geniculate neurons in behaving primates. I. Responses to two-dimensional stimuli. J Neurophysiol. 1991 Sep;66(3):777–793. [PubMed]
  • Maynard EM, Hatsopoulos NG, Ojakangas CL, Acuna BD, Sanes JN, Normann RA, Donoghue JP. Neuronal interactions improve cortical population coding of movement direction. J Neurosci. 1999 Sep 15;19(18):8083–8093. [PubMed]
  • Mel B, Fiser J. Minimizing binding errors using learned conjunctive features. Neural Comput. 2000 Feb;12(2):247–278. [PubMed]
  • Moran J, Desimone R. Selective attention gates visual processing in the extrastriate cortex. Science. 1985 Aug 23;229(4715):782–784. [PubMed]
  • Motter BC. Neural correlates of attentive selection for color or luminance in extrastriate area V4. J Neurosci. 1994 Apr;14(4):2178–2189. [PubMed]
  • Opara R, Wörgötter F. Using visual latencies to improve image segmentation. Neural Comput. 1996 Oct 1;8(7):1493–1520. [PubMed]
  • Optican LM, Richmond BJ. Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. III. Information theoretic analysis. J Neurophysiol. 1987 Jan;57(1):162–178. [PubMed]
  • Oram MW, Perrett DI. Time course of neural responses discriminating different views of the face and head. J Neurophysiol. 1992 Jul;68(1):70–84. [PubMed]
  • Oram MW, Perrett DI. Integration of form and motion in the anterior superior temporal polysensory area (STPa) of the macaque monkey. J Neurophysiol. 1996 Jul;76(1):109–129. [PubMed]
  • Oram MW, Perrett DI, Hietanen JK. Directional tuning of motion-sensitive cells in the anterior superior temporal polysensory area of the macaque. Exp Brain Res. 1993;97(2):274–294. [PubMed]
  • Oram MW, Földiák P, Perrett DI, Sengpiel F. The 'Ideal Homunculus': decoding neural population signals. Trends Neurosci. 1998 Jun;21(6):259–265. [PubMed]
  • Oram MW, Wiener MC, Lestienne R, Richmond BJ. Stochastic nature of precisely timed spike patterns in visual system neuronal responses. J Neurophysiol. 1999 Jun;81(6):3021–3033. [PubMed]
  • Oram MW, Hatsopoulos NG, Richmond BJ, Donoghue JP. Excess synchrony in motor cortical neurons provides redundant direction information with that from coarse temporal measures. J Neurophysiol. 2001 Oct;86(4):1700–1716. [PubMed]
  • Palm G, Aertsen AM, Gerstein GL. On the significance of correlations among neuronal spike trains. Biol Cybern. 1988;59(1):1–11. [PubMed]
  • Panzeri S, Schultz SR, Treves A, Rolls ET. Correlations and the encoding of information in the nervous system. Proc Biol Sci. 1999 May 22;266(1423):1001–1012. [PMC free article] [PubMed]
  • Perrett DI, Oram MW. Visual recognition based on temporal cortex cells: viewer-centred processing of pattern configuration. Z Naturforsch C. 1998 Jul-Aug;53(7-8):518–541. [PubMed]
  • Perrett DI, Mistlin AJ, Chitty AJ, Smith PA, Potter DD, Broennimann R, Harries M. Specialized face processing and hemispheric asymmetry in man and monkey: evidence from single unit and reaction time studies. Behav Brain Res. 1988 Aug;29(3):245–258. [PubMed]
  • Perrett DI, Oram MW, Ashbridge E. Evidence accumulation in cell populations responsive to faces: an account of generalisation of recognition without mental transformations. Cognition. 1998 Jul;67(1-2):111–145. [PubMed]
  • Prut Y, Vaadia E, Bergman H, Haalman I, Slovin H, Abeles M. Spatiotemporal structure of cortical activity: properties and behavioral relevance. J Neurophysiol. 1998 Jun;79(6):2857–2874. [PubMed]
  • Reich DS, Victor JD, Knight BW, Ozaki T, Kaplan E. Response variability and timing precision of neuronal spike trains in vivo. J Neurophysiol. 1997 May;77(5):2836–2841. [PubMed]
  • Reich DS, Mechler F, Victor JD. Temporal coding of contrast in primary visual cortex: when, what, and why. J Neurophysiol. 2001 Mar;85(3):1039–1050. [PubMed]
  • Reynolds JH, Chelazzi L, Desimone R. Competitive mechanisms subserve attention in macaque areas V2 and V4. J Neurosci. 1999 Mar 1;19(5):1736–1753. [PubMed]
  • Reynolds JH, Pasternak T, Desimone R. Attention increases sensitivity of V4 neurons. Neuron. 2000 Jun;26(3):703–714. [PubMed]
  • Richmond BJ, Sato T. Enhancement of inferior temporal neurons during visual discrimination. J Neurophysiol. 1987 Dec;58(6):1292–1306. [PubMed]
  • Richmond BJ, Optican LM. Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. II. Information transmission. J Neurophysiol. 1990 Aug;64(2):370–380. [PubMed]
  • Richmond BJ, Optican LM, Podell M, Spitzer H. Temporal encoding of two-dimensional patterns by single units in primate inferior temporal cortex. I. Response characteristics. J Neurophysiol. 1987 Jan;57(1):132–146. [PubMed]
  • Richmond BJ, Optican LM, Spitzer H. Temporal encoding of two-dimensional patterns by single units in primate primary visual cortex. I. Stimulus-response relations. J Neurophysiol. 1990 Aug;64(2):351–369. [PubMed]
  • Richmond BJ, Oram MW, Wiener MC. Response features determining spike times. Neural Plast. 1999;6(4):133–145. [PMC free article] [PubMed]
  • Riehle A, Grün S, Diesmann M, Aertsen A. Spike synchronization and rate modulation differentially involved in motor cortical function. Science. 1997 Dec 12;278(5345):1950–1953. [PubMed]
  • Sato T. Effects of attention and stimulus interaction on visual responses of inferior temporal neurons in macaque. J Neurophysiol. 1988 Jul;60(1):344–364. [PubMed]
  • Shadlen MN, Newsome WT. Noise, neural codes and cortical organization. Curr Opin Neurobiol. 1994 Aug;4(4):569–579. [PubMed]
  • Shadlen MN, Newsome WT. Is there a signal in the noise? Curr Opin Neurobiol. 1995 Apr;5(2):248–250. [PubMed]
  • Shadlen MN, Newsome WT. The variable discharge of cortical neurons: implications for connectivity, computation, and information coding. J Neurosci. 1998 May 15;18(10):3870–3896. [PubMed]
  • Singer W, Gray CM. Visual feature integration and the temporal correlation hypothesis. Annu Rev Neurosci. 1995;18:555–586. [PubMed]
  • Snowden RJ, Treue S, Andersen RA. The response of neurons in areas V1 and MT of the alert rhesus monkey to moving random dot patterns. Exp Brain Res. 1992;88(2):389–400. [PubMed]
  • Softky WR, Koch C. The highly irregular firing of cortical cells is inconsistent with temporal integration of random EPSPs. J Neurosci. 1993 Jan;13(1):334–350. [PubMed]
  • Tolhurst DJ, Movshon JA, Dean AF. The statistical reliability of signals in single neurons in cat and monkey visual cortex. Vision Res. 1983;23(8):775–785. [PubMed]
  • Tovée MJ, Rolls ET, Treves A, Bellis RP. Information encoding and the responses of single neurons in the primate temporal visual cortex. J Neurophysiol. 1993 Aug;70(2):640–654. [PubMed]
  • Treisman A. The binding problem. Curr Opin Neurobiol. 1996 Apr;6(2):171–178. [PubMed]
  • Treisman A. Feature binding, attention and object perception. Philos Trans R Soc Lond B Biol Sci. 1998 Aug 29;353(1373):1295–1306. [PMC free article] [PubMed]
  • Treisman AM, Kanwisher NG. Perceiving visually presented objects: recognition, awareness, and modularity. Curr Opin Neurobiol. 1998 Apr;8(2):218–226. [PubMed]
  • Treue S, Maunsell JH. Attentional modulation of visual motion processing in cortical areas MT and MST. Nature. 1996 Aug 8;382(6591):539–541. [PubMed]
  • Treves A, Panzeri S, Rolls ET, Booth M, Wakeman EA. Firing rate distributions and efficiency of information transmission of inferior temporal cortex neurons to natural visual stimuli. Neural Comput. 1999 Apr 1;11(3):601–632. [PubMed]
  • Ullman S, Soloviev S. Computation of pattern invariance in brain-like structures. Neural Netw. 1999 Oct;12(7-8):1021–1036. [PubMed]
  • Vaadia E, Haalman I, Abeles M, Bergman H, Prut Y, Slovin H, Aertsen A. Dynamics of neuronal interactions in monkey cortex in relation to behavioural events. Nature. 1995 Feb 9;373(6514):515–518. [PubMed]
  • Van Rullen R, Gautrais J, Delorme A, Thorpe S. Face processing using one spike per neurone. Biosystems. 1998 Sep-Dec;48(1-3):229–239. [PubMed]
  • Victor JD, Purpura KP. Nature and precision of temporal coding in visual cortex: a metric-space analysis. J Neurophysiol. 1996 Aug;76(2):1310–1326. [PubMed]
  • Villa AE, Bajo Lorenzana VM. Ketamine modulation of the temporal pattern of discharges and spike train interactions in the rat substantia nigra pars reticulata. Brain Res Bull. 1997;43(6):525–535. [PubMed]
  • Vogels R, Spileers W, Orban GA. The response variability of striate cortical neurons in the behaving monkey. Exp Brain Res. 1989;77(2):432–436. [PubMed]
  • von der Malsburg C. Binding in models of perception and brain function. Curr Opin Neurobiol. 1995 Aug;5(4):520–526. [PubMed]
  • von der Malsburg C, Schneider W. A neural cocktail-party processor. Biol Cybern. 1986;54(1):29–40. [PubMed]
  • Wallis G, Rolls ET. Invariant face and object recognition in the visual system. Prog Neurobiol. 1997 Feb;51(2):167–194. [PubMed]
  • Wiener MC, Richmond BJ. Using response models to estimate channel capacity for neuronal classification of stationary visual stimuli using temporal coding. J Neurophysiol. 1999 Dec;82(6):2861–2875. [PubMed]
  • Wiener MC, Oram MW, Liu Z, Richmond BJ. Consistency of encoding in monkey visual cortex. J Neurosci. 2001 Oct 15;21(20):8210–8221. [PubMed]
  • Zhang K, Ginzburg I, McNaughton BL, Sejnowski TJ. Interpreting neuronal population activity by reconstruction: unified framework with application to hippocampal place cells. J Neurophysiol. 1998 Feb;79(2):1017–1044. [PubMed]

Articles from Philosophical Transactions of the Royal Society B: Biological Sciences are provided here courtesy of The Royal Society


Related citations in PubMed

See reviews...See all...

Cited by other articles in PMC

See all...


  • MedGen
    Related information in MedGen
  • PubMed
    PubMed citations for these articles

Recent Activity

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

See more...