Time course of visual perception: Coarse-to-fine processing and beyond

Research output: Contribution to journalReview article

162 Citations (Scopus)

Abstract

Our perception of a visual scene changes rapidly in time, even when the scene itself does not. It is increasingly clear that understanding how the visual percept changes in time is crucial to understanding how we see. We are still far from fully understanding the temporal changes in the visual percept and the neural mechanisms that underlie it. But recently, many disparate lines of evidence are beginning to converge to produce a complex but fuzzy picture of visual temporal dynamics. It is clear, largely from psychophysical studies in humans, that one can get the 'gist' of complex visual scenes within about 150 ms after the stimulus onset, even when the stimulus itself is presented as briefly as 10 ms or so. It generally takes longer processing, if not longer stimulus presentation, to identify individual objects. It may take even longer for a fuller semantic understanding, or awareness, of the scene to emerge and be encoded in short-term memory. Microelectrode recording studies in monkeys, along with neuroimaging studies mostly in humans, have elucidated many important temporal dynamic phenomena at the level of individual neurons and neuronal populations. Many of the temporal changes at the perceptual and the neural levels can be captured by the multifaceted and somewhat ambiguous concept of coarse-to-fine processing, although it is clear that not all temporal changes can be characterized this way. A more comprehensive, albeit unproven, alternative framework for understanding visual temporal dynamics is to view it as a sequential, Bayesian decision-making process. At each step, the visual system infers the likely nature visual scene by jointly evaluating the available processed image information and prior knowledge about the scene, including prior inferences. Whether the processing proceeds in a coarse-to-fine fashion depends largely on whether the underlying computations are hierarchical or not. Characterizing these inferential steps from the computational, perceptual and neural standpoints will be a key part of future work in this emerging field.

Original languageEnglish (US)
Pages (from-to)405-439
Number of pages35
JournalProgress in Neurobiology
Volume84
Issue number4
DOIs
StatePublished - Apr 1 2008
Externally publishedYes

Fingerprint

Visual Perception
Naphazoline
Microelectrodes
Short-Term Memory
Semantics
Neuroimaging
Haplorhini
Decision Making
Neurons

Keywords

  • Adaptive filtering
  • Awareness
  • Bayesian inference
  • Decorrelation
  • Feed-forward
  • Feedback
  • Fine-to-coarse
  • Global-to-local
  • Hierarchical coding
  • Hypothesis testing
  • Lateralization
  • Masking
  • Microgenesis
  • Natural vision
  • Perceptual learning
  • Plasticity
  • Priming
  • Recurrent/reentrant processing
  • Sequential decision-making

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Time course of visual perception : Coarse-to-fine processing and beyond. / Hegde, Jay.

In: Progress in Neurobiology, Vol. 84, No. 4, 01.04.2008, p. 405-439.

Research output: Contribution to journalReview article

@article{97a9f02b8fc942618f543ef5ea9fc05e,
title = "Time course of visual perception: Coarse-to-fine processing and beyond",
abstract = "Our perception of a visual scene changes rapidly in time, even when the scene itself does not. It is increasingly clear that understanding how the visual percept changes in time is crucial to understanding how we see. We are still far from fully understanding the temporal changes in the visual percept and the neural mechanisms that underlie it. But recently, many disparate lines of evidence are beginning to converge to produce a complex but fuzzy picture of visual temporal dynamics. It is clear, largely from psychophysical studies in humans, that one can get the 'gist' of complex visual scenes within about 150 ms after the stimulus onset, even when the stimulus itself is presented as briefly as 10 ms or so. It generally takes longer processing, if not longer stimulus presentation, to identify individual objects. It may take even longer for a fuller semantic understanding, or awareness, of the scene to emerge and be encoded in short-term memory. Microelectrode recording studies in monkeys, along with neuroimaging studies mostly in humans, have elucidated many important temporal dynamic phenomena at the level of individual neurons and neuronal populations. Many of the temporal changes at the perceptual and the neural levels can be captured by the multifaceted and somewhat ambiguous concept of coarse-to-fine processing, although it is clear that not all temporal changes can be characterized this way. A more comprehensive, albeit unproven, alternative framework for understanding visual temporal dynamics is to view it as a sequential, Bayesian decision-making process. At each step, the visual system infers the likely nature visual scene by jointly evaluating the available processed image information and prior knowledge about the scene, including prior inferences. Whether the processing proceeds in a coarse-to-fine fashion depends largely on whether the underlying computations are hierarchical or not. Characterizing these inferential steps from the computational, perceptual and neural standpoints will be a key part of future work in this emerging field.",
keywords = "Adaptive filtering, Awareness, Bayesian inference, Decorrelation, Feed-forward, Feedback, Fine-to-coarse, Global-to-local, Hierarchical coding, Hypothesis testing, Lateralization, Masking, Microgenesis, Natural vision, Perceptual learning, Plasticity, Priming, Recurrent/reentrant processing, Sequential decision-making",
author = "Jay Hegde",
year = "2008",
month = "4",
day = "1",
doi = "10.1016/j.pneurobio.2007.09.001",
language = "English (US)",
volume = "84",
pages = "405--439",
journal = "Progress in Neurobiology",
issn = "0301-0082",
publisher = "Elsevier Limited",
number = "4",

}

TY - JOUR

T1 - Time course of visual perception

T2 - Coarse-to-fine processing and beyond

AU - Hegde, Jay

PY - 2008/4/1

Y1 - 2008/4/1

N2 - Our perception of a visual scene changes rapidly in time, even when the scene itself does not. It is increasingly clear that understanding how the visual percept changes in time is crucial to understanding how we see. We are still far from fully understanding the temporal changes in the visual percept and the neural mechanisms that underlie it. But recently, many disparate lines of evidence are beginning to converge to produce a complex but fuzzy picture of visual temporal dynamics. It is clear, largely from psychophysical studies in humans, that one can get the 'gist' of complex visual scenes within about 150 ms after the stimulus onset, even when the stimulus itself is presented as briefly as 10 ms or so. It generally takes longer processing, if not longer stimulus presentation, to identify individual objects. It may take even longer for a fuller semantic understanding, or awareness, of the scene to emerge and be encoded in short-term memory. Microelectrode recording studies in monkeys, along with neuroimaging studies mostly in humans, have elucidated many important temporal dynamic phenomena at the level of individual neurons and neuronal populations. Many of the temporal changes at the perceptual and the neural levels can be captured by the multifaceted and somewhat ambiguous concept of coarse-to-fine processing, although it is clear that not all temporal changes can be characterized this way. A more comprehensive, albeit unproven, alternative framework for understanding visual temporal dynamics is to view it as a sequential, Bayesian decision-making process. At each step, the visual system infers the likely nature visual scene by jointly evaluating the available processed image information and prior knowledge about the scene, including prior inferences. Whether the processing proceeds in a coarse-to-fine fashion depends largely on whether the underlying computations are hierarchical or not. Characterizing these inferential steps from the computational, perceptual and neural standpoints will be a key part of future work in this emerging field.

AB - Our perception of a visual scene changes rapidly in time, even when the scene itself does not. It is increasingly clear that understanding how the visual percept changes in time is crucial to understanding how we see. We are still far from fully understanding the temporal changes in the visual percept and the neural mechanisms that underlie it. But recently, many disparate lines of evidence are beginning to converge to produce a complex but fuzzy picture of visual temporal dynamics. It is clear, largely from psychophysical studies in humans, that one can get the 'gist' of complex visual scenes within about 150 ms after the stimulus onset, even when the stimulus itself is presented as briefly as 10 ms or so. It generally takes longer processing, if not longer stimulus presentation, to identify individual objects. It may take even longer for a fuller semantic understanding, or awareness, of the scene to emerge and be encoded in short-term memory. Microelectrode recording studies in monkeys, along with neuroimaging studies mostly in humans, have elucidated many important temporal dynamic phenomena at the level of individual neurons and neuronal populations. Many of the temporal changes at the perceptual and the neural levels can be captured by the multifaceted and somewhat ambiguous concept of coarse-to-fine processing, although it is clear that not all temporal changes can be characterized this way. A more comprehensive, albeit unproven, alternative framework for understanding visual temporal dynamics is to view it as a sequential, Bayesian decision-making process. At each step, the visual system infers the likely nature visual scene by jointly evaluating the available processed image information and prior knowledge about the scene, including prior inferences. Whether the processing proceeds in a coarse-to-fine fashion depends largely on whether the underlying computations are hierarchical or not. Characterizing these inferential steps from the computational, perceptual and neural standpoints will be a key part of future work in this emerging field.

KW - Adaptive filtering

KW - Awareness

KW - Bayesian inference

KW - Decorrelation

KW - Feed-forward

KW - Feedback

KW - Fine-to-coarse

KW - Global-to-local

KW - Hierarchical coding

KW - Hypothesis testing

KW - Lateralization

KW - Masking

KW - Microgenesis

KW - Natural vision

KW - Perceptual learning

KW - Plasticity

KW - Priming

KW - Recurrent/reentrant processing

KW - Sequential decision-making

UR - http://www.scopus.com/inward/record.url?scp=41149143520&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=41149143520&partnerID=8YFLogxK

U2 - 10.1016/j.pneurobio.2007.09.001

DO - 10.1016/j.pneurobio.2007.09.001

M3 - Review article

C2 - 17976895

AN - SCOPUS:41149143520

VL - 84

SP - 405

EP - 439

JO - Progress in Neurobiology

JF - Progress in Neurobiology

SN - 0301-0082

IS - 4

ER -