How thoughts influence what the eyes see

It depends, of course, on whether you’re making a hearty winter stew or getting ready to watch the Super Bowl.

Most scientists agree that categorizing an object — like thinking of a carrot as either a root vegetable or a party snack — is the job of the prefrontal cortex, the brain region responsible for reasoning and other high-level functions that make us smart and social. In that account, the eyes and visual regions of the brain are kind of like a security camera collecting data and processing it in a standardized way before passing it off for analysis.

However, a new study led by biomedical engineer and neuroscientist Nuttida Rungratsameetaweemana, an assistant professor at Columbia Engineering, shows that the brain’s visual regions play an active role in making sense of information. Crucially, the way it interprets the information depends on what the rest of the brain is working on.

If it’s Super Bowl Sunday, the visual system sees those carrots on a veggie tray before the prefrontal cortex knows they exist.

Published April 11 in Nature Communications, the study provides some of the clearest evidence yet that early sensory systems play a role in decision-making — and that they adapt in real-time. It also points to new approaches for designing AI systems that can adapt to new or unexpected situations.