Skip to main content

Mountain splendor? Scientists know where your eyes will look

Mountain splendor? Scientists know where your eyes will look :


The top row shows images that our participants viewed in the fMRI scanner. The bottom row shows neural reconstructions from the participants' brain activity that predict where people will direct their eyes, overlaid on top of the images. Note that just the colored overlay predicting eye movements is reconstructed from brain activity and not the image underlay. The brighter white and pink areas in the reconstructions show where people directed their attention.

Using precise brain measurements, Yale researchers predicted how people's eyes move when viewing natural scenes, an advance in understanding the human visual system that can improve a host of artificial intelligence efforts, such as the development of driverless cars, said the researchers.
"We are visual beings and knowing how the brain rapidly computes where to look is fundamentally important," said Yale's Marvin Chun, Richard M. Colgate Professor of Psychology, professor of neuroscience and co-author of new research published Dec. 4 in the journal Nature Communications.
Eye movements have been extensively studied, and researchers can tell with some certainty where a gaze will be directed at different elements in the environment. What hasn't been understood is how the brain orchestrates this ability, which is so fundamental to survival.
In a previous example of "mind reading," Chun's group successfully reconstructed facial images viewed while people were scanned in an MRI machine, based on their brain imaging data alone.
In the new paper, Chun and lead author Thomas P. O'Connell took a similar approach and showed that by analyzing the brain responses to complex, natural scenes, they could predict where people would direct their attention and gaze. This was made possible by analyzing the brain data with deep convolutional neural networks -- models that are extensively used in artificial intelligence (AI).
"The work represents a perfect marriage of neuroscience and data science," Chun said.
The findings have a myriad of potential applications -- such as testing competing artificial intelligence systems that categorize images and guide driverless cars.
"People can see better than AI systems can," Chun said. "Understanding how the brain performs its complex calculations is an ultimate goal of neuroscience and benefits AI efforts."

Comments

Post a Comment

Popular posts from this blog

Size matters: New data reveals cell size sparks genome awakening in embryos

Transitions are a hallmark of life. When dormant plants flower in the spring or when a young adult strikes out on their own, there is a shift in control. Similarly, there is a transition during early development when an embryo undergoes biochemical changes, switching from being controlled by maternal molecules to being governed by its own genome. For the first time, a team from the Perelman School of Medicine at the University of Pennsylvania found in an embryo that activation of its genome does not happen all at once, instead it follows a specific pattern controlled primarily by the various sizes of its cells. The researchers published their results this week as the cover story in  Developmental Cell . In an early embryo undergoing cell division, maternally loaded RNA and proteins regulate the cell cycle. The genomes of the zygote -- a term for the fertilized egg -- are initially in sleep mode. However, at a point in the early life of the embryo, these zygotic nuclei "wake...
Post a Comment
Read more

Home births as safe as hospital births: International study suggests

A large international study led by McMaster University shows that low risk pregnant women who intend to give birth at home have no increased chance of the baby's perinatal or neonatal death compared to other low risk women who intend to give birth in a hospital. The results have been published by  The Lancet 's  EClinicalMedicine  journal. "More women in well-resourced countries are choosing birth at home, but concerns have persisted about their safety," said Eileen Hutton, professor emeritus of obstetrics and gynecology at McMaster, founding director of the McMaster Midwifery Research Centre and first author of the paper. "This research clearly demonstrates the risk is no different when the birth is intended to be at home or in hospital." The study examined the safety of place of birth by reporting on the risk of death at the time of birth or within the first four weeks, and found no clinically important or statistically different risk between home...
Post a Comment
Read more

Molecular adlayer produced by dissolving water-insoluble nanographene in water

Molecular adlayer produced by dissolving water-insoluble nanographene in water : "Nanographene incorporated micelle capsules" can be prepared by simply pulverizing and mixing nanographene with amphiphilic V-shaped anthracene molecules in water at room temperature. Even though nanographene is insoluble in water and organic solvents, Kumamoto University (KU) and Tokyo Institute of Technology (Tokyo Tech) researchers have found a way to dissolve it in water. Using "molecular containers" that encapsulate water-insoluble molecules, the researchers developed a formation procedure for a nanographene adlayer, a layer that chemically interacts with the underlying substance, by just mixing the molecular containers and nanographene together in water. The method is expected to be useful for the fabrication and analysis of next-generation functional nanomaterials. Graphene is a single layer of carbon atoms arranged in sheet form. It is lighter than metal wit...
Post a Comment
Read more