Skip to main content

Mountain splendor? Scientists know where your eyes will look

Mountain splendor? Scientists know where your eyes will look :


The top row shows images that our participants viewed in the fMRI scanner. The bottom row shows neural reconstructions from the participants' brain activity that predict where people will direct their eyes, overlaid on top of the images. Note that just the colored overlay predicting eye movements is reconstructed from brain activity and not the image underlay. The brighter white and pink areas in the reconstructions show where people directed their attention.

Using precise brain measurements, Yale researchers predicted how people's eyes move when viewing natural scenes, an advance in understanding the human visual system that can improve a host of artificial intelligence efforts, such as the development of driverless cars, said the researchers.
"We are visual beings and knowing how the brain rapidly computes where to look is fundamentally important," said Yale's Marvin Chun, Richard M. Colgate Professor of Psychology, professor of neuroscience and co-author of new research published Dec. 4 in the journal Nature Communications.
Eye movements have been extensively studied, and researchers can tell with some certainty where a gaze will be directed at different elements in the environment. What hasn't been understood is how the brain orchestrates this ability, which is so fundamental to survival.
In a previous example of "mind reading," Chun's group successfully reconstructed facial images viewed while people were scanned in an MRI machine, based on their brain imaging data alone.
In the new paper, Chun and lead author Thomas P. O'Connell took a similar approach and showed that by analyzing the brain responses to complex, natural scenes, they could predict where people would direct their attention and gaze. This was made possible by analyzing the brain data with deep convolutional neural networks -- models that are extensively used in artificial intelligence (AI).
"The work represents a perfect marriage of neuroscience and data science," Chun said.
The findings have a myriad of potential applications -- such as testing competing artificial intelligence systems that categorize images and guide driverless cars.
"People can see better than AI systems can," Chun said. "Understanding how the brain performs its complex calculations is an ultimate goal of neuroscience and benefits AI efforts."

Comments

Post a Comment

Popular posts from this blog

Home births as safe as hospital births: International study suggests

A large international study led by McMaster University shows that low risk pregnant women who intend to give birth at home have no increased chance of the baby's perinatal or neonatal death compared to other low risk women who intend to give birth in a hospital. The results have been published by  The Lancet 's  EClinicalMedicine  journal. "More women in well-resourced countries are choosing birth at home, but concerns have persisted about their safety," said Eileen Hutton, professor emeritus of obstetrics and gynecology at McMaster, founding director of the McMaster Midwifery Research Centre and first author of the paper. "This research clearly demonstrates the risk is no different when the birth is intended to be at home or in hospital." The study examined the safety of place of birth by reporting on the risk of death at the time of birth or within the first four weeks, and found no clinically important or statistically different risk between home...
Post a Comment
Read more

Dark matter may be older than the Big Bang

Dark matter, which researchers believe make up about 80% of the universe's mass, is one of the most elusive mysteries in modern physics. What exactly it is and how it came to be is a mystery, but a new Johns Hopkins University study now suggests that dark matter may have existed before the Big Bang. The study, published August 7 in  Physical Review Letters , presents a new idea of how dark matter was born and how to identify it with astronomical observations. "The study revealed a new connection between particle physics and astronomy. If dark matter consists of new particles that were born before the Big Bang, they affect the way galaxies are distributed in the sky in a unique way. This connection may be used to reveal their identity and make conclusions about the times before the Big Bang too," says Tommi Tenkanen, a postdoctoral fellow in Physics and Astronomy at the Johns Hopkins University and the study's author. While not much is known about its origins,...
Post a Comment
Read more

Scientists challenge notion of binary sexuality with naming of new plant species

A collaborative team of scientists from the US and Australia has named a new plant species from the remote Outback. Bucknell University biology postdoctoral fellow Angela McDonnell and professor Chris Martine led the description of the plant that had confounded field biologists for decades because of the unusual fluidity of its flower form. The discovery, published in the open access journal  PhytoKeys , offers a powerful example of the diversity of sexual forms found among plants. The new species of bush tomato discovered in remote Australia provides a compelling example of the fact that sexuality among Earth's living creatures is far more diverse -- and interesting -- than many people likely realize. Bucknell University postdoctoral fellow Angela McDonnell and biology professor Chris Martine led the study following an expedition last year to relocate populations of the new plant, which were first noted by Australian botanists during the 1970s. Herbarium specimens from th...
Post a Comment
Read more