Skip to main content

Mountain splendor? Scientists know where your eyes will look

Mountain splendor? Scientists know where your eyes will look :


The top row shows images that our participants viewed in the fMRI scanner. The bottom row shows neural reconstructions from the participants' brain activity that predict where people will direct their eyes, overlaid on top of the images. Note that just the colored overlay predicting eye movements is reconstructed from brain activity and not the image underlay. The brighter white and pink areas in the reconstructions show where people directed their attention.

Using precise brain measurements, Yale researchers predicted how people's eyes move when viewing natural scenes, an advance in understanding the human visual system that can improve a host of artificial intelligence efforts, such as the development of driverless cars, said the researchers.
"We are visual beings and knowing how the brain rapidly computes where to look is fundamentally important," said Yale's Marvin Chun, Richard M. Colgate Professor of Psychology, professor of neuroscience and co-author of new research published Dec. 4 in the journal Nature Communications.
Eye movements have been extensively studied, and researchers can tell with some certainty where a gaze will be directed at different elements in the environment. What hasn't been understood is how the brain orchestrates this ability, which is so fundamental to survival.
In a previous example of "mind reading," Chun's group successfully reconstructed facial images viewed while people were scanned in an MRI machine, based on their brain imaging data alone.
In the new paper, Chun and lead author Thomas P. O'Connell took a similar approach and showed that by analyzing the brain responses to complex, natural scenes, they could predict where people would direct their attention and gaze. This was made possible by analyzing the brain data with deep convolutional neural networks -- models that are extensively used in artificial intelligence (AI).
"The work represents a perfect marriage of neuroscience and data science," Chun said.
The findings have a myriad of potential applications -- such as testing competing artificial intelligence systems that categorize images and guide driverless cars.
"People can see better than AI systems can," Chun said. "Understanding how the brain performs its complex calculations is an ultimate goal of neuroscience and benefits AI efforts."

Comments

Post a Comment

Popular posts from this blog

Dark matter may be older than the Big Bang

Dark matter, which researchers believe make up about 80% of the universe's mass, is one of the most elusive mysteries in modern physics. What exactly it is and how it came to be is a mystery, but a new Johns Hopkins University study now suggests that dark matter may have existed before the Big Bang. The study, published August 7 in  Physical Review Letters , presents a new idea of how dark matter was born and how to identify it with astronomical observations. "The study revealed a new connection between particle physics and astronomy. If dark matter consists of new particles that were born before the Big Bang, they affect the way galaxies are distributed in the sky in a unique way. This connection may be used to reveal their identity and make conclusions about the times before the Big Bang too," says Tommi Tenkanen, a postdoctoral fellow in Physics and Astronomy at the Johns Hopkins University and the study's author. While not much is known about its origins,...
Post a Comment
Read more

Home births as safe as hospital births: International study suggests

A large international study led by McMaster University shows that low risk pregnant women who intend to give birth at home have no increased chance of the baby's perinatal or neonatal death compared to other low risk women who intend to give birth in a hospital. The results have been published by  The Lancet 's  EClinicalMedicine  journal. "More women in well-resourced countries are choosing birth at home, but concerns have persisted about their safety," said Eileen Hutton, professor emeritus of obstetrics and gynecology at McMaster, founding director of the McMaster Midwifery Research Centre and first author of the paper. "This research clearly demonstrates the risk is no different when the birth is intended to be at home or in hospital." The study examined the safety of place of birth by reporting on the risk of death at the time of birth or within the first four weeks, and found no clinically important or statistically different risk between home...
Post a Comment
Read more

GSAT-11 satellite to be launched from French Guiana on Dec 5th

GSAT-11 satellite to be launched from French Guiana on Dec 5th GSAT-11 would be located at 74 East and is the fore-runner in a series of advanced communications satellite with multi-spot beam antenna coverage over Indian mainland and Islands, ISRO said. GSAT-11 is the next generation “high throughput” communication satellite configured around ISRO’s I-6K Bus. (PTI/Representational). Indian space agency ISRO is scheduled to launch GSAT-11, the “heaviest” satellite built by it, on-board Ariane-5 rocket of Arianespace from French Guiana on December 5. Weighing about 5,854 kg, GSAT-11 would play a vital role in providing broadband services across the country, and also provide a platform to demonstrate new generation applications, the Indian Space Research Organisation (ISRO) said. It is the “heaviest” satellite built by ISRO, the space agency said. GSAT-11 is the next generation “high throughput” communication satellite configured around ISRO’s  I-6K Bus, and it...
Post a Comment
Read more