Skip to content

Choose which optional content this site may load. You can change this at any time from the Cookie Settings link at the bottom of the page.

Necessary

Remembers your cookie and accessibility choices in your browser. Always on.

Allows audience measurement tools to load, if this site uses them.

Allows content from other services, such as embedded social media posts, to load. These services may set their own cookies.

This site shows ads from Google AdSense. Allowing this lets Google use cookies to show ads based on your interests. Without it, you see non-personalized ads.

Accessibility

Text size 100%

Settings are saved in this browser.

Health & Science

Weizmann Brain-IT Research Reconstructs Seen Images From Brain Activity

Brain-IT, developed in Professor Michal Irani’s laboratory at Israel’s Weizmann Institute of Science, reconstructs pictures from brain activity recorded while people view them. An October 18 JNS report highlights research presented earlier this year and its advance in adapting image reconstruction to a new participant using less scanning data.

An MRI scanner in an empty research suite beside a glass control room
Brain Imaging Research Suite · Disclaimer

Reconstructing Content and Layout

The computer is not given the original photograph when it produces its reconstruction. According to the research team’s project page, it receives functional magnetic resonance imaging recordings, or fMRI, associated with viewing the picture. Its task is to estimate both what the scene contains and how those elements fit together.

The system uses two complementary paths. One supplies structural information, including a coarse arrangement of shapes and colors. Another provides information about visual content. An image generation model combines those signals to refine the reconstruction. Recognizing a scene’s subject is therefore only part of the challenge: preserving its actual composition matters too.

Learning Across Different Brains

Weizmann’s September 14 announcement describes a search for visual response patterns shared between brain regions and between participants. Instead of treating every measurement from every person as entirely separate, the model groups signals with similar visual functions.

The project page describes shared functional clusters that allow information to move within and across participants’ recordings. This provides a way to reuse knowledge from earlier participants when adapting the model to somebody new. The practical research question becomes how much additional scanning is needed, alongside how faithfully the resulting picture resembles the original.

An Hour of New Participant Data

The researchers report that one hour of fMRI data from a new participant produced results comparable to previous methods trained on approximately 40 hours. That comparison concerns the experimental setup described by the team. It does not mean an ordinary clinical scan can immediately reveal whatever somebody is thinking.

The published project page also presents visual comparisons and reports stronger results than its baselines on seven of eight evaluation metrics. Those measures address different aspects of image similarity. They should not be collapsed into a single accuracy percentage or treated as evidence of unrestricted access to thoughts.

What the Demonstration Actually Covers

The experiment concerns pictures shown to participants and brain recordings associated with viewing them. It does not establish the ability to recover arbitrary memories, intentions or private thoughts outside that task. A convincing generated picture is also not proof that every detail matches the scene originally viewed.

That distinction helps explain the significance of the Israeli work without overstating it. The advance concerns the combination of structural and semantic information and the reduction in data needed for adaptation. Weizmann publicized the research in September; the October 18 report brings it renewed attention rather than announcing that the study began that day.

The team’s examples and comparisons give other researchers concrete results to examine. Further progress will depend on reconstruction fidelity and how well methods transfer between participants and experimental conditions. For readers, the useful takeaway is specific: an Israeli research group has improved an experimental route from measured visual brain activity to reconstructed pictures, while the demonstration remains a controlled scientific task.

Back to Latest News