(以下內容引述自Scientists use brain imaging to reveal the movies in our mind)
…..Nishimoto and two other research team members served as subjects for the experiment,
because the procedure requires volunteers to remain still inside the MRI scanner
for hours at a time…..
…..They watched two separate sets of Hollywood movie trailers,
while fMRI was used to measure blood flow through the visual cortex,
the part of the brain that processes visual information. On the computer,
the brain was divided into small, three-dimensional cubes known as volumetric pixels,
…..“We built a model for each voxel that describes how shape and motion information in the movie
is mapped into brain activity,” Nishimoto said…..
…..The brain activity recorded while subjects viewed the first set of clips was fed into
a computer program that learned, second by second,
to associate visual patterns in the movie with the corresponding brain activity…..
…..Brain activity evoked by the second set of clips was used to test the movie reconstruction algorithm.
This was done by feeding 18 million seconds of random YouTube videos into the computer program
so that it could predict the brain activity that each film clip would most likely evoke in each subject…..
…..Finally, the 100 clips that the computer program decided were most similar to the clip
that the subject had probably seen were merged to produce a blurry
yet continuous reconstruction of the original movie…..
…..Reconstructing movies using brain scans has been challenging because the blood flow signals
measured using fMRI change much more slowly than the neural signals that encode
dynamic information in movies, researchers said. For this reason,
most previous attempts to decode brain activity have focused on static images…..
…..“We addressed this problem by developing a two-stage model that separately describes
the underlying neural population and blood flow signals,” Nishimoto said…..
…..Ultimately, Nishimoto said, scientists need to understand how the brain processes
dynamic visual events that we experience in everyday life…..
…..“We need to know how the brain works in naturalistic conditions,” he said.
“For that, we need to first understand how the brain works while we are watching movies.”…..