A group of scientists say they are the first to reconstruct a recognizable song from data collected directly from the brain by monitoring electrical activity and modeling the resultant patterns with regression-based decoding models.

That song is Pink Floyd's "Another Brick in the Wall, Pt. 1" and the question on the mind of the researchers was:

What information about the outside world can be extracted from examining the activity elicited in a sensory circuit and which features are represented by different neural populations?

The research appeared on Tuesday in [1]PLOS Biology . The 190.72 seconds of the song were delivered through in-ear monitor headphones at a volume individually comfortable for the 29 patients between 2009 and 2015.

Because all patients had pharmacoresistant epilepsy, they were each already equipped with electrodes placed on the surface of their brain to look for seizures before the team's research even began. Collectively the group had 2,668 electrodes.

By playing the music and recording the output, the electrodes provided an intracranial electroencephalography (iEEG) data set the boffins examined to determine the parts of the brain stimulated by certain frequencies within the song.

[2]

Of the electrodes, 347 ended up being significant in encoding the song's acoustics. They were concentrated in three distinct regions, with a higher proportion skewed toward the right side of the brain. The 16th-note rhythm guitar pattern present in the song particularly activated a certain region of the brain in the temporal lobe – a section linked with processing auditory information and encoding memory.

[3]

[4]

"These results are in accord with prior research, showing that music perception relies on a bilateral network, with a relative right lateralization," wrote the study authors.

[5]Roger Waters tells Facebook CEO to Zuck off after 'huge' song rights request

[6]Researchers discover algorithm to create shapes that roll down pre-determined paths

[7]Artificial General Intelligence remains a distant dream despite LLM boom

[8]Idea of downloading memories far-fetched say experts after Musk claim resurfaces in latest Neuralink development

The reconstruction of the song involved training 128 models to each restore a frequency that was eventually assembled into a whole. Previous studies had done similar with speech but didn't take on enough nuances to piece together music.

"Music is core to human experience, yet the precise neural dynamics underlying music perception remain unknown," said the researchers. Indeed, music is layered with complexity. Notes, rhythm, harmony, and chords all play a role in evoking an emotional response to music in addition to the phonemes, syllables, words, semantics, and syntax that speech offers.

"Another Brick in the Wall, Pt. 1" was a particularly apt song choice. Its crafted instrumentals complemented by a comparatively sparse 41 seconds of lyrics make it what the boffins described as a "rich and complex auditory stimulus."

[9]

Plus, it was [10]reportedly tolerable to the oldies in the group.

The reconstructed bits are [11]available to listen to for anyone who doesn't find it creepy to listen to classic rock as interpreted in someone else's head.

Once that hurdle is passed, those with an ear for Pink Floyd's 11th album can pick up a distorted version of the melody, an appropriate rhythm and even some lyrics.

[12]

Should there have been more electrodes or had they been more precisely placed, the researchers believe the reconstructed strong would likely be even clearer. Further work could achieve this, as well as vary the decoding models' features and targets or add a behavioral dimension.

Applications of such research could help those struggling to communicate due to paralysis from stroke, diseases like ALS, or other reasons by better artificially replicating elements of speech than current similar technologies allow. ®

Get our [13]Tech Resources



[1] https://journals.plos.org/plosbiology/article?id=10.1371/journal.pbio.3002176

[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZN5ELW8kPOtZripRgqrEJAAAAhA&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZN5ELW8kPOtZripRgqrEJAAAAhA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZN5ELW8kPOtZripRgqrEJAAAAhA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[5] https://www.theregister.com/2021/06/17/roger_waters_says_zuck_off/

[6] https://www.theregister.com/2023/08/09/trajectoids_study/

[7] https://www.theregister.com/2023/07/04/agi_llm_distant_dream/

[8] https://www.theregister.com/2022/01/31/neuralink_job_ad/

[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZN5ELW8kPOtZripRgqrEJAAAAhA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[10] https://www.nytimes.com/2023/08/15/science/music-brain-pink-floyd.html

[11] https://regmedia.co.uk/2023/08/17/pink_floyds_another_brick_in_the_wall_part_1.wav

[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZN5ELW8kPOtZripRgqrEJAAAAhA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[13] https://whitepapers.theregister.com/