Male Fruit Fly Brain Trained to Play Doom (pcgamer.com)
- Reference: 0185610256
- News link: https://games.slashdot.org/story/26/09/11/2022239/male-fruit-fly-brain-trained-to-play-doom
- Source link: https://www.pcgamer.com/hardware/after-google-mapped-an-adult-male-fruit-flys-brain-software-engineers-made-it-play-doom-mario64-and-beat-saber/
> You can even watch the fruit fly play in real time [3]via Wormuth's website , and it not only shows the point of view in Doom, but can also show a third-person render of the fly going around Doom maps. As of the time of writing, the fly is on round 6385 and, well, it's not very good. Sorry, fly.
>
> But modders aren't done here. They have also somehow managed to make the fruit fly play Beat Saber, and play it pretty well. [4]Lyra Bubbles on X has used the brain and replays of a song in Beat Saber to teach the fruit fly where to hit and why, via Reinforcement Learning. That does mean it's not organically reacting to the notes popping up on screen, but it is receiving input and responding to stimuli. Lyra says, "Further training is to reduce reliance on external signals and allow it to play fully reactively with no input data."
>
> And, after "pivoting to fly engineering in 2026", Jessica Paquette also [5]shared on X their experience running the digital fly brain through Super Mario 64. If you think that is all the game's modders made the fruit fly play, think again, as YouTuber [6]Ro0oney even put it in Minecraft. But this time, Ro0oney used [7]Flywire.AI , a similar project made in collaboration with Princeton University. The number of neurons are different (160,000+ vs 139,255), and Google analyzed a male brain whilst Flywire analyzed a female brain, but the basic idea is the same.
[1] https://blog.google/innovation-and-ai/technology/research/male-fruit-fly-brain-map/
[2] https://www.pcgamer.com/hardware/after-google-mapped-an-adult-male-fruit-flys-brain-software-engineers-made-it-play-doom-mario64-and-beat-saber/
[3] https://fly-brain-doom.awormuth.chatgpt.site/
[4] https://x.com/_lyraaaa_/status/2097527368919470162
[5] https://x.com/barrelshifter/status/2097004115826200898
[6] https://www.youtube.com/watch?v=BUkLWjcoBc0
[7] http://flywire.ai/
X is paywalled (Score:2)
X has now essentially paywalled everything. Unless you're one of them, you get nothing.
Re: (Score:2)
I am sure you know this and are just trying to shit on the editors, as one does on /.; but here, use this in case you didn't know: [1]https://xcancel.com/_lyraaaa_/... [xcancel.com]
[1] https://xcancel.com/_lyraaaa_/status/2097527368919470162
Wuhan energy (Score:1)
Insects trained on first person shooters escape from a lab...
What could possibly go wrong?
Re: (Score:2)
> Insects trained on first person shooters escape from a lab... What could possibly go wrong?
I'm looking forward to the movie and finding out. :-)
Re: (Score:2)
Defense identified: [1]It's an insecticide and a condiment [youtu.be]
[1] https://youtu.be/XZubL4mZ5n0?si=bR1GCe9Dji-FpwLQ
Scientists map fly brain; headline loses its own (Score:3, Informative)
They used actual fly wiring data, added simplified neuron behavior, and hooked the output up to game controls. That's pretty cool already. It doesn't need the implied "we uploaded a tiny gamer" upgrade.
The [1]developer's own notes [github.com] are refreshingly honest: the baseline doesn't learn, and the experimental learning version hasn't demonstrated improved survival. Sending a signal to something labeled "dopamine neuron" isn't, by itself, evidence that anything learned a lesson.
Also, in three very short baseline tests, it killed more enemies with black visual input than with the actual game image. That doesn't settle much scientifically, but as someone who's played public servers, I recognize the strategy.
[1] https://github.com/nftechie/doomfly/blob/main/docs/doom-live-training.md
Re: (Score:1)
Physical experience ( qualia ) is "actual". Numerical data is modelistic.
No surprise but - isn't the headline misleading? (Score:2)
Am I misunderstanding this? It sounds to me like they're using a computer model of a fruit fly's brain to do this - not the actual brain of an actual fly.
"Killer Bees" will soon have (Score:1)
AK47's
For what definition of "play"? (Score:2)
I've watched the "runs". This isn't playing Doom. This is the "fly" sitting in the middle of a single room with four opponents that shoot at it and lasting about six or seven seconds of game time.
This was by no means a fruit fly brain playing doom. It was an exercise in interfacing Doom to a fruit fly brain which gets squashed in Doom about as fast as it does in my kitchen.
What a colossal waste of time. Predictably, when you take 139,255 neurons and place them in a situation they are utterly unequipped
What exactly was created? (Score:2)
So, a 3D model was created. I guess that means a considerably larger but same geometry in space. A physical thing. And then we jump a huge gap with implying that a 3D object that looks like a brain would also act like one? Sounds like a cargo cult with wooden airplanes and mysterious rituals to induce goods dropped on a little island of fools.
Train robots to play doom (Score:2)
But not as the Doom guy.
Re:Train robots to play doom (Score:4, Insightful)
I think it is funny that the tech community tends to take a very dim view of AI drones and other weaponization of artificial intelligence, and yet, the very instant we get our hands on something that we can train to play doom, we do.
"If you put a large switch in some cave somewhere, with a sign on it saying 'End-of-the-World Switch. PLEASE DO NOT TOUCH', the paint wouldn't even have time to dry.”
Terry Pratchett, Thief of Time
Re: (Score:2)
Is the "tech community" not the people involved in AI?
Re: (Score:2)
I think the distinction they are making is between technology that kills people, and technology that entertains people. If someone fitted actual weapons to a Doom engine, they'd probably object.
Re: (Score:2)
Roman emperors used to enjoy fitting actual weapons to some guys in the Coliseum. Nobody objected.