AI godfather-turned-doomer shares Nobel with neural network pioneer
(2024/10/09)
- Reference: 1728426610
- News link: https://www.theregister.co.uk/2024/10/08/ai_godfather_wins_nobel_prize/
- Source link:
If you needed another sign that we've well and truly entered the AI age, here it is: The first Nobel Prize has been awarded for contributions to artificial intelligence.
AI "godfather" Dr. Geoffrey Hinton, and his intellectual predecessor in the realm of learning machines, Dr. John Hopfield, were jointly awarded the 2024 Nobel Prize for physics today "for foundational discoveries and inventions that enable machine learning with artificial neural networks," the Royal Swedish Academy of Sciences [1]said .
El Reg readers and AI watchers are likely familiar with Hinton's pioneering work on neural networks, and his high-profile [2]departure from an advisory role at Google, driven by concerns over the potential dangers of the AI systems he helped create. Hopfield's work, on the other hand, is even more foundational to modern AI, and influenced Hinton's advancements.
[3]
According to a [4]write up [PDF] of the reasons for the award, Hopfield's greatest contribution to AI came in 1982 when he created a neural network (named after himself) capable of storing multiple patterns and retrieving them from memory by distinguishing between them.
[5]
[6]
The Committee likened the "Hopfield network" to the brain's associative memory, where we search for and recall information, such as words. It described the network as a system of artificial neurons with varying connection strengths.
"Hopfield described the overall state of the network with a property that is equivalent to the energy in the spin system found in physics; the energy is calculated using a formula that uses all the values of the nodes and all the strengths of the connections between them," it explained.
[7]
By the time the entire network processes the data, it often reproduces the original image it was trained on, the Academy noted, but what made it truly special was its ability to store multiple pictures at the same time, and differentiate between them.
From recall to interpretation
While a Hopfield network and associative memory techniques can recall images as patterns in data, it can't interpret what they are. That's where Hinton came in.
[8]
"When Hopfield published his article on associative memory, Geoffrey Hinton was working at Carnegie Mellon University in Pittsburgh, USA," the Academy said. "Along with his colleague, Terrence Sejnowski, Hinton started from the Hopfield network and expanded it to build something new, using ideas from statistical physics."
"The states in which the individual components can jointly exist can be analyzed using statistical physics, and the probability of them occurring calculated," the Nobel awarding body said. Measure those probabilities and assign them to objects, and you have Hinton's [9]Boltzmann machine .
[10]AI won't take our jobs and it might even save the middle class
[11]Defense AI models 'a risk to life' alleges spurned tech firm
[12]If AI drives humans to extinction, it'll be our fault
[13]California governor vetoes controversial AI safety law, tells everyone to start over
Another neural network, but a far more advanced one, the Boltzmann machine can learn from examples of data, recognize familiar traits across samples, and recognize new examples of an object by filtering known basics into various categories.
Boltzmann machines are still used today to power recommendation engines and other basic AIs, and are frequently a part of larger machine learning networks.
"The laureates' work has already been of the greatest benefit. In physics we use artificial neural networks in a vast range of areas, such as developing new materials with specific properties," Ellen Moons, Chair of the Nobel Committee for the physics prize said.
From interpretation to worry
It's the second major award Hinton's won for his contributions to AI, after [14]sharing the 2019 Turing Prize - often called the Nobel of computing - with fellow "AI godfathers" Yoshua Bengio and Yann LeCun.
Since then, however, Hinton has become downright skeptical of the learning machines he helped create. After leaving Google in May 2023, Hinton expressed regret for his role in laying the foundation for modern AI, [15]saying that when he looked at AI's growth to date and how it was likely to impact society in the future, the possibilities were "scary."
"I console myself with the normal excuse: if I hadn't done it, somebody else would have," Hinton told the New York Times' Cade Metz, a former Register journalist, last year.
Hinton was joined by Bengio in signing an [16]open letter last year calling for regulation of AI to prevent future harms. The letter likened AI to the threat of climate change, saying that while we ignored those warnings, we could head off trouble with AI before it's too late.
"There is a responsible path, if we have the wisdom to take it," the letter begs. Hinton reiterated his concerns about AI in an [17]interview shortly after he found out he won the Nobel.
"I wish I had a sort of simple recipe that if you do this, everything's going to be okay. But I don't," Hinton told Nobel Prize Outreach's chief science officer Adam Smith. "We're a kind of bifurcation point in history where in the next few years we need to figure out if there's a way to deal with that threat [of AI running amok]."
"One thing governments can do is force the big companies to spend a lot more of their resources on safety research," Hinton added. "Companies like OpenAI can't just put safety research on the back burner."
Hinton and Hopfield will share a prize of 11 million Swedish kronor (about $1 million), and will receive their awards on December 10, the anniversary of dynamite inventor and prize namesake Alfred Nobel's death in 1896. ®
Get our [18]Tech Resources
[1] https://www.nobelprize.org/prizes/physics/2024/press-release/
[2] https://www.theregister.com/2023/05/01/ai_geoffrey_hinton_resigns/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://www.nobelprize.org/uploads/2024/10/popular-physicsprize2024.pdf
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://www.theregister.com/2014/03/29/hawkins_ai_feature/?page=3
[10] https://www.theregister.com/2024/02/14/ai_wont_take_our_jobs/
[11] https://www.theregister.com/2024/09/06/defense_ai_models_risk/
[12] https://www.theregister.com/2023/06/25/ai_rogue_paper_comment/
[13] https://www.theregister.com/2024/09/30/california_governor_vetoes_ai_safety_bill/
[14] https://www.theregister.com/2019/04/01/ai_roundup_290319/
[15] https://www.theregister.com/2023/05/01/ai_geoffrey_hinton_resigns/
[16] https://managing-ai-risks.com/
[17] https://www.nobelprize.org/prizes/physics/2024/hinton/interview/
[18] https://whitepapers.theregister.com/
AI "godfather" Dr. Geoffrey Hinton, and his intellectual predecessor in the realm of learning machines, Dr. John Hopfield, were jointly awarded the 2024 Nobel Prize for physics today "for foundational discoveries and inventions that enable machine learning with artificial neural networks," the Royal Swedish Academy of Sciences [1]said .
El Reg readers and AI watchers are likely familiar with Hinton's pioneering work on neural networks, and his high-profile [2]departure from an advisory role at Google, driven by concerns over the potential dangers of the AI systems he helped create. Hopfield's work, on the other hand, is even more foundational to modern AI, and influenced Hinton's advancements.
[3]
According to a [4]write up [PDF] of the reasons for the award, Hopfield's greatest contribution to AI came in 1982 when he created a neural network (named after himself) capable of storing multiple patterns and retrieving them from memory by distinguishing between them.
[5]
[6]
The Committee likened the "Hopfield network" to the brain's associative memory, where we search for and recall information, such as words. It described the network as a system of artificial neurons with varying connection strengths.
"Hopfield described the overall state of the network with a property that is equivalent to the energy in the spin system found in physics; the energy is calculated using a formula that uses all the values of the nodes and all the strengths of the connections between them," it explained.
[7]
By the time the entire network processes the data, it often reproduces the original image it was trained on, the Academy noted, but what made it truly special was its ability to store multiple pictures at the same time, and differentiate between them.
From recall to interpretation
While a Hopfield network and associative memory techniques can recall images as patterns in data, it can't interpret what they are. That's where Hinton came in.
[8]
"When Hopfield published his article on associative memory, Geoffrey Hinton was working at Carnegie Mellon University in Pittsburgh, USA," the Academy said. "Along with his colleague, Terrence Sejnowski, Hinton started from the Hopfield network and expanded it to build something new, using ideas from statistical physics."
"The states in which the individual components can jointly exist can be analyzed using statistical physics, and the probability of them occurring calculated," the Nobel awarding body said. Measure those probabilities and assign them to objects, and you have Hinton's [9]Boltzmann machine .
[10]AI won't take our jobs and it might even save the middle class
[11]Defense AI models 'a risk to life' alleges spurned tech firm
[12]If AI drives humans to extinction, it'll be our fault
[13]California governor vetoes controversial AI safety law, tells everyone to start over
Another neural network, but a far more advanced one, the Boltzmann machine can learn from examples of data, recognize familiar traits across samples, and recognize new examples of an object by filtering known basics into various categories.
Boltzmann machines are still used today to power recommendation engines and other basic AIs, and are frequently a part of larger machine learning networks.
"The laureates' work has already been of the greatest benefit. In physics we use artificial neural networks in a vast range of areas, such as developing new materials with specific properties," Ellen Moons, Chair of the Nobel Committee for the physics prize said.
From interpretation to worry
It's the second major award Hinton's won for his contributions to AI, after [14]sharing the 2019 Turing Prize - often called the Nobel of computing - with fellow "AI godfathers" Yoshua Bengio and Yann LeCun.
Since then, however, Hinton has become downright skeptical of the learning machines he helped create. After leaving Google in May 2023, Hinton expressed regret for his role in laying the foundation for modern AI, [15]saying that when he looked at AI's growth to date and how it was likely to impact society in the future, the possibilities were "scary."
"I console myself with the normal excuse: if I hadn't done it, somebody else would have," Hinton told the New York Times' Cade Metz, a former Register journalist, last year.
Hinton was joined by Bengio in signing an [16]open letter last year calling for regulation of AI to prevent future harms. The letter likened AI to the threat of climate change, saying that while we ignored those warnings, we could head off trouble with AI before it's too late.
"There is a responsible path, if we have the wisdom to take it," the letter begs. Hinton reiterated his concerns about AI in an [17]interview shortly after he found out he won the Nobel.
"I wish I had a sort of simple recipe that if you do this, everything's going to be okay. But I don't," Hinton told Nobel Prize Outreach's chief science officer Adam Smith. "We're a kind of bifurcation point in history where in the next few years we need to figure out if there's a way to deal with that threat [of AI running amok]."
"One thing governments can do is force the big companies to spend a lot more of their resources on safety research," Hinton added. "Companies like OpenAI can't just put safety research on the back burner."
Hinton and Hopfield will share a prize of 11 million Swedish kronor (about $1 million), and will receive their awards on December 10, the anniversary of dynamite inventor and prize namesake Alfred Nobel's death in 1896. ®
Get our [18]Tech Resources
[1] https://www.nobelprize.org/prizes/physics/2024/press-release/
[2] https://www.theregister.com/2023/05/01/ai_geoffrey_hinton_resigns/
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://www.nobelprize.org/uploads/2024/10/popular-physicsprize2024.pdf
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZwX_6ArroCZoV3csRxemuQAAAJc&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[9] https://www.theregister.com/2014/03/29/hawkins_ai_feature/?page=3
[10] https://www.theregister.com/2024/02/14/ai_wont_take_our_jobs/
[11] https://www.theregister.com/2024/09/06/defense_ai_models_risk/
[12] https://www.theregister.com/2023/06/25/ai_rogue_paper_comment/
[13] https://www.theregister.com/2024/09/30/california_governor_vetoes_ai_safety_bill/
[14] https://www.theregister.com/2019/04/01/ai_roundup_290319/
[15] https://www.theregister.com/2023/05/01/ai_geoffrey_hinton_resigns/
[16] https://managing-ai-risks.com/
[17] https://www.nobelprize.org/prizes/physics/2024/hinton/interview/
[18] https://whitepapers.theregister.com/
Anonymous Coward
We've reached the event horizon of AI hype from which even hallucinations cannot escape ...
If somebody else...
Peter Prof Fox
I did invent it (in 8 bits) but left it to others.
Was I wrong?
Or morally weak?
Or Worry too much about how easy it was for humans to let computers do the hard things like... think?
PS I have reinvented the wheel ( [1] Wheel patent ) Some of us are quite clever you know!
The OTHER thing about AI is if you throw enough Mips at something you can make it APPEAR real, just like your child telling you details about their imaginary friend when (a) the friend doesn't exist and (B) they don't have any friends.
I know people in general can be well sub-normal and terribly deluded, so perhaps I shouldn't be surprised. I'm beginning to think that like left-handedness and red-hairiness and tone-deafness and attention-to-detailness and amusement-at-sufferingness and beliving-their-liesiness and so on that the ten-eighty-ten rule applies to intelligence. 'Ten percent' are properly clever. 'Ten percent' are unbelievably dumb. There could be an evolutionary reason why 10% of a population have a different trait. That is they might survive a wipe-out, or of course be the ones to be clobbered by circumstances. If you are one of the few who run far away from home then you might be the only drop left of the gene pool which was wiped-out by the something-plague. Look at the scale of tone-deaf to perfect pitch or incapable of driving to smoothly anticipating and understanding physics then wonder how the human world of outliers has evolved. Should AI be renamed Artificial Competence?
[1] https://vulpeculox.net/misc/WheelPatent.pdf
This is so shoe-horned into "physics" that I think I'm hallucinating.