Bad trip coming for AI hype as humanity tools up to fight back
(2025/04/22)
- Reference: 1745310607
- News link: https://www.theregister.co.uk/2025/04/22/bad_trip_coming_for_ai/
- Source link:
Opinion 6:56 PM. April 11, 2025. Write it down. That's the precise moment the tech-bro-niverse imploded due to the gravitational force of irony at its core. That was the moment Jack Dorsey posted "Delete all IP law" on X. A little later, Elon Musk added his approval with "I agree."
Is this a considered intellectual stance born from a closely argued radical reassessment of the legal, economic, and cultural framework of modern times, or a [1]petulant outburst from an entitled billionaire ? We report, you decide. Fortunately for the world beyond Jack's egosphere, deleting IP law is still outside presidential powers, for now, at least. It's also a good thing for Jack and Elon themselves, whose entire empires are built on IP law.
Although there's much that would bear reform, the system of patents, copyright, and trademarks underpins all innovation and commerce, nationally and globally. Who would invest in hardware companies if R&D had a payback time of however many weeks it took to be ripped off? Who would invest in software if any employee could post the source code publicly? Would Linux have evolved without the GPL?
[2]
Without IP law, the structure of the 21st century would degenerate into warlord-managed fiefdoms where the organizations with the most power to intimidate would take what they wanted and deny others. Jack and Elon may fondly imagine they'd be among those warlords.
[3]
[4]
Rather than demonstrating the risible braggadocio of teenage boys on their first beer binge, our dynamic duo should look to the inevitable consequences of acting as if IP law had indeed been deleted. The technology they wish to give free rein to feed on human brains is demonstrably flawed. Not only is no one able to stop it hallucinating on unsullied training data – [5]careful with that coding supply chain , Eugene – it can be provoked into a full-blown bad trip with data that appears OK to humans but contains carefully engineered digital LSD: adversarial noise.
Just like Dr Hofmann's original infamous elixir, adversarial noise is effective in very small amounts, adding tiny tweaks to data that sound like one thing to humans but are perceived by certain kinds of generative AI very differently. If used in training data, this can unhinge the resultant model; if used in data an unsullied model is trying to analyse, it can embed hidden commands or perceptions that corrupt the AI's output.
[6]
All this is possible because no matter how the hipsters gussy it up, AI isn't intelligent and works completely differently to our own wetware. Once you set out to deceive it, it goes off the rails. The [7]CIA tested LSD as a mind-control drug last century , but it didn't work out. Adversarial noise does.
Take a look at the work of musician and IP activist Benn Jordan. As he puts it in his [8]latest highly entertaining and informative video , he was trying to work with lawmakers to compel large AI companies to document their training data and have a licensing structure to pay creatives for the use of their work. As he says, the magic mute button for anyone pushing a new paid-for generative AI product is "What data did you use to train your base model?" Either they don't know, or admitting that they just scraped everything makes them liable for copyright claims. Big, big copyright claims. So let's get it out into the open.
[9]Official abuse of state security has always been bad, now it's horrifying
[10]When even Microsoft can't understand its own Outlook, big tech is stuck in a swamp of its own making
[11]Time to make C the COBOL of this century
[12]The biggest microcode attack in our history is underway
All that came to an end on January 20, when the question became "how do we take this into our own hands?" One answer is adversarial noise. Researchers at the University of Tennessee, Knoxville had already created a technology called HarmonyCloak that sounds fine to human ears but completely breaks AI's ability to recognize harmony and rhythm. The results are comically horrific. Adding this to his own Poisonify system, which makes AI misidentify instruments, Jordan brews up a potion that makes an acid casualty of artificial intelligence. Degenerative AI.
These are early days, but this stuff works. Put out protected music and it will poison any AI that feeds on it. That immediately protects musicians and visual artists, as this works on diffusion models common to both audio and graphical content. Enough of it, and business models break down as well. That's before the potential for pranking and attacking voice recognition systems.
This may not appear to affect LLMs directly, where adding noise is much harder to disguise from ordinary users.
[13]
The lesson's the same, Jack and Elon. If you don't demonstrably regularize your training data, your product is vulnerable, your business even more so. IP law provides the framework within which you can do that, protecting you from attack and formalizing your intellectual supply chain.
On which you utterly depend. You dolts. ®
Get our [14]Tech Resources
[1] https://ipwatchdog.com/2025/04/15/delete-ip-dorsey-musk-retract-destructive-statements/id=188213/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2025/04/12/ai_code_suggestions_sabotage_supply_chain/
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://en.wikipedia.org/wiki/Operation_Midnight_Climax
[8] https://www.youtube.com/watch?v=xMYm2d9bmEA&ab_channel=BennJordan
[9] https://www.theregister.com/2025/04/14/opinion_secret_state_security/
[10] https://www.theregister.com/2025/03/31/opinion_column_big_tech/
[11] https://www.theregister.com/2025/02/18/c_opinion/
[12] https://www.theregister.com/2025/02/10/microcode_attack_trump_musk/
[13] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[14] https://whitepapers.theregister.com/
Is this a considered intellectual stance born from a closely argued radical reassessment of the legal, economic, and cultural framework of modern times, or a [1]petulant outburst from an entitled billionaire ? We report, you decide. Fortunately for the world beyond Jack's egosphere, deleting IP law is still outside presidential powers, for now, at least. It's also a good thing for Jack and Elon themselves, whose entire empires are built on IP law.
Although there's much that would bear reform, the system of patents, copyright, and trademarks underpins all innovation and commerce, nationally and globally. Who would invest in hardware companies if R&D had a payback time of however many weeks it took to be ripped off? Who would invest in software if any employee could post the source code publicly? Would Linux have evolved without the GPL?
[2]
Without IP law, the structure of the 21st century would degenerate into warlord-managed fiefdoms where the organizations with the most power to intimidate would take what they wanted and deny others. Jack and Elon may fondly imagine they'd be among those warlords.
[3]
[4]
Rather than demonstrating the risible braggadocio of teenage boys on their first beer binge, our dynamic duo should look to the inevitable consequences of acting as if IP law had indeed been deleted. The technology they wish to give free rein to feed on human brains is demonstrably flawed. Not only is no one able to stop it hallucinating on unsullied training data – [5]careful with that coding supply chain , Eugene – it can be provoked into a full-blown bad trip with data that appears OK to humans but contains carefully engineered digital LSD: adversarial noise.
Just like Dr Hofmann's original infamous elixir, adversarial noise is effective in very small amounts, adding tiny tweaks to data that sound like one thing to humans but are perceived by certain kinds of generative AI very differently. If used in training data, this can unhinge the resultant model; if used in data an unsullied model is trying to analyse, it can embed hidden commands or perceptions that corrupt the AI's output.
[6]
All this is possible because no matter how the hipsters gussy it up, AI isn't intelligent and works completely differently to our own wetware. Once you set out to deceive it, it goes off the rails. The [7]CIA tested LSD as a mind-control drug last century , but it didn't work out. Adversarial noise does.
Take a look at the work of musician and IP activist Benn Jordan. As he puts it in his [8]latest highly entertaining and informative video , he was trying to work with lawmakers to compel large AI companies to document their training data and have a licensing structure to pay creatives for the use of their work. As he says, the magic mute button for anyone pushing a new paid-for generative AI product is "What data did you use to train your base model?" Either they don't know, or admitting that they just scraped everything makes them liable for copyright claims. Big, big copyright claims. So let's get it out into the open.
[9]Official abuse of state security has always been bad, now it's horrifying
[10]When even Microsoft can't understand its own Outlook, big tech is stuck in a swamp of its own making
[11]Time to make C the COBOL of this century
[12]The biggest microcode attack in our history is underway
All that came to an end on January 20, when the question became "how do we take this into our own hands?" One answer is adversarial noise. Researchers at the University of Tennessee, Knoxville had already created a technology called HarmonyCloak that sounds fine to human ears but completely breaks AI's ability to recognize harmony and rhythm. The results are comically horrific. Adding this to his own Poisonify system, which makes AI misidentify instruments, Jordan brews up a potion that makes an acid casualty of artificial intelligence. Degenerative AI.
These are early days, but this stuff works. Put out protected music and it will poison any AI that feeds on it. That immediately protects musicians and visual artists, as this works on diffusion models common to both audio and graphical content. Enough of it, and business models break down as well. That's before the potential for pranking and attacking voice recognition systems.
This may not appear to affect LLMs directly, where adding noise is much harder to disguise from ordinary users.
[13]
The lesson's the same, Jack and Elon. If you don't demonstrably regularize your training data, your product is vulnerable, your business even more so. IP law provides the framework within which you can do that, protecting you from attack and formalizing your intellectual supply chain.
On which you utterly depend. You dolts. ®
Get our [14]Tech Resources
[1] https://ipwatchdog.com/2025/04/15/delete-ip-dorsey-musk-retract-destructive-statements/id=188213/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2025/04/12/ai_code_suggestions_sabotage_supply_chain/
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://en.wikipedia.org/wiki/Operation_Midnight_Climax
[8] https://www.youtube.com/watch?v=xMYm2d9bmEA&ab_channel=BennJordan
[9] https://www.theregister.com/2025/04/14/opinion_secret_state_security/
[10] https://www.theregister.com/2025/03/31/opinion_column_big_tech/
[11] https://www.theregister.com/2025/02/18/c_opinion/
[12] https://www.theregister.com/2025/02/10/microcode_attack_trump_musk/
[13] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aAdo0_zqMKv2VkZm9X18ZwAAAdU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[14] https://whitepapers.theregister.com/
Re: Copyright is not IP
Michael Strorm
Copyright is a type of IP, or at least, one of the mechanisms that makes IP- and ownership of non-physical concepts- possible.
The GPL might use it in a way not originally intended, but it still (ironically) depends on copyright and ownership to allow the creators to enforce its conditions on how *their* code may be distributed.
(Of course, if copyright didn't exist, then much of that would be irrelevant in the first place, but that's a can of worms and another discussion).
Tech bros gonna tech bro
Michael Strorm
> "Jack Dorsey posted "Delete all IP law" on X"
This has the same grandstanding adolescent tone as Elon Musk's claim to be a "free speech absolutist".
And much like how the first thing Musk did after spouting that was to start kicking anyone who disagreed with him (or got under his thin skin) off Twitter, we know damn well that Dorsey's comment is coming from the same one-sided place and is similarly hollow and hypocritical.
Musk only "cared" about free speech when it was coming from him or in his own interests.
As with all ultra-rich, ultra-entitled tech bros, Musk's "principles" only include freedom for himself and the ability to crush any "little people" who have the audacity to get in his way.
Similarly, when push comes to shove, it'll be clear that Dorsey's all mouth and no trousers and only really wants to get rid of IP that's in *his* way.
Tech bros all over.
Copyright is not IP
Would Linux have evolved without the GPL?
I'm not certain why you are mentioning Linux and the GPL in an article about IP law. The GPL is all about copyright (or copyleft if you are pedantic) and has nothing to do with IP.