Curl project founder snaps over deluge of time-sucking AI slop bug reports
- Reference: 1746613809
- News link: https://www.theregister.co.uk/2025/05/07/curl_ai_bug_reports/
- Source link:
Stenberg said the amount of time it takes project maintainers to triage each AI-assisted vulnerability report made via HackerOne, only for them to be deemed invalid, is tantamount to a DDoS attack on the project.
Cloudflare builds an AI to lead AI scraper bots into a horrible maze of junk content [1]READ MORE
Citing a specific recent report that "pushed [him] over the limit," Stenberg [2]said via LinkedIn: "That's it. I've had it. I'm putting my foot down on this craziness."
From now on, every HackerOne report claiming to have found a bug in curl, a command-line tool and library for transferring data with URLs, must disclose whether AI was used to generate the submission.
If selected, the bug reporter can expect a barrage of follow-up questions demanding a stream of proof that the bug is genuine before the curl team spends time on verifying it.
[3]
"We now ban every reporter instantly who submits reports we deem AI slop," Stenberg added. "A threshold has been reached. We are effectively being DDoSed. If we could, we would charge them for this waste of our time."
[4]
[5]
He went on to say that the project has never received a single valid bug report that was generated using AI, and their rate is increasing.
"These kinds of reports did not exist at all a few years ago, and the rate seems to be increasing," Stenberg said, replying to a follower. "Still not drowning us, but the trend is not looking good."
[6]
These concerns are not new. Python's Seth Larson also raised concerns about these [7]AI slop reports back in December, saying that responding to them is expensive and time-consuming because on face value, they seem legitimate and must be investigated further by trained eyes before confirming that they are, in fact, bogus.
"Security reports that waste maintainers' time result in confusion, stress, frustration, and to top it off, a sense of isolation due to the secretive nature of security reports," Larson [8]wrote . "All of these feelings can add to burnout of likely highly trusted contributors to open source projects.
"In many ways, these low-quality reports should be treated as if they are malicious. Even if this is not their intent, the outcome is maintainers that are burnt out and more averse to legitimate security work."
We now ban every reporter instantly who submits reports we deem AI slop ... If we could, we would charge them for this waste of our time
Stenberg's decision to add an AI filter to HackerOne reports follows years of frustration about the practice. He [9]raised the issue as far back as January 2024, saying reports made with Google Bard, for example, as Gemini was called back then, were "crap" but better crap.
The comment referred to the same point Larson made almost a year later – that AI reports look legitimate at first, but take time to reveal issues like hallucinations.
[10]
The issue is especially damaging for open source software projects like curl and Python, which largely depend on the work of a small number of unpaid volunteer specialists to help improve them.
[11]Microsoft expands Copilot bug bounty targets, adds payouts for even moderate messes
[12]Just how private is Apple's Private Cloud Compute? You can test it to find out
[13]Google Cloud Document AI flaw (still) allows data theft despite bounty payout
[14]Samsung boosts bug bounty to a cool million for cracks of the Knox Vault subsystem
Developers come and go with these projects, staying for a short time, often to help fix a bug they reported, or some other feature, before leaving. At the time of writing, curl's website states that at least 3,379 people have individually contributed to the project since Stenberg founded it in 1998.
Curl offers bounty rewards of up to $9,200 for the discovery and report of a critical vulnerability in the project, and has paid $86,000 in rewards since 2019.
According to its HackerOne page, it received 24 reports in the previous 90 days, none of which have led to payouts, and as Stenberg said in his LinkedIn post, none of the AI-assisted reports made in the last six years have actually discovered a genuine bug.
Generative AI tools have allowed low-skilled individuals with an awareness of bug bounty programs to quickly file reports based on AI-generated content in the hope they can cash in on the rewards they offer.
However, Stenberg said that it is not just the newbies and grifters using AI to chance their luck on a [15]bounty program – those with a degree of reputation are also getting in on the act.
The report that pushed the project founder over the edge was made two days ago and was a textbook AI-generated submission.
It was pitched as "a novel exploit leveraging stream dependency cycles in the HTTP/3 protocol stack was discovered, resulting in memory corruption and potential denial-of-service or remote code execution scenarios."
Ultimately, though, it was found to refer to nonexistent functions.
Stenberg said: "What fooled me for a short while was that it sounded almost plausible, combined with the fact that the reporter actually had proper 'reputation' (meaning that this person has reported and have had many previous reports vetted as fine). Plus, of course, that we were preoccupied over the day with the annual curl up meeting." ®
Get our [16]Tech Resources
[1] https://www.theregister.com/2025/03/21/cloudflare_ai_labyrinth/
[2] https://www.linkedin.com/posts/danielstenberg_hackerone-curl-activity-7324820893862363136-glb1/?utm_source=share&utm_medium=member_desktop&rcm=ACoAABvgIC0Bx1xUu-E97QUzl6wtDuTtUHlFX7g
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_security/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2aBuDoRBEf4flnwbBBujUXQAAAsM&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_security/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aBuDoRBEf4flnwbBBujUXQAAAsM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_security/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aBuDoRBEf4flnwbBBujUXQAAAsM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_security/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44aBuDoRBEf4flnwbBBujUXQAAAsM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2024/12/10/ai_slop_bug_reports/
[8] https://sethmlarson.dev/slop-security-reports
[9] https://www.theregister.com/2024/01/04/aiassisted_bug_reports_make_developers/
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_security/front&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33aBuDoRBEf4flnwbBBujUXQAAAsM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[11] https://www.theregister.com/2025/02/20/microsoft_copilot_bug_bounty_updated/
[12] https://www.theregister.com/2024/10/25/apple_private_cloud_compute/
[13] https://www.theregister.com/2024/09/17/google_cloud_document_ai_flaw/
[14] https://www.theregister.com/2024/08/08/samsung_microsoft_big_bug_bounty/
[15] https://www.theregister.com/2025/02/20/microsoft_copilot_bug_bounty_updated/
[16] https://whitepapers.theregister.com/
Re: It's the bug bounty
I'm starting to understand [1]why MS demand videos now (and we all complained).
[1] https://www.theregister.com/2025/03/17/microsoft_bug_report_troll/
Re: It's the bug bounty
Precisely my thought.
By now the spammers will know to deepfake a video, too.
And so the karmic wheel of slop rolls on.
Re: It's the bug bounty
How about issuing fines for "plausible but wrong" reports?
-A.
Re: It's the bug bounty
Under whose power?
No one would ever consider paying. Even if they get banned unless they pay the 'fine', what's the difference between that and directly banning them?
Re: It's the bug bounty
Are seen as free lottery tickets
Take the "free" out of equation and require a deposit of USD10 or EUR10 for each bug submission refunded with a bounty for a legitimate submission otherwise surrendered to fund curl maintenance and development.
Re: It's the bug bounty
Not necessarily with every report. Just a deposit on joining HackerOne, refunded after a genuine report. If, subsequently, slop reports are sent a new, double deposit will be required to be refunded after 2 genuine reports, otherwise the submitter is banned. Double up again as necessary.
It's the spam effect
When it costs nothing to send an email offering a low price on a counterfeit drug, people will send lots of emails.
When it costs nothing to send a bug report in hopes of getting a bounty, people will send bug reports. Another commenter got it right "free lottery tickets".
I suggest Hacker One and other bug-bounty clearing houses revisit their business models. Charge money for the lottery tickets. Refundable after triage, or something like that.
The current system isn't resilient. And defect detection schemes need to be resilient.
Sorry to nitpick, but...
"He went on to say that the project has never received a single valid bug report that was generated using AI"
If a report points to a real bug how do you know it wasn't an AI all along? Isn't this confirmation bias? It's like people who say "I can always spot a liar" when they have no way of knowing when they've been lied to.
The cons of this round of "AI" outweigh the pros. when will the nonsense stop?
When will the nonsense stop?
Hard to say.
I am distrustful of AI but have been keeping an eye on Google's AI Overviews as I encounter them and was slowly being suckered into thinking it's not as bad as I had believed. Until it claimed, with it's usual confident certainty, that something I knew was absolutely wrong was a fact.
Maybe that's what it takes; experiencing its bullshit, lies, fake facts and hallucinations first hand?
It's the bug bounty
"Curl offers bounty rewards of up to $9,200 for the discovery and report of a critical vulnerability in the project, and has paid $16,300 in rewards since 2019."
I think these "bug reports" aresern as free lottery tickets for the bug bounty.
You have an LLM running on you hardware or some free subscription to an AI. What is easier than to deluge every bug bounty project with bug reports.
It is like Spam, if one in a million pays out, you send two million. The costs are lower than the expected payouts.
That is, assuming they are actually able to do that math. Or they can get others to pay for bandwidth, electricity, and subscriptions.