News: 1688574613

  ARM Give a man a fire and he's warm for a day, but set fire to him and he's warm for the rest of his life (Terry Pratchett, Jingo)

OpenAI pauses Bing search feature over paywall bypass abilities

(2023/07/05)


OpenAI's experiment with allowing ChatGPT to search the web via Bing has been suspended because the feature inadvertently allowed users to bypass paywalls.

First [1]rolled out in May and limited to paying ChatGPT users, OpenAI updated its [2]help page for the "Browse with Bing" feature yesterday to indicate that, as of July 3, ChatGPT is back to not knowing anything about the world after September 2021, the cutoff date for its training data.

"We have learned that the ChatGPT Browse beta can occasionally display content in ways we don't want. For example, if a user specifically asks for a URL's full text, it might inadvertently fulfil this request," said OpenAI's Michael Schade. "We've disabled the Browse with Bing beta feature out of an abundance of caution while we fix this in order to do right by content owners."

[3]

Users of the feature weren't happy with the news, and took to OpenAI's forums to register their [4]discontent , with several saying they only paid for ChatGPT Plus for access to the Bing web search feature.

[5]

[6]

OpenAI hasn't said anything about how long the ChatGPT web search moratorium will last, or what the feature will look like once it returns. Schade's statement that ChatGPT inadvertently delivers the full text of a web page may mean that ChatGPT could lose the ability to translate websites – a worry that one user expressed in the forums.

"Let's say I needed it to read a certain repository or topic on GitHub or some forum where the language is foreign to me, now it can't? You've got to be kidding me," said ChatGPT user Thiago Ramos. "Now the responses from ChatGPT 4 have worsened. It makes so many mistakes that even the 3.5 outperforms it in several areas," Ramos opined.

[7]

We reached out to OpenAI to ask several questions about the move; the company answered our email, but only to point us to a [8]tweet that said much the same as the updated help page.

[9]Artificial General Intelligence remains a distant dream despite LLM boom

[10]No, GPT-4 cannot get a computer science degree at MIT

[11]Mozilla Developer Network adds AI Help that does the opposite

[12]Microsoft and GitHub are still trying to derail Copilot code copyright legal fight

There's more than one way to bypass a paywall, or at least there was

Microsoft's [13]Bing AI chat bot , itself powered by OpenAI's ChatGPT, and Google's [14]Bard both launched in February. The pair differ from ChatGPT in that they're both able to access the web to pull ( [15]supposedly ) more up-to-date and relevant information. Both, as users have [16]reported for [17]months , are also able to bypass paywalls – and without requiring a paid subscription to do so.

Whether that's still the case is unclear; neither [18]Bard's nor [19]Bing's recent update notes mention a revamp of the chatbots to limit paywall bypassing capabilities, but sources said both returned negative responses when attempting to get them to do so.

"I am not able to display the full content of articles from [the site you requested] or any other publication that is protected by copyright," Bing said, instead offering to learn about the topic and report back.

Bard's response was a bit more terse when asked to provide a copy of a paywalled article: "I'm just a language model, so I can't help you with that."

[20]

We asked Microsoft and Google for their take on OpenAI's move, and their position on paywall-busting AIs more generally, but didn't get a response. ®

Get our [21]Tech Resources



[1] https://help.openai.com/en/articles/6825453-chatgpt-release-notes#h_9894d7b0a4

[2] https://help.openai.com/en/articles/8077698-how-do-i-use-chatgpt-browse-with-bing-to-search-the-web

[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZKXoANPBNF@b4leqd6TM@QAAAY8&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0

[4] https://community.openai.com/t/chatgpt4-browsing-bing-disabled/286800

[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZKXoANPBNF@b4leqd6TM@QAAAY8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZKXoANPBNF@b4leqd6TM@QAAAY8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZKXoANPBNF@b4leqd6TM@QAAAY8&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0

[8] https://twitter.com/OpenAI/status/1676072388436594688?s=20

[9] https://www.theregister.com/2023/07/04/agi_llm_distant_dream/

[10] https://www.theregister.com/2023/07/03/ai_in_brief/

[11] https://www.theregister.com/2023/07/03/mozilla_developer_network_adds_ai/

[12] https://www.theregister.com/2023/07/01/microsoft_github_copilot/

[13] https://www.theregister.com/2023/02/14/microsoft_ai_bing_error/

[14] https://www.theregister.com/2023/02/08/alphabet_bard_mistake/

[15] https://www.theregister.com/2023/04/26/is_your_ai_hallucinating/

[16] https://www.reddit.com/r/Bard/comments/13rlavz/any_article_with_paywall_can_be_bypassed_and/

[17] https://www.reddit.com/r/bing/comments/10z78yt/bing_ai_works_around_paywalled_articles/

[18] https://bard.google.com/updates

[19] https://blogs.bing.com/

[20] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZKXoANPBNF@b4leqd6TM@QAAAY8&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0

[21] https://whitepapers.theregister.com/



MiguelC

Why (how?) do the LLMs crawl behind the paywalls, in the first place?

badflorist

Because Microsft needs to advertise Bing somehow.

This is some guerrilla marketing crap for Microsoft products. Stop pretending people pay for Bing let alone find workarounds for it... this is just ridiculous.

EvilGardenGnome

Because someone in the pipeline paid for the access to increase the available content. Now that world and dog is using this subscription, someone has realized that EULAs can really, really bite you in the ass.

DS999

Some paywalled sites allow web crawlers (I'm guessing OpenAI uses a web crawler similar to Googlebot to collect its data) to access the full text, so that searches will return their site more often. The problem comes when you see that site in a search, click on it, and find nothing to do with your search terms in what you can see without paying.

heyrick

Can be... interesting... to fiddle your User-Agent to pretend to be a search bot.

FILE_ID.DIZ

Well... might not be that simple.

Google, Bing and DDG, for example, maintain lists of their bot's IP ranges. Google, Bing and DDG also seem to use FCrDNS with a specific domain (googlebot.com and search.msn.com) and DDG uses duckduckbot-X.duckduckgo.com where X is an integer it seems.

Bing bot IP ranges - https://www.bing.com/toolbox/bingbot.json

Google bot IP ranges - https://developers.google.com/static/search/apis/ipranges/googlebot.json

DDG bot IP ranges - https://help.duckduckgo.com/duckduckgo-help-pages/results/duckduckbot/

And as the saying goes - the "good guys" always have to be right. The bad guys (in this example, trying to circumvent a paywall) just have to be right once.

And I have to imagine that writing a middleware to update whatever application(s) is/are responsible to allow spiders in based on third-party provided, non-RFC standardized formated IP data might be harder than just looking for a UA string. At least until someone in the bean counter department notices.

Thank god

heyrick

Sometimes Bing can find stuff that Google is convinced doesn't exist.

The use of AI completely buggered up using Bing on my phone. Pressing the Enter arrow would give a new line in the text rather than starting a search, and there was no obvious on-screen method to get it to actually begin searching instead of trying to get me to edit the text.

At least, for today, the Enter button on the on-screen keyboard is a magnifying glass and it does what it is supposed to.

Even the best of friends cannot attend each other's funeral.
-- Kehlog Albran, "The Profit"