Stack Overflow to charge LLM developers for access to its coding content
(2024/03/01)
- Reference: 1709299334
- News link: https://www.theregister.co.uk/2024/03/01/stack_overflow_launches_api_to/
- Source link:
Stack Overflow has launched an API that will require all AI models trained on its coding question-and-answer content to attribute sources linking back to its posts. And it will cost money to use the site's content.
"All products based on models that consume public Stack Overflow data are required to provide attribution back to the highest relevance posts that influenced the summary given by the model," it confirmed in a [1]statement .
The Overflow API is designed to act as a knowledge database to help developers build more accurate and helpful code-generation models. Google announced it was using the service to access relevant information from Stack Overflow via the API and integrate the data with its latest Gemini models, and for its cloud storage console.
[2]
"This partnership brings our enterprise AI platform together with the most in-depth and popular developer knowledge platform available today," Thomas Kurian, CEO at Google Cloud, [3]declared in a statement.
[4]
[5]
"Google Cloud and Stack Overflow will help developers more effectively use AI in the platforms they prefer, combining the vast knowledge from the Stack Overflow community and new AI capabilities, powered by Vertex AI and Google Cloud's trusted, secure infrastructure."
Overflow API will give Gemini the ability to generate code and answer programming-related questions by referencing content posted and curated on Stack Overflow. Meanwhile, developers will be able to access the platform's information directly inside Google Cloud Console to ask cloud and infrastructure questions.
[6]What is GitHub Copilot Enterprise? You and your org just might find out firsthand
[7]Mamas, don't let your babies grow up to be coders, Jensen Huang warns
[8]Going with the flow makes AI better at solving coding problems
[9]If you use AI to teach you how to code, remember you still need to think for yourself
Google has [10]previously explained that it will collect public resources on the web to train models. Stack Overflow, however, believes it should be compensated for its content – [11]made up of more than 58 million questions and answers.
"In the AI era, Stack Overflow has maintained that the foundation of trusted and accurate data will be central to how technology solutions are built, with millions of the world's developers coming to our platform as one of the few high quality sources of information with community attribution at its core," said CEO Prashanth Chandrasekar.
[12]
As our sister site DevClass [13]notes , "last year some moderators declared a [14]“general moderator strike” over being restricted from removing AI-generated answers. The company is also developing [15]OverflowAI as an AI-driven service, presumably now using Google AI under the covers."
With developers increasingly turning to chatbots to answer their questions, traffic to Stack Overflow has steadily [16]dropped over time. The platform, however, believes that it is more relevant than ever – considering that AI will need fresh data created by humans.
"The best content has a human at its core. [Generative AI] can only respond with what has already been published – it won't provide any data or insightful feedback on anything created after its last data ingestion. What does a human component provide? Humans provide up-to-date information, identify patterns early on, and add signals around the social value of knowledge within a community, providing context to the content," it concluded. ®
Get our [17]Tech Resources
[1] https://stackoverflow.blog/2024/02/29/defining-socially-responsible-ai-how-we-select-api-partners/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://stackoverflow.co/company/press/archive/google-cloud-strategic-gen-ai-partnership
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2024/02/27/github_copilot_enterprise/
[7] https://www.theregister.com/2024/02/27/jensen_huang_coders/
[8] https://www.theregister.com/2024/02/19/codium_ai_interview/
[9] https://www.theregister.com/2024/01/27/ai_coding_automatic/
[10] https://www.theregister.com/2023/07/06/google_ai_models_internet_scraping/
[11] https://stackoverflow.co/advertising/why-stack/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[13] https://devclass.com/2024/02/29/stack-overflow-turns-to-google-for-hosting-and-ai-features-trusts-in-gemini-for-tech-answers/
[14] https://devclass.com/2023/06/05/stack-overflow-volunteer-moderators-down-tools-over-secret-new-policy-that-obstructs-removal-of-ai-generated-content/
[15] https://devclass.com/2023/07/28/stack-overflow-unveils-overflowai-and-vs-code-add-in/
[16] https://devclass.com/2023/05/15/stack-overflow-traffic-drops-as-developers-turn-to-ai-coding-assistants/
[17] https://whitepapers.theregister.com/
"All products based on models that consume public Stack Overflow data are required to provide attribution back to the highest relevance posts that influenced the summary given by the model," it confirmed in a [1]statement .
The Overflow API is designed to act as a knowledge database to help developers build more accurate and helpful code-generation models. Google announced it was using the service to access relevant information from Stack Overflow via the API and integrate the data with its latest Gemini models, and for its cloud storage console.
[2]
"This partnership brings our enterprise AI platform together with the most in-depth and popular developer knowledge platform available today," Thomas Kurian, CEO at Google Cloud, [3]declared in a statement.
[4]
[5]
"Google Cloud and Stack Overflow will help developers more effectively use AI in the platforms they prefer, combining the vast knowledge from the Stack Overflow community and new AI capabilities, powered by Vertex AI and Google Cloud's trusted, secure infrastructure."
Overflow API will give Gemini the ability to generate code and answer programming-related questions by referencing content posted and curated on Stack Overflow. Meanwhile, developers will be able to access the platform's information directly inside Google Cloud Console to ask cloud and infrastructure questions.
[6]What is GitHub Copilot Enterprise? You and your org just might find out firsthand
[7]Mamas, don't let your babies grow up to be coders, Jensen Huang warns
[8]Going with the flow makes AI better at solving coding problems
[9]If you use AI to teach you how to code, remember you still need to think for yourself
Google has [10]previously explained that it will collect public resources on the web to train models. Stack Overflow, however, believes it should be compensated for its content – [11]made up of more than 58 million questions and answers.
"In the AI era, Stack Overflow has maintained that the foundation of trusted and accurate data will be central to how technology solutions are built, with millions of the world's developers coming to our platform as one of the few high quality sources of information with community attribution at its core," said CEO Prashanth Chandrasekar.
[12]
As our sister site DevClass [13]notes , "last year some moderators declared a [14]“general moderator strike” over being restricted from removing AI-generated answers. The company is also developing [15]OverflowAI as an AI-driven service, presumably now using Google AI under the covers."
With developers increasingly turning to chatbots to answer their questions, traffic to Stack Overflow has steadily [16]dropped over time. The platform, however, believes that it is more relevant than ever – considering that AI will need fresh data created by humans.
"The best content has a human at its core. [Generative AI] can only respond with what has already been published – it won't provide any data or insightful feedback on anything created after its last data ingestion. What does a human component provide? Humans provide up-to-date information, identify patterns early on, and add signals around the social value of knowledge within a community, providing context to the content," it concluded. ®
Get our [17]Tech Resources
[1] https://stackoverflow.blog/2024/02/29/defining-socially-responsible-ai-how-we-select-api-partners/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://stackoverflow.co/company/press/archive/google-cloud-strategic-gen-ai-partnership
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://www.theregister.com/2024/02/27/github_copilot_enterprise/
[7] https://www.theregister.com/2024/02/27/jensen_huang_coders/
[8] https://www.theregister.com/2024/02/19/codium_ai_interview/
[9] https://www.theregister.com/2024/01/27/ai_coding_automatic/
[10] https://www.theregister.com/2023/07/06/google_ai_models_internet_scraping/
[11] https://stackoverflow.co/advertising/why-stack/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZeIJuC7vvyePyvsHIMWCfQAAAcM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[13] https://devclass.com/2024/02/29/stack-overflow-turns-to-google-for-hosting-and-ai-features-trusts-in-gemini-for-tech-answers/
[14] https://devclass.com/2023/06/05/stack-overflow-volunteer-moderators-down-tools-over-secret-new-policy-that-obstructs-removal-of-ai-generated-content/
[15] https://devclass.com/2023/07/28/stack-overflow-unveils-overflowai-and-vs-code-add-in/
[16] https://devclass.com/2023/05/15/stack-overflow-traffic-drops-as-developers-turn-to-ai-coding-assistants/
[17] https://whitepapers.theregister.com/
Re: "traffic to Stack Overflow has steadily dropped over time"
Yet Another Anonymous coward
So stackoverflow starts to find ways to hide public generated content behind a paywall. Only question is his you make a suggestively named URL from stack overflow
"traffic to Stack Overflow has steadily dropped over time"
And that will continue in inverse relation with just how much Stack Overflow considers itself a money-making tool versus a public utility.
The more Stack orients itself towards making money and locking down its content, the less people will go to it.
[1]Tek Tips is a site that has never changed its objective : being useful to the public. It has competent people in every one of its forums, and I have never had a bad experience on that site.
Stack, on the other hand, has form in restricting its content unless you pay, thereby declaring its basic intent. Stack is not my first choice destination to solve a problem I might have.
[1] https://www.tek-tips.com/