OpenAI opens ChatGPT floodgates with dirt-cheap API
(2023/03/02)
- Reference: 1677722352
- News link: https://www.theregister.co.uk/2023/03/02/openai_api_chatgpt_whisper/
- Source link:
After a limited trial OpenAI has unleashed its ChatGPT and Whisper models on developers, who can now integrate chatbot interaction and speech-to-text conversion into their own applications through API calls.
ChatGPT is a language model tuned for responding to questions and has attracted considerable attention since its November 30, 2022 [1]debut . Presented with a text prompt, it has a fair chance of formulating an acceptable response if the answer can be found in its training data. Or if queried with [2]a jailbreak prompt , it may reply in a way that violates its safety rules.
Whisper is an automatic speech recognition system [3]released last September . It's capable of turning spoken English into text, which can then be input into ChatGPT or used for any other speech-to-text application, like interview transcription.
[4]
The ChatGPT model family released on Wednesday, gpt-3.5-turbo, is offered at a price of $0.002 per 1,000 tokens (~750 words), which OpenAI says is 10x cheaper than previous GPT-3.5 models. The Whisper large-V2 model is priced at $0.006 / minute. There's also [5]an open source version of the code, though OpenAI admits it can be hard to run.
[6]
[7]
Max Woolf, a data scientist, in an [8]online post , observes that that the API pricing is extraordinarily low.
“I have no idea how OpenAI can make money on this,” he said. “This has to be a loss-leader to lock out competitors before they even get off the ground.”
[9]
There is of course no guarantee these prices won’t rise later.
Accessing ChatGPT with a curl request looks like this: curl https://api.openai.com/v1/chat/completions
-H "Authorization: Bearer $OPENAI_API_KEY"
-H "Content-Type: application/json"
-d '{
"model": "gpt-3.5-turbo",
"messages": [{"role": "user", "content": "What is the OpenAI mission?"}]
}'
Making a call to the Whisper endpoint is similarly uncomplicated.
In preparation for an anticipated rush of paying customers, OpenAI has committed to changes based on feedback from early adopters. This includes: no longer using data submitted via API for service improvements like model training unless customers opt-in; updating its [10]Terms of Service and Usage Policies to clarify "users own the input and output of the models"; and other adjustments.
Furthermore, the company now understands that the stability of its services – [11]something not evident recently – matters.
[12]
"For the past two months our uptime has not met our own expectations nor that of our users," the company said in its [13]blog post . "Our engineering team's top priority is now stability of production use cases – we know that ensuring AI benefits all of humanity requires being a reliable service provider."
That's not quite a Service Level Agreement, but [14]something of the sort may be coming .
OpenAI's aspirational plan to ensure that "AI benefits all of humanity" remains sketchy. But surely bringing mechanical chatter to the wretched of the world begins with availability.
[15]OpenAI offers error-prone AI detector amid fears of a machine-stuffed future
[16]Hey, AI hucksters. Dial down the hype. Lots of love, the FTC
[17]'Major' news: Microsoft slips Bing chatbot shortcut into Windows 11
[18]Hey, AI hucksters. Dial down the hype. Lots of love, the FTC
The possibility that ChatGPT or some more capable successor could upend the search business has [19]alarmed Google executives and convinced Microsoft that its also-ran search service Bing could do better wedded to a browser sidebar of engaging if [20]not always accurate conversation.
OpenAI has been providing early adopter companies with access to these two models through an API. The result is apps like My AI, a chatbot released this week for Snapchat+ subscribers that the messaging company [21]describes as "a personal sidekick to each Snapchatter who chats with it."
Other apps integrating the API include: [22]Q-Chat , a study service Quizlet's ChatGPT-powered tutoring service; [23]Shop , ecommerce platform Shopify's ChatGPT-powered shopping assistant; and [24]Speak , a language learning app that relies on Whisper.
These are just examples of what's possible and OpenAI – a non-profit that opened a [25]for-profit arm in 2019 and has since been [26]showered with money from Microsoft – hopes developers will build other apps that make use of their models in novel but [27]remunerative ways . ®
Get our [28]Tech Resources
[1] https://www.theregister.com/2022/12/03/in_brief_ai/
[2] https://www.jailbreakchat.com/
[3] https://openai.com/research/whisper
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[5] https://github.com/openai/whisper
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[8] https://news.ycombinator.com/item?id=34986033
[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[10] https://platform.openai.com/docs/usage-policies
[11] https://status.openai.com/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[13] https://openai.com/blog/introducing-chatgpt-and-whisper-apis
[14] https://help.openai.com/en/articles/5008641-is-there-an-sla-for-latency-guarantees-on-the-various-engines
[15] https://www.theregister.com/2023/01/31/openai_tool_chatgpt_detection/
[16] https://www.theregister.com/2023/02/28/ftc_warns_ai_hucksters/
[17] https://www.theregister.com/2023/03/01/microsoft_ai_chatgpt_bing/
[18] https://www.theregister.com/2023/02/28/ftc_warns_ai_hucksters/
[19] https://www.theregister.com/2022/12/25/in_brief_ai/
[20] https://www.theregister.com/2023/02/14/microsoft_ai_bing_error/
[21] https://help.snapchat.com/hc/en-us/articles/13266788358932-What-is-My-AI-on-Snapchat-and-how-do-I-use-it-
[22] https://www.prnewswire.com/news-releases/quizlet-launches-q-chat-ai-tutor-built-with-openai-api-301759014.html
[23] https://twitter.com/shop/status/1630995646843944960
[24] https://www.speak.com/blog/speak-openai-speech-recognition
[25] https://openai.com/blog/openai-lp
[26] https://www.theregister.com/2023/01/23/microsoft_openai_applications/
[27] https://openai.com/pricing
[28] https://whitepapers.theregister.com/
ChatGPT is a language model tuned for responding to questions and has attracted considerable attention since its November 30, 2022 [1]debut . Presented with a text prompt, it has a fair chance of formulating an acceptable response if the answer can be found in its training data. Or if queried with [2]a jailbreak prompt , it may reply in a way that violates its safety rules.
Whisper is an automatic speech recognition system [3]released last September . It's capable of turning spoken English into text, which can then be input into ChatGPT or used for any other speech-to-text application, like interview transcription.
[4]
The ChatGPT model family released on Wednesday, gpt-3.5-turbo, is offered at a price of $0.002 per 1,000 tokens (~750 words), which OpenAI says is 10x cheaper than previous GPT-3.5 models. The Whisper large-V2 model is priced at $0.006 / minute. There's also [5]an open source version of the code, though OpenAI admits it can be hard to run.
[6]
[7]
Max Woolf, a data scientist, in an [8]online post , observes that that the API pricing is extraordinarily low.
“I have no idea how OpenAI can make money on this,” he said. “This has to be a loss-leader to lock out competitors before they even get off the ground.”
[9]
There is of course no guarantee these prices won’t rise later.
Accessing ChatGPT with a curl request looks like this: curl https://api.openai.com/v1/chat/completions
-H "Authorization: Bearer $OPENAI_API_KEY"
-H "Content-Type: application/json"
-d '{
"model": "gpt-3.5-turbo",
"messages": [{"role": "user", "content": "What is the OpenAI mission?"}]
}'
Making a call to the Whisper endpoint is similarly uncomplicated.
In preparation for an anticipated rush of paying customers, OpenAI has committed to changes based on feedback from early adopters. This includes: no longer using data submitted via API for service improvements like model training unless customers opt-in; updating its [10]Terms of Service and Usage Policies to clarify "users own the input and output of the models"; and other adjustments.
Furthermore, the company now understands that the stability of its services – [11]something not evident recently – matters.
[12]
"For the past two months our uptime has not met our own expectations nor that of our users," the company said in its [13]blog post . "Our engineering team's top priority is now stability of production use cases – we know that ensuring AI benefits all of humanity requires being a reliable service provider."
That's not quite a Service Level Agreement, but [14]something of the sort may be coming .
OpenAI's aspirational plan to ensure that "AI benefits all of humanity" remains sketchy. But surely bringing mechanical chatter to the wretched of the world begins with availability.
[15]OpenAI offers error-prone AI detector amid fears of a machine-stuffed future
[16]Hey, AI hucksters. Dial down the hype. Lots of love, the FTC
[17]'Major' news: Microsoft slips Bing chatbot shortcut into Windows 11
[18]Hey, AI hucksters. Dial down the hype. Lots of love, the FTC
The possibility that ChatGPT or some more capable successor could upend the search business has [19]alarmed Google executives and convinced Microsoft that its also-ran search service Bing could do better wedded to a browser sidebar of engaging if [20]not always accurate conversation.
OpenAI has been providing early adopter companies with access to these two models through an API. The result is apps like My AI, a chatbot released this week for Snapchat+ subscribers that the messaging company [21]describes as "a personal sidekick to each Snapchatter who chats with it."
Other apps integrating the API include: [22]Q-Chat , a study service Quizlet's ChatGPT-powered tutoring service; [23]Shop , ecommerce platform Shopify's ChatGPT-powered shopping assistant; and [24]Speak , a language learning app that relies on Whisper.
These are just examples of what's possible and OpenAI – a non-profit that opened a [25]for-profit arm in 2019 and has since been [26]showered with money from Microsoft – hopes developers will build other apps that make use of their models in novel but [27]remunerative ways . ®
Get our [28]Tech Resources
[1] https://www.theregister.com/2022/12/03/in_brief_ai/
[2] https://www.jailbreakchat.com/
[3] https://openai.com/research/whisper
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[5] https://github.com/openai/whisper
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[8] https://news.ycombinator.com/item?id=34986033
[9] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[10] https://platform.openai.com/docs/usage-policies
[11] https://status.openai.com/
[12] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZAAtdTnfDm4bvf8SkDmstQAAAEk&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[13] https://openai.com/blog/introducing-chatgpt-and-whisper-apis
[14] https://help.openai.com/en/articles/5008641-is-there-an-sla-for-latency-guarantees-on-the-various-engines
[15] https://www.theregister.com/2023/01/31/openai_tool_chatgpt_detection/
[16] https://www.theregister.com/2023/02/28/ftc_warns_ai_hucksters/
[17] https://www.theregister.com/2023/03/01/microsoft_ai_chatgpt_bing/
[18] https://www.theregister.com/2023/02/28/ftc_warns_ai_hucksters/
[19] https://www.theregister.com/2022/12/25/in_brief_ai/
[20] https://www.theregister.com/2023/02/14/microsoft_ai_bing_error/
[21] https://help.snapchat.com/hc/en-us/articles/13266788358932-What-is-My-AI-on-Snapchat-and-how-do-I-use-it-
[22] https://www.prnewswire.com/news-releases/quizlet-launches-q-chat-ai-tutor-built-with-openai-api-301759014.html
[23] https://twitter.com/shop/status/1630995646843944960
[24] https://www.speak.com/blog/speak-openai-speech-recognition
[25] https://openai.com/blog/openai-lp
[26] https://www.theregister.com/2023/01/23/microsoft_openai_applications/
[27] https://openai.com/pricing
[28] https://whitepapers.theregister.com/