Tech Workers Made ChatGPT Drive a Toyota Corolla
(Tuesday September 29, 2026 @11:30PM (BeauHD)
from the what-will-they-think-of-next dept.)
- Reference: 0185900060
- News link: https://tech.slashdot.org/story/26/09/29/1921233/tech-workers-made-chatgpt-drive-a-toyota-corolla
- Source link:
An anonymous reader quotes a report from 404 Media:
> Some tech workers in San Francisco [1]hooked up ChatGPT to a Toyota Corolla and got it to drive around a parking lot. This may not sound impressive in the age of the self-driving car until you realize that the LLM driving the car was a general purpose chatbot running on a laptop and not the purpose-built driving system based on millions of hours of training data used by Waymo or Tesla.
>
> The people behind the stunt call themselves DrivingBench and they've posted [2]their code , [3]their prompts , and [4]videos of the experiment online. In the experiment, DrivingBench hooked up GPT-6 Astra, Claude Fable 5.1, Grok 4.6, and GPT-5.6 Sol to a Toyota Corolla and gave the LLMs control over the car's steering, accelerator, and brakes. Then they set up a small cone course in a public parking lot and prompted the chatbots to navigate the space.
>
> The goal, they said, was to find out if untrained, off-the-shelf frontier AIs can drive a real car. The results were mixed. Grok, Sol, and Fable only drove a few meters and didn't finish the course. GPT-6 Astra, however, did eventually learn to navigate the course and complete it. But not without a lot of troubleshooting.
"It's an interesting demonstration of potential emergent capabilities," said Mahns. "It can fail a turn, and then the next turn, next try, it will be able to do that turn and other turns that it hasn't seen before. Not necessarily saying LLMs are gonna put Waymo out of business or something, just an interesting demonstration of where things are, and things are just moving fast."
"Most people that are familiar with ChatGPT have used it in this white collar, kind of like in the computer, and it's definitely imminent to the point that this capability will start having more impact in the physical world. So I think seeing the sparks of this happening, the shift of this utility coming into the physical world, is also somewhat exciting."
[1] https://www.404media.co/these-tech-workers-made-chatgpt-drive-a-toyota-corolla/
[2] https://github.com/aditya-ramabadran/drivingbench_harness_v1
[3] https://drivingbench.com/report/
[4] https://drivingbench.com/
> Some tech workers in San Francisco [1]hooked up ChatGPT to a Toyota Corolla and got it to drive around a parking lot. This may not sound impressive in the age of the self-driving car until you realize that the LLM driving the car was a general purpose chatbot running on a laptop and not the purpose-built driving system based on millions of hours of training data used by Waymo or Tesla.
>
> The people behind the stunt call themselves DrivingBench and they've posted [2]their code , [3]their prompts , and [4]videos of the experiment online. In the experiment, DrivingBench hooked up GPT-6 Astra, Claude Fable 5.1, Grok 4.6, and GPT-5.6 Sol to a Toyota Corolla and gave the LLMs control over the car's steering, accelerator, and brakes. Then they set up a small cone course in a public parking lot and prompted the chatbots to navigate the space.
>
> The goal, they said, was to find out if untrained, off-the-shelf frontier AIs can drive a real car. The results were mixed. Grok, Sol, and Fable only drove a few meters and didn't finish the course. GPT-6 Astra, however, did eventually learn to navigate the course and complete it. But not without a lot of troubleshooting.
"It's an interesting demonstration of potential emergent capabilities," said Mahns. "It can fail a turn, and then the next turn, next try, it will be able to do that turn and other turns that it hasn't seen before. Not necessarily saying LLMs are gonna put Waymo out of business or something, just an interesting demonstration of where things are, and things are just moving fast."
"Most people that are familiar with ChatGPT have used it in this white collar, kind of like in the computer, and it's definitely imminent to the point that this capability will start having more impact in the physical world. So I think seeing the sparks of this happening, the shift of this utility coming into the physical world, is also somewhat exciting."
[1] https://www.404media.co/these-tech-workers-made-chatgpt-drive-a-toyota-corolla/
[2] https://github.com/aditya-ramabadran/drivingbench_harness_v1
[3] https://drivingbench.com/report/
[4] https://drivingbench.com/
inputs and outputs (Score:2)
They had the LLM steer the car using a kind of programming language, with function calls that look like this:
> set_motion(right, 60 %, 1.5 m/s, 10 s)
They translated those functions into input for some [1]aftermarket car controlling hardware [comma.ai], which looks kind of cool but I didn't know was a thing.
I couldn't figure out from their report how they returned data back to the LLM, but apparently they pasted images and telemetry into the chat window every so often, or something like that.
[1] https://comma.ai/