Unlimited plans are bullshit for things that have unlimited costs for unlimited usage. In the best case they still rate limit, in the worst case they cancel your account because of some fair usage definition that is nowhere explained because if they tell you the limits it would not be unlimited.

I had Claude and ChatGPT work with each other on a little engineering project, each finding the limitations in the design the other hadn't spotted.

It was actually good fun. Cost me a bit to get all the technical info they both wanted, but I now have a design both insist is absolutely robust, absolutely perfect. But they also both tell me that it's too big to properly process.

Yes, AI itself designed a project the very same AI cannot actually understand.

I now have a very large file, that cost me a fair bit of money to produce, that I'm quite convinced is useless but no AI examining even part can find fault in.

Beyond the fun aspect of having AI defeat itself, the project illustrates two things:

1. If AI can't handle a toy specification, it's never going to be able to handle any complex problem. This means that the "pro" editions are not all that "pro". The processing windows are clearly too small for real problems if my little effort is too big.

2. Anything either AI got right is, by virtue of how I worked on the problem, something the other AI got wrong. Of course, AI doesn't "understand", it's only looking at word patterns, but it shows that the reasoning capacity simply isn't there, regardless of whether the knowledgebase is.

3. I've now got a quite nice benchmark for AI systems. I can ignore any AI that can't cope. If it hasn't got the capacity to handle any trivial problem, because the complexity is too high, then it won't manage any real problem better.

I know they say higher rate limits, I but can't help worrying if this will be like Google did with Colab Pro, where you have to pay more to keep the capabilities you were using, and they nerf the pay tier you were using?