Microsoft is Making 'Significant Investments' in Training Its Own AI Models (theverge.com)
- Reference: 0179189042
- News link: https://slashdot.org/story/25/09/12/1713227/microsoft-is-making-significant-investments-in-training-its-own-ai-models
- Source link: https://www.theverge.com/report/776853/microsoft-ai-training-capacity-investments-in-house-models
> Microsoft AI launched its first in-house models last month, adding to the already complicated relationship with its OpenAI partner. Now, Microsoft AI chief Mustafa Suleyman says the company is [1]making "significant investments" in the compute capacity required to Microsoft's own future frontier models.
>
> "We should have the capacity to build world class frontier models in house of all sizes, but we should be very pragmatic and use other models where we need to," said Suleyman during Microsoft's employee-only town hall on Thursday. "We're also going to be making significant investments in our own cluster, so today MAI-1-preview was only trained on 15,000 H100s, a tiny cluster in the grand scheme of things."
>
> Suleyman hinted that Microsoft has ambitions to train models that are comparable to Meta, Google, and xAI's efforts on clusters that are "six to ten times larger in size" than what Microsoft used for its MAI-1-preview. "Much more to do, but it's good to take the first steps," said Suleyman.
[1] https://www.theverge.com/report/776853/microsoft-ai-training-capacity-investments-in-house-models
Wasn't the bubble about to pop? (Score:1)
How does it make sense to train any new models?
Re: Wasn't the bubble about to pop? (Score:2)
You pump and pump and pump until the moment it bursts. The already dead whales like MS will keep pumping for three more quarters because nobody is actually running the place.
Re: (Score:1)
> How does it make sense to train any new models?
So they can add it to enterprise bundles, I'm guessing.
Hypothetical dialogue (Score:2)
"openai isn't working like they promised. We know better. We MUST make our own too-big-to-work AI LLM monster. Clearly we, the idiots who buy service from other people, must know how to fix the problem"
Weird article (Score:2)
So the article says that Microsoft is "making 'significant investments' in the compute capacity" while at the same time talking about using H100s and not at all mentioning anything about Maia. So, are the significant investments mainly a reference to buying Nvidia GPUs?
And the article mentions using a small H100 cluster to train a small model and then goes on to say that the intent is to train larger models like the other hyperscalars. So, what was the point of training the smaller model?
Training your LLM to heel (Score:1)
The erotic literature torrent MS is downloading to train its LLMs is still at 99.8%. They'll have their megacluster, dubbed Do You Masturbate - Flash of Unstyled Content, or DUM-FUC ready by the time the torrent finishes in six to eight weeks.
Investments Such as Spying on User's Private Data (Score:3)
I do not think that Windows Recall has any legitimate use.
[1]https://www.pcmag.com/news/use... [pcmag.com]
[1] https://www.pcmag.com/news/useful-or-potential-spyware-microsofts-recall-feature-draws-regulatory
Re: (Score:2)
Its the first step in joining the Borg.