NASA, IBM just open sourced an AI climate model so you can fine-tune your own
(2024/09/25)
- Reference: 1727249105
- News link: https://www.theregister.co.uk/2024/09/25/nasa_ibm_ai_weather/
- Source link:
Researchers at IBM and NASA this week released an open source AI climate model designed to accurately predict weather patterns while consuming fewer compute resources compared to traditional physics-based simulations.
Developed as part of a collaboration between IBM and NASA with help from the US Department of Energy's Oak Ridge National Laboratory, the 2.3 billion parameter foundation model called Prithvi WxC was trained on 40 years of observation data from NASA's Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) dataset.
Despite the model's diminutive size, researchers say it was still able to accurately generate global surface temperatures using a random sample that contained just 5 percent of the original data. They also believe the model is particularly well suited to simulating the behavior of hurricanes and atmospheric rivers. However, the model's real advantage may just be its flexibility.
[1]
IBM and NASA aren't the only ones experimenting with AI models for weather and climate forecasting. For example, researchers at Google [2]detailed a novel approach to bolstering the accuracy of forecasts by augmenting existing physics models with machine learning. Meanwhile, Nvidia has been hard at work [3]expanding the capabilities of its Earth-2 climate models.
[4]
[5]
What sets IBM and NASA's efforts apart is that Prithvi WxC is a foundation model, which means it can be adapted to serve any number of use cases ranging from short-term weather forecasting to long-term climate projections.
"This space has seen the emergence of large AI models that focus on a fixed dataset and single use case — primarily forecasting. We have designed our weather and climate foundation model to go beyond such limitations so that it can be tuned to a variety of inputs and uses," Juan Bernabe-Moreno, director of IBM Research Europe, said in a [6]statement this week.
[7]
To support the creation of new climate models based on Prithvi WxC, IBM and NASA have [8]released it on Hugging Face alongside a pair of fine-tuned models designed for climate and weather downscaling and gravity wave parameterization.
If you're not familiar with weather downscaling, it [9]refers to taking low-resolution inputs, like temperature precipitation, or wind speed, from a larger-scale model and using statistical or dynamic probabilities to generate a higher resolution forecast. Gravity waves on the other hand are a [10]phenomenon which affect various atmospheric processes including cloud formation and even aircraft turbulence.
The goal that researchers around the globe will be able to take these models and adapt them to their particular needs, whether that be improving warning times for severe weather or improving global climate simulations.
[11]
"The NASA foundation model will help us produce a tool that people can use [for] weather, season and climate projections to help inform decisions on how to prepare, respond, and mitigate," Karen St Germain, director of NASA's Earth Science Division, said in a statement.
[12]Look to the skies this weekend as solar storms strike Earth
[13]The secret to better weather forecasts may be a dash of AI
[14]First of ESA's Cluster satellites prepares for fiery finale over South Pacific
[15]Nvidia's latest AI climate model takes aim at severe weather
And because Prithvi WxC is so small, this may not even require that much compute, at least not compared to the large language models that power AI chatbots like Copilot or Gemini. According to the [16]paper , the model was trained from scratch using a relatively small cluster of 64 Nvidia A100s.
In theory, fine-tuning the model should require far, far less than that, making it well within reach for various climate centers, many of which are already upgrading their supercomputing clusters with GPU partitions.
According to IBM, one of the first to put the model to use is the Canadian government, which has begun adapting the model to include additional weather forecasting use cases. In particular, Environment and Climate Change Canada (ECCC), the department heading up the project, is looking to use the model for very short-term precipitation forecasts by feeding real-time radar data into the model. The ECCC is also experimenting with downscaling to generate forecasts down to kilometer scale.
Get our [17]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://www.theregister.com/2024/07/27/google_ai_weather/
[3] https://www.theregister.com/2024/08/19/nvidia_ai_weather/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://newsroom.ibm.com/2024-09-23-ibm-and-nasa-release-open-source-ai-model-on-hugging-face-for-weather-and-climate-applications
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://huggingface.co/Prithvi-WxC
[9] https://www.gfdl.noaa.gov/climate-model-downscaling/
[10] https://www.weather.gov/source/zhu/ZHU_Training_Page/Miscellaneous/gravity_wave/gravity_wave.html
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[12] https://www.theregister.com/2024/05/10/g4class_solar_storm/
[13] https://www.theregister.com/2024/07/27/google_ai_weather/
[14] https://www.theregister.com/2024/08/23/esa_cluster_reentry/
[15] https://www.theregister.com/2024/08/19/nvidia_ai_weather/
[16] https://arxiv.org/abs/2409.13598
[17] https://whitepapers.theregister.com/
Developed as part of a collaboration between IBM and NASA with help from the US Department of Energy's Oak Ridge National Laboratory, the 2.3 billion parameter foundation model called Prithvi WxC was trained on 40 years of observation data from NASA's Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) dataset.
Despite the model's diminutive size, researchers say it was still able to accurately generate global surface temperatures using a random sample that contained just 5 percent of the original data. They also believe the model is particularly well suited to simulating the behavior of hurricanes and atmospheric rivers. However, the model's real advantage may just be its flexibility.
[1]
IBM and NASA aren't the only ones experimenting with AI models for weather and climate forecasting. For example, researchers at Google [2]detailed a novel approach to bolstering the accuracy of forecasts by augmenting existing physics models with machine learning. Meanwhile, Nvidia has been hard at work [3]expanding the capabilities of its Earth-2 climate models.
[4]
[5]
What sets IBM and NASA's efforts apart is that Prithvi WxC is a foundation model, which means it can be adapted to serve any number of use cases ranging from short-term weather forecasting to long-term climate projections.
"This space has seen the emergence of large AI models that focus on a fixed dataset and single use case — primarily forecasting. We have designed our weather and climate foundation model to go beyond such limitations so that it can be tuned to a variety of inputs and uses," Juan Bernabe-Moreno, director of IBM Research Europe, said in a [6]statement this week.
[7]
To support the creation of new climate models based on Prithvi WxC, IBM and NASA have [8]released it on Hugging Face alongside a pair of fine-tuned models designed for climate and weather downscaling and gravity wave parameterization.
If you're not familiar with weather downscaling, it [9]refers to taking low-resolution inputs, like temperature precipitation, or wind speed, from a larger-scale model and using statistical or dynamic probabilities to generate a higher resolution forecast. Gravity waves on the other hand are a [10]phenomenon which affect various atmospheric processes including cloud formation and even aircraft turbulence.
The goal that researchers around the globe will be able to take these models and adapt them to their particular needs, whether that be improving warning times for severe weather or improving global climate simulations.
[11]
"The NASA foundation model will help us produce a tool that people can use [for] weather, season and climate projections to help inform decisions on how to prepare, respond, and mitigate," Karen St Germain, director of NASA's Earth Science Division, said in a statement.
[12]Look to the skies this weekend as solar storms strike Earth
[13]The secret to better weather forecasts may be a dash of AI
[14]First of ESA's Cluster satellites prepares for fiery finale over South Pacific
[15]Nvidia's latest AI climate model takes aim at severe weather
And because Prithvi WxC is so small, this may not even require that much compute, at least not compared to the large language models that power AI chatbots like Copilot or Gemini. According to the [16]paper , the model was trained from scratch using a relatively small cluster of 64 Nvidia A100s.
In theory, fine-tuning the model should require far, far less than that, making it well within reach for various climate centers, many of which are already upgrading their supercomputing clusters with GPU partitions.
According to IBM, one of the first to put the model to use is the Canadian government, which has begun adapting the model to include additional weather forecasting use cases. In particular, Environment and Climate Change Canada (ECCC), the department heading up the project, is looking to use the model for very short-term precipitation forecasts by feeding real-time radar data into the model. The ECCC is also experimenting with downscaling to generate forecasts down to kilometer scale.
Get our [17]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://www.theregister.com/2024/07/27/google_ai_weather/
[3] https://www.theregister.com/2024/08/19/nvidia_ai_weather/
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[6] https://newsroom.ibm.com/2024-09-23-ibm-and-nasa-release-open-source-ai-model-on-hugging-face-for-weather-and-climate-applications
[7] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[8] https://huggingface.co/Prithvi-WxC
[9] https://www.gfdl.noaa.gov/climate-model-downscaling/
[10] https://www.weather.gov/source/zhu/ZHU_Training_Page/Miscellaneous/gravity_wave/gravity_wave.html
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_offbeat/science&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZvPfR7ohtnBbGrLsxKYOqQAAAkE&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[12] https://www.theregister.com/2024/05/10/g4class_solar_storm/
[13] https://www.theregister.com/2024/07/27/google_ai_weather/
[14] https://www.theregister.com/2024/08/23/esa_cluster_reentry/
[15] https://www.theregister.com/2024/08/19/nvidia_ai_weather/
[16] https://arxiv.org/abs/2409.13598
[17] https://whitepapers.theregister.com/
Re: While forecast is a classic case of learning from past observations
b0llchit
The historic data would already contain significant information about the changing of the climate. The model should be able to extrapolate if it at least includes concentrations of the different atmospheric gasses.
But, remember, the results are just statistical inference and may be everything from spot-on to completely off the rails, with (probably exponentially) increasing uncertainties further into the modelled future.
"a relatively small cluster of 64 Nvidia A100s"
Pascal Monett
So now you can have your own weather forcast for, what, only 6 A100s ? At $8,000+ a piece ?
Or you might choose to rent them on a cloud platform for only $2 per hour.
A bargain, I say !
While forecast is a classic case of learning from past observations
How does this approach deal with changing climate or extreme weather events?