Google DeepMind's GraphCast AI weather predictor looks fascinating on paper but ...
(2023/11/15)
- Reference: 1700036892
- News link: https://www.theregister.co.uk/2023/11/15/google_deepmind_graphcast/
- Source link:
Google DeepMind claims its latest AI model is capable of generating ten-day weather forecasts in under a minute and is just as accurate as traditional predictive models running on supercomputers.
In a paper [1]published in Science on Tuesday, researchers described GraphCast: a graph neural network made up of 36.7 million parameters. Trained on 39 years of data collected from 1979 to 2017 by the European Centre for Medium-Range Weather Forecasts (ECMWF) – a research institute that crunches global numerical weather predictions 24/7 – the system produces a ten-day weather forecast, split into six-hour increments.
The ECMWF's models rely on numerical weather prediction methods that run mathematical simulations modelling the motion of the atmosphere and oceans with fluid dynamics equations. GraphCast, however, looks at the weather patterns in satellite images, radar, and measurements from meteorological stations to make its predictions.
[2]
The model splits global maps containing information about the atmospheric and oceanic data into grids, and is trained to learn the relationships between the different weather variables that lead to specific events – like tropical cyclone tracks, atmospheric rivers, and heat waves. GraphCast predicts factors like the temperature, wind speed and direction, humidity, and air pressure at 37 different altitudes to help forecast the weather.
[3]
[4]
"In a comprehensive performance evaluation against the gold-standard deterministic system, [the ECMWF's High Resolution Forecast], GraphCast provided more accurate predictions on more than 90 percent of 1,380 test variables and forecast lead times," [5]declared Remi Lam, lead author of the paper and a staff research scientist at Google DeepMind.
"When we limited the evaluation to the troposphere, the 6–20 kilometer high region of the atmosphere nearest to Earth's surface where accurate forecasting is most important, our model outperformed HRES on 99.7 percent of the test variables for future weather," he added.
[6]If it's going to rain within the next 90 mins, this very British AI system can warn you
[7]Here comes an AI that can predict hurricane strength. Don't worry, NASA made it so it probably actually works
[8]What could power an early-warning system for harmful radiation storms in Earth's Van Allen belts? AI? Let's see, say Los Alamos boffins
Although the training process for GraphCast is computationally intensive and required running a cluster of 32 Google's Cloud TPU v4 chips over four weeks, the final trained model can be run on a single Google TPU v4 machine (which [9]includes four TPU v4 chips ). A ten-day forecast can be generated in under a minute, beating the hours it typically takes numerical weather prediction models running on supercomputers.
Like all AI models, GraphCast's performance is dependent on the quality of its data. "GraphCast is now the most accurate ten-day global weather forecasting system in the world, and can predict extreme weather events further into the future than was previously possible. As the weather patterns evolve in a changing climate, GraphCast will evolve and improve as higher quality data becomes available," Lam claimed.
[10]
GraphCast's forecasts aren't perfect, however. The data it generates is sometimes incomplete, and spatial blurring occurs in areas of uncertainty – meaning its predictions might not be useful when trying to calculate probabilities of different weather events, known as ensemble forecasts. It also struggles to generate predictions for atmospheric data high in the stratosphere as well as the ECMWF's High Resolution Forecast system.
So can AI replace older, clunkier numerical weather prediction models? Not really, unfortunately.
The researchers admitted that GraphCast relied on traditional methods to obtain quality data in the first place, and that the ECMWF's High Resolution Forecast system can produce other types of forecasts that AI cannot yet.
[11]
"Our approach should not be regarded as a replacement for traditional weather forecasting methods, which have been developed for decades, rigorously tested in many real-world contexts, and offer many features we have not yet explored," they concluded in their paper.
"Rather our work should be interpreted as evidence that [machine learning-based weather prediction] is able to meet the challenges of real-world forecasting problems and has potential to complement and improve the current best methods."
Google DeepMind has released the code for GraphCast [12]here . ®
Get our [13]Tech Resources
[1] https://www.science.org/doi/10.1126/science.adi2336
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://deepmind.google/discover/blog/graphcast-ai-model-for-faster-and-more-accurate-global-weather-forecasting/
[6] https://www.theregister.com/2021/09/30/ai_model_rain_deepminnd/
[7] https://www.theregister.com/2020/09/03/ai_hurricane_prediction/
[8] https://www.theregister.com/2020/03/04/los_alamos_van_allen_belts_ai/
[9] https://cloud.google.com/tpu/pricing
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[12] https://github.com/google-deepmind/graphcast
[13] https://whitepapers.theregister.com/
In a paper [1]published in Science on Tuesday, researchers described GraphCast: a graph neural network made up of 36.7 million parameters. Trained on 39 years of data collected from 1979 to 2017 by the European Centre for Medium-Range Weather Forecasts (ECMWF) – a research institute that crunches global numerical weather predictions 24/7 – the system produces a ten-day weather forecast, split into six-hour increments.
The ECMWF's models rely on numerical weather prediction methods that run mathematical simulations modelling the motion of the atmosphere and oceans with fluid dynamics equations. GraphCast, however, looks at the weather patterns in satellite images, radar, and measurements from meteorological stations to make its predictions.
[2]
The model splits global maps containing information about the atmospheric and oceanic data into grids, and is trained to learn the relationships between the different weather variables that lead to specific events – like tropical cyclone tracks, atmospheric rivers, and heat waves. GraphCast predicts factors like the temperature, wind speed and direction, humidity, and air pressure at 37 different altitudes to help forecast the weather.
[3]
[4]
"In a comprehensive performance evaluation against the gold-standard deterministic system, [the ECMWF's High Resolution Forecast], GraphCast provided more accurate predictions on more than 90 percent of 1,380 test variables and forecast lead times," [5]declared Remi Lam, lead author of the paper and a staff research scientist at Google DeepMind.
"When we limited the evaluation to the troposphere, the 6–20 kilometer high region of the atmosphere nearest to Earth's surface where accurate forecasting is most important, our model outperformed HRES on 99.7 percent of the test variables for future weather," he added.
[6]If it's going to rain within the next 90 mins, this very British AI system can warn you
[7]Here comes an AI that can predict hurricane strength. Don't worry, NASA made it so it probably actually works
[8]What could power an early-warning system for harmful radiation storms in Earth's Van Allen belts? AI? Let's see, say Los Alamos boffins
Although the training process for GraphCast is computationally intensive and required running a cluster of 32 Google's Cloud TPU v4 chips over four weeks, the final trained model can be run on a single Google TPU v4 machine (which [9]includes four TPU v4 chips ). A ten-day forecast can be generated in under a minute, beating the hours it typically takes numerical weather prediction models running on supercomputers.
Like all AI models, GraphCast's performance is dependent on the quality of its data. "GraphCast is now the most accurate ten-day global weather forecasting system in the world, and can predict extreme weather events further into the future than was previously possible. As the weather patterns evolve in a changing climate, GraphCast will evolve and improve as higher quality data becomes available," Lam claimed.
[10]
GraphCast's forecasts aren't perfect, however. The data it generates is sometimes incomplete, and spatial blurring occurs in areas of uncertainty – meaning its predictions might not be useful when trying to calculate probabilities of different weather events, known as ensemble forecasts. It also struggles to generate predictions for atmospheric data high in the stratosphere as well as the ECMWF's High Resolution Forecast system.
So can AI replace older, clunkier numerical weather prediction models? Not really, unfortunately.
The researchers admitted that GraphCast relied on traditional methods to obtain quality data in the first place, and that the ECMWF's High Resolution Forecast system can produce other types of forecasts that AI cannot yet.
[11]
"Our approach should not be regarded as a replacement for traditional weather forecasting methods, which have been developed for decades, rigorously tested in many real-world contexts, and offer many features we have not yet explored," they concluded in their paper.
"Rather our work should be interpreted as evidence that [machine learning-based weather prediction] is able to meet the challenges of real-world forecasting problems and has potential to complement and improve the current best methods."
Google DeepMind has released the code for GraphCast [12]here . ®
Get our [13]Tech Resources
[1] https://www.science.org/doi/10.1126/science.adi2336
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://deepmind.google/discover/blog/graphcast-ai-model-for-faster-and-more-accurate-global-weather-forecasting/
[6] https://www.theregister.com/2021/09/30/ai_model_rain_deepminnd/
[7] https://www.theregister.com/2020/09/03/ai_hurricane_prediction/
[8] https://www.theregister.com/2020/03/04/los_alamos_van_allen_belts_ai/
[9] https://cloud.google.com/tpu/pricing
[10] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_software/aiml&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33ZVSk1taGJxtK7n5JmbNu4wAAAIA&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[12] https://github.com/google-deepmind/graphcast
[13] https://whitepapers.theregister.com/
Questions
Mike 137
" Trained on 39 years of data collected from 1979 to 2017 by the European Centre for Medium-Range Weather Forecasts (ECMWF) "
[1] As the training has a finite cut-off, will the AI adapt to changing climatic conditions?
I suspect it will need tweaking to account for climate change.
[2] Are less than 40 years worth of data sufficient?
Probably not, but that's all that seems to be available.
[3] Is an empirical model based on observations as good as a parametric model based on the relevant physics?
This seems a retrograde step to how weather forecasting was done some 150 years ago.
I would also like to know its spatial resolution -- this really matters in terms of local relevance of forecasts.
So what does it say to to the " [1]lady from Wales who asked if there is going to be a hurricane" ?
[1] https://www.netweather.tv/1987-great-storm