US weather forecasters triple supercomputing oomph with latest machines
(2022/06/29)
- Reference: 1656458114
- News link: https://www.theregister.co.uk/2022/06/28/noaa_dogwood_cactus_supercomputers/
- Source link:
Predicting the weather is a notoriously tricky enterprise, but that’s never held back America's National Oceanic and Atmospheric Administration (NOAA).
After more than two years of development, the agency brought a pair of supercomputers online this week that it says are three times as powerful as the machines they replace, enabling more accurate forecast models.
Developed and maintained by General Dynamics Information Technology under an eight-year contract, the Cactus and Dogwood supers — named after the fauna native to the machines' homes in Phoenix, Arizona, and Manassas, Virginia, respectively — will support larger, higher-resolution models than previously possible.
[1]
The cost to build, house, and support these machines, now operational, will be at least $150 million, we understand; the contract can run to an [2]estimated $505 million.
[3]
[4]
“People are looking for the best possible weather forecast information that they can get,” Brian Gross, director of the Environmental Modeling Center for the National Weather Service, told The Register .
In order to provide better predictions, larger and more complex models are needed, and that’s where Cactus and Dogwood come in, he explained.
[5]
The new systems “will allow us to better capture the physical processes that are going on in the Earth's systems, like formation of clouds, the formation of precipitation, and so forth,” Gross said, adding that they will also enable the National Weather Service to make multiple predictions simultaneously.
The agency claims the improved storage and compute capabilities offered by the twin systems also open the door to more diverse physics models. These include an upgrade to the US Global Forecast System planned for this fall, as well as a new hurricane forecast model called the Hurricane Analysis and Forecast System slated to come online ahead of the 2023 storm season.
Beyond traditional forecast modeling, Cactus and Dogwood will also serve as a testbed for novel applications created by an open community of public and private developers as part of the US Unified Forecast System over the next five years.
[6]
Once the models have been updated to take advantage of the systems, expect to see longer, more accurate forecasts and predictions, David Michaud, director for the Office of Central Processing at the National Weather Service, told The Register . “For things like hurricanes or tropical weather-related forecasts, that can be a very important thing.”
[7]Astra fails, sends NASA's Tropics weather satellites back to Earth
[8]Germany to host Europe's first exascale supercomputer
[9]AI and ML could save the planet – or add more fuel to the climate fire
[10]All-AMD US Frontier supercomputer ousts Japan's Fugaku as No. 1 in Top500
The systems running these models are among NOAA’s most powerful to date, each [11]boasting 12.1 petaflops of peak FP64 performance in production and 26PB of storage. They are said to be three times faster than their predecessors: two Cray and IBM supercomputers in Reston, Virginia, and Orlando, Florida, which will be replaced by Cactus and Dogwood.
The latest duo were built by Cray, which is Hewlett Packard Enterprise’s supercomputing division responsible for building the Oak Ridge National Laboratory’s chart-topping [12]Frontier supercomputer.
For this spring’s Top500 list, the systems each utilized AMD’s 64-core Epyc Rome processors — 327,680 cores worth — and HPE’s Slingshot-10 interconnects to achieve 10.01 petaflops of performance in the Linpack bench. This landed the twins in the [13]No. 49 (Cactus) and [14]50 (Dogwood) spots, notably without the assistance of GPU acceleration.
According to Michaud, the decision to forgo GPUs was influenced in part by the existing code base used by the models. In this case, a GPU-less system offered the greatest performance per dollar.
“It takes a lot of effort to shift the code base to be optimized for a certain type of processor,” he said, adding that that’s not to say NOAA isn’t investigating use cases for GPU acceleration of these models. “We do have a research and development component of our NOAA high-performance computing program, and within that program… we've been exploring GPUs for a number of years.”
According to NOAA, the Cactus and Dogwood systems boost its supercomputing capacity beyond 42 petaflops of combined performance. The agency has research supercomputers in West Virginia, Tennessee, Mississippi, and Colorado, which have a combined capacity of 18 petaflops.
It should be noted that its latest systems won’t be individually tasked. Instead, Cactus and Dogwood will serve as the administration's primary and backup forecasting systems, enabling a degree of redundancy should one of the systems experience a fault.
Whether the agency's five-day forecasts turn out to be more accurate or not, well, you can quite easily be the judge of that, if you live stateside.
For more analysis and data points, check out Timothy Prickett Morgan's take of the news on [15]The Next Platform . ®
Get our [16]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://www.gd.com/Articles/2020/02/21/general-dynamics-awarded-high-performance-computing-contract
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2022/06/13/astra_fail/
[8] https://www.theregister.com/2022/06/16/first_european_exascale/
[9] https://www.theregister.com/2022/06/08/ai_climate_impact/
[10] https://www.theregister.com/2022/05/30/us_frontier_supercomputer_ousts_japans/
[11] https://www.noaa.gov/news-release/us-supercomputers-for-weather-and-climate-forecasts-get-major-bump
[12] https://www.theregister.com/2022/05/30/us_frontier_supercomputer_ousts_japans/
[13] https://www.top500.org/system/179944/
[14] https://www.top500.org/system/179945/
[15] https://www.nextplatform.com/2022/06/28/noaa-gets-3x-more-oomph-for-weather-forecasting-it-needs-3300x/
[16] https://whitepapers.theregister.com/
After more than two years of development, the agency brought a pair of supercomputers online this week that it says are three times as powerful as the machines they replace, enabling more accurate forecast models.
Developed and maintained by General Dynamics Information Technology under an eight-year contract, the Cactus and Dogwood supers — named after the fauna native to the machines' homes in Phoenix, Arizona, and Manassas, Virginia, respectively — will support larger, higher-resolution models than previously possible.
[1]
The cost to build, house, and support these machines, now operational, will be at least $150 million, we understand; the contract can run to an [2]estimated $505 million.
[3]
[4]
“People are looking for the best possible weather forecast information that they can get,” Brian Gross, director of the Environmental Modeling Center for the National Weather Service, told The Register .
In order to provide better predictions, larger and more complex models are needed, and that’s where Cactus and Dogwood come in, he explained.
[5]
The new systems “will allow us to better capture the physical processes that are going on in the Earth's systems, like formation of clouds, the formation of precipitation, and so forth,” Gross said, adding that they will also enable the National Weather Service to make multiple predictions simultaneously.
The agency claims the improved storage and compute capabilities offered by the twin systems also open the door to more diverse physics models. These include an upgrade to the US Global Forecast System planned for this fall, as well as a new hurricane forecast model called the Hurricane Analysis and Forecast System slated to come online ahead of the 2023 storm season.
Beyond traditional forecast modeling, Cactus and Dogwood will also serve as a testbed for novel applications created by an open community of public and private developers as part of the US Unified Forecast System over the next five years.
[6]
Once the models have been updated to take advantage of the systems, expect to see longer, more accurate forecasts and predictions, David Michaud, director for the Office of Central Processing at the National Weather Service, told The Register . “For things like hurricanes or tropical weather-related forecasts, that can be a very important thing.”
[7]Astra fails, sends NASA's Tropics weather satellites back to Earth
[8]Germany to host Europe's first exascale supercomputer
[9]AI and ML could save the planet – or add more fuel to the climate fire
[10]All-AMD US Frontier supercomputer ousts Japan's Fugaku as No. 1 in Top500
The systems running these models are among NOAA’s most powerful to date, each [11]boasting 12.1 petaflops of peak FP64 performance in production and 26PB of storage. They are said to be three times faster than their predecessors: two Cray and IBM supercomputers in Reston, Virginia, and Orlando, Florida, which will be replaced by Cactus and Dogwood.
The latest duo were built by Cray, which is Hewlett Packard Enterprise’s supercomputing division responsible for building the Oak Ridge National Laboratory’s chart-topping [12]Frontier supercomputer.
For this spring’s Top500 list, the systems each utilized AMD’s 64-core Epyc Rome processors — 327,680 cores worth — and HPE’s Slingshot-10 interconnects to achieve 10.01 petaflops of performance in the Linpack bench. This landed the twins in the [13]No. 49 (Cactus) and [14]50 (Dogwood) spots, notably without the assistance of GPU acceleration.
According to Michaud, the decision to forgo GPUs was influenced in part by the existing code base used by the models. In this case, a GPU-less system offered the greatest performance per dollar.
“It takes a lot of effort to shift the code base to be optimized for a certain type of processor,” he said, adding that that’s not to say NOAA isn’t investigating use cases for GPU acceleration of these models. “We do have a research and development component of our NOAA high-performance computing program, and within that program… we've been exploring GPUs for a number of years.”
According to NOAA, the Cactus and Dogwood systems boost its supercomputing capacity beyond 42 petaflops of combined performance. The agency has research supercomputers in West Virginia, Tennessee, Mississippi, and Colorado, which have a combined capacity of 18 petaflops.
It should be noted that its latest systems won’t be individually tasked. Instead, Cactus and Dogwood will serve as the administration's primary and backup forecasting systems, enabling a degree of redundancy should one of the systems experience a fault.
Whether the agency's five-day forecasts turn out to be more accurate or not, well, you can quite easily be the judge of that, if you live stateside.
For more analysis and data points, check out Timothy Prickett Morgan's take of the news on [15]The Next Platform . ®
Get our [16]Tech Resources
[1] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[2] https://www.gd.com/Articles/2020/02/21/general-dynamics-awarded-high-performance-computing-contract
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[6] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/hpc&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33YrvOYhHDzLSyLqJAhAvrpQAAANU&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[7] https://www.theregister.com/2022/06/13/astra_fail/
[8] https://www.theregister.com/2022/06/16/first_european_exascale/
[9] https://www.theregister.com/2022/06/08/ai_climate_impact/
[10] https://www.theregister.com/2022/05/30/us_frontier_supercomputer_ousts_japans/
[11] https://www.noaa.gov/news-release/us-supercomputers-for-weather-and-climate-forecasts-get-major-bump
[12] https://www.theregister.com/2022/05/30/us_frontier_supercomputer_ousts_japans/
[13] https://www.top500.org/system/179944/
[14] https://www.top500.org/system/179945/
[15] https://www.nextplatform.com/2022/06/28/noaa-gets-3x-more-oomph-for-weather-forecasting-it-needs-3300x/
[16] https://whitepapers.theregister.com/
I don't think weather forecasting has gotten much better in the past forty years.
Perhaps with the prediction and accuracy of tornadoes? But run-of-the-mill temperature, precipitation chance, humidity, wind - not much seems to have changed and that's not saying a whole lot.
Still loved it when I was in Los Angeles several years back and the local news channels were all advertising that they had the most powerful Doppler radar in the area. Can't find the commercial, but here's LA ABC7's [1]Mega Doppler 7000 HD page... eyes rolling. (It's stated in the title of the page.)
Oh, and by the way - Los Angeles receives on average 14 inches of rain a year, with 92% of that coming during the rainy season (November to April). Big whoop. [0].
[0] - https://en.wikipedia.org/wiki/Climate_of_Los_Angeles
[1] https://abc7.com/weather/