WoFS in the virtual NOAA Hazardous Weather Testbed


The first week of April concluded the end of the 2021 Warn-on-Forecast Testbed Experiment as part of the NOAA Hazardous Weather Testbed. In this experiment, a total of 16 forecasters from nine southern regions National Weather Service Forecast Offices (WFOs), the NOAA NWS Storm Prediction Center (SPC), and the NOAA NWS Weather Prediction Center (WPC) came together over four weeks to explore the use of Warn-on-Forecast System (WoFS) guidance in the watch-to-warning time frame.

Like many other scientific activities, this experiment was delayed and then moved virtually due to the ongoing COVID-19 pandemic. Despite the many challenges this unique situation presented, our research team is pleased to report the experiment was very successful. This success is attributable to the significant efforts of numerous University of Oklahoma Cooperative Institute for Mesoscale Meteorological Studies (CIMMS) and NOAA National Severe Storms Laboratory scientists, as well as participants and collaborators in the NWS

Together, Pat Skinner (with OU CIMMS/NSSL), Patrick Burke (with NSSL), Burkely Gallo (with OU CIMMS/SPC), and I (Katie Wilson with OU CIMMS/NSSL) designed and executed this experiment to examine how forecasters envision WoFS guidance fitting into both their existing and visionary forecast processes, and to explore the ways that WoFS guidance can be used most effectively given national center and local office forecasting responsibilities.

A screenshot showing an experimental National Weather Service severe weather graphic. The black graphic shows storm areas highlighted.
An example of an experimental decision support graphic influenced by WoFS and constructed during one of the 2021 WoFS experiment case studies. (Screenshot)

A Collaborative Undertaking

During the experiment, Skinner delivered an overview presentation to build familiarity with WoFS guidance prior to participants’ completion of two case studies. These cases formed the first of two major activities during the experiment, which was for participants to immerse themselves in simulated real-time events and use WoFS guidance to make forecast and communication decisions. 

To prepare for the case study activity, each week Burke provided participants with a hands-on AWIPS-2 demo. Furthermore, his work to design AWIPS-2 perspectives and procedures, which was conducted jointly with Gallo, enabled a simulation setup that was more familiar to participants, especially to those from national centers who do not use AWIPS-2 in the way local office forecasters do.

A screenshot of the experimental WoFS guidance in the AWIPS-2 viewer.
For the first time, experimental WoFS guidance was viewable in the AWIPS-2 interface.

The preparation of these case studies was a major task undertaken by Jonny Madden (OU CIMMS/NSSL), Justin Monroe (OU CIMMS/NSSL), Jorge Guerra (OU CIMMS/NSSL), and Dale Morris (OU CIMMS/NWS Warning Decision Training Division).

The case studies presented two notable firsts:

  • Running AWIPS-2 in-the-cloud such that participants could complete the case studies from their own homes, and;
  • Presenting WoFS guidance in AWIPS-2, including the development of a tool to visualize paintball plots. 

Madden, Monroe, Guerra, and Morris worked together to accomplish numerous tasks, including: aggregating and processing a full suite of observational and model datasets for both cases, setting up the WES- 2 Bridge and AWIPS-2 interfaces, and collaborating with federal partners to get datasets onto the cloud framework. Much of what was accomplished for the case study portion of this experiment has laid the AWIPS-2 in-the-cloud groundwork for future virtual experiments. 

The second major activity during the experiment was focus groups. Together, Wilson and Gallo led three semi-structured discussions each week to explore forecasters’ visions for how WoFS will impact the current and future forecast process. Additionally, the presence of both national center and local office forecasters meant that much was learned about each others’ workflows, how one another makes decisions, and where there is an opportunity to strengthen collaboration. In a post-experiment questionnaire, participants rated the focus groups as a highly effective activity for sharing thoughts and ideas, and was the most enjoyed activity of the week.

A graphic showing how the team used Google Meet Jam Board to spur discussion. The graphic has two circles, with forecast offices in one area and SPC and WPC in another.
The team used the Google Meet jam board to spur discussion in focus groups.

In addition to the efforts of scientists at OU CIMMS and NOAA NSSL, we were grateful for input from our collaborators at NWS Southern Region, including Chad Gravelle (SR HQ), Todd Lindley (OUN SOO), Stephen Bieda (AMA SOO), and Randy Bowers (OUN). Gravelle and Lindleyalso joined the experiment for multiple weeks, and Randy created two excellent weather briefing videos to prepare forecasters for the case studies. A big thank you also goes to our pilot participants, Laren Reynolds (El Paso, Texas) and Joseph Merchant (Lubbock, Texas), for volunteering their time to fulfill an important support role throughout the whole experiment. This support role emerged following findings from the pilot week, and made for a much stronger experiment.

We are extremely appreciative to the 16 NWS forecasters who participated in this experiment. We realize the stressful conditions many people continue to live and work with, and have done so over the past year. We also realize the disappointment from not being able to attend this experiment in the NOAA Hazardous Weather Testbed, in Norman, Oklahoma, as originally planned. However, participants showed up to our virtual experiment with enthusiasm and made meaningful contributions to the experiment. We collected an enormous amount of data, and we can’t wait to analyze it and share what was learned.

For questions on this or other WoFS-related research please contact WoFS Program Lead, Patrick Burke, nssl.outreach@noaa.gov.

Share this:

WoFS at the AMS, and the 2020 Iowa Derecho

The Annual Meeting of the American Meteorological Society is the largest recurring conference in our field. In January 2021, the 101st Annual Meeting of AMS took place in a virtual venue, but that didn’t stop the experimental Warn-on-Forecast System (WoFS) from taking center stage in a variety of ways. At least seven posters and a dozen oral presentations covered stories specific to WoFS. Many more covered closely related aspects of mesoscale modeling and forecast and warning operations. WoFS presenters included Norman-community researchers and students, but also National Weather Service forecasters from national centers as well as local offices. One group especially well represented were science operations officers from the group of nine Southern Plains NWS offices that have been evaluating WoFS as part of a two-year project. Many showed real-world examples of the ways in which WoFS is already influencing lead time and specificity of information shared with the public and other users.

Poster presentation of Warn-on-Forecast.
Poster presentation led by Todd Lindley, Science and Operations Officer at the NOAA NWS Weather Forecast Office in Norman, Oklahoma.

There was so much enthusiasm for developing WoFS-style probabilistic and rapidly updating guidance — with novel data assimilation for the watch to warning time scales — an entire conference session was dedicated to WoFS and included a panel discussion titled, “Utilization and Development of Rapidly Updating Mesoscale Models for IDSS (Incident Decision Support Services).”

A graphic saying Utilization and Development of Rapidly Updating Mesoscale Models for IDSS.
Image used to advertise and introduce a WoFS-related panel discussion at the 101st Annual Meeting of the American Meteorological Society. (Courtesy of AMS)

Perhaps no presentation spoke more to the potential utility of WoFS than Patrick Skinner’s talk, “Predictability of the 10 August 2020 Midwest Derecho.” The “Iowa Derecho” was one of the biggest weather stories of 2020. Occurring at the height of the growing season, the swath of destructive winds was not only life-threatening but also obliterated crops in its path, making this the costliest single thunderstorm event in United States history.

Presentation slide showing satellite imagery before and after the Iowa Derecho. Image courtesy of NASA.
Presentation slide showing satellite imagery before and after the Iowa Derecho. Image courtesy of NASA.

Predictability varies for thunderstorm events, and many numerical models did not do a particularly good job of helping forecasters to anticipate such a devastating event, even the day of the storm. To test whether the experimental WoFS could have contributed to an improved forecast of the event, researchers first had to expand the model domain to capture the evolution of such a fast-moving and long-lived storm. Once this had been accomplished, the results of the forecast runs proved very promising. A forecast based on data that was available 12 hours before the derecho correctly predicted a fast-moving, bowing thunderstorm system with significant severe winds (> 75 mph) near the ground. In the loop below, red shading represents the swath of WoFS-predicted significant severe winds, and the small blue squares and red triangles plot the locations where damaging winds and tornadoes, respectively, were observed on August 10, 2020.

A gray GIF loop of a WoFS retrospective forecast. The forecasted areas over Iowa change color from orange to red over time.
Loop of a WoFS retrospective forecast that was initialized with data from 03 UTC on August 10, 2020, approximately 12 hours prior to the onset of damaging winds from the derecho. Shown here are the ensemble 90th percentile of maximum 10-meter wind gusts, the probability matched mean of radar reflectivity, and (very faintly) paintball splatters representing reflectivity from individual ensemble members. Local storm reports are plotted over the data as squares (severe wind), circles (severe hail), and triangles (tornadoes). The model system predicts a derecho-like system, including a broad swath of winds greater than 75 mph. (Courtesy of NOAA NSSL)

In the future, when a fully developed WoFS becomes available for events such as these, this could lead to earlier anticipation of a high-end event. The initial WoFS forecasts were displaced a little to the north of the worst damage, but as the early stage of the storm development got underway, WoFS forecasts adjusted to the correct latitude/location, still with a few hours of lead time before the worst of the storm would have occurred.

A screenshot of the Warn-on-Forecast System with plots summarizing the probability of severe near-ground winds.
Plot summarizing the probability of severe near-ground winds from a WoFS run initialized with data from 11 UTC on August 10, 2020. As time drew nearer to the derecho event, WoFS forecasts adjusted southward, then overlapping more directly with the swath of very damaging winds that would occur a few hours later. (Courtesy of NOAA NSSL)

Preliminary results indicate the poor depiction of overnight thunderstorms in Nebraska and South Dakota led to large errors in the operational forecast models. The models generated too many thunderstorms early in the forecast period, thus limiting the energy available for daytime storms in Iowa. Employing rapid and high-resolution assimilation of radar and satellite data, the experimental WoFS forecasts better depicted the overnight storms, and therefore better reflected the large amounts of energy available for the damaging daytime storms in Iowa. The group led by Skinner plans to publish this research in the near future.

For questions on this or other WoFS-related research please contact WoFS Program Lead, Patrick Burke, nssl.noaa@outreach.gov.

Share this: