EWP2013 Week #2 Welcome

Monday 13 May 2013 begins the second week of our three-week spring experiment of the 2013 NSSL-NWS Experimental Warning Program (EWP2013) in the NOAA Hazardous Weather Testbed at the National Weather Center in Norman, OK.  There will be five primary projects geared toward WFO applications, 1) the development of “best practices” for using Multiple-Radar/Multiple-Sensor (MRMS) severe weather products in warning operations, 2) an evaluation of a dual-polarization Hail Size Discrimination Algorithm (HSDA), 3) an evaluation of model performance and forecast utility of the OUN WRF when operations are expected in the Southern Plains, 4) an evaluation of the Local Analysis Prediction System (LAPS) Space and Time Multiscale Analysis System (STMAS), and 5) an evaluation of multiple CONUS GOES-R convective applications, including pseudo-geostationary lightning mapper products when operations are expected within the Lightning Mapping Array domains (OK, w-TX, AL, DC, FL, se-TX, ne-CO).  We will also be coordinating with and evaluating the EFP’s probabilistic severe weather outlooks as guidance for our warning operations.  Operational activities will take place during the week Monday through Friday.

For the week of 13-17 May, our distinguished NWS guests will be Chris Leonardi (WFO Charleston, WV), Becca Mazur (WFO Cheyenne, WY), Ernie Ostuno (WFO Grand Rapids, MI), Joey Picca (WFO New York, NY), and Michael Scotten (WFO Norman, OK).  If you see any of these folks walking around the building with a “NOAA Spring Experiment” visitor tag, please welcome them!   The GOES-R program office, the NOAA Global Systems Divisions (GSD), and NWS WFO Huntsville’s Applications Integration Meteorologist (AIM) Program have generously provided travel stipends for our participants from NWS forecast offices nationwide.

Visiting scientists this week will include Jordan Gerth (Univ. Wisconsin), Wayne Feltz (Univ. Wisconsin), Hongli Jiang (NOAA/GSD), Amanda Terberg (NWS Air Weather Center GOES-R Liaison), and Helge Tuschy (Deutscher Wetterdienst (DWD), Leipzig, Germany).

Kristin Calhoun
will be the weekly coordinator.  Clark Payne (WDTB) will be our “Tales from the Testbed” Webinar facilitator. Our support team also includes Darrel Kingfield, Gabe Garfield, Travis Smith, Chris Karstens, Greg Stumpf, Kiel Ortega, Karen Cooper, Lans Rothfusz, Aaron Anderson, and David Andra.
Each Friday of the experiment (10 May, 17 May, 24 May), from 1200-1240pm CDT, the WDTB will be hosting a weekly Webinar called “Tales From the Testbed”.  These will be forecaster-led, and each forecaster will summarize their biggest takeaway from their week of participation in EWP2013.  The audience is for anyone with an interest in what we are doing to improve NWS severe weather warnings.  New for EWP2013, there will be pre-specified weekly topics.  This is meant to keep the material fresh for each subsequent week, and to maintain the audience participation levels throughout the experiment.  The weekly schedule:

Week 1:  GOES-R; pGLM

Week 2:  MRMS, HSDA

Week 3:  EFP outlooks, OUN WRF, LAPS

One final post-experiment Webinar will be delivered to the National Weather Association and the Research and Innovation Transition Team (RITT) in June.  This Webinar will be a combined effort of both sides of the Hazardous Weather Testbed (EFP and EWP).

Here are several links of interest:

You can learn more about the EWP here:

http://hwt.nssl.noaa.gov/ewp/

NOAA employees can access the internal EWP2013 page with their LDAP credentials.

https://secure.nssl.noaa.gov/projects/ewp2013/

Stay tuned on the blog for more information, daily outlooks and summaries, live blogging, and end-of-week summaries!

Greg Stumpf, CIMMS/NWS-MDL, EWP2013 Operations Coordinator

Tags: None

EWP2013 Week 1 Summary: 6 – 10 May 2013

EWP2013 PROJECT OVERVIEW:

The National Oceanic and Atmospheric Administration (NOAA) Hazardous Weather Testbed (HWT) in Norman, Oklahoma, is a joint project of the National Weather Service (NWS) and the National Severe Storms Laboratory (NSSL).  The HWT provides a conceptual framework and a physical space to foster collaboration between research and operations to test and evaluate emerging technologies and science for NWS operations.  The Experimental Warning Program (EWP) at the HWT is hosting the 2013 Spring Program (EWP2013).  This is the sixth year for EWP activities in the testbed.  EWP2013 takes place across three weeks (Monday – Friday), from 6 May through 24 May.

EWP2013 is designed to test and evaluate new applications, techniques, and products to support Weather Forecast Office (WFO) severe convective weather warning operations.  There will be three primary projects geared toward WFO applications this spring, 1) evaluation of multiple CONUS GOES-R convective applications, including pseudo-geostationary lightning mapper products when operations are expected within the Lightning Mapping Array domains (OK/west-TX, AL, DC, FL), 2) evaluation of model performance and forecast utility of the OUN WRF when operations are expected in the Southern Plains, and 3) evaluation of model performance and forecast utility of the 1-km and 3-km WRF initialized with LAPS.

PARTICIPANTS:

We had six visiting NWS forecasters this week: Marc Austin (WFO, Norman, OK), Hayden Frank (WFO, Boston, MA), Jonathan Guseman (WFO, Lubbock, TX), Nick Hamphsire (WFO, Fort Worth, TX), Andrew Hatzos (WFO, Wilmington, OH), and Jonathan Kurtz (WFO, Norman, OK).  The GOES-R program office, the NOAA Global Systems Divisions (GSD), and NWS WFO Huntsville’s Applications Integration Meteorologist (AIM) Program have generously provided travel stipends for our participants from NWS forecast offices nationwide.

Visiting scientists this week included Lee Cronce (Univ. Wisconsin), Geoffrey Stano (NASA-SPoRT), Isidora Jankov (NOAA/GSD), and Amanda Terberg (NWS Air Weather Center GOES-R Liaison).

Gabe Garfield was the weekly coordinator.  Clark Payne (WDTB) was the “Tales from the Testbed” Webinar facilitator. Our support team also included Darrel Kingfield, Kristin Calhoun, Travis Smith, Chris Karstens, Greg Stumpf, Kiel Ortega, Karen Cooper, Lans Rothfusz, Aaron Anderson, and David Andra.

ewp2013_week1_photo_inset

Experimental Warning Program Week #1 group photo. 1) Isidore Jankov (NOAA/ESRL/GSD), 2) Kristin Calhoun (CIMMS/NSSL), 3) Gabe Garfield (CIMMS/NWS/WFO/OUN), 4) Darrel Kingfield (CIMMS/NSSL), 5) Geoffrey Stano (NASA/SPoRT), 6) Nick Hampshire (NWS/WFO/Fort Worth, TX), 7) Lee Cronce (U. Wisc/CIMSS), 8 ) Hayden Frank (NWS/WFO/Boston, MA), 9) Greg Stumpf (CIMMS/NWS-MDL), 10) Marc Austin (NWS/WFO/Norman, OK), 11) Amanda Terborg (U. Wisc./CIMSS), 12) Jonathan Guseman (NWS/WFO/Lubbock, TX), 13) Kiel Ortega (CIMMS/NSSL), 14) Jonathan Kurtz (NWS/WFO/Norman, OK), and 15) Andy Hatzos (NWS/WFO/Wilmington, OH).

REAL-TIME EVENT OVERVIEW:

6 May: Blacksburg (RNK), Raleigh (RAH), and Lubbock (LUB):  Marginally severe storms with hail and wind.

7 May: Goodland (GLD), Dodge City (DDC), and Lubbock (LUB):  Severe storms in KS with large to very large hail; marginally severe storms in the Texas Panhandle.

8 May: Norman (OUN), Lubbock (LUB), and Dodge City (DDC):  Widespread severe weather outbreak with hail and wind.

9 May: Fort Worth (FWD), San Angelo (SJT), and Lubbock (LUB):  Supercells with large to very large hail and severe winds.

FEEDBACK ON EXPERIMENTAL PRODUCTS:

HSDA:

  • Giant hail detections are too generous.  Seems to be indicating giant hail when many reports are below 2”.
  • The algorithm is good at detecting hail, but the area is too large.
  • When using FSI to cut vertical cross-sections, the change to all red (any size hail) above melting layer was particularly noted.

MRMS:

  • MESH underestimated hail size in colder core low on Monday; the algorithm did much better on Thursday.
  • MESH and other hail diagnosis indicators underestimate hail size for left splits.
  • Recommend adding a radial shear product, to help detect mid-altitude radial convergence (MARC) signatures.
  • Has the greatest value in identifying hail threats; however, tornadoes will still always require examination of base data.

OUN WRF:

  • Recommend a new convective initiation product that displays the probability of convection.
  • Recommend a surface convergence product to monitor CI (there is a Severe Local Storms conference preprint by a Fort Worth WFO author).

Variational LAPS:

  • Some WFOs deliver an enhanced short term forecast every 3 hours, and variational LAPS would be useful.

GOES-R UAH SatCast/UW Cloud-Top Cooling:

  • The UAH CI product was found to be “too noisy”
  • Would like to change color curve to filter out UAH CI Strength of Signal values below 50% (or some other threshold).

GOES-R PLGM and Lightning Trend Tool:

  • Recommend adding capability to use trending tool in four panels.  Right now, it only works in a single panel.

OVERALL COMMENTS:

  • Suggest that the PIs sit with forecasters to write procedures on the first part of the first day of operations.
  • All the products are useful and valuable; each forecaster will find their own ways to implement.
  • Need to work with WDTB to determine an optimal way to attract forecasters to the new products so that they do not immediately default to their “comfort zones” of base products.  Perhaps having an assistant forecaster or HMT monitor the new products side-by-side with the warning forecaster.
  • Suggests starting week by incorporating experimental products and concluding week with just experimental products.  However, many weeks won’t have quality storms each day.
  • New product evaluation would probably not be helpful in a “canned case” – need real-time evaluation.
  • Time allotted for surveys was adequate.
  • Training was sufficient to prepare for week’s activities.

CONTRIBUTORS:

Gabe Garfield, EWP 2013 Week #1 Weekly Coordinator

Greg Stumpf, EWP 2013 Week #1 Back-up Coordinator

Tags: None

Forecaster Thoughts – Andy Hatzos (2013 Week 1)

Andy wrote a very detailed and illustrated summary of his visit to the EWP.  It is available here:

ftp://24.172.201.242/ewp_review_hatzos.pdf

Aside from the above, he added a few more quick items:

1) I struggled a bit on the mesoscale desk, and a part of that was finding that my data-heavy AWIPS I procedures (which work fine here) were almost unloadable on AWIPS II. Because of that, I had to simplify and rebuild a bunch of things on the fly. For next year’s experiment, it may be worth asking participants to create their procedures in advance on an AWIPS II system (ADAM) before sending them on to Oklahoma. That way, they could know for sure that what they’re sending works alright on AWIPS II.

2) The GOES RGB Airmass product sort of seemed to get forgotten about to an extent. I don’t recall seeing it in the training presentations (though we had a WES case on it) and it wasn’t emphasized heavily at the EWP. I’d love to see this covered a bit more next year, on the same level as some of the other GOES-R Proving Ground products. The RGB Airmass is admittedly difficult to interpret, but rather interesting to try to use, once you get an idea of what you’re looking for. I definitely think it’s worth a closer look.

Finally, I just wanted to say thanks again for the invitation to attend. I really enjoyed the week and I hope I was able to help make some progress toward everything the EWP was working for.

Andy Hatzos
General Forecaster
NWS Wilmington OH
2013 Week 2 Evaluator

Tags: None

Forecaster Thoughts – Jonathan Guseman (2013 Week 1)

Here is what I took away from the experiment last week.

Out of the MRMS products, the Maximum Estimated Size of Hail (MESH) one was the most useful since many of the storms we evaluated were primarily hailers. It did underestimate hail size by around 0.50 inches some of the time, especially within colder airmasses (e.g. the cutoff low that lingered across the eastern CONUS early last week). However, it did prove to be effective most of the time across the plains. Plotting the 30, 60, or 120 minute accumulated MESH was nice in extrapolating the storm’s track and subsequently finessing the extent of a warning polygon. Several other products were also useful, including the height of 50 or 60 dBZ cores above the 0 or -20C level as well as isothermal reflectivity products.

POD was very high, but FAR was also high when evaluating the HSDA. The spatial extent of giant hail was overdone at times, but a hail event was rarely if ever missed.
The OUN WRF showed utility in forecasting convective initiation in the short term, but it missed Wednesday’s event as it forecast a complex to develop near the Red River Valley. Switching to the RAP for initial conditions will likely be a benefit for the model. The variational LAPS analysis was useful in the 0-3 hour forecast timeframe, providing 15 minute forecasts in the short term. Lower resolution extended guidance was also available but not used as much.

Lightning jumps using total lightning data were evaluated with the Flash Extent Density product. The 8 km resolution is pretty coarse for evaluating discrete areas, but the product does give a good general idea of where to focus. The idea of drawing a polygon to evaluate a specific area for total lightning data will benefit the Total Lightning Trending tool. Simulated IR and WV imagery look very similar to real-time data and are very useful in getting a feel for convective evolution throughout the day. They do underdo the spatial extent of features, such as MCCs, quite a bit, but the idea is certainly there. Fields like convective instability and PWAT difference using the Nearcast product can be evaluated to aid in short term convective forecasting. The UAHCI product can be sporadic at times showing low probabilities of CI where flat cumulus fields exist, but the larger values usually do well, especially along boundaries (i.e. dryline). Cloud top cooling via the UWCTC product is also very helpful in diagnosing storms capable of becoming severe. Values of -20C/15 min of cooling have shown to provide extended lead times, sometimes on the order of one hour. Both the UAHCI and UWCTC products do suffer from cirrus contamination. They both suffered on one shift when convection was ongoing early, but they were very helpful prior to CI where skies were mostly clear.

Thanks again for the opportunity to participate and hopefully I’ll see you in upcoming experiments!

Jonathan Guseman
General Forecaster
NWS Lubbock, TX
2013 Week 1 Evaluator

Tags: None

Daily Summary: 9 May 2013

On Thursday, operations began at noon in the Development Lab, with storms ongoing in the Southern Plains.  After the daily debriefing and forecast discussion, we moved to the Hazardous Weather Testbed.  Around 1 p.m., the Experimental Forecast Program provided an in-depth weather briefing.  This discussion confirmed our decision to operate in the Fort Worth and San Angelo County Warning Areas.

The San Angelo desk consisted of Andrew Hatzos and Jonathan Buseman; the Fort Worth office of Hayden Frank and Marc Austin; and the Mesoscale Desk of Jon Kurtz and Nick Hampshire.  Multiple clusters of thunderstorms were already present, including supercellls.    With time, it became apparent that the storms in the Norman CWA would allow for an examination of the PGLM data.  Thus, the Fort Worth office was shifted to become the Norman office.  Not long after this, storms began to develop in the Lubbock CWA, which gave us another opportunity to examine PGLM data.  Thus, we decided to send the Mesoscale Desk to Lubbock to cover this activity.

After operations concluded, the forecasters completed the daily surveys.  Clark Payne (WDTB) arrived around 7 p.m. to help the forecasters complete the Friday webinar.

 -G. Garfield, Week 1 Coordinator

Tags: None

PGLM Flash Extent Density in Linear Convection

The PGLM flash extent density product was useful at picking out areas of more severe convection in a linear storm segment. While the lightning “jumps” were not all that impressive (~20 to 30 flashes/min), they were still significant enough in conjunction with MESH near an inch to issue a warning. This is evident in the four panel image below which shows FED, Comp Reflectivity and MESH.pglmline

Austin/Frank

Tags: None

Warning issued with only pGLM Lightning Jump

At 2226z a storm in the LUB CWA had 1 flash on the pGLM and 10 minutes later the number was up to near 40 flashes.

PGLMhit1

An experimental warning was issued based only on this and without any other data. About 5 minutes post warning, the HSDA algorithm hit for large hail.

Purple Color is large hail
Purple Color is large hail

Several minutes later the MESH hit at 1.02″

pglmhit4

The pGLM was the first hit of possible severe weather and gave 5-10 minutes more lead time to when the MRMS products hit for severe hail.

Hampshire

Tags: None

MRMS Products Confirm Extreme Hail

A supercell thunderstorm developed north of San Angelo TX at about 2030Z, and became severe as it moved east. After the storm made a hard right turn and began moving southeast, it grew to an extreme level of intensity, especially with regard to hail potential.

DYX radar showing an intense TBSS signature at 2137Z.
DYX radar showing an intense TBSS signature at 2137Z.

About a half hour later, t he storm continued to strengthen, now showing a TBSS with > 30 dBZ and a 70 dbZ core that extended to over 25k feet.

DYX 0.5 degree reflectivity at 2210Z, showing an intense TBSS signature.
DYX 0.5 degree reflectivity at 2210Z, showing an intense TBSS signature.

The HC product showed giant hail at numerous slices throughout this period of very high storm intensity. Here are examples from the 2210Z volume scan.

DYX HC at 0.5 degrees (2210Z).
DYX HC at 0.5 degrees (2210Z).
DYX HC at 1.8 degrees (2210Z).
DYX HC at 1.8 degrees (2210Z).
DYX HC at 4.0 degrees (2210Z).
DYX HC at 4.0 degrees (2210Z).

At the time of these images, we received reports of baseball size hail, and numerous reports of golf ball size hail.

Here is a look at a plethora of MRMS products at 2210Z.

MRMS at 2210Z (part 1).

MRMS at 2210Z (part 1).
MRMS at 2210Z (part 2).
MRMS at 2210Z (part 2).

MESH showed a maximum hail size of over 2.75″ in this image (and actually peaked at over 3″ near the same time). This is in the top left of the first MRMS image.

POSH (which is directly proportional to MESH) reached values of 100% when MESH indicated about 2.5″ or greater. This is in the top left of the second MRMS image.

Reflectivity at -20 degrees C (top right in the second MRMS image) is over 70 dBZ. The 60 dBZ echo reached over 20k feet above the freezing level (bottom left in the second MRMS image). Vertically Integrated Ice (bottom right of the second MRMS image) is over 50 kg/m2, too high for the default color scale.

This data helped provide forecaster confidence in the fact that hail was extremely large in this particular supercell.

–Hatzos

Tags: None

PGLM Flash Extent Density Helps with tracking Storm Intensification

We finally had storms develop within the West Texas LMA.  The strongest updraft this evening showed marked ramp up of flashes to 40 just as the storms 50 dBZ core reached 26.25 kft briefly before coming back down about 10 minutes later with the flash density also subsiding back to 15 to 25 flashes. Although the storm didn’t reach severe criteria, it was beneficial that the Flash Extent Density updates in 1 minute intervals, which lets the warning forecaster monitor for rapid updraft development between radar volume scans.  This storm resulted in a report of dime size hail.

0.5 reflectivity and Flash Extent Density
0.5 reflectivity and Flash Extent Density

Kurtz

Tags: None

Daily Summary: 8 May 2013

stormreports_0508

On Wednesday, we began operations in the Development Lab.  After a short debrief of the previous day’s events, we discussed the Day 1 forecast.  We agreed that the Norman and Dodge City County Warning Areas were most likely to receive severe weather.   Before we decided where to operate, though, we asked Jimmy Correia (SPC) to give a forecast briefing for the Experimental Forecasting Program.  From his briefing, it became apparent that convection was most likely to develop in the Norman CWA first.  So, it was decided to operate there initially.

Our forecasters were divided into three teams: two warning teams and one mesoscale team.  The North warning team consisted of Hayden Frank and Jonathan Buseman; they covered the warnings in north of I-40 in Norman’s CWA.   The South warning team consisted of Marc Austin and Nick Hampshire; they covered the warnings in Lubbock’s CWA, then the southern half of Norman’s CWA.  Andrew Hatzos and Jonathan Kurtz filled the Mesoscale Desk.  We kept these teams throughout the afternoon and into the early evening.  Around 5 p.m., though, it became apparent that Dodge City’s CWA was likely to see severe weather.  For this reason, Jonathan Kurtz was moved to the DDC Warning Desk.

A squall line developed just west of the National Weather Center toward late evening, which gave us an opportunity to observe the weather for which we were forecasting.  The Norman mesonet registered a 40 mile wind gust, and we observed blowing dust from the observation deck of the National Weather Service.  After issuing almost 40 warnings, the EWP crew finished operations.

-G. Garfield, Week 1 Coordinator

 

Tags: None