Summary – 30 April 2008

We spent the day doing archive case playbacks again with all the participants. However, around 745pm, one severe storms developed in Western Nebraska, too late to begin an IOP (since they must end by 8:30pm). I did some more gridded warning testing and we found a few more minor bugs that need to be issued.

Previous blog entries capture some of the discussion about the gridded warning project. We hope to summarize more of this for the end of week summary. Also, we will be gathering feedback from the PAR and CASA folks.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Live Blog – 30 April 2008 (6:23pm)

Notes on Gridded Warning Archive Case

Stream of consciousness notes from Mike Cammarata’s exercise:

Getting used to the software. Mike has some experience with this from earlier this week.

“Calibrated” ourselves with the MESH.

Desire to hide/show products more easily.

Would like to know when the next update is expected in displaced realtime case.

Long list of products (mostly warning output grids) became cumbersome to deal with.

At one point, Mike realized that we were encompassing more than the *current* threat area, made that adjustment.

———————————————————————————————————-

Group discussion: Mike Cammarata and Patrick Marsh, warning participants (Kristin/Kevin M. pw coords.)

A more informed decision could be made with better technology and guidance tools. For example, storm-following loops and cross-sections (even automated).

Took longer to issue due to polygon drawing (hard to get used to different knobology)

How did we feel about issuing probabilities? Probability was very arbitrary. Mike: “At what level of risk are we going to have a tornado?”

Discussion ensued about difference between achieving GPRA goals and current paradigm of warnings.

Discussion about significant call to action. (Are probs the best way? For tornado?)

Every decision maker has their individual cost-loss ratio for each decision made.

Andy feels that the “public” needs to know when to be told to “duck”.

The big issue is how we can objectively calibrate forecasters to the verification and to each other, so that there is a consistent answer for each warning.

Kevin Manross and Greg Stumpf (Gridded Warning Cognizant Scientists)

Tags: None

Outlook – 30 April 2008

Today will most likely be another non-IOP day, filled with a schedule of more training and archive case playback for all three experiments. There is an SPC DY1 “See Text” area in western Nebraska and SW South Dakota for some high-based marginally severe wind and hail events after 7pm.

We’ll be on an “IOP_standby, for 7-9pm, if severe storms develop in this area. Otherwise, we will continue experiment archive case playback exercises.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Summary – 29 April 2008

There was no IOP today.  The forecasters spent the day doing training and archive case playback on the various systems.  This summary will contain our notes from the Gridded Warning archive case playback.

Comments and thoughts from our forecasters:

Knobology of WDSSII getting in the way of science – not comfortable with tool. Perhaps in 3-4 more days, we could be more ready. Consider a 2 week tour with a one-week overlap between tours.

Would be nice to issue hail warnings on Ref and MESH in one pane, and tornado warnings on Ref and Vel on another pane, another monitor, or another workstation.

There was some discussion about the use of low-probabilities for “pre-warnings”. Actually, that is part of the NSSL concept of gridded threat areas – to provide some downstream users who need lower-probability longer lead time information between the watch and warnings time and space scales.

Paul started by issuing threat areas in “swath mode” as is done today in the WFOs, but quickly realized this and adjusted his threat areas accordingly (current threat only).

Paul would like to issue different probs for different parts of the threat area.

Paul and Dave had a hard time with motion vector because it is not shown on the screen. With warngen, there is an arrow and past and future positions.

Most of these technology issues go away if this is fully integrated into D2D.

Definitely helps to have someone who knows the system sitting next to the forecaster.

Dave comments that perhaps the 2nd-week forecasters in the above scenario are the ones issuing the warning, while the first weekers in in training mode – perhaps not working together, so that the “veterans” can really concentrate on the science.

Paul and Dave are concerned about the precision of the prob values – what about every 10%?

Andy – how do we calibrate our probabilities? Perhaps we can integratee the verification into the live system?

Andy – Verification system should be included in the NGWT from the get-go – lesson learned from WRH experience with GFE (see white paper).

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Outlook – 29 April 2008

Bupkes! No IOP planned for today, as there is no chance of severe weather across the CONUS during the 1-9pm shift. And no chance of Central OK weather at all for the next 48 hours.

So, we are planning to put the forecaster/evaluators through the PAR, CASA, and gridded warning archive case playback simulations today to gather feedback for the respective project scientists. There will be 4 shifts today, 90-120 minutes each, and the forecasters will rotate between experiment stations.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Summary – 28 April 2008

Our first day of operations with our visiting forecasters was a moderate success. The orientation briefing went about 30 minutes long, so we didn’t start WDSSII training until 330pm. This will probably be the norm. Once that was complete, we begin training and briefing on the gridded warning experiment. That didn’t end until about 530pm when we morphed into me demonstrating the gridded warning software on the tail end of the event in NE North Carolina and SE Virginia. We did not have a chance to issue warnings on the major tornadoes that occurred today as they happened before we were ready, but there we did issue a few low-probability tornado warnings on the remaining mesocyclones before they went offshore. Our “IOP” lasted only about 90 minutes and then we had a dinner break. Afterwards, each forecaster was given hands-on training with the gridded warning software, and we ended the day with a 30 minutes discussion, captured nicely by Kristin on the live blog. I also made a few “live blog” entries during our “IOP” that I’ll need to clean up.

No pictures to show today since our “IOP” really wasn’t a true IOP (I operated the software most of the time), and we won’t be using these data in any post-analysis. But we may play back a little of the data at the debriefing on Tuesday.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Live Blog – 28 Apr 2008 (8:30-9:00pm)

The following entry highlights initial impressions and perspectives from the forecasters/scientists after day 1.

*workload management

– segment operations by type of threat (allows view of specific products)

– sector by storm; in current system, loss of svr thunder warning during tornado warning.

– users would find separate wind/hail products useful; overlap of products and additional information.

– increases need for interoffice collaboration if different people are issuing separate warning types.

– County Warning Areas (CWA), warnings moving into new CWA-ownership? Discontinuous probabilities at CWA borders.

*Is issuing probabilities for warnings the right direction for NWS?

– 30 min vs 3 days. (tornado vs hurricane). Possible loss of response from public with 30 min/30% tornado warning?

– user cost/loss ratio using warn-on-forecast (NWP) guidance.

– binary threshold, doesn’t always allow for conveyance of information.

– significant wx advisory/warning decision products as pre-warning updates. Same as low probability warning forecast w/long lead-time (1hr+).

– For pubic communication issue low, mod, high probability instead of specific % #’s.

– WAS*IS direction for year 2 of project, working with external groups and how the data may be used.

*First forecast today, uncertainty of development and decay of storms and not communicated well with forecast. Duration of warning lasted much longer than storm threat. Was the warning decision “good?” Are our probabilities for t=end going to be too high? Is the shape of the warning grid an accurate representation of the threat?

*More time spent on software and drawing polygons then analysis of storm and storm environment. Again, automation of initial threat area would be useful in year 2, e.g., hail=mesh & tornado=meso. Movement away from WDSSII so forecaster don’t spend as much time learning the software.

Kristin Kuhlman (Gridded Warning Cognizant Scientist)

Tags: None

Live Blog – 28 Apr 2008 (6:50-6:58pm)

–Continued training with each forecaster on the probwarn software–

*Discussion of gridded vs current text products and information conveyed within each:

-Inclusion of checkbox for hailsize and windspeed (standardization)

— Ideas:

3/4 in hail now and golfball expected with linear interpolation.

Probability of particular size hail.

*Software: Suggestion of vector from original warning polygon to current threat at current time. With multiple warnings in close proximity to each other it can be hard to tell which polygon goes with each threat area

Kristin Kuhlman (Gridded Warning Cognizant Scientist)

Tags: None

Live Blog – 28 April 2008 (6:25-6:43pm)

More comments:

Higher prob initially, fall off faster with greater spread.

Would be nice to be able to trace the trend.

Analogy to GFE. Want to be careful we don’t get consumed by the technology.

Also, manage many warnings and adjusting and tweaking might be too time consuming.

Re-draw threat area automatically each volume scan to have continuously advecting threat area.

Could use hail tracks/rotation tracks to update TA.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Live Blog – 28 April 2008 (6:20pm)

We have just switched our warning location to SE VA/NE NC with some small supercells still over land. We’ve kind of transitioned into our IOP. Greg is working the technology, and we are having a group discussion on the concept. Here are some comments.

Change “Peak Probability” to “trend Probability”

What about the users’ perspective when the warning keeps getting re-adjusted and the grid value change?

Are the threat areas too small? Could hurt if there is evolution.

Perhaps we could capture cyclic evolution by increasing the motion uncertainty.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None