Summary – 29 April 2008

There was no IOP today.  The forecasters spent the day doing training and archive case playback on the various systems.  This summary will contain our notes from the Gridded Warning archive case playback.

Comments and thoughts from our forecasters:

Knobology of WDSSII getting in the way of science – not comfortable with tool. Perhaps in 3-4 more days, we could be more ready. Consider a 2 week tour with a one-week overlap between tours.

Would be nice to issue hail warnings on Ref and MESH in one pane, and tornado warnings on Ref and Vel on another pane, another monitor, or another workstation.

There was some discussion about the use of low-probabilities for “pre-warnings”. Actually, that is part of the NSSL concept of gridded threat areas – to provide some downstream users who need lower-probability longer lead time information between the watch and warnings time and space scales.

Paul started by issuing threat areas in “swath mode” as is done today in the WFOs, but quickly realized this and adjusted his threat areas accordingly (current threat only).

Paul would like to issue different probs for different parts of the threat area.

Paul and Dave had a hard time with motion vector because it is not shown on the screen. With warngen, there is an arrow and past and future positions.

Most of these technology issues go away if this is fully integrated into D2D.

Definitely helps to have someone who knows the system sitting next to the forecaster.

Dave comments that perhaps the 2nd-week forecasters in the above scenario are the ones issuing the warning, while the first weekers in in training mode – perhaps not working together, so that the “veterans” can really concentrate on the science.

Paul and Dave are concerned about the precision of the prob values – what about every 10%?

Andy – how do we calibrate our probabilities? Perhaps we can integratee the verification into the live system?

Andy – Verification system should be included in the NGWT from the get-go – lesson learned from WRH experience with GFE (see white paper).

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Outlook – 29 April 2008

Bupkes! No IOP planned for today, as there is no chance of severe weather across the CONUS during the 1-9pm shift. And no chance of Central OK weather at all for the next 48 hours.

So, we are planning to put the forecaster/evaluators through the PAR, CASA, and gridded warning archive case playback simulations today to gather feedback for the respective project scientists. There will be 4 shifts today, 90-120 minutes each, and the forecasters will rotate between experiment stations.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Summary – 28 April 2008

Our first day of operations with our visiting forecasters was a moderate success. The orientation briefing went about 30 minutes long, so we didn’t start WDSSII training until 330pm. This will probably be the norm. Once that was complete, we begin training and briefing on the gridded warning experiment. That didn’t end until about 530pm when we morphed into me demonstrating the gridded warning software on the tail end of the event in NE North Carolina and SE Virginia. We did not have a chance to issue warnings on the major tornadoes that occurred today as they happened before we were ready, but there we did issue a few low-probability tornado warnings on the remaining mesocyclones before they went offshore. Our “IOP” lasted only about 90 minutes and then we had a dinner break. Afterwards, each forecaster was given hands-on training with the gridded warning software, and we ended the day with a 30 minutes discussion, captured nicely by Kristin on the live blog. I also made a few “live blog” entries during our “IOP” that I’ll need to clean up.

No pictures to show today since our “IOP” really wasn’t a true IOP (I operated the software most of the time), and we won’t be using these data in any post-analysis. But we may play back a little of the data at the debriefing on Tuesday.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Live Blog – 28 April 2008 (6:25-6:43pm)

More comments:

Higher prob initially, fall off faster with greater spread.

Would be nice to be able to trace the trend.

Analogy to GFE. Want to be careful we don’t get consumed by the technology.

Also, manage many warnings and adjusting and tweaking might be too time consuming.

Re-draw threat area automatically each volume scan to have continuously advecting threat area.

Could use hail tracks/rotation tracks to update TA.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Live Blog – 28 April 2008 (6:20pm)

We have just switched our warning location to SE VA/NE NC with some small supercells still over land. We’ve kind of transitioned into our IOP. Greg is working the technology, and we are having a group discussion on the concept. Here are some comments.

Change “Peak Probability” to “trend Probability”

What about the users’ perspective when the warning keeps getting re-adjusted and the grid value change?

Are the threat areas too small? Could hurt if there is evolution.

Perhaps we could capture cyclic evolution by increasing the motion uncertainty.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Live Blog – 28 April 2008 (5:49pm)

We are in the process of educating our guests on the gridded probabilistic warning concept. Our IOP will probably begin around 6pm, over the Ohio Valley. Hoping there are still storms around when we begin, as the training today is taking a little longer than we planned. We also need to take a dinner break! So I’m going take notes on the blog to capture some of the PW training discussion.

Some good questions already – what probability numbers should be used? Forecasters need to be calibrated since they haven’t really thought about this.

How will we verify events in sparsely populated areas like the desert Southwest?

The spreading polygon is opposite to a probability contour. If the initial warning is set to, e.g., 50%, as the warning grows larger down the swath, the probabilities are actually smaller due to the uncertainty. If you look at a probability grid, the 50% contour will actually come to a point rather than spread out with time.

We’ll try do a demo live case, with NSSL driving first, and then letting each forecaster try it out, before the forecasters go through the archive case with the job sheet. The archive case will be doneon Tuesday.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Outlook – 28 April 2008

Our first set of visiting forecasters arrived today. Mike Cammarata (Columbia SC), David Blanchard (Flagstaff AZ), and for today only, Ken Cook (Wichita KS).

I didn’t have much time to brief on the weather situation today, but one this is for sure – no Central Oklahoma storms….for a few days. There is a Slight Risk for Eastern VA/NC (departing cold front), and a “See Text”, formerly a Slight Risk, over the Ohio Valley (cold core upper level low). The East Coast event is currently ongoing with several tornado warnings. However, we need to get the visitors trained on WDSSII and the gridded warning software (from 3-5 pm today), so we plan to let those storms go offshore, and hope for some hailers over the Ohio Valley during an IOP of 5-9pm.

Greg Stumpf (EWP Weekly Coordinator, 28 April – 2 May)

Tags: None

Shakedown Week Summary: 21 – 25 April 2008

Our first week of “operations” has completed, our operational shakedown week. We conducted our first end-of-week debriefing with a large group of NWC participants. Some of the highlights:

We discussed how to hold these end-of-week debriefings. They will include:

  1. A daily debriefing of Thursday operations.
  2. Scientific and technological discussion about the various projects.
  3. Logistical concerns of the visiting participants.
  4. Overall discussion on how we might improve the experience for all participants.

We also had a discussion on how we will introduce the visitors to the experiment at the orientation seminar. One particular item of note was to point out that we are running a research experiment, and that we should all expect bugs, kinks, and wrinkles. The forecaster/evaluators should look beyond those and focus on the bigger picture, to the future of NWS warning operations and technologies.

We finished the meeting with a lengthy discussion on the gridded probabilistic warning experiment.

One suggestion was to suggest at the orientation seminar that the forecasters should divorce themselves of the non-meteorological factors that effect their warning decision making, for example:

  1. Not getting verification due to low population.
  2. Letting certain users or subsets of users dictate your meteorological decisions.
  3. Turn off the county and city overlays…

…and focus on the science and meteorology!

Some discussion on what metrics we might measure included:

  1. Lead time for each event at different probability thresholds versus deterministic polygon. Can use LSRs, or hail tracks/rotation tracks for time of arrival/departure.
  2. Kristin talked to Harold Brooks, who suggested the forecasters, when issuing their warnings, treat our initial probability plateau as the probability of an event within the initial threat area, and not within x distance from the grid point. We can do that kind of analysis after the fact with the collected data.

Finally, we discussed the kinds of feedback we might seek from the forecasters. I’ve summarized the discussion:

1. Evaluate the concept of continuously advecting threat areas

  • How do we define the initial threat area?
  • Equitable lead time
  • Canceling out back of threat with time
  • Maintaining the threats during lifetime of storm

2. Provide feedback on the science of adding uncertainty information to warnings.

  • What baseline probabilities relate to today’s storm-based warnings?
  • How do we calibrate these probabilities over time?
  • Using algorithms to offer probabilistic guidance as a “first guess”?
  • How does enhanced verification (SHAVE reports) affect your WDM?

3. Assess the scientific and technological concepts before they are implemented into the NWS Next-Generation Warning Tool (NGWT).

Kiel added a “check box” to the polygon GUI that a forecaster could check when they think the current threat area that they are warning has now reached their “internal criteria” for issuing a storm-based warning of today. There was mixed reaction to that idea, but most folks generally felt it was ok to leave that there.

Here are some various images from the week. Most of the folks working this week were our future weekly coordinators and cognizant scientists, getting training on the various system and acting as “forecaster/evaluators”. Their comments and suggestions have been very helpful.

Greg Stumpf (EWP Weekly Coordinator, 21-25 April)

Tags: None

Summary – 24 April 2008

From 3-5pm, I trained Liz Quoetone, Jim LaDue, and Pail Schlatter on WDSSII. At the end of the training session, I tested a bug fix for the gridded warning software, and now, none of the warnings are automagically disappearing any more! Just a few more small issues, and the software should be ready to go.

Starting around 545pm, we began our gridded warning IOP centered on several storm which developed in NW KS. I spent the first hour explaining the software to Liz and Jim. Then, Jim took over the driver’s seat, followed by Liz, and then we wrapped up at 830pm. Several severe storms developed in the area, including one supercell that was a very large hail producer, and possibly a tornado producer. We issue gridded warnings for both hail and tornado on that storm.

During the event, we decided to try a new thing – live blogging. Jim and Liz put their thoughts on the blog as the event was occurring. I’ve decided that this would be a great idea for the gridded warning experiment. The cognizant scientist and/or one of the forecaster/evaluators should blog live during the IOP to share their thoughts in real time. We’ll try to put these live blog on a separate page in the EWP Blog.

Friday is the first of our end-of-week debriefings at 10am. We really don’t have a firm plan for how we are going to conduct these just yet, so we will probably spend some time discussing how we are going to conduct these weekly debriefings in the following 6 weeks.

Greg Stumpf (EWP Weekly Coordinator, 21-25 April)

Tags: None

Outlook – 24 April 2008

Another moderate risk day over NW and NC KS and SW NE, with a slight risk extending down into Oklahoma. The big question today is whether the cap south of I-70 will break. The operational RUC says yes, but all the SPC ensemble members and the deterministic NAM and ETA say no. But, we will be on guard for Central OK operations nonetheless.

The progs predict a strong surface cyclone in SW KS, with wrapping moisture and instability northward to the east of a dryline and around the north side of the low. Strong upslope north of the low will be a decent target for today, but the shear isn’t as great up there than points further south along the dryline. However, there is that cap to content with.

The plan is to operate a gridded warning IOP from 5-9 in Western KS and SW NE, where the initial storms develop. If the cap miraculously breaks in OK, we will shift south, and also operate the PAR. No CASA operations are expected, as the radars are not yet ready.

Greg Stumpf (EWP Weekly Coordinator, 21-25 April)

Tags: None