{"id":6197,"date":"2012-12-07T16:57:20","date_gmt":"2012-12-07T21:57:20","guid":{"rendered":"https:\/\/hwt.nssl.noaa.gov\/ewp\/internal\/blog\/?p=6197"},"modified":"2017-06-23T14:05:17","modified_gmt":"2017-06-23T19:05:17","slug":"warning-verification-pitfalls-explained-part-5","status":"publish","type":"post","link":"https:\/\/inside.nssl.noaa.gov\/ewp\/2012\/12\/07\/warning-verification-pitfalls-explained-part-5\/","title":{"rendered":"Warning Verification Pitfalls Explained – Lack of Reports Can Inflate Lead Time"},"content":{"rendered":"

As finally promised as an “aside” in this blog entry<\/a>, I will cover the issue of how using point observations can lead to a misrepresentation of the lead time of a warning.<\/p>\n

Consider that one warning is issued, and a single severe weather report is received for that warning.\u00a0 We have a POD = 1 (one report is warning, zero are unwarned), and an FAR = 0 (one warning is verified, zero warnings are false).\u00a0 Nice!<\/p>\n

How do we compute the lead time for this warning?\u00a0 Presently, this is done by simply subtracting the warning issuance time from the time of the first report on the storm.\u00a0 From this earlier blog post<\/a>:<\/p>\n

t<\/em>warningBegins<\/sub> = time that the warning begins<\/p>\n

t<\/em>warningEnds<\/sub>= time that the warning ends<\/p>\n

t<\/em>obsBegins<\/sub> = time that the observation begins<\/p>\n

t<\/em>obsEnds<\/sub>= time that the observation ends<\/p>\n

LEAD TIME (lt): t<\/em>obsBegins <\/sub>\u2013 t<\/em>warningBegins <\/sub>[HIT events only]<\/p>\n

Let’s look at our scenario from the previous blog post<\/a>:<\/p>\n

\"lead<\/a><\/p>\n

For ease of illustration, I’m using the spatial scale to represent the time scale.\u00a0 The warning begins at some time t<\/em>warningBegins<\/sub>, and the report is at a later time t<\/em>obsBegins<\/sub>.\u00a0 The lead time is shown spatially in the figure, and in this case, it appears that the warning was issued with some appreciable lead time before the event at the reporting location occurs.<\/p>\n

However, as we explained in the previous blog post<\/a>, reports only represent a single sample of the severe weather event in space in time.\u00a0 How can we be certain that the report above represents the location and time of the very first instance<\/em> that the storm became severe?\u00a0 In all but probably rare cases, it does not, and the storm became severe at some time prior to the time of that report.\u00a0 This tells us that for pretty much every warning (hail and wind events at least), the computed lead times are erroneously too large<\/em>!\u00a0 Reality looks more like this:<\/p>\n

\"lead<\/a><\/p>\n

ADDENDUM (1\/10\/2013):\u00a0 Here is another way to view this so that the timeline of events is better illustrated.\u00a0 In this next example, a warning is issued at t=0 minutes on a storm that is not yet severe, but expected to become severe in the next 10-20 minutes, hence hopefully providing that amount of lead time.\u00a0 Let’s assume that the red contour in the storm indicates the area over which hail ><\/span>1″ is falling, and when red appears, the storm is officially severe.\u00a0 As the storm moves east, I’ve “accumulated” the severe hail locations into a hail swath (much like the NSSL Hail Swath algorithm works using multiple-radar\/multiple-sensor data).\u00a0 Only two storm reports were received on this storm, one at t=25 minutes after the warning was issued, and another at t=35 minutes.\u00a0 That means this warning verified (was not a false alarm), and both reports were warned (two hits, no misses).\u00a0 The lead times for each report were 25 and 35 minutes respectively, but official warning verification uses lead time to the first report known as the initial lead time<\/em>.\u00a0 Therefore, the lead time recorded for this warning would be 25 minutes, which is very respectable. \u00a0 However, in this case, the storm was actually severe starting at t=10 minutes.\u00a0 The lead time between the start of the warning and the start of severe weather was 15 minutes shorter<\/em> than that officially recorded.<\/p>\n

\"leadtimeloop\"<\/a><\/p>\n

\"Picture<\/a><\/p>\n

How can we be more certain of the actual lead times of our warnings?\u00a0 By either gathering more reports on the storm (which isn’t always entirely feasible, although that may be improving with new weather crowdsourcing apps like mPING<\/a>), or using proxy verification<\/em> based on a combination of remotely-sensed data (like radar data) and actual reports.\u00a0 Again, more on this later…<\/p>\n

Greg Stumpf, <\/em>CIMMS and NWS\/MDL<\/em><\/p>\n","protected":false},"excerpt":{"rendered":"

As finally promised as an “aside” in this blog entry, I will cover the issue of how using point observations can lead to a misrepresentation of the lead time of… <\/p>\n

Read more \u00bb<\/a><\/p>\n","protected":false},"author":333,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[5],"tags":[],"class_list":["post-6197","post","type-post","status-publish","format-standard","hentry","category-experimental-warning-thoughts"],"_links":{"self":[{"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/posts\/6197","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/users\/333"}],"replies":[{"embeddable":true,"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/comments?post=6197"}],"version-history":[{"count":3,"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/posts\/6197\/revisions"}],"predecessor-version":[{"id":14611,"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/posts\/6197\/revisions\/14611"}],"wp:attachment":[{"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/media?parent=6197"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/categories?post=6197"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/inside.nssl.noaa.gov\/ewp\/wp-json\/wp\/v2\/tags?post=6197"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}