Spatial Forecast Verification Methods Inter-Comparison Project

Spring 2008 Workshop

  • About
  • Agenda
  • Logistics
  • Meeting Summary

14-15 April 2008 at NCAR's Foothills Laboratory, FL1-2198 (EOL Atrium), Boulder, Colorado.

The goal of the workshop is to discuss results from the "fake" test cases, continue discussing comparisons, and determine where to go from here.

Secific topics include:

  • Category-specific methods: Most of the methods can be categorized into one of four general types of methods. Discussion sessions have been set aside to focus on within-category comparisons.
  • Scale issues: One aspect of forecast performance of interest pertains to the "scales" at which a forecast has skill. Many of the methods give information about scale-specific performance, but in different ways. A discussion session will focus on this issue of how each method handles "scale."
  • New Methods: Many methods have been propopsed since the first ICP meeting last February, and some older methods that were not represented last year are now being represented. Specific talks on these new methods will be given as well as a discussion session focusing on them.
  • White paper and special issue of Weather and Forecasting: some discussion about the current state of the white paper, and plans for finishing it will be addressed. Information about the special issue will also be given, and some discussion time has been set aside in case there are any issues that come up.

All sessions were held in FL1-2198 (EOL Atrium). Slides from presentations (as available) are linked to the titles below. Please note that some of the slides represent works in progress. Please contact specific authors for how to cite their work, etc. You can email Eric Gilleland if you need to contact someone you do not know.

Session chairs
Monday morning; B Brown
Monday afternoon; E Gilleland
Tuesday morning; D Ahijevych

pdf version of the agenda.

TimeTitle/Activity Presenter/Leader
Monday, April 14
8:30Continental Breakfast/Registration-
9:00Introduction/Welcome (ppt) E Gilleland
9:15Traditional Verification Scores (Results from MET) (ppt, pdf)D Ahijevych
9:35Image Warping results (pdf)E Gilleland
9:55FQM: A new displacement-based forecast quality measure (pdf)C Keil
10:15Break-
10:35Discussion of field morphing resultsE Gilleland
11:35SAL (ppt) and Composite Methods (ppt)C Keil
12:00Lunch
13:00FQI and Kantarovich Distance (pdf)S Basu
13:20Application of the CRA Method (ppt)W Gallus
13:40CellID/Procrustes (ppt)S Lack
14:00General Framework for Features-Based VerificationM Baldwin
14:20MODE results (ppt)D Ahijevych
14:40Break
15:00Discussion of features-based resultsB Brown
16:00Scale DiscussionB Casati
16:30Informal Discussions at the Boulder Beer CompanyE Gilleland
Tuesday, April 15
8:30Continental Breakfast
9:00Intensity-Scale (pdf)B Casati
9:20FSS modified (ppt)M Mittermaier
9:40Fuzzy Verification of Fake Cases (ppt)B Ebert
10:00Break
10:15Discussion of filtering resultsB Ebert
11:20Cluster Analysis, Optical Flow and Variograms (pdf) C Marzban
12:00Lunch
13:00White Paper and Special Issue of WAFE Gilleland/W Gallus
14:00DiscussionsM Baldwin
16:00Adjourn

Venue

The workshop will be held at the National Center for Atmospheric Research (NCAR) Foothills Laboratory in the northeast part of Boulder, Colorado. The main meeting sessions will take place in the EOL Atrium in Building 1. The Foothills Campus has an on-site cafeteria where breakfast and lunch may be purchased.

Remote Attendence

For those who wish to attend, but cannot make it to Boulder, we will be employing ReadyTalk. Please email Barbara Brown (bgb " at " ucar "dot" edu) if you would like to attend the meeting in this way.

Lodging

Arrangements have been made with the Best Western Golden Buff Lodge for a special lodging rate of $59.00 per night. The Golden Buff is located at 1725 28th Street, Boulder, CO 80301, and is on the NCAR shuttle route and near to many shopping areas and restaurants. You can make reservations with them at bwgoldenbuff@yahoo.com or at 303-442-7450 (1-800-999-2833). For the DTC verification workshop use Group # 506476; for the Intercomparison Project use Group # 506475 to get the special rate.

Transportation

NCAR provides a regular shuttle service that has a stop across the street from the Golden Buff Lodge, at 28th Street and Canyon Blvd. Shuttle schedules and maps can be found at http://www.fin.ucar.edu/sass/transport/shuttserv.html.

An NCAR van will be doing a special pick-up at the Golden Buff every morning during the workshop to take workshop participants to the NCAR Foothills Lab. On Monday and Tuesday they will pick up at 8:20. The van will also return people to the Golden Buff at the end of the day. Specifically, the van will pick up at the Foothills laboratory at 4:45pm. For those wishing to join us at the Boulder Beer Co. on Monday evening, the van will drop you off there, but you will need to arrange for your own ride back to the hotel.

Coming Soon!


The National Center for Atmospheric Research is sponsored by the National Science Foundation. Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.