Spatial Forecast Verification Methods Inter-Comparison Project
Spring 2008 Workshop
- About
- Agenda
- Logistics
- Meeting Summary
14-15 April 2008 at NCAR's Foothills Laboratory, FL1-2198 (EOL Atrium), Boulder, Colorado.
The goal of the workshop is to discuss results from the "fake" test cases, continue discussing comparisons, and determine where to go from here.
Secific topics include:
- Category-specific methods: Most of the methods can be categorized into one of four general types of methods. Discussion sessions have been set aside to focus on within-category comparisons.
- Scale issues: One aspect of forecast performance of interest pertains to the "scales" at which a forecast has skill. Many of the methods give information about scale-specific performance, but in different ways. A discussion session will focus on this issue of how each method handles "scale."
- New Methods: Many methods have been propopsed since the first ICP meeting last February, and some older methods that were not represented last year are now being represented. Specific talks on these new methods will be given as well as a discussion session focusing on them.
- White paper and special issue of Weather and Forecasting: some discussion about the current state of the white paper, and plans for finishing it will be addressed. Information about the special issue will also be given, and some discussion time has been set aside in case there are any issues that come up.
All sessions were held in FL1-2198 (EOL Atrium). Slides from presentations (as available) are linked to the titles below. Please note that some of the slides represent works in progress. Please contact specific authors for how to cite their work, etc. You can email Eric Gilleland if you need to contact someone you do not know.
Session chairs
Monday morning; B Brown
Monday afternoon; E Gilleland
Tuesday morning; D Ahijevych
pdf version of the agenda.
Time | Title/Activity | Presenter/Leader |
Monday, April 14 | ||
8:30 | Continental Breakfast/Registration | - |
9:00 | Introduction/Welcome (ppt) | E Gilleland |
9:15 | Traditional Verification Scores (Results from MET) (ppt, pdf) | D Ahijevych |
9:35 | Image Warping results (pdf) | E Gilleland |
9:55 | FQM: A new displacement-based forecast quality measure (pdf) | C Keil |
10:15 | Break | - |
10:35 | Discussion of field morphing results | E Gilleland |
11:35 | SAL (ppt) and Composite Methods (ppt) | C Keil |
12:00 | Lunch | |
13:00 | FQI and Kantarovich Distance (pdf) | S Basu |
13:20 | Application of the CRA Method (ppt) | W Gallus |
13:40 | CellID/Procrustes (ppt) | S Lack |
14:00 | General Framework for Features-Based Verification | M Baldwin |
14:20 | MODE results (ppt) | D Ahijevych |
14:40 | Break | |
15:00 | Discussion of features-based results | B Brown |
16:00 | Scale Discussion | B Casati |
16:30 | Informal Discussions at the Boulder Beer Company | E Gilleland |
Tuesday, April 15 | ||
8:30 | Continental Breakfast | |
9:00 | Intensity-Scale (pdf) | B Casati |
9:20 | FSS modified (ppt) | M Mittermaier |
9:40 | Fuzzy Verification of Fake Cases (ppt) | B Ebert |
10:00 | Break | |
10:15 | Discussion of filtering results | B Ebert |
11:20 | Cluster Analysis, Optical Flow and Variograms (pdf) | C Marzban |
12:00 | Lunch | |
13:00 | White Paper and Special Issue of WAF | E Gilleland/W Gallus |
14:00 | Discussions | M Baldwin |
16:00 | Adjourn |
Venue
The workshop will be held at the National Center for Atmospheric Research (NCAR) Foothills Laboratory in the northeast part of Boulder, Colorado. The main meeting sessions will take place in the EOL Atrium in Building 1. The Foothills Campus has an on-site cafeteria where breakfast and lunch may be purchased.
Remote Attendence
For those who wish to attend, but cannot make it to Boulder, we will be employing ReadyTalk. Please email Barbara Brown (bgb " at " ucar "dot" edu) if you would like to attend the meeting in this way.
Lodging
Arrangements have been made with the Best Western Golden Buff Lodge for a special lodging rate of $59.00 per night. The Golden Buff is located at 1725 28th Street, Boulder, CO 80301, and is on the NCAR shuttle route and near to many shopping areas and restaurants. You can make reservations with them at bwgoldenbuff@yahoo.com or at 303-442-7450 (1-800-999-2833). For the DTC verification workshop use Group # 506476; for the Intercomparison Project use Group # 506475 to get the special rate.
Transportation
NCAR provides a regular shuttle service that has a stop across the street from the Golden Buff Lodge, at 28th Street and Canyon Blvd. Shuttle schedules and maps can be found at http://www.fin.ucar.edu/sass/transport/shuttserv.html.
An NCAR van will be doing a special pick-up at the Golden Buff every morning during the workshop to take workshop participants to the NCAR Foothills Lab. On Monday and Tuesday they will pick up at 8:20. The van will also return people to the Golden Buff at the end of the day. Specifically, the van will pick up at the Foothills laboratory at 4:45pm. For those wishing to join us at the Boulder Beer Co. on Monday evening, the van will drop you off there, but you will need to arrange for your own ride back to the hotel.
Coming Soon!
The National Center for Atmospheric Research is sponsored by the National Science Foundation. Any opinions, findings, and conclusions or recommendations expressed in this publication are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.