报告题目:Forecast Interpretation and Evaluation
报告时间:2018年4月3日上午10:00
报告地点:旭日楼306教室
主讲人:杜海良博士
主讲人简介:
杜海良,统计学博士,2009年博士毕业于伦敦政治经济公司。毕业以后至2013年在伦敦政治经济公司时间序列研究中心和气候变化经济政策研究中心担任研究员从事时间序列分析以及非线性动力学理论研究。2014年加入芝加哥大学气候能源决策研究中心从事气候模型可靠性分析。于2017加入杜伦大学数学科学系从事能源系统不确定性量化分析。2018 被杜伦大学任命为助理教授。
报告简介:
The evaluation of forecast performance plays a central role both in the interpretation and in the use of forecast systems and their development. Many forecast systems are available, but evaluations of their performance are not standardized, with many different scores being used to measure different aspects of performance. Ensemble interpretations which interpret a probability forecast as a point forecast (a delta function such as the ensemble mean) or as a collection of delta functions (reflecting, for example, the position of each ensemble member) may provide misleading estimates of skill in nonlinear systems as they fail to consider all the probabilistic information available. Even when the discussion is restricted to proper scores, there remains considerable variability between scores in terms of their sensitivity to outcomes in regions of low (or vanishing) probability; proper scores need not rank competing forecast systems in the same order when each forecast system is imperfect. The locality property is explored to further distinguish skill scores. The only local proper score, the logarithmic score, has an immediate interpretation in terms of bits of information. Nonlocal proper scores considered are shown to have properties that could produce counter intuitive evaluations. It is suggested that the logarithmic score always be included in the evaluation of probabilistic forecasts.