Inicio  /  Atmosphere  /  Vol: 9 Núm: 3 Par: March (2018)  /  Artículo
ARTÍCULO
TITULO

Evaluation of Analysis by Cross-Validation. Part I: Using Verification Metrics

Richard Ménard and Martin Deshaies-Jacques    

Resumen

We examine how passive and active observations are useful to evaluate an air quality analysis. By leaving out observations from the analysis, we form passive observations, and the observations used in the analysis are called active observations. We evaluated the surface air quality analysis of O3 and PM2.5 against passive and active observations using standard model verification metrics such as bias, fractional bias, fraction of correct within a factor of 2, correlation and variance. The results show that verification of analyses against active observations always give an overestimation of the correlation and an underestimation of the variance. Evaluation against passive or any independent observations display a minimum of variance and maximum of correlation as we vary the observation weight, thus providing a mean to obtain the optimal observation weight. For the time and dates considered, the correlation between (independent) observations and the model is 0.55 for O3 and 0.3 for PM2.5 and for the analysis, with optimal observation weight, increases to 0.74 for O3 and 0.54 for PM2.5. We show that bias can be a misleading measure of evaluation and recommend the use of a fractional bias such as the modified normalized mean bias (MNMB). An evaluation of the model bias and variance as a function of model values also show a clear linear dependence with the model values for both O3 and PM2.5.

 Artículos similares

       
 
Helani Perera, Nipuna Senaratne, Miyuru B. Gunathilake, Nitin Mutill and Upaka Rathnayake    
Satellite Rainfall Products (SRPs) are now in widespread use around the world as a better alternative for scarce observed rain gauge data. Upon proper analysis of the SRPs and observed rainfall data, SRP data can be used in many hydrological applications... ver más
Revista: Climate

 
Corrie Monteverde, Fernando De Sales and Charles Jones    
The Brazilian Amazon provides important hydrological cycle functions, including precipitation regimes that bring water to the people and environment and are critical to moisture recycling and transport, and represents an important variable for climate mo... ver más
Revista: Climate

 
Irene Jensen, Zana Arapovic-Johansson and Emmanuel Aboagye    
Background: The study evaluates the cost-effectiveness of the Productivity Measurement and Enhancement System (ProMes) intervention to reduce employee work-related stress and enhance work performance. Methods: A prospective cohort study was used to under... ver más

 
Matthew Oyeleye, Tianhua Chen, Sofya Titarenko and Grigoris Antoniou    
Heart disease, caused by low heart rate, is one of the most significant causes of mortality in the world today. Therefore, it is critical to monitor heart health by identifying the deviation in the heart rate very early, which makes it easier to detect a... ver más

 
Sarah Syed, Tracey L. O?Sullivan and Karen P. Phillips    
Background: Extreme heat caused by climate change is a major public health concern, disproportionately affecting poor and racialized communities. Gestational heat exposure is a well-established teratogen in animal studies, with a growing body of literatu... ver más