Comparing standard to feature-based meteorological model evaluation techniques in Bogotá, Colombia

Standard meteorological model performance evaluation (sMPE) can be insufficient in determining fitness for air quality modeling. An sMPE compares predictions of meteorological variables with community-based thresholds. Conceptually, these thresholds measure the model\u27s capability to represent mesoscale features that cause variability in air pollution. A method that instead examines features could provide a better estimate of fitness. This work compares measures of fitness from sMPE analysis with a feature-based MPE (fMPE). Meteorological simulations for Bogotá, Colombia, using the Weather Research and Forecasting (WRF) Model provide an ideal case study that highlights the importance of fMPE. Bogotá is particularly interesting because the complex topography presents challenges for WRF in sMPE. A cluster analysis identified four dominant meteorological features associated with air quality driven by wind patterns. The model predictions are able to pass several sMPE thresholds but show poor performance for wind direction. The base simulation can be improved with alternative surface characterization datasets for terrain, soil classification, and land use. Despite doubling the number of days with acceptable specific humidity, overall acceptability was never more than 10%. By comparison, an fMPE showed that predictions were able to reproduce the air-quality-relevant features on 38.4% of the days. The fMPE is based on features derived from an observational cluster analysis that have clear relationships with air quality, which suggests that reproducing those features will indicate better air quality model performance. An fMPE may be particularly useful for high-resolution modeling (1 km or less) when finescale variability can cause poor sMPE performance even when the general pattern that drives air pollution is well reproduced