Development and reliability of a streetscape observation instrument for international use: MAPS-global

MethodsMAPS-Global was developed by compiling concepts and items from eight environmental measures relevant to walking and bicycling. Inter-rater reliability data were collected in neighborhoods selected to vary on geographic information system (GIS)-derived macro-level walkability in five countries (Australia, Belgium, Brazil, Hong Kong-China, and Spain). MAPS-Global assessments (n = 325) were completed in person along a ≥ 0.25 mile route from a residence toward a non-residential destination, and a commercial block was also rated for each residence (n = 82). Two raters in each country rated each route independently. A tiered scoring system was created that summarized items at multiple levels of aggregation, and positive and negative valence scores were created based on the expected effect on physical activity. The intraclass correlation coefficient (ICC) was computed for scales and selected items using one-way random models.ResultsOverall, 86.6% of individual items and single item indicators showed excellent agreement (ICC ≥ 0.75), and 13.4% showed good agreement (ICC = 0.60–0.74). All subscales and overall summary scores showed excellent agreement. Six of 123 items were too rare to compute the ICC. The median ICC for items and scales was 0.92 with a range of 0.50–1.0. Aesthetics and social characteristics showed lower ICCs than other sub-scales, but reliabilities were still in the excellent range (ICC ≥ 0.75).ConclusionEvaluation of inter-observer reliability of MAPS-Global across five countries indicated all items and scales had “good” or “excellent” reliability. The results demonstrate that trained observers from multiple countries were able to reliably conduct observations of both residential and commercial areas with the new MAPS-Global instrument. Next steps are to evaluate construct validity in relation to physical activity in multiple countries and gain experience with using MAPS-Global for research and practice applications.