A review of scale development practices in the study of organizations

Questionnaires are the most commonly used method of data collection infield research (Stone, 1978). Problems with the reliability and validity of measures used on questionnaires has often led to difficulties in interpreting the results of field research (Cook, Hepworth, Wall & Wart-, 1981; Schriesheim, Powers, Scandura, Gardiner & Lankau, 1993). This article reviews scale development procedures for 277 measures used in 75 articles published in leading academic journals from 1989 to 1994. It points out some of the problems encountered and provides examples of what could be considered “best practices “in scale development and reporting. Based on the review, recommendations are made to improve the scale development process. Questionnaires are the most commonly used method of data collection in field research (Stone, 1978). Over the past several decades hundreds of scales have been developed to assess various attitudes, perceptions, or opinions of organizational members in order to examine a priori hypothesized relationships with other constructs or behaviors. As Schwab (1980) points out, measures are often used before adequate data exist regarding their reliability and validity. Many researchers have drawn seemingly significant conclusions from the application of new measures, only to have subsequent studies contradict heir findings (Cook et al., 1981). Often scholars are left with the uncomfortable and somewhat embarrassing realization that results are inconclusive and that very little may actually be known about a particular topic. Although there may be a number of substantive reasons why different researchers arrive at varying conclusions, perhaps the greatest difficulty in conducting survey research is assuring the accuracy of measurement of the constructs under examination (Barrett, 1972). For example, recent studies of power and influence (Schrieshei