Understanding the Role of Theory on Instrument Development: An Examination of Strengths and Weaknesses of Discriminant Validity Analysis Techniques

Numerous researchers have called attention to many important issues in instrument development throughout the relatively short history of the information systems (IS) academic research discipline (e.g., Petter, Straub, & Rai 2007; Straub, Boudreau, & Gefen 2004; Straub 1989). With the accumulation of knowledge related to the process of instrument development, it has now become necessary to take a closer look at specific aspects of this process. This paper focuses on construct validity, specifically discriminant validity, and examines some popular methods of supporting this type of validity when using cross-sectional data. We examine strengths and weaknesses of these analysis techniques with a focus on the role of theory and informed interpretation. We highlight the applicability of these techniques by analyzing a sample dataset where we theorize two constructs to be highly correlated. With this paper, we provide both researchers and reviewers a greater understanding of the highlighted discriminant validity analysis techniques