Flight Service Specialist Initial Qualifications Course: Content Validation of FAA Academy Course 50232

Civil Aerospace Medical Institute1991PDFTech ReportBroach, DanaCivil Aeromedical InstituteUnited States. Office of Aviation MedicineCivil Aerospace Medical InstituteUnited StatesAir traffic controllersSelection and appointmentTrainingValidityJob analysisQualificationsAir traffic controllers--Selection and appointmentExaminations--Design and constructionExaminations--ValidityJob analysisDOT/FAA/AM-91/4This study evaluates the content validity of the Initial Qualifications Course provided to flight service specialists (FSS) by the FAA Academy. The purpose of FSS Initial Qualifications Course (FAA Academy course 50232) is to predict the student's probability of attaining certification as a full performance level controller in field facilities. First, results of analyses of the FSS position in automated flight service stations (AFSSs) are reviewed and summarized. Second, the linkage between job analysis and specifications of training content are described. Third, a content validation study, using a panel of 16 full performance level specialists from field facilities, is described.The panel reviewed the graded, multiple-choice written examinations and a sample of graded laboratory simulations against the available job function descriptions and identified knowledges and skills required to perform those functions. The panel indicated whether a knowledge or skill was represented or tested in the reviewed graded instrument. The proportion of knowledges or skills represented by an instrument was then calculated for each rater; the average of these proportions across raters provided an overall index of the degree to which the knowledges and skills were represented in the graded instruments. A criterion of 70% coverage was selected as the evaluative benchmark. Three job functions are taught in the FSS Initial Qualifications Course: (a) flight plan processing; (b) orienting lost aircraft; and (c) weather analysis. Overall, eight of the ten graded components of FAA Academy course 50232 appeared to adequately sample the knowledge and task domains associated with these three AFSS job functions.This content validation study and associated review of job analyses and course development indicate that FAA Academy course 50232 was constructed with reasonable competence and bears some reasonable, manifest relationship to the job of flight service specialist. The evidence provided by this study provides a basis for using the FSS Initial Qualifications Course on an interim basis for making personnel decisions about specialists.119