Statistical inference for two reliability indices in mastery testing based on the beta-binomial model

In mastery testing the raw agreement index and the kappa index may be estimated via one test administration when the test scores follow beta-binomial distributions. This paper reports formulae, tables, and a computer program which facil-itate the computation of the standard errors of the estimates. Illustrative applications are provided in the form of confi-dence intervals, hypothesis testing, and minimum sample sizes in reliability studies for mastery tests