Skilled or Unskilled, but Still Unaware of It: How Perceptions of Difficulty Drive Miscalibration in Relative Comparisons

People are inaccurate judges of how their abilities compare to others’. Kruger and Dunning (1999; 2002) argue that most inaccuracy is attributable to unskilled performers’ lack of metacognitive skill to evaluate their performance. They overestimate their standing, whereas skilled performers accurately predict theirs. Consequently, the majority of people believe they are above average. However, not all tasks show this bias. In a series of ten tasks across three studies, we show that moderately difficult tasks produce little overall bias and little difference in accuracy between best and worst performers, and that more difficult tasks produce a negative bias, making the worst performers appear more accurate in their judgments. This pattern suggests that judges at all skill levels are subject to similar degrees of inaccuracy and bias. Although differences in metacognitive ability may play a role in the accuracy of interpersonal comparisons, our results indicate that, for the most part, the skilled and the unskilled are equally unaware of how their performances compare to those of others.http://deepblue.lib.umich.edu/bitstream/2027.42/39168/1/956.pd