This paper reports on a comparison of the two alternative tests of attention in the Mini-Mental State Examination (MMSE), a well-known cognitive screening tool. The two tests, serial subtraction by seven and backwards spelling of the word world, are often used interchangeably. In a large population-based sample, the two tests were found to be weakly associated with each other, with the former test appearing more difficult, although both were strongly associated with educational level. The authors discuss the implications of this finding in clinical and research settings, and make recommendations for more consistent use of the instrument.