Although deficits in visual attention are often postulated as an important component of many declines in cognitive processing and functional outcomes in older adults, surprisingly little emphasis has been placed on evaluating psychometric instruments with which individual differences in visual attention ability can be assessed. This article reports the development and beginning psychometric evaluation of DriverScan, a change detection measure of attentional search for older adults. A constrained graded response model is used to approximate response speed and accuracy with categories of immediate, delayed, or no response. DriverScan items are shown to have excellent reliability over the studied sample, and the distribution of items is shown to adequately cover the difficulty continuum and to be maximally sensitive at distinguishing individuals with lower than average abilities (i.e., individuals with attention deficits). Item design features representing goal-directed and stimulus-driven attentional processing significantly predict item difficulty as hypothesized