There is a need to identify biomarkers that predict degree of chronic speech fluency/language impairment and potential for improvement after stroke. We previously showed that the Arcuate Fasciculus lesion load (AF-LL), a combined variable of lesion site and size, predicted speech fluency in patients with chronic aphasia. In the current study, we compared lesion loads of such a structural map (i.e., AF-LL) with those of a functional map [i.e., the functional gray matter lesion load (fGM-LL)] in their ability to predict speech fluency and naming performance in a large group of patients. The fGM map was constructed from functional brain images acquired during an overt speaking task in a group of healthy elderly controls. The AF map was reconstructed from high-resolution diffusion tensor images also from a group of healthy elderly controls. In addition to these two canonical maps, a combined AF-fGM map was derived from summing fGM and AF maps. Each canonical map was overlaid with individual lesion masks of 50 chronic aphasic patients with varying degrees of impairment in speech production and fluency to calculate a functional and structural lesion load value for each patient, and to regress these values with measures of speech fluency and naming. We found that both AF-LL and fGM-LL independently predicted speech fluency and naming ability; however, AF lesion load explained most of the variance for both measures. The combined AF-fGM lesion load did not have a higher predictability than either AF-LL or fGM-LL alone. Clustering and classification methods confirmed that AF lesion load was best at stratifying patients into severe and non-severe outcome groups with 96% accuracy for speech fluency and 90% accuracy for naming. An AF-LL of greater than 4 cc was the critical threshold that determined poor fluency and naming outcomes, and constitutes the severe outcome group. Thus, surrogate markers of impairments have the potential to predict outcomes and can be used as a stratifier in experimental studies