We present an argument against a standard evidentialist position on the ethics of belief. We argue that sometimes a person merits criticism for holding a belief even when that belief is well supported by her evidence in any relevant sense. We show how our argument advances the case for anti-evidentialism (pragmatism) in the light of other arguments presented in the recent literature, and respond to a set of possible evidentialist rejoinders