EUROCONTROL Annual Safety R&D Seminar (2008), Southampton, UK, 22-24 October 2008Short Term Conflict Alert (STCA) systems are complex software programs, with many parameters that must be adjusted to achieve best performance. We describe a simple evolutionary algorithm for optimising the trade-off between wanted alerts and nuisance alerts. The procedure yields an estimate of the Pareto optimal Receiver Operating Characteristic for the STCA system and we discuss additional uses of this for characterising and comparing the performance of STCA systems and airspaces