We present a summary of a problem analysis examining the challenges of introducing automated component black-box testing for an evolutionary grown software system. We outline the system and illustrate the challenges associated with testing. To explore to what extent black-box testing is feasible under a set of given conditions, we developed a prototype test automation framework. We describe the lessons learned in the process
