Promoting Robust Black-Box Solvers Through Competitions

International audienceThis paper presents the experiences of the organisers of the four constraint solver competitions which were held in conjunction with CP in the previous years. The paper mainly focuses on the competitions which were held in 2008 and 2009, outlines the reasons for organising the competitions, describes how the solvers were evaluated, and presents lessons, observations, and general trends