ABSTRACT We propose an AR-based painting interface that enables users to design an illumination distribution for a real room using an array of computer-controlled lights. Users specify an illumination distribution of the room by painting on the image obtained by a camera mounted in the room. The painting result is overlaid on the camera image as contour lines of the target illumination intensity. The system runs an optimization interactively to calculate light parameters to deliver the requested illumination condition. In this implementation, we used actuated lights that can change the lighting direction to generate the requested illumination condition more accurately and efciently than static lights. We built a miniature-scale experimental environment and ran a user study to compare our method with a standard direct manipulation method using widgets. The results showed that the users preferred our method for informal light control. We propose an augmented reality (AR) user interface called Lighty that enables users to easily design an illumination distribution for a real room using an array of computer-controlled lights. Users specify which area of the room is to be well-lit and which is to be dark by painting an illumination distribution on a tablet device displaying an image obtained by a camera mounted in the room. The system runs an optimization to calculate the light parameters and then illuminates the room. Our method is inspired by the goal-based lighting optimization approach in computer graphics SYSTEM OVERVIEW Our overall system is shown in USER INTERFACE The user interface is shown i
