The elderly population is increasing and the response of the society was to provide them with services directed to them to cope with their needs. One of the oldest solutions is the retirement home, providing housing and permanent assistance for the elderly. Furthermore, most of the retirement homes are inhabited by multiple elderly people, thus creating a community of people who are somewhat related in age and medical issues. The ambient assisted living (AAL) area tries to solve some of the elderly issues by producing technological products, some of them dedicated to elderly homes. One of the identified problem is that elderly people are sometimes discontent about the activities that consume most of their day promoted by the retirement home social workers. The work presented in this paper attempts to improve how these activities are scheduled taking into account the elderlies' emotional response to these activities. The aim is to maximize the group happiness by promoting the activities the group likes, minding if they are bored due to activities repetition. In this sense, this paper presents an extension of the Cognitive Life Assistant platform incorporating a social emotional model. The proposed system has been modelled as a free time activity manager which is in charge of suggesting activities to the social workers. (C) 2018 Elsevier B.V. All rights reserved.Angelo Costa thanks the Fundacao para a Ciencia e a Tecnologia (FCT) the Post-Doc scholarship with the Ref. SFRH/BPD/102696/2014. This work is also supported by COMPETE: POCI-01-0145-FEDER-007043 and FCT - Fundacao para a Ciencia e Tecnologia within the Project Scope: UID/CEC/00319/2013 and partially supported by the MINECO/FEDER TIN2015-65515-C4-1-R and the FPI grant AP2013-01276 awarded to Jaime-Andres Rincon
