Genetic Programming for Smart Phone Personalisation

Personalisation in smart phones requires adaptability to dynamic context based on user mobility, application usage and sensor inputs. Current personalisation approaches, which rely on static logic that is developed a priori, do not provide sufficient adaptability to dynamic and unexpected context. This paper proposes genetic programming (GP), which can evolve program logic in realtime, as an online learning method to deal with the highly dynamic context in smart phone personalisation. We introduce the concept of collaborative smart phone personalisation through the GP Island Model, in order to exploit shared context among co-located phone users and reduce convergence time. We implement these concepts on real smartphones to demonstrate the capability of personalisation through GP and to explore the benefits of the Island Model. Our empirical evaluations on two example applications confirm that the Island Model can reduce convergence time by up to two-thirds over standalone GP personalisation.Comment: 43 pages, 11 figure

The simplicity project: easing the burden of using complex and heterogeneous ICT devices and services

As of today, to exploit the variety of different "services", users need to configure each of their devices by using different procedures and need to explicitly select among heterogeneous access technologies and protocols. In addition to that, users are authenticated and charged by different means. The lack of implicit human computer interaction, context-awareness and standardisation places an enormous burden of complexity on the shoulders of the final users. The IST-Simplicity project aims at leveraging such problems by: i) automatically creating and customizing a user communication space; ii) adapting services to user terminal characteristics and to users preferences; iii) orchestrating network capabilities. The aim of this paper is to present the technical framework of the IST-Simplicity project. This paper is a thorough analysis and qualitative evaluation of the different technologies, standards and works presented in the literature related to the Simplicity system to be developed

Customizing smart environments: a tabletop approach

Smart environments are becoming a reality in our society and the number of intelligent devices integrated in these spaces is in-creasing very rapidly. As the combination of intelligent elements will open a wide range of new opportunities to make our lives easier, final users should be provided with a simplified method of handling complex intelligent features. Specifying behavior in these environments can be difficult for non-experts, so that more efforts should be directed towards easing the customization tasks. This work presents an entirely visual rule editor based on dataflow expressions for interactive tabletops which allows be-havior to be specified in smart environments. An experiment was carried out aimed at evaluating the usability of the editor in terms of non-programmers understanding of the abstractions and concepts involved in the rule model, ease of use of the pro-posed visual interface and the suitability of the interaction mechanisms implemented in the editing tool. The study revealed that users with no previous programming experience were able to master the proposed rule model and editing tool for specifying be-havior in the context of a smart home, even though some minor usability issues were detected.We would like to thank all the volunteers that participated in the empirical study. Our thanks are also due to the ASIC/Polimedia team for their computer hardware support. This work was partially funded by the Spanish Ministry of Science and Innovation under the National R&D&I Program within the project CreateWorlds (TIN2010-20488). It also received support from a postdoctoral fellowship within the VALi+d Program of the Conselleria d'Educacio, Cultura I Esport (Generalitat Valenciana) awarded to Alejandro Catala (APOSTD/2013/013). The work of Patricia Pons has been supported by the Universitat Politecnica de Valencia under the "Beca de Excelencia" program, and currently by an FPU fellowship from the Spanish Ministry of Education, Culture and Sports (FPU13/03831).Pons Tomás, P.; Catalá Bolós, A.; Jaén Martínez, FJ. (2015). Customizing smart environments: a tabletop approach. Journal of Ambient Intelligence and Smart Environments. 7(4):511-533. https://doi.org/10.3233/AIS-150328S51153374[1]C. Becker, M. Handte, G. Schiele and K. Rothermel, PCOM – a component system for pervasive computing, in: Proc. of the Second IEEE International Conference on Pervasive Computing and Communications (PerCom’04), IEEE Computer Society, Washington, DC, USA, 2004, pp. 67–76.Bhatti, Z. W., Naqvi, N. Z., Ramakrishnan, A., Preuveneers, D., & Berbers, Y. (2014). Learning distributed deployment and configuration trade-offs for context-aware applications in Intelligent Environments. Journal of Ambient Intelligence and Smart Environments, 6(5), 541-559. doi:10.3233/ais-140274Bonino, D., & Corno, F. (2011). What would you ask to your home if it were intelligent? Exploring user expectations about next-generation homes. Journal of Ambient Intelligence and Smart Environments, 3(2), 111-126. doi:10.3233/ais-2011-0099[4]D. Bonino, F. Corno and L. Russis, A user-friendly interface for rules composition in intelligent environments, in: Ambient Intelligence – Software and Applications, Advances in Intelligent and Soft Computing, Vol. 92, Springer, Berlin, Heidelberg, 2011, pp. 213–217.[5]X. Carandang and J. Campbell, The design of a tangible user interface for a real-time strategy game, in: Proc. of the 34th International Conference on Information Systems (ICIS 2013), Association for Information Systems (AIS), 2013, pp. 3781–3790.Catalá, A., Garcia-Sanjuan, F., Jaen, J., & Mocholi, J. A. (2012). TangiWheel: A Widget for Manipulating Collections on Tabletop Displays Supporting Hybrid Input Modality. Journal of Computer Science and Technology, 27(4), 811-829. doi:10.1007/s11390-012-1266-4Catala, A., Pons, P., Jaen, J., Mocholi, J. A., & Navarro, E. (2013). A meta-model for dataflow-based rules in smart environments: Evaluating user comprehension and performance. Science of Computer Programming, 78(10), 1930-1950. doi:10.1016/j.scico.2012.06.010[8]C. Chen, Y. Xu, K. Li and S. Helal, Reactive programming optimizations in pervasive computing, in: Proc. of the 2010 10th IEEE/IPSJ International Symposium on Applications and the Internet (SAINT’10), IEEE Computer Society, Washington, DC, USA, 2010, pp. 96–104.Cook, D. J., Augusto, J. C., & Jakkula, V. R. (2009). Ambient intelligence: Technologies, applications, and opportunities. Pervasive and Mobile Computing, 5(4), 277-298. doi:10.1016/j.pmcj.2009.04.001Dey, A. K. (2009). Modeling and intelligibility in ambient environments. Journal of Ambient Intelligence and Smart Environments, 1(1), 57-62. doi:10.3233/ais-2009-0008[11]A.K. Dey, T. Sohn, S. Streng and J. Kodama, iCAP: Interactive prototyping of context-aware applications, in: Proc. of Pervasive Computing, Lecture Notes in Computer Science, Vol. 3968, Springer-Verlag, Berlin, Heidelberg, 2006, pp. 254–271.[12]N. Díaz, J. Lilius, M. Pegalajar and M. Delgado, Rapid prototyping of semantic applications in smart spaces with a visual rule language, in: Proc. of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, ACM, New York, NY, USA, 2013, pp. 1335–1338.Gámez, N., & Fuentes, L. (2011). FamiWare: a family of event-based middleware for ambient intelligence. Personal and Ubiquitous Computing, 15(4), 329-339. doi:10.1007/s00779-010-0354-0García-Herranz, M., Alamán, X., & Haya, P. A. (2010). Easing the Smart Home: A rule-based language and multi-agent structure for end user development in Intelligent Environments. Journal of Ambient Intelligence and Smart Environments, 2(4), 437-438. doi:10.3233/ais-2010-0085[17]J. Good, K. Howland and K. Nicholson, Young people’s descriptions of computational rules in role-playing games: An empirical study, in: Proc. of the 2010 IEEE Symposium on Visual Languages and Human-Centric Computing, IEEE, 2010, pp. 67–74.Gouin-Vallerand, C., Abdulrazak, B., Giroux, S., & Dey, A. K. (2013). A context-aware service provision system for smart environments based on the user interaction modalities. Journal of Ambient Intelligence and Smart Environments, 5(1), 47-64. doi:10.3233/ais-120190[19]S. Holloway and C. Julien, The case for end-user programming of ubiquitous computing environments, in: Proc. of the FSE/SDP Workshop on Future of Software Engineering Research (FoSER’10), ACM, New York, NY, USA, 2010, pp. 167–172.Horn, M. S., Crouser, R. J., & Bers, M. U. (2011). Tangible interaction and learning: the case for a hybrid approach. Personal and Ubiquitous Computing, 16(4), 379-389. doi:10.1007/s00779-011-0404-2[21]M.S. Horn, E.T. Solovey, R.J. Crouser and R.J.K. Jacob, Comparing the use of tangible and graphical programming languages for informal science education, in: Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI’09), ACM, New York, NY, USA, 2009, pp. 975–984.Kelleher, C., & Pausch, R. (2005). Lowering the barriers to programming. ACM Computing Surveys, 37(2), 83-137. doi:10.1145/1089733.1089734[23]J. Lee, L. Garduño, E. Walker and W. Burleson, A tangible programming tool for creation of context-aware applications, in: Proc. of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’13), ACM, New York, NY, USA, 2013, pp. 391–400.Lézoray, J.-B., Segarra, M.-T., Phung-Khac, A., Thépaut, A., Gilliot, J.-M., & Beugnard, A. (2011). A design process enabling adaptation in pervasive heterogeneous contexts. Personal and Ubiquitous Computing, 15(4), 353-363. doi:10.1007/s00779-010-0356-y[25]B.Y. Lim and A.K. Dey, Assessing demand for intelligibility in context-aware applications, in: Proc. of the 11th International Conference on Ubiquitous Computing (Ubicomp’09), ACM, New York, NY, USA, 2009, pp. 195–204.[26]B.Y. Lim and A.K. Dey, Evaluating Intelligibility usage and usefulness in a context-aware application, in: Proc. of the 15th International Conference on Human-Computer, Lecture Notes in Computer Science, Vol. 8008, Springer, Berlin, Heidelberg, 2013, pp. 92–101.[28]P. Marshall, Do tangible interfaces enhance learning? in: Proc. of the 1st International Conference on Tangible and Embedded Interaction (TEI’07), ACM, New York, NY, USA, 2007, pp. 163–170.[30]C. Maternaghan and K.J. Turner, A configurable telecare system, in: Proc. of the 4th International Conference on Pervasive Technologies Related to Assistive Environments (PETRA’11), ACM, New York, NY, USA, 2011, pp. 14:1–14:8.[31]D.A. Norman, The Invisible Computer, MITT Press, Cambridge, MA, USA, 1998.PANE, J. F., RATANAMAHATANA, C. «ANN», & MYERS, B. A. (2001). Studying the language and structure in non-programmers’ solutions to programming problems. International Journal of Human-Computer Studies, 54(2), 237-264. doi:10.1006/ijhc.2000.0410[33]P. Pons, A. Catala, J. Jaen and J.A. Mocholi, DafRule: Un modelo de reglas enriquecido mediante flujos de datos para la definición visual de comportamiento reactivo de entidades virtuales, in: Actas de las Jornadas de Ingeniería del Software y Bases de Datos (JISBD 2011), 2011, 989–1002.Rasch, K. (2014). An unsupervised recommender system for smart homes. Journal of Ambient Intelligence and Smart Environments, 6(1), 21-37. doi:10.3233/ais-130242[35]K. Ryall, C. Forlines, C. Shen and M.R. Morris, Exploring the effects of group size and table size on interactions with tabletop shared-display groupware, in: Proc. of the 2004 ACM Conference on Computer Supported Cooperative Work, ACM, New York, NY, USA, 2004, pp. 284–293.Schmidt, A. (2000). Implicit human computer interaction through context. Personal Technologies, 4(2-3), 191-199. doi:10.1007/bf01324126[37]S.D. Scott, M. Sheelagh, T. Carpendale and K.M. Inkpen, Territoriality in collaborative tabletop workspaces, in: Proc. of the 2004 ACM Conference on Computer Supported Cooperative Work, ACM, New York, NY, USA, 2004, pp. 294–303.Sapounidis, T., & Demetriadis, S. (2013). Tangible versus graphical user interfaces for robot programming: exploring cross-age children’s preferences. Personal and Ubiquitous Computing, 17(8), 1775-1786. doi:10.1007/s00779-013-0641-7Shadbolt, N. (2003). Brain power. IEEE Intelligent Systems, 18(3), 2-3. doi:10.1109/mis.2003.1200718Shafti, L. S., Haya, P. A., García-Herranz, M., & Pérez, E. (2013). Inferring ECA-based rules for ambient intelligence using evolutionary feature extraction. Journal of Ambient Intelligence and Smart Environments, 5(6), 563-587. doi:10.3233/ais-130232[41]A. Strawhacker, A. Sullivan and M.U. Bers, TUI, GUI, HUI: Is a bimodal interface truly worth the sum of its parts? in: Proc. of the 12th International Conference on Interaction Design and Children, ACM, New York, NY, USA, 2013, pp. 309–312.Sylla, C., Branco, P., Coutinho, C., & Coquet, E. (2011). TUIs vs. GUIs: comparing the learning potential with preschoolers. Personal and Ubiquitous Computing, 16(4), 421-432. doi:10.1007/s00779-011-0407-zTeruel, M. A., Navarro, E., López-Jaquero, V., Montero, F., Jaen, J., & González, P. (2012). Analyzing the understandability of Requirements Engineering languages for CSCW systems: A family of experiments. Information and Software Technology, 54(11), 1215-1228. doi:10.1016/j.infsof.2012.06.001[44]E. Tse, J. Histon, S.D. Scott and S. Greenberg, Avoiding interference: How people use spatial separation and partitioning in SDG workspaces, in: Proc. of the 2004 ACM Conference on Computer Supported Cooperative Work, ACM, New York, NY, USA, 2004, pp. 252–261.[45]P. Tuddenham, D. Kirk and S. Izadi, Graspables revisited: Multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks, in: Proc. of the SIGCHI Conference on Human Factors in Computing Systems (CHI’10), ACM, New York, NY, USA, 2010, pp. 2223–2232.[46]A. Uribarren, J. Parra, R. Iglesias, J.P. Uribe and D. López de Ipiña, A middleware platform for application configuration, adaptation and interoperability, in: Proc. of the 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems Workshops, IEEE Computer Society, Washington, DC, USA, 2008, pp. 162–167.Weiser, M. (1991). The Computer for the 21st Century. Scientific American, 265(3), 94-104. doi:10.1038/scientificamerican0991-94[48]C. Wohlin, P. Runeson, M. Höst, M.C. Ohlsson, B. Regnell and A. Wesslén, Experimentation in Software Engineering: An Introduction, 1st edn, Kluwer Academic Publishers, Norwell, MA, USA, 2000.Zuckerman, O., & Gal-Oz, A. (2013). To TUI or not to TUI: Evaluating performance and preference in tangible vs. graphical user interfaces. International Journal of Human-Computer Studies, 71(7-8), 803-820. doi:10.1016/j.ijhcs.2013.04.00

System Support for Managing Invalid Bindings

Context-aware adaptation is a central aspect of pervasive computing applications, enabling them to adapt and perform tasks based on contextual information. One of the aspects of context-aware adaptation is reconfiguration in which bindings are created between application component and remote services in order to realize new behaviour in response to contextual information. Various research efforts provide reconfiguration support and allow the development of adaptive context-aware applications from high-level specifications, but don't consider failure conditions that might arise during execution of such applications, making bindings between application and remote services invalid. To this end, we propose and implement our design approach to reconfiguration to manage invalid bindings. The development and modification of adaptive context-aware applications is a complex task, and an issue of an invalidity of bindings further complicates development efforts. To reduce the development efforts, our approach provides an application-transparent solution where the issue of the invalidity of bindings is handled by our system, Policy-Based Contextual Reconfiguration and Adaptation (PCRA), not by an application developer. In this paper, we present and describe our approach to managing invalid bindings and compare it with other approaches to this problem. We also provide performance evaluation of our approach

Interaction With Tilting Gestures In Ubiquitous Environments

In this paper, we introduce a tilting interface that controls direction based applications in ubiquitous environments. A tilt interface is useful for situations that require remote and quick interactions or that are executed in public spaces. We explored the proposed tilting interface with different application types and classified the tilting interaction techniques. Augmenting objects with sensors can potentially address the problem of the lack of intuitive and natural input devices in ubiquitous environments. We have conducted an experiment to test the usability of the proposed tilting interface to compare it with conventional input devices and hand gestures. The experiment results showed greater improvement of the tilt gestures in comparison with hand gestures in terms of speed, accuracy, and user satisfaction.Comment: 13 pages, 10 figure