Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey

The increasing number of publications on recommender systems for Technology Enhanced Learning (TEL) evidence a growing interest in their development and deployment. In order to support learning, recommender systems for TEL need to consider specific requirements, which differ from the requirements for recommender systems in other domains like e-commerce. Consequently, these particular requirements motivate the incorporation of specific goals and methods in the evaluation process for TEL recommender systems. In this article, the diverse evaluation methods that have been applied to evaluate TEL recommender systems are investigated. A total of 235 articles are selected from major conferences, workshops, journals, and books where relevant work have been published between 2000 and 2014. These articles are quantitatively analysed and classified according to the following criteria: type of evaluation methodology, subject of evaluation, and effects measured by the evaluation. Results from the survey suggest that there is a growing awareness in the research community of the necessity for more elaborate evaluations. At the same time, there is still substantial potential for further improvements. This survey highlights trends and discusses strengths and shortcomings of the evaluation of TEL recommender systems thus far, thereby aiming to stimulate researchers to contemplate novel evaluation approaches.Laboratorio de Investigación y Formación en Informática Avanzad

Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey

The increasing number of publications on recommender systems for Technology Enhanced Learning (TEL) evidence a growing interest in their development and deployment. In order to support learning, recommender systems for TEL need to consider specific requirements, which differ from the requirements for recommender systems in other domains like e-commerce. Consequently, these particular requirements motivate the incorporation of specific goals and methods in the evaluation process for TEL recommender systems. In this article, the diverse evaluation methods that have been applied to evaluate TEL recommender systems are investigated. A total of 235 articles are selected from major conferences, workshops, journals, and books where relevant work have been published between 2000 and 2014. These articles are quantitatively analysed and classified according to the following criteria: type of evaluation methodology, subject of evaluation, and effects measured by the evaluation. Results from the survey suggest that there is a growing awareness in the research community of the necessity for more elaborate evaluations. At the same time, there is still substantial potential for further improvements. This survey highlights trends and discusses strengths and shortcomings of the evaluation of TEL recommender systems thus far, thereby aiming to stimulate researchers to contemplate novel evaluation approaches.Laboratorio de Investigación y Formación en Informática Avanzad

Evaluating Recommender Systems for Technology Enhanced Learning: A Quantitative Survey

The increasing number of publications on recommender systems for Technology Enhanced Learning (TEL) evidence a growing interest in their development and deployment. In order to support learning, recommender systems for TEL need to consider specific requirements, which differ from the requirements for recommender systems in other domains like e-commerce. Consequently, these particular requirements motivate the incorporation of specific goals and methods in the evaluation process for TEL recommender systems. In this article, the diverse evaluation methods that have been applied to evaluate TEL recommender systems are investigated. A total of 235 articles are selected from major conferences, workshops, journals, and books where relevant work have been published between 2000 and 2014. These articles are quantitatively analysed and classified according to the following criteria: type of evaluation methodology, subject of evaluation, and effects measured by the evaluation. Results from the survey suggest that there is a growing awareness in the research community of the necessity for more elaborate evaluations. At the same time, there is still substantial potential for further improvements. This survey highlights trends and discusses strengths and shortcomings of the evaluation of TEL recommender systems thus far, thereby aiming to stimulate researchers to contemplate novel evaluation approaches.Laboratorio de Investigación y Formación en Informática Avanzad

Análisis de portales para compartir contenido digital en la formación del profesorado. Una propuesta conceptual de diseño

Los avances tecnológicos se hacen cada día más presentes en todos los ámbitos de la sociedad. En el ámbito educativo las principales instituciones internacionales y europeas se han preocupado de promover políticas para favorecer la construcción de espacios web que congreguen el contenido digital educativo disperso en la red. En el ámbito concreto de la formación del profesorado, las prácticas de compartición son limitadas y los servicios existentes no se adecúan completamente a la idiosincrasia de este colectivo. Esta tesis tiene como objetivo proporcionar unas guías para el diseño de portales educativos que atiendan a las necesidades educativas, sociales y tecnológicas de formadores de profesores y otros profesionales de la educación. Con el fin de arrojar luz a este problema se realiza una investigación multimétodo abordando dos estudios. En primer lugar, se analiza a fondo un portal europeo para la compartición de contenido digital en el ámbito de la formación del profesorado, Share.TEC, así como la información proporcionada por sus informantes. Para ello se utiliza el método de estudio de caso y se recaban y analizan los datos mediante técnicas cualitativas y cuantitativas de investigación. En segundo lugar se analiza una selección de portales educativos para compartir contenido digital y experiencias educativas. Para ello se genera un modelo de evaluación, permitiendo el análisis comparativo de estos portales. Finalmente se proponen un conjunto de consideraciones pedagógicas, tecnológicas y sociales para el diseño de portales educativos mediante la integración de las principales interpretaciones de cada estudio. Las contribuciones de este tesis son: 1) la definición de necesidades pedagógicas, tecnológicas y sociales de los formadores de profesores y otros profesionales de la educación sobre el uso de portales para compartir contenidos digitales educativos y experiencias; 2) la generación de un modelo de evaluación de portales educativos de contenido digital; 3) la detección de buenas prácticas de portales educativos; y 4) la propuesta teórica para la creación/remodelación de portales educativos para la formación del profesorado.Departamento de PedagogíaDoctorado en Investigación Transdisciplinar en Educació