Putting theory oriented evaluation into practice

Evaluations of gaming simulations and business games as teaching devices are typically end-state driven. This emphasis fails to detect how the simulation being evaluated does or does not bring about its desired consequences. This paper advances the use of a logic model approach which possesses a holistic perspective that aims at including all elements associated with the situation created by a game. The use of the logic model approach is illustrated as applied to Simgame, a board game created for secondary school level business education in six European Union countries

Maturation trajectories of cortical resting-state networks depend on the mediating frequency band

The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but whether distinct cortical rhythms, which are generated by separable neural mechanisms and are often manifested abnormally in psychiatric conditions, mediate maturation differentially, remains unknown. Using magnetoencephalography (MEG) to map frequency band specific maturation of resting state networks from age 7 to 29 in 162 participants (31 independent), we found significant changes with age in networks mediated by the beta (13–30 Hz) and gamma (31–80 Hz) bands. More specifically, gamma band mediated networks followed an expected asymptotic trajectory, but beta band mediated networks followed a linear trajectory. Network integration increased with age in gamma band mediated networks, while local segregation increased with age in beta band mediated networks. Spatially, the hubs that changed in importance with age in the beta band mediated networks had relatively little overlap with those that showed the greatest changes in the gamma band mediated networks. These findings are relevant for our understanding of the neural mechanisms of cortical maturation, in both typical and atypical development.This work was supported by grants from the Nancy Lurie Marks Family Foundation (TK, SK, MGK), Autism Speaks (TK), The Simons Foundation (SFARI 239395, TK), The National Institute of Child Health and Development (R01HD073254, TK), National Institute for Biomedical Imaging and Bioengineering (P41EB015896, 5R01EB009048, MSH), and the Cognitive Rhythms Collaborative: A Discovery Network (NFS 1042134, MSH). (Nancy Lurie Marks Family Foundation; Autism Speaks; SFARI 239395 - Simons Foundation; R01HD073254 - National Institute of Child Health and Development; P41EB015896 - National Institute for Biomedical Imaging and Bioengineering; 5R01EB009048 - National Institute for Biomedical Imaging and Bioengineering; NFS 1042134 - Cognitive Rhythms Collaborative: A Discovery Network

Level models of continuing professional development evaluation: a grounded review and critique

Continuing professional development (CPD) evaluation in education has been heavily influenced by ‘level models’, deriving from the work of Kirkpatrick and Guskey in particular, which attempt to trace the processes through which CPD interventions achieve outcomes. This paper considers the strengths and limitations of such models, and in particular the degree to which they are able to do justice to the complexity of CPD and its effects. After placing level models within the broader context of debates about CPD evaluation, the paper reports our experience of developing such models heuristically for our own evaluation practice. It then draws on positivist, realist and constructivist traditions to consider some more fundamental ontological and epistemological questions to which they give rise. The paper concludes that level models can be used in a number of ways and with differing emphases, and that choices made about their use will need to reflect both theoretical choices and practical considerations

Multi-Modal Neuroimaging Analysis and Visualization Tool (MMVT)

Sophisticated visualization tools are essential for the presentation and exploration of human neuroimaging data. While two-dimensional orthogonal views of neuroimaging data are conventionally used to display activity and statistical analysis, three-dimensional (3D) representation is useful for showing the spatial distribution of a functional network, as well as its temporal evolution. For these purposes, there is currently no open-source, 3D neuroimaging tool that can simultaneously visualize desired combinations of MRI, CT, EEG, MEG, fMRI, PET, and intracranial EEG (i.e., ECoG, depth electrodes, and DBS). Here we present the Multi-Modal Visualization Tool (MMVT), which is designed for researchers to interact with their neuroimaging functional and anatomical data through simultaneous visualization of these existing imaging modalities. MMVT contains two separate modules: The first is an add-on to the open-source, 3D-rendering program Blender. It is an interactive graphical interface that enables users to simultaneously visualize multi-modality functional and statistical data on cortical and subcortical surfaces as well as MEEG sensors and intracranial electrodes. This tool also enables highly accurate 3D visualization of neuroanatomy, including the location of invasive electrodes relative to brain structures. The second module includes complete stand-alone pre-processing pipelines, from raw data to statistical maps. Each of the modules and module features can be integrated, separate from the tool, into existing data pipelines. This gives the tool a distinct advantage in both clinical and research domains as each has highly specialized visual and processing needs. MMVT leverages open-source software to build a comprehensive tool for data visualization and exploration.Comment: 29 pages, 10 figure

Maturation trajectories of cortical resting-state networks depend on the mediating frequency band.

The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but whether distinct cortical rhythms, which are generated by separable neural mechanisms and are often manifested abnormally in psychiatric conditions, mediate maturation differentially, remains unknown. Using magnetoencephalography (MEG) to map frequency band specific maturation of resting state networks from age 7 to 29 in 162 participants (31 independent), we found significant changes with age in networks mediated by the beta (13-30 Hz) and gamma (31-80 Hz) bands. More specifically, gamma band mediated networks followed an expected asymptotic trajectory, but beta band mediated networks followed a linear trajectory. Network integration increased with age in gamma band mediated networks, while local segregation increased with age in beta band mediated networks. Spatially, the hubs that changed in importance with age in the beta band mediated networks had relatively little overlap with those that showed the greatest changes in the gamma band mediated networks. These findings are relevant for our understanding of the neural mechanisms of cortical maturation, in both typical and atypical development

Online peer assessment in higher education: a systematic review of literature in educational practices

Neste artigo procedemos a uma revisão sistemática da literatura sobre Online Peer Assessment (OPA) no Ensino Superior, mediadas por Tecnologias Digitais de Informação e Comunicação (TIC). Identificamos suas características, centrais e opcionais e mapeamos exemplos práticos (procedimentos e TIC) de OPA que poderão ser transversais, adaptáveis e aplicáveis em diversas unidades curriculares e regimes educacionais. Os resultados apontam para a utilização da OPA como uma estratégia que potencia a “avaliação para a aprendizagem”. Os referenciais teóricos subjacentes, os métodos de avaliação e os tipos de TIC utilizadas indicam seu direcionamento para um maior envolvimento e responsabilidade do aluno na sua aprendizagem. Evidenciamos na literatura que se busca desenvolver essas competências, dando ao aluno oportunidades com alguma regularidade para autoavaliar-se e avaliar seus pares por meio de feedback construtivo. Há também evidências de que dar ou produzir feedback é mais benéfico para a aprendizagem do que apenas recebê-lo, como também é cognitivamente mais exigente e envolve os alunos de forma mais ativa e os direciona ao pensamento crítico e a processos metacognitivos. A partir dos resultados alcançados, consideramos que a OPA, enquanto ferramenta cognitiva, contribui para a construção do conhecimento e para a reflexão sobre a aprendizagem. Um desafio que se coloca diz respeito ao desenvolvimento criativo com foco na diversificação e na inovação das práticas de avaliação no sentido de potenciar aprendizagens e resultados acadêmicos, em atenção às necessidades de aprendizagem que se manifestam frente às expectativas da educação atual e futura e às exigências da sociedade.In this research a systematic review of literature about Online Peer Assessment (OPA) in higher education, mediated by Information and Communication Technology (ICT), was carried out. Optional and central characteristics and its practices (procedures and ICT) were identified and mapping. These procedures and practices may be transversal, adaptable and applied in several curriculum units and educational regimes. The results point to the use of OPA as a strategy that enhances “assessment for learning”. The theoretical framework, the methods of assessment and the kinds of ICT used indicate directions for greater involvement and responsibility from the part of the student in his/her learning. Theoretical framework identifies the need to develop students’ skills, providing them with opportunities for self-assessment and peer assessment on a regular basis through constructive feedback. There is also evidence that to give or receive feedback is more beneficial for learning than just receiving it. It is also cognitively more demanding and directs the students to critical thinking and metacognitive processes. From the results obtained, OPA is seen as a cognitive tool, contributing to the building of knowledge and to reflection about learning. Issues for further reflection are also identified such as the creative development of assessment methods with a focus on diversity and innovation in order to enhance students’ learning and academic results, taking into account their learning needs in face of the expectations of current and future education and the demands of society.CIEC - Centro de Investigação em Estudos da Criança, IE, UMinho (UI 317 da FCT), PortugalFundos Nacionais através da FCT (Fundação para a Ciência e a Tecnologia) e cofinanciado pelo Fundo Europeu de Desenvolvimento Regional (FEDER) através do COMPETE 2020 – Programa Operacional Competitividade e Internacionalização (POCI) com a referência POCI-01-0145-FEDER-007562info:eu-repo/semantics/publishedVersio

Participation, knowledge production, and evaluative research: participation by different actors in a mental health study

This article reflects on the interrelations between participation, knowledge production, and public policy evaluation in light of issues from our own experience with evaluative research on a municipal network of Psychosocial Care Centers (CAPS) in Brazil. The article discusses the coordination of the complex process and the potentials and limits of partnerships for conducting qualitative evaluative studies in mental health with participation by different social actors. The authors conclude that qualitative evaluative research aligned with the perspective of including different points of view representing various segments is the best approach for understanding the numerous spin-offs from the implementation of services linked to the Brazilian psychiatric reform movement, given the inherent specificities of the mental health field.No presente texto apresentamos considerações sobre pesquisa avaliativa qualitativa e participativa com base em investigação desta natureza realizada junto a uma rede municipal de Centros de Atenção Psicossocial (CAPS) ligados ao Sistema Único de Saúde (SUS). A coordenação do complexo processo, bem como as potencialidades e limites do estabelecimento de parcerias para a realização de trabalhos de investigação avaliativa qualitativa em saúde mental, com a inclusão de diferentes atores sociais, são aqui discutidas. Concluímos que a pesquisa avaliativa qualitativa aliada à perspectiva de inclusão de distintos pontos de vista dos vários segmentos envolvidos é a que melhor se adequa à compreensão dos muitos desdobramentos oriundos da implementação de serviços ligados ao movimento de reforma psiquiátrica brasileira, dado as especificidades inerentes ao campo da saúde mental.Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq)Universidade Federal de São Paulo (UNIFESP)Universidade Estadual de Campinas FCMUNIFESPSciEL

The Connectome Visualization Utility: Software for Visualization of Human Brain Networks

In analysis of the human connectome, the connectivity of the human brain is collected from multiple imaging modalities and analyzed using graph theoretical techniques. The dimensionality of human connectivity data is high, and making sense of the complex networks in connectomics requires sophisticated visualization and analysis software. The current availability of software packages to analyze the human connectome is limited. The Connectome Visualization Utility (CVU) is a new software package designed for the visualization and network analysis of human brain networks. CVU complements existing software packages by offering expanded interactive analysis and advanced visualization features, including the automated visualization of networks in three different complementary styles and features the special visualization of scalar graph theoretical properties and modular structure. By decoupling the process of network creation from network visualization and analysis, we ensure that CVU can visualize networks from any imaging modality. CVU offers a graphical user interface, interactive scripting, and represents data uses transparent neuroimaging and matrix-based file types rather than opaque application-specific file formats