The Interdisciplinary Ph.D. in Evaluation: Reflections on Its Development and First Seven Years

Background: The Interdisciplinary Ph.D. in Evaluation (IDPE) program at Western Michigan University (WMU) was designed and developed to address the increasing need and demand for highly trained and skilled evaluators. After only six and a half years, the program’s graduates are serving in important evaluation leadership positions throughout the world. Purpose: The purpose of this article is to provide readers with a historical overview and up-to-date description of the IDPE and is intended for those who are interested in evaluation curriculum and advances in the profession. Setting: Not applicable. Intervention: Not applicable. Research Design: Not applicable. Data Collection and Analysis: In this article each of the program’s current and previous leaders reflect on their role in the IDPE. Findings: The concept, design, and operations of this program should be of interest both to evaluation scholars and to those who administer graduate education programs in evaluation.  Keywords: evaluation training, doctoral programming, interdisciplinary programming, evaluation histor

Contextual adaptation of the Personnel Evaluation Standards for assessing faculty evaluation systems in developing countries: the case of Iran

<p>Abstract</p> <p>Background</p> <p>Faculty evaluations can identify needs to be addressed in effective development programs. Generic evaluation models exist, but these require adaptation to a particular context of interest. We report on one approach to such adaptation in the context of medical education in Iran, which is integrated into the delivery and management of healthcare services nationwide.</p> <p>Methods</p> <p>Using a triangulation design, interviews with senior faculty leaders were conducted to identify relevant areas for faculty evaluation. We then adapted the published checklist of the Personnel Evaluation Standards to fit the Iranian medical universities' context by considering faculty members' diverse roles. Then the adapted instrument was administered to faculty at twelve medical schools in Iran.</p> <p>Results</p> <p>The interviews revealed poor linkages between existing forms of development and evaluation, imbalance between the faculty work components and evaluated areas, inappropriate feedback and use of information in decision making. The principles of Personnel Evaluation Standards addressed almost all of these concerns and were used to assess the existing faculty evaluation system and also adapted to evaluate the core faculty roles. The survey response rate was 74%. Responses showed that the four principles in all faculty members' roles were met <it>occasionally </it>to <it>frequently</it>. Evaluation of teaching and research had the highest mean scores, while clinical and healthcare services, institutional administration, and self-development had the lowest mean scores. There were statistically significant differences between small medium and large medical schools (p < 0.000).</p> <p>Conclusion</p> <p>The adapted Personnel Evaluation Standards appears to be valid and applicable for monitoring and continuous improvement of a faculty evaluation system in the context of medical universities in Iran. The approach developed here provides a more balanced assessment of multiple faculty roles, including educational, clinical and healthcare services. In order to address identified deficiencies, the evaluation system should recognize, document, and uniformly reward those activities that are vital to the academic mission. Inclusion of personal developmental concerns in the evaluation discussion is essential for evaluation systems.</p

Combining and optimizing NIRS and EEG to study interictal epileptic discharges

We describe our ongoing application of NIRS-EEG to the study of inter-ictal discharges in adult epilepsy. We discuss optimizing NIRS-EEG data acquisition and analysis and we present preliminary NIRS-EEG results for an epileptic patient. © 2012 OSA

Maturation trajectories of cortical resting-state networks depend on the mediating frequency band

The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but whether distinct cortical rhythms, which are generated by separable neural mechanisms and are often manifested abnormally in psychiatric conditions, mediate maturation differentially, remains unknown. Using magnetoencephalography (MEG) to map frequency band specific maturation of resting state networks from age 7 to 29 in 162 participants (31 independent), we found significant changes with age in networks mediated by the beta (13–30 Hz) and gamma (31–80 Hz) bands. More specifically, gamma band mediated networks followed an expected asymptotic trajectory, but beta band mediated networks followed a linear trajectory. Network integration increased with age in gamma band mediated networks, while local segregation increased with age in beta band mediated networks. Spatially, the hubs that changed in importance with age in the beta band mediated networks had relatively little overlap with those that showed the greatest changes in the gamma band mediated networks. These findings are relevant for our understanding of the neural mechanisms of cortical maturation, in both typical and atypical development.This work was supported by grants from the Nancy Lurie Marks Family Foundation (TK, SK, MGK), Autism Speaks (TK), The Simons Foundation (SFARI 239395, TK), The National Institute of Child Health and Development (R01HD073254, TK), National Institute for Biomedical Imaging and Bioengineering (P41EB015896, 5R01EB009048, MSH), and the Cognitive Rhythms Collaborative: A Discovery Network (NFS 1042134, MSH). (Nancy Lurie Marks Family Foundation; Autism Speaks; SFARI 239395 - Simons Foundation; R01HD073254 - National Institute of Child Health and Development; P41EB015896 - National Institute for Biomedical Imaging and Bioengineering; 5R01EB009048 - National Institute for Biomedical Imaging and Bioengineering; NFS 1042134 - Cognitive Rhythms Collaborative: A Discovery Network

Multi-Modal Neuroimaging Analysis and Visualization Tool (MMVT)

Sophisticated visualization tools are essential for the presentation and exploration of human neuroimaging data. While two-dimensional orthogonal views of neuroimaging data are conventionally used to display activity and statistical analysis, three-dimensional (3D) representation is useful for showing the spatial distribution of a functional network, as well as its temporal evolution. For these purposes, there is currently no open-source, 3D neuroimaging tool that can simultaneously visualize desired combinations of MRI, CT, EEG, MEG, fMRI, PET, and intracranial EEG (i.e., ECoG, depth electrodes, and DBS). Here we present the Multi-Modal Visualization Tool (MMVT), which is designed for researchers to interact with their neuroimaging functional and anatomical data through simultaneous visualization of these existing imaging modalities. MMVT contains two separate modules: The first is an add-on to the open-source, 3D-rendering program Blender. It is an interactive graphical interface that enables users to simultaneously visualize multi-modality functional and statistical data on cortical and subcortical surfaces as well as MEEG sensors and intracranial electrodes. This tool also enables highly accurate 3D visualization of neuroanatomy, including the location of invasive electrodes relative to brain structures. The second module includes complete stand-alone pre-processing pipelines, from raw data to statistical maps. Each of the modules and module features can be integrated, separate from the tool, into existing data pipelines. This gives the tool a distinct advantage in both clinical and research domains as each has highly specialized visual and processing needs. MMVT leverages open-source software to build a comprehensive tool for data visualization and exploration.Comment: 29 pages, 10 figure

Can programme theory be used as a 'translational tool’ to optimise health service delivery in a national early years’ initiative in Scotland: a case study

Background Theory-based evaluation (TBE) approaches are heralded as supporting formative evaluation by facilitating increased use of evaluative findings to guide programme improvement. It is essential that learning from programme implementation is better used to improve delivery and to inform other initiatives, if interventions are to be as effective as they have the potential to be. Nonetheless, few studies describe formative feedback methods, or report direct instrumental use of findings resulting from TBE. This paper uses the case of Scotland’s, National Health Service, early years’, oral health improvement initiative (Childsmile) to describe the use of TBE as a framework for providing feedback on delivery to programme staff and to assess its impact on programmatic action.&lt;p&gt;&lt;/p&gt; Methods In-depth, semi-structured interviews and focus groups with key stakeholders explored perceived deviations between the Childsmile programme 'as delivered’ and its Programme Theory (PT). The data was thematically analysed using constant comparative methods. Findings were shared with key programme stakeholders and discussions around likely impact and necessary actions were facilitated by the authors. Documentary review and ongoing observations of programme meetings were undertaken to assess the extent to which learning was acted upon.&lt;p&gt;&lt;/p&gt; Results On the whole, the activities documented in Childsmile’s PT were implemented as intended. This paper purposefully focuses on those activities where variation in delivery was evident. Differences resulted from the stage of roll-out reached and the flexibility given to individual NHS boards to tailor local implementation. Some adaptations were thought to have diverged from the central features of Childsmile’s PT, to the extent that there was a risk to achieving outcomes. The methods employed prompted national service improvement action, and proposals for local action by individual NHS boards to address this.&lt;p&gt;&lt;/p&gt; Conclusions The TBE approach provided a platform, to direct attention to areas of risk within a national health initiative, and to agree which intervention components were 'core’ to its hypothesised success. The study demonstrates that PT can be used as a 'translational tool’ to facilitate instrumental use of evaluative findings to optimise implementation within a complex health improvement programme.&lt;p&gt;&lt;/p&gt

Maturation trajectories of cortical resting-state networks depend on the mediating frequency band.

The functional significance of resting state networks and their abnormal manifestations in psychiatric disorders are firmly established, as is the importance of the cortical rhythms in mediating these networks. Resting state networks are known to undergo substantial reorganization from childhood to adulthood, but whether distinct cortical rhythms, which are generated by separable neural mechanisms and are often manifested abnormally in psychiatric conditions, mediate maturation differentially, remains unknown. Using magnetoencephalography (MEG) to map frequency band specific maturation of resting state networks from age 7 to 29 in 162 participants (31 independent), we found significant changes with age in networks mediated by the beta (13-30 Hz) and gamma (31-80 Hz) bands. More specifically, gamma band mediated networks followed an expected asymptotic trajectory, but beta band mediated networks followed a linear trajectory. Network integration increased with age in gamma band mediated networks, while local segregation increased with age in beta band mediated networks. Spatially, the hubs that changed in importance with age in the beta band mediated networks had relatively little overlap with those that showed the greatest changes in the gamma band mediated networks. These findings are relevant for our understanding of the neural mechanisms of cortical maturation, in both typical and atypical development

Using network dynamic fMRI for detection of epileptogenic foci

Abstract\ud \ud Background\ud Epilepsy is one of the most prevalent neurological disorders. It remains medically intractable for about one-third of patients with focal epilepsy, for whom precise localization of the epileptogenic zone responsible for seizure initiation may be critical for successful surgery. Existing fMRI literature points to widespread network disturbances in functional connectivity. Per previous scalp and intracranial EEG studies and consistent with excessive local synchronization during interictal discharges, we hypothesized that, relative to same regions in healthy controls, epileptogenic foci would exhibit less chaotic dynamics, identifiable via entropic analyses of resting state fMRI time series.\ud \ud \ud Methods\ud In order to first validate this hypothesis on a cohort of patients with known ground truth, here we test individuals with well-defined epileptogenic foci (left mesial temporal lobe epilepsy). We analyzed voxel-wise resting-state fMRI time-series using the autocorrelation function (ACF), an entropic measure of regulation and feedback, and performed follow-up seed-to-voxel functional connectivity analysis. Disruptions in connectivity of the region exhibiting abnormal dynamics were examined in relation to duration of epilepsy and patients’ cognitive performance using a delayed verbal memory recall task.\ud \ud \ud Results\ud ACF analysis revealed constrained (less chaotic) functional dynamics in left temporal lobe epilepsy patients, primarily localized to ipsilateral temporal pole, proximal to presumed focal points. Autocorrelation decay rates differentiated, with 100 % accuracy, between patients and healthy controls on a subject-by-subject basis within a leave-one-subject out classification framework. Regions identified via ACF analysis formed a less efficient network in patients, as compared to controls. Constrained dynamics were linked with locally increased and long-range decreased connectivity that, in turn, correlated significantly with impaired memory (local left temporal connectivity) and epilepsy duration (left temporal – posterior cingulate cortex connectivity).\ud \ud \ud Conclusions\ud Our current results suggest that data driven functional MRI methods that target network dynamics hold promise in providing clinically valuable tools for identification of epileptic regions.This research was supported by the National Science Foundation (CBET\ud 1264440; LRMP) and the Sao Paulo Research Foundation (Young\ud Investigators Awards FAPESP 11/08573-4; JSI)