Toward a Dialogue: Following Professional Standards on Education Achievement Testing

The authors describe challenges of following professional standards for educational achievement testing due to the complexity of gathering appropriate evidence to support demanding test interpretation and use. Validity evidence has been found to be low for some individual testing standards, leading to the possibility of faulty or impoverished test interpretation and use. In response to this context, measurement professionals have called for a theory of action including behavior changes of multiple agents involved in the testing process. Also, changing roles have been seen for a broad range of agents including test developers, those who influence testing, and those influenced by testing. Some of these roles are discussed and others illustrated with examples from practice. A sociocultural theory of action noted in the literature is proposed as a thematic guide to practice. The paper concludes with a call for dialogue and two research and development tasks that might advance practice

To Write or Not to Write? The Contested Nature and Role of Writing in Arts Practice Research

One of the most contested areas of arts practice research concerns the nature and role of writing. For many artist-scholars, research predicated on artistic practice does not require written contextualization. For those who engage in writing, questions as to the nature, mode, register, and purpose of writing abound. The growing body of publications addressing this question illustrates two broad responses. On the one hand, the ethnographic tradition attempts to capture phenomenological aspects of the artistic and reflexive experience. On the other, writing itself is approached as an integral part (a generative strand) of an artist’s creative process. In this article, the development of arts practice research at the Irish World Academy of Music and Dance, University of Limerick, Ireland is reviewed and it serves as a point of departure to discuss an engagement with writing that invites a dialogue between ethnographic and generative approaches, the balance of which is ultimately decided by the research question, and the approach taken to answer the question

Conducting a Large Public Health Data Collection Project in Uganda: Methods, Tools, and Lessons Learned

We report on the implementation experience of carrying out data collection and other activities for a public health evaluation study on whether U.S. President’s Emergency Plan for AIDS Relief (PEPFAR) investment improved utilization of health services and health system strengthening in Uganda. The retrospective study period focused on the PEPFAR scale-up, from mid-2005 through mid-2011, a period of expansion of PEPFAR programing and health services. We visited 315 health care facilities in Uganda in 2011 and 2012 to collect routine health management information system data forms, as well as to conduct interviews with health system leaders. An earlier phase of this research project collected data from all 112 health district headquarters, reported elsewhere. This article describes the lessons learned from collecting data from health care facilities, project management, useful technologies, and mistakes. We used several new technologies to facilitate data collection, including portable document scanners, smartphones, and web-based data collection, along with older but reliable technologies such as car batteries for power, folding tables to create space, and letters of introduction from appropriate authorities to create entrée. Research in limited-resource settings requires an approach that values the skills and talents of local people, institutions and government agencies, and a tolerance for the unexpected. The development of personal relationships was key to the success of the project. We observed that capacity building activities were repaid many fold, especially in data management and technology

Management of a Multidisciplinary Research Project: A Case Study on Adopting Agile Methods

Agile methods, initially used by cross-functional teams in software development projects, can also facilitate teamwork in collaborative research processes. For this, project management-related issues need to be addressed, including the challenge of finding practical means for coordinating scientific collaboration, while garnering commitment from all participants. This article explores the utilisation of agile methods by a semi-distributed scientific team, for coordinating a multidisciplinary research project. It examines how these methods can contribute to task coordination in scientific research and highlights key factors for successful adoption of the agile framework in collaborative research projects. Data are collected from a research team, after a 10-week phase of implementing agile methods. Data analysis focuses on the effectiveness of team dynamics and the digital tools used for communication and coordination during the project. The findings indicate a perception that agile methods contribute to improved coordination and teamwork during project development, with less agreement on the utility of some of the tools used. Also, it suggests the importance of involvement of the Principal Investigator and the role and contribution of a Facilitator

Key Components of Collaborative Research in the Context of Environmental Health: A Scoping Review

In a collaborative research process, the participation of interdisciplinary researchers and multi-sectoral stakeholders supports the co-creation, translation, and exchange of new knowledge. Following a scoping review methodology, we explored the collaborative research processes in the specific context of environment and human health research. Initially, our literature search strategy identified 1,328 publications. After several phases of reviewing and applying screening criteria to titles, abstracts, and full text, 45 publications were selected for final review. Data were charted by different topics and then collated, summarized, and analyzed thematically. From the different experiences and research approaches analyzed, we identified comprehensive details of the key components, facilitators, challenges, and best practices that impact the collaborative research process. Specifically, we identified the following seven emerging themes: (a) allocating time and resources, (b) addressing disciplinary and sectoral issues, (c) building relationships, (d) ensuring representation, (e) embedding participation in the research, (f) supporting ongoing collaboration, and (g) developing knowledge translation and exchange

Gaining a Fuller Picture of Sex Trafficking in Manitoba: A Case Study of Narrative-Based Research Utilizing 'Low Tech' Thematic Analysis

This article explores narrative-based, person-centered research, carried out by the author for his PhD dissertation, titled "Modern Day Slavery and the Sex Industry: Raising the Voices of Survivors and Collaborators While Confronting Sex Trafficking and Exploitation in Manitoba, Canada." The article describes interview dynamics considered and accounted for, including positionality of the researcher and the narrative-based research methodology. The author provides detailed description of the grounded, inductive, "old school," low technology data analysis process used, some of the challenges encountered, and recommendations for similar studies in future. The key challenges arose from the positionality of the researcher and the need to protect the participants from potential repercussions. The recommendations relate to the relevance of narrative-based research, limited transferability of the results of such research, and the value of a more open-ended interviewing style

Ethical Issues in Designing Internet-Based Research: Recommendations for Good Practice

This article presents an overview of internet-based research, highlighting the absence of a standard terminology to define and classify such research. The label internet-based research or online research can cover a diverse range of research designs and methods, involving different degrees of ethical concern regarding privacy, transparency, confidentiality, and security. Although the basic principles of human research ethics (such as respect, integrity, justice, and beneficence) are still applicable in this context, interpreting and applying these principles correctly and protecting the interests of the research participants effectively are not easy to ensure. While the nature of the internet poses challenges of user authentication and confidentiality, the diversity of national laws and codes of ethics poses additional challenges. The article refers to relevant Canadian laws, with which the author is familiar. Finally, a set of recommendations are offered to mitigate the ethical challenges of internet-based research. These include ethical practices such as ensuring transparency while recruitment, considering participants’ expectations about privacy, ensuring legal compliance, using secure communication protocols, obtaining informed and knowledgeable consent, offering participants the opportunity to withdraw from the research and retract their data, and ensuring that data are not used for subsequent non-research purposes