Bonet, Sally

Cheong, Simone

Gonzalez, Lizette

English

Scholarly Commons@Baptist Health South Florida

Baptist Health South Florida Scholarly Commons @ Baptist Health South Florida All Publications 3-23-2017 Reliability and Validity Testing of a Rubric Aimed at Assessing Quality of Responses in a Virtual Journal Club Sally Bonet West Kendall Baptist Hopsital, sallybo@baptisthealth.net Simone Cheong West Kendall Baptist Hospital, simonech@baptisthealth.net Lizette Gonzalez West Kendall Baptist Hospital, lizetteg@baptisthealth.net Follow this and additional works at: https://scholarlycommons.baptisthealth.net/se-all-publications  Part of the Medicine and Health Sciences Commons Citation Bonet, Sally; Cheong, Simone; and Gonzalez, Lizette, "Reliability and Validity Testing of a Rubric Aimed at Assessing Quality of Responses in a Virtual Journal Club" (2017). All Publications. 2666. https://scholarlycommons.baptisthealth.net/se-all-publications/2666 This Conference Poster -- Open Access is brought to you for free and open access by Scholarly Commons @ Baptist Health South Florida. It has been accepted for inclusion in All Publications by an authorized administrator of Scholarly Commons @ Baptist Health South Florida. For more information, please contact Carrief@baptisthealth.net. MethodsResultsBackgroundPurpose Implications for PracticeReferencesReliability and Validity Testing of a Rubric Aimed at Assessing Quality of Responses in a Virtual Journal ClubSally Bonet MSN, RN, Simone Cheong MSHSA, MSN, CMSRN, RN, & Lizette Gonzalez BSN, CMSRN, RNTo determine the reliability and validity of a rubric developed to assess the quality of responses in a virtual journal club.• Journal clubs (JC) are a common form of education in health care with the goal of promoting the translation of research evidence into practice1.• Virtual journal clubs (VJC) can facilitate a critical review of research to change nursing practice based on empirical findings2 through quality responses.• The better the quality of the responses, the more nurses are critically reviewing the possibility of a change in practice based on evidence.• However, an assessment tool to evaluate the quality of VJC responses does not exist.This is a psychometric assessment of a rubric study.  1. Content validity will be established on a 4-point Likert scale where 5-10 clinical educators will assess the relevance and clarity of each rubric item.  2. Once agreement is met, inter-observer reliability will be established by the assessment of VJC responses from 10-20 Advanced and/or Expert Medical-Surgical nurses. Each VJC responses will have 2-3 assessments for comparison.Assessment items were taken from questions developed to derive a contact hour for responses.Content Validity Results• The 5 rubric items (Figure 1) were considered to be sufficient to determine the quality of a response because none of the 7 reviewers suggested more or different items.• The content validity coefficients for all items were all excellent. 100% of the 7 reviewers found the 5 items relevant and 100% of the 7 reviewers found the 5 items clear (Tables 1 & 2).Item 1 relevantItem 2 relevantItem 3 relevantItem 4 relevantItem 5 relevantDisagree or somewhat disagree0 of 7 0 of 7 0 of 7 0 of 7 0 of 7Somewhat agree or Agree7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(all 7 agree)7 of 7(all 7 agree)Item 1 clear Item 2 clear Item 3 clear Item 4 clear Item 5 clearDisagree or somewhat disagree0 of 7 0 of 7 0 of 7 0 of 7 0 of 7Somewhat agree or Agree7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(all 7 agree)7 of 7(all 7 agree)Inter-observer Reliability• Work in progress.• This study engages clinical educators and staff nurses in the research and tool development process.• Study byproduct is a tool to assist staff and informal leaders in evidence-based practice engagement, driving an engaged workforce. • An engaged workforce is a happy workforce which then leads to staff retention.1Bilodeau, I., Pepin, J., & St-Louis, L. (2012). Journal club in a critical care unit: An innovative design triggering learning through reading and dialogue. Dynamics, 23(1), 18–23.2Berger, J., Hardin, H. K., & Topp, R. (2011). Implementing a virtual journal club in a clinical nursing setting. Journal for Nurses in Staff Development, 27(3), 116-120.Figure 1. Researcher-developed Rubric: Virtual Journal Club Posting Quality Assessment Tool (Item 1)(Item 2)(Item 3)(Item 4)(Item 5)Contact Informationsallybo@baptisthealth.netsimonech@baptisthealth.netlizetteg@baptisthealth.netTables 1 & 2. Content validity results of rubric itemsrelated to clarity and relevance of each item

Reliability and Validity Testing of a Rubric Aimed at Assessing Quality of Responses in a Virtual Journal Club

Baptist Health South FloridaScholarly Commons @ Baptist Health South FloridaAll Publications2-3-2017Reliability and Validity Testing of a Rubric Aimedat Assessing Quality of Responses in a VirtualJournal ClubSally BonetWest Kendall Baptist Hospital, sallybo@baptisthealth.netSimone CheongWest Kendall Baptist Hospital, simonech@baptisthealth.netLizette GonzalezWest Kendal Baptist Hospital, lizetteg@baptisthealth.netFollow this and additional works at: https://scholarlycommons.baptisthealth.net/se-all-publicationsPart of the Nursing CommonsThis Conference Poster -- Open Access is brought to you for free and open access by Scholarly Commons @ Baptist Health South Florida. It has beenaccepted for inclusion in All Publications by an authorized administrator of Scholarly Commons @ Baptist Health South Florida. For moreinformation, please contact Carrief@baptisthealth.net.CitationBonet, Sally; Cheong, Simone; and Gonzalez, Lizette, "Reliability and Validity Testing of a Rubric Aimed at Assessing Quality ofResponses in a Virtual Journal Club" (2017). All Publications. 1978.https://scholarlycommons.baptisthealth.net/se-all-publications/1978MethodsResultsBackgroundPurpose Implications for PracticeReferencesReliability and Validity Testing of a Rubric Aimed at Assessing Quality of Responses in a Virtual Journal ClubSally Bonet MSN, RN, Simone Cheong MSHSA, MSN, CMSRN, RN, & Lizette Gonzalez BSN, CMSRN, RNTo determine the reliability and validity of a rubric developed to assess the quality of responses in a virtual journal club.• Journal clubs (JC) are a common form of education in health care with the goal of promoting the translation of research evidence into practice1.• Virtual journal clubs (VJC) can facilitate a critical review of research to change nursing practice based on empirical findings2 through quality responses.• The better the quality of the responses, the more nurses are critically reviewing the possibility of a change in practice based on evidence.• However, an assessment tool to evaluate the quality of VJC responses does not exist.This is a psychometric assessment of a rubric study.  1. Content validity will be established on a 4-point Likert scale where 5-10 clinical educators will assess the relevance and clarity of each rubric item.  2. Once agreement is met, inter-observer reliability will be established by the assessment of VJC responses from 10-20 Advanced and/or Expert Medical-Surgical nurses. Each VJC responses will have 2-3 assessments for comparison.Assessment items were taken from questions developed to derive a contact hour for responses.Content Validity Results• The 5 rubric items (Figure 1) were considered to be sufficient to determine the quality of a response because none of the 7 reviewers suggested more or different items.• The content validity coefficients for all items were all excellent. 100% of the 7 reviewers found the 5 items relevant and 100% of the 7 reviewers found the 5 items clear (Tables 1 & 2).Item 1 relevantItem 2 relevantItem 3 relevantItem 4 relevantItem 5 relevantDisagree or somewhat disagree0 of 7 0 of 7 0 of 7 0 of 7 0 of 7Somewhat agree or Agree7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(all 7 agree)7 of 7(all 7 agree)Item 1 clear Item 2 clear Item 3 clear Item 4 clear Item 5 clearDisagree or somewhat disagree0 of 7 0 of 7 0 of 7 0 of 7 0 of 7Somewhat agree or Agree7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(6 agree and 1 somewhat agree)7 of 7(all 7 agree)7 of 7(all 7 agree)Inter-observer Reliability• Work in progress.• This study engages clinical educators and staff nurses in the research and tool development process.• Study byproduct is a tool to assist staff and informal leaders in evidence-based practice engagement, driving an engaged workforce. • An engaged workforce is a happy workforce which then leads to staff retention.1Bilodeau, I., Pepin, J., & St-Louis, L. (2012). Journal club in a critical care unit: An innovative design triggering learning through reading and dialogue. Dynamics, 23(1), 18–23.2Berger, J., Hardin, H. K., & Topp, R. (2011). Implementing a virtual journal club in a clinical nursing setting. Journal for Nurses in Staff Development, 27(3), 116-120.Figure 1. Researcher-developed Rubric: Virtual Journal Club Posting Quality Assessment Tool (Item 1)(Item 2)(Item 3)(Item 4)(Item 5)Contact Informationsallybo@baptisthealth.netsimonech@baptisthealth.netlizetteg@baptisthealth.netTables 1 & 2. Content validity results of rubric itemsrelated to clarity and relevance of each item

https://scholarlycommons.baptisthealth.net/cgi/viewcontent.cgi?article=3168&context=se-all-publications

Reliability and Validity Testing of a Rubric Aimed at Assessing Quality of Responses in a Virtual Journal Club

Abstract

Similar works

Full text

Available Versions

Scholarly Commons@Baptist Health South Florida

Scholarly Commons@Baptist Health South Florida