Dostal, Julie, MD

Foster, Elissa, PhD

Keister, Drew, MD

English

Lehigh Valley Health Network: LVHN Scholarly Works

Lehigh Valley Health NetworkLVHN Scholarly WorksDepartment of Family MedicineA Novel Method of Evaluating Competency inInformation LiteracyDrew Keister MDLehigh Valley Health Network, Drew_M.Keister@lvhn.orgJulie Dostal MDLehigh Valley Health Network, Julie.Dostal@lvhn.orgElissa Foster PhDLehigh Valley Health Network, Elissa.Foster@lvhn.orgFollow this and additional works at: http://scholarlyworks.lvhn.org/family-medicinePart of the Primary Care CommonsThis Poster is brought to you for free and open access by LVHN Scholarly Works. It has been accepted for inclusion in LVHN Scholarly Works by anauthorized administrator. For more information, please contact LibraryServices@lvhn.org.Published In/Presented AtKeister, D., Dostal, J., & Foster, E. (2010). A Novel Method of Evaluating Competency in Information Literacy. Poster presentation.A Novel Method of Evaluating Competency in Information LiteracyLehigh Valley Health Network, Allentown, PennsylvaniaThe Problem:Drew Keister, MD; Julie Dostal, MD; Elissa Foster, PhD“There is little evidence about the effectiveness of different methods (of teaching information literacy), and this may be related to the lack of a conceptual framework within which to structure evaluation strategies.”  Straus 2004Successes•  Translates observed behaviors to Dreyfus competency levels	 	 -	 Translates	further	into	ACGME	competencies• Eliminates “Lake Wobegone Effect,” where all residents are above average•  Data easily interpretable via radar graphThe Process•  Sought to use direct observation of resident behavior as central to the assessment of this competency (See	study	by	McCord	2007)	Standard Observable BehaviorsNovice:N1> Develops skills in selective data acquisitionN2> Knows how to formulate a focused clinical question and draws from appropriate resources for solution.N1> Uses or asks preceptor for help with evidence at point of care (PBLI, PC)N1> Searches an evidence-based resource to find an answer to a focused clinical question (PBLI)N2> Formulates clear, concise clinical question related to patients seen in clinical care (e.g. PICO question) (PBLI)Advanced Beginner: This level not represented by sample questionsCompetent:C1> Recognizes EBM triad as the integration of physician experience and patient experience of condition along with conclusions drawn from clinical research. C1> > Interprets information from evidence-based resources within the context of an individual patient (PC, PBLI)C1> Compares and contrasts evidence with their personal clinical observations/experiences and integrates both features into clinical decision making (PBLIProficient:P1> Integrates the three circles of EBM triad into all aspects of patient care. P1> Assists others with the proper utilization of EBM (PBLI, ICS)Sample Questions - Continuity Care:•  Formulates a clear, concise clinical question related to patients seen in clinical care (e.g. PICO question)•  Uses or asks preceptor for help with evidence at point of care•  Compares and contrasts evidence with their personal clinical observations/experiences and integrates both features into clinical decision makingSample Questions - In-patient:Check the behaviors that you observed the resident perform during this week:Searches an evidence-based resource to find an answer to a focused clinical questionInterprets information from evidence-based resources within the context of the patient’s situation Assists others with the proper utilization of EBM “Radar Graph”Challenges•  Currently unclear whether observable behaviors accurately reflect their associated competency level• Evaluator training requiredApplication•  Process of translating competency to observable behaviors is reproducible•  IL/KC assessment integrated into broader summative assessment for the residency“Write a short narrative about when yourecognized the performance of excellentInformational Literacy and Knowledge Creation by a colleague”Narratives analyzed for themesStandard Statements (Dreyfus scale competency)Observable BehaviorsIdentified 4 sites/activities where residents can be observed using IL/KC skills:1. Continuity care office hours2. Learning Labs3. FM in-patient service4. Continuity care teamsResponse Options:Routinely observedObservedNot ObservedN/A this sessionCompetency Correlation: 10.90.80.70.60. 50.40.30.20.10IL/KC-4-P1IL/KC-3-C2IL/KC-3-C1IL/KC-2-AB2IL/KC-1-N2IL/KC-1-N14p

A Novel Method of Evaluating Competency in Information Literacy

https://scholarlyworks.lvhn.org/cgi/viewcontent.cgi?article=1004&context=family-medicine

A Novel Method of Evaluating Competency in Information Literacy

Abstract

Similar works

Full text

Available Versions

Lehigh Valley Health Network: LVHN Scholarly Works