Skip to main content
Article thumbnail
Location of Repository

Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the PubMed interface

By Michael Simon, Elke Hausner, Susan F. Klaus and Nancy E. Dunton


Background: The identification of health services research in databases such as PubMed/Medline is a cumbersome task. This task becomes even more difficult if the field of interest involves the use of diverse methods and data sources, as is the case with nurse staffing research. This type of research investigates the association between nurse staffing parameters and nursing and patient outcomes. A comprehensively developed search strategy may help identify nurse staffing research in PubMed/Medline.<br/><br/>Methods: A set of relevant references in PubMed/Medline was identified by means of three systematic reviews. This development set was used to detect candidate free-text and MeSH terms. The frequency of these terms was compared to a random sample from PubMed/Medline in order to identify terms specific to nurse staffing research, which were then used to develop a sensitive, precise and balanced search strategy. To determine their precision, the newly developed search strategies were tested against a) the pool of relevant references extracted from the systematic reviews, b) a reference set identified from an electronic journal screening, and c) a sample from PubMed/Medline. Finally, all newly developed strategies were compared to PubMed's Health Services Research Queries (PubMed's HSR Queries).<br/><br/>Results: The sensitivities of the newly developed search strategies were almost 100% in all of the three test sets applied; precision ranged from 6.1% to 32.0%. PubMed's HSR queries were less sensitive (83.3% to 88.2%) than the new search strategies. Only minor differences in precision were found (5.0% to 32.0%).<br/><br/>Conclusions: As with other literature on health services research, nurse staffing studies are difficult to identify in PubMed/Medline. Depending on the purpose of the search, researchers can choose between high sensitivity and retrieval of a large number of references or high precision, i.e. and an increased risk of missing relevant references, respectively. More standardized terminology (e.g. by consistent use of the term "nurse staffing") could improve the precision of future searches in this field. Empirically selected search terms can help to develop effective search strategies. The high consistency between all test sets confirmed the validity of our approach.<br/><br/

Year: 2010
OAI identifier:
Provided by: e-Prints Soton

Suggested articles


  1. (2006). Agespecific search strategies for Medline. doi
  2. (2004). Arnold-Oatley AE: Optimal search strategies for detecting health services research studies in MEDLINE. CMAJ
  3. (2006). Balka E, Fitzgerald JM: Nurse staffing levels and hospital mortality in critical care settings: literature review and meta-analysis. doi
  4. (2006). Cheung RB: Are patient falls and pressure ulcers sensitive to nurse staffing? doi
  5. (2003). Clinical Evidence diagnosis: Developing a sensitive search strategy to retrieve diagnostic studies on deep vein thrombosis: a pragmatic approach. Health Info Libr J doi
  6. (2008). Core Team: R: A Language and Environment for Statistical Computing Vienna: R Foundation for Statistical Computing
  7. (2007). Currow DC: Improving search filter development: a study of palliative care literature. BMC Med Inform Decis Mak doi
  8. (1994). Developing optimal search strategies for detecting clinically sound studies in MEDLINE. doi
  9. (2002). Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. doi
  10. (2004). Evaluation of methodological search filters–a review. Health Info Libr J doi
  11. (2002). Handsearching versus electronic searching to identify reports of randomized trials. Cochrane Database of Methodology Reviews: Reviews doi
  12. (2002). Haynes RB: Robustness of empirical search strategies for clinical content in MEDLINE. Proceedings/AMIA
  13. (2007). Hedges T: EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. doi
  14. (2006). How to identify randomized controlled trials in Medline: ten years on. J Med Libr Assoc doi
  15. (1998). Identifying systematic reviews in MEDLINE: developing an objective approach to search strategy design. doi
  16. (2006). Institut für Qualität und Wirtschaftlichkeit im Gesundheitswesen (IQWiG): Zusammenhang zwischen Pflegekapazität und Ergebnisqualität in der stationären Versorgung - Eine systematische Übersicht Cologne
  17. (2008). NL: Retrieving randomized controlled trials from medline: a comparison of 38 published search filters. Health Info Libr J doi
  18. (2007). NR: Making literature searches easier: A rapid and sensitive search filter for retrieving randomized controlled trials from PubMed. Diabetic Medicine doi
  19. (2006). RB: Developing optimal search strategies for detecting clinically sound treatment studies in EMBASE. J Med Libr Assoc
  20. (2006). RB: Optimal CINAHL search strategies for identifying therapy studies and review articles. doi
  21. (2005). RB: Optimal search strategies for retrieving systematic reviews from Medline: analytical survey. BMJ doi
  22. (2008). RB: PsycINFO search strategies identified methodologically sound therapy studies and review articles for use by clinicians and researchers. doi
  23. (2003). Research methodology search filters: are they effective for locating research for evidence-based veterinary medicine in PubMed?
  24. (2006). RW: An alternative to the hand searching gold standard: validating methodological search filters using relative recall.
  25. (2001). TA: A statistical approach to designing search filters to find systematic reviews: objectivity enhances accuracy. doi
  26. (2001). Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. Effective Clinical Practice
  27. (2007). TJ: Nurse staffing and quality of patient care. Evid Rep Technol Assess (Full Rep)
  28. (2008). tm: Text Mining Package. doi

To submit an update or takedown request for this paper, please submit an Update/Correction/Removal Request.