BiblioBouts Project Interim Report #5

The University of Michigan’s School of Information and its partner, the Center for History and New Media at George Mason University, have undertaken the 4-year BiblioBouts Project (October 1, 2008 to September 30, 2012) to support the design, development, testing, and evaluation of the web-based BiblioBouts game to teach incoming undergraduate students information literacy skills and concepts. This fifth interim report describes the BiblioBouts Project team’s 12-month progress achieving the project’s 4 objectives: designing, developing, deploying, and evaluating the BiblioBouts game and recommending best practices for future information literacy games. This latest 12-month period was marked by extensive progress in the analysis of evaluation data from the testing of the beta 1.0 version of BiblioBouts and putting to work what was learned from this analysis in the design and development of the beta 2.0 version of BiblioBouts. Major tasks that will occupy the team for the next 12 months are demonstrating BiblioBouts’ learning goals, recruiting more instructors to incorporate BiblioBouts in their classes, seeking additional funding, and finding a future home for BiblioBouts. For additional information about game design, pedagogical goals, scoring, game play, project participants, and playing BiblioBouts in your course, consult the BiblioBouts Project web site (http://bibliobouts.si.umich.edu).Institute of Museum and Library Studieshttp://deepblue.lib.umich.edu/bitstream/2027.42/87186/1/bbInterimReportToIMLS05.pd

Preference vs. Authority: A Comparison of Student Searching in a Subject-Specific Indexing and Abstracting Database and a Customized Discovery Layer

Discovery layers provide a simplified interface for searching library resources. Libraries with limited finances make decisions about retaining indexing and abstracting databases when similar information is available in discovery layers. These decisions should be informed by student success at finding quality information as well as satisfaction with search interfaces. Students executed searches in two discovery layer configurations and an indexing and abstracting database. While students reported a preference for discovery layers, the articles selected from the indexing and abstracting database were more authoritative. These results illuminate the relative strengths of these tools, informing decisions about resource allocation and discovery configuration

What We Talk about When We Talk about Quality: A Librarian and Instructor Compare How They Assess Students\u27 Sources

This case study explores and compares how a librarian and an instructor evaluated the quality of bibliographies students produced for the instructor’s class. The ethnographic study attempted to unearth nuances in the respective practical approaches librarian and instructor took to assess a source’s quality as well as differences in what librarian and instructor might mean by “quality.” Themes emerged as indicators of quality that librarian and instructor applied differently in terms of frequency and weight. Findings also included that librarian and instructor looked to different aspects of citations to demonstrate common values, such as thoroughness, and to reflect the quality of a student’s research process. Additional findings included differences in librarian and instructor’s working definitions of “academic” and in their approaches to consulting the citation versus the full text of a cited source. The aim of the study was to make such implicit practices and expectations around “quality” explicit, and thus more transparent to students, and to better align librarian and instructor’s daily practices

Building the Games Students Want to Play: BiblioBouts Project Interim Report #3

The University of Michigan's School of Information and its partner, the Center for History and New Media at George Mason University, are undertaking the 3-year BiblioBouts Project (October 1, 2008 to September 30, 2011) to support the design, development, testing, and evaluation of the web-based BiblioBouts game to teach incoming undergraduate students information literacy skills and concepts. This third interim report describes the BiblioBouts Project team’s 6-month progress achieving the project's 4 objectives: designing, developing, deploying, and evaluating the BiblioBouts game and recommending best practices for future information literacy games. This latest 6-month period was marked by extensive progress in the deployment and evaluation of the alpha version of BiblioBouts. Major tasks that will occupy the team for the next 6 months are applying evaluation findings to game redesign and enhancement. For general information about game design, pedagogical goals, scoring, game play, project participants, and playing BiblioBouts in your course, consult the BiblioBouts Project web site.Institute of Museum and Library Serviceshttp://deepblue.lib.umich.edu/bitstream/2027.42/69157/1/bbInterimReportToIMLS03.pd

Measuring the Magic: Assessment in the Special Collections and Archives Classroom

The article discusses effective methods for measuring the success of classroom instruction using original primary sources in special collections and archives and how to translate these effects to demonstrate learning impact that can be used in other assessment projects. The global economic crisis has reportedly pushed assessment activities in libraries and archives due to mounting pressure on administrators to show evidence of a return on investments of time and money. To show how special collections contribute to learning, the authors say that formal assessment techniques and strategies that measure the impact through quantitative and qualitative means should be formulated.Keywords: special collections and archives, assessment, instructio

Google vs. the Library (Part III): Assessing the Quality of Sources Found by Undergraduates

This study assesses and compares the quality of sources found by undergraduate students when doing research using both Google and a library (federated) search tool. Thirty undergraduates were asked to find four sources (one book, two articles, and one additional source of their choosing) related to a selected research topic. Students used both Google and a federated search (resource discovery) tool to find material they believed to be relevant. Each source was evaluated for topic relevance, authority, appropriateness, and date, and assigned a total quality score. Results showed that the books found via Google were slightly higher quality than those uncovered via the federated search tool. The articles and additional sources students found via the federated search tool were slightly to moderately higher quality, respectively, than those discovered via Google

BiblioBouts final performance review

A University of Michigan (U-M) research team designed, developed, deployed, and evaluated the BiblioBouts information literacy game. BiblioBouts gave students repeated opportunities to develop and practice information literacy skills while they completed a research-and-writing assignment. The evaluation enlisted a multi-methodological approach to data collection. BiblioBouts players were exposed to more online sources than non-players. Players cited more sources in their final-paper bibliographies than non-players. Players felt that they would be better at and more confident about performing various research tasks than they felt before playing the game. They rated their motivation and perseverance at playing the game at high and very high levels. They cited many game-play benefits such as getting a head start on their research, finding relevant sources from classmates’ submissions, becoming a more confident researcher, and being better prepared to write their papers as a result of using the Zotero citation management system.Institute of Museum and Library Serviceshttp://deepblue.lib.umich.edu/bitstream/2027.42/97036/1/bbFinalPerfReviewToIMLS.pd

User-Centered Collection Development: A Citation Analysis of Graduate Biology Theses

The authors sought to identify biology collection usage among graduate students at Jacksonville State University. Forty Master’s student theses from 2008-2014 were examined. A total of 2,351 citations were analyzed, of which journals accounted for 75%, books for 10%, and the remaining 15% included government documents, web sites, dissertations, and theses. Findings are consistent with previous similar studies that students referenced journals more often than books and other sources. Journal and book citations present discrepancies between number of citations and number of authors citing. Wide ranges of journal subjects were cited due to the interdisciplinary nature of graduate programs. Recommendations are provided for future collection development and library instruction practice

Comparing Apples and Bananas? A/B Testing for Discovery System Optimization

Discovery systems have changed the ways in which students are able to search academic library resources by providing a simplified, customizable user interface. Librarians often make discovery system customization decisions based on instincts about what will work best for students or on small usability studies. A/B testing, commonly used by commercial enterprise but infrequently by libraries, employs two simultaneous, live versions of a web interface to gauge the effects of changing variables. This method has the advantage of reaching a large number of users performing authentic search tasks. The authors combined A/B testing with scenario-based usability testing to explore variables such as facet labels, facet order, and placement of search options. The results provide insight into the extent to which interface changes prompt users to employ available search options, allowing libraries to make decisions about discovery system customization driven by user data

In Their Words: Student Reflections on Information-Seeking Behaviors

Academic librarians try to facilitate student information seeking by providing classroom instruction, creating tutorials and guides, and selecting and modifying search tools to best meet student needs and preferences. These efforts are often informed by interactions with students, and can be even better informed through analysis of student descriptions of their searching practices. In this case study, 50 upper-division students from the Social and Behavioral Sciences major completed searching tasks in a few library search tools and were then interviewed about their search behaviors, both in the experimental setting and in general. Their responses illuminate some of their tendencies, including considerations when choosing sources, strategies employed when searches fail, and adoption of their instructors\u27 priorities