Assessment
at UIUC


 

Assessment Resources


 

Data Sources

Current Assessment Projects

The projects listed below are from various library units and the Library Assessment Working Group is not directly involved in many of them.

You can also download this page as either a Microsoft Word .doc file or an Open Office .odt file.

 

Table of Contents

1.      Library-Wide Assessment

2.      Reference Services Assessment

3.      Web Usability Studies

 

Library-Wide Assessment

 

IDEALS as Assessment Data Repository

Investigators: Library Assessment Working Group

Summary: The Library Assessment Working Group is investigating the desirability and feasibility of using the IDEALS repository as a clearinghouse for assessment efforts and data. While IDEALS' collection development policy does allow the submission of data sets, possible issues include requiring data sets to meet minimal reliability standards (i.e. is the methodology transparent enough that other projects could repeat the assessment program?) and to provide enough contextual information to make interpretation and comparison possible.

 

Government Printing Office and Federal Depository Library Program User Surveys

Investigators: Government Printing Office, UIUC's Government Information Services

Summary: The GPO is running two separate surveys to evaluate the use of FDLP libraries, the accessibility of government information online, completeness of collections, and users' perceptions of both print and online government documents. The first survey is accessible at this link: http://www.surveymonkey.com/s/HSLCRRB.

 

Room and Gate Count Analysis

Investigators: Eric Phetteplace (GA), Social Sciences Division, Undergraduate Library

Summary: The LAWG Graduate Assistant has been developing "macro" programs which operate out of Microsoft Excel to ease the burden of processing customized data fields in Desk Tracker, including the library-specific Room Count forms which several libraries utilize as well as the more universal Gate Count fields. These macros should enable librarians to assess traffic and use of space patterns at their locations. An example outcome could be discovering insufficient numbers of outlets for laptops, seats, or scanners in a particular space.

 

Chemistry Library User Survey

Investigators: Tina Chrzastowski

Summary: The Chemistry Library is soliciting feedback from users by means of a survey handed to patrons in the library. The survey asks questions about use of the physical space, use of print collections, why patrons came to the Chemistry Library, and what other library they would use instead.

 

Reference Services Assessment

 

Desk Tracker Standardization

Investigators: Eric Phetteplace (GA)

Summary: In an attempt to standardize the way in which various Desk Tracker fields are interpreted by disparate library units, the Assessment Website is hosting a series of documents which provide definitions and examples for commonly used features (URI: http://www.library.illinois.edu/assessment/desktracker.html). Currently, there are documents related to the Description, Patron Type, RRGIS-This Question is About, and Referred to Specialist fields. While libraries are encouraged to develop their own unique forms, it would aid cross-unit comparisons and reduce training redundancies to have a one-stop repository for fields used in multiple locations.

 

READ Scale Implementation

Investigators: Kathleen Kern, Carissa Phillips, David Ward

Summary: While current Desk Tracker forms can provide information on the length and subject of reference interactions, these are weak and inaccurate proxies for question complexity. The READ Scale, developed by Bella Gerlich of Dominican University, ranks questions on a 1-to-6 scale based on the sophistication and knowledge required to answer a question. A pilot project of implementing this scale is being planned, currently involving the Undergraduate Library and the Reference, Research, and Government Information Services department.

 

Staffing by Design

Investigators: Kathleen Kern, David Ward, Eric Phetteplace (GA)

Summary: Using Fall 2010 semester Desk Tracker data collected at the Undergraduate Library and the Main Library's Information Desk (staffed by the Reference, Research, and Government Information Services department), this investigation is looking into the desirability of a virtual reference desk which would handle remote reference modes such as IM/Chat, SMS, and email. The Desk Tracker data has yielded a wealth of information on topics as such which times of day are busiest in which reference modes, which modes are preferred by which patron types, which patron types ask questions during certain times of day, and which question subjects come through which modes of communication.

 

Web Usability Studies

 

LEARN Site

Investigators: Merinda Hensley, Jenny Emanuel, Suzanne IM (GA)

Summary: Study examining the LEARN site's (URI: http://www.library.illinois.edu/learn/) content and navigation.  Currently being reviewed by IRB. The goal of this study is to determine how Illinois library users interact with LEARN portal webpages in order to make informed improvements to the site and increase the efficiency of site navigation.

 

Librarian Search Habits

Investigators: Jenny Emanuel

Summary: Ethnographic research on how different ages and demographics search for information differently.  Will commence in November of 2010.

 

Mobile Wayfinding Application

Investigators: Jim Hahn

Summary: Studied student usage of a mobile wayfinding application developed by Jim Hahn.

 

Undergrad Library Homepage

Investigators: David Ward, Jim Hahn

Summary: Currently involved in usability testing for current and future versions of the UGL home page (URI: http://www.library.illinois.edu/ugl/). A recent redesign included adding an IM/Chat widget on the UGL home page as well as images of recent acquisitions.

 

Undergraduate Research Methods Project

Investigators: Robert Slater, Lisa Hinchliffe, Camilla Fulton, David Vess, Melody Allison, Rudy Leon

Summary: Interviewed twenty undergraduate students, mostly freshman and a few sophomores, and asked them to talk about and demonstrate how they engaged in doing research for a recent class assignment (among many other things). The study undertook an initial analysis of the data to establish a model of information seeking behavior for Illinois Undergraduate Students. Each of the investigators has been applying the findings to our own work (on the web and related to in person services). However, there is still some analysis to do to issue a full report.

 

User Study of Current and Prototype Library Gateway

Investigators: Robert Slater, Camilla Fulton

Summary: IRB approval is in place and students will be brought in over the next few weeks to participate in some usability studies of the Library Gateway (URI: http://www.library.illinois.edu). First, students will be asked the same questions about the current and proposed new sites. Then the investigators will provide a comparative analysis of their use of and thoughts about both versions. There will be three to four rounds for this study, and the prototype Gateway will be modified based on feedback from each iteration of users, and then new users will be given the opportunity to assess the each updated prototype.