The Design of the Wilson’s Library Literature Online TutorialThe Lamar Soutter Library University of Massachusetts Medical School Worcester, MA 01655
The Wilson’s Library Literature Online tutorial (LLOT) was designed for the Graduate School of Library and Information Science at Simmons College for the Master’s level class LIS 408, User Instruction. This paper, which accompanies the tutorial, will do the following:
The Graduate School of Library and Information Science is part of Simmons College, a women’s college founded in 1899 with approximately 1,300 undergraduate students granting Bachelor of Arts and Bachelor of Science degrees. Graduate programs offered include physical therapy, nutrition, nursing, health-care administration, children’s literature, English, French, liberal studies, Spanish, social work, and management (Peterson’s annual guides/undergraduate study, 2004).
The Master’s program is a graduate, co-educational Master’s of Science, which requires 36 semester units to complete. There are three required courses:
Students in the program can choose from a general set of electives including academic, public, or special libraries, web publishing, children’s/youth librarianship, etc. or they can choose from the following concentrations:
There are about 600 students typically enrolled in each of the Fall and Spring semesters and about 300 in the summer. In 2002, the school graduated 215 Master’s degrees (Peterson’s Graduate Programs, 2004).
The School also offers a Doctor of Arts degree in Library and Information Science. This degree is designed for experienced librarians to learn administration and management. It requires 60 credit hours, a supervised Field Research of 4 units, and a comprehensive examination (Simmons GSLIS, Doctor of Arts, 2004).
The GSLIS Library contains approximately 25,000 monographs, 10,000 bound periodicals and 59,000 microforms (Bridget Capobianco, GSLIS Library Assistant, Personal Communication, 2004): it also has access to about 101 electronic databases (Simmons Colleges Libraries, 2004).
The GSLIS Library offers bibliographic instruction workshops every semester. These are one-hour workshops geared toward library science students. They are hands-on training sessions and include sessions on:
Staff of the Simmons College Libraries includes:
The GSLIS Collection is one of the collections of the Simmons College Libraries and is managed by the GSLIS Librarian. The department also includes two full-time library assistants (one of which splits time with the GSLIS West campus) and 7 part time student library assistants (Bridget Capobianco & Gary Atwood, Personal Communication, 2004).
Because graduate students may need to write theses and dissertations, it is crucial for them to learn how to use the library. The University of Maryland University College and the Northridge campus of the California State System are two institutions that have information literacy requirements in some of their graduate programs (Kelly, Orr, and Houck, 2001; Curzon, 2002). Issues of design of online tutorials for graduate students have been addressed by Ardis & Hass (2001), and Holmes (2003).
Graduate students differ from undergraduate students in several ways:
These differences point to online education as a good way to address the special needs of graduate students. Teaching library resources in person to a heterogeneous group can be difficult if they all have different skill levels: with an online program, each one can go at his/her own pace. An online course can be done at any time and at home. The person does not have to ask others questions that might betray lack of knowledge. There, online instruction would be able to capture these students in ways that in-person instruction could not.
Because computer education is one-way, and lacks human interaction, design issues become very important. The program should explain things in an understandable way, have a goal for what the student will learn in the timeframe of the tutorial, provide examples, and test the student for understanding. Nancy Dewald (1999) addressed best practices in the design and content in online tutorials. Her criteria were
Besides the above criteria, a designer of an online tutorial must be aware of the inherent problems of computer-assisted instruction. One of the problems addressed in the literature is that computer instruction tends to favor certain learning styles over others. In a study by Terrell and Dringus (1999), 98 information science students in an online master’s degree program were tracked and their learning styles were assessed using Kolb’s Learning Style Inventory. The graduation rates of those with diverger, converger and assimilator styles were all about 80%. But the graduation rate of those with the accommodator style was less, 60%. The authors believed that this was because of the impersonal nature of the online environment. This finding is supported by Ross (1998) and Holmes (2003).
Because of this finding, Holmes suggests that tutorials include one or more of these features: some interactivity, quizzes with feedback, simulations, ability to contact a real librarian, photos of staff, or some other human touch (2003).
These include online pathfinders, one-on-one instruction, workshops, one-shot sessions, and course integrated instruction. LaGuardia et al. (1996) mention the pros and cons of an online tutorial summarized here:
PLANNING for the LLOT:
According to LaGuardia et al. (1996, p. 34), there are 12 steps to designing an instruction program. Steps 1-6 address the planning aspect:
Step 1: Determining the need. The way to do this in a real-life situation is through librarian observation of a need, either via questions at the reference desk, or reports from faculty of poor student bibliographies, etc. Since the LLOT will be designed by a student, the assistance of an experienced librarian was requested in the form of a questionnaire (Appendix 1). The following insights were gained from this questionnaire:
1. The most asked questions by students were:
a. Why shouldn’t I limit the search to full text articles?
b. Why can’t I use Library Literature right after I open it? (They don’t understand that they must also check the Library Literature box)
c. What does “peer reviewed” mean?
2. The biggest problems with the students’ papers were the quality of the student’s literature searches and the writing style.
3. The specific way that student searches could be improved was that students learn the variety and content of the different databases. Typically they just used one database, when a thorough search on the topic would require use of Library Literature, LISA, ISTA and maybe others.
4. The most important features of Library Literature for students to learn in detail were the Thesaurus, Booleans, when to use the different fields, and Truncation.
5. The librarian thought the tutorial should last 60 minutes (Linda Watkins, personal communication, November 11, 2004).
Step 2: Securing administrative/collegial support. An online tutorial needs this support for different reasons than a traditional teaching program. Some reasons an online tutorial development project may need support are:
Step 3: Information gathering. This is where LaGuardia et al. suggest using feedback forms, circulation data, and reference desk use patterns. Reference desk use patterns were addressed in this case with the librarian questionnaire.
Step 4: Instructional needs assessment. In order to accomplish this step, a needs assessment questionnaire was designed (Appendix 2): From the questionnaire several areas were identified as ones needing to be addressed by the tutorial.
The students were given a list of possible tutorial topics (Appendix 2) and were asked to select the ones that they felt should be covered. Each topic is tabulated with the number of times it was selected by a student.
Step 5: Discussion/Brainstorming/Consulting/Prioritizing. As noted above, the student questionnaire asked people to prioritize the features of the Library Literature that should be covered in the tutorial.
Technical Planning for the LLOT
Step 6: Program Planning. In order to plan for the LLOT, the paper “On-line tutorials: some tips taken from the literature and three examples in the graduate school setting” was used as a guideline for the design.
Tip 1: Stated Objectives.
The broad goals of the LLOT are:
Tip 2: Teach concepts, not just mechanics
The tutorial included a link to Boolean operators, defined “peer reviewed” and discussed the difference between “All Smart Search”, keyword search, and subject search. Use of thesaurus was explained.
Tip 3. Initial technology check.
Tip 4. Don’t let the user get lost.
Hyperlinks in text were designed to open in new popup windows, preserving the user’s place in the main program.
Tip 5. Clear navigation.
Both forward and backward arrows are provided. Every screen has a link to the tutorial home page and to the Simmons College Libraries home page.
Tip 6. Readability: Allow reader to scan the pages.
The attempt was made to have only one idea per page. Bold text was used for new terminology so it would stand out. Bulleting of lists helped readability, and finally, scrolling was minimized where possible.
Tip 7. Readability: Use of white space and color.
Empty lines of white space were used to separate instructions. Red color was used to indicate words the user was directed to type. Colors that were already in the Simmons Libraries home page were used as the framework to make the tutorial harmonize with other library pages.
Tip 8: Absence of linear navigation.
Navigation arrows for forward and backward were provided. However, once the user leaves the computer in the middle a module, he/she cannot return to the place they left off. To do so presented too much technical difficulty.
Tip 9.Updated links and crash free.
Usability testing was performed by the class who went through the tutorial. Problems in the programming that were found were corrected.
Tip 10. Accessibility
Being a simulation, the tutorial’s accessibility depends on the accessibility of the Wilson databases. However, for the exercise of doing so, all pictures received alternative text and the homepage and a page of Module 1 was run through www.cast.org/bobby. Some comments provided by the program included:
1. Use the “scope” attribute to further clarify tables and provide summary for them.
2. If you use color to convey information, be sure it is conveyed another way.
Issue one is not valid for these pages when tables are used for layout only. Otherwise, tables would need increased information. In most instances color is used for effect, but the red color (for user input) needed to be explained.
Tip 11. Load time
Program was tested with the “slow” computer (1998 IBM computer, with Windows 98, a Pentium II Processor, 128 MB RAM, AOL Browser at a modem speed of 52K) and it was mostly limited by Wilson itself.
Tip 12. Use simulations to include tactile learners.
This was done.
Tip 13. Provide interactivity.
It was hoped that simulations would do this instead of quizzes. Photos were not obtainable. Flash would be a good way to provide interaction, but was not implemented here for simplicity.
Tip 14. Effective use of screen shots.
Screen shots were clipped with PowerPoint so that only the relevant portions of the screen would show and they would be large enough. The size of the screen shot pop-up windows was made large so the screen shots would be large.
Formative evaluation would include pre-tests and post-tests, surveys done immediately after the instruction, and feedback from faculty. The LLOT included a survey done immediately after the instruction. Quizzes were not done because the on-line simulation provided the interactivity instead. Feedback from faculty of student work would be the best indicator of effectiveness but does not provide immediate feedback and the LLOT’s scope is too limited. A summative evaluation would be seeing how many people accessed the program, obtaining attitude measures from students and faculty, testing of people starting the L.I.S. program versus people who are just finishing. It would be ideal for an online tutorial to assess students online, however this may not be possible in the time allotted. The online evaluation will only address student attitudes. In the web version, questions 1, 2, 3, 5 and 7 were implemented with radio buttons and 4 with a checkbox.
SAMPLE EVALUTION FORM
INTRODUCTORY STATEMENTS: (wording adapted from Research Committee, Library Instruction Round Table, 1996). Simmons College wishes to determine our patrons’ satisfaction with our online Library Literature tutorial. Please answer the following questionnaire, which should take about 5 minutes to complete. Your answers will be confidential.
1. I am a(n) ___________
a. Undergraduate Simmons student
b. GSLIS Master’s student
c. GSLIS D.A. student
2. (If applicable), I have completed ___ units in the GSLIS program.
3. The tutorial has helped to develop my skills in using the database.
a. Strongly agree
e. Strongly Disagree
4. The Library Literature online tutorial taught me (check all that apply).
a. basic use of Library Literature, including navigation, basic searching, how to access the articles you find, how to print, email and save.
b. keyword vs. subject searching
c. use of the thesaurus
d. what does peer reviewed mean
e. how to conduct effective searches in library literature, i.e. to obtain citations for most of the relevant and useful materials that pertain to the topic.
5. How often do you use Library Literature?
a. At least once a week
b. At least once a month
c. At least once a semester
d. I never use it
6. What aspects of the database do you feel were not covered adequately?
7. The tutorial was
a. Too long
b. Too short
c. About right
8. Please add additional comments about the tutorial. Your thoughtful responses will be most appreciated. Responses with specific examples are the most helpful.
Thank you for answering the questionnaire!
The budget for doing the online tutorial is very difficult to assess. One way of estimating the budget would be based on the number of hours to create and maintain it and the salary of the librarian. Suppose the design took a full week, i.e. 40 hours. Also, suppose that the maintenance takes one-half week per year. Therefore, the tutorial would take one FTE 1.5 weeks of that year.
The median salary of an academic librarian in New England in Fiscal year 2003 was $47,990, including ACRL libraries and excluding ARL libraries (Carson, 2002). Therefore the calculated cost of the tutorial would be: $47,990*1.5/52 = $1,384.
This assumes the library already has the necessary hardware and software including Dreamweaver. In reality, the tutorial was created for a class and so it was done for free. Even the handout was printed out with no cost to the student developer.
Designing an online tutorial for educational use is a difficult thing. It can be a supplement to in-person instruction but does not replace the give and take of a real interaction. It’s advantageous to have the tutorial in place in case a student needs information during a time when in-person instruction is not available. It favors some learners over others and so efforts must be made to include all learning styles. This paper has tried to build on the previous paper and implement a tutorial that followed the 14 tips taken from the literature. The tutorial can (for the time being) be found at www.simmons.edu/~bianco/Library%20Literature/homepage.htm
Needs Assessment Questionnaire-Library Literature—Librarian Version
Which of these features do you think is the most important for students to learn in detail? (pick as many as you want) by putting an x next to it
5. Finally, how long do you think an online tutorial should take?
Other (write in )________
Thank you for completing the questionnaire!!
1. What questions about the database do you get the most often?
2. In looking at student’s papers yourself or hearing from the faculty, what do you think is the greatest problem with student’s papers?
a. Finding a topic
b. Finding a question of the right size to answer with in that topic
c. Quality of the student’s literature searches
d. Discussion or analysis
e. Writing style
3. In looking at the quality of the students’ literature searches, what would you think needs improvement: (circle all that apply)
a. Students don’t pick relevant articles to their topics
b. Students are not thorough enough, i.e., they miss many materials that are relevant to the topic.
c. Students pick articles that are on the topic, but of poor quality.
Please add other comments
Appendix 2. Needs Assessment Questionnaire-Library Literature
If you have ever used Library Literature for a class project then please answer these questions.
1. Do you find it easy for you to use? If not please explain what feature(s) are difficult for you to use?
2. What features (if any) would you like to know more about?
3. Think back to when you first used Library Literature. What were things that you wished someone had told you first thing?
4. Which of these features do you think is the most important for students to learn in detail? (pick as many as you want) by putting an x next to it
5. Finally, how long do you think an online tutorial should take you?
Other (write in)________
Thank you for completing the questionnaire!!
Peterson's annual guides/undergraduate study. guide to four-year colleges (2004). (34th ed.). Princeton, N.J.: Peterson's Guides.
Peterson's graduate programs in business, education, health, information studies, law & social work (2004). (38th ed.). Princeton, N.J.: Peterson's Guides.
Ardis, S., & Haas, J. (2001). Specialized remote user education: Web-based tutorials for engineering graduate students. Issues in Science & Technology Librarianship, Fall(32). Retrieved October 7, 2004, fromwww.istl.org/istl/01-fall/article3.html
Carson, C. H. (2002). Salary distribution of full time professional librarians in ACRL/NEC four year academic libraries, fiscal year 2003. Retrieved November 26, 2004, fromgslis.uri.edu/ACRL/tableAp.html
Claxton, C. S., & Murrell, P. H. (1987). Learning styles : Implications for improving educational practices. College Station, Tex: Association for the Study of Higher Education.
Curzon, S. C. (2002). Cooperating for success: The information competence initiative of the California State University.Resource Sharing and Information Networks, 16(1), 67-78. Retrieved October 11, 2004, from the Haworth Press database.
Dewald, N. H. (1999). Transporting good library instruction practices into the web environment: An analysis of online tutorials.The Journal of Academic Librarianship, 25(1), 26-31. Retrieved October 1, 2004, from the Academic Search Premier database.
Edwards, R. G. (2000). Web tutorials for education students: A practical alternative to traditional library instruction--basic issues and concerns. Behavioral & Social Sciences Librarian, 18(2), 17-25. Retrieved November 11, 2004, from the H. W. Wilson (Library Literature) database.
Holmes, K. E. (2003). A kaleidoscope of learning styles: Instructional supports that meet the diverse needs of distant learners.Journal of Library Administration, 37(3/4), 367-378. Retrieved October 6, 2004, from the Haworth Press database.
Kelley, K. B., Orr, G. J., & Houck, J. (2001). Library instruction for the next millennium: Two web-based courses to teach distant students information literacy.Journal of Library Administration, 32(1/2), 281-294. Retrieved October 6, 2004, from the Haworth Press database.
LaGuardia, C., et al. (1996).Teaching the new library : A how-to-do-it manual for planning and designing instructional programs. New York: Neal-Schuman Publishers.
Onwuegbuzie, A. J., & Jiao, Q. G. (1998). The relationship between library anxiety and learning styles among graduate students: Implications for library instruction.Library & Information Science Research, 20(3), 235-249.
Prestamo, A. M. (1998). Development of web-based tutorials for online databases.Issues in Science & Technology Librarianship, 17(Winter). Retrieved October 9, 2004, fromwww.library.ucsb.edu/istl/98-winter/article3.html
Research Committee, Library Instruction Round Table. (1996).Evaluating library instruction: Sample questions, forms and strategies for practical use. Chicago: American Library Association.
Ross, J. L. (1998). On-line but off course: A wish list for distance educators.International Electronic Journal for Leadership in Learning, 2(3). Retrieved October 1, 2004, fromwww.acs.ucalgary.ca/~iejll/volume2/Ross2_3.html
Simmons College Graduate School of Library and Information Science (GSLIS). (2004). Doctor of arts. Retrieved November 18, 2004 from Web site:www.simmons.edu/gslis/academics/programs/da/da.shtml
Simmons College Graduate School of Library and Information Science (GSLIS). (2004). Master of science. Retrieved November 4, 2004 from Web site:www.simmons.edu/gslis/academics/programs/ms/
Simmons College Libraries. (2004). Simmons College catalog. Retrieved November 28, 2004 fromlibrary.simmons.edu/
Terrell, S. R., & Dringus, L. (1999). An investigation of the effect of learning style on student success in an online learning environment.Journal of Educational Technology Systems, 28(3), 231-238.