Abstract
This study aimed to use the Kirkpatrick four-stage model to evaluate the learning outcomes of information organization (IO) courses. The study used the learning outcomes evaluation method and case studies; the evaluation method was used to transform the expected achievement and course goal according to cataloging competencies. The 3-credit “information organization” (IO) course at National Chengchi University and enrolled students during the 2016 fall semester were selected as the case study, with the study population consisting of 33 graduate students of two classes. Cataloging competencies were transformed into learning objectives and ten course units for the IO course, including information organization concept, descriptive cataloging, subject analysis, cataloging management and technology. The study used the four–stage Kirkpatrick model to evaluate student learning outcomes of the IO course, including evaluation of the level 1 reaction, level 2 learning, level 3 behavior and level 4 results. The empirical data collected from the course tasks was used to evaluate level 2 through three assignments, four tests and a final examination, while a questionnaire survey was used to evaluate levels 1, 3 and 4, with the student satisfaction score 4.51, shown with the IO course. As the average student achievement score was 83.48 points, the post-test scores of two classes’ graduate students were significantly higher than pre-test scores, with the study thus proving that all students made progress after taking the courses. Based on the Kirkpatrick model, the results provide favorable evidence for course effectiveness and its value, as well as illustrating that the students learned well on the information organization course.
Acknowledgements
The author would like to express gratitude to the Minstry of Science and Techonogy in Taiwan for financial support of this study (grant MOST 105-2410-H-004-133).
References
Al-Hijji, K.Z., and O.S. Fadlallah. 2013. “Theory versus Practice in Cataloging Education in Oman: Students’ Perspectives.” Cataloging & Classification Quarterly 51 (8):929–944.10.1080/01639374.2013.832456Search in Google Scholar
Cabonero, D.A., and R.B. Dolendo. 2013. “Cataloging and Classification Skills of Library and Information Science Practitioners in Their Workplaces: A Case Analysis.” Library Philosophy and Practice (E-Journal) 960. Accessed December 3, 2017. http://digitalcommons.unl.edu/libphilprac/960.Search in Google Scholar
Chang, N., and L. Chen. 2014. “Evaluating the Learning Effectiveness of an Online Information Literacy Class Based on the Kirkpatrick Framework.” Libri: International Journal of Libraries and Information Services 64 (3):211–223. doi:10.1515/libri-2014-0016.Search in Google Scholar
Gorman, M. 2002. “Why Teach Cataloguing and Classification?” Cataloging & Classification Quarterly 34 (1/2):1–13.10.1300/J104v34n01_01Search in Google Scholar
Joudrey, D.N., and R. McGinnis. 2014. “Graduate Education for Information Organization, Cataloging, and Metadata.” Cataloging & Classification Quarterly 52 (5):506–550.10.1080/01639374.2014.911236Search in Google Scholar
Kirkpatrick, D.L., and J.D. Kirkpatrick. 2006. Evaluating Training Programs: The Four Levels, 3rd ed. San Francisco, California: Berrett-Koehler Publishers.Search in Google Scholar
Li, K.C. 2011. The Development of University Curriculum and the Evaluation of Learning Effect. Taipei: Higher Education Press.Search in Google Scholar
Peng, S. 2010. Evaluation of College Students’ Learning Outcomes. Taipei: Higher Education Evaluation Center Foundation.Search in Google Scholar
Praslov, L. 2010. “Adatation of Kirkpatrick’s Four Level Model of Training Criteria to Assessment of Learning Outcomes and Program Evaluation in Higher Education.” Educational Assessment, Evaluation and Accountability 22 (3):215–225.10.1007/s11092-010-9098-7Search in Google Scholar
Wang, M. 2007. “Cataloging and Metadata Education in Taiwan Library and Information Science Programs.” Library and Information Science 33 (1):103–122.Search in Google Scholar
Wang, M. 2017. Developing A Cataloging Competency Based Curriculum on Information Organization. Taipei: Graduate Institute of Library, Information and Archival Studies, National Cheng-chi University.Search in Google Scholar
WebJunction comp. 2014. Competency Index for the Library Field. Dublin. Ohio: OCLC. Accessed December 3, 2017. https://www.webjunction.org/content/dam/WebJunction/Documents/webJunction/Competency%20Index%20for%20Library%20Field.pdf.Search in Google Scholar
Zhan, H.X. 2014. “Learning Outcomes-Oriented Teaching Design and Evaluation: Practical Examples of Teaching Principles.” Curiculum and Teaching 17 (2):197–225.Search in Google Scholar
© 2018 Walter de Gruyter GmbH, Berlin/Boston
