Abstract
Providing students with timely, targeted, and useful feedback regarding their understanding of course topics is generally accepted as a good educational practice. However, when classes are very large there are challenges that prevent many instructors from accomplishing this goal. This study explores the perceived helpfulness to students and the instructor of implementing a relatively new method of automated scoring and feedback in a large section of an organic chemistry course. Prior research has shown this method to be helpful in other STEM classes. In the current study, students in two different offerings of a stand-alone organic chemistry course completed an anonymous survey in which they were asked to provide feedback about their perceptions of the new methodology. The faculty member who taught the course was also asked to respond to a series of questions regarding the feedback system. Both students and the instructor provided favorable comments about the helpfulness of the methodology and the feedback provided by it. The instructor found it helpful for providing individual feedback to students, which had previously not been possible due to the number of students enrolled in the course. Students reported that the feedback helped them to identify course topic strengths and challenge areas and that they planned to study the material differently going forward. The results indicate that this intervention can help improve student understanding of course topics and necessary actions for improving future performance in the course.
Similar content being viewed by others
Availability of Data and Material
The survey instrument used and the confidential survey data collected in support of this project are available upon request. Our current IRB approval does not include permission to publish all data obtained in the study. We would need to submit a revised IRB proposal if the journal wanted us to publish the data in their entirety.
References
Anderson, L.W., & Krathwohl, D. R. (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Boston, MA: Allyn & Bacon.
Bhattacharyya, G. (2013). From source to sink: Mechanistic reasoning using the electron-pushing formalism. Journal of Chemical Education, 90(10), 1282–1289. https://doi.org/10.1021/ed300765k
Bloom, B. S., (ed.). (1956). Taxonomy of educational objectives: The classification of educational goals” in Handbook I: Cognitive Domain. New York, NY: David McKay Company.
Boud, D. & Soler, R. (2016). Sustainable assessment revisited. Assessment & Evaluation in Higher Education, 41(3), 400–413.
Butler, R. & Nisan, M. (1986). Effects of no feedback, task-related comments, and grades on intrinsic motivation and performance. Journal of Educational Psychology, 78(3), 210–216.
Eastwood, M. L. (2013). Fastest fingers: A molecule-building game for teaching organic chemistry. Journal of Chemical Education, 90(8), 1038–1041. https://doi.org/10.1021/ed3004462
Frohock, B. H., Winterrowd, S. T., & Gallardo-Williams, M. T. (2018). #IHeartChemistryNCSU: Free choice, content, and elements of science communication as the framework for an introductory organic chemistry project. Chemistry Education Research and Practice, 19, 240–250. https://doi.org/10.1039/C7RP00132K
Green, G. & Rollnick, M. J. (2006). The role of structure of the discipline in improving student understanding: The case of organic chemistry. Journal of Chemical Education, 83(9), 1376–1381. https://doi.org/10.1021/ed083p1376
Hedtrich, S. & Graulich, N. (2018). Using software tools to provide students in large classes with individualized formative feedback. Journal of Chemical Education, 95(12), 2263–2267. https://doi.org/10.1021/acs.jchemed.8b00173
Hubbard, B. A., Jones, G. C., & Gallardo-Williams, M. T. (2019). Student-generated digital tutorials in an introductory organic chemistry course. Journal of Chemical Education, 96(3), 597–600. https://doi.org/10.1021/acs.jchemed.8b00457
Jones, B.D. (2009). Motivating students to engage in learning: The MUSIC model of academic motivation. International Journal of Teaching and Learning in Higher Education, 21(2), 272–285.
Jones, B.D. (2018). Motivating students by design: Practical strategies for professors (2nd ed.). Charleston, SC: CreateSpace.
Jones, B.D. (2019). Testing the MUSIC model of motivation theory: Relationships betweenstudents’ perceptions, engagement, and overall ratings. The Canadian Journal for the Scholarship of Teaching and Learning, 10(3). https://doi.org/10.5206/cjsotl-rcacea.2019.3.9471
McMurry, J.E. (2011). Fundamentals of organic chemistry (7th edition). Belmont, CA: Brooks/Cole.
Miller, A.C. & Mills, B. (2019). ‘If they don’t care, I don’t care’: Millennial and Generation Z students and the impact of faculty caring. Journal of the Scholarship of Teaching and Learning, 19(4), 78–89. https://doi.org/10.14434/josotl.v19i4.24167
Mullins, J. J. (2008). Six pillars of organic chemistry. Journal of Chemical Education, 85(1), 83–87. https://doi.org/10.1021/ed085p83
Ormrod, J. E. (2011). Educational psychology: Developing learners (7th edition). Boston, MA:Pearson.
Ropohl, M. & Ronnebeck, S. (2019). Making learning effective – quantity and quality of pre-service teachers’ feedback. International Journal of Science Education, 41(15), 2156–2176.
Santrock, J.W. (2011). Educational psychology (5th edition). New York, NY: McGraw Hill.
Schaffer, H. (2017). Individualized formative feedback [Perl scripts to carry out necessary exam analyses]. Retrieved from https://github.com/hes8/formassess
Schaffer, H., Young, K.R., Ligon, E.W., & Chapman, D. (2017). Automating individualized formative feedback in large classes based on a directed concept graph. Frontiers in Psychology, 8. https://doi.org/10.3389/fpsyg.2017.00260
Sclater, N. (June, 2019). Rolling out learning analytics at a national level.. Educause Review. Retrieved from https://er.educause.edu/articles/2019/6/rolling-out-learning-analytics-at-a-national-level. Accessed 14 Aug 2019.
Seery, M. K. & Donnelly, R. (2012). The implementation of pre-lecture resources to reduce in-class cognitive load: A case study for higher education chemistry. British Journal of Educational Technology, 43(4), 667–677. https://doi.org/10.1111/j.1467-8535.2011.01237.x
Teixeira, J. & Holman, R.W. (2008). A simple assignment that enhances students’ ability to solve organic chemistry synthesis problems and understand mechanisms. Journal of Chemical Education, 85(1), 88–89. https://doi.org/10.1021/ed085p88
Zhu, M., Lee, H., Wang, T., Liu, O.L., Belur, V., & Pallant, A. (2017). Investigating the impact of automated feedback on students’ scientific argumentation. International Journal of Science Education, 39(12), 1648–1668.
Acknowledgements
The authors wish to thank the anonymous reviewers for their valuable feedback on an earlier draft of this manuscript.
Funding
No funding was received in support of this research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of Interest/Competing Interests
One of the authors was the faculty instructor for the course described in the study, but we do not believe that had an inappropriate influence on the research. This research was not supported by any funding agency and the authors do not have any financial or non-financial interests that might be perceived as influencing the research.
Code Availability
All computer code used in this project is available in GitHub for anyone to freely use, per the reference section of the paper.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Young, K.R., Schaffer, H.E., James, J.B. et al. Tired of Failing Students? Improving Student Learning Using Detailed and Automated Individualized Feedback in a Large Introductory Science Course. Innov High Educ 46, 133–151 (2021). https://doi.org/10.1007/s10755-020-09527-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10755-020-09527-5