Abstract
Given prior work identifying sourcing, corroboration, and contextualization as key strategies needed to learn from multiple texts, this study examines students’ multiple text processing and written response composition under three different heuristic conditions. In particular, students were asked to engage in sourcing, corroboration, or contextualization while completing a multiple text task. Then, log data of text access, students’ notes, and written responses were analyzed across task conditions. Moreover, each sentence included in students’ written responses was linked to information in notes and in the library texts provided. Results indicate that students directed to engage in sourcing both accessed more document information and included more of such information in their notes. More generally, students’ response composition was found to be reductive in nature, with students filtering information from library texts into their notes and into the written responses that they composed; at the same time, cross-textual integration was found to be limited.
Similar content being viewed by others
References
Anmarkrud, Ø., Bråten, I., & Strømsø, H. I. (2014). Multiple-documents literacy: Strategic processing, source awareness, and argumentation when reading multiple conflicting documents. Learning and Individual Differences, 30, 64–76. https://doi.org/10.1016/j.lindif.2013.01.007.
Anmarkrud, Ø., McCrudden, M. T., Bråten, I., & Strømsø, H. I. (2013). Task-oriented reading of multiple documents: Online comprehension processes and offline products. Instructional Science: An International Journal of the Learning Sciences, 41, 873–894. https://doi.org/10.1007/s11251-013-9263-8.
Barzilai, S., & Strømsø, H. I. (2018). Individual differences in multiple document comprehension. In J. L. G. Braasach, I. Bråten, & M. T. McCrudden (Eds.), Handbook of multiple source use (pp. 99–116). New York: Routledge.
Barzilai, S., Thomm, E., & Shlomi-Elooz, T. (2020). Dealing with disagreement: The roles of topic familiarity and disagreement explanation in evaluation of conflicting expert claims and sources. Learning and Instruction, 69, Advanced online publication. https://doi.org/10.1016/j.learninstruc.2020.101367
Barzilai, S., Zohar, A. R., & Mor-Hagani, S. (2018). Promoting integration of multiple texts: a review of instructional approaches and practices. Educational Psychology Review, 30, 973–999. https://doi.org/10.1007/s10648-018-9436-8.
Bigot, L. L., & Rouet, J. F. (2007). The impact of presentation format, task assignment, and prior knowledge on students’ comprehension of multiple online documents. Journal of Literacy Research, 39, 445–470. https://doi.org/10.1080/10862960701675317.
Blanca, M. J., Alarcón, R., Arnau, J., Bono, R., & Bendayan, R. (2017). Non-normal data: Is ANOVA still a valid option? Psicothema, 29(4), 552–557.
Bohn-Gettler, C. M., & McCrudden, M. T. (2018). Effects of task relevance instructions and topic beliefs on reading processes and memory. Discourse Processes, 55, 410–431. https://doi.org/10.1080/0163853X.2017.1292824.
Brante, E. W., & Strømsø, H. I. (2018). Sourcing in text comprehension: A review of interventions targeting sourcing skills. Educational Psychology Review, 30, 773–799. https://doi.org/10.1007/s10648-017-9421-7.
Bråten, I., Anmarkrud, Ø., Brandmo, C., & Strømsø, H. I. (2014). Developing and testing a model of direct and indirect relationships between individual differences, processing, and multiple-text comprehension. Learning and Instruction, 30, 9–24. https://doi.org/10.1016/j.learninstruc.2013.11.002.
Bråten, I., Brante, E. W., & Strømsø, H. I. (2018). What really matters: The role of behavioural engagement in multiple document literacy tasks. Journal of Research in Reading, 41, 680–699. https://doi.org/10.1111/1467-9817.12247.
Bråten, I., & Strømsø, H. I. (2009). Effects of task instruction and personal epistemology on the understanding of multiple texts about climate change. Discourse Processes: A Multidisciplinary Journal, 47, 1–31. https://doi.org/10.1080/01638530902959646.
Bråten, I., & Strømsø, H. I. (2011). Measuring strategic processing when students read multiple texts. Metacognition and Learning, 6, 111–130. https://doi.org/10.1007/s11409-011-9075-7.
Bråten, I., Strømsø, H. I., & Britt, M. A. (2009). Trust matters: Examining the role of source evaluation in students’ construction of meaning within and across multiple texts. Reading Research Quarterly, 44, 6–28. https://doi.org/10.1598/RRQ.44.1.1.
Bråten, I., Strømsø, H. I., & Salmerón, L. (2011). Trust and mistrust when students read multiple information sources about climate change. Learning and Instruction, 21, 180–192. https://doi.org/10.1016/j.learninstruc.2010.02.002.
Britt, M. A., & Aglinskas, C. (2002). Improving students’ ability to identify and use source information. Cognition and Instruction, 20, 485–522. https://doi.org/10.1207/S1532690XCI2004_2.
Britt, M. A., Perfetti, C. A., Sandak, R., & Rouet, J. F. (1999). Content integration and source separation in learning from multiple texts. In S. R. Goldman, A. C. Graesser, & P. van den Broek (Eds.), Narrative comprehension, causality, and coherence: Essays in honor of Tom Trabasso (pp. 209–233). Mahwah: Lawrence Erlbaum Associates.
Britt, M. A., & Rouet, J. F. (2012). Learning with multiple documents: Component skills and their acquisition. In J. R. Kirby & M. J. Lawson (Eds.), Enhancing the quality of learning: Dispositions, instruction, and learning processes (pp. 276–314). New York: Cambridge University Press.
Britt, M. A., Rouet, J. F., Blaum, D., & Millis, K. (2019). A reasoned approach to dealing with fake news. Policy Insights from the Behavioral and Brain Sciences, 6(1), 94–101. https://doi.org/10.1177/2372732218814855.
Burton, V. T., & Chadwick, S. A. (2000). Investigating the practices of student researchers: Patterns of use and criteria for use of Internet and library sources. Computers and Composition: An International Journal, 17, 309–328. https://doi.org/10.1016/S8755-4615(00)00037-2.
Cerdán, R., & Vidal-Abarca, E. (2008). The effects of tasks on integrating information from multiple documents. Journal of Educational Psychology, 100, 209–222. https://doi.org/10.1037/0022-0663.100.1.209.
Du, H., & List, A. (2020). Researching and writing based on multiple texts. Learning and Instruction, 66.
Fives, H., & Buehl, M. M. (2012). Spring cleaning for the “messy” construct of teachers’ beliefs: What are they? Which have been examined? What can they tell us?. In K. R. Harris, S. Graham, T. Urdan, S. Graham, J. M. Royer, & M. Zeidner (Eds.), Individual differences and cultural and contextual factors (Vol. 2, pp. 471–499)., APA Handbooks in Psychology®. APA educational psychology handbook Washington, D.C: American Psychological Association.
Gil, L., Bråten, I., Vidal-Abarca, E., & Strømsø, H. I. (2010a). Summary versus argument tasks when working with multiple documents: Which is better for whom? Contemporary Educational Psychology, 35, 157–173. https://doi.org/10.1016/j.cedpsych.2009.11.002.
Gil, L., Bråten, I., Vidal-Abarca, E., & Strømsø, H. I. (2010b). Understanding and integrating multiple science texts: Summary tasks are sometimes better than argument tasks. Reading Psychology, 31, 30–68. https://doi.org/10.1080/02702710902733600.
Goldman, S. R. (2004). Cognitive aspects of constructing meaning through and across multiple texts. In N. Shuart-Faris & D. Bloome (Eds.), Uses of intertextuality in classroom and educational research (pp. 317–352). Greenwich: Information Age.
Goldman, S. R., Braasch, J. L., Wiley, J., Graesser, A. C., & Brodowinska, K. (2012). Comprehending and learning from Internet sources: Processing patterns of better and poorer learners. Reading Research Quarterly, 47, 356–381. https://doi.org/10.1002/RRQ.027.
Goldman, S. R., Britt, M. A., Brown, W., Cribb, G., George, M., Greenleaf, C., et al. (2016). Disciplinary literacies and learning to read forunderstanding: A conceptual framework for disciplinary literacy. Educational Psychologist, 51(2), 219–246.
Gottschling, S., Kammerer, Y., & Gerjets, P. (2019). Readers’ processing and use of source information as a function of its usefulness to explain conflicting scientific claims. Discourse Processes, 56, 429–446. https://doi.org/10.1080/0163853X.2019.1610305.
Hagen, Å. M., Braasch, J. L., & Bråten, I. (2014). Relationships between spontaneous note-taking, self-reported strategies and comprehension when reading multiple texts in different task conditions. Journal of Research in Reading, 37(S1), S141–S157. https://doi.org/10.1111/j.1467-9817.2012.01536.x.
Hartman, D. K., & Hartman, J. A. (1993). Reading across texts: Expanding the role of the reader. The Reading Teacher, 47, 202–211.
Havlicek, L. L., & Peterson, N. L. (1976). Robustness of the Pearson correlation against violations of assumptions. Perceptual and Motor Skills, 43(3_suppl), 1319–1334. https://doi.org/10.2466/pms.1976.43.3f.1319
Hyland, K., & Bondi, M. (Eds.). (2006). Academic discourse across disciplines (Vol. 42). New York: Peter Lang.
Iordanou, K., & Constantinou, C. P. (2014). Developing pre-service teachers’ evidence-based argumentation skills on socio-scientific issues. Learning and Instruction, 34, 42–57. https://doi.org/10.1016/j.learninstruc.2014.07.004.
Kendeou, P., Robinson, D. H., & McCrudden, M. T. (2019). Misinformation and disinformation in education: An introduction. In P. Kendeou, D. H. Robinson, & M. T. McCrudden (Eds.), Misinformation and fake news in education (pp. 1–6). Charlotte: Information Age.
Kobayashi, K. (2009). Comprehension of relations among controversial texts: Effects of external strategy use. Instructional Science, 37, 311–324. https://doi.org/10.1007/s11251-007-9041-6.
Kurby, C. A., Britt, M. A., & Magliano, J. P. (2005). The role of top-down and bottom-up processes in between-text integration. Reading Psychology, 26, 335–362. https://doi.org/10.1080/02702710500285870.
List, A. (2020). Six questions regarding strategy use when learning from multiple texts. In D. L. Dinsmore, L. Fryer, & M. M. Parkinson (Eds.), Handbookof strategies and strategic processing: conceptualization, intervention, measurement, and analysis (pp. 119–140). New York: Routledge.
List, A., & Alexander, P. A. (2017). Text navigation in multiple source use. Computers in Human Behavior, 75, 364–375.
List, A., & Alexander, P. A. (2018). Corroborating students’ self-reports of source evaluation. Behaviour & Information Technology, 37(3), 198–216.
List, A., & Alexander, P. A. (2019). Toward an integrated framework of multiple text use. Educational Psychologist, 54(1), 20–39.
List, A., & Alexander, P. A. (2020). Strategy use in learning from multiple texts: An investigation of the Integrative Framework of Learning from multipletexts. Frontiers in Education, 5.
List, A., Alexander, P. A., & Stephens, L. A. (2017). Trust but verify: Examining the association between students’ sourcing behaviors and ratings of texttrustworthiness. Discourse Processes, 54(2), 83–104.
List, A., Du, H., Wang, Y. (2019). Understanding students’ conceptions of task assignments. Contemporary Educational Psychology, 59, 101801.
List, A., Du, H., Wang, Y., & Lee, H. Y. (2019). Toward a typology of integration: Examining the documents model framework. ContemporaryEducational Psychology, 58, 228–242.
List, A., & Rubenstein, L. D. (2019). Understanding susceptibility to educational inaccuracies: Examining the Likelihood of Adoption Model. In P. Kendeou, D. Robinson, & M. T. McCrudden (Eds.), Misinformation and Fake News in Education (pp. 29–53). Charlotte, NC: Information Age Publishing.
List, A., Stephens, L. A., & Alexander, P. A. (2019). Examining interest throughout multiple text use. Reading and Writing, 32(2), 307–333.
Macedo-Rouet, M., Braasch, J. L., Britt, M. A., & Rouet, J. F. (2013). Teaching fourth and fifth graders to evaluate information sources during text comprehension. Cognition and Instruction, 31, 204–226. https://doi.org/10.1080/07370008.2013.769995.
Maier, J., & Richter, T. (2013). Text belief consistency effects in the comprehension of multiple texts with conflicting information. Cognition and Instruction, 31, 151–175. https://doi.org/10.1080/07370008.2013.769997.
Many, J. E. (1996). Patterns of selectivity in drawing on sources: Examining students’ use of intertextuality across literacy events. Literacy Research and Instruction, 36, 51–63. https://doi.org/10.1080/19388079609558227.
Martínez, I., Mateos Sanz, M. D. M., Martín, E., & Rijlaarsdam, G. (2015). Learning history by composing synthesis texts: Effects of an instructional programme on learning, reading and writing processes, and text quality. Journal of Writing Research., 7, 275–302. https://doi.org/10.17239/jowr-2015.07.02.03.
Mateos, M., Solé, I., Martín, E., Cuevas, I., Miras, M., & Castells, N. (2014). Writing a synthesis from multiple sources as a learning activity. In P. Klein, P. Boscolo, L. Kirkpatrick, & C. Gelati (Eds.), Writing as a learning activity (pp. 169–190). Leiden: Brill.
McCrudden, M. T., & Schraw, G. (2007). Relevance and goal-focusing in text processing. Educational Psychology Review, 19, 113–139. https://doi.org/10.1007/s10648-006-9010-7.
McCarthy, K. S., & Goldman, S. R. (2019). Constructing interpretive inferences about literary text: The role of domain-specific knowledge. Learning andInstruction, 60, 245–251.
Nokes, J. D., Dole, J. A., & Hacker, D. J. (2007). Teaching high school students to use heuristics while reading historical texts. Journal of Educational Psychology, 99, 492–504. https://doi.org/10.1037/0022-0663.99.3.492.
Paris, S. G., Lipson, M. Y., & Wixson, K. K. (1983). Becoming a strategic reader. Contemporary Educational Psychology, 8, 293–316. https://doi.org/10.1016/0361-476X(83)90018-8.
Pérez, A., Potocki, A., Stadtler, M., Macedo-Rouet, M., Paul, J., Salmerón, L., et al. (2018). Fostering teenagers’ assessment of information reliability: Effects of a classroom intervention focused on critical source dimensions. Learning and Instruction, 58, 53–64. https://doi.org/10.1016/j.learninstruc.2018.04.006.
Perfetti, C. A., Rouet, J.-F., & Britt, M. A. (1999). Towards a theory of documents representation. In H. van Oostendorp & S. R. Goldman (Eds.), The Construction of mental representations during reading (pp. 99–122). Mahwah: Lawrence Erlbaum Associates.
Reisman, A. (2012). Reading like a historian: A document-based history curriculum intervention in urban high schools. Cognition and instruction, 30(1), 86–112. https://doi.org/10.1080/07370008.2011.634081.
Reisman, A., & Wineburg, S. (2008). Teaching the skill of contextualizing in history. The Social Studies, 99, 202–207. https://doi.org/10.3200/TSSS.99.5.202-207.
Richter, T. (2011). Cognitive flexibility and epistemic validation in learning from multiple texts. In J. Elen, E. Stahl, R. Bromme, & G. Clarebout (Eds.), Links between beliefs and cognitive flexibility. (pp. 125–140). Dordrecht: Springer. https://doi.org/10.1007/978-94-007-1793-0_7.
Richter, T., & Maier, J. (2017). Comprehension of multiple documents with conflicting information: A two-step model of validation. Educational Psychologist, 52(3), 148–166. https://doi.org/10.1080/00461520.2017.1322968.
Ronan, B. (2015). Intertextuality and dialogic interaction in students’ online text construction. Literacy Research: Theory, Method, and Practice, 64, 379–397. https://doi.org/10.1177/2381336915617613.
Rouet, J. F., & Britt, M. A. (2011). Relevance processes in multiple docu- ment comprehension. In M. T. McCrudden, J. P. Magliano, & G. Schraw (Eds.), Relevance instructions and goal-focusing in text learning (pp. 19–52). Greenwich: Information Age.
Rouet, J. F., Favart, M., Britt, M. A., & Perfetti, C. A. (1997). Studying and using multiple documents in history: Effects of discipline expertise. Cognition and Instruction, 15, 85–106. https://doi.org/10.1207/s1532690xci1501_3.
Salmerón, L., Gil, L., & Bråten, I. (2018). Using eye-tracking to assess sourcing during multiple document reading: A critical analysis. Frontline Learning Research, 6(3), 105–122.
Schmidt, A. F., & Finan, C. (2018). Linear regression and the normality assumption. Journal of clinical epidemiology, 98, 146–151. https://doi.org/10.1016/j.jclinepi.2017.12.006
Shanahan, C. (2009). Disciplinary comprehension. In S. E. Israel & G. G. Duffy (Eds.), Handbook of research on reading comprehension (pp. 240–260). New York: Routledge.
Smagorinsky, P., & O’Donnell-Allen, C. (1998). Reading as mediated and mediating action: Composing meaning for literature through multimedia interpretive texts. Reading Research Quarterly, 33, 198–226. https://doi.org/10.1598/RRQ.33.2.3.
Spivey, N. N. (1990). Transforming texts: Constructive processes in reading and writing. Written Communication, 7, 256–287. https://doi.org/10.1177/0741088390007002004.
Stadtler, M., & Bromme, R. (2007). Dealing with multiple documents on the WWW: The role of metacognition in the formation of documents models. International Journal of Computer-Supported Collaborative Learning, 2, 191–210. https://doi.org/10.1007/s11412-007-9015-3.
Stadtler, M., & Bromme, R. (2013). Multiple document comprehension: An approach to public understanding of science. Cognition and Instruction, 31, 122–129. https://doi.org/10.1080/07370008.2013.771106.
Stadtler, M., & Bromme, R. (2014). The content-source integration model: A taxonomic description of how readers comprehend conflicting scientific information. In D. N. Rapp & J. L. G. Braasch (Eds.), Processing inaccurate information: Theoretical and applied perspectives from cognitive science and the educational sciences (pp. 379–402). Cambridge: MIT Press.
Stahl, S. A., Hynd, C. R., Britton, B. K., McNish, M. M., & Bosquet, D. (1996). What happens when students read multiple source documents in history? Reading Research Quarterly, 31, 430–456. https://doi.org/10.1598/RRQ.31.4.5.
Strømsø, H. I., Bråten, I., & Samuelstuen, M. S. (2003). Students’ strategic use of multiple sources during expository text reading: A longitudinal think-aloud study. Cognition and Instruction, 21, 113–147. https://doi.org/10.1207/S1532690XCI2102_01.
Thomm, E., & Bromme, R. (2016). How source information shapes lay interpretations of science conflicts: Interplay between sourcing, conflict explanation, source evaluation, and claim evaluation. Reading and Writing: An Interdisciplinary Journal, 29, 1629–1652. https://doi.org/10.1007/s11145-016-9638-8.
Van Boxtel, C., & van Drie, J. (2012). “That’s in the time of the Romans!” Knowledge and strategies students use to contextualize historical images and documents. Cognition and Instruction, 30, 113–145. https://doi.org/10.1080/07370008.2012.661813.
Wiley, J., Goldman, S. R., Graesser, A. C., Sanchez, C. A., Ash, I. K., & Hemmerich, J. A. (2009). Source evaluation, comprehension, and learning in Internet science inquiry tasks. American Educational Research Journal, 46, 1060–1106. https://doi.org/10.3102/0002831209333183.
Wiley, J., & Voss, J. F. (1999). Constructing arguments from multiple sources: Tasks that promote understanding and not just memory for text. Journal of Educational Psychology, 91, 301. https://doi.org/10.1037/0022-0663.91.2.301.
Wineburg, S. S. (1991). Historical problem solving: A study of the cognitive processes used in the evaluation of documentary and pictorial evidence. Journal of Educational Psychology, 83, 73. https://doi.org/10.1037/0022-0663.83.1.73.
Wolfe, M. B., & Goldman, S. R. (2005). Relations between adolescents’ text processing and reasoning. Cognition and Instruction, 23, 467–502. https://doi.org/10.1207/s1532690xci2304_2.
Zembal-Saul, C., Munford, D., Crawford, B., Friedrichsen, P., & Land, S. (2002). Scaffolding preservice science teachers’ evidence-based arguments during an investigation of natural selection. Research in Science Education, 32, 437–463. https://doi.org/10.1023/A:1022411822951
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix 1: interest and attitudes
Interest Interest was assessed at the topic level. In particular, students were asked to rate their interest in each of seven topics related to gifted education (e.g., gifted and talented education, school policy, special education) using a seven point Likert scale, ranging from not at all interested to very interested. Cronbach’s alpha reliability for the seven item scale was .86. Students’ average interest ratings were 4.74 (SD = 1.07).
Attitudes Students were asked to report attitudes toward gifted education in three primary ways, capturing attitude content, stance, and certainty. Attitude content was captured by asking students to rate their agreement with 10 items reflecting statements in support of or in opposition to gifted and talented education. Statements read: Gifted education is an important priority for all schools and All students are gifted in different ways. It is wrong to prioritize some students over others. Scale reliability for the five items supporting the inclusion of gifted education in schools was .72, while reliability for the five items opposing gifted education was .70.
Students were additionally asked to adopt an attitude stance regarding the inclusion of gifted education in schools. In particular, students were asked to respond to the multiple choice item: do you think elementary schools should have gifted and talented programs and asked to select (a) yes, (b) no, or (c) I don’t know. While 56.94% (n = 41) of students supported the inclusion of gifted education in schools, 13.89% of students opposed this measure, and 29.17% indicated that they did not know whether or not they supported gifted education. Finally, students were asked to report attitude certainty. Specifically, after responding to the multiple choice item capturing attitude stance, students were asked to rate three Likert items assessing the strength of their chosen position (i.e., how sure are you? how certain are you? how strongly do you feel?). Reliability for the three item certainty scale was .92.
Across these various individual difference measures we were able to verify both that students had at least a moderate degree of interest in the topic of the task and held varied attitudes supporting and opposing gifted education. Additionally, neither interest (p = .79) nor any of the attitude-related measures (p > .07) were found to significantly differ across task conditions.
Appendix 2: sample coding of students’ notes
Appendix 3: sample response
-
1.
I believe that my school should not have a gifted and talented program. (position)
-
2.
Within the six resources I have just read, I came to the conclusion that three of the sources authors were against gifted education programs, and three were for them. (inter-text)
-
3.
Susan Moore, a teacher with a mixed abilities classroom was the first I saw to be for these programs. (organization)
-
4.
However, her arguments were completely biased and opinionated. (transform)
-
5.
She stated that teaching her mixed ability class was very “challenging and disappointing.” (text-direct)
-
6.
She further explains that this is because she cannot keep the attention of all of her students throughout the day. (intra-text)
-
7.
Personally, I think she just does not sound like the best teacher. (transform)
-
8.
If she were a good teacher, she would be able to differentiate instruction effectively so she can keep all of her students engaged and attentive. (transform)
-
9.
Frederick M. Hess was the next author to be for gifted and talented programs. (organization)
-
10.
He believes that “schools exist to provide resources and instruction that can nurture the gifts that students possess.” (text-direct)
···
-
13.
Hess also states that is its “unreasonable to expect most teachers to differentiate instruction well.” (intra-text)
-
14
Teachers are taught specifically how to differentiate instruction, so why would they not be held to that standard to do so. (transform)
-
15
Going back to Moore’s above position, good teachers will be able to differentiate instruction. (inter-text)
···
-
20
Halley J. Potter was an author who is against gifted and talented programs, and she made points that I have never thought of. (transform)
-
21
She explains that programs like these increase socioeconomic and racial segregation. (text-direct)
-
22
She gives evidence from 2011 by saying “roughly 70 percent of all New York City public school students were black or Latino, but more than 70 perfect of kindergartners in gifted and talented programs were white or Asian.” (text-direct)
-
23
If this holds true, it really is segregating schools. (elaboration)
-
24
I am not saying the schools are segregating students on purpose, however, it is still a trend from gifted and talented programs. (elaboration)
···
Rights and permissions
About this article
Cite this article
List, A., Du, H. Reasoning beyond history: examining students’ strategy use when completing a multiple text task addressing a controversial topic in education. Read Writ 34, 1003–1048 (2021). https://doi.org/10.1007/s11145-020-10095-5
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11145-020-10095-5