Abstract
When seen in a positive light, accountability systems are understood as a means for promoting transparency, improvement, responsibility and commitment to valuable goals, thus ensuring that State funding is invested in initiatives that are beneficial to all citizens. However, in education, there is extensive evidence about the negative effects of predominant accountability systems, which call their expected positive impacts into question. Some of the detrimental effects of these systems involve unequal distribution of knowledge as well as discrimination and stigmatisation of vulnerable students, minorities and powerless groups, and of the schools that serve them. This evidence, along with emerging demands for social justice in terms of participation and recognition, highlights the need to analyse the shortcomings of current accountability systems in connection to ideals of social justice in education. On the basis of a review of relevant literature that connects the areas of social justice, education and assessment and accountability systems, this paper aims at illustrating some of the significant challenges and potential new avenues for the development of more just and, therefore, more intelligent accountability systems.
Notes
The larger programme involves three strands of research: (1) a review of the literature around the concept of social justice in political philosophy and education and its connections to assessment; (2) exploration of experiences of injustice in connection to assessment; (3) development and exploration of innovative practices in assessment that respond to current emerging horizons of social justice. The discussion in this article responds to the first strand and is based on an initial review that focused on the following questions: “What is and has been the role of large-scale assessment systems with regard to social justice in education? Are current assessment systems responding to emerging horizons of social justice in the present? What would be the main characteristics of a socially just assessment system in the present?” (Flórez Petour et al. 2018).
References
Adams, M. (2014). Social justice and education. In M. Reisch (Ed.), The Routledge international handbook of social justice (pp. 249–268). London and New York: Routledge.
Adams, M., & Zuñiga, X. (2016). Getting started. Core concepts for social justice education. In M. Adams, L. A. Bell, D. Goodman, & K. Y. Joshi (Eds.), Teaching for diversity and social justice (3rd ed.). New York: Routledge Ltd - M.U.A.
AERA, APA, & NCME. (2014). Standards for educational and psychological testing. Washington, DC: AERA.
Anderson, J. A. (2004). Accountability in education. Paris: International Institute for Educational Planning, UNESCO. https://doi.org/10.1038/200218c0.
Baird, J. A., Hopfenbeck, T., Ahmed, A., Elwood, J., Paget, C., & Usher, N. (2014). Predictability in the Irish Leaving Certificate Examination (Working Paper 1). Oxford.
Ball, S., Maguire, M., & Brau, A. (2012). How schools do policy: Policy enactments in secondary schools. London: Routledge.
Bellei, C., Canales, M., Orellana, V., & Contreras, M. (2016). Elección de escuela en sectores populares: Estado, mercado e integración social. Revista Austral de Ciencias Sociales,2016(31), 95–110. https://doi.org/10.1007/s13238-015-0219-4.
Bellei, C., & Morawietz, L. (2015). Strong content, weak tools. Twenty-first-century competencies in the Chilean Educational Reform. In F. Reimers & C. Chung (Eds.), Teaching and learning for the twenty-first century. Educational goals, policies, and curricula from six nations. Cambridge: Harvard Education Press.
Berryhill, J., Berryhill, J., Linney, J. A., Linney, J. A., Fromewick, J., & Fromewick, J. (2009). The effects of education accountability on teachers: Are policies too stress provoking for their own good? International Journal of Education Policy and Leadership,4(5), 1–14. https://doi.org/10.1093/ajae/aau020.
Bolívar, A. (2012). Justicia social y equidad escolar. Una revisión actual. Revista Internacional de Educación Para La Justicia Social (RIEJS),1(1), 9–45.
Bovens, M. (2007). Analysing and assessing accountability: A conceptual framework. European Law Journal,13(4), 447–468. https://doi.org/10.1111/j.1468-0386.2007.00378.x.
Bovens, M., Schillemans, T., & Goodin, R. E. (2014). Public accountability. In M. Bovens, R. E. Goodin, & T. Schillemans (Eds.), The Oxford handbook of public accountability (pp. 1–23). Oxford: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780199641253.013.0012.
Brill, F., Grayson, H., & Donnell, S. O. (2018). What impact does accountability have on curriculum, Standards and engagement in education ?. A literature review. The Mere: National Foundation for Educational Research (NFER). Retrieved from https://www.nfer.ac.uk/media/3032/nfer_accountability_literature_review_2018.pdf. Accessed 14 June 2019.
Campos, J., & Guerrero, P. (2016). Efectos Indeseados De La Medición De La Calidad Educativa En Chile. La Respuesta De La Sociedad Civil. Cadernos CEDES,36(100), 355–374. https://doi.org/10.1590/cc0101-32622016171351.
Campos-Martínez, J., & Fernandez, M. B. (2014). Resistiendo la emboscada neoliberal desde las escuelas: Experiencias de organización docente contra las pruebas estandarizadas. Revista Docencia,52, 72–87.
Canales, M., Bellei, C., & Orellana, V. (2016). ¿Por qué elegir una escuela privada subvencionada? Sectores medios emergentes y elección de escuela en un sistema de mercado. Estudios Pedagógicos (Valdivia),42(3), 89–109. https://doi.org/10.4067/S0718-07052016000400005.
Carrasco, A., Gutiérrez, G., & Flores, C. (2017). Failed regulations and school composition: Selective admission practices in Chilean primary schools. Journal of Education Policy,32(5), 642–672. https://doi.org/10.1080/02680939.2017.1312549.
Comisión SIMCE. (2003). Evaluación de Aprendizajes para una Educación de Calidad. Santiago: MINEDUC.
Comision SIMCE. (2015). Hacia un sistema completo y equilibrado de evaluación de los aprendizajes en Chile de evaluación de los aprendizajes en Chile. Informe Equipo de Tarea para la revisión del SIMCE. Santiago: Ministerio de Educación. Retrieved from https://www.mineduc.cl/wp-content/uploads/sites/19/2015/11/Informe-Equipo-de-Tarea-Revisión-Simce.pdf. Accessed 14 June 2019.
Cuff, B. M. P. (2018). International approaches to the moderation of non-examination assessments in secondary education. London. Retrieved from https://www.gov.uk/government/publications/international-literature-review-of-secondary-assessments. Accessed 14 June 2019.
Darling-Hammond, L., & Rustique Forrester, E. (2005). The consequences of student testing for teaching and teacher quality. In J. Herman & E. Haertel (Eds.), The uses and misuses of data in accountability testing: The 104th yearbook of the National Society for the Study of Education, part II (pp. 289–319). Malden, MA: Blackwell.
Donoso Díaz, S., & Hawes Barrios, G. (2002). Eficiencia escolar y diferencias socioeconómicas: a propósito de los resultados de las pruebas de medición de la calidad de la educación en Chile. Educação e Pesquisa,28(2), 25–39. https://doi.org/10.1590/S1517-97022002000200003.
Dubet, F. (2011). Repensar la justicia social. Contra el mito de la igualdad de oportunidades. Buenos Aires: Editorial siglo XXI.
Ehren, M. C. M., & Hatch, T. (2013). Responses of schools to accountability systems using multiple measures: The case of New York City elementary schools. Educational Assessment, Evaluation and Accountability,25(4), 341–373. https://doi.org/10.1007/s11092-013-9175-9.
Ellison, S. (2012). Intelligent accountability: Rethinking the concept of “accountability” in the popular discourse of education policy. Journal of Thought,47(2), 19–41. https://doi.org/10.2307/jthought.47.2.19.
Elwood, J. (2005). Gender and achievement: What have exams got to do with it? Oxford Review of Education,31(3), 373–393. https://doi.org/10.1080/03054980500222031.
Elwood, J. (2013). The role(s) of student voice in 14–19 education policy reform: reflections on consultation and participation. London Review of Education,2(11), 97–111.
Falabella, A. (2014). The performing school: The effects of market and accountability policies. Education Policy Analysis Archives. https://doi.org/10.1016/S0378-777X(80)80142-9.
Falabella, A., & De la Vega, L. F. (2016). Políticas de responsabilización por desempeño escolar: Un debate a partir de la literatura internacional y el caso chileno. Estudios Pedagógicos,2(42), 395–413. https://doi.org/10.4067/S0718-07052016000200023.
Falabella, A., & Opazo, C. (2014). Sistema de Aseguramiento de la Calidad y Procesos de Mejoramiento: una mirada desde la gestión educativa. Informe ejecutivo. Santiago. Retrieved from https://www.diversidadinclusiva.com/wp-content/uploads/2016/06/Estudio-Sistema-de-Aseguramiento-de-la-Calidad-Una-mirada-desde-la-Gesti%C3%B3n-Educativa-A.-Falabella-y-C.-Opazo.pdf. Accessed 4 Nov 2019.
Filer, A., & Polard, A. (2000). Assessment: Social practice and social product. London: Routledge.
Flórez Petour, M. T. (2015). Systems, ideologies and history: A three-dimensional absence in the study of assessment reform processes. Assessment in Education: Principles, Policy & Practice, 22(1), 3–26.
Flórez Petour, M. T., Rozas Assael, T., Gysling, J., & Olave Astorga, J. M. (2018). The consequences of metrics for social justice: Tensions, pending issues, and questions. Oxford Review of Education, 44(5), 651–667.
Fraser, N. (1995). From redistribution to recognition? Dilemmas of justice in a “post-socialist” age. New Left Review,212, 68–93.
Fraser, N. (2003). Social justice in the age of identity politics: Redistribution, recognition, and participation. In N. Fraser & A. Honneth (Eds.), Redistribution ir recognition? A political-philosophical exchange (pp. 7–109). London: Verso.
Gale, T. (2000). Rethinking social justice in schools: How will we recognize it when we see it? International Journal of Inclusive Education,4(3), 253–269. https://doi.org/10.1080/13603110050059178.
Gana, Y. (2012). Key features and impacts of educational accountability systems: Library-based review of international evidence and analysis of Chilean high-stakes school accountability policy. Bristol: University of Bristol.
Gardner, J., Holmes, B., & Leitch, R. (2009). Assessment and Social Justice. A futurelab literature review: Report 16. Bristol. Retrieved from https://www.nfer.ac.uk/publications/FUTL63/FUTL63.pdf. Accessed 14 June 2019.
Geiser, S. (2005). The growing correlation between race and sat scores: new findings from California. California: Center for Studies in Higher Education. Retrieved from https://cshe.berkeley.edu/sites/default/files/publications/rops.cshe_.10.15.geiser.racesat.10.26.2015.pdf. Accessed 14 June 2019.
Gewirtz, S. (1998). Conceptualizing social justice in education: Mapping the territory. Journal of Education Policy,13(4), 469–484. https://doi.org/10.1080/0268093980130402.
Gewirtz, S. (2002). The managerial school: Post-welfarism and social justice in education. London and New York: Routledge.
Gewirtz, S. (2006). Towards a contextualized analysis of social justice in education. Educational Philosophy and Theory,38(1), 69–81. https://doi.org/10.1111/j.1469-5812.2006.00175.x.
Gipps, C., & Stobart, G. (2009). Fairness in assessment. In C. Wyatt-Smith & J. J. Claire (Eds.), Educational assessment in the 21st century: Connecting theory and practice (pp. 1–309). Dordrecht: Springer Netherlands. https://doi.org/10.1007/978-1-4020-9964-9.
Greene, J. (2001). Dialogue in evaluation a relational perspective. Evaluation,7(2), 181–187. https://doi.org/10.1177/135638900100700203.
Griffiths, M. (2003). Action for social justice in education. Philadelphia: Open University Press.
Guillou, V. (2014). Boicot al Simce: 22 escuelas no rindieron la prueba con normalidad. El Desconcierto. Retrieved from http://www.eldesconcierto.cl/2014/11/18/boicot-al-simce-unas-22-escuelas-rindieron-la-prueba-con-normalidad/. Accessed 14 June 2019.
Gutmann, A. (Ed.). (1994). Introduction. In Multiculturalism: Examining the politics of recognition. Princeton: Princeton University Press.
Heilig, J. V., & Darling-Hammond, L. (2008). Accountability texas-style: The progress and learning of urban minority students in a high-stakes testing context. Source: Educational Evaluation and Policy Analysis,30(2), 75–110.
Hevia, F. J., & Vergara-Lope, S. (2016). Evaluaciones educativas realizadas por ciudadanos en México: validación de la Medición Independiente de Aprendizajes. Innovación Educativa,16(70), 85–109.
Hopfenbeck, T. N., Flórez Petour, M. T., & Tolo, A. (2015). Balancing tensions in educational policy reforms: Large-scale implementation of Assessment for Learning in Norway. Assessment in Education: Principles, Policy and Practice, 22(1), 44–60.
Howe, K. (1997). Understanding equal educational opportunity: social justice, democracy, and schooling. New York: Teachers College Press.
Isaacs, T., Zara, C., Herbert, G., Coombs, S. J., & Smith, C. (2013). Key concepts in educational assessment. Los Angeles: SAGE.
Kane, M. (2010). Validity and fairness. Language Testing,27(2), 177–182. https://doi.org/10.1177/0265532209349467.
Klenowski, V., & Wyatt-Smith, C. (2012). The impact of high stakes testing: the Australian story. Assessment in Education: Principles, Policy & Practice,19(1), 65–79. https://doi.org/10.1080/0969594X.2011.592972.
Koretz, D. (2008). Measuring up: What educational testing really tells us. Cambridge: Harvard University Press.
Lambert, D., & Lines, D. (2000). Understanding assessment purposes, perceptions, Practice. London: RoutledgeFalmer.
Lee, C. D. (1998). Culturally responsive pedagogy and performance-based assessment. The Journal of Negro Education,67(3), 268–279. https://doi.org/10.2307/2668195.
Lipman, P. (Ed.). (2004). Accountability, social differentitation and racialized social control. High-stakes education: Inequality, globalization, and urban school reform (pp. 41–69). New York: RoutledgeFalmer.
Luaces, O. (2014). Evaluaciones en Línea Una innovación educativa en el marco del programa de una computadora por alumno. Montevideo: ANEP.
Lynch, K., & Lodge, A. (2002). Equality and power in schools: Redistribution, recognition and representation. London: RoutledgeFalmer.
McArthur, J. (2016). Assessment for social justice: The role of assessment in achieving social justice. Assessment & Evaluation in Higher Education,41(7), 967–981. https://doi.org/10.1080/02602938.2015.1053429.
McArthur, J. (2018). Theories of social justice. In J. McArthur (Ed.), Assessment for social justice: Perspectives and practices within higher education (pp. 35–50). London: Bloomsbury Academic. https://doi.org/10.5040/9781474236089.ch-002.
Murillo, F. J., & Hernández, R. (2011). Hacia un concepto de Justicia Social. Revista Iberoamericana Sobre Calidad, Eficacia y Cambio En Educación,9(4), 7–23.
Murillo, F. J., Román, M., & Hernández Castilla, R. (2011). Evaluación educativa para la justicia social. Revista Iberoamericana de Evaluación Educativa,4(1), 7–23.
Nieuwenhuis, J. (2010). Social justice in education revisited. Education Inquiry,1(4), 269–287. https://doi.org/10.3402/edui.v1i4.21946.
North, C. E. (2006). More than words? Delving into the substantive meaning(s) of “social justice” in education. Review of Educational Research,76(4), 507–535. https://doi.org/10.3102/00346543076004507.
O’Neill, O. (2013). Intelligent accountability in education. Oxford Review of Education,39(1), 4–16. https://doi.org/10.1080/03054985.2013.764761.
Ortiz Cáceres, I. (2012). En torno a la validez del Sistema de Medición de la Calidad de la Educación en Chile. Estudios Pedagógicos (Valdivia),38(2), 355–373. https://doi.org/10.4067/S0718-07052012000200022.
Polesel, J., Dulfer, N., & Turnbull, M. (2012). The experience of education: The impacts of high stakes testing on school students and their families. An educator’s perspective. Rydalmere: University of Western Sydney, Whitlam Institute.
Power, S. (2012). From redistribution to recognition to representation: Social injustice and the changing politics of education. Globalisation, Societies and Education,10(4), 473–492. https://doi.org/10.1080/14767724.2012.735154.
Power, S., & Frandji, D. (2010). Education markets, the new politics of recognition and the increasing fatalism towards inequality. Journal of Education Policy,25(3), 385–396. https://doi.org/10.1080/02680930903576404.
Power, S., & Gewirtz, S. (2001). Reading education action zones. Journal of Education Policy,16(1), 39–51. https://doi.org/10.1080/02680930010009813.
PREAL. (2009). Tendencias en la evaluación del logro escolar: la experiencia de cinco países con alto rendimiento educativo. Serie Mejores Prácticas,11(31), 1–4.
Rawls, J. (1999). A theory of justice (Revised ed.). Cambridge, Massachusetts: Harvard University Press.
Reay, D., Wiliam, D., & College, K. (1999). ‘I’ ll be a nothing’: Structure, agency and the construction of identity through assessment [1 ]. British Educational Research Journal,25(3), 343–354.
Ribeiro, V. M. (2014). What principle of justice for basic education? Cadernos de Pesquisa,44(154), 1095–1109.
Rodriguez de Mayo, R. (2003). Naturaleza política de la evaluación curricular: Los fundamentos políticos del enfoque democrático de Barry MacDonald. Revista Pedagogica,24(71), 349–384.
Rojas, M., Falabella, A., & Alarcón, P. (2016). Inclusión social en las escuelas: estudio de prácticas pedagógicas inclusivas y proyecciones para enfrentar un escenario sin copago y selección escolar. Retrieved from https://www.supereduc.cl/wp-content/uploads/2017/01/Inclusion-social-en-las-escuelas.pdf. Accessed 14 June 2019.
Sahlberg, P. (2010). Rethinking accountability in a knowledge society. Journal of Educational Change,11(1), 45–61. https://doi.org/10.1007/s10833-008-9098-2.
Shepard, L. (1992). Will national tests improve student learning. CSE Technical report 342. Boulder: CRESST, University of Colorado.
Simoes, P., & Pereira, S. (2017). Low stakes national external assessment in Portugal: A singular case among European school systems. Princeton: Association for Educational Assessment (IAEA).
Slavin, R. E., & Madden, N. A. (2006). Reducing the gap: Success for all and the achievement of African American Students. Journal of Negro Education,75(3), 389–400. https://doi.org/10.2307/40026810.
Stein, Z. (2016). Social justice and educational measurement. John Rawls, the history of testing, and the future of education. London: Routledge.
Stobart, G. (2008). Testing times the uses and abuses of assessment. London: Routledge.
Stobart, G., & Eggen, T. (2012). High-stakes testing—Value, fairness and consequences. Assessment in Education: Principles, Policy & Practice,19(1), 1–6. https://doi.org/10.1080/0969594X.2012.639191.
Taut, S., Cortés, F., Sebastian, C., & Preiss, D. (2009). Evaluating school and parent reports of the national student achievement testing system (SIMCE) in Chile: Access, comprehension, and use. Evaluation and Program Planning,32(2), 129–137. https://doi.org/10.1016/j.evalprogplan.2008.10.004.
Taylor, C. (1994). The politics of recognition. In C. Taylor, A. Appiah, J. Habermas, M. Walzer, & S. Wolf (Eds.), Multiculturalism: examining the politics of recognition (pp. 25–74). Princeton, N.J: Princeton University Press.
Tikly, L., & Barrett, A. M. (2011). Social justice, capabilities and the quality of education in low income countries. International Journal of Educational Development,31(1), 3–14. https://doi.org/10.1016/j.ijedudev.2010.06.001.
Treviño, E., Valenzuela, J. P., & Villalobos, C. (2016). Within-school segregation in the Chilean school system: What factors explain it? How efficient is this practice for fostering student achievement and equity? Learning and Individual Differences,51, 367–375. https://doi.org/10.1016/j.lindif.2016.08.021.
UNESCO. (2017). The Global education monitoring report. Accountability in education: Meeting our commitments. Paris: UNESCO. https://doi.org/10.1017/CBO9781107415324.004.
Waldow, F. (2017). Constellations of actors and fairness in assessment. In C. Alarcón & M. Lawn (Eds.), Assessment cultures. Historical perspectives (pp. 335–361). Berlin: Peter Lang.
Wandall, J. (2011). National tests in Denmark – CAT as a pedagogic tool. The Journal of Applied Testing Technology (JATT), 12, 1–21.
Weinstein, J., Marfan, J., & Munoz, G. (2016). School leadership challenged by double accountability toward schools. In J. Easley II & P. Tulowitzki (Eds.), Educational accountability. International perspectives on challenges and possibilities for school leadership (1st edn, pp. 54–72). New York and London: Routledge.
White, J. (2014). Who needs examinations?: A story of climbing ladders and dodging snakes. London: IOE Press.
Wöbmann, L., Lüdemann, E., Schütz, G., & West, M. R. (2007). School accountability, autonomy, choice, and the level of student achievement. Paris: OECD. https://doi.org/10.1787/246402531617.
Young, I. M. (1990). Justice and the politics of difference. Princeton: Princeton University Press.
Acknowledgements
Our involvement in this special issue and in collaborative reflections on Intelligent Accountability with international colleagues has been facilitated by the project [Name of the project deleted for anonymity purposes]. We would also like to thank other members of our Centre for their feedback and invaluable comments on this article, with special thanks to Dr Jacqueline Gysling. Finally, we would like to thank our reviewers for their comments and contributions to this article.
Funding
Funding was provided by CONICYT for the project “A network of research centres around assessment and social justice; SLATE, CIESAS and the Centre for Studies on Educational Assessment” (Grant No. REDES 170112).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Flórez Petour, M.T., Rozas Assael, T. Accountability from a social justice perspective: Criticism and proposals. J Educ Change 21, 157–182 (2020). https://doi.org/10.1007/s10833-019-09361-3
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10833-019-09361-3