Skip to main content
SpringerLink
Log in

Data-informed design parameters for adaptive collaborative scripting in across-spaces learning situations

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

This study presents how predictive analytics can be used to inform the formulation of adaptive collaborative learning groups in the context of Computer Supported Collaborative Learning considering across-spaces learning situations. During the study we have collected data from different learning spaces which depicted both individual and collaborative learning activity engagement of students in two different learning contexts (namely the classroom learning and distance learning context) and attempted to predict individual student’s future collaborative learning activity participation in a pyramid-based collaborative learning activity using supervised machine learning techniques. We conducted experimental case studies in the classroom and in distance learning settings, in which real-time predictions of student’s future collaborative learning activity participation were used to formulate adaptive collaborative learner groups. Findings of the case studies showed that the data collected from across-spaces learning scenarios is informative when predicting future collaborative learning activity participation of students hence facilitating the formulation of adaptive collaborative group configurations that adapt to the activity participation differences of students in real-time. Limitations of the proposed approach and future research direction are illustrated.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. http://scikit-learn.org.

References

  • Amarasinghe, I., Hernández-Leo, D., Jonsson, A.: Towards data-informed group formation support across learning spaces. In: International Workshop on Learning Analytics across-spaces (Cross-LAK), 7th International Conference on Learning Analytics & Knowledge (LAK’17) (2017)

  • Baghaei, N., Mitrovic, A., Irwin, W.: Supporting collaborative learning and problem-solving in a constraint-based CSCL environment for UML class diagrams. Int. J. Comput. Supported Collab. Learn. 2(2–3), 159–190 (2007)

    Article  Google Scholar 

  • Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)

    Article  Google Scholar 

  • Cen, L., Ruta, D., Powell, L., Hirsch, B., Ng, J.: Quantitative approach to collaborative learning: performance prediction, individual assessment, and group composition. Int. J. Comput. Supported Collab. Learn. 11(2), 187–225 (2016)

    Article  Google Scholar 

  • Coffrin, C., Corrin, L., de Barba, P., Kennedy, G.: Visualizing patterns of student engagement and performance in MOOCs. In: 4th International Conference on Learning Analytics and Knowledge, pp. 83–92 (2014)

  • Cukurova, M., Luckin, R., Millán, E., Mavrikis, M.: The nispi framework: analysing collaborative problem-solving from students’ physical interactions. Comput. Educ. 116, 93–109 (2018)

    Article  Google Scholar 

  • Dawson, S.: Study of the relationship between student communication interaction and sense of community. Internet High. Education. 9(3), 153–162 (2006)

    Article  Google Scholar 

  • Demetriadis, S., Karakostas, A.: Adaptive collaboration scripting: a conceptual framework and a design case study. In: International Conference on Complex, Intelligent and Software Intensive Systems, IEEE, pp. 487–492 (2008)

  • Demetriadis, S., Karakostas, A., Tsiatsos, T., Caballé, S., Dimitriadis, Y., Weinberger, A., Papadopoulos, P.M., Palaigeorgiou, G., Tsimpanis, C., Hodges, M.: Towards integrating conversational agents and learning analytics in moocs. In: International Conference on Emerging Internetworking, Data & Web Technologies, pp. 1061–1072, Springer (2018)

  • Dillenbourg, P., Tchounikine, P.: Flexibility in macro-scripts for computer-supported collaborative learning. J. Comput. Assist. Learn. 23, 1–13 (2007)

    Article  Google Scholar 

  • Dillenbourg, P., Zufferey, G., Alavi, H., Jermann, P., Do-Lenh, S., Bonnard, Q., Cuendet, S., Kaplan, F.: Classroom orchestration: the third circle of usability. In: CSCL2011 Proceedings, vol. 1, pp. 510–517 (2011)

  • Dyckhoff, A., Lukarov, V., Muslim, A., Chatti, M., Schroeder, U.: Supporting action research with learning analytics. In: 3rd International Conference on Learning Analytics and Knowledge, pp. 220–229 (2013)

  • Ellis, R.A., Goodyear, P.: Spaces of Teaching and Learning: Integrating Perspectives on Research and Practice. Springer, New York (2018)

    Book  Google Scholar 

  • Fall, R., Webb, N.M., Chudowsky, N.: Group discussion and large-scale language arts assessment: effects on students’ comprehension. Am. Educ. Res. J. 37(4), 911–941 (2000)

    Article  Google Scholar 

  • Ferguson, R.: Learning analytics: drivers, developments and challenges. Int. J. Technol. Enhanc. Learn. 4(5–6), 304–317 (2012)

    Article  Google Scholar 

  • Goode, W., Caicedo, G.: Online collaboration: individual involvement used to predict team performance. In: Zaphiris, P., Ioannou, A. (eds.) International Conference on Learning and Collaboration Technologies, pp. 408–416. Springer, New York (2014)

    Google Scholar 

  • Grover, S., Bienkowski, M., Tamrakar, A., Siddiquie, B., Salter, D., Divakaran, A.: Multimodal analytics to study collaborative problem solving in pair programming. In: Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, pp. 516–517, ACM (2016)

  • Hagan, M.T., Demuth, H.B., Beale, M.H., De Jess, O.: Neural Network Design, vol. 20. PWS Pub, Boston (1996)

    Google Scholar 

  • Hernández-Leo, D., Nieves, R., Arroyo, E., Rosales, A., Melero Gallardo, J., Blat, J.: SOS: orchestrating collaborative activities across digital and physical spaces using wearable signaling devices. J. Univers. Comput. Sci. 18(15), 2165–2186 (2012)

    Google Scholar 

  • Karakostas, A., Demetriadis, S.: Enhancing collaborative learning through dynamic forms of support: the impact of an adaptive domain-specific support strategy. J. Comput. Assist. Learn. 27(3), 243–258 (2011)

    Article  Google Scholar 

  • Kloos, C.D., Hernández-Leo, D., Asensio-Pérez, J.I.: Technology for learning across physical and virtual spaces: J. UCS special issue. J. Univers. Comput. Sci. 18(15), 2093–2096 (2012)

    Google Scholar 

  • Kobbe, L., Weinberger, A., Dillenbourg, P., Harrer, A., Hämäläinen, R., Häkkinen, P., Fischer, F.: Specifying computer-supported collaboration scripts. Int. J. Comput. Supported Collab. Learn. 2(2–3), 211–224 (2007)

    Article  Google Scholar 

  • Kollar, I., Fischer, F., Hesse, F.W.: Collaboration scripts-a conceptual analysis. Educ. Psychol. Rev. 18(2), 159–185 (2006)

    Article  Google Scholar 

  • Kotsiantis, S.B., Zaharakis, I., Pintelas, P.: Supervised machine learning: a review of classification techniques. Emerg. Artif. Intellig. Appl. Comput. Eng. 160, 3–24 (2007)

    Google Scholar 

  • Kumar, R., Rosé, C.P., Wang, Y.C., Joshi, M., Robinson, A.: Tutorial dialogue as adaptive collaborative learning support. In: Luckin, R., Kenneth, R., Greer, Jim E. (eds.) International Conference on Artificial Intelligence in Education, pp. 383–390. IOS Press, Amsterdam (2007)

    Google Scholar 

  • Liaw, S., Huang, H.: Enhancing interactivity in web-based instruction: a review of the literature. Educ. Technol. 40(3), 41–45 (2000)

    Google Scholar 

  • Lykourentzou, I., Giannoukos, I., Nikolopoulos, V., Mpardis, G., Loumos, V.: Dropout prediction in e-learning courses through the combination of machine learning techniques. Comput. Educ. 53(3), 950–965 (2009)

    Article  Google Scholar 

  • Manathunga, K., Hernández-Leo, D.: Authoring and enactment of mobile pyramid-based collaborative learning activities. Br. J. Educ. Technol. 49(2), 262–275 (2018)

    Article  Google Scholar 

  • Martinez-Maldonado, R., Yacef, K., Kay, J.: Data mining in the classroom: discovering groups’ strategies at a multi-tabletop environment. In: International Conference on Educational Data Mining, pp. 121–128 (2013)

  • Martinez-Maldonado, R., Pardo, A., Hernández-Leo, D.: Introduction to cross LAK 2016: Learning analytics across spaces. In: First International Workshop on Learning Analytics Across Physical and Digital Spaces co-located with 6th International Conference on Learning Analytics & Knowledge (LAK 2016), CEUR (2016)

  • Martinez-Maldonado, R., Hernandez-Leo, D., Pardo, A., Ogata, H.: 2nd cross-LAK: learning analytics across physical and digital spaces. In: Proceedings of the Seventh International Learning Analytics & Knowledge Conference, pp. 510–511, ACM (2017)

  • McNely, B.J., Gestwicki, P., Hill, J.H., Parli-Horne, P., Johnson, E.: Learning analytics for collaborative writing: a prototype and case study. In: Proceedings of the 2nd International Conference on Learning Analytics and Knowledge, pp. 222–225, ACM (2012)

  • Moreno, J., Ovalle, D.A., Vicari, R.M.: A genetic algorithm approach for group formation in collaborative learning considering multiple student characteristics. Comput. Educ. 58(1), 560–569 (2012)

    Article  Google Scholar 

  • Northrup, P.: A framework for designing interactivity into web-based instruction. Educ. Technol. 41(2), 31–39 (2001)

    Google Scholar 

  • Nyce, C., Cpcu, A.: Predictive Analytics White Paper, pp. 9–10. American Institute for CPCU Insurance Institute of America, Malvern (2007)

    Google Scholar 

  • Olsen, J.K., Aleven, V., Rummel, N.: Predicting student performance in a collaborative learning environment. In: International Conference on Educational Data Mining, ERIC, pp. 211–217 (2015)

  • Prieto, L.P., Martínez-Maldonado, R., Spikol, D., Hernández-Leo, D., Rodríguez-Triana, M.J., Ochoa, X.: Joint proceedings of the sixth multimodal learning analytics (MMLA) workshop and the second cross-LAK workshop. In: CEUR Workshop Proceedings (2017)

  • Prieto, L.P., Sharma, K., Kidzinski, Ł., Dillenbourg, P.: Orchestration load indicators and patterns: in-the-wild studies using mobile eye-tracking. IEEE Trans. Learn. Technol. 11(2), 216–229 (2018)

    Article  Google Scholar 

  • Rafferty, A., Davenport, J., Brunskill, E.: Estimating student knowledge from paired interaction data. In: International Conference on Educational Data Mining, pp. 260–263 (2013)

  • Roschelle, J., Teasley, S.D.: The construction of shared knowledge in collaborative problem solving. In: O’Malley, C.E. (ed.) Computer Supported Collaborative Learning, pp. 69–97. Springer, New York (1995)

    Chapter  Google Scholar 

  • Rummel, N., Spada, H.: Can people learn computer-mediated collaboration by following a script? In: Fischer, F., Kollar, I., Mandl, H., Haake, J.M. (eds.) Scripting Computer-Supported Collaborative Learning, pp. 39–55. Springer, Boston (2007)

    Chapter  Google Scholar 

  • Rummel, N., Weinberger, A., Wecker, C., Fischer, F., Meier, A., Voyiatzaki, E., Kahrimanis, G., Spada, H., Avouris, N., Walker, E., et al.: New challenges in CSCL: towards adaptive script support. In: Proceedings of the 8th International Conference on International Conference for the Learning Sciences, vol. 3, pp. 338–345. International Society of the Learning Sciences (2008)

  • Sanz-Martínez, L., Martínez-Monés, A., Bote-Lorenzo, M.L., Muñoz-Cristóbal, J.A., Dimitriadis, Y.: Automatic group formation in a MOOC based on students’ activity criteria. In: European Conference on Technology Enhanced Learning, Springer, pp. 179–193 (2017)

  • Soller, A.: Computational modeling and analysis of knowledge sharing in collaborative distance learning. User Model. User Adapt. Interact. 14(4), 351–381 (2004)

    Article  Google Scholar 

  • Spikol, D., Ruffaldi, E., Dabisias, G., Cukurova, M.: Supervised machine learning in multimodal learning analytics for estimating success in project-based learning. J. Comput. Assist. Learn. 34(4), 366–377 (2018)

    Article  Google Scholar 

  • Spoelstra, H., Van Rosmalen, P., Houtmans, T., Sloep, P.: Team formation instruments to enhance learner interactions in open learning environments. Comput. Hum. Behav. 45, 11–20 (2015)

    Article  Google Scholar 

  • Stahl, G., Koschmann, T., Suthers, D.: Computer-supported collaborative learning: an historical perspective. In: Sawyer, R.K. (ed.) Cambridge Handbook of the Learning Sciences, vol. 2006, pp. 409–426. Cambridge University Press, Cambridge (2006)

    Google Scholar 

  • Taylor, C., Veeramachaneni, K., O’Reilly, U.M.: Likely to stop? Predicting stopout in massive open online courses. arXiv preprint arXiv:1408.3382 (2014)

  • Tissenbaum, M., Slotta, J.D.: Scripting and orchestration of learning across contexts: a role for intelligent agents and data mining. In: Wong, L.H., Milrad, M., Specht, M. (eds.) Seamless Learning in the Age of Mobile Connectivity, pp. 223–257. Springer, Singapore (2015)

    Google Scholar 

  • Tsovaltzi, D., Judele, R., Puhl, T., Weinberger, A.: Scripts, individual preparation and group awareness support in the service of learning in facebook: how does CSCL compare to social networking sites? Comput. Hum. Behav. 53, 577–592 (2015)

    Article  Google Scholar 

  • Vapnik, V.: The Nature of Statistical Learning Theory. Springer-Verlag, New York (2013)

    MATH  Google Scholar 

  • Villasclaras-Fernández, E.D., Hernández-Gonzalo, J.A., Hernández Leo, D., Asensio-Pérez, J.I., Dimitriadis, Y., Martínez-Monés, A.: Instancecollage: a tool for the particularization of collaborative IMS-LD scripts. J. Educ. Technol. Soc. 12(4), 56–70 (2009)

    Google Scholar 

  • Walker, E., Rummel, N., Koedinger, K.R.: CTRL: a research framework for providing adaptive collaborative learning support. User Model. User Adapt. Interact. 19(5), 387–431 (2009)

    Article  Google Scholar 

  • Walker, E., Rummel, N., Koedinger, K.R.: Adaptive intelligent support to improve peer tutoring in algebra. Int. J. Artif. Intell. Educ. 24(1), 33–61 (2014)

    Article  Google Scholar 

  • Waller, M.A., Fawcett, S.E.: Data science, predictive analytics, and big data: a revolution that will transform supply chain design and management. J. Bus. Logist. 34(2), 77–84 (2013)

    Article  Google Scholar 

  • Weinberger, A., Stegmann, K., Fischer, F., Mandl, H.: Scripting argumentative knowledge construction in computer-supported learning environments. In: Fischer, F., Kollar, I., Mandl, H., Haake, J.M. (eds.) Scripting Computer-Supported Collaborative Learning, pp. 191–211. Springer, Boston (2007)

    Chapter  Google Scholar 

  • Xing, W., Guo, R., Petakovic, E., Goggins, S.: Participation-based student final performance prediction model through interpretable genetic programming: integrating learning analytics, educational data mining and theory. Comput. Hum. Behav. 47, 168–181 (2015)

    Article  Google Scholar 

  • Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation-based filter solution. In: Proceedings of the 20th International Conference on Machine Learning (ICML-03), pp. 856–863 (2003)

Download references

Acknowledgements

This work has been partially funded by FEDER, the National Research Agency of the Spanish Ministry of Science, Innovations and Universities MDM-2015-0502, TIN2014-53199-C3-3-R, TIN2017-85179-C3-3-R and “la Caixa Foundation” (CoT project, 100010434). DHL is a Serra Húnter Fellow.

Author information

Authors and Affiliations

  1. ICT Department, Universitat Pompeu Fabra, Roc Boronat, 138, 08018, Barcelona, Spain

    Ishari Amarasinghe, Davinia Hernández-Leo & Anders Jonsson

Authors
  1. Ishari Amarasinghe
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Davinia Hernández-Leo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anders Jonsson
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ishari Amarasinghe.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This paper or a similar version is not currently under review by a journal or conference. This paper is void of plagiarism or self-plagiarism as defined by the Committee on Publication Ethics and Springer Guidelines.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amarasinghe, I., Hernández-Leo, D. & Jonsson, A. Data-informed design parameters for adaptive collaborative scripting in across-spaces learning situations. User Model User-Adap Inter 29, 869–892 (2019). https://doi.org/10.1007/s11257-019-09233-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-019-09233-8

Keywords

Search

Navigation