Skip to main content
Log in

Effects of personal characteristics in control-oriented user interfaces for music recommender systems

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Music recommender systems typically offer a “one-size-fits-all” approach with the same user controls and visualizations for all users. However, the effectiveness of interactive interfaces for music recommender systems is likely to be affected by individual differences. In this paper, we first conduct a comprehensive literature review of interactive interfaces in recommender systems to motivate the need for personalized interaction with music recommender systems, and two personal characteristics,  visual memory and musical sophistication. More specifically, we studied the influence of these characteristics on the design of (a) visualizations for enhancing recommendation diversity and (b) the optimal level of user controls while minimizing cognitive load. The results of three experiments show a benefit for personalizing both visualization and control elements to musical sophistication. We found that (1) musical sophistication influenced the acceptance of recommendations for user controls. (2) musical sophistication also influenced recommendation acceptance, and perceived diversity for visualizations and the UI combining user controls and visualizations. However, musical sophistication only strengthens the impact of UI on perceived diversity (moderation effect) when studying the combined effect of controls and visualizations. These results allow us to extend the model for personalization in music recommender systems by providing guidelines for interactive visualization design for music recommender systems, with regard to both visualizations and user control.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Similar content being viewed by others

Notes

  1. https://www.gold.ac.uk/music-mind-brain/gold-msi/, accessed June 2018.

  2. http://www.chambers.co.uk.

  3. https://humansystems.arc.nasa.gov/groups/tlx.

  4. https://developer.spotify.com/web-api/get-recommendations, accessed June 2018.

  5. https://developer.spotify.com/web-api/get-recommendations/#tablepress-220., accessed June 2018.

  6. https://api.spotify.com/v1/me/top , retrieved July 2018.

  7. https://api.spotify.com/v1/recommendations , retrieved July 2018.

  8. http://www.gold.ac.uk/music-mind-brain/gold-msi/, accessed June 2018.

  9. https://www.humanbenchmark.com/tests/memory, accessed June 2018.

  10. https://developer.spotify.com/web-api, accessed June 2018.

  11. https://humansystems.arc.nasa.gov/groups/tlx.

  12. AVE is short for average variance extracted. For a given factor, it is the average of the \(R^2\) values of the factor’s question items.

  13. http://lavaan.ugent.be/, accessed August 2019.

  14. https://d3js.org/, accessed June 2018.

  15. http://lavaan.ugent.be/, accessed February 2019.

  16. http://lavaan.ugent.be/, accessed February 2019.

  17. https://cran.r-project.org/web/packages/rockchalk/index.html.

  18. We note that the result for perceived diversity in Experiment 1 was inconclusive as the item did not fit.

References

  • Alba, J.W., Hutchinson, J.W.: Dimensions of consumer expertise. J. Consum. Res. 13(4), 411–454 (1987)

    Article  Google Scholar 

  • Aljukhadar, M., Senecal, S., Daoust, C.E.: Using recommendation agents to cope with information overload. Int. J. Electron. Commer. 17(2), 41–70 (2012)

    Article  Google Scholar 

  • Al-Maskari, A., Sanderson, M.: The effect of user characteristics on search effectiveness in information retrieval. Inform. Process. Manag. 47(5), 719–729 (2011)

    Article  Google Scholar 

  • Andjelkovic, I., Parra, D., O’Donovan, J.: Moodplay: interactive mood-based music discovery and recommendation. In: Proceedings of UMAP’16, pp. 275–279. ACM (2016)

  • Aykin, N.M., Aykin, T.: Individual differences in human–computer interaction. Comput. Ind. Eng. 20(3), 373–379 (1991)

    Article  Google Scholar 

  • Bakalov, F., Meurs, M.J., König-Ries, B., Sateli, B., Witte, R., Butler, G., Tsang, A.: An approach to controlling user models and personalization effects in recommender systems. In: Proceedings of IUI’13, pp. 49–56. ACM (2013)

  • Blair, A.: Chapter 14: Mediation and moderation. https://ademos.people.uic.edu/Chapter14.html (2019). Accessed 7 Mar 2019

  • Bogdanov, D., Haro, M., Fuhrmann, F., Xambó, A., Gómez, E., Herrera, P.: Semantic audio content-based music recommendation and visualization based on user preference examples. Inform. Process. Manag. 49(1), 13–33 (2013)

    Article  Google Scholar 

  • Bostandjiev, S., O’Donovan, J., Höllerer, T.: Tasteweights: a visual interactive hybrid recommender system. In: Proceedings of RecSys’12, pp. 35–42. ACM (2012)

  • Bostandjiev, S., O’Donovan, J., Höllerer, T.: LinkedVis: exploring social and semantic career recommendations. In: Proceedings of the 2013 International Conference on Intelligent User Interfaces, pp. 107–116. ACM (2013)

  • Bradford, G.R.: A relationship study of student satisfaction with learning online and cognitive load: Initial results. Internet High. Educ. 14(4), 217–226 (2011)

    Article  Google Scholar 

  • Brusilovsky, P., Millán, E.: User models for adaptive hypermedia and adaptive educational systems. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web, pp. 3–53. Springer, New York (2007)

    Chapter  Google Scholar 

  • Carenini, G., Conati, C., Hoque, E., Steichen, B., Toker, D., Enns, J.: Highlighting interventions and user differences: informing adaptive information visualization support. In: Proceedings of the 32nd Annual ACM Conference on Human Factors in Computing Systems, pp. 1835–1844. ACM (2014)

  • Champiri, Z.D., Shahamiri, S.R., Salim, S.S.B.: A systematic review of scholar context-aware recommender systems. Exp. Syst. Appl. 42(3), 1743–1758 (2015)

    Article  Google Scholar 

  • Chandler, P., Sweller, J.: Cognitive load theory and the format of instruction. Cognit. Instr. 8(4), 293–332 (1991)

    Article  Google Scholar 

  • Chen, L., Pu, P.: Critiquing-based recommenders: survey and emerging trends. UMUAI 22(1–2), 125–150 (2012)

    Google Scholar 

  • Chen, P.I., Liu, J.Y., Yang, Y.H.: Personal factors in music preference and similarity: user study on the role of personality traits. In: Proceedings of International Symposium on Computer Music Multidisciplinary Research (CMMR) (2015)

  • Chen, H., Parra, D., Verbert, K.: Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Exp. Syst. Appl. 56, 9–27 (2016)

    Article  Google Scholar 

  • Chernev, A.: When more is less and less is more: the role of ideal point availability and assortment in consumer choice. J. Consum. Res. 30(2), 170–183 (2003)

    Article  Google Scholar 

  • Conati, C., Carenini, G., Hoque, E., Steichen, B., Toker, D.: Evaluating the impact of user characteristics and different layouts on an interactive visualization for decision making. Comput. Graph. Forum 33, 371–380 (2014)

    Article  Google Scholar 

  • Conati, C., Carenini, G., Toker, D., Lallé, S.: Towards user-adaptive information visualization. In: Proceedings of AAAI’15, pp. 4100–4106. AAAI Press (2015)

  • Dawson, J.F.: Moderation in management research: what, why, when, and how. J. Bus. Psychol. 29(1), 1–19 (2014)

    Article  Google Scholar 

  • de Vries, P.W.: Trust in systems: effects of direct and indirect information. Technische Universiteit Eindhoven (2004)

  • Domik, G.O., Gutkauf, B.: User modeling for adaptive visualization systems. In: Proceedings and IEEE Conference on Visualization, 1994 (Visualization’94), pp. 217–223. IEEE (1994)

  • Ferwerda, B., Graus, M.: Predicting musical sophistication from music listening behaviors: a preliminary study. arXiv preprint arXiv:180807314 (2018)

  • Ferwerda, B., Yang, E., Schedl, M., Tkalcic, M.: Personality traits predict music taxonomy preferences. In: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2241–2246. ACM (2015)

  • Ferwerda, B., Tkalcic, M., Schedl, M.: Personality traits and music genre preferences: How music taste varies over age groups. In: 1st Workshop on Temporal Reasoning in Recommender Systems (RecTemp) at the 11th ACM Conference on Recommender Systems, Como, August 31, 2017, vol. 1922, pp. 16–20. ACM Digital Library (2017a)

  • Ferwerda, B., Tkalcic, M., Schedl, M.: Personality traits and music genres: What do people prefer to listen to? In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, pp. 285–288. ACM (2017b)

  • Fitzsimons, G.J., Lehmann, D.R.: Reactance to recommendations: when unsolicited advice yields contrary responses. Market. Sci. 23(1), 82–94 (2004)

    Article  Google Scholar 

  • Gauch, S., Speretta, M., Chandramouli, A., Micarelli, A.: User profiles for personalized information access. In: Brusilovsky, P., Kobsa, A., Nejdl, W. (eds.) The Adaptive Web, pp. 54–89. Springer, New York (2007)

    Chapter  Google Scholar 

  • Gena, C., Brogi, R., Cena, F., Vernero, F.: The impact of rating scales on user’s rating behavior. In: Proceedings of UMAP’11, pp. 123–134. Springer, New York (2011)

  • He, C., Parra, D., Verbert, K.: Interactive recommender systems: a survey of the state of the art and future research challenges and opportunities. Exp. Syst. Appl. 56, 9–27 (2016)

    Article  Google Scholar 

  • Herlocker, J.L., Konstan, J.A., Riedl, J.: Explaining collaborative filtering recommendations. In: Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 241–250. ACM (2000)

  • Hilliges, O., Holzer, P., Klüber, R., Butz, A.: Audioradar: A metaphorical visualization for the navigation of large music collections. In: International Symposium on Smart Graphics, pp. 82–92. Springer, New York (2006)

  • Hu, R., Pu, P.: Enhancing recommendation diversity with organization interfaces. In: Proceedings of IUI’11, pp. 347–350. ACM (2011)

  • Inoue, S., Aoyama, H., Nakata, K.: Cognitive analysis for knowledge modeling in air traffic control work. In: International Conference on Human–Computer Interaction, pp. 341–350. Springer, New York (2011)

  • Jin, Y., Seipp, K., Duval, E., Verbert, K.: Go with the flow: effects of transparency and user control on targeted advertising using flow charts. In: Proceedings of AVI’16, pp. 68–75. ACM (2016)

  • Jin, Y., Cardoso, B., Verbert, K.: How do different levels of user control affect cognitive load and acceptance of recommendations? In: Proceedings of IntRS Co-located with RecSys’17, CEUR-WS, pp. 35–42 (2017)

  • Jin, Y., Tintarev, N., Verbert, K.: Effects of individual traits on diversity-aware music recommender user interfaces. In: Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization, pp. 291–299 . ACM (2018a)

  • Jin, Y., Tintarev, N., Verbert, K.: Effects of personal characteristics on music recommender systems with different levels of controllability. In: Proceedings of the 12th ACM Conference on Recommender Systems, pp. 13–21 . ACM (2018b)

  • Judd, C.M., Kenny, D.A., McClelland, G.H.: Estimating and testing mediation and moderation in within-subject designs. Psychol. Methods 6(2), 115 (2001)

    Article  Google Scholar 

  • Jugovac, M., Jannach, D., Lerche, L.: Efficient optimization of multiple recommendation quality factors according to individual user tendencies. Exp. Syst. Appl. 81, 321–331 (2017)

    Article  Google Scholar 

  • Kamehkhosh, I., Jannach, D.: User perception of next-track music recommendations. In: Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, pp. 113–121. ACM (2017)

  • Kim, H., Choo, J., Park, H., Endert, A.: Interaxis: steering scatterplot axes via observation-level interaction. IEEE TVCG’16 22(1), 131–140 (2016)

    Google Scholar 

  • Kittur, A., Chi, E.H., Suh, B.: Crowdsourcing user studies with mechanical Turk. In: Proceedings of CHI’08, pp. 453–456. ACM (2008)

  • Knees, P., Schedl, M., Pohle, T., Widmer, G.: Exploring music collections in virtual landscapes. IEEE Multimed. 14(3), 46–54 (2007)

    Article  Google Scholar 

  • Knijnenburg, B.P., Reijmer, N.J., Willemsen, M.C.: Each to his own: how different users call for different interaction methods in recommender systems. In: Proceedings of RecSys’11, pp. 141–148. ACM (2011)

  • Knijnenburg, B.P., Willemsen, M.C., Gantner, Z., Soncu, H., Newell, C.: Explaining the user experience of recommender systems. UMUAI 22(4–5), 441–504 (2012)

    Google Scholar 

  • Komiak, S.Y., Benbasat, I.: The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS Q. 30(4), 941–960 (2006)

    Article  Google Scholar 

  • Konstan, J.A., Riedl, J.: Recommender systems: from algorithms to user experience. UMUAI’12 22(1), 101–123 (2012)

    Google Scholar 

  • Kramer, T.: The effect of measurement task transparency on preference construction and evaluations of personalized recommendations. J. Market. Res. 44(2), 224–233 (2007)

    Article  Google Scholar 

  • Lallé, S., Conati, C., Carenini, G.: Impact of individual differences on user experience with a visualization interface for public engagement. In: Proceedings of UMAP’17, pp. 247–252. ACM (2017)

  • Lee, J.H., Kim, Y.S., Hubbles, C.: A look at the cloud from both sides now: an analysis of cloud music service usage. In: ISMIR, pp. 299–305 (2016)

  • Lekkas, Z., Tsianos, N., Germanakos, P., Mourlas, C., Samaras, G.: The effects of personality type in user-centered appraisal systems. In: International Conference on Human–Computer Interaction, pp. 388–396. Springer, New York (2011)

  • Mayer, R.E., Moreno, R.: Nine ways to reduce cognitive load in multimedia learning. Educ. Psychol. 38(1), 43–52 (2003)

    Article  Google Scholar 

  • McCarthy, K., Salem, Y., Smyth, B.: Experience-based critiquing: Reusing critiquing experiences to improve conversational recommendation. In: Proceedings of ICCBR’10, pp. 480–494. Springer, New York (2010)

  • Millecamp, M., Htun, N.N., Jin, Y., Verbert, K.: Controlling spotify recommendations: effects of personal characteristics on music recommender user interfaces. In: Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization, pp. 101–109. ACM (2018)

  • Millecamp, M., Htun, N.N., Conati, C., Verbert, K.: To explain or not to explain: the effects of personal characteristics when explaining music recommendations. In: Proceedings of the 2019 Conference on Intelligent User Interface, pp. 1–12. ACM (2019)

  • Müllensiefen, D., Gingras, B., Musil, J., Stewart, L.: The musicality of non-musicians: an index for assessing musical sophistication in the general population. PloS One 9(2), e89642 (2014)

    Article  Google Scholar 

  • O’Donovan, J., Smyth, B., Gretarsson, B., Bostandjiev, S., Höllerer, T.: PeerChooser: visual interactive recommendation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1085–1088. ACM (2008)

  • Pampalk, E., Rauber, A., Merkl, D.: Content-based organization and visualization of music archives. In: Proceedings of the Tenth ACM International Conference on Multimedia, pp. 570–579. ACM (2002)

  • Parra, D., Brusilovsky, P.: User-controllable personalization: a case study with setfusion. IJHCS 78, 43–67 (2015)

    Google Scholar 

  • Perera, R.E.: Optimizing human-computer interaction for the electronic commerce environment. J. Electron Commer. Res. 1(1), 23–44 (2000)

    Google Scholar 

  • Perik, E., De Ruyter, B., Markopoulos, P., Eggen, B.: The sensitivities of user profile information in music recommender systems. In: Proceedings of Private, Security, Trust, pp. 137–141 (2004)

  • Pommeranz, A., Broekens, J., Wiggers, P., Brinkman, W.P., Jonker, C.M.: Designing interfaces for explicit preference elicitation: a user-centered investigation of preference representation and elicitation process. UMUAI 22(4–5), 357–397 (2012)

    Google Scholar 

  • Pu, P., Chen, L., Hu, R.: A user-centric evaluation framework for recommender systems. In: Proceedings of RecSys’11, pp. 157–164. ACM (2011)

  • Randall, T., Terwiesch, C., Ulrich, K.T.: Research note-user design of customized products. Market. Sci. 26(2), 268–280 (2007)

    Article  Google Scholar 

  • Saito, Y., Itoh, T.: Musicube: a visual music recommendation system featuring interactive evolutionary computing. In: Proceedings of VINCI’11, p. 5. ACM (2011)

  • Schaffer, J., Höllerer, T., O’Donovan, J.: Hypothetical recommendation: a study of interactive profile manipulation behavior for recommender systems. In: FLAIRS Conference, pp. 507–512 (2015)

  • Schedl, M., Zamani, H., Chen, C.W., Deldjoo, Y., Elahi, M.: Current challenges and visions in music recommender systems research. Int. J. Multimed. Inform. Retr. 7(2), 95–116 (2018)

    Article  Google Scholar 

  • Sweller, J.: Cognitive load during problem solving: effects on learning. Cognit. Sci. 12(2), 257–285 (1988)

    Article  Google Scholar 

  • Tintarev, N., Dennis, M., Masthoff, J.: Adapting recommendation diversity to openness to experience: a study of human behaviour. In: Proceedings of UMAP’13, pp. 190–202. Springer, New York (2013)

  • Tintarev, N., Masthoff, J.: Effects of individual differences in working memory on plan presentational choices. Front. Psychol. 7, 1793 (2016). https://www.frontiersin.org/articles/10.3389/fpsyg.2016.01793/bibTex

  • Tintarev, N.: Presenting diversity aware recommendations: making challenging news acceptable. In: Proceedings of FATREC’17 (2017)

  • Tkalcic, M., Kunaver, M., Tasic, J., Košir, A.: Personality based user similarity measure for a collaborative recommender system. In: Proceedings of the 5th Workshop on Emotion in Human–Computer Interaction-Real world challenges, pp. 30–37 (2009)

  • Tkalcic, M., Kunaver, M., Košir, A., Tasic, J.: Addressing the new user problem with a personality based user similarity measure. In: First International Workshop on Decision Making and Recommendation Acceptance Issues in Recommender Systems (DEMRA 2011), p. 106 (2011)

  • Toker, D., Conati, C., Carenini, G., Haraty, M.: Towards adaptive information visualization: on the influence of user characteristics. In: International Conference on User Modeling, Adaptation, and Personalization, pp. 274–285. Springer, New York (2012)

  • Torrens, M., Hertzog, P., Arcos, J.L.: Visualizing and exploring personal music libraries. In: ISMIR (2004)

  • Tsai, C.H., Brusilovsky, P.: Enhancing recommendation diversity through a dual recommendation interface. In: Proceedings of RecSys IntRS’17, p. 10 (2017)

  • Verbert, K., Parra, D., Brusilovsky, P., Duval, E.: Visualising recommendations to support exploration, transparency and controllability. In: Proceedings of IUI’13, pp. 351–362. ACM (2013)

  • Viegas, F.B., Wattenberg, M., Van Ham, F., Kriss, J., McKeon, M.: Manyeyes: a site for visualization at internet scale. IEEE TVCG 13(6), 1121–1128 (2007)

    Google Scholar 

  • Wong, D., Faridani, S., Bitton, E., Hartmann, B., Goldberg, K.: The diversity donut: enabling participant control over the diversity of recommended responses. In: Proceedings of CHI EA’11, pp. 1471–1476. ACM (2011)

  • Zhang, X., Chignell, M.: Assessment of the effects of user characteristics on mental models of information retrieval systems. J. Assoc. Inform. Sci. Technol. 52(6), 445–459 (2001)

    Article  Google Scholar 

  • Zhao, Q., Adomavicius, G., Harper, F.M., Willemsen, M., Konstan, J.A.: Toward better interactions in recommender systems: cycling and serpentining approaches for top-n item lists. In: Proceedings of CSCW’17, pp. 1444–1453. ACM (2017)

  • Ziegler, C.N., McNee, S.M., Konstan, J.A., Lausen, G.: Improving recommendation lists through topic diversification. In: Proceedings WWW’05, pp. 22–32. ACM (2005)

Download references

Acknowledgements

This research has been supported by the KU Leuven Research Council (grant agreement C24/16/017).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yucheng Jin.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jin, Y., Tintarev, N., Htun, N.N. et al. Effects of personal characteristics in control-oriented user interfaces for music recommender systems. User Model User-Adap Inter 30, 199–249 (2020). https://doi.org/10.1007/s11257-019-09247-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-019-09247-2

Keywords

Navigation