Skip to main content
SpringerLink
Log in

Better targeting of consumers: Modeling multifactorial gender and biological sex from Instagram posts

  • Published:
User Modeling and User-Adapted Interaction Aims and scope Submit manuscript

Abstract

Along with the rapidly increasing influence and importance of advertisements and publicity in social networking services (SNS), considerable efforts are being made to provide user-customized services through an understanding of SNS content. Studies on online purchasing patterns based on user attributes have also been conducted; however, these studies used either only experimental methods (e.g., surveys or ethnographic accounts) or simple user attributes (e.g., age, biological sex, and location) for computational user modeling. This paper, through interviews with professional marketers, identifies their needs to understand multifactorial SNS user (potential customers) attributes—gender (i.e., masculine, feminine, androgynous) and biological sex (i.e., male and female) characteristics—for marketing purposes. Based on 33,752 Instagram posts, we develop a deep learning-based, classification model merged with three modalities—image (i.e., VGG16 feature and gesture), text (i.e., linguistic, tag, sentence, and category), and activity (i.e., reply and day). Our model achieves a better performance in classifying three gender types in the male, female, and male + female cases than the traditional machine learning models. Our study results reveal the applicability of identifying gender characteristics from posts in the marketing field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. https://www.statista.com/statistics/325587/instagram-global-age-group.

  2. https://bit.ly/2aliuXW.

  3. https://keras.io/.

References

  • Adali, S., Golbeck, J.: Predicting personality with social behavior. In: 2012 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), pp. 302–309. IEEE (2012)

  • Adalı, S., Golbeck, J.: Predicting personality with social behavior: a comparative study. Soc. Netw. Anal. Min. 4(1), 159 (2014)

    Article  Google Scholar 

  • Al Zamal, F., Liu, W., Ruths, D.: Homophily and latent attribute inference: inferring latent attributes of Twitter users from neighbors. In: Proceedings of the International Conference on Web and Social Media, AAAI (2012)

  • Argamon, S., Koppel, M., Fine, J., Shimoni, A.R.: Gender, genre, and writing style in formal written texts. Text-The Hague Then Amsterdam Then Berlin 23(3), 321–346 (2003)

    Google Scholar 

  • Argamon-Engelson, S., Koppel, M., Avneri, G.: Style-based text categorization: what newspaper am i reading. In: Proceedings of the AAAI Workshop on Text Categorization, pp. 1–4 (1998)

  • Bakan, D.: The Duality of Human Existence: An Essay on Psychology and Religion. Rand McNally, Chicago (1966)

    Google Scholar 

  • Bamman, D., Eisenstein, J., Schnoebelen, T.: Gender identity and lexical variation in social media. J. Socioling. 18(2), 135–160 (2014). https://doi.org/10.1111/josl.12080

    Article  Google Scholar 

  • Bem, S.L.: The measurement of psychological androgyny. J. Consult. Clin. Psychol. 42(2), 155 (1974)

    Article  Google Scholar 

  • Bem, S.L.: Bem Sex Role Inventory: Professional Manual. Consulting Psychologists Press, Palo Alto, CA (1981a)

    Google Scholar 

  • Bem, S.L.: Gender schema theory: a cognitive account of sex typing. Psychol. Rev. 88(4), 354 (1981b)

    Article  Google Scholar 

  • Bem, S.L.: The Lenses of Gender: Transforming the Debate on Sexual Inequality. Yale University Press, New Haven (1993)

    Google Scholar 

  • Bland, J.M., Altman, D.G.: Statistics notes: Cronbach’s alpha. BMJ 314(7080), 572 (1997)

    Article  Google Scholar 

  • Bosnjak, M., Galesic, M., Tuten, T.: Personality determinants of online shopping: explaining online purchase intentions using a hierarchical approach. J. Bus. Res. 60(6), 597–605 (2007)

    Article  Google Scholar 

  • Boulis, C., Ostendorf, M.: A quantitative analysis of lexical differences between genders in telephone conversations. In: Proceedings of the 43rd Annual Meeting on Association for Computational Linguistics, pp. 435–442. Association for Computational Linguistics (2005)

  • Burger, J.D., Henderson, J.C.: An exploration of observable features related to blogger age. In: AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs, pp. 15–20. Menlo Park, CA (2006)

  • Burr, V.: Gender and Social Psychology. Routledge, New York (2002)

    Google Scholar 

  • Burstein, J., Andreyev, S., Lu, C.: Automated essay scoring. US Patent 7,088,949 (2006)

  • Busch, M., Mattheiss, E., Reisinger, M., Orji, R., Fröhlich, P., Tscheligi, M.: More than sex: the role of femininity and masculinity in the design of personalized persuasive games. In: International Conference on Persuasive Technology, pp. 219–229. Springer, Berlin (2016)

  • Chen, H.: College-aged young consumers’ perceptions of social media marketing: the story of Instagram. J. Curr. Issues Res. Advert. 39(1), 22–36 (2018)

    Article  Google Scholar 

  • Datta, R., Joshi, D., Li, J., Wang, J.Z.: Studying aesthetics in photographic images using a computational approach. In: European Conference on Computer Vision, pp. 288–301. Springer, Berlin (2006)

  • De Veirman, M., Cauberghe, V., Hudders, L.: Marketing through Instagram influencers: the impact of number of followers and product divergence on brand attitude. Int. J. Advert. 36(5), 798–828 (2017)

    Article  Google Scholar 

  • Dolliver, M.J.: The impact of gender identity on female offending: a quantitative assessment using the BSRI. Women Crim. Justice 29(2), 73–86 (2019)

    Article  Google Scholar 

  • Donnelly, K., Twenge, J.M.: Masculine and feminine traits on the bem sex-role inventory, 1993–2012: a cross-temporal meta-analysis. Sex Roles 76(9–10), 556–565 (2017)

    Article  Google Scholar 

  • Feiereisen, S., Broderick, A.J., Douglas, S.P.: The effect and moderation of gender identity congruity: utilizing real women advertising images. Psychol. Mark. 26(9), 813–843 (2009)

    Article  Google Scholar 

  • Fischer, E., Arnold, S.J.: More than a labor of love: gender roles and christmas gift shopping. J. Consum. Res. 17(3), 333–345 (1990)

    Article  Google Scholar 

  • Fischer, E., Arnold, S.J.: Sex, gender identity, gender role attitudes, and consumer behavior. Psychol. Mark. 11(2), 163–182 (1994)

    Article  Google Scholar 

  • Flekova, L., Ungar, L., Preotiuc-Pietro, D.: Exploring stylistic variation with age and income on Twitter. In: Proceedings of the Annual Meeting of the Association for Computational Linguistics, pp. 313–319 (2016)

  • Gainer, B.: An empirical investigation of the role of involvement with a gendered product. Psychol. Mark. 10(4), 265–283 (1993)

    Article  Google Scholar 

  • Gao, R., Hao, B., Bai, S., Li, L., Li, A., Zhu, T.: Improving user profile with personality traits predicted from social media content. In: Proceedings of the 7th ACM Conference on Recommender Systems, pp. 355–358. ACM (2013)

  • Garera, N., Yarowsky, D.: Modeling latent biographic attributes in conversational genres. In: Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP, vol. 2, pp. 710–718. Association for Computational Linguistics (2009)

  • Gelli, F., He, X., Chen, T., Chua, T.S.: How personality affects our likes: towards a better understanding of actionable images. In: Proceedings of the 2017 ACM on Multimedia Conference, pp. 1828–1837. ACM (2017)

  • Ginsberg, K.: Instabranding: shaping the personalities of the top food brands on Instagram. Elon J. Undergrad. Res. Commun. 6(1), 78–91 (2015)

    MathSciNet  Google Scholar 

  • Golbeck, J., Robles, C., Edmondson, M., Turner, K.: Predicting personality from Twitter. In: 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust (PASSAT) and 2011 IEEE Third International Conference on Social Computing (SocialCom), pp. 149–156. IEEE (2011)

  • Gou, L., Zhou, M.X., Yang, H.: KnowMe and ShareMe: understanding automatically discovered personality traits from social media and user sharing preferences. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 955–964. ACM (2014)

  • Guido, G.: Shopping motives, big five factors, and the hedonic/utilitarian shopping value: an integration and factorial study. Innov. Mark. 2(2), 57–67 (2006)

    MathSciNet  Google Scholar 

  • Guidotti, R., Monreale, A., Ruggieri, S., Turini, F., Giannotti, F., Pedreschi, D.: A survey of methods for explaining black box models. ACM Comput. Surv. (CSUR) 51(5), 93 (2018)

    Google Scholar 

  • Guo, Y., Liu, M., Gu, T., Wang, W.: Improving photo composition elegantly: considering image similarity during composition optimization. Comput. Graph. Forum 31, 2193–2202 (2012)

    Article  Google Scholar 

  • Haferkamp, N., Eimler, S.C., Papadakis, A.M., Kruck, J.V.: Men are from mars, women are from venus? examining gender differences in self-presentation on social networking sites. Cyberpsychol. Behav. Soc. Netw. 15(2), 91–98 (2012)

    Article  Google Scholar 

  • Han, K., Jo, Y., Jeon, Y., Kim, B., Song, J., Kim, S.W.: Photos don’t have me, but how do you know me?: Analyzing and predicting users on Instagram. In: Adjunct Publication of the 26th Conference on User Modeling, pp. 251–256. ACM, Adaptation and Personalization (2018)

  • Hassan, A.: Do brands targeting women use instamarketing differently: a content analysis. In: Proceedings of the Marketing Management Association, p. 62 (2014)

  • Herring, S.C., Paolillo, J.C.: Gender and genre variation in weblogs. J. Socioling. 10(4), 439–459 (2006)

    Article  Google Scholar 

  • Hoffman, R.M., Borders, L.: Assessment in action. Meas. Eval. Couns. Dev. 34, 39 (2001)

    Article  Google Scholar 

  • Hogg, M.K., Garrow, J.: Gender, identity and the consumption of advertising. Qual. Mark. Res. Int. J. 6(3), 160–174 (2003)

    Article  Google Scholar 

  • Hu, M., Liu, B.: Mining and summarizing customer reviews. In: Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 168–177. ACM (2004)

  • Jaffe, L.J.: Impact of positioning and sex-role identity on women’s responses to advertising. J. Advert. Res. 31(3), 57–64 (1991)

    Google Scholar 

  • Jaffe, L.J., Berger, P.D.: Impact on purchase intent of sex-role identity and product positioning. Psychol. Mark. (1986–1998) 5(3), 259 (1988)

    Google Scholar 

  • Jia, J., Wu, S., Wang, X., Hu, P., Cai, L., Tang, J.: Can we understand van Gogh’s mood?: learning to infer affects from images in social networks. In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 857–860. ACM (2012)

  • Joachims, T.: A probabilistic analysis of the Rocchio algorithm with TFIDF for text categorization. Technical report, Department of Computer Science, Carnegie-Mellon University, Pittsburgh, PA (1996)

  • Johansson, U., Eklöf Wallsbeck, F.: Instagram marketing: when brands want to reach generation y with their communication (2014)

  • Kaplan, A.M., Haenlein, M.: Users of the world, unite! the challenges and opportunities of social media. Bus. Horiz. 53(1), 59–68 (2010)

    Article  Google Scholar 

  • Karpathy, A., Toderici, G., Shetty, S., Leung, T., Sukthankar, R., Fei-Fei, L.: Large-scale video classification with convolutional neural networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1725–1732 (2014)

  • Keller, K.L.: Conceptualizing, measuring, and managing customer-based brand equity. J. Mark. 57, 1–22 (1993)

    Article  Google Scholar 

  • Kempf, D.S., Palan, K.M., Laczniak, R.N.: Laczniak. Gender differences in information processing confidence in an advertising context: a preliminary study. ACR N. Am. Adv. 24(1), 443–449 (1997)

    Google Scholar 

  • Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:14126980 (2014)

  • Kleinbaum, D.G., Dietz, K., Gail, M., Klein, M., Klein, M.: Logistic Regression. Springer, Berlin (2002)

    Google Scholar 

  • Koppel, M., Argamon, S., Shimoni, A.R.: Automatically categorizing written texts by author gender. Lit. Linguist. Comput. 17(4), 401–412 (2002)

    Article  Google Scholar 

  • Kumar, A., Bezawada, R., Rishika, R., Janakiraman, R., Kannan, P.: From social to sale: the effects of firm-generated content in social media on customer behavior. J. Mark. 80(1), 7–25 (2016)

    Article  Google Scholar 

  • Lakoff, R.: Language and woman’s place. Lang. Soc. 2(1), 45–79 (1973)

    Article  MathSciNet  Google Scholar 

  • Lee, E., Lee, J.A., Moon, J.H., Sung, Y.: Pictures speak louder than words: motivations for using Instagram. Cyberpsychol. Behav. Soc. Netw. 18(9), 552–556 (2015)

    Article  Google Scholar 

  • LePage, E.: A long list of Instagram statistics and facts (that prove its importance) (2015). Retrieved 23 March 2016

  • Liaw, A., Wiener, M., et al.: Classification and regression by randomforest. R News 2(3), 18–22 (2002)

    Google Scholar 

  • Lima, A.C.E., De Castro, L.N.: A multi-label, semi-supervised classification approach applied to personality prediction in social media. Neural Netw. 58, 122–130 (2014)

    Article  Google Scholar 

  • Lu, X., Suryanarayan, P., Adams Jr, R.B., Li, J., Newman, M.G., Wang, J.Z.: On shape and the computability of emotions. In: Proceedings of the 20th ACM International Conference on Multimedia, pp. 229–238. ACM (2012)

  • Lubinski, D., Tellegen, A., Butcher, J.N.: The relationship between androgyny and subjective indicators of emotional well-being. J. Pers. Soc. Psychol. 40(4), 722 (1981)

    Article  Google Scholar 

  • Lup, K., Trub, L., Rosenthal, L.: Instagram# instasad?: exploring associations among Instagram use, depressive symptoms, negative social comparison, and strangers followed. Cyberpsychol. Behav. Soc. Netw. 18(5), 247–252 (2015)

    Article  Google Scholar 

  • MagazineB Issue no. 68 Instagram. Magazine (2018). http://magazine-b.com/en/instagram/

  • Martin, H., Finn, S.E.: Masculinity and Femininity in the MMPI-2 and MMPI-A. University of Minnesota Press, Minneapolis (2010)

    Google Scholar 

  • Martin, B.A., Gnoth, J.: Is the marlboro man the only alternative? the role of gender identity and self-construal salience in evaluations of male models. Mark. Lett. 20(4), 353–367 (2009)

    Article  Google Scholar 

  • Matthews, R.A., Merriam, T.V.: Neural computation in stylometry I: an application to the works of Shakespeare and Fletcher. Lit. Linguist. Comput. 8(4), 203–209 (1993)

    Article  Google Scholar 

  • Montavon, G., Samek, W., Müller, K.R.: Methods for interpreting and understanding deep neural networks. Digit. Signal Process. 73, 1–15 (2018)

    Article  MathSciNet  Google Scholar 

  • Mooradian, T.A., Olver, J.M.: Shopping motives and the five factor model: an integration and preliminary study. Psychol. Rep. 78(2), 579–592 (1996)

    Article  Google Scholar 

  • Mowen, J.C.: The 3M Model of Motivation and Personality: Theory and Empirical Applications to Consumer Behavior. Springer, Berlin (2000)

    Book  Google Scholar 

  • Mukherjee, A., Liu, B.: Improving gender classification of blog authors. In: Proceedings of the International Conference on Empirical Methods in Natural Language Processing, pp. 207–217 (2010)

  • Muñoz, C.L., Towner, T.L.: The image is the message: Instagram marketing and the 2016 presidential primary season. J. Polit. Mark. 16(3–4), 290–318 (2017)

    Google Scholar 

  • Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., Ng, A.Y.: Multimodal deep learning. In: Proceedings of the 28th International Conference on Machine Learning (ICML-11), pp. 689–696 (2011)

  • Odekerken-Schröder, G., De Wulf, K., Schumacher, P.: Strengthening outcomes of retailer–consumer relationships: the dual impact of relationship marketing tactics and consumer personality. J. Bus. Res. 56(3), 177–190 (2003)

    Article  Google Scholar 

  • Parsons, T., Bales, R.: Family, Socialization and Interaction Process. The Free Press, Glencoe, IL (1955)

    Google Scholar 

  • Pittman, M., Reich, B.: Social media and loneliness: why an Instagram picture may be worth more than a thousand Twitter words. Comput. Hum. Behav. 62, 155–167 (2016)

    Article  Google Scholar 

  • Radu, V., Tong, C., Bhattacharya, S., Lane, N.D., Mascolo, C., Marina, M.K., Kawsar, F.: Multimodal deep learning for activity and context recognition. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1(4), 157 (2018)

    Article  Google Scholar 

  • Ram, S., Jung, H.-S.: The link between involvement, use innovativeness and product usage. ACR North American Advances (1989)

  • Rao, D., Yarowsky, D., Shreevats, A., Gupta, M.: Classifying latent user attributes in Twitter. In: Proceedings of the 2nd International Workshop on Search and Mining User-Generated Contents, pp 37–44. ACM (2010)

  • Reece, A.G., Danforth, C.M.: Instagram photos reveal predictive markers of depression. EPJ Data Sci. 6(1), 15 (2017)

    Article  Google Scholar 

  • Reilly, D., Neumann, D.L., Andrews, G.: Sex and sex-role differences in specific cognitive abilities. Intelligence 54, 147–158 (2016)

    Article  Google Scholar 

  • Rosen, P.A., Kluemper, D.H.: The impact of the big five personality traits on the acceptance of social networking website. In: AMCIS 2008 proceedings, p. 274 (2008)

  • Rosenthal, S., McKeown, K.: Age prediction in blogs: a study of style, content, and online behavior in pre-and post-social media generations. In: Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics, pp. 763–772 (2011)

  • Schler, J., Koppel, M., Argamon, S., Pennebaker, J.W.: Effects of age and gender on blogging. In: AAAI Spring Symposium: Computational Approaches to Analyzing Weblogs, vol. 6, pp. 199–205 (2006)

  • Schwartz, H.A., Eichstaedt, J.C., Kern, M.L., Dziurzynski, L., Ramones, S.M., Agrawal, M., Shah, A., Kosinski, M., Stillwell, D., Seligman, M.E., et al.: Personality, gender, and age in the language of social media: the open-vocabulary approach. PLoS ONE 8(9), e73791 (2013)

    Article  Google Scholar 

  • Selfhout, M., Burk, W., Branje, S., Denissen, J., Van Aken, M., Meeus, W.: Emerging late adolescent friendship networks and big five personality traits: a social network approach. J. Pers. 78(2), 509–538 (2010)

    Article  Google Scholar 

  • Sheldon, P., Bryant, K.: Instagram: motives for its use and relationship to narcissism and contextual age. Comput. Hum. Behav. 58, 89–97 (2016)

    Article  Google Scholar 

  • Shin, Y., Kim, E.Y.: Affective prediction in photographic images using probabilistic affective model. In: Proceedings of the ACM International Conference on Image and Video Retrieval, pp. 390–397. ACM (2010)

  • Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:14091556 (2014)

  • Szegedy, C., Ioffe, S., Vanhoucke, V., Alemi, A.A.: Inception-v4, inception-resnet and the impact of residual connections on learning. In: Thirty-First AAAI Conference on Artificial Intelligence (2017)

  • Ulrich, I.: The effect of consumer multifactorial gender and biological sex on the evaluation of cross-gender brand extensions. Psychol. Mark. 30(9), 794–810 (2013)

    Article  Google Scholar 

  • Valdez, P., Mehrabian, A.: Effects of color on emotions. J. Exp. Psychol. Gen. 123(4), 394 (1994)

    Article  Google Scholar 

  • Wallis, C.: Performing gender: a content analysis of gender display in music videos. Sex Roles 64(3–4), 160–172 (2011)

    Article  Google Scholar 

  • Wally, E., Koshy, S.: The use of Instagram as a marketing tool by Emirati female entrepreneurs: an exploratory study (2014)

  • Wang, S., Wang, S., Wang, M.T.: Shopping online or not? cognition and personality matters. J. Theor. Appl. Electron. Commer. Res. 1(3), 68–80 (2006)

    Google Scholar 

  • Weinberger, M.G., Swani, K., Yoon, H.J., Gulas, C.S.: Understanding responses to comedic advertising aggression: the role of vividness and gender identity. Int. J. Advert. 36(4), 562–587 (2017)

    Article  Google Scholar 

  • Wu, B., Jia, J., Yang, Y., Zhao, P., Tang, J.: Understanding the emotions behind social images: inferring with user demographics. In: 2015 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE (2015)

  • Yang, Y., Cui, P., Zhu, W., Yang, S.: User interest and social influence based emotion prediction for individuals. In: Proceedings of the 21st ACM International Conference on Multimedia, pp. 785–788. ACM (2013)

  • Yarnell, L.M., Neff, K.D., Davidson, O.A., Mullarkey, M.: Gender differences in self-compassion: examining the role of gender role orientation. Mindfulness 10(6), 1136–1152 (2019)

    Article  Google Scholar 

  • Yoon, H.J., Kim, Y.: The moderating role of gender identity in responses to comedic violence advertising. J. Advert. 43(4), 382–396 (2014)

    Article  Google Scholar 

  • Zhao, S., Gao, Y., Jiang, X., Yao, H., Chua, T.S., Sun, X.: Exploring principles-of-art features for image emotion recognition. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp 47–56. ACM (2014)

Download references

Acknowledgements

This research was supported by the National Research Foundation of Korea (NRF) Grants funded by the Korea government (Ministry of Science and ICT) (NRF-2017M3C4A7083529, 2017R1C1B5017391).

Author information

Authors and Affiliations

  1. Department of Computer Science, Ajou University, Suwon, South Korea

    Youngseung Jeon, Seung Gon Jeon & Kyungsik Han

Authors
  1. Youngseung Jeon
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Seung Gon Jeon
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kyungsik Han
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Kyungsik Han.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jeon, Y., Jeon, S. & Han, K. Better targeting of consumers: Modeling multifactorial gender and biological sex from Instagram posts. User Model User-Adap Inter 30, 833–866 (2020). https://doi.org/10.1007/s11257-020-09260-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11257-020-09260-w

Keywords

Search

Navigation