Similarities Between Ranking and Rating Measures of Values Preferences
Evidence From a Latent Class Segmentation Approach
Abstract
Abstract. The form-resistant hypothesis states that alternative ways of measuring the same values should be small if method-specific features are taken into account. However, previous research that compared rating and ranking questionnaires for measuring values has shown mixed results. We suggest that adopting a latent class segmentation approach helps to explain these mixed results by identifying segments with similar item preference structures and segments linked to one format only. Our approach is applied to a Dutch survey on work values. In both ranking and rating mode, we find two similar segments reflecting the intrinsic and extrinsic preference structure, while other segments differed between modes. In line with the modified form-resistant hypothesis, the results suggest the same latent preference structure has guided particular segments in a population to respond similarly to rating and ranking questions.
References
(1985). The measurement of values in surveys: A comparison of ratings and rankings. Public Opinion Quarterly, 49, 535–552. doi: 10.1086/268949
(1989).
Latent class models for the analysis of rankings . In G. de SoeteH. FegerK. C. KlauerEds., New developments in psychological choice modeling (pp. 99–121). Amsterdam, The Netherlands: Elsevier Science.(2004).
European work orientations at the end of the twentieth century . In W. ArtsL. HalmanEds., European values at the turn of the millenium (pp. 255–279). Leiden, The Netherlands/Boston, MA: Brill.(2007). The work values of first-year college students: Exploring group differences. Career Development Quarterly, 55, 359–364. doi: 10.1002/j.2161-0045.2007.tb00090.x
(1984). Facets of work values: A structural analysis of work outcomes. The Journal of Applied Psychology, 69, 379–389. doi: 10.1037/0021-9010.69.3.379
(1994). Gender and work values: A comparative analysis. The Journal of Social Psychology, 134, 201–212. doi: 10.1080/00224545.1994.9711383
(1991). The structure of work values: A cross-cultural comparison. Journal of Organizational Behavior, 12, 21–38. doi: 10.1002/job.4030120103
(2005). A cross-cultural investigation into the relationships between personality traits and work values. The Journal of Psychology, 139, 5–32. doi: 10.3200/JRLP.139.1.5-32
(1990). Categorical longitudinal data: Log-linear panel, trend, and cohort analysis. Newbury Park, CA: Sage.
(1996). Individualization and the fragmentation of work values: Evidence from the European Values Study. WORC-Paper 96.07.013. Tilburg, The Netherlands: WORC – Work and Organization Research Centre.
(1980). The factor analysis of ipsative measures. Sociological Methods & Research, 9, 218–238. doi: 10.1177/004912418000900206
(1977). Work values and job rewards: A theory of job satisfaction. American Sociological Review, 42, 124–143. Retrieved from http://www.jstor.org/stable/2117735
(2011). Structure and/or culture: Explaining racial differences in work values. Journal of Black Studies, 42, 638–664. doi: 10.1177/0021934710390692
(1994). Work values and job satisfaction. The Journal of Psychology, 128, 683–690. doi: 10.1080/00223980.1994.9921297
(1987). An evaluation of a cognitive theory of response-order effects in survey measurement. Public Opinion Quarterly, 51, 201–219. doi: 10.1086/269029
(1988). A test of the form-resistant correlation hypothesis: Ratings, rankings, and the measurement of values. Public Opinion Quarterly, 52, 526–538. doi: 10.1086/269128
(2003). New developments in latent class choice modeling. In Proceedings Sawtooth Software Conference 2003, (pp. 89–112). https://www.sawtoothsoftware.com/download/techpap/2003Proceedings.pdf
(2006).
Use of latent class regression models with a random intercept to remove the effects of the overall response rating level . In A. RizziM. VichiEds., COMPSTAT 2006: Proceedings in Computational Statistics (pp. 351–360). Heidelberg, Germany: Springer(1996). Rankings, ratings, and the measurement of values: Evidence for the superior validity of ratings. Basic and Applied Social Psychology, 18, 171–181. doi: 10.1207/s15324834basp1802_4
(2000). The measurement of personal values in survey research: A test of alternative rating procedures. Public Opinion Quarterly, 64, 271–298. doi: 10.1086/317989
(1986). The choice theory approach to marketing research. Marketing Science, 5, 275–297. doi: 10.1287/mksc.5.4.275
(2000). Mixed MNL models for discrete response. Journal of Applied Econometrics, 15, 447–470. doi: 10.1002/1099-1255
(2010). Ranking the ratings: A latent-class regression model to control for overall agreement in opinion research. International Journal of Public Opinion Research, 22, 93–119. doi: 10.1093/ijpor/edp036
(2016). Two of a kind. Similarities between ranking and rating data in measuring work values. Survey Research Methods, 10, 15–33. doi: 10.18148/srm/2016.v10i1.6209
(2004). Ratings and rankings: Reconsidering the structure of values and their measurement. International Journal of Social Research Methodology, 7, 403–414. doi: 10.1080/1364557032000081654
Parsons, T.Shils, E. A. (Eds.). (1962). Toward a general theory of action. New York, NY: Harper.
(1987). Effect of values on perception and decision making: A study of alternative work value measures. The Journal of Applied Psychology, 72, 666–673. doi: 10.1037/0021-9010.72.4.666
(1973). The nature of human values. New York, NY: The Free Press.
(1999). Basic individual values, work values, and the meaning of work. Applied Psychology: An International Review, 48, 49–71. doi: 10.1111/j.1464-0597.1999.tb00048.x
(2010).
“True” longitudinal and probability-based internet panels: Evidence from the Netherlands . In M. DasP. EsterL. KaczmirekEds., Social and behavioral research and the Internet: Advances in applied methods and research strategies (pp. 77–104). Boca Raton, FL: Taylor & Francis.(1962). The structure of work values in relation to status, achievement, interests, and adjustment. The Journal of Applied Psychology, 46, 231–239. doi: 10.1037/h0040109
(2005). Latent GOLD choice 4.0 user’s guide. Belmont, MA: Statistical Innovations.
(2015). Controlling for response order effects in ranking items using latent choice factor modeling. Sociological Methods & Research, 46, 218–241. doi: 10.1177/0049124115588997
