Abstract
Social desirability bias is a major threat to data quality for survey studies, particularly studies involving sensitive questions, such as age, income, sexual behaviors, and drug use. In this chapter, we introduced a construal level theory (CLT)-based method we devised to reduce social desirability bias. Construals are our mental constructions of the universe organized in hierarchies along with spatiotemporal and psychosocial distances, with self, here, and now as the reference. Answering sensitive question regarding self is often executed at low construal levels subjected to contextual factors. In this case, the respondent tend to edit the answer to make it socially desirable either to avoid penalty or to enhance reward. In contrast, answering sensitive questions for others is often executed at high construal levels, less likely to subject to contextual factors but more dependent on one’s own knowledge, attitudes and beliefs. CLT-based method is a technique based on this theory by asking participants to answer the same questions for 2–3 socially distant others. In this study, we reported our work on building the method through three studies, one with data collected from college students in the US, two with data collected in China, including one sample of urban residents and another sample of rural residents. Four questions (reading newspaper, engaging in physical activity, frequent of sexual intercourse and attitudes toward homosexuality) were used in the college student study conducted in the US; the Brief Sexual Openness Scale (BSOS) was used in the two studies conducted in China. The use of the method and future research are also recommended.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Achenbach, T. M., Mcconaughy, S. H., & Howell, C. T. (1987). Child adolescent behavioral and emotional-problems - implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101(2), 213–232. https://doi.org/10.1037//0033-2909.101.2.213
Achenbach, T. M., & Ruffle, T. M. (2000). The Child Behavior Checklist and related forms for assessing behavioral/emotional problems and competencies. Pediatrics in Review, 21(1), 265–271.
Albaum, G., Roster, C. A., & Smith, S. M. (2012). A cross national study of topic sensitivity: Implications for web-based surveys. Journal of Marketing Development and Competitiveness, 6(5), 71–82.
Bajtelsmit, J. W. (1979). Convergent and discriminant validation of chartered life underwriter (Clu) examinations by the multitrait-multimethod matrix. Educational and Psychological Measurement, 39(4), 891–896. https://doi.org/10.1177/001316447903900422
Bajunirwe, F., Haberer, J. E., Boum, Y., 2nd, Hunt, P., Mocello, R., Martin, J. N., … Hahn, J. A. (2014). Comparison of self-reported alcohol consumption to phosphatidylethanol measurement among HIV-infected patients initiating antiretroviral treatment in southwestern Uganda. PLoS One, 9(12), e113152. https://doi.org/10.1371/journal.pone.0113152
Bauer, D. J., Howard, A. L., Baldasaro, R. E., Curran, P. J., Hussong, A. M., Chassin, L., & Zucker, R. A. (2013). A Trifactor model for integrating ratings across multiple informants. Psychological Methods, 18(4), 475–493. https://doi.org/10.1037/a0032475
Bockenholt, U. (2014). Modeling motivated misreports to sensitive survey questions. Psychometrika, 79(3), 515–537. https://doi.org/10.1007/s11336-013-9390-9
Bockenholt, U., & van der Heijden, P. G. M. (2007). Item randomized-response models for measuring noncompliance: Risk-return perceptions, social influences, and self-protective responses. Psychometrika, 72(2), 245–262. https://doi.org/10.1007/s11336-005-1495-y
Bollen, K. A. (2002). Latent variables in psychology and the social sciences. Annual Review of Psychology, 53, 605–634. https://doi.org/10.1146/annurev.psych.53.100901.135239
Bond, D., Ramsey, E., & Boddy, C. R. (2011). Projective techniques: Are they a victim of clashing paradigms? Munich Personal RePEc Archive. Retrieved from http://mpra.ub.uni-muenchen.de/33331/
Borsboom, D., Mellenbergh, G. J., & van Heerden, J. (2003). The theoretical status of latent variables. Psychological Review, 110(2), 203–219.
Brener, N. D., Kann, L., McManus, T., Kinchen, S. A., Sundberg, E. C., & Ross, J. G. (2002). Reliability of the 1999 youth risk behavior survey questionnaire. The Journal of Adolescent Health, 31(4), 336–342.
Brown, W. (1910). Some experimental results in the correlation of mental abilities. British Journal of Psychology, 1904–1920, 3(3), 296–322. https://doi.org/10.1111/j.2044-8295.1910.tb00207.x
Cai, L., Yang, J. S., & Hansen, M. (2011). Generalized full-information item bifactor analysis. Psychological Methods, 16(3), 221–248. https://doi.org/10.1037/A0023350
Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.
Chen, X., Wang, Y., Li, F., Gong, J., & Yan, Y. (2015). Development and evaluation of the Brief Sexual Openness Scale-A construal level theory based approach. PLoS One, 10(8), e0136683. https://doi.org/10.1371/journal.pone.0136683
Chen, X., Hu, H., Xu, X., Gong, J., Yan, Y. Q., & Li, F. (2018). Probability sampling by connecting space with households using Gis/Gps technologies. Journal of Survey Statistics and Methodology, 6(2), 149–168. https://doi.org/10.1093/jssam/smx032
Chen, X., Wang, Y., Leeman, R. F., Li, F., Zhao, J., & Bruijnzeel, A. W. (2018). Videoassisted topographical measurement of cigarette smoking: Exploration of an objective approach to evaluate nicotine dependence. Tobacco Prevention & Cessation, 41, 21. https://doi.org/10.18332/tpc/90821.
Cordero-Coma, J., & Breen, R. (2012). HIV prevention and social desirability: Husband-wife discrepancies in reports of condom use. Journal of Marriage and Family, 74(3), 601–613.
Crowne, D. P., & Marlowe, D. (1960). A new scale of social desirability independent of psychopathology. Journal of Consulting Psychology, 24(4), 349–354. https://doi.org/10.1037/h0047358
Dasgupta, A. (2015). Alcohol and its biomarkers: Clinical aspects and laboratory determination. New York: Elsevier.
Dawtry, R. J., Sutton, R. M., & Sibley, C. G. (2015). Why wealthier people think people are wealthier, and why it matters: From social sampling to attitudes to redistribution. Psychological Science, 26(9), 1389–1400. https://doi.org/10.1177/0956797615586560
de Jong, M. G., Pieters, R., & Stremersch, S. (2012). Analysis of sensitive questions across cultures: An application of multigroup item randomized response theory to sexual attitudes and behavior. Journal of Personality and Social Psychology, 103(3), 543–564. https://doi.org/10.1037/A0029394
Dunn, M., Thomas, J. O., Swift, W., & Burns, L. (2012). Elite athletes’ estimates of the prevalence of illicit drug use: Evidence for the false consensus effect. Drug and Alcohol Review, 31(1), 27–32. https://doi.org/10.1111/j.1465-3362.2011.00307.x
Dwyer, J. H. (1980). Measurement models. In J. H. Dwyer (Ed.), Statistical models for the social and behavioral sciences. New York: Oxford University Press.
Fisher, R. J., & Tellis, G. J. (1998). Removing social desirability bias with indirect questioning: Is the cure worse than the disease? Advances in Consumer Research, 25, 563–567.
Gibbons, R. D., Bock, R. D., Hedeker, D., Weiss, D. J., Segawa, E., Bhaumik, D. K., … Stover, A. (2007). Full-information item bifactor analysis of graded response data. Applied Psychological Measurement, 31(1), 4–19. https://doi.org/10.1177/0146621606289485
Gueguen, N. (2015). Similarity and sensitive topics survey: When similarity elicits answers to intimate questions in survey research. Current Psychology, 34(1), 58–65. https://doi.org/10.1007/s12144-014-9240-7
Gupta, S., Gupta, B., & Singh, S. (2002). Estimation of sensitivity level of personal interview survey questions. Journal of Statistical Planning and Inference, 100(2), 239–247. https://doi.org/10.1016/S0378-3758(01)00137-9
Himmelfarb, S. (2008). The multi-item randomized response technique. Sociological Methods & Research, 36(4), 495–514. https://doi.org/10.1177/0049124107313900
Holbrook, A. L., & Krosnick, J. A. (2010). Measuring voter turnout by using the randomized response technique: Evidence calling into question the method's validity. Public Opinion Quarterly, 74(2), 328–343.
Holtgraves, T. (2004). Social desirability and self-reports: Testing models of socially desirable responding. Personality and Social Psychology Bulletin, 30(2), 161–172. https://doi.org/10.1177/0146167203259930
Holzinger, K. J., & Swineford, F. (1937). The bi-factor method. Psychometrika, 2(1), 41–54. https://doi.org/10.1007/Bf02287965
Jo, M.-S. (2000). Controlling social-desirability bias via method factors of direct and indirect questioning in structural equation models. Psychology & Marketing, 17(2), 137–148. https://doi.org/10.1002/(sici)1520-6793(200002)17:2<137::aid-mar5>3.0.co;2-v
Johnson, T. R., & Bolt, D. M. (2010). On the use of factor-analytic multinomial logit item response models to account for individual differences in response style. Journal of Educational and Behavioral Statistics, 35(1), 92–114.
Jonason, P., & Fisher, T. (2009). The power of prestige: Why young men report having more sex partners than young women. Sex Roles, 60(3–4), 151–159. https://doi.org/10.1007/s11199-008-9506-3
Kim, H., Schnall, S., Yi, D. J., & White, M. P. (2013). Social distance decreases responders' sensitivity to fairness in the ultimatum game. Judgment and Decision making, 8(5), 632–638.
Kline, R. B. (2005). Principles and practice of structural equation modeling (2nd ed.). New York: Guilford Press.
Kraemer, H. C., Measelle, J. R., Ablow, J. C., Essex, M. J., Boyce, W. T., & Kupfer, D. J. (2003). A new approach to integrating data from multiple informants in psychiatric assessment and research: Mixing and matching contexts and perspectives. American Journal of Psychiatry, 160(9), 1566–1577. https://doi.org/10.1176/appi.ajp.160.9.1566
Krumpal, I. (2013). Determinants of social desirability bias in sensitive surveys: A literature review. Quality & Quantity, 47(4), 2025–2047. https://doi.org/10.1007/s11135-011-9640-9
Liberman, N., & Trope, Y. (1998). The role of feasibility and desirability considerations in near and distant future decisions: A test of temporal construal theory. Journal of Personality and Social Psychology, 75(1), 5–18. https://doi.org/10.1037/0022-3514.75.1.5
Liberman, N., & Trope, Y. (2008). The psychology of transcending the here and now. Science, 322(5905), 1201–1205. https://doi.org/10.1126/science.1161958
Liberman, N., Trope, Y., & Stephan, E. (2007). Psychological distance. In A. W. Kruglanski & E. T. Higgins (Eds.), Social psychology: Handbook of basic principles. New York: Guilford Press.
Liberman, N., Trope, Y., & Wakslak, C. (2007). Construal level theory and consumer behavior. Journal of Consumer Psychology, 17(2), 113–117. https://doi.org/10.1016/S1057-7408(07)70017-7
Liviatan, I., Trope, Y., & Liberman, N. (2008). Interpersonal similarity as a social distance dimension: Implications for perception of others' actions. Journal of Experimental Social Psychology, 44(5), 1256–1269. https://doi.org/10.1016/j.jesp.2008.04.007
Meisenberg, G., & Williams, A. (2008). Are acquiescent and extreme response styles related to low intelligence and education? Personality and Individual Differences, 44(7), 1539–1550. https://doi.org/10.1016/j.paid.2008.01.010
Nguyen, B. H., Nguyen, C. P., McPhee, S. J., Stewart, S. L., Bui-Tong, N., & Nguyen, T. T. (2015). Cognitive interviews of Vietnamese Americans on healthy eating and physical activity health educational materials. Ecology of Food and Nutrition, 54(5), 455–469. https://doi.org/10.1080/03670244.2015.1015119
Nicewander, W. A., & Thomasson, G. L. (1999). Some reliability estimates for computerized adaptive tests. Applied Psychological Measurement, 23(3), 239–247. https://doi.org/10.1177/01466219922031356
Ostapczuk, M., & Musch, J. (2011). Estimating the prevalence of negative attitudes towards people with disability: A comparison of direct questioning, projective questioning and randomised response. Disability and Rehabilitation: An International, Multidisciplinary Journal, 33(5), 399–411. https://doi.org/10.3109/09638288.2010.492067
Paulhus, D. L. (1984). Two-component models of socially desirable responding. Journal of Personality and Social Psychology, 46(3), 598–609. https://doi.org/10.1037/0022-3514.46.3.598
Paulhus, D. L. (1991). Measurement and control of response bias. In J. P. Robinson, P. R. Shaver, & L. S. Wrightsman (Eds.), Measures of personality and social psychological attitudes (pp. 17–59). San Diego, CA, US: Academic.
Paulhus, D. L., Harms, P. D., Bruce, M. N., & Lysy, D. C. (2003). The over-claiming technique: Measuring self-enhancement independent of ability. Journal of Personality and Social Psychology, 84(4), 890–904. https://doi.org/10.1037/0022-3514.84.4.890
Pei, Q.L., Chen, S., Xiao, Y., & Wu, S.S. (2015). A noval prevacy preseveing method for data collection and sharing in HIV survey studies. Current HIV Research, Accepted (invited mansucript).
Penney, S. R., McMaster, R., & Wilkie, T. (2014). Multirater reliability of the historical, clinical, and risk management-20. Assessment, 21(1), 15–27. https://doi.org/10.1177/1073191113514107
Pollack, A. Z. (2012). Metals, reproductive hormones, and oxidative stress in women and consideration of correlated biomarker measurement error (Vol. 72, pp. 5850–5850). Ann Arbor: University microfilms.
Rasinski, K. A., Willis, G. B., Baldwin, A. K., Yeh, W. C., & Lee, L. (1999). Methods of data collection, perceptions of risks and losses, and motivation to give truthful answers to sensitive survey questions. Applied Cognitive Psychology, 13(5), 465–484. https://doi.org/10.1002/(Sici)1099-0720(199910)13:5<465::Aid-Acp609>3.0.Co;2-Y
Raykov, T., & Marcoulides, G. A. (2011). Introduction to psychometric theory. New York: Routledge.
Rim, S. Y., Trope, Y., Liberman, N., & Shapira, O. (2013). The highs and lows of mental representation: A construal level perspective on the structure of knowledge. In D. E. Carlston & D. E. Carlston (Eds.), The Oxford handbook of social cognition (pp. 194–219). New York: Oxford University Press.
Robinson, R. J., Hensel, E. C., Morabito, P. N., & Roundtree, K. A. (2015). Electronic cigarette topography in the natural environment. PLoS One, 10(6), e0129296. https://doi.org/10.1371/journal.pone.0129296
Robles, T. F., Shetty, V., Zigler, C. M., Glover, D. A., Elashoff, D., Murphy, D., & Yamaguchi, M. (2011). The feasibility of ambulatory biosensor measurement of salivary alpha amylase: Relationships with self-reported and naturalistic psychological stress. Biological Psychology, 86(1), 50–56. https://doi.org/10.1016/j.biopsycho.2010.10.006
Ross, L., Greene, D., & House, P. (1977). The “false consensus effect”: An egocentric bias in social perception and attribution processes. Journal of Experimental Social Psychology, 13(3), 279–301. https://doi.org/10.1016/0022-1031(77)90049-X
Sakai, J. T., Mikulich-Gilbertson, S. K., Long, R. J., & Crowley, T. J. (2006). Validity of transdermal alcohol monitoring: Fixed and self-regulated dosing. Alcoholism-Clinical and Experimental Research, 30(1), 26–33. https://doi.org/10.1111/j.1530.0277.2006.00004.x
Schwarz, N. (2007). Cognitive aspects of survey methodology. Applied Cognitive Psychology, 21(2), 277–287. https://doi.org/10.1002/acp.1340
Selvam, A. P., Muthukumar, S., Kamakoti, V., & Prasad, S. (2016). A wearable biochemical sensor for monitoring alcohol consumption lifestyle through Ethyl glucuronide (EtG) detection in human sweat. Scientific Reports, 6, 23111. https://doi.org/10.1038/Srep23111
Sieving, R. E., Eisenberg, M. E., Pettingell, S., & Skay, C. (2006). Friends' influence on adolescents’ first sexual intercourse. Perspectives on Sexual and Reproductive Health, 38(1), 13–19. https://doi.org/10.1363/psrh.38.013.06
Spearman, C. (1904). “General intelligence” objectively determined and measured. American Journal of Psychology, 15, 201–292. https://doi.org/10.2307/1412107
Spearman, C. (1910). Correlation calculation from faulty data. British Journal of Psychology, 1904–1920, 3(3), 271–295. https://doi.org/10.1111/j.2044-8295.1910.tb00206.x
Spearman, C. (1931). The general factor in Spearman’s theory of intelligence. Nature, 127, 57–57. https://doi.org/10.1038/127057a0
Statistical Bureau of Wuhan (2012). Wuhan statistical yearbook-2012. Beijing: China Statistics Press.
Steenkamp, J.-B. E. M., De Jong, M. G., & Baumgartner, H. (2010). Socially desirable response tendencies in survey research. Journal of Marketing Research, 47(2), 199–214. https://doi.org/10.1509/jmkr.47.2.199
Tavakoli, H. R., Hull, M., & Okasinski, L. M. (2011). Review of current clinical biomarkers for the detection of alcohol dependence. Innovations in Clinical Neuroscience, 8(3), 26–33.
Tourangeau, A. E., Lance, J. R., & Raninski, K. (2000). The psychology of survey response. Cambridge: The University of Cambridge Press.
Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133(5), 859–883.
Trope, Y., & Liberman, N. (2010). Construal-level theory of psychological distance. Psychological Review, 117(2), 440–463. https://doi.org/10.1037/a0018963
Trope, Y., & Liberman, N. (2012). Construal level theory. In P. A. M. Van Lange, A. W. Kruglanski, & E. T. Higgins (Eds.), Handbook of theories of social psychology (Vol. 1, pp. 118–134). Thousand Oaks: Sage Publications Ltd.
Verhelst, N. D., & Verstralen, H. H. F. M. (2008). Some considerations on the partial credit model. Psicológica, 29(2), 229–254.
Warner, L. (1965). Random response: A survey techniqe for eliminating evaise answer bias. Journal of American Statistical Association, 60, 63–69.
Willis, G. (2015). Pretesting of health survey questionnaires: Cognitive interviewing, usability testing and behavioral coding. In T. P. Johnson (Ed.), Health survey methods (pp. 217–242). New York: Wiley.
Wright, S. A. (2012). Using construal level theory to detect social desirable bias. In Z. Gürhan-Canli, C. Otnes, & R. Z. Duluth (Eds.), Advances in consumer research (Vol. 40, pp. 687–685). Cincinnati: University of Cincinnati.
Wu, S. S., Chen, S., Burr, D., & Zhang, L. (2016). A new data collection technique for preserving privacy. Journal of Privacy and Confidentiality, 7(3), 99–129. Retrieved from http://repository.cmu.edu/jpc_forthcoming/8/.
Yuen, H. K., Wang, E., Holthaus, K., Vogtle, L. K., Sword, D., Breland, H. L., & Kamen, D. L. (2013). Self-reported versus objectively assessed exercise adherence. American Journal of Occupational Therapy, 67(4), 484–489.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Wang, Y., Chen, X. (2020). Construal Level Theory Supported Method for Sensitive Topics: Applications in Three Different Populations. In: Chen, X., Chen, (.DG. (eds) Statistical Methods for Global Health and Epidemiology. ICSA Book Series in Statistics. Springer, Cham. https://doi.org/10.1007/978-3-030-35260-8_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-35260-8_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-35259-2
Online ISBN: 978-3-030-35260-8
eBook Packages: Mathematics and StatisticsMathematics and Statistics (R0)