Skip to main content

Removing the Mask - Do People Over Trust Avatars Reconstructed from Video?

  • Conference paper
  • First Online:
Virtual Reality and Augmented Reality (EuroVR 2017)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10700))

Included in the following conference series:

Abstract

This experiment compared the detection of deceit across video conferencing and a fixed viewpoint 3D video based computer graphic medium. The purpose was to determine if the process of 3D reconstruction influenced trust by reducing detail of facial expression. Comparison with the literature investigates the impact of facial expression on trust. Inspiration comes from previous studies in the natural and virtual world that suggest a stronger tendency to over trust a person when their facial expression is hidden. A virtual avatar that copies head and eye movement but not that of the face, could be argued as akin to a person wearing a mask. Thus, our opening research question is: Would a 3D medium that removed this mask result in a truth bias similar to video and therefore real world? Two confederates each gave a set of accounts of which half were true. These were captured and transmitted simultaneously in real time using 2D and full 3D video based communication mediums. Recordings of these sessions were later examined by two sets of participants. Twenty-one participants were asked to determine which accounts were true. Measures included: accuracy at detecting truth and deceit, and from this tendency to over trust and lastly cognitive effort in determining truthfulness. Results show that participants performed and worked to a similar degree in both mediums. Findings are of interest to those developing 3D telepresence technologies and virtual humans, and to those concerned with the trustworthiness of a medium.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bond Jr., C.F., DePaulo, B.M.: Accuracy of deception judgments. Pers. Soc. Psychol. Rev. 10, 214–234 (2006)

    Article  Google Scholar 

  2. Steptoe, W., Steed, A., Rovira, A., Rae, J.: Lie tracking: social presence, truth and deception in avatar-mediated telecommunication. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1039–1048. ACM (2010)

    Google Scholar 

  3. McDonnell, R., Breidt, M., Bulthoff, H.: Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Trans. Graph. 31, 1–11 (2012)

    Article  Google Scholar 

  4. Bailenson, J.N., Beall, A.C.: Transformed social interaction: exploring the digital plasticity of avatars. In: Schroeder, R., Axelsson, A.S. (eds.) Avatars at Work and Play. Computer Supported Cooperative Work, vol. 34, pp. 1–16. Springer, Dordrecht (2006). https://doi.org/10.1007/1-4020-3898-4_1

    Chapter  Google Scholar 

  5. Ekman, P.: Telling Lies: Clues to Deceit in the Marketplace, Marriage, and Politics. Norton, New York (1985)

    Google Scholar 

  6. Roberts, D.J., Fairchild, A.J., Campion, S.P., O’Hare, J., Moore, C.M., Aspin, R., Duckworth, T., Gasparello, P., Tecchia, F.: Withyou—an experimental end-to-end telepresence system using video-based reconstruction. IEEE J. Sel. Top. Sig. Process. 9, 562–574 (2015)

    Article  Google Scholar 

  7. Vrij, A., Mann, S.: Who killed my relative? Police officers’ ability to detect real-life high-stake lies. Psychol. Crime Law 7, 119–132 (2001)

    Article  Google Scholar 

  8. Horn, D.B.: Is seeing believing? Detecting deception in technologically mediated communication. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, pp. 297–298. ACM (2001)

    Google Scholar 

  9. Frank, M.G., Feeley, T.H.: To catch a liar: challenges for research in lie detection training. J. Appl. Commun. Res. 31, 58–75 (2003)

    Article  Google Scholar 

  10. McKenzie, F.R., Scerbo, M., Catanzaro, J., Phillips, M.: Nonverbal indicators of malicious intent: affective components for interrogative virtual reality training. Int. J. Hum.-Comput. Stud. 59, 237–244 (2003)

    Article  Google Scholar 

  11. Ekman, P., Friesen, W.V.: Nonverbal leakage and clues to deception. Psychiatry 32, 88–106 (1969)

    Article  Google Scholar 

  12. Ekman, P.: Darwin, deception, and facial expression. Ann. N. Y. Acad. Sci. 1000, 205–221 (2003)

    Article  Google Scholar 

  13. Feldman, R.S., Jenkins, L., Popoola, O.: Detection of deception in adults and children via facial expressions. Child Dev. 50, 350–355 (1979)

    Article  Google Scholar 

  14. Millar, M.G., Millar, K.U.: The effects of cognitive capacity and suspicion on truth bias. Commun. Res. 24, 556–570 (1997)

    Article  MATH  Google Scholar 

  15. Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384 (1993)

    Article  Google Scholar 

  16. Endres, J., Laidlaw, A.: Micro-expression recognition training in medical students: a pilot study. BMC Med. Educ. 9, 47 (2009)

    Article  Google Scholar 

  17. Slater, M.: Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. B: Biol. Sci. 364, 3549–3557 (2009)

    Article  Google Scholar 

  18. Porter, S., Ten Brinke, L.: Reading between the lies identifying concealed and falsified emotions in universal facial expressions. Psychol. Sci. 19, 508–514 (2008)

    Article  Google Scholar 

  19. Bernstein, D.M., Loftus, E.F.: How to tell if a particular memory is true or false. Perspect. Psychol. Sci. 4, 370–374 (2009)

    Article  Google Scholar 

  20. Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigatoris Guide. Consulting Psychologists Press, Palo Alto (1978)

    Google Scholar 

  21. Dyck, M., Winbeck, M., Leiberg, S., Chen, Y., Gur, R.C., Mathiak, K.: Recognition profile of emotions in natural and virtual faces. PLoS ONE 3, e3628 (2008)

    Article  Google Scholar 

  22. Ayaz, H., Shewokis, P.A., Bunce, S., Izzetoglu, K., Willems, B., Onaral, B.: Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36–47 (2012)

    Article  Google Scholar 

  23. Ferrari, M., Quaresima, V.: A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application. Neuroimage 63, 921–935 (2012)

    Article  Google Scholar 

  24. Hu, F., Wang, Y., Cao, X., Hao, Q., Brown, D.: Using Wiimote and Kinect for cognitive rehabilitation: toward an intelligent sensor/image signal processing. Cyber-Phys. Syst.: Integr. Comput. Eng. Des. 321, 2566–2570 (2013)

    Google Scholar 

  25. Seraglia, B., Gamberini, L., Priftis, K., Scatturin, P., Martinelli, M., Cutini, S.: An exploratory fNIRS study with immersive virtual reality: a new method for technical implementation. Front. Hum. Neurosci. 5 (2011). Article no. 176

    Google Scholar 

  26. Cansiz, Y., Tokel, S.T.: Effects of way finding affordances on usability of virtual world environments in terms of users’ satisfaction, performance, and mental workload: examination by eye-tracking and fNIR. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications, pp. 1073–1079 (2012)

    Google Scholar 

  27. http://www.vicon.com/Press/Details/10

  28. http://www.faceshift.com/

  29. Fuchs, H., Bishop, G., Arthur, K., McMillan, L., Bajcsy, R., Lee, S., Farid, H., Kanade, T.: Virtual space teleconferencing using a sea of cameras. In: Proceedings of the First International Conference on Medical Robotics and Computer Assisted Surgery (1994)

    Google Scholar 

  30. Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: a unified approach to image-based modeling and spatially immersive displays. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 179–188. ACM (1998)

    Google Scholar 

  31. Roberts, D., Rae, J., Duckworth, T., Moore, C., Aspin, R.: Estimating the gaze of a virtuality human. IEEE Trans. Vis. Comput. Graph. 19, 681–690 (2013)

    Article  Google Scholar 

  32. Maimone, A., Fuchs, H.: Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 137–146. IEEE (2011)

    Google Scholar 

  33. http://www.microsoft.com/en-us/kinectforwindows/

  34. Pan, X., Gillies, M., Slater, M.: The impact of avatar blushing on the duration of interaction between a real and virtual person. In: Presence 2008: The 11th Annual International Workshop on Presence, pp. 100–106. Citeseer (2008)

    Google Scholar 

  35. Spellman, B.A., Tenney, E.R.: Credible testimony in and out of court. Psychon. Bull. Rev. 17, 168–173 (2010)

    Article  Google Scholar 

  36. Bailenson, J.N., Blascovich, J., Beall, A.C., Noveck, B.: Courtroom applications of virtual environments, immersive virtual environments, and collaborative virtual environments. Law Policy 28, 249–270 (2006)

    Article  Google Scholar 

  37. http://www.salford.ac.uk/computing-science-engineering/facilities/octave-technical-information

  38. Duckworth, T., Roberts, D.J.: Parallel processing for real-time 3D reconstruction from video streams. J. Real-Time Image Process. 9, 427–445 (2014)

    Article  Google Scholar 

  39. Moore, C., Duckworth, T., Aspin, R., Roberts, D.: Synchronization of images from multiple cameras to reconstruct a moving human. In: 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications (DS-RT), pp. 53–60. IEEE (2010)

    Google Scholar 

  40. Franco, J., Boyer, E.: Efficient polyhedral modeling from silhouettes. IEEE Trans. Pattern Anal. Mach. Intell. 31, 414–427 (2009)

    Article  Google Scholar 

  41. Duckworth, T., Roberts, D.J.: 3DRecon a utility for 3D reconstruction from video. Short Paper at the Joint Virtual Reality Conference (ICAT, EEG, Eurographics), Madrid (2012)

    Google Scholar 

  42. http://www.pstnet.com/eprime.cfm

  43. http://fnirdevices.com/

  44. https://www.biopac.com/Manuals/fNIR%20COBI%20Manual.pdf

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simon Campion .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Campion, S., Landowska, A., Duckworth, T., Moore, C., Eachus, P., Roberts, D. (2017). Removing the Mask - Do People Over Trust Avatars Reconstructed from Video?. In: Barbic, J., D'Cruz, M., Latoschik, M., Slater, M., Bourdot, P. (eds) Virtual Reality and Augmented Reality. EuroVR 2017. Lecture Notes in Computer Science(), vol 10700. Springer, Cham. https://doi.org/10.1007/978-3-319-72323-5_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-72323-5_9

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-72322-8

  • Online ISBN: 978-3-319-72323-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics