Abstract
This experiment compared the detection of deceit across video conferencing and a fixed viewpoint 3D video based computer graphic medium. The purpose was to determine if the process of 3D reconstruction influenced trust by reducing detail of facial expression. Comparison with the literature investigates the impact of facial expression on trust. Inspiration comes from previous studies in the natural and virtual world that suggest a stronger tendency to over trust a person when their facial expression is hidden. A virtual avatar that copies head and eye movement but not that of the face, could be argued as akin to a person wearing a mask. Thus, our opening research question is: Would a 3D medium that removed this mask result in a truth bias similar to video and therefore real world? Two confederates each gave a set of accounts of which half were true. These were captured and transmitted simultaneously in real time using 2D and full 3D video based communication mediums. Recordings of these sessions were later examined by two sets of participants. Twenty-one participants were asked to determine which accounts were true. Measures included: accuracy at detecting truth and deceit, and from this tendency to over trust and lastly cognitive effort in determining truthfulness. Results show that participants performed and worked to a similar degree in both mediums. Findings are of interest to those developing 3D telepresence technologies and virtual humans, and to those concerned with the trustworthiness of a medium.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Bond Jr., C.F., DePaulo, B.M.: Accuracy of deception judgments. Pers. Soc. Psychol. Rev. 10, 214–234 (2006)
Steptoe, W., Steed, A., Rovira, A., Rae, J.: Lie tracking: social presence, truth and deception in avatar-mediated telecommunication. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1039–1048. ACM (2010)
McDonnell, R., Breidt, M., Bulthoff, H.: Render me real? Investigating the effect of render style on the perception of animated virtual humans. ACM Trans. Graph. 31, 1–11 (2012)
Bailenson, J.N., Beall, A.C.: Transformed social interaction: exploring the digital plasticity of avatars. In: Schroeder, R., Axelsson, A.S. (eds.) Avatars at Work and Play. Computer Supported Cooperative Work, vol. 34, pp. 1–16. Springer, Dordrecht (2006). https://doi.org/10.1007/1-4020-3898-4_1
Ekman, P.: Telling Lies: Clues to Deceit in the Marketplace, Marriage, and Politics. Norton, New York (1985)
Roberts, D.J., Fairchild, A.J., Campion, S.P., O’Hare, J., Moore, C.M., Aspin, R., Duckworth, T., Gasparello, P., Tecchia, F.: Withyou—an experimental end-to-end telepresence system using video-based reconstruction. IEEE J. Sel. Top. Sig. Process. 9, 562–574 (2015)
Vrij, A., Mann, S.: Who killed my relative? Police officers’ ability to detect real-life high-stake lies. Psychol. Crime Law 7, 119–132 (2001)
Horn, D.B.: Is seeing believing? Detecting deception in technologically mediated communication. In: CHI 2001 Extended Abstracts on Human Factors in Computing Systems, pp. 297–298. ACM (2001)
Frank, M.G., Feeley, T.H.: To catch a liar: challenges for research in lie detection training. J. Appl. Commun. Res. 31, 58–75 (2003)
McKenzie, F.R., Scerbo, M., Catanzaro, J., Phillips, M.: Nonverbal indicators of malicious intent: affective components for interrogative virtual reality training. Int. J. Hum.-Comput. Stud. 59, 237–244 (2003)
Ekman, P., Friesen, W.V.: Nonverbal leakage and clues to deception. Psychiatry 32, 88–106 (1969)
Ekman, P.: Darwin, deception, and facial expression. Ann. N. Y. Acad. Sci. 1000, 205–221 (2003)
Feldman, R.S., Jenkins, L., Popoola, O.: Detection of deception in adults and children via facial expressions. Child Dev. 50, 350–355 (1979)
Millar, M.G., Millar, K.U.: The effects of cognitive capacity and suspicion on truth bias. Commun. Res. 24, 556–570 (1997)
Ekman, P.: Facial expression and emotion. Am. Psychol. 48, 384 (1993)
Endres, J., Laidlaw, A.: Micro-expression recognition training in medical students: a pilot study. BMC Med. Educ. 9, 47 (2009)
Slater, M.: Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philos. Trans. R. Soc. B: Biol. Sci. 364, 3549–3557 (2009)
Porter, S., Ten Brinke, L.: Reading between the lies identifying concealed and falsified emotions in universal facial expressions. Psychol. Sci. 19, 508–514 (2008)
Bernstein, D.M., Loftus, E.F.: How to tell if a particular memory is true or false. Perspect. Psychol. Sci. 4, 370–374 (2009)
Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigatoris Guide. Consulting Psychologists Press, Palo Alto (1978)
Dyck, M., Winbeck, M., Leiberg, S., Chen, Y., Gur, R.C., Mathiak, K.: Recognition profile of emotions in natural and virtual faces. PLoS ONE 3, e3628 (2008)
Ayaz, H., Shewokis, P.A., Bunce, S., Izzetoglu, K., Willems, B., Onaral, B.: Optical brain monitoring for operator training and mental workload assessment. Neuroimage 59, 36–47 (2012)
Ferrari, M., Quaresima, V.: A brief review on the history of human functional near-infrared spectroscopy (fNIRS) development and fields of application. Neuroimage 63, 921–935 (2012)
Hu, F., Wang, Y., Cao, X., Hao, Q., Brown, D.: Using Wiimote and Kinect for cognitive rehabilitation: toward an intelligent sensor/image signal processing. Cyber-Phys. Syst.: Integr. Comput. Eng. Des. 321, 2566–2570 (2013)
Seraglia, B., Gamberini, L., Priftis, K., Scatturin, P., Martinelli, M., Cutini, S.: An exploratory fNIRS study with immersive virtual reality: a new method for technical implementation. Front. Hum. Neurosci. 5 (2011). Article no. 176
Cansiz, Y., Tokel, S.T.: Effects of way finding affordances on usability of virtual world environments in terms of users’ satisfaction, performance, and mental workload: examination by eye-tracking and fNIR. In: World Conference on Educational Multimedia, Hypermedia and Telecommunications, pp. 1073–1079 (2012)
Fuchs, H., Bishop, G., Arthur, K., McMillan, L., Bajcsy, R., Lee, S., Farid, H., Kanade, T.: Virtual space teleconferencing using a sea of cameras. In: Proceedings of the First International Conference on Medical Robotics and Computer Assisted Surgery (1994)
Raskar, R., Welch, G., Cutts, M., Lake, A., Stesin, L., Fuchs, H.: The office of the future: a unified approach to image-based modeling and spatially immersive displays. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 179–188. ACM (1998)
Roberts, D., Rae, J., Duckworth, T., Moore, C., Aspin, R.: Estimating the gaze of a virtuality human. IEEE Trans. Vis. Comput. Graph. 19, 681–690 (2013)
Maimone, A., Fuchs, H.: Encumbrance-free telepresence system with real-time 3D capture and display using commodity depth cameras. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 137–146. IEEE (2011)
Pan, X., Gillies, M., Slater, M.: The impact of avatar blushing on the duration of interaction between a real and virtual person. In: Presence 2008: The 11th Annual International Workshop on Presence, pp. 100–106. Citeseer (2008)
Spellman, B.A., Tenney, E.R.: Credible testimony in and out of court. Psychon. Bull. Rev. 17, 168–173 (2010)
Bailenson, J.N., Blascovich, J., Beall, A.C., Noveck, B.: Courtroom applications of virtual environments, immersive virtual environments, and collaborative virtual environments. Law Policy 28, 249–270 (2006)
http://www.salford.ac.uk/computing-science-engineering/facilities/octave-technical-information
Duckworth, T., Roberts, D.J.: Parallel processing for real-time 3D reconstruction from video streams. J. Real-Time Image Process. 9, 427–445 (2014)
Moore, C., Duckworth, T., Aspin, R., Roberts, D.: Synchronization of images from multiple cameras to reconstruct a moving human. In: 2010 IEEE/ACM 14th International Symposium on Distributed Simulation and Real Time Applications (DS-RT), pp. 53–60. IEEE (2010)
Franco, J., Boyer, E.: Efficient polyhedral modeling from silhouettes. IEEE Trans. Pattern Anal. Mach. Intell. 31, 414–427 (2009)
Duckworth, T., Roberts, D.J.: 3DRecon a utility for 3D reconstruction from video. Short Paper at the Joint Virtual Reality Conference (ICAT, EEG, Eurographics), Madrid (2012)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Campion, S., Landowska, A., Duckworth, T., Moore, C., Eachus, P., Roberts, D. (2017). Removing the Mask - Do People Over Trust Avatars Reconstructed from Video?. In: Barbic, J., D'Cruz, M., Latoschik, M., Slater, M., Bourdot, P. (eds) Virtual Reality and Augmented Reality. EuroVR 2017. Lecture Notes in Computer Science(), vol 10700. Springer, Cham. https://doi.org/10.1007/978-3-319-72323-5_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-72323-5_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-72322-8
Online ISBN: 978-3-319-72323-5
eBook Packages: Computer ScienceComputer Science (R0)