Skip to main content
SpringerLink
Log in

Rapid and accurate face depth estimation in passive stereo systems

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In this paper, we introduce a novel approach for face depth estimation in a passive stereo vision system. Our approach is based on rapid generation of facial disparity maps, requiring neither expensive devices nor generic face models. It consists in incorporating face properties into the disparity estimation process to enhance the 3D face reconstruction. We propose a model-based method that is independent from the specific stereo algorithm used. Our method is a two-step process. First, an algorithm based on the Active Shape Model (ASM) is proposed to acquire a disparity model specific to the face concerned. Second, using this model as a guidance, the dense disparity is calculated and the depth map is estimated. Besides, an original post-processing algorithm is proposed in order to detect holes and spikes in the generated depth maps caused by wrong matches and uncertainties. It is based on the smoothness property of the face and a local and global analysis of the image. Experimental results are presented to demonstrate the reconstruction accuracy and the speed of the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Berretti S, Del Bimbo A, Pala P (2010) 3d face recognition using isogeodesic stripes. IEEE Trans Pattern Anal Mach Intell 32(12):2162–2177. doi:10.1109/TPAMI.2010.43

    Article  Google Scholar 

  2. Birchfield S, Tomasi C (1999) Depth discontinuities by pixel-to-pixel stereo. Int J Comput Vis 35(3):269–293

    Article  Google Scholar 

  3. Choi J, Medioni G, Lin Y, Silva L, Regina O, Pamplona M, Faltemier T (2010) 3d face reconstruction using a single or multiple views. In: 20th international conference on pattern recognition (ICPR) 2010, pp 3959–3962. doi:10.1109/ICPR.2010.963

  4. Chow C, Yuen S (2009) Recovering shape by shading and stereo under lambertian shading model. Int J Comput Vis 85(1):58–100

    Article  Google Scholar 

  5. Cootes T, Edwards G, Taylor C (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685

    Article  Google Scholar 

  6. Cryer J, Tsai P, Shah M (1995) Integration of shape from shading and stereo. Pattern Recogn 28(7):1033–1043

    Article  Google Scholar 

  7. Faltemier T, Bowyer K, Flynn P (2008) A region ensemble for 3-d face recognition. IEEE Trans Inform Foren Secur 3(1):62–73. doi:10.1109/TIFS.2007.916287

    Article  Google Scholar 

  8. Fortuna J, Martinez A (2010) Rigid structure from motion from a blind source separation perspective. Int J Comput Vis 88(3):404–424. doi:10.1007/s11263-009-0313-2

    Article  MathSciNet  Google Scholar 

  9. Gupta S, Castleman K, Markey M, Bovik A (2010) Texas 3d face recognition database. In: IEEE Southwest symposium on image analysis & interpretation (SSIAI) 2010. IEEE, pp 97–100

  10. Hirschmuller H (2001) Improvements in real-time correlation-based stereo vision. In: Proceedings IEEE workshop on stereo and multi-baseline vision(SMBV 2001). IEEE, pp 141–148

  11. Huang D, Ouji K, Ardabilian M, Wang Y, Chen L (2011) 3d face recognition based on local shape patterns and sparse representation classifier. Adv Multimedia Model 6523:206–216

    Article  Google Scholar 

  12. Huang Y, Wang Y, Tan T (2006) Combining statistics of geometrical and correlative features for 3d face recognition. In: Proceedings of the British machine vision conference, pp 879–888

  13. Kakadiaris I, Passalis G, Toderici G, Murtuza M, Lu Y, Karampatziakis N, Theoharis T (2007) Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans Pattern Anal Mach Intell 29(4):640–649. doi:10.1109/TPAMI.2007.1017

    Article  Google Scholar 

  14. Kolmogorov V, Zabih R (2002) Multi-camera scene reconstruction via graph cuts. In: Proceedings of the 7th European conference on computer vision-part III, ECCV ’02. Springer-Verlag, London, pp 82–96. http://dl.acm.org/citation.cfm?id=645317.756415

    Google Scholar 

  15. Koo HS, Lam KM (2008) Recovering the 3d shape and poses of face images based on the similarity transform. Patt Recogn Lett 29(6):712–723. doi:10.1016/j.patrec.2007.11.018. http://www.sciencedirect.com/science/article/pii/S016786550700373X

    Article  Google Scholar 

  16. Le V, Tang H, Cao L, Huang T (2010) Accurate and efficient reconstruction of 3d faces from stereo images. In: 17th IEEE international conference on image processing (ICIP) 2010, pp 4265–4268. doi:10.1109/ICIP.2010.5651875

  17. Lengagne R, Fua P, Monga O (2000) 3d stereo reconstruction of human faces driven by differential constraints. Image Vis Comput 18(4):337–343

    Article  Google Scholar 

  18. Lin WY, Chen MY (2012) A novel framework for automatic 3d face recognition using quality assessment. Multimed Tools Appl. doi:10.1007/s11042-012-1092-2

    Google Scholar 

  19. Milborrow S, Nicolls F (2008) Locating facial features with an extended active shape model. In: Proceedings of the 10th European conference on computer vision: Part IV, ECCV ’08. Springer-Verlag, Berlin, pp 504–513. doi:10.1007/978-3-540-88693-8_37

    Google Scholar 

  20. Park U, Jain AK (2006) 3d face reconstruction from stereo video. In: The 3rd Canadian conference on computer and robot vision 2006, p 41. doi:10.1109/CRV.2006.1

  21. Savran A, Alyüz N, Dibeklioğlu H, Çeliktutan O, Gökberk B, Sankur B, Akarun L (2008) Bosphorus database for 3d face analysis. In: Biometrics and identity management. Springer, pp 47–56

  22. Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis 47:7–42. doi:10.1023/A:1014573219977. http://portal.acm.org/citation.cfm?id=598429.598475

    Article  MATH  Google Scholar 

  23. Spreeuwers L (2011) Fast and accurate 3d face recognition. Int J Comput Vis 93:389–414. doi:10.1007/s11263-011-0426-2

    Article  MATH  Google Scholar 

  24. Sun J, Zheng NN, Shum HY (2003) Stereo matching using belief propagation. IEEE Trans Pattern Anal Mach Intell 25(7):787–800. doi:10.1109/TPAMI.2003.1206509

    Article  Google Scholar 

  25. Sun Z, Lam KM (2011) Depth estimation of face images based on the constrained ica model. IEEE Trans Inf Foren Secur 6(2):360–370. doi:10.1109/TIFS.2011.2118207

    Article  Google Scholar 

  26. Sun ZL, Lam KM, Gao Q (2013) Depth estimation of face images using the nonlinear least-squares model. IEEE Trans Image Process 22(1):17–30

    Article  MathSciNet  Google Scholar 

  27. Trucco E, Verri A (1998) Introductory techniques for 3-D computer vision. Prentice Hall PTR, Upper Saddle River, NJ, USA

    Google Scholar 

  28. Wang SF, Lai SH (2011) Reconstructing 3d face model with associated expression deformation from a single face image via constructing a low-dimensional expression deformation manifold. IEEE Trans Pattern Anal Mach Intell 33(10):2115–2121. doi:10.1109/TPAMI.2011.88

    Article  Google Scholar 

  29. Wang Y, Liu J, Tang X (2010) Robust 3d face recognition by local shape difference boosting. IEEE Trans Pattern Anal Mach Intell 32(10):1858–1870. doi:10.1109/TPAMI.2009.200

    Article  Google Scholar 

  30. Xiao J, Baker S, Matthews I, Kanade T (2004) Real-time combined 2d+3d active appearance models. In: Proceedings of the IEEE conference on computer vision and pattern recognition, vol 2, pp 535–542

  31. Yan P, Bowyer KW (2007) A fast algorithm for icp-based 3d shape biometrics. Comput Vis Image Understand 107(3):195–202. doi:10.1016/j.cviu.2006.11.001

    Article  Google Scholar 

  32. Zheng Y, Chang J, Zheng Z, Wang Z (2007) 3d face reconstruction from stereo: a model based approach. In: IEEE international conference on image processing ICIP, pp III–65–68. doi:10.1109/ICIP.2007.4379247

Download references

Author information

Authors and Affiliations

  1. Laboratoire d’Informatique Fondamentale de Lille, 50 Halley avenue, 59650, Villeneuve d’Ascq, France

    Amel Aissaoui, Jean Martinet & Chaabane Djeraba

Authors
  1. Amel Aissaoui
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jean Martinet
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chaabane Djeraba
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Amel Aissaoui.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Aissaoui, A., Martinet, J. & Djeraba, C. Rapid and accurate face depth estimation in passive stereo systems. Multimed Tools Appl 72, 2413–2438 (2014). https://doi.org/10.1007/s11042-013-1556-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1556-z

Keywords

Search

Navigation