Abstract
Recommender systems can facilitate people to get effective information from the massive data, and it is the hot research currently in data mining. SVD++ is a kind of effective single model recommendation algorithm, which is based on the matrix decomposition combined with the neighborhood model. On the Spark, using the Stochastic Gradient Descent, this paper realized the distributed SVD++ algorithm through the Scala, deployed and applied the algorithm into an actual recommendation product for testing. The testing results represent that the distributed SVD++ algorithm succeeded in solving problems of terabytes of data processing in the e-commerce recommendation and the sparse data of user-item matrix, enhancing the quality in personalized commodity recommendation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Jia, Y., Zhang, C., Lu, Q., Wang, P.: Users’ brands preference based on SVD++ in recommender systems. In: 2014 IEEE Workshop on Advanced Research and Technology in Industry Applications (WARTIA), pp. 1175–1178. IEEE Press, Ottawa (2014)
Hu., Y.F., Koren, Y., Volinsky, C.: Collaborative filtering for implicit feedback datasets. In: Proceedings of the IEEE International Conference on Data Mining (ICDM 2008), pp. 263–272. IEEE CS Press (2008)
Zhang C.Y.: A LBS-based mobile personalized recommendation system. Sci. Technol. Eng. 30, 7439–7442, 7447 (2011)
Zhang, X., Niu, B., Zhao, J.: A novel data mining model based on SOAP in E-commerce. In: Ninth International Conference on Hybrid Intelligent Systems (HIS 2009), pp. 404–407. IEEE, Shenyang (2009)
Ren, F., Zhang, C., Liu, L., Xu, W., Owall, V., Markovic, D.: A square-root-free matrix decomposition method for energy-efficient least square computation on embedded systems. Embedded Syst. Lett. 6, 73–76 (2014). IEEE
Funk, S.: Netflix Update: Try This at Home. http://sifter.org/~simon/journal/20061211.html
Liang, X.: Recommendation System Practice, pp. 179–193. People’s Posts and Telecommunications Press, Beijing (2012)
Koren ,Y.: Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of the 14th ACM SIGKDD Conference, pp. 426–434 (2008)
Hynninen, P., Kauppinen, M.: A/B testing: A promising tool for customer value evaluation. In: Requirements Engineering and Testing (RET), pp. 16–17. IEEE, Karlskrona (2014)
Lin, X., Wang, P., Wu, B.: Log analysis in cloud computing environment with Hadoop and Spark. In: Broadband Network & Multimedia Technology (IC-BNMT), pp. 273–276. IEEE, Guilin (2013)
IBM Corperation: Spark, an alternative for fast data analytics. http://www.ibm.com/developerworks/library/os-spark
Hanna, A.I., Yates, I., Mandic, D.P.: Analysis of the class of complex-valued error adaptive normalised nonlinear gradient descent algorithms. In: Proceedings of the 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2003), vol. 2, pp. II–705–708. IEEE (2003)
Malago, L., Matteo. M., Pistone, G.: Stochastic Natural Gradient Descent by estimation of empirical covariances. In: 2011 IEEE Congress Evolutionary Computation (CEC), pp. 949–956. IEEE, New Orleans (2011)
Boukis, C.G., Papoulis, E.V.: A normalised adaptive amplitude nonlinear gradient descent algorithm for system identification. In: Proceedings of the 2003 10th IEEE International Conference on Electronics, Circuits and Systems (ICECS 2003), vol. 3, pp. 1042–1045. IEEE (2003)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer Science+Business Media Singapore
About this paper
Cite this paper
Cao, J. et al. (2015). Distributed Design and Implementation of SVD++ Algorithm for E-commerce Personalized Recommender System. In: Zhang, X., Wu, Z., Sha, X. (eds) Embedded System Technology. ESTC 2015. Communications in Computer and Information Science, vol 572. Springer, Singapore. https://doi.org/10.1007/978-981-10-0421-6_4
Download citation
DOI: https://doi.org/10.1007/978-981-10-0421-6_4
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-0420-9
Online ISBN: 978-981-10-0421-6
eBook Packages: Computer ScienceComputer Science (R0)