Open Access   Article Go Back

Single-criteria Collaborative Filter Implementation using Apache Mahout in Big data

M.N. Manu1 , B. Ramesh2

Section:Research Paper, Product Type: Journal Paper
Volume-5 , Issue-1 , Page no. 7-13, Jan-2017

Online published on Jan 31, 2017

Copyright © M.N. Manu, B. Ramesh . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

How to Cite this Paper

  • IEEE Citation
  • MLA Citation
  • APA Citation
  • BibTex Citation
  • RIS Citation

IEEE Style Citation: M.N. Manu, B. Ramesh , “Single-criteria Collaborative Filter Implementation using Apache Mahout in Big data,” International Journal of Computer Sciences and Engineering, Vol.5, Issue.1, pp.7-13, 2017.

MLA Style Citation: M.N. Manu, B. Ramesh "Single-criteria Collaborative Filter Implementation using Apache Mahout in Big data." International Journal of Computer Sciences and Engineering 5.1 (2017): 7-13.

APA Style Citation: M.N. Manu, B. Ramesh , (2017). Single-criteria Collaborative Filter Implementation using Apache Mahout in Big data. International Journal of Computer Sciences and Engineering, 5(1), 7-13.

BibTex Style Citation:
@article{Manu_2017,
author = {M.N. Manu, B. Ramesh },
title = {Single-criteria Collaborative Filter Implementation using Apache Mahout in Big data},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {1 2017},
volume = {5},
Issue = {1},
month = {1},
year = {2017},
issn = {2347-2693},
pages = {7-13},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=1147},
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=1147
TI - Single-criteria Collaborative Filter Implementation using Apache Mahout in Big data
T2 - International Journal of Computer Sciences and Engineering
AU - M.N. Manu, B. Ramesh
PY - 2017
DA - 2017/01/31
PB - IJCSE, Indore, INDIA
SP - 7-13
IS - 1
VL - 5
SN - 2347-2693
ER -

VIEWS PDF XML
1207 818 downloads 500 downloads
  
  
           

Abstract

In everyday life recommendation system plays an important role and collaborative filtering (CF) is used widely in many e-commerce applicationsfor online product recommendation. A recommender system is mainly used for better predictions as better decision making by using preferences during searching, shopping etc. The preferences of other users, user`s past preferences and big data is the driving force behind Recommendation systems. In this paper, we present collaborative filter types and their main challenges. Using the open source library Apache Mahout, we implemented collaborative filter using single-criteria to recommend items to particular users. Also, we showed the flow of Apache Mahout command�s execution to process the huge data using LogLikelihood similarity algorithm in big data scenario.

Key-Words / Index Term

Recommendation system; Collaborative filtering; Apache Mahout; Big data; Hive

References

[1] Dr. Sarika Jain, Anjali Grover, Praveen Singh Thakur, Sourabh Kumar Choudhary, �Trends, problems and solutions of recommender system,� International Conference on Computing, Communication and Automation (ICCCA2015), IEEE 2015, ISBN:978-1-4799-8890-7/15.
[2] BakirKarahodza, DzenanaDonko, HarisSupic, �Temporal dynamics of changes in group user`s preferences in recommender systems,� MIPRO 2015, , Opatija, Croatia, 25-29 May 2015
[3] Burke R, �Hybrid web recommender systems,�in: The Adaptive Web, pp. 377�408. Springer Berlin / Heidelberg (2007)
[4] Peter Brusilovsky, Alfred Kobsa, Wolfgang Nejdl, �The adaptive web: methods and strategies of web personalization,� page no. 325, Volume: 4321, 2007, ISBN: 978-3-540-72078-2.
[5] ParitoshNagarnaik, A.Thomas, �Survey on recommendation system methods,� IEEE Sponsored 2nd International Conference on Electronicsand Communication System (ICECS 2015), 2015
[6] D.Deepika, K.Pugazhmathi, "Efficient Indexing and Searching of Big Data in HDFs", International Journal of Computer Sciences and Engineering, Volume-04, Issue-04, Page No (237-243), Apr -2016
[7] Poornima Sharma, Varun Garg , Prof. Randeep Kaur , Prof. Satendra Sonare , "Big Data in Cloud Environment", International Journal of Computer Sciences and Engineering, Volume-01, Issue-03, Page No (15-17), Nov -2013.
[8] Bo Xie, Peng Han, Fan Yang, Shen, �An efficient neighbor searching scheme of distributed collaborative filtering on p2p overlay network,� database and expert systems applications pp. 141�150, Springer 2004.
[9] Mantripatjit Kaur and Gurleen Kaur Dhaliwal, "Performance Comparison of Map Reduce and Apache Spark on Hadoop for Big Data Analysis", International Journal of Computer Sciences and Engineering, Volume-03, Issue-11, Page No (66-69), Nov -2015
[10] YiBo Chen, �Solving the sparsity problem in recommender systems using association retrieval,� Academy Publisher, Journal of Computers, Vol. 6, No. 9, September 2011.
[11] Lili Wu, �Browsemap: Collaborative Filtering At LinkedIn,� October 23, 2014
[12] Greg Linden, Brent Smith, Jeremy York, �Amzon.com: recommendations- item-to-item collaborative filtering,� Industry report, Published by the IEEE Computer Society 1089-7801/03/$17.00�2003 IEEE Internet computing
[13] Jai Prakash Verma, Bankim Patel, Atul Patel, �Big Data Analysis: Recommendation System with Hadoop Framework,� Computational Intelligence & Communication Technology (CICT), 2015 IEEE International Conference on 13-14 Feb. 2015, pp.92�97, DOI: 10.1109/CICT.2015.86.
[14] Seikyung Jung, Juntae Kim, Herlocker, �Applying collaborative filtering for efficient document search,� Web Intelligence, Proceedings 2004, IEEE/WIC/ACM International Conference,pp. 640-643, DOI: 10.1109/WI.2004.10126.
[15] ShivlalMewada, Umesh Kumar Singh, "Measurement Based Performance of Reactive and Proactive Routing Protocols in WMN ", International journal of Advance Research in Computer science and software Engineering,Volume-1,Issue-1, December 2011.
[16] Sarita Sharma, Priyanka Agiwal, Rakesh Gaherwal, Shivlal Mewada and Pradeep Sharma, �Analysis of Recovery Techniques in Data Base Management System�, Research Journal of Computer and Information Technology Sciences, Vol-4, Issue-3, pp.(4-8), March 2016 . -ISSN 2320 � 6527, DOI: dx.doi.org/10.13140/RG.2.2.23964.49289
[17] Albert Bifet, �Mining Big Data in Real Time,� Informatica 37 (2013) 15�20.
[18] Chong-Ben Huang, Song-Jie Gong, �Employing rough set theory to alleviate the sparsity issue in recommender system�, Proceeding of the Seventh International Conference on Machine Learning and Cybernetics (ICMLC2008), IEEE Press, 2008, pp.1610-1614.
[19] GediminasAdomavicius, Alexander Tuzhilin, "Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions". IEEE Transaction on Knowledge and Data Engineering, 2005.17(6): pp. 734-749.
[20] YiBo Huang, �An item based collaborative filtering using item clustering prediction,� 2009 ISECS International Colloquium on Computing, Communication, Control, and Management (Volume: 4), Aug 2009, pp.54 � 56, 2009 IEEE, ISBN: 978-1-4244-4247-8,
[21] Gui-RongXue, Chenxi Lin, Qiang Yang, Wensi Xi, Hua-Jun Zeng, Yong Yu, Zheng Chen, �Scalable collaborative filtering using cluster-based smoothing,� Proceedings of the ACM SIGIR Conference 2005, pp.114�121
[22] Yi-Chung Hu, �Non-additive similarity-based single-layer perceptron for multi-criteria collaborative filtering,� Journal Neurocomputing, Volume 129, April, 2014, pp. 306-314.
[23] Z. R. Deng, X. Zhang, X. Deng, L. Xu, W. M. Huang, �An improvement of video recommender similarity measurement model,� International Conference on Automation, Mechanical Control and Computational Engineering(AMCCE 2015), pp.675-680, 2015.
[24] J. Chandrika, K.R Ananda Kumar, �Data stream querying: challenges and issues,� Int.Conf. on Computer Applications, ISBN: 978-981-08-7300-4, 2011.
[25] Y. K. Park, S. C. Park, W. S. Jung, S. G. Lee, �Reversed CF: A fast collaborative filtering algorithm using a k-nearest neighbor graph,� Expert Systems with Applications, vol. 42, no.8 pp.4022-4028, 2015.
[26] SongJie Gong, HongWu Ye, HengSong Tan, �Combining memory-based and model-based collaborative filtering in recommender system�, 2009 Pacific-Asia Conference on Circuits, Communications and System, 978-0-7695-3614-9/09 �2009 IEEE, DOI 10.1109/PACCS.2009.66
[27] Changbingchen, Xia Yang, Bong Zoebir, SivadonChaisiri, �A workflow framework for big data analytics: event recognition in a building,� 2013 IEEE Ninth World Congress on Services, pp.21�28, 2013 IEEE, DOI: 10.1109/SERVICES.2013.29.
[28] Skategui, �Recommendation algorithms with Apache Mahout,� [Online] Apr 11.
[29] R. Murugesh and I. Meenatchi, "A Study Using PI on: Sorting Structured Big Data In Distributed Environment Using Apache Hadoop MapReduce", International Journal of Computer Sciences and Engineering, Volume-02, Issue-08, Page No (35-38), Aug -2014,
[30] Dunning, �Accurate methods for the statistics of surprise and coincidence,� Computer Linguist, vol. 19, no. 1, pp. 61-74, Mar, 2003.
[31] N. Rastin and M. ZolghadriJahromi, �Using content features to enhance performance of user-based collaborative filtering performance of user-based collaborative filtering,� Int. journal of artificial intelligence and applications, vol. 5, no. 1, pp. 53-62, Jan 2014.
[32] F. Ricci, L. Rokach, B. Shapira, �Introduction to recommender systems handbook,� New York: Springer, 2011, pp. 1-35.
[33] Manu M N, Anandakumar K R, �A current trends in big data landscape,� 2015 IEEE International Conference on Computational Intelligence and Computing Research, IEEE 2015, 978-1-4799-7849-6/15.
[34] Qiao Cheng, Xiangke Wang, Dong Yin, YifengNiu, �The new similarity measure based on user preference models for collaborative filtering,� Information and Automation, 2015 IEEE International Conference, Aug 2015, pp.577-582, 2015 IEEE, DOI: 10.1109/ICInfA.2015.7279353.
[35] Mazin S. Al-Hakeem, "A Proposed Big Data as a Service (BDaaS) Model", International Journal of Computer Sciences and Engineering, Volume-04, Issue-11, Page No (1-6), Nov -2016, E-ISSN: 2347-2693
[36] V.Vijayadeepa, Archana.G "Semantic Based Service Recommendation using Collaborative Filtering", SSRG International Journal of Computer Science and Engineering (SSRG - IJCSE), V3 (10), 13-19 October 2016. ISSN:2348 � 8387.