Open Access   Article Go Back

Implementation of Hadoop Distributed File System Services in an Application

Shincy Anto Anila Ramesh K1 , Ladlie Dias2 , Sabna A.B3

Section:Research Paper, Product Type: Journal Paper
Volume-3 , Issue-9 , Page no. 10-14, Sep-2015

Online published on Oct 01, 2015

Copyright © Shincy Anto Anila Ramesh K, Ladlie Dias , Sabna A.B . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

How to Cite this Paper

  • IEEE Citation
  • MLA Citation
  • APA Citation
  • BibTex Citation
  • RIS Citation

IEEE Style Citation: Shincy Anto Anila Ramesh K, Ladlie Dias , Sabna A.B, “Implementation of Hadoop Distributed File System Services in an Application,” International Journal of Computer Sciences and Engineering, Vol.3, Issue.9, pp.10-14, 2015.

MLA Style Citation: Shincy Anto Anila Ramesh K, Ladlie Dias , Sabna A.B "Implementation of Hadoop Distributed File System Services in an Application." International Journal of Computer Sciences and Engineering 3.9 (2015): 10-14.

APA Style Citation: Shincy Anto Anila Ramesh K, Ladlie Dias , Sabna A.B, (2015). Implementation of Hadoop Distributed File System Services in an Application. International Journal of Computer Sciences and Engineering, 3(9), 10-14.

BibTex Style Citation:
@article{K_2015,
author = {Shincy Anto Anila Ramesh K, Ladlie Dias , Sabna A.B},
title = {Implementation of Hadoop Distributed File System Services in an Application},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {9 2015},
volume = {3},
Issue = {9},
month = {9},
year = {2015},
issn = {2347-2693},
pages = {10-14},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=632},
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=632
TI - Implementation of Hadoop Distributed File System Services in an Application
T2 - International Journal of Computer Sciences and Engineering
AU - Shincy Anto Anila Ramesh K, Ladlie Dias , Sabna A.B
PY - 2015
DA - 2015/10/01
PB - IJCSE, Indore, INDIA
SP - 10-14
IS - 9
VL - 3
SN - 2347-2693
ER -

VIEWS PDF XML
2782 2539 downloads 2414 downloads
  
  
           

Abstract

Cloud is the collection of computers on the internet that is being offered as a revolutionary storage method for files and Big Data is an evolving term that describes any voluminous amount of structured, semi-structured and unstructured data that has the potential to be mined for information. In our proposed system, we implement a safe method to save Big Data files using Apache Hadoop technology. And here we provide two web services: uploading and downloading of files. Once we upload the files, they are stored in different nodes across the cluster after partitioning. We make the data highly available, by keeping the different copies of data in several nodes. The uploaded files can be retrieved at any time according to our needs. Even if there is a failure at any node, the copy of data on some other nodes makes our system fault tolerant and reliable. Along with that, we can also make our files public or private and thus providing file sharing facility. We offer a security system for storing and managing Big Data files.

Key-Words / Index Term

Big Data, Fault tolerant, Hadoop Distributed File System

References

[1]Sivaraman, E.; Manickachezian, R., "High Performance and Fault Tolerant Distributed File System for Big Data Storage and Processing Using Hadoop," International Conference on Intelligent Computing Applications (ICICA), 2014, vol., no., pp.32,36, 6-7 March 2014.
[2]Krishna, T.L.S.R.; Ragunathan, T.; Battula, S.K., "Performance Evaluation of Read and Write Operations in Hadoop Distributed File System," Parallel Architectures, Algorithms and Programming (PAAP), 2014 Sixth International Symposium on , vol., no., pp.110,113, 13-15 July 2014
[3]Shvachko, K.; Hairong Kuang; Radia, S.; Chansler, R., "The Hadoop Distributed File System," in Mass Storage Systems and Technologies (MSST), 2010 IEEE 26th Symposium on , vol., no., pp.1-10, 3-7 May 2010
[4]K.V. Shvachko, “HDFS Scalability: The limits to growth,” login:. April 2010, pp. 6-16.
[5]Manikandan, S.G.; Ravi, S., "Big Data Analysis Using Apache Hadoop," in IT Convergence and Security (ICITCS), 2014 International Conference on , vol., no., pp.1-4, 28-30 Oct. 2014
[6]Devakunchari, R., "Handling big data with Hadoop toolkit," in Information Communication and Embedded Systems (ICICES), 2014 International Conference on , vol., no., pp.1-5, 27-28 Feb. 2014