Open Access   Article Go Back

Uses of HDFS in Metadata Management System

N. Durga1 , D. Ragupathi2 , V.R Kumar3

Section:Research Paper, Product Type: Journal Paper
Volume-2 , Issue-9 , Page no. 145-150, Sep-2014

Online published on Oct 04, 2014

Copyright © N. Durga, D. Ragupathi, V.R Kumar . This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

View this paper at   Google Scholar | DPI Digital Library

How to Cite this Paper

  • IEEE Citation
  • MLA Citation
  • APA Citation
  • BibTex Citation
  • RIS Citation

IEEE Style Citation: N. Durga, D. Ragupathi, V.R Kumar, “Uses of HDFS in Metadata Management System,” International Journal of Computer Sciences and Engineering, Vol.2, Issue.9, pp.145-150, 2014.

MLA Style Citation: N. Durga, D. Ragupathi, V.R Kumar "Uses of HDFS in Metadata Management System." International Journal of Computer Sciences and Engineering 2.9 (2014): 145-150.

APA Style Citation: N. Durga, D. Ragupathi, V.R Kumar, (2014). Uses of HDFS in Metadata Management System. International Journal of Computer Sciences and Engineering, 2(9), 145-150.

BibTex Style Citation:
@article{Durga_2014,
author = {N. Durga, D. Ragupathi, V.R Kumar},
title = {Uses of HDFS in Metadata Management System},
journal = {International Journal of Computer Sciences and Engineering},
issue_date = {9 2014},
volume = {2},
Issue = {9},
month = {9},
year = {2014},
issn = {2347-2693},
pages = {145-150},
url = {https://www.ijcseonline.org/full_paper_view.php?paper_id=268},
publisher = {IJCSE, Indore, INDIA},
}

RIS Style Citation:
TY - JOUR
UR - https://www.ijcseonline.org/full_paper_view.php?paper_id=268
TI - Uses of HDFS in Metadata Management System
T2 - International Journal of Computer Sciences and Engineering
AU - N. Durga, D. Ragupathi, V.R Kumar
PY - 2014
DA - 2014/10/04
PB - IJCSE, Indore, INDIA
SP - 145-150
IS - 9
VL - 2
SN - 2347-2693
ER -

VIEWS PDF XML
3457 3386 downloads 3422 downloads
  
  
           

Abstract

A (HDFS) Hadoop Distributed File System is intended to store very large data sets unfailingly and to stream those data sets at elevated bandwidth to consumer applications. Metadata managing is serious to distributed file system. In HDFS design, a solo master server administers all metadata, while numerals of data servers pile up file data. This design can�t gather the exponentially improved storage claim in cloud computing, as the solo master server may happen to a performance traffic jam. Proportional study of a metadata managing proposal is done. Its consist of three techniques tree separation, hashing and reliable hashing of metadata managing proposal. Out of these three proposals reliable hashing is the best techniques which utilize multiple Name Nodes, and segregate the metadata into �Buckets� which can be energetically move around among Name Nodes according to system job weight. To uphold consistency, metadata is simulated in dissimilar Name Nodes with log duplication knowledge, and Paxos algorithm is adopted to keep duplication uniformity.

Key-Words / Index Term

Hadoop, HDFS, Distributed File System, File Management System, Metadata Management

References

[1] Zhanye Wang ; Dept. of Comput. Sci. & Technol., Tsinghua Univ., Beijing, China ; Dongsheng Wang �NCluster: Using Multiple Active Name Nodes to Achieve High Availability for HDFS� Published in: High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing (HPCC_EUC), 2013 IEEE 10th International Conference on Date of Conference: 13-15 Nov. 2013 Page(s): 2291 � 2297.
[2] Azzedin, F. ; Inf. & Comput. Sci. Dept., King Fahd Univ. of Pet. & Miner., Dhahran, Saudi Arabia �Towards a scalable HDFS architecture� Published in: Collaboration Technologies and Systems (CTS), 2013 International Conference on Date of Conference: 20-24 May 2013 Page(s): 155 � 161.
[3] Dutta, R. ; Dept. of Comput. Sci. & Eng., Nat. Inst. of Technol. Karnataka, Surathkal, India ; Annappa, B. �A Scalable Cloud Platform using Matlab Distributed Computing Server Integrated with HDFS� Published in: Cloud and Services Computing (ISCOS), 2012 International Symposium on Date of Conference: 17-18 Dec. 2012 Page(s): 141� 145.
[4] Cheng Li-xin ; Suzhou Inst. of Nano-Tech & Nano-Bionics (SINANO), Suzhou, China ; Yue Yang ; Liu Yun-yun ; Ka Lok Man �A research on the storage structure and reconstruction algorithm of Meta data during the startup process of solid state storage systems� Published in: SoC Design Conference (ISOCC), 2013 International Date of Conference: 17-19 Nov. 2013 Page(s): 263 � 266.
[5] Zhen-Chun Huang ; Dept. of Comput. Sci. & Eng., Tsinghua Univ., Beijing ; Guo-qing Li �Meta-Data Adapter: A Way to Enable Spatial Information Data Grid� Published in: Future Generation Communication and Networking Symposia, 2008. FGCNS `08. Second International Conference on (Volume:5 ) Date of Conference: 13-15 Dec. 2008 Page(s): 87 � 92.
[6] Narayan, S. ; InfoBlox Inc., Santa Clara, CA, USA ; Bailey, S. ; Daga, A. �Hadoop Acceleration in an OpenFlow-Based Cluster� Published in: High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion: Date of Conference: 10-16 Nov. 2012 Page(s): 535 � 538.
[7] Mandal, A. ; Renaissance Comput. Inst., Univ. of North Carolina at Chapel Hill, Chapel Hill, NC, USA ; Yufeng Xin ; Baldine, I. ; Ruth, P. �Provisioning and Evaluating Multi-domain Networked Clouds for Hadoop-based Applications� Published in: Cloud Computing Technology and Science (CloudCom), 2011 IEEE Third International Conference on Date of Conference: Nov. 29 2011-Dec. 1 2011 Page(s): 690 � 697.
[8] Xiaoyi Lu ; Islam, N.S. ; Wasi-Ur-Rahman, M. ; Jose, J. �High-Performance Design of Hadoop RPC with RDMA over InfiniBand� Published in: Parallel Processing (ICPP), 2013 42nd International Conference on Date of Conference: 1-4 Oct. 2013 Page(s): 641 � 650.