Home > Computer Science > Other > Volume-2 > Issue-5 > HDFS: Erasure-Coded Information Repository System for Hadoop Clusters

HDFS: Erasure-Coded Information Repository System for Hadoop Clusters

Call for Papers

Volume-6 | Issue-5

Last date : 27-Aug-2022

Best International Journal
Open Access | Peer Reviewed | Best International Journal | Indexing & IF | 24*7 Support | Dedicated Qualified Team | Rapid Publication Process | International Editor, Reviewer Board | Attractive User Interface with Easy Navigation

Journal Type : Open Access

Processing Charges : 700/- INR Only OR 25 USD (for foreign users)

First Update : Within 7 Days after submittion

Submit Paper Online

For Author

Research Area



HDFS: Erasure-Coded Information Repository System for Hadoop Clusters


Ameena Anjum | Prof. Shivleela Patil

https://doi.org/10.31142/ijtsrd18206



Ameena Anjum | Prof. Shivleela Patil "HDFS: Erasure-Coded Information Repository System for Hadoop Clusters" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-2 | Issue-5, August 2018, pp.1957-1960, URL: https://www.ijtsrd.com/papers/ijtsrd18206.pdf

Existing disk based recorded stockpiling frameworks are insufficient for Hadoop groups because of the obliviousness of information copies and the guide decrease programming model. To handle this issue, a deletion coded information chronicled framework called HD-FS is developed for Hadoop bunches, where codes are utilized to file information copies in the Hadoop dispersed document framework or HD-FS. Here there are two chronicled systems that HDFS-Grouping and HDFS-Pipeline in HDFS to accelerate the information documented process. HDFS-Grouping is a Map Reduce-based information chronicling plan - keeps every mapper's moderate yield Key-Value matches in a nearby key-esteem store and unions all the transitional key-esteem sets with a similar key into one single key-esteem combine, trailed by rearranging the single Key-Value match to reducers to create last equality squares. HDFS-Pipeline frames an information recorded pipeline utilizing numerous information hub in a Hadoop group. HDFS-Pipeline conveys the consolidated single key-esteem combine to an ensuing hub's nearby key-esteem store. Last hub in the pipeline is mindful to yield equality squares. HD-FS is executed in a true Hadoop group. The exploratory outcomes demonstrate that HDFS-Grouping and HDFS-Pipeline accelerate Baseline's rearrange and diminish stages by a factor of 10 and 5, individually. At the point when square size is bigger than 32 M-B, HD-FS enhances the execution of HDFS-RA-ID and HDFS-EC by roughly 31.8 and 15.7 percent, separately.

Hadoop distributed ?le system, replica-based storage clusters, archival performance, erasure codes, parallel encoding


IJTSRD18206
Volume-2 | Issue-5, August 2018
1957-1960
IJTSRD | www.ijtsrd.com | E-ISSN 2456-6470
Copyright © 2019 by author(s) and International Journal of Trend in Scientific Research and Development Journal. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0) (http://creativecommons.org/licenses/by/4.0)

International Journal of Trend in Scientific Research and Development - IJTSRD having online ISSN 2456-6470. IJTSRD is a leading Open Access, Peer-Reviewed International Journal which provides rapid publication of your research articles and aims to promote the theory and practice along with knowledge sharing between researchers, developers, engineers, students, and practitioners working in and around the world in many areas like Sciences, Technology, Innovation, Engineering, Agriculture, Management and many more and it is recommended by all Universities, review articles and short communications in all subjects. IJTSRD running an International Journal who are proving quality publication of peer reviewed and refereed international journals from diverse fields that emphasizes new research, development and their applications. IJTSRD provides an online access to exchange your research work, technical notes & surveying results among professionals throughout the world in e-journals. IJTSRD is a fastest growing and dynamic professional organization. The aim of this organization is to provide access not only to world class research resources, but through its professionals aim to bring in a significant transformation in the real of open access journals and online publishing.

Thomson Reuters
Google Scholer
Academia.edu

ResearchBib
Scribd.com
archive

PdfSR
issuu
Slideshare

WorldJournalAlerts
Twitter
Linkedin