International Journal of Scientific Engineering and Technology
  • Year: 2014
  • Volume: 3
  • Issue: 1

Big Data Problems: Understanding Hadoop Framework

  • Author:
  • G S Aditya Rao1,, Palak Pandey2
  • Total Page Count: 3
  • Page Number: 40 to 42

1B.tech in, Computer Sciences Engineering, University of Petroleum and Energy Studies

2B.tech in, Geo-Informatics Engineering, University of Petroleum and Energy Studies

* adyraj@rediff.com

Online published on 11 April, 2017.

Abstract

The IT Industry has Seen Revolution from Migrating from Standardization to Integration to Virtualization to Automation to the Cloud. Now The Industry is all set to spin around the commercialization that is data analytics-business intelligence. From all fields data is generating be IT any Industry Sector. Thus Volume, variety and Velocity of the data have been extremely high. Thus to handle such enormous data where traditional databases is not possible the problem of storage, Compution, Low network bandwidth and less fault tolerant which lead to the introduction of bigdata. In this paper we have focused on the backend architecture and working of the parts of the hadoop framework which are themap reduce for the computational and analytics section and the hadoop distributed file system (HDFS) for the storage section.

Keywords

Hadoop, HDFS, MapReduce, Jobtracker, Tasktracker, Namenode, D atanode