*Department of IT, Institute of Information Technology & Management, GGSIPU, New Delhi
**Student - MCA, Institute of Information Technology & Management, GGSIPU, New Delhi
Online published on 29 April, 2016.
In today's world, requirement of huge data is increasing rapidly with major security concern. Everyone wants their data to be secured with every aspect and dimension. If we talk about our personnel life everyone have data in huge quantity and of a huge variety (audio, video, text, chat, photos) and Professionally we have a large amount of data in field of media, healthcare, technology, private sector, science, sports which has to be stored so that security could be maintained with every aspect. Big data refers to management and analysis of huge amount of data that exceeds the capability and efficiency of traditional data with every dimension. Cloud computing can be viewed as a solution to store huge amount of data, but there are certain security concerns to deal with. Measures can be taken to provide incremental enhancements in securing the cloud that will ultimately provide us with a secure cloud.
To manage, identify and analyze complex data it is essential to store and share huge amount of data i.e. why big data is introduced to store large amount of data with great security. Big data was introduced to handle a large amount of data and also be processed massive quantity of data. Google has announced mapreduce framework to process large amount of data on hardware. Later on apache hadoop distributed file system is evolved as an efficient hardware component for cloud computing along with integrated part like map reduces. However hdfs and mapreduce were not quite efficient because they do not provide security to protect sensitive data. That is why hadoop was introduced to encourage security measures by using different technologies such as combining data mining technology. In this paper, we come up with some solution to provide security aspect in storing big data.
FLUME, Hadoop, HBASE, HIVE, PIG, SQOOP, ZOOKEEPER