Posts

1) Interview Questions on Big Data

1. What is the difference between Hadoop and Traditional RDBMS? Hadoop vs RDBMS Criteria Hadoop RDBMS Datatypes Processes semi-structured and unstructured data. Processes structured data. Schema Schema on Read Schema on Write Best Fit for Applications Data discovery and Massive Storage/Processing of Unstructured data. Best suited for OLTP and complex ACID transactions. Speed Writes are Fast Reads are Fast 2.  What do the four V’s of Big Data denote?    The four critical features of big data: a) Volume –Scale of data b) Velocity –Analysis of streaming data c) Variety – Different forms of data d) Veracity –Uncertainty of data 3. How big data analysis helps businesses increase their revenue? Give example. Big data analysis is helping businesses differentiate themselves – for example Walmart the world’s largest retailer in 2014 in terms of revenue - is using big data analytics to increase its sales through better predictive analytics, providing cu...

Single Node Hadoop Installation

HADOOP INSTALLATION This section refers to the installation settings of Hadoop on a standalone system as well as on a system existing as a node in a cluster. SINGLE-NODE INSTALLATION Running Hadoop on Ubuntu  The report here will describe the required steps for setting up a single-node Hadoop cluster backed by the Hadoop Distributed File System, running on Ubuntu Linux. Hadoop is a framework written in Java for running applications on large clusters of commodity hardware and incorporates features similar to those of the Google File System (GFS) and of the MapReduce computing paradigm. Hadoop’s HDFS is a highly fault-tolerant distributed file system and, like Hadoop in general, designed to be deployed on low-cost hardware. It provides high throughput access to application data and is suitable for applications that have large data sets. DataNode: A DataNode stores data in the Hadoop File System. A functional file system has more than one DataNode, with the data...