Apache Solr – On Hadoop
Solr can be used along with Hadoop. As Hadoop handles a large amount of data, Solr helps us in finding the required information from such a large source. In this…
Hadoop – Multi-Node Cluster
This chapter explains the setup of the Hadoop Multi-Node cluster on a distributed environment. As the whole cluster cannot be demonstrated, we are explaining the Hadoop cluster environment using three…
Hadoop – Streaming
Hadoop streaming is a utility that comes with the Hadoop distribution. This utility allows you to create and run Map/Reduce jobs with any executable or script as the mapper and/or…
Hadoop – MapReduce
MapReduce is a framework using which we can write applications to process huge amounts of data, in parallel, on large clusters of commodity hardware in a reliable manner. What is…
Apache Flume – Environment
We already discussed the architecture of Flume in the previous chapter. In this chapter, we will discuss about apache flume environment let us see how to download and setup Apache…
Hadoop – Command Reference
There are many more commands in "$HADOOP_HOME/bin/hadoop fs" than are demonstrated here, although these basic operations will get you started. Running ./bin/hadoop dfs with no additional arguments will list all the commands…
Hadoop – HDFS Operations
Starting HDFS Initially you have to format the configured HDFS file system, open namenode (HDFS server), and execute the following command. $ hadoop namenode -format After formatting the HDFS, start…
Hadoop – HDFS Overview
Hadoop File System was developed using distributed file system design. It is run on commodity hardware. Unlike other distributed systems, HDFS is highly faulttolerant and designed using low-cost hardware. HDFS…
Apache Flume – Data Transfer In Hadoop
Here we will discus apache flume data transfer in hadoop and Big Data, as we know, is a collection of large datasets that cannot be processed using traditional computing techniques. Big…
Hadoop – Enviornment Setup
Hadoop is supported by GNU/Linux platform and its flavors. Therefore, we have to install a Linux operating system for setting up Hadoop environment. In case you have an OS other…