Author: S K S

Take a look at the following illustration. It shows the cluster diagram of Kafka. Here we will discuss about cluster architecture of apache kafka. The following table describes each of…

Here we will discuss fundamentals of apache kafka and Before moving deep into the Kafka, you must aware of the main terminologies such as topics, brokers, producers and consumers. The…

Apache Kafka was originated at LinkedIn and later became an open sourced Apache project in 2011, then First-class Apache project in 2012. Kafka is written in Scala and Java. Apache…

Here we will discus about apache flume netcat source. This chapter takes an example to explain how you can generate events and subsequently log them into the console. For this,…

Here we will discuss about apache flume sequence generator source. In the previous chapter, we have seen how to fetch data from twitter source to HDFS. This chapter explains how…

Here we will discuss about apache flume fetching twitter data. Using Flume, we can fetch data from various services and transport it to centralized stores (HDFS and HBase). This chapter…

Here we will discuss about apache flume configuration. After installing Flume, we need to configure it using the configuration file which is a Java property file having key-value pairs. We need…

Here we will discuss about apache flume data flow. Flume is a framework which is used to move log data into HDFS. Generally events and log data are generated by…

Here WE will discuss about apache flume architecture. The following illustration depicts the basic architecture of Flume. As shown in the illustration, data generators (such as Facebook, Twitter) generate data which gets…