Apache Flume Training

Apache Flume Training is skilfully incorporated to enrich the trainers with Apache Solr and learn all that is required to refine and visualize server log data, and also to observe how Hadoop takes server-log analysis to the next level by speeding forensics.

Apache Flume Training Curriculum

Introduction

Overview

Architecture

Data flow mode

Reliability and Recoverability

Setting up an agent

Configuring individual components

Wiring the pieces together

Data ingestion
Executing Commands

Network streams
Setting Multi-Agent Flow

Consolidation

Multiplexing the flow

Configuration

Defining the flow

Configuring individual components

Adding multiple flows in an agent
Configuring A Multi Agent Flow

Fan out flow

Flume Sources

Avro Source, Exec Source

NetCat Source

Sequence Generator Source

Syslog Sources

Syslog TCP Source

Syslog UDP Source

Legacy Sources

Avro Legacy Source

Thrift Legacy Source

Custom Source
Flume Sinks

HDFS Sink

Logger Sink

Avro Sink

IRC Sink

File Roll Sink

Null Sink

HbaseSinks

HbaseSink

AsyncHBaseSink

Custom Sink
Flume Channels

Memory Channel

JDBC Channel

Recoverable Memory Channel

File Channel, Pseudo Transaction Channel

Custom Channel

Flume Channel Selectors

Replicating Channel Selector

Multiplexing Channel Selector

Custom Channel Selector
Flume Sink Processors

Default Sink Processor

Failover Sink Processor

Load balancing Sink Processor

Custom Sink Processor
Flume Interceptors

Timestamp Interceptor

Host Interceptor

Flume Properties

Property
Security

Monitoring

Troubleshooting

Handling agent failures

Compatibility

HDFS

AVRO.