Apache Flume is an open source, scalable, distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.
The system is centrally managed and allows for intelligent dynamic management. It uses a simple extensible data model that allows for online analytic applications.
The main goal of Apache Flume is to deliver data from applications to Apache Hadoop’s HDFS. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic applications.
- Complex flows:
- build multi-hop flows where events travel through multiple agents before reaching the final destination.
- fan-in and fan-out flows.
- contextual routing.
- backup routes (fail-over) for failed hops.
- Channel-based transactions to guarantee reliable message delivery.
- Supports a durable file channel which is backed by the local file system. Events are staged in the channel, which manages recovery from failure.
- High performance persistent channel – the File Channel.
- ElasticSearch Sink.
- Create a SpoolDirectory Source and Client.
- Regex Extractor Interceptor.
- Load Balancing RPC client.
- Hive Sink based on the new Hive Streaming support.
- End to End authentication in Flume.
- Simple regex search-and-replace interceptor.
|The largest compilation of the best free and open source software in the universe. Each article is supplied with a legendary ratings chart helping you to make informed decisions.
|Hundreds of in-depth reviews offering our unbiased and expert opinion on software. We offer helpful and impartial information.
|Replace proprietary software with open source alternatives: Google, Microsoft, Apple, Adobe, IBM, Autodesk, Oracle, Atlassian, Corel, Cisco, Intuit, and SAS.
|Awesome Free Linux Games Tools showcases a series of tools that making gaming on Linux a more pleasurable experience. This is a new series.
|Machine Learning explores practical applications of machine learning and deep learning from a Linux perspective. We've written reviews of more than 40 self-hosted apps. All are free and open source.
|New to Linux? Read our Linux for Starters series. We start right at the basics and teach you everything you need to know to get started with Linux.
|Alternatives to popular CLI tools showcases essential tools that are modern replacements for core Linux utilities.
|Essential Linux system tools focuses on small, indispensable utilities, useful for system administrators as well as regular users.
|Linux utilities to maximise your productivity. Small, indispensable tools, useful for anyone running a Linux machine.
|Surveys popular streaming services from a Linux perspective: Amazon Music Unlimited, Myuzi, Spotify, Deezer, Tidal.
|Saving Money with Linux looks at how you can reduce your energy bills running Linux.
|Home computers became commonplace in the 1980s. Emulate home computers including the Commodore 64, Amiga, Atari ST, ZX81, Amstrad CPC, and ZX Spectrum.
|Now and Then examines how promising open source software fared over the years. It can be a bumpy ride.
|Linux at Home looks at a range of home activities where Linux can play its part, making the most of our time at home, keeping active and engaged.
|Linux Candy reveals the lighter side of Linux. Have some fun and escape from the daily drudgery.
|Getting Started with Docker helps you master Docker, a set of platform as a service products that delivers software in packages called containers.
|Best Free Android Apps. We showcase free Android apps that are definitely worth downloading. There's a strict eligibility criteria for inclusion in this series.
|These best free books accelerate your learning of every programming language. Learn a new language today!
|These free tutorials offer the perfect tonic to our free programming books series.
|Linux Around The World showcases usergroups that are relevant to Linux enthusiasts. Great ways to meet up with fellow enthusiasts.
|Stars and Stripes is an occasional series looking at the impact of Linux in the USA.