Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus.
It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream.
This is free and open source software.
A Loki-based logging stack consists of 3 components:
- promtail is the agent, responsible for gathering logs and sending them to Loki.
- loki is the main server, responsible for storing logs and processing queries.
- Grafana for querying and displaying the logs.
Key Features
- Stores compressed, unstructured logs and only indexing metadata, Loki is simple to operate and cheaper to run. Send logs in any format, from any source, using a wide array of clients.
- 100% persistence to object storage.
- Build metrics and generate alerts from your log lines.
- Indexes and groups log streams using the same labels you’re already using with Prometheus, enabling you to seamlessly switch between metrics and logs using the same labels that you’re already using with Prometheus.
- Tail your logs in realtime to see the logs as they come into the system, update the logs after every certain time, view logs for a particular date, etc.
- Works well for storing Kubernetes Pod logs. Metadata such as Pod labels is automatically scraped and indexed.
- Native support in Grafana (needs Grafana v6.0).
Website: grafana.com/oss/loki
Support: GitHub Code Repository
Developer: Grafana Labs
License: GNU Affero General Public License v3.0
Loki is written in Go. Learn Go with our recommended free books and free tutorials.
Related Software
| System Monitoring Tools | |
|---|---|
| Prometheus | Systems and service monitoring system |
| Nagios | Host and service monitor designed to inform you of network problems |
| OpenNMS | Enterprise grade network monitoring platform |
| LibreNMS | Fully featured network monitoring system |
| SigNoz | Monitor your applications and troubleshoot problems |
| ZABBIX | All-in-one 24x7 free monitoring solution |
| Jaeger | Distributed tracing system |
| Beszel | Lightweight server monitoring platform |
| Loki | Horizontally-scalable, highly-available, multi-tenant log aggregation system |
| Cockpit | Sysadmin login session in a web browser |
| Monit | Utility for managing and monitoring processes, files, directories and filesystems |
| HyperDX | Cloud-based production monitoring and debugging tool |
| NetXMS | Network and infrastructure monitoring and management system |
| FreeNATS | Automatic network status testing, alerting and reporting package |
| Cacti | Web-based frontend to RRDtool |
| Monitorix | Lightweight system monitoring tool |
| Icinga | Monitoring platform with a powerful configuration language |
| Checkmk | IT monitoring platform |
| Munin | Networked resource monitoring tool designed to be plug and play |
| Shinken | Flexible and scalable monitoring framework |
| Pandora FMS | Flexible monitoring system |
| Xymon | System for monitoring of hosts and networks |
| Mon | General-purpose problem alerting system |
Read our verdict in the software roundup.
| Log Analyzers | |
|---|---|
| Kibana | Browser based interface for logstash and ElasticSearch |
| logstash | Log processing, search, and analytics |
| Fluentd | Data collector for unified logging layer |
| Loki | Horizontally-scalable, highly-available, multi-tenant log aggregation system |
| Graylog2 | Log management solution implementation storing logs in ElasticSearch |
| Graphite | Enterprise scalable realtime graphing |
| SigNoz | Monitor your applications and troubleshoot problems |
| Apache Flume | Delivers data from applications to Apache Hadoop's HDFS |
| OpenTSDB | Scalable, distributed Time Series Database |
| LogoRRR | Cross-platform log analysis tool |
| Scribe | Server for aggregating log data that is streamed in real time from clients |
| Chukwa | Hadoop sub-project devoted to large-scale log collection and analysis |
Read our verdict in the software roundup.
 Explore our comprehensive directory of recommended free and open source software. Our carefully curated collection spans every major software category.This directory is part of our ongoing series of informative articles for Linux enthusiasts. It features hundreds of detailed reviews, along with open source alternatives to proprietary solutions from major corporations such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. You’ll also find interesting projects to try, hardware coverage, free programming books and tutorials, and much more. Discovered a useful open source Linux program that we haven’t covered yet? Let us know by completing this form. |