CLP (Compressed Log Processor) is an end-to-end log management system from YScope designed to reduce the storage footprint of large log collections while retaining practical access to the information they contain.
It is particularly suited to environments generating substantial quantities of machine-produced data, where retaining conventional text logs can consume significant storage. CLP combines compression, search, analytics and viewing rather than treating compression simply as an archival step. Its architecture also supports logging pipelines that encode data before it reaches long-term storage, making it applicable to both historical collections and continuously generated logs.
This is free and open source software.
Key Features
- Handles both structured JSON logs and unstructured free-text logs.
- Searches compressed log archives without first decompressing their contents.
- Provides an index-less approach to storing and querying log data.
- Includes web interfaces for searching and viewing stored logs.
- Provides logging libraries that compress messages in real time.
- Supports integrations with Python and Java logging environments.
- Uses a purpose-built intermediate representation for compact log storage and transmission.
- Supports further compression of intermediate-representation data into searchable archives.
- Offers filtering of compressed logs according to information such as log severity.
- Includes libraries for analyzing compressed intermediate-representation data from Python and Go applications.
- Provides a custom pushdown-automata-based parser for recognizing structure in log messages.
- Supports distributed compression and search deployments.
- Provides datasets and tooling for evaluating compression and query behaviour.
Website: github.com/y-scope/clp
Support:
Developer: YScope
License: Apache License 2.0
CLP is written in C++. Learn C++ with our recommended free books and free tutorials.
Related Software
| Log Analyzers | |
|---|---|
| Kibana | Browser based interface for logstash and ElasticSearch |
| logstash | Log processing, search, and analytics |
| OpenObserve | Cloud-native observability platform |
| GoAccess | Real-time web log analyzer and interactive viewer |
| Fluentd | Data collector for unified logging layer |
| Loki | Horizontally-scalable, highly-available, multi-tenant log aggregation system |
| Graphite | Enterprise scalable realtime graphing |
| SigNoz | Monitor your applications and troubleshoot problems |
| Apache Flume | Delivers data from applications to Apache Hadoop's HDFS |
| OpenTSDB | Scalable, distributed Time Series Database |
| VictoriaLogs | High-performance log database designed to ingest, store, and query log data |
| syslog-ng | Collects, filters, and routes logs across systems |
| CLP | Compresses logs for efficient search and analysis |
| Matomo SLA | Imports web server logs into Matomo for analysis |
Read our verdict in the software roundup.
 LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more. Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion. Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README. |
Please read our Comment Policy before commenting.