CLP (Compressed Log Processor) is an end-to-end log management system from YScope designed to reduce the storage footprint of large log collections while retaining practical access to the information they contain.
It is particularly suited to environments generating substantial quantities of machine-produced data, where retaining conventional text logs can consume significant storage. CLP combines compression, search, analytics and viewing rather than treating compression simply as an archival step. Its architecture also supports logging pipelines that encode data before it reaches long-term storage, making it applicable to both historical collections and continuously generated logs.
This is free and open source software.
Key Features
- Handles both structured JSON logs and unstructured free-text logs.
- Searches compressed log archives without first decompressing their contents.
- Provides an index-less approach to storing and querying log data.
- Includes web interfaces for searching and viewing stored logs.
- Provides logging libraries that compress messages in real time.
- Supports integrations with Python and Java logging environments.
- Uses a purpose-built intermediate representation for compact log storage and transmission.
- Supports further compression of intermediate-representation data into searchable archives.
- Offers filtering of compressed logs according to information such as log severity.
- Includes libraries for analyzing compressed intermediate-representation data from Python and Go applications.
- Provides a custom pushdown-automata-based parser for recognizing structure in log messages.
- Supports distributed compression and search deployments.
- Provides datasets and tooling for evaluating compression and query behaviour.
Website: github.com/y-scope/clp
Support:
Developer: YScope
License: Apache License 2.0
CLP is written in C++. Learn C++ with our recommended free books and free tutorials.
Related Software
| Log Analyzers | |
|---|---|
| Kibana | Browser based interface for logstash and ElasticSearch |
| logstash | Log processing, search, and analytics |
| OpenObserve | Cloud-native observability platform |
| GoAccess | Real-time web log analyzer and interactive viewer |
| Fluentd | Data collector for unified logging layer |
| Loki | Horizontally-scalable, highly-available, multi-tenant log aggregation system |
| Graylog2 | Log management solution implementation storing logs in ElasticSearch |
| Graphite | Enterprise scalable realtime graphing |
| SigNoz | Monitor your applications and troubleshoot problems |
| Apache Flume | Delivers data from applications to Apache Hadoop's HDFS |
| OpenTSDB | Scalable, distributed Time Series Database |
| VictoriaLogs | High-performance log database designed to ingest, store, and query log data |
| Scribe | Server for aggregating log data that is streamed in real time from clients |
| LogoRRR | Cross-platform log analysis tool |
| Chukwa | Hadoop sub-project devoted to large-scale log collection and analysis |
Read our verdict in the software roundup.
 Explore our carefully curated directory of recommended free and open source software, covering every major software category.The directory forms part of our extensive collection of articles for Linux enthusiasts. It includes hundreds of detailed reviews, together with free and open source alternatives to proprietary software from companies such as Google, Microsoft, Apple, Adobe, IBM, Cisco, Oracle, and Autodesk. LinuxLinks also covers interesting projects worth exploring, Linux-compatible hardware, free programming books and tutorials, and much more. Know a useful free and open source Linux application that we haven’t covered? Tell us about it using our submission form. |
Please read our Comment Policy before commenting.