data processing Archives

yq – command-line YAML, XML and TOML processor

yq processes YAML, XML and TOML files using jq filters, supporting format conversion, in-place editing and preservation of comments.

zsv is a high-performance CSV parser and extensible command-line tool with SIMD acceleration, SQL queries, conversion and data viewing.

pyjanitor adds readable DataFrame cleaning operations for column names, reshaping, conditional joins, missing values and transformation.

Logstash collects, parses, transforms and routes events through configurable pipelines with inputs, filters, outputs and plugins.

Polars provides fast DataFrame analysis with lazy queries, expressive transformations, joins, streaming execution and data scanning.

AWS SDK for pandas connects pandas DataFrames to Amazon S3, Athena, Glue, Redshift and other AWS data processing and analytics services.

Apache UIMA builds text-analysis pipelines with typed annotations, reusable components, CAS data structures and Java integration.

Nuclio processes real-time events using serverless functions, streaming triggers, Kubernetes deployment, and CPU or GPU execution.