Luigi is a Python package that helps you build complex pipelines of batch jobs.
Read more
Tag: Hadoop
HDFS – distributed file system for large datasets
HDFS is Apache Hadoop’s distributed file system for large datasets, with replicated storage, NameNode high availability and erasure coding.
Read more
Alluxio – distributed caching and data access platform
Alluxio is a distributed caching and data access layer that accelerates analytics workloads across multiple underlying storage systems.
Read more