Deep Learning

tinygrad – compact end-to-end deep learning stack

tinygrad is a compact end-to-end deep learning stack designed to sit somewhere between PyTorch and micrograd. It combines a tensor library, automatic differentiation, compiler, JIT execution, and neural network facilities in a deliberately small and hackable codebase.

Its execution engine supports a wide range of hardware backends while exposing much of the compiler and intermediate representation to developers.

This is free and open source software.

Key Features

  • Tensor library with automatic differentiation.
  • Intermediate representation and compiler for lowering computational kernels.
  • Lazy execution enables operations to be fused into efficient kernels.
  • JIT compilation and graph execution.
  • Includes neural network layers and optimisers.
  • Supports familiar PyTorch-style training loops.
  • Provides datasets and other components needed for model training.
  • Runs on CPUs and numerous hardware accelerators.
  • Supports CUDA, AMD, Metal, OpenCL, Qualcomm, and WebGPU backends.
  • Compiler and intermediate representation are designed to remain readable and hackable.
  • Small codebase intended to minimise complexity.

Website: https://github.com/tinygrad/tinygrad
Support:
Developer: tiny corp
License: MIT License

tinygrad is written in Python and C. Learn Python with our recommended free books and free tutorials. Learn C with our recommended free books and free tutorials.


Related Software

Deep Learning with Python
TensorFlowA very popular Deep Learning framework
PyTorchTensors and Dynamic neural networks in Python
KerasHigh-level neural networks API
fastaiSimplifies training fast and accurate neural networks
tinygradCompact, lightweight deep learning framework
PyTorch LightningFramework for scaling PyTorch training workflows
JAXHigh-performance numerical computing and ML library
PyTensorLibrary for fast numerical computation
MindSporeFramework for training and deploying neural networks
ElephasDistributed deep learning with Keras and Spark
ChainerPowerful, flexible, and intuitive framework for neural networks
EquinoxNeural network library for building flexible models with JAX
CaffeConvolutional Architecture for Fast Feature Embedding
TFlearnDeep learning library featuring a higher-level API for TensorFlow
MXNetFlexible and efficient library
CNTKDistributed deep learning
NeupyPython library for neural networks and deep learning

Read our verdict in the software roundup.


Best Free and Open Source Software LinuxLinks helps you discover the best free and open source software for Linux. Explore our extensive collection of recommended applications, including alternatives to popular proprietary software.

We also publish software reviews, Linux tutorials, hardware reviews, free programming books and articles covering the wider open source community. Browse our Linux resources to discover more.

Know a useful free and open source Linux application we haven't covered? Suggest a program for inclusion.

Has your software been featured on LinuxLinks? Display one of our Featured on LinuxLinks badges on your website or GitHub README.
Subscribe

Please read our Comment Policy before commenting.

Notify of
guest
0 Comments
Oldest
Newest Most Voted