A deep learning framework replaces hand-written low-level gradient code with reusable tools for building and training neural networks. Keras, JAX, TensorFlow, and PyTorch are prominent examples. section 3.1
A modern framework combines three capabilities:
- Automatic differentiation computes gradients for arbitrary differentiable functions. section 3.1
- Tensor computation runs on CPUs, GPUs, and potentially specialized deep learning hardware. section 3.1
- Distributed execution spreads computation across multiple devices or computers. section 3.1
Why frameworks matter
Instead of writing gradient logic by hand in C++ and targeting one GPU with custom CUDA code, use a framework that packages differentiation, tensor execution, and distribution. section 3.1


