Generalizing Automatic Differentiation to Automatic Sparsity, Uncertainty, Stability, and Parallelism
Automatic differentiation is a "compiler trick" whereby a code that calculates f(x) is transformed into a code that calculates f'(x). This trick and its two forms, forward and reverse mode automati...
Read It