An introduction to automatic differentiation

This thesis is an exposition of the article Arithmetic of Differentiation by L.B Rall. It gives a comprehensive account of automatic differentiation. Automatic differentiation is a technique where it is possible to solve for derivatives without the use of its definition or various formulas. Rather, it offers an alternative option of solving for derivatives by simple arithmetic. Using this, one can solve for both the value of the function and its corresponding derivative evaluated at a given value. All of the formulas stated in this thesis are given in the article. The researchers provided the complete proofs and concrete examples for properties that were described by the author