Fast Approximation of the Gauss--Newton Hessian Matrix for the Multilayer Perceptron

We introduce a fast algorithm for entrywise evaluation of the Gauss--Newton Hessian (GNH) matrix for the fully connected feed-forward neural network. The algorithm has a precomputation step and a s...