Posts

  • Readings

    List of things I’ve been reading. Only adding things that I’ve read thoroughly and understand beyond a superficial level.

  • Hutchinson's Diagonal Estimator

    In this post, we’ll take a look at a method of approximating large Hessian matrices using a stochastic diagonal estimator. Hutchinson’s method can be used for optimization and loss-landscape analysis in deep neural networks.