Perspectives on Natural Gradient Descent
This slides contain results on connecting first-order descent methods with physics. By deriving a general form for gradient-based methods like vanilla descent, mirror descent, etc, it reveals potential connection to Einstein's theory.