Technical notes 2026 Duality theory — Jan 12 2025 Nonlinear optimization — Dec 22 Gradient and stochastic gradient descent — Nov 17 Gradient descent for neural networks with automatic differentiation — Oct 14 Little-oh, the derivative, Taylor's formula — Oct 11 L-smoothness and strong convexity — Oct 10