< radamsgd optimizer/ >
RAdamSGD Optimizer
Machine Learning / Optimization
Speed3.8-5x Faster
Project Overview
Novel optimizer blending RAdam & SGD via instability-driven switching; 3.8-5x faster convergence than Adam/SGD and only sampled optimizer to converge on ill-conditioned quadratics.
Collaborators
Independent project.