Improving First-Order Optimization Algorithms (Student Abstract)

2020-06-02

Proceedings of the AAAI Conference on Artificial Intelligence, 34

Volume

Vol. 34 No. 10: Issue 10: AAAI-20 Student Tracks

Student Abstract Track

This paper presents a simple and intuitive technique to accelerate the convergence of first-order optimization algorithms. The proposed solution modifies the update rule, based on the variation of the direction of the gradient and the previous step taken during training. Results after tests show that the technique has the potential to significantly improve the performance of existing first-order optimization algorithms.

10.1609/aaai.v34i10.7240