The following list contains the optimizers available in the VES code.
OPT_ADAM | Adaptive moment estimation (ADAM) optimizer. |
OPT_AVERAGED_SGD | Averaged stochastic gradient decent with fixed step size. |
OPT_DUMMY | Dummy optimizer for debugging. |
OPT_ROBBINS_MONRO_SGD | Robbins-Monro stochastic gradient decent. |