Optimizers

chainer.optimizers.AdaDelta

Zeiler’s ADADELTA.

chainer.optimizers.AdaGrad

AdaGrad optimizer.

chainer.optimizers.Adam

Adam optimizer.

chainer.optimizers.CorrectedMomentumSGD

Momentum SGD optimizer.

chainer.optimizers.MomentumSGD

Momentum SGD optimizer.

chainer.optimizers.NesterovAG

Nesterov’s Accelerated Gradient.

chainer.optimizers.RMSprop

RMSprop optimizer.

chainer.optimizers.RMSpropGraves

Alex Graves’s RMSprop.

chainer.optimizers.SGD

Vanilla Stochastic Gradient Descent.

chainer.optimizers.SMORMS3

Simon Funk’s SMORMS3.

Optimizer base classes

chainer.Optimizer

Base class of all numerical optimizers.

chainer.UpdateRule

Base class of all update rules.

chainer.optimizer.Hyperparameter

Set of hyperparameter entries of an optimizer.

chainer.GradientMethod

Base class of all single gradient-based optimizers.

Hook functions

chainer.optimizer_hooks.WeightDecay

Optimizer/UpdateRule hook function for weight decay regularization.

chainer.optimizer_hooks.Lasso

Optimizer/UpdateRule hook function for Lasso regularization.

chainer.optimizer_hooks.GradientClipping

Optimizer hook function for gradient clipping.

chainer.optimizer_hooks.GradientHardClipping

Optimizer/UpdateRule hook function for gradient clipping.

chainer.optimizer_hooks.GradientNoise

Optimizer/UpdateRule hook function for adding gradient noise.

chainer.optimizer_hooks.GradientLARS

Optimizer/UpdateRule hook function for layer wise adaptive rate scaling.