osc.lr_scheduler.LinearWarmupCosineAnneal

class LinearWarmupCosineAnneal(optimizer, warmup_steps, decay_steps, end_lr)

Bases: object

Increase LR linearly, then decay with cosine annealing

Methods

step