optimization

15 problems

• Adadelta optimizerMedium
• Adagrad optimizerEasy
• Adam optimiser stepMedium
• Adamax optimizerMedium
• AdamW step (decoupled weight decay)Medium
• SGD step (in place)Easy
• Warmup + cosine decay LR scheduleEasy
• Exponential LR schedulerEasy
• Clip gradients by global L2 normEasy
• Linear regression — gradient descentEasy
• Lion optimizer stepMedium
• Nesterov accelerated gradientMedium
• RMSprop optimizerEasy
• SGD with momentum (one step)Easy
• Step LR schedulerEasy