neural-net

10 problems

• Linear forward (Wx + b)Easy
• ReLU forward + backwardEasy
• Sigmoid forward + backwardEasy
• MSE loss + backwardEasy
• Linear backward (chain rule)Medium
• SGD step (in place)Easy
• Train a 2-layer MLP on XORHard
• Leaky ReLU activationEasy
• SELU activationEasy
• Swish / SiLU activationEasy