activation

9 problems

• ReLU forward + backwardEasy
• Sigmoid forward + backwardEasy
• Dynamic-Tanh (DyT)Medium
• GELU backward (tanh approximation)Medium
• GELU forward (tanh approximation)Easy
• Leaky ReLU activationEasy
• SELU activationEasy
• SwiGLU activationMedium
• Swish / SiLU activationEasy