Regularizers

L1 Regularization

• Description: Adds the absolute value of weights to the loss function to encourage sparsity.
• Function: float l1(float x, float y, float lr, float *w, float *b, float *v_w, float *v_b, float *s_w, float *s_b, float beta1, float beta2, float epsilon)
• File: l1.c

L2 Regularization

• Description: Adds the squared value of weights to the loss function to prevent overfitting.
• Function: float l2(float x, float y, float lr, float *w, float *b, float *v_w, float *v_b, float *s_w, float *s_b, float beta1, float beta2, float epsilon, float reg_l2)
• File: l2.c

Combined L1-L2 Regularization

• Description: Combines L1 and L2 regularization techniques.
• Function: float l1_l2(float *w, float *dw, float l1, float l2, int n)
• File: l1_l2.c