The Most Important Memory Rule Memorize this: Hidden layers → ReLU Binary classification → Sigmoid Multiclass classification → Softmax Multilabel classification → Sigmoid Regression → Linear An even easier memory sentence is: ReLU inside, Sigmoid for yes/no, Softmax for one-of-many, Sigmoid for many-of-many, Linear for numbers. 1. ReLU: The Default Choice for Hidden Layers ReLU […]
