StudyHub

ML/DL · Hub

ML foundations

Eight ideas every machine-learning project rests on: the learning paradigms, how to score classifiers and regressors, why models underfit or overfit, how regularization helps, how to evaluate honestly with cross-validation, how to prepare data, and how to avoid leakage.

Why it matters: most failed ML projects fail here, not in the choice of algorithm: a wrong metric, an overfit model, unscaled features or a leaky evaluation.

5 random questions mixed from all eight foundation pages.

Quick comparison

TopicKey quantityTypical mistake
ParadigmsLabels? Rewards?Calling a numeric prediction "classification"
Classification metricsPrecision, recall, F1Trusting accuracy on imbalanced data
Regression metricsMAE, MSE, $R^2$Comparing MSE across different scales
Bias–varianceTraining vs test errorJudging a model by training error
Regularization$\lambda$, L1 vs L2Not standardizing before penalising
Cross-validationMean ± spread of $k$ scoresPreprocessing outside the folds
Preprocessing$z = (x - \mu)/\sigma$Fitting the scaler on all data
Data leakage"Known at prediction time?"Future-only features

The eight foundation pages

Learning paradigms

Supervised, unsupervised, reinforcement.

labels → supervised · no labels → unsupervised

Study

Classification metrics

Confusion matrix, precision, recall, F1.

TP 40 · FP 10 · FN 20 · TN 30 → F1 0.73

Study

Regression metrics

MAE, MSE, RMSE and R².

MAE robust · MSE punishes big errors

Study

Bias–variance trade-off

Underfit, good fit, overfit.

error = bias² + variance + noise

Study

Regularization

L1 and L2 penalties on weights.

L2 shrinks · L1 shrinks and zeroes

Study

Cross-validation

Rotate the test fold k times.

k trainings · mean ± spread

Study

Preprocessing

Scale, encode, impute.

fit on train · apply everywhere

Study

Data leakage

When test or future information sneaks in.

too good to be true → check for leaks

Study

Which one to pick?

flowchart TD
  A{"Where are you in the project?"} -->|"framing the problem"| P["Learning paradigms"]
  A -->|"preparing data"| PR["Preprocessing"]
  PR --> DL["check for data leakage"]
  A -->|"choosing how to score"| M{"Category or number?"}
  M -->|category| CM["Classification metrics"]
  M -->|number| RM["Regression metrics"]
  A -->|"model fits badly"| BV["Bias-variance"]
  BV -->|overfitting| RG["Regularization"]
  A -->|"comparing models or settings"| CV["Cross-validation"]
      

Key points

External resources

Videos

Review schedule

Come back after 3, 7, 14, then 30 days. Spacing beats cramming.

Feynman prompt

Explain this topic in your own words, as if teaching a beginner.

Explain it in your own words first, then record a 2–3 minute video on your phone.

25:00

Ready to record? Open your phone camera now and record a 2–3 minute explanation.

My notes

Saved only in this browser (localStorage). Nothing is uploaded.