https://t-redactyl.io/series/machine-learning-from-scratch/Recent content in Machine Learning From Scratch on Standard errorHugoen-usMon, 02 Mar 2026 00:00:00 +0000https://t-redactyl.io/posts/2026-03-02-ols-regression-from-scratch-in-python/Mon, 02 Mar 2026 00:00:00 +0000https://t-redactyl.io/posts/2026-03-02-ols-regression-from-scratch-in-python/<p>Almost six years ago (which means this blog is &hellip; old), I wrote what has become <a href="https://t-redactyl.io/posts/2020-07-13-linear-algebra-ols-regression/">one of my favourite blog posts</a>), explaining the linear algebra approach to linear regression (specifically to OLS, or ordinary least square regression). I was recently rereading it, and I realised that there are some steps I skipped which might not be intuitive for people without a background in linear algebra. As such, in this blog post I will build this algorithm from scratch in Python, showing you step-by-step how the algorithm works. To really show you exactly what's going on under the hood, I'll be building all methods from scratch rather than using the corresponding Numpy operations.</p>