03 Loss Minimisation for Decisions, Boosting, Forests

In block 03 we cover:

• Decision Trees
• Loss functions
• Boosting
• Bagging
• Stacking
• Random Forests

Lectures:

Trees and Losses:

• 03.1 Decision Trees
  • Reference R code
• 03.1.P Portfolio on Decision Tree and Loss
• Second unexamined 03.1.P2 Regression Trees

Bagging, Forests, Boosting, Stacking:

• 03.2 Ensembles, Forests and Boosting
  • Reference Python code
• 03.2.P Portfolio on Boosting
• Second unexamined 03.1.P2 Regression Trees

Workshop:

• 03.3.1 Classification (.Rmd)
• 03.3.1 Classification (.html)
• 03.3.2 Classification in python (.ipynb)

Assessments:

• The main long form portfolio Portfolio 3.
• Block03 on Noteable via Blackboard (2026-27 link)

Navigation

Previous: Block 02. Next: Block 04.