03 Loss Minimisation for Decisions, Boosting, Forests

In block 03 we cover:

• Decision Trees
• Loss functions
• Boosting
• Bagging
• Stacking
• Random Forests

Lectures:

Trees and Losses:

• 03.1 Decision Trees
  • Reference Python code (03.2-RandomForestSlideContent.ipynb)
• 3.1.P Portfolio on Decision Trees and Loss
• Second unexamined 3.1.P2 Portfolio on Regression Trees

Bagging, Forests, Boosting, Stacking:

• 03.2 Ensembles, Forests and Boosting
  • Reference Python code (03.2-RandomForestSlideContent.ipynb)
• 3.2.P Portfolio on Boosting

Workshop:

• 03.3.1 Classification (.Rmd)
• 03.3.1 Classification (.html)
• 03.3.2 Classification in Python (.ipynb)

Assessments:

• The main long form portfolio Portfolio 3.
• Block03 on Noteable via Blackboard (2026-27 link)

Navigation

Previous: Block 02. Next: Block 04.