Applied Statistics

The Frisch–Waugh–Lovell Theorem

Introduction In a standard multiple linear regression model, the effect of a predictor is typically estimated by including all variables simultaneously in the model. However, the Frisch–Waugh–Lovell (FWL) theorem states that any coefficient in a multiple regression model can be equivalently obtained by regressing both the dependent variable and the regressor of interest against all […]

The Frisch–Waugh–Lovell Theorem Read More »

Box-Jenkins Methodology in R

The Box-Jenkins methodology is a systematic approach to identifying, estimating, and evaluating models for time series data, particularly those represented by the AutoRegressive Integrated Moving Average (ARIMA) processes. The method consists of four main stages: model identification, parameter estimation, diagnostic checking, and forecasting. In this post, we’ll work through each stage of the Box-Jenkins process

Box-Jenkins Methodology in R Read More »

How to Interpret Multiple Regression Output in R

Multiple linear regression is a statistical model used to predict the response variable based on two or more explanatory variables. Unlike simple regression, which includes only one explanatory variable, multiple regression takes into account the effect of multiple variables simultaneously, resulting in more accurate predictions. The multiple regression model is typically written as follows: \(

How to Interpret Multiple Regression Output in R Read More »