Statistics How To

ARMA model

Statistics Definitions >

An ARMA model, or Autoregressive Moving Average model, is used to describe weakly stationary stochastic time series in terms of two polynomials. The first of these polynomials is for autoregression, the second for the moving average.

Often this model is referred to as the ARMA(p,q) model; where:

  • p is the order of the autoregressive polynomial,
  • q is the order of the moving average polynomial.

The equation is given by:
arma model

Where:

  • φ = the autoregressive model’s parameters,
  • θ = the moving average model’s parameters.
  • c = a constant,
  • ε = error terms (white noise).

Difference Between an ARMA model and ARIMA

The two models share many similarities. In fact, the AR and MA components are identical, combining a general autoregressive model AR(p) and general moving average model MA(q). AR(p) makes predictions using previous values of the dependent variable. MA(q) makes predictions using the series mean and previous errors.

What sets ARMA and ARIMA apart is differencing. An ARMA model is a stationary model; If your model isn’t stationary, then you can achieve stationarity by taking a series of differences. The “I” in the ARIMA model stands for integrated; It is a measure of how many nonseasonal differences are needed to achieve stationarity. If no differencing is involved in the model, then it becomes simply an ARMA.

A model with a dth difference to fit and ARMA(p,q) model is called an ARIMA process of order (p,d,q). You can select p,d, and q with a wide range of methods, including AIC, BIC, and empirical autocorrelations (Petris, 2009).

Another, similar model is ARIMAX, which is just an ARIMA with additional explanatory variables.

References

Petris, G. et al. (2009). Dynamic Linear Models with R. Springer Science & Business Media.

------------------------------------------------------------------------------

Need help with a homework or test question? With Chegg Study, you can get step-by-step solutions to your questions from an expert in the field. Your first 30 minutes with a Chegg tutor is free!

Statistical concepts explained visually - Includes many concepts such as sample size, hypothesis tests, or logistic regression, explained by Stephanie Glen, founder of StatisticsHowTo.

Comments? Need to post a correction? Please post a comment on our Facebook page.

Check out our updated Privacy policy and Cookie Policy