Key Takeaways
- The autocorrelation function (ACF) measures the linear relationship between lagged values in a time series, with significance tested using Bartlett's formula where the standard error for lag k is approximately 1/sqrt(n) for large n, as detailed in Box-Jenkins methodology.
- Stationarity in time series requires constant mean, variance, and autocovariance, tested via Augmented Dickey-Fuller (ADF) test with null hypothesis of unit root, rejecting if test statistic < critical value at 5% level (e.g., -2.89 for n=100).
- Differencing a non-stationary series d times transforms it to stationarity, where d is determined by the number of unit roots, typically 0-2 for most economic series.
- SARIMA(p,d,q)(P,D,Q)s extends ARIMA with seasonal AR/MA, differencing Δ^D_s y_t at period s.
- ETS(A,N,N) is simple exponential smoothing, forecast ŷ_{t+h|t} = l_t, error variance σ²_h = σ² (1 + sum α^{2j}).
- Prophet model decomposes as g(t) + s(t) + h(t) + ε_t, with logistic growth g(t)= (C(t)/(1+exp(-(t-m)/δ))) and Fourier seasonal.
- In M3 forecasting competition (2000), Theta method won 21/24 monthly series categories with average sMAPE 10.52%.
- In M4 competition (2018), hybrid statistical/ML models like ES-RNN won overall with 9.4% MASE improvement over benchmarks.
- ARIMA used in 85% of corporate forecasting per Hyndman survey, but ML hybrids reduce error by 15-20% in retail sales.
- In finance, EGARCH asymmetry captures leverage effect, negative returns increase vol 1.5x positive.
- MASE normalizes MAE by in-sample naive forecast, scale-independent, M3 median 0.92 for winners.
- sMAPE = (1/n) sum |f-a| / (|f|+|a|)/2 *200%, symmetric, less biased than MAPE for zeros.
- In Python statsmodels, ARIMA forecast CI ±1.96 σ_h /sqrt(n) asymptotic normal.
- R forecast package by Hyndman auto.arima selects p,d,q via stepwise AICc, 10^6 models/sec T=1000.
- Python Prophet pip install prophet, fit(model.add_regressor('holiday'), changepoint_prior_scale=0.05).
This blog post covers the essential concepts and statistical methods for time series analysis.
Fundamentals
Fundamentals Interpretation
Key Models
Key Models Interpretation
Performance Metrics
Performance Metrics Interpretation
Real-World Applications
Real-World Applications Interpretation
Tools
Tools Interpretation
Trends
Trends Interpretation
Sources & References
- Reference 1OTEXTSotexts.comVisit source
- Reference 2STATSMODELSstatsmodels.orgVisit source
- Reference 3ENen.wikipedia.orgVisit source
- Reference 4ITLitl.nist.govVisit source
- Reference 5ROBJHYNDMANrobjhyndman.comVisit source
- Reference 6FACEBOOKfacebook.github.ioVisit source
- Reference 7NEURALPROPHETneuralprophet.comVisit source
- Reference 8ARXIVarxiv.orgVisit source
- Reference 9ENGeng.toronto.caVisit source
- Reference 10LIGHTGBMlightgbm.readthedocs.ioVisit source
- Reference 11SCIKIT-LEARNscikit-learn.orgVisit source
- Reference 12STATEPRESSstatepress.comVisit source
- Reference 13SCIENCEDIRECTsciencedirect.comVisit source
- Reference 14CFAPUBScfapubs.orgVisit source
- Reference 15FEDERALRESERVEfederalreserve.govVisit source
- Reference 16KAGGLEkaggle.comVisit source
- Reference 17SSRNssrn.comVisit source
- Reference 18ECBecb.europa.euVisit source
- Reference 19JSTORjstor.orgVisit source
- Reference 20ENGeng.uber.comVisit source
- Reference 21OPECopec.orgVisit source
- Reference 22NRELnrel.govVisit source
- Reference 23NEWYORKFEDnewyorkfed.orgVisit source
- Reference 24HBRhbr.orgVisit source
- Reference 25SASsas.upenn.eduVisit source
- Reference 26FORECASTERSforecasters.orgVisit source
- Reference 27TANDFONLINEtandfonline.comVisit source
- Reference 28GITHUBgithub.comVisit source
- Reference 29PKGpkg.robjhyndman.comVisit source
- Reference 30SKTIMEsktime.netVisit source
- Reference 31TSts.gluon.aiVisit source
- Reference 32UNIT8COunit8co.github.ioVisit source
- Reference 33FACEBOOKRESEARCHfacebookresearch.github.ioVisit source
- Reference 34PYFLUXpyflux.readthedocs.ioVisit source
- Reference 35NIXTLAVERSEnixtlaverse.nixtla.ioVisit source
- Reference 36ORACLEoracle.comVisit source
- Reference 37MATHWORKSmathworks.comVisit source
- Reference 38DOCUMENTATIONdocumentation.sas.comVisit source
- Reference 39IBMibm.comVisit source
- Reference 40KNIMEknime.comVisit source
- Reference 41HELPhelp.tableau.comVisit source
- Reference 42DOCSdocs.microsoft.comVisit source
- Reference 43DOCSdocs.h2o.aiVisit source
- Reference 44DOCdoc.dataiku.comVisit source
- Reference 45AWSaws.amazon.comVisit source
- Reference 46CLOUDcloud.google.comVisit source
- Reference 47MARKETSANDMARKETSmarketsandmarkets.comVisit source
- Reference 48GARTNERgartner.comVisit source
- Reference 49MCKINSEYmckinsey.comVisit source
- Reference 50ARMarm.comVisit source
- Reference 51NBERnber.orgVisit source






