Data, Methods, and the Limits of Forecasts
In forecasting, the key is not the method but the fit between data and the task. Every forecast depends on which data we use and what remains after removing noise. There are three levels. Raw data. Observations, prices, news. Without interpretation — just a stream. Processing. Smoothing, filters, feature selection. An attempt to preserve structure and remove the rest. Models. From simple heuristics to statistics and ML. The model should be simple enough to work, and complex enough to reflect probability. ...