Error Statistics for the Survey of Professional Forecasters for Industrial Production [QA] Release Date: 11/18/2011 Tom Stark Assistant Director and Manager Real-Time Data Research Center Economic Research Department Federal Reserve Bank of Philadelphia 1. OVERVIEW. This document reports error statistics for median projections from the Survey of Professional Forecasters (SPF), conducted since 1990 by the Federal Reserve Bank of Philadelphia. We provide the results in a series of tables and, in the PDF version of this document, a number of charts. The tables show the survey variable forecast and, importantly, the transformation of the data that we used to generate the statistics. (The transformation is usually a quarter-over-quarter growth rate, expressed in annualized percentage points. However, some variables, such as interest rates, the unemployment rate, and housing starts are untransformed and, thus, expressed in their natural units.) The paragraphs below explain the format of the tables and charts and the methods used to compute the statistics. These paragraphs are general. The same discussion applies to all variables in the survey. 2. DESCRIPTION OF TABLES. Tables 1A-1B report error statistics for various forecast horizons, sample periods, and choices of the real-time historical value that we used to assess accuracy. In each quarterly survey, we ask our panelists for their projections for the current quarter and the next four quarters. The current quarter is defined as the quarter in which we conducted the survey. Our tables provide error statistics separately for each quarter of this five-quarter horizon, beginning with the current quarter (denoted H = 1) and ending with the quarter that is four quarters in the future (H = 5). For each horizon, we report the mean forecast error [ME(S)], the mean absolute forecast error [MAE(S)], and the root-mean-square error [RMSE(S)]. All are standard measures of accuracy, though the academic literature generally places the most weight on the latter. We define a forecast error as the difference between the historical value and the forecast. The mean error for each horizon is simply the average of the forecast errors at that horizon, constructed over the sample periods shown in Table 1A. Other things the same, a forecast with a mean error close to zero is better than one with a mean error far from zero. The mean absolute error is the sample average of the absolute value of the errors. Many analysts prefer this measure to the mean error because it does not allow large positive errors to offset large negative errors. In this sense, the mean absolute error gives a cleaner estimate of the size of the errors. Decision makers, however, may care not only about the average size of the errors but also about their variability, as measured by variance. Our last measure of accuracy is one that reflects the influence of the mean error and the variance of the error. The root-mean-square error for the SPF [RMSE(S)], the measure most often used by analysts and academicians, is the square root of the the average squared error. The lower the root-mean-square error, the more accurate the forecast. 2.1. Benchmark Models. The forecast error statistics from the SPF are of interest in their own right. However, it is often more interesting to compare such statistics with those of alternative, or benchmark, forecasts. Tables 1A-1B report four such comparisons. They show the ratio of the root-mean-square error of the SPF forecast to that of four benchmark models. The benchmark models are statistical equations that we estimate on the data. We use the equations to generate projections for the same horizons included in the survey. In effect, we imagine standing back in time at each date when a survey was conducted and generating a separate forecast with each benchmark model. We do this in the same way that a survey panelist would have done using his own model. Table 1A reports the root-mean-square-error ratios using as many observations as possible for each model. The number of observations can differ from model to model. We first compute the RMSE for each model. We then construct the ratio. Table 1B reports RMSE ratios after we adjust the samples to include only the observations common to both models in the pair. Accordingly, the ratios reported in Table 1B may differ slightly from those of Table 1A, depending on the availability of sufficient real-time observations for estimating the benchmark models or for computing the errors of the SPF or benchmark forecasts. Table 1B also reports three two-sided p-values for each ratio. The p-values, corrected for the presence of heteroskedasticity and serial correlation in the time series of differences in squared forecast errors, are those for the test of equality of mean-square error between the SPF and the benchmark. The p-values are those for: (1) The Diebold-Mariano statistic (July 1995, Journal of Business and Economic Statistics), using a uniform lag window with the truncation lag set to the forecast horizon minus unity. When the uniform lag window produces a nonpositive standard error, the Bartlett window is used. (2) The Harvey-Leybourne-Newbold correction (1997, International Journal of Forecasting) to the Diebold-Mariano statistic. (3) The Diebold-Mariano statistic, using a Bartlett lag window with the truncation lag increased four quarters beyond that of (1) and (2). A RMSE ratio below unity indicates that the SPF consensus (median) forecast has a root-mean-square error lower than that of the benchmark. This means the SPF is more accurate. We now describe the benchmark models. The first is perhaps the simplest of all possible benchmarks: A no-change model. In this model, the forecast for quarter T, the one-step-ahead or current-quarter forecast, is simply the historical value for the prior quarter (T - 1). There is, in other words, no change in the forecast compared with the historical value. Moreover, the forecast for the remaining quarters of the horizon is the same as the forecast for the current quarter. We denote the relative RMSE ratio for this benchmark as RMSE(S/NC), using NC to indicate no change. The second and third benchmark models generate projections using one or more historical observations of the the variable forecast, weighted by coefficients estimated from the data. Such autoregressive (AR) models can be formulated in two ways. We can estimate one model to generate the forecasts at all horizons, using an iteration method to generate the projections beyond the current quarter (IAR), or we can directly estimate a new model for each forecast horizon (DAR). The latter formulation has been shown to reduce the bias in a forecast when the underlying model is characterized by certain types of misspecification. The root-mean-square error ratios are denoted RMSE(S/IAR) and RMSE(S/DAR), respectively. The one- through five-step-ahead projections of the benchmark models use information on the quarterly average of the variable forecast. The latest historical observation is for the quarter that is one quarter before the quarter of the first projection in the horizon. In contrast, the panelists generate their projections with the help of additional information. They submit their projections near the middle of each quarter and hence have access to some monthly indicators for the first month of each quarter, when those data are released before the survey deadline. This puts the projections of panelists for some variables at an advantage relative to the corresponding benchmark projections. Moreover, the panelists may also examine the very recent historical values of such monthly indicators in forming their projections for quarterly averages. Such monthly statistical momentum represents an advantage not shared by the benchmark models, which use only quarterly averages. For survey variables whose observations are reported at a monthly frequency, such as interest rates, industrial production, housing starts, and unemployment, we estimate and forecast a fourth benchmark model, the DARM. This model adds recent monthly historical values to the specification of the DAR model. For the projections for unemployment, nonfarm payroll employment, and interest rates, we add the values of monthly observations, beginning with that for the first month of the first quarter of the forecast horizon. These values should be in the information set of the survey panelists at the time they formed their projections. In contrast, for variables such as housing starts and industrial production, we include only lagged values of monthly observations. For such variables, the panelists would not have known the monthly observation for the first month of the first quarter of the forecast horizon. In general, we find that adding monthly observations to the benchmark DAR models improves accuracy. Indeed, for the projections for interest rates and the unemployment rate, the accuracy of the benchmark DARM projections rivals that of the SPF projections. 2.2. Real-Time Data. All benchmark models are estimated on a rolling, fixed window of 60 real-time quarterly observations. Lag lengths, based on either the Akaike information criterion (AIC) or the Schwarz information criterion (SIC), are re-estimated each period. The tables below indicate whether the lag length was was chosen by the AIC or SIC. We would like to make the comparison between the SPF forecast and the forecasts of each benchmark as fair as possible. Therefore, we must subject the benchmark models to the same data environment the survey panelists faced when they made their projections. This is important because macroeconomic data are revised often, and we do not want the benchmark models to use a data set that differs from the one our panelists would have used. We estimate and forecast the benchmark models with real-time data from the Philadelphia Fed real-time data set, using the vintage of data that the survey panelists would have had at the time they generated their own projections. (For more information on the Philadelphia Fed real-time data set, go to www.philadelphiafed.org/econ/forecast/real-time-data/.) An open question in the literature on forecasting is: What version or vintage of the data should we use to compute the errors? A closely related question is: What version of the data are professional forecasters trying to predict? Our computations take no strong position on these questions. In Tables 1A - 1B, we evaluate the projections (SPF and benchmark) with five alternative measures of the historical values, all from the Philadelphia Fed real-time data set. These measures range from the initial-release values to the values as we know them today. All together, we compute the forecast error statistics using the following five alternative measures of historical values: (1) The initial or first-release value; (2) The revised value as it appears one quarter after the initial release; (3) The revised value as it appears five quarters after the initial release; (4) The revised value as it appears nine quarters after the initial release; (5) The revised value as it appears today. Each measure of the historical value has advantages and disadvantages. The initial-release value is the first measure released by government statistical agencies. A forecaster might be very interested in this measure because it enables him to evaluate his latest forecast soon after he generated it. However, early releases of the data are often subject to large measurement error. Subsequent releases [(2) - (5)] are more accurate, but they are available much later than the initial release. As we go from the first measure to the fifth, we get more reliability, at the cost of higher delays in availability. The last two columns in Table 1A report the number of observations that we used to compute the error statistics. Some observations are omitted because the data are missing in the real-time data set, such as occurred when federal government statistical agencies closed in late 1995. 2.3. Recent Projections and Realizations. Tables 2 to 7 provide information on recent projections and realizations. They show how we align the data prior to computing the forecast errors that form the backbone of the computations in Tables 1A - 1B. Any error can be written as the equation given by error = realization - forecast. For our computations, we must be more precise because, for each projection (SPF and benchmarks), we have different periods forecast (T) different forecast horizons (h), and several measures of the realization (m). Thus, we can define the forecast error more precisely as error( T, h, m ) = realization( T, m ) - forecast( T, h ). Tables 2 to 7 are organized along these lines. Table 2 shows recent forecasts from the SPF. Each column gives the projection for a different horizon or forecast step (h), beginning with that for the current quarter, defined as the quarter in which we conducted the survey. The dates (T) given in the rows show the periods forecast. These also correspond to the dates that we conducted the survey. Tables 3 to 6 report the recent projections of the four benchmark models. They are organized in the same way as Table 2. Table 7 reports recent values of the five alternative realizations (m) we use to compute the error statistics. 2.4. Qualifications. We note two minor qualifications to the methods discussed above. The first concerns the vintage of data that we used to estimate and forecast the benchmark models for CPI inflation. The second concerns the five measures of realizations used for the unemployment rate, nonfarm payroll employment, and CPI inflation. To estimate and forecast the benchmark models for CPI inflation, we use the vintage of data that would have been available in the middle of each quarter. This postdates by one month the vintage that SPF panelists would have had at their disposal when they formed their projections. To compute the realizations for unemployment, nonfarm payroll employment, and CPI inflation, we use the vintages associated with the middle of each quarter. The measure that we call initial comes from this vintage, even though the initial estimate was available in the vintage dated one month earlier. Thus, for these variables, our initial estimate reflects some revision by government statistical agencies. The effect for unemployment and CPI inflation is likely small. The effect could be somewhat larger for nonfarm payroll employment. 3. DESCRIPTION OF GRAPHS. 3.1. Root-Mean-Square Errors. For each sample period shown in Table 1, we provide graphs of the root-mean-square error for the SPF forecast. There is one page for each sample period. On each page, we plot (for each forecast horizon) the RMSE on the y-axis. The x-axis shows the measure of the historical value that we used to compute the RMSE. These range from the value on its initial release to the value one quarter later to the value as we know it now (at the time we made the computation). The graphs provide a tremendous amount of information. If we focus on a particular graph, we can see how a change in the measure of the realization (x-axis) affects the root-mean-square-error measure of accuracy. The effect is pronounced for some variables, such as real GDP and some of its components. For others, there is little or no effect. For example, because the historical data on interest rates are not revised, the estimated RMSE is the same in each case. If we compare a particular point on one graph with the same point on another, we see how the forecast horizon affects accuracy. In general, the RMSE rises (accuracy falls) as the forecast horizon lengthens. Finally, if we compare a graph on one page with the corresponding graph on another page, we see how our estimates of accuracy in the SPF change with the sample period. Periods characterized by a high degree of economic turbulence will generally produce large RMSEs. 3.2. Fan Charts. The last chart plots recent historical values and the latest SPF forecast. It also shows confidence intervals for the forecast, based on back-of-the-envelope calculations. The historical values and the SPF forecast are those associated with the latest vintage of data and survey, respectively, available at the time we ran our computer programs. The confidence intervals are constructed under the assumption that the historical forecast errors over the sample (shown in the footnote) follow a normal distribution with a mean of zero and a variance given by the squared root-mean-square error. The latter is estimated over the aforementioned sample, using the measure of history listed in the footnote. --------------------------------------------------------------------------------------- Table 1A. Forecast Error Summary Statistics for SPF Variable: INDPROD (Industrial Production [QA]) --------------------------------------------------------------------------------------- Computed Over Various Sample Periods Various Measures of Realizations Transformation: Q/Q Growth Rate Lag Length for IAR(p), DAR(p), and DARM(p) Models: AIC Last Updated: 11/18/2011 16:35 --------------------------------------------------------------------------------------- H ME(S) MAE(S) RMSE(S) RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) Nspf N History: Initial Release 1985:01-2009:02 1 -0.42 2.09 2.71 0.72 0.76 0.76 0.82 98 98 2 -0.97 3.07 4.17 0.84 0.94 0.93 0.94 98 98 3 -1.40 3.31 4.68 0.88 0.97 0.96 0.96 98 98 4 -1.43 3.29 4.94 0.89 1.01 1.00 1.00 98 98 5 -1.34 3.18 4.82 0.80 0.97 0.96 0.95 98 98 1985:01-1996:04 1 -0.01 1.96 2.49 0.62 0.73 0.73 0.75 48 48 2 -0.27 2.70 3.43 0.66 0.88 0.86 0.85 48 48 3 -0.68 2.75 3.58 0.75 0.94 0.90 0.89 48 48 4 -0.60 2.52 3.67 0.81 0.99 0.98 0.97 48 48 5 -0.51 2.38 3.24 0.61 0.87 0.84 0.83 48 48 1997:01-2009:02 1 -0.81 2.20 2.90 0.82 0.79 0.79 0.87 50 50 2 -1.65 3.43 4.78 1.01 0.98 0.97 1.00 50 50 3 -2.10 3.84 5.54 0.95 0.98 0.98 0.99 50 50 4 -2.23 4.02 5.91 0.93 1.01 1.01 1.01 50 50 5 -2.14 3.95 5.95 0.90 1.01 1.00 1.00 50 50 H ME(S) MAE(S) RMSE(S) RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) Nspf N History: One Qtr After Initial Release 1985:01-2009:02 1 -0.27 2.09 2.79 0.72 0.76 0.76 0.81 98 98 2 -0.82 3.09 4.19 0.83 0.94 0.93 0.94 98 98 3 -1.25 3.28 4.67 0.86 0.97 0.96 0.96 98 98 4 -1.28 3.25 4.91 0.88 1.01 1.00 1.00 98 98 5 -1.19 3.20 4.80 0.80 0.97 0.96 0.96 98 98 1985:01-1996:04 1 0.33 1.98 2.50 0.63 0.74 0.74 0.75 48 48 2 0.06 2.75 3.39 0.65 0.88 0.86 0.84 48 48 3 -0.34 2.69 3.50 0.72 0.93 0.89 0.88 48 48 4 -0.26 2.47 3.55 0.77 0.97 0.97 0.95 48 48 5 -0.18 2.42 3.20 0.60 0.87 0.85 0.84 48 48 1997:01-2009:02 1 -0.84 2.20 3.03 0.81 0.78 0.78 0.86 50 50 2 -1.67 3.42 4.84 0.99 0.98 0.96 1.00 50 50 3 -2.12 3.84 5.57 0.94 0.99 0.98 0.99 50 50 4 -2.26 4.00 5.93 0.94 1.02 1.01 1.02 50 50 5 -2.16 3.94 5.95 0.90 1.01 1.00 1.00 50 50 H ME(S) MAE(S) RMSE(S) RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) Nspf N History: Five Qtrs After Initial Release 1985:01-2009:02 1 -0.31 2.15 2.83 0.73 0.79 0.79 0.83 98 98 2 -0.87 3.08 4.14 0.84 0.95 0.94 0.94 98 98 3 -1.30 3.29 4.61 0.87 0.98 0.97 0.97 98 98 4 -1.33 3.21 4.82 0.86 1.00 1.00 1.00 98 98 5 -1.24 3.18 4.72 0.79 0.97 0.96 0.96 98 98 1985:01-1996:04 1 0.20 1.98 2.52 0.64 0.76 0.76 0.78 48 48 2 -0.07 2.65 3.32 0.66 0.88 0.87 0.84 48 48 3 -0.47 2.63 3.40 0.71 0.92 0.89 0.89 48 48 4 -0.39 2.36 3.44 0.71 0.96 0.96 0.95 48 48 5 -0.31 2.30 3.06 0.57 0.86 0.85 0.85 48 48 1997:01-2009:02 1 -0.80 2.31 3.10 0.82 0.80 0.80 0.88 50 50 2 -1.64 3.50 4.79 0.99 0.98 0.97 1.00 50 50 3 -2.09 3.93 5.53 0.96 1.00 1.00 1.00 50 50 4 -2.22 4.03 5.85 0.94 1.02 1.01 1.02 50 50 5 -2.13 4.02 5.88 0.91 1.01 1.00 1.00 50 50 H ME(S) MAE(S) RMSE(S) RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) Nspf N History: Nine Qtrs After Initial Release 1985:01-2009:02 1 -0.39 2.23 2.97 0.77 0.82 0.82 0.86 98 98 2 -0.95 3.07 4.25 0.86 0.95 0.94 0.95 98 98 3 -1.38 3.27 4.76 0.88 0.98 0.96 0.96 98 98 4 -1.41 3.25 4.97 0.87 1.00 0.99 1.00 98 98 5 -1.32 3.24 4.91 0.81 0.98 0.97 0.97 98 98 1985:01-1996:04 1 0.37 1.87 2.38 0.62 0.76 0.76 0.75 48 48 2 0.11 2.53 3.08 0.64 0.86 0.84 0.81 48 48 3 -0.30 2.47 3.17 0.67 0.89 0.86 0.84 48 48 4 -0.22 2.27 3.19 0.66 0.93 0.93 0.91 48 48 5 -0.13 2.26 2.93 0.55 0.85 0.84 0.85 48 48 1997:01-2009:02 1 -1.13 2.57 3.45 0.88 0.85 0.85 0.92 50 50 2 -1.96 3.59 5.13 1.02 0.99 0.98 1.01 50 50 3 -2.41 4.04 5.89 0.98 1.01 1.00 1.01 50 50 4 -2.55 4.19 6.22 0.96 1.02 1.01 1.02 50 50 5 -2.45 4.18 6.25 0.93 1.01 1.00 1.00 50 50 H ME(S) MAE(S) RMSE(S) RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) Nspf N History: Latest Vintage 1985:01-2009:02 1 -0.26 2.72 3.51 0.83 0.89 0.89 0.93 98 98 2 -0.82 3.45 4.56 0.88 0.97 0.96 0.96 98 98 3 -1.25 3.58 4.98 0.90 0.99 0.98 0.98 98 98 4 -1.28 3.62 5.17 0.87 1.00 1.00 1.00 98 98 5 -1.19 3.61 5.18 0.81 0.99 0.98 0.98 98 98 1985:01-1996:04 1 0.39 2.45 3.01 0.74 0.89 0.89 0.87 48 48 2 0.13 2.88 3.49 0.68 0.93 0.91 0.87 48 48 3 -0.28 2.86 3.50 0.71 0.94 0.91 0.90 48 48 4 -0.20 2.68 3.46 0.67 0.94 0.95 0.93 48 48 5 -0.12 2.63 3.25 0.58 0.89 0.88 0.88 48 48 1997:01-2009:02 1 -0.89 2.98 3.92 0.90 0.88 0.88 0.97 50 50 2 -1.73 3.99 5.39 1.02 0.99 0.98 1.01 50 50 3 -2.18 4.28 6.07 1.00 1.01 1.01 1.01 50 50 4 -2.32 4.52 6.39 0.98 1.02 1.01 1.02 50 50 5 -2.22 4.55 6.52 0.93 1.02 1.01 1.00 50 50 Notes for Table 1A. (1) The forecast horizon is given by H, where H = 1 is the SPF forecast for the current quarter. (2) The headers ME(S), MAE(S), and RMSE(S) are mean error, mean absolute error, and root-mean-square error for the SPF. (3) The header RMSE(S/NC) is the ratio of the SPF RMSE to that of the no-change (NC) model. (4) The headers RMSE(S/IAR), RMSE(S/DAR) and RMSE(S/DARM) are the ratios of the SPF RMSE to the RMSE of the iterated and direct autoregressive models and the direct autoregressive model augmented with monthly observations, respectively. All models are estimated on a rolling window of 60 observations from the Philadelphia Fed real-time data set. (5) The headers Nspf and N are the number of observations analyzed for the SPF and benchmark models. (6) When the variable forecast is a growth rate or an interest rate, it is expressed in annualized percentage points. When the variable forecast is the unemployment rate, it is expressed in percentage points. (7) Sample periods refer to the dates forecast, not the dates when the forecasts were made. Source: Tom Stark, Research Department, FRB Philadelphia. ---------------------------------------------------------------------------------------------- Table 1B. Ratios of Root-Mean-Square Errors for SPF Variable: INDPROD (Industrial Production [QA]) Alternative P-Values in Parentheses ---------------------------------------------------------------------------------------------- Computed Over Various Sample Periods Various Measures of Realizations Transformation: Q/Q Growth Rate Lag Length for IAR(p), DAR(p), and DARM(p) Models: AIC Last Updated: 11/18/2011 16:35 ---------------------------------------------------------------------------------------------- History: Initial Release 1985:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.719 0.760 0.760 0.817 98 98 98 98 (0.005) (0.001) (0.001) (0.006) (0.006) (0.002) (0.002) (0.008) (0.015) (0.009) (0.009) (0.009) 2 0.844 0.945 0.929 0.941 98 98 98 98 (0.167) (0.327) (0.212) (0.344) (0.177) (0.337) (0.222) (0.354) (0.192) (0.295) (0.194) (0.297) 3 0.877 0.972 0.958 0.958 98 98 98 98 (0.213) (0.366) (0.254) (0.154) (0.227) (0.381) (0.269) (0.168) (0.154) (0.250) (0.183) (0.076) 4 0.894 1.008 1.000 1.001 98 98 98 98 (0.164) (0.774) (0.996) (0.963) (0.182) (0.783) (0.996) (0.964) (0.187) (0.719) (0.995) (0.957) 5 0.799 0.970 0.958 0.951 98 98 98 98 (0.003) (0.254) (0.152) (0.124) (0.006) (0.279) (0.175) (0.145) (0.002) (0.232) (0.144) (0.111) History: Initial Release 1985:01-1996:04 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.624 0.727 0.727 0.752 48 48 48 48 (0.017) (0.057) (0.057) (0.055) (0.023) (0.066) (0.066) (0.064) (0.051) (0.126) (0.126) (0.072) 2 0.663 0.882 0.865 0.845 48 48 48 48 (0.033) (0.390) (0.347) (0.291) (0.044) (0.409) (0.367) (0.312) (0.080) (0.379) (0.330) (0.253) 3 0.754 0.943 0.902 0.892 48 48 48 48 (0.087) (0.509) (0.335) (0.143) (0.112) (0.534) (0.365) (0.171) (0.046) (0.437) (0.278) (0.087) 4 0.809 0.993 0.983 0.973 48 48 48 48 (0.159) (0.903) (0.753) (0.601) (0.198) (0.911) (0.772) (0.631) (0.126) (0.890) (0.728) (0.601) 5 0.605 0.869 0.840 0.831 48 48 48 48 (0.000) (0.051) (0.056) (0.073) (0.000) (0.084) (0.090) (0.110) (0.000) (0.050) (0.053) (0.058) History: Initial Release 1997:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.820 0.787 0.787 0.874 50 50 50 50 (0.121) (0.002) (0.002) (0.014) (0.131) (0.004) (0.004) (0.018) (0.083) (0.007) (0.007) (0.003) 2 1.014 0.981 0.967 1.002 50 50 50 50 (0.928) (0.629) (0.272) (0.961) (0.930) (0.642) (0.292) (0.962) (0.912) (0.481) (0.199) (0.939) 3 0.946 0.984 0.983 0.989 50 50 50 50 (0.681) (0.522) (0.523) (0.660) (0.698) (0.546) (0.547) (0.678) (0.642) (0.293) (0.368) (0.493) 4 0.933 1.014 1.007 1.013 50 50 50 50 (0.472) (0.663) (0.838) (0.694) (0.506) (0.687) (0.850) (0.716) (0.520) (0.560) (0.789) (0.614) 5 0.899 1.005 1.001 0.996 50 50 50 50 (0.270) (0.800) (0.963) (0.829) (0.320) (0.819) (0.966) (0.845) (0.259) (0.767) (0.957) (0.819) History: One Qtr After Initial Release 1985:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.723 0.764 0.764 0.810 98 98 98 98 (0.006) (0.002) (0.002) (0.002) (0.008) (0.002) (0.002) (0.003) (0.017) (0.009) (0.009) (0.001) 2 0.832 0.942 0.928 0.939 98 98 98 98 (0.120) (0.282) (0.191) (0.306) (0.129) (0.292) (0.201) (0.316) (0.151) (0.251) (0.172) (0.254) 3 0.863 0.970 0.955 0.959 98 98 98 98 (0.156) (0.329) (0.229) (0.178) (0.170) (0.344) (0.244) (0.192) (0.111) (0.219) (0.159) (0.096) 4 0.885 1.006 0.999 0.999 98 98 98 98 (0.109) (0.837) (0.961) (0.961) (0.126) (0.844) (0.962) (0.962) (0.126) (0.804) (0.954) (0.956) 5 0.799 0.972 0.959 0.955 98 98 98 98 (0.003) (0.242) (0.126) (0.133) (0.005) (0.267) (0.148) (0.155) (0.001) (0.250) (0.135) (0.130) History: One Qtr After Initial Release 1985:01-1996:04 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.634 0.742 0.742 0.747 48 48 48 48 (0.024) (0.057) (0.057) (0.025) (0.030) (0.066) (0.066) (0.032) (0.071) (0.144) (0.144) (0.027) 2 0.654 0.881 0.863 0.840 48 48 48 48 (0.038) (0.383) (0.339) (0.270) (0.050) (0.402) (0.359) (0.291) (0.087) (0.370) (0.316) (0.224) 3 0.725 0.931 0.889 0.883 48 48 48 48 (0.054) (0.426) (0.291) (0.137) (0.074) (0.455) (0.322) (0.166) (0.029) (0.352) (0.231) (0.080) 4 0.774 0.974 0.966 0.953 48 48 48 48 (0.113) (0.634) (0.541) (0.470) (0.148) (0.661) (0.574) (0.506) (0.075) (0.602) (0.517) (0.470) 5 0.600 0.874 0.846 0.839 48 48 48 48 (0.000) (0.008) (0.028) (0.058) (0.001) (0.020) (0.052) (0.092) (0.000) (0.035) (0.043) (0.056) History: One Qtr After Initial Release 1997:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.808 0.779 0.779 0.862 50 50 50 50 (0.119) (0.009) (0.009) (0.022) (0.129) (0.012) (0.012) (0.028) (0.076) (0.014) (0.014) (0.005) 2 0.987 0.976 0.965 0.999 50 50 50 50 (0.923) (0.494) (0.215) (0.981) (0.926) (0.510) (0.235) (0.982) (0.909) (0.331) (0.163) (0.970) 3 0.941 0.986 0.984 0.992 50 50 50 50 (0.643) (0.567) (0.543) (0.767) (0.662) (0.589) (0.566) (0.780) (0.605) (0.356) (0.396) (0.657) 4 0.935 1.018 1.011 1.016 50 50 50 50 (0.440) (0.601) (0.756) (0.628) (0.476) (0.629) (0.774) (0.654) (0.498) (0.505) (0.697) (0.550) 5 0.901 1.005 1.000 0.997 50 50 50 50 (0.243) (0.826) (0.984) (0.897) (0.293) (0.842) (0.986) (0.907) (0.230) (0.803) (0.983) (0.892) History: Five Qtrs After Initial Release 1985:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.731 0.785 0.785 0.834 98 98 98 98 (0.005) (0.003) (0.003) (0.007) (0.007) (0.004) (0.004) (0.008) (0.017) (0.013) (0.013) (0.006) 2 0.840 0.948 0.935 0.944 98 98 98 98 (0.151) (0.340) (0.253) (0.361) (0.160) (0.350) (0.263) (0.370) (0.171) (0.310) (0.228) (0.304) 3 0.868 0.979 0.965 0.968 98 98 98 98 (0.168) (0.521) (0.378) (0.324) (0.182) (0.534) (0.392) (0.339) (0.126) (0.459) (0.323) (0.252) 4 0.860 1.005 0.997 0.998 98 98 98 98 (0.063) (0.862) (0.925) (0.940) (0.076) (0.867) (0.927) (0.942) (0.059) (0.836) (0.913) (0.933) 5 0.788 0.974 0.963 0.962 98 98 98 98 (0.002) (0.300) (0.161) (0.178) (0.004) (0.325) (0.185) (0.202) (0.001) (0.311) (0.175) (0.172) History: Five Qtrs After Initial Release 1985:01-1996:04 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.637 0.763 0.763 0.778 48 48 48 48 (0.019) (0.082) (0.082) (0.068) (0.024) (0.092) (0.092) (0.078) (0.068) (0.175) (0.175) (0.078) 2 0.663 0.883 0.868 0.842 48 48 48 48 (0.060) (0.407) (0.384) (0.302) (0.075) (0.426) (0.404) (0.323) (0.105) (0.395) (0.357) (0.250) 3 0.711 0.924 0.890 0.885 48 48 48 48 (0.061) (0.403) (0.324) (0.162) (0.082) (0.432) (0.355) (0.191) (0.036) (0.342) (0.268) (0.104) 4 0.705 0.961 0.962 0.950 48 48 48 48 (0.039) (0.360) (0.486) (0.425) (0.061) (0.400) (0.522) (0.464) (0.013) (0.347) (0.486) (0.436) 5 0.565 0.863 0.848 0.852 48 48 48 48 (0.000) (0.008) (0.035) (0.077) (0.001) (0.020) (0.062) (0.116) (0.000) (0.031) (0.057) (0.076) History: Five Qtrs After Initial Release 1997:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.819 0.800 0.800 0.877 50 50 50 50 (0.121) (0.013) (0.013) (0.024) (0.131) (0.017) (0.017) (0.030) (0.076) (0.018) (0.018) (0.005) 2 0.988 0.983 0.972 1.004 50 50 50 50 (0.926) (0.622) (0.296) (0.902) (0.929) (0.635) (0.316) (0.905) (0.911) (0.461) (0.237) (0.845) 3 0.957 1.002 0.997 1.004 50 50 50 50 (0.722) (0.940) (0.924) (0.867) (0.737) (0.944) (0.928) (0.874) (0.693) (0.925) (0.910) (0.832) 4 0.939 1.021 1.010 1.016 50 50 50 50 (0.486) (0.529) (0.773) (0.622) (0.520) (0.561) (0.789) (0.648) (0.525) (0.425) (0.717) (0.537) 5 0.908 1.011 1.001 0.998 50 50 50 50 (0.279) (0.638) (0.955) (0.938) (0.329) (0.671) (0.959) (0.944) (0.269) (0.596) (0.950) (0.934) History: Nine Qtrs After Initial Release 1985:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.768 0.817 0.817 0.859 98 98 98 98 (0.010) (0.005) (0.005) (0.014) (0.012) (0.006) (0.006) (0.016) (0.025) (0.011) (0.011) (0.016) 2 0.862 0.952 0.938 0.945 98 98 98 98 (0.186) (0.310) (0.202) (0.316) (0.196) (0.320) (0.212) (0.325) (0.214) (0.279) (0.184) (0.255) 3 0.879 0.978 0.964 0.965 98 98 98 98 (0.206) (0.452) (0.316) (0.251) (0.221) (0.465) (0.331) (0.266) (0.172) (0.395) (0.274) (0.215) 4 0.868 1.002 0.995 0.997 98 98 98 98 (0.079) (0.948) (0.863) (0.924) (0.094) (0.950) (0.868) (0.927) (0.077) (0.941) (0.846) (0.916) 5 0.810 0.980 0.968 0.970 98 98 98 98 (0.006) (0.451) (0.240) (0.270) (0.010) (0.473) (0.265) (0.295) (0.004) (0.453) (0.242) (0.263) History: Nine Qtrs After Initial Release 1985:01-1996:04 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.622 0.759 0.759 0.753 48 48 48 48 (0.017) (0.096) (0.096) (0.062) (0.022) (0.106) (0.106) (0.071) (0.055) (0.152) (0.152) (0.068) 2 0.641 0.861 0.841 0.811 48 48 48 48 (0.025) (0.338) (0.301) (0.219) (0.035) (0.358) (0.322) (0.240) (0.066) (0.311) (0.268) (0.158) 3 0.672 0.893 0.856 0.842 48 48 48 48 (0.034) (0.253) (0.206) (0.070) (0.051) (0.284) (0.237) (0.092) (0.025) (0.201) (0.164) (0.052) 4 0.659 0.926 0.928 0.913 48 48 48 48 (0.010) (0.066) (0.271) (0.219) (0.021) (0.095) (0.312) (0.261) (0.003) (0.087) (0.271) (0.236) 5 0.551 0.852 0.837 0.846 48 48 48 48 (0.000) (0.009) (0.048) (0.081) (0.001) (0.022) (0.080) (0.121) (0.000) (0.034) (0.065) (0.083) History: Nine Qtrs After Initial Release 1997:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.881 0.848 0.848 0.924 50 50 50 50 (0.235) (0.015) (0.015) (0.078) (0.245) (0.019) (0.019) (0.087) (0.189) (0.016) (0.016) (0.048) 2 1.017 0.991 0.979 1.010 50 50 50 50 (0.894) (0.720) (0.304) (0.735) (0.898) (0.730) (0.324) (0.744) (0.881) (0.650) (0.345) (0.642) 3 0.980 1.006 1.002 1.010 50 50 50 50 (0.870) (0.796) (0.951) (0.679) (0.877) (0.807) (0.953) (0.696) (0.858) (0.747) (0.943) (0.607) 4 0.961 1.024 1.014 1.023 50 50 50 50 (0.671) (0.450) (0.668) (0.450) (0.695) (0.486) (0.691) (0.486) (0.690) (0.353) (0.602) (0.347) 5 0.932 1.015 1.004 1.003 50 50 50 50 (0.401) (0.546) (0.858) (0.876) (0.449) (0.585) (0.871) (0.888) (0.387) (0.499) (0.841) (0.866) History: Latest Vintage 1985:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.832 0.885 0.885 0.928 98 98 98 98 (0.043) (0.038) (0.038) (0.110) (0.046) (0.041) (0.041) (0.115) (0.087) (0.080) (0.080) (0.156) 2 0.875 0.973 0.961 0.965 98 98 98 98 (0.225) (0.521) (0.352) (0.453) (0.235) (0.529) (0.362) (0.461) (0.241) (0.485) (0.328) (0.392) 3 0.897 0.990 0.979 0.978 98 98 98 98 (0.283) (0.691) (0.484) (0.359) (0.298) (0.699) (0.497) (0.374) (0.241) (0.656) (0.438) (0.332) 4 0.874 1.003 0.997 1.002 98 98 98 98 (0.101) (0.876) (0.898) (0.944) (0.117) (0.880) (0.901) (0.946) (0.104) (0.868) (0.891) (0.941) 5 0.814 0.990 0.979 0.976 98 98 98 98 (0.014) (0.664) (0.423) (0.354) (0.021) (0.679) (0.446) (0.379) (0.011) (0.676) (0.429) (0.353) History: Latest Vintage 1985:01-1996:04 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.742 0.888 0.888 0.868 48 48 48 48 (0.093) (0.350) (0.350) (0.172) (0.103) (0.359) (0.359) (0.183) (0.176) (0.448) (0.448) (0.212) 2 0.682 0.925 0.909 0.872 48 48 48 48 (0.043) (0.524) (0.469) (0.303) (0.056) (0.541) (0.486) (0.324) (0.078) (0.495) (0.428) (0.238) 3 0.708 0.939 0.907 0.896 48 48 48 48 (0.027) (0.381) (0.312) (0.162) (0.042) (0.411) (0.342) (0.191) (0.013) (0.306) (0.246) (0.123) 4 0.670 0.942 0.951 0.932 48 48 48 48 (0.006) (0.237) (0.489) (0.427) (0.014) (0.279) (0.524) (0.465) (0.002) (0.205) (0.474) (0.422) 5 0.582 0.888 0.879 0.881 48 48 48 48 (0.001) (0.010) (0.133) (0.171) (0.004) (0.025) (0.180) (0.221) (0.000) (0.075) (0.165) (0.186) History: Latest Vintage 1997:01-2009:02 H RMSE(S/NC) RMSE(S/IAR) RMSE(S/DAR) RMSE(S/DARM) N1 N2 N3 N4 1 0.899 0.884 0.884 0.968 50 50 50 50 (0.251) (0.031) (0.031) (0.403) (0.262) (0.038) (0.038) (0.412) (0.262) (0.048) (0.048) (0.459) 2 1.018 0.994 0.984 1.011 50 50 50 50 (0.892) (0.853) (0.486) (0.705) (0.895) (0.858) (0.502) (0.715) (0.877) (0.825) (0.527) (0.637) 3 0.999 1.009 1.006 1.009 50 50 50 50 (0.993) (0.650) (0.771) (0.590) (0.993) (0.669) (0.783) (0.611) (0.992) (0.625) (0.762) (0.575) 4 0.975 1.023 1.011 1.025 50 50 50 50 (0.797) (0.263) (0.654) (0.243) (0.812) (0.303) (0.679) (0.283) (0.812) (0.224) (0.617) (0.181) 5 0.927 1.020 1.008 1.003 50 50 50 50 (0.420) (0.361) (0.699) (0.871) (0.467) (0.410) (0.727) (0.883) (0.405) (0.308) (0.668) (0.859) Notes for Table 1B. (1) The forecast horizon is given by H, where H = 1 is the SPF forecast for the current quarter. (2) The headers RMSE(S/NC), RMSE(S/IAR), RMSE(S/DAR), and RMSE(S/DARM) are the ratios of the SPF root-mean-square error to that of the benchmark models: No-change (NC), indirect autoregression (IAR), direct autoregession (DAR), and direct autoregression augmented with monthly information (DARM). These statistics may differ slightly from those reported in Table 1A because they incorporate only those observations common to both the SPF and the benchmark model. The previous statistics make use of all available observations for each model. (3) All models are estimated on a rolling window of 60 observations from the Philadelphia Fed real-time data set. (4) A set of three two-sided p-values (in parentheses) accompanies each statistic. These are the p-values for the test of the equality of mean-square-error. The first is for the Diebold-Mariano (1995, JBES) statistic, using a uniform lag window with the trunction lag set to the forecast horizon minus one. (The tables report the p-values using a Bartlett window when the uniform window produces a negative standard error.) The second is for the Harvey-Leybourne-Newbold (1997, IJF) correction to the Diebold-Mariano statistic. The third is for the Diebold-Mariano statistic, using a Bartlett lag window with the truncation lag increased four quarters. (5) The headers N1, N2, N3, and N4 show the number of observations used in constructing each ratio of root-mean-square errors. (6) Sample periods refer to the dates forecast, not the dates when the forecasts were made. Source: Tom Stark, Research Department, FRB Philadelphia. -------------------------------------------------------------------- Table 2. Recent SPF Forecasts - Dated at the Quarter Forecast -------------------------------------------------------------------- Variable: INDPROD (Industrial Production [QA]) By Forecast Step (1 to 5) Transformation: Q/Q Growth Rate Last Updated: 11/18/2011 16:35 -------------------------------------------------------------------- Qtr Forecast Step 1 Step 2 Step 3 Step 4 Step 5 2005:01 4.402 4.632 4.457 5.069 5.078 2005:02 3.379 3.894 3.201 4.064 4.416 2005:03 4.369 3.785 3.998 3.906 4.582 2005:04 2.495 3.794 3.855 4.023 4.492 2006:01 4.857 3.506 4.020 3.365 3.597 2006:02 4.299 3.542 3.409 2.974 3.763 2006:03 3.879 3.601 3.275 3.927 2.942 2006:04 1.664 3.309 3.615 3.380 3.545 2007:01 2.192 2.435 3.532 3.336 2.578 2007:02 2.118 2.972 3.100 3.068 2.991 2007:03 2.862 2.257 3.038 3.199 2.652 2007:04 2.116 2.229 2.681 2.994 2.954 2008:01 0.386 2.105 2.627 2.862 2.910 2008:02 -0.711 1.450 2.623 2.681 2.706 2008:03 0.360 1.014 2.064 2.805 2.897 2008:04 -4.694 0.646 2.000 2.273 2.510 2009:01 -10.189 -3.515 0.977 2.688 3.149 2009:02 -8.028 -3.093 -0.795 2.265 2.500 2009:03 2.524 -1.009 0.000 0.936 1.501 2009:04 5.831 4.633 1.544 2.776 2.064 2010:01 5.351 4.106 2.063 0.851 2.483 2010:02 5.093 5.126 3.389 3.332 2.647 2010:03 5.131 5.181 5.072 4.132 5.323 2010:04 3.123 4.255 4.404 5.114 5.057 2011:01 4.575 3.762 4.314 4.351 3.037 2011:02 4.366 4.233 3.502 3.864 4.104 2011:03 3.022 4.495 4.351 4.193 3.797 2011:04 2.337 3.890 4.490 4.274 4.926 2012:01 NA 3.244 3.056 4.134 3.667 2012:02 NA NA 3.689 3.270 3.600 2012:03 NA NA NA 3.310 3.230 2012:04 NA NA NA NA 2.782 Notes for Table 2. (1) Each column gives the sequence of SPF projections for a given forecast step. The forecast steps range from one (the forecast for the quarter in which the survey was conducted) to four quarters in the future (step 5). (2) The dates listed in the rows are the dates forecast, not the dates when the forecasts were made, with the exception of the forecast at step one, for which the two dates coincide. Source: Tom Stark, Research Department, FRB Philadelphia. ------------------------------------------------------------------------------------ Table 3. Recent Benchmark Model 1 IAR Forecasts - Dated at the Quarter Forecast ------------------------------------------------------------------------------------ Variable: INDPROD (Industrial Production [QA]) By Forecast Step (1 to 5) Transformation: Q/Q Growth Rate Lag Length for IAR(p): AIC Last Updated: 11/18/2011 16:35 ------------------------------------------------------------------------------------ Qtr Forecast Step 1 Step 2 Step 3 Step 4 Step 5 2005:01 3.749 3.032 3.819 3.521 3.115 2005:02 3.423 3.467 3.061 3.562 3.300 2005:03 2.384 3.257 3.293 3.079 3.398 2005:04 1.824 2.592 3.154 3.185 3.090 2006:01 3.619 2.254 2.721 3.091 3.119 2006:02 4.075 3.539 2.519 2.800 3.052 2006:03 5.544 3.871 3.492 2.682 2.848 2006:04 3.520 4.785 3.762 3.464 2.783 2007:01 0.939 3.471 4.322 3.704 3.447 2007:02 2.325 1.882 3.442 4.040 3.673 2007:03 3.094 2.786 2.461 3.424 3.868 2007:04 3.749 3.151 3.062 2.818 3.413 2008:01 0.548 3.625 3.186 3.228 3.037 2008:02 1.004 1.490 3.546 3.208 3.327 2008:03 -1.192 1.663 2.090 3.495 3.222 2008:04 -3.518 0.132 2.096 2.473 3.463 2009:01 -9.056 -1.779 1.019 2.380 2.717 2009:02 -19.618 -7.088 -0.542 1.614 2.567 2009:03 -10.059 -19.259 -5.496 0.337 2.013 2009:04 9.101 -8.655 -18.913 -4.207 0.961 2010:01 5.136 8.042 -7.452 -18.579 -3.164 2010:02 5.800 3.400 5.750 -6.420 -18.257 2010:03 4.941 3.967 2.299 3.809 -5.536 2010:04 3.216 3.661 2.724 1.766 2.609 2011:01 0.993 2.393 2.846 2.068 1.583 2011:02 5.775 0.925 2.009 2.402 1.804 2011:03 -0.142 4.614 1.209 1.862 2.188 2011:04 5.419 -0.003 3.541 1.494 1.824 2012:01 NA 4.468 0.422 2.791 1.689 2012:02 NA NA 3.453 0.804 2.341 2012:03 NA NA NA 2.707 1.063 2012:04 NA NA NA NA 2.242 Notes for Table 3. (1) Each column gives the sequence of benchmark IAR projections for a given forecast step. The forecast steps range from one to five. The first step corresponds to the forecast that SPF panelists make for the quarter in which the survey is conducted. (2) The dates listed in the rows are the dates forecast, not the dates when the forecasts were made, with the exception of the forecast at step one, for which the two dates coincide. (3) The IAR benchmark model is estimated on a fixed 60-quarter rolling window. Its forecasts are computed with the indirect method. Estimation uses data from the Philadelphia Fed real-time data set. Source: Tom Stark, Research Department, FRB Philadelphia. --------------------------------------------------------------------------------------- Table 4. Recent Benchmark Model 2 No-Change Forecasts - Dated at the Quarter Forecast --------------------------------------------------------------------------------------- Variable: INDPROD (Industrial Production [QA]) By Forecast Step (1 to 5) Transformation: Q/Q Growth Rate Last Updated: 11/18/2011 16:35 --------------------------------------------------------------------------------------- Qtr Forecast Step 1 Step 2 Step 3 Step 4 Step 5 2005:01 4.207 2.910 5.833 6.549 6.139 2005:02 3.693 4.207 2.910 5.833 6.549 2005:03 2.045 3.693 4.207 2.910 5.833 2005:04 1.128 2.045 3.693 4.207 2.910 2006:01 3.754 1.128 2.045 3.693 4.207 2006:02 4.460 3.754 1.128 2.045 3.693 2006:03 6.789 4.460 3.754 1.128 2.045 2006:04 3.601 6.789 4.460 3.754 1.128 2007:01 -0.592 3.601 6.789 4.460 3.754 2007:02 1.558 -0.592 3.601 6.789 4.460 2007:03 3.004 1.558 -0.592 3.601 6.789 2007:04 3.944 3.004 1.558 -0.592 3.601 2008:01 -0.931 3.944 3.004 1.558 -0.592 2008:02 0.000 -0.931 3.944 3.004 1.558 2008:03 -3.166 0.000 -0.931 3.944 3.004 2008:04 -5.966 -3.166 0.000 -0.931 3.944 2009:01 -11.486 -5.966 -3.166 0.000 -0.931 2009:02 -19.989 -11.486 -5.966 -3.166 0.000 2009:03 -11.697 -19.989 -11.486 -5.966 -3.166 2009:04 5.217 -11.697 -19.989 -11.486 -5.966 2010:01 6.976 5.217 -11.697 -19.989 -11.486 2010:02 7.569 6.976 5.217 -11.697 -19.989 2010:03 6.478 7.569 6.976 5.217 -11.697 2010:04 4.709 6.478 7.569 6.976 5.217 2011:01 2.295 4.709 6.478 7.569 6.976 2011:02 6.096 2.295 4.709 6.478 7.569 2011:03 0.865 6.096 2.295 4.709 6.478 2011:04 5.119 0.865 6.096 2.295 4.709 2012:01 NA 5.119 0.865 6.096 2.295 2012:02 NA NA 5.119 0.865 6.096 2012:03 NA NA NA 5.119 0.865 2012:04 NA NA NA NA 5.119 Notes for Table 4. (1) Each column gives the sequence of benchmark no-change projections for a given forecast step. The forecast steps range from one to five. The first step corresponds to the forecast that SPF panelists make for the quarter in which the survey is conducted. (2) The dates listed in the rows are the dates forecast, not the dates when the forecasts were made, with the exception of the forecast at step one, for which the two dates coincide. (3) The projections use data from the Philadelphia Fed real-time data set. Source: Tom Stark, Research Department, FRB Philadelphia. ------------------------------------------------------------------------------------ Table 5. Recent Benchmark Model 3 DAR Forecasts - Dated at the Quarter Forecast ------------------------------------------------------------------------------------ Variable: INDPROD (Industrial Production [QA]) By Forecast Step (1 to 5) Transformation: Q/Q Growth Rate Lag Length for DAR(p): AIC Last Updated: 11/18/2011 16:35 ------------------------------------------------------------------------------------ Qtr Forecast Step 1 Step 2 Step 3 Step 4 Step 5 2005:01 3.749 3.016 3.695 3.512 3.211 2005:02 3.423 3.447 3.018 3.430 3.354 2005:03 2.384 3.257 3.297 3.006 3.368 2005:04 1.824 2.617 3.176 3.178 3.006 2006:01 3.619 2.270 2.737 3.112 3.197 2006:02 4.075 3.426 2.500 2.833 3.129 2006:03 5.544 3.840 3.353 2.684 2.847 2006:04 3.520 4.649 3.736 3.266 2.699 2007:01 0.939 3.527 4.310 3.565 3.239 2007:02 2.325 1.856 3.555 3.877 3.487 2007:03 3.094 2.691 2.237 3.515 3.700 2007:04 3.749 3.198 2.898 2.939 3.486 2008:01 0.548 3.589 3.241 3.271 3.137 2008:02 1.004 1.564 3.521 3.317 3.355 2008:03 -1.192 1.707 2.071 3.428 3.315 2008:04 -3.518 0.198 2.118 2.777 3.433 2009:01 -9.056 -1.407 1.157 2.542 2.847 2009:02 -19.618 -5.960 -0.066 1.926 2.598 2009:03 -10.059 -16.435 -2.983 1.365 2.083 2009:04 9.101 -9.717 -11.881 -0.568 1.503 2010:01 5.136 3.368 -8.179 -5.232 0.444 2010:02 5.800 3.622 3.057 -4.684 -3.597 2010:03 4.941 3.859 2.948 2.510 -2.567 2010:04 3.216 3.556 2.809 2.409 2.283 2011:01 0.993 2.481 2.340 1.901 2.281 2011:02 5.775 0.950 1.687 2.001 1.851 2011:03 -0.142 4.719 0.691 1.393 1.705 2011:04 5.419 -0.246 3.669 0.909 1.702 2012:01 NA 4.819 -0.070 2.556 1.890 2012:02 NA NA 3.925 0.259 1.378 2012:03 NA NA NA 3.076 1.748 2012:04 NA NA NA NA 1.307 Notes for Table 5. (1) Each column gives the sequence of benchmark DAR projections for a given forecast step. The forecast steps range from one to five. The first step corresponds to the forecast that SPF panelists make for the quarter in which the survey is conducted. (2) The dates listed in the rows are the dates forecast, not the dates when the forecasts were made, with the exception of the forecast at step one, for which the two dates coincide. (3) The DAR benchmark model is estimated on a fixed 60-quarter rolling window. Its forecasts are computed with the direct method. Estimation uses data from the Philadelphia Fed real-time data set. Source: Tom Stark, Research Department, FRB Philadelphia. ------------------------------------------------------------------------------------ Table 6. Recent Benchmark Model 4 DARM Forecasts - Dated at the Quarter Forecast ------------------------------------------------------------------------------------ Variable: INDPROD (Industrial Production [QA]) By Forecast Step (1 to 5) Transformation: Q/Q Growth Rate Lag Length for DARM(p): AIC Last Updated: 11/18/2011 16:35 ------------------------------------------------------------------------------------ Qtr Forecast Step 1 Step 2 Step 3 Step 4 Step 5 2005:01 4.561 2.935 4.021 4.050 3.310 2005:02 3.034 3.117 2.607 3.987 3.962 2005:03 4.740 3.203 2.571 2.577 4.103 2005:04 -1.636 2.292 2.961 2.465 3.194 2006:01 5.496 2.809 2.351 2.952 2.585 2006:02 4.558 3.634 3.304 2.455 3.213 2006:03 4.676 3.842 4.026 3.293 2.089 2006:04 1.253 4.070 3.840 4.069 3.684 2007:01 1.422 3.191 3.392 3.901 3.277 2007:02 3.188 1.663 3.092 3.066 3.498 2007:03 2.702 3.352 1.860 2.003 2.975 2007:04 2.782 2.769 3.979 2.813 3.301 2008:01 1.326 3.021 2.314 4.091 3.238 2008:02 -0.133 1.995 2.830 2.725 3.708 2008:03 -0.312 0.540 2.478 2.948 3.045 2008:04 -5.979 0.355 0.738 3.118 3.041 2009:01 -9.793 -2.902 1.452 1.637 3.174 2009:02 -16.521 -6.542 -1.022 1.658 1.814 2009:03 -9.068 -13.198 -3.971 1.270 2.696 2009:04 10.314 -7.548 -11.273 -0.531 -0.266 2010:01 5.060 6.816 -7.597 -4.734 -0.784 2010:02 3.540 3.619 4.781 -5.023 -3.597 2010:03 5.468 0.666 2.556 2.920 -2.487 2010:04 1.774 5.097 0.746 2.232 3.343 2011:01 3.194 0.588 5.286 1.702 2.124 2011:02 4.924 4.352 0.507 3.954 2.069 2011:03 0.018 3.518 0.932 1.694 3.389 2011:04 3.559 -1.522 -0.433 -0.842 1.349 2012:01 NA 2.693 -0.742 0.536 1.552 2012:02 NA NA 0.452 -1.204 -0.224 2012:03 NA NA NA 2.755 0.834 2012:04 NA NA NA NA -0.200 Notes for Table 6. (1) Each column gives the sequence of benchmark DARM projections for a given forecast step. The forecast steps range from one to five. The first step corresponds to the forecast that SPF panelists make for the quarter in which the survey is conducted. (2) The dates listed in the rows are the dates forecast, not the dates when the forecasts were made, with the exception of the forecast at step one, for which the two dates coincide. (3) The DARM benchmark model is estimated on a fixed 60-quarter rolling window. Its forecasts are computed with the direct method and incorporate recent monthly values of the dependent variable. Estimation uses data from the Philadelphia Fed real-time data set. Source: Tom Stark, Research Department, FRB Philadelphia. ------------------------------------------------------------ Table 7. Recent Realizations (Various Measures) Source: Philadelphia Fed Real-Time Data Set ------------------------------------------------------------ Variable: INDPROD (Industrial Production [QA]) Transformation: Q/Q Growth Rate Last Updated: 11/18/2011 16:35 1- Initial Release 2- One Qtr After Initial Release 3- Five Qtrs After Initial Release 4- Nine Qtrs After Initial Release 5- Latest Vintage ------------------------------------------------------------- Obs. Date (1) (2) (3) (4) (5) 2005:01 3.693 3.810 3.950 4.528 6.116 2005:02 2.045 1.474 1.627 2.797 1.694 2005:03 1.128 1.495 0.752 0.752 -1.666 2005:04 3.754 5.157 4.695 3.790 3.123 2006:01 4.460 4.965 5.152 2.995 4.099 2006:02 6.789 6.789 6.484 2.598 2.364 2006:03 3.601 4.015 4.015 1.838 1.655 2006:04 -0.592 -1.534 -0.846 -0.604 1.096 2007:01 1.558 1.077 1.588 1.708 4.427 2007:02 3.004 3.613 3.306 2.560 4.518 2007:03 3.944 3.460 3.525 2.055 0.935 2007:04 -0.931 0.238 0.958 0.958 0.266 2008:01 0.000 0.596 0.000 -1.717 -1.189 2008:02 -3.166 -3.167 -4.449 -5.874 -6.620 2008:03 -5.966 -8.910 -8.957 -9.534 -12.138 2008:04 -11.486 -12.778 -12.889 -15.761 -15.761 2009:01 -19.989 -19.128 -17.445 -18.806 -18.806 2009:02 -11.697 -10.219 -10.301 -11.471 -11.471 2009:03 5.217 6.952 8.319 NA 5.173 2009:04 6.976 7.129 5.595 NA 5.595 2010:01 7.569 7.063 8.115 NA 8.115 2010:02 6.478 6.938 7.154 NA 7.154 2010:03 4.709 6.666 NA NA 6.715 2010:04 2.295 3.113 NA NA 3.113 2011:01 6.096 4.885 NA NA 4.885 2011:02 0.865 0.432 NA NA 0.432 2011:03 5.119 NA NA NA 5.119 2011:04 NA NA NA NA NA 2012:01 NA NA NA NA NA 2012:02 NA NA NA NA NA 2012:03 NA NA NA NA NA 2012:04 NA NA NA NA NA Notes for Table 7. (1) Each column reports a sequence of realizations from the Philadelphia Fed real-time data set. (2) The date listed in each row is the observation date. (3) Moving across a particular row shows how the observation is revised in subsequent releases. Source: Tom Stark, Research Department, FRB Philadelphia.