Abstract
One of the multiple decisions that statisticians have to face on the release of seasonal and calendar adjusted series, is the revision policy when new data are available. The INE used to apply the policy of Partial Concurrent Adjustment: ARIMA Parameters in JDemetra
Keywords
Introduction
There are two main widely used methodologies for seasonal adjustment: the model based approach (see [1, 2]) and the fixed filters approach (see [3, 4]). Both methodologies are officially used (and recommended) by Eurostat and by the European Central Bank. This paper refers only to the former methodology as it does not make any sense in the latter. Note that the first step in the signal extraction approach is to obtain an autoregressive integrated moving average (ARIMA) model for the complete series, so it is sometimes called the ARIMA-model based seasonal adjustment method.
TRAMO-SEATS (that stands for Time Series Regression with ARIMA Noise, Missing Observations and Outliers-Signal Extraction in ARIMA Time Series) is a program following the ARIMA-model based approach, and it consists of two steps. In the first step, the reg-ARIMA model that fits best the series is adjusted. In the second step, the ARIMA model is decomposed into several ARIMA models, one for each of the unobserved components (Trend-cycle, Seasonal, Transitory and Irregular, see [5]). The unobserved components are then estimated using the Wiener-Kolmogorov filter, which has the property of being the MMSE (Minimum Mean Squared Error) estimator. This filter is symmetric and centered, convergent in B (backward operator) and in F (forward operator). Unless the model for the observed series is a pure AR model, the filter will extend from
JDemetra
JDemetra
The revisions of seasonal adjusted data take place for two main reasons. First due to the availability of new observations in the observed time series, and second because of a better estimate/identification of the seasonal pattern. The former is unavoidable, but only causes revisions near the time points where the data set changes, often near the end of the time series (in most cases we just get one more observation at the end of the series). Regarding the latter, a different estimate of the seasonal pattern produces small revisions from the beginning of the series, because of the small changes in the estimated coefficients in the Wiener-Kolmogorov filter. However, a different model for the seasonal pattern results in a completely different Wiener-Kolmogorov filter, even if the model for the observed series is preserved, leading to big differences from the beginning of the series. The challenge is to find a balance between the need for the best possible seasonally adjusted data, specially at the end of the series, and the need to avoid revisions that may later be reversed (see chapter 4 in [8]).
The INE started publishing Seasonal and Calendar adjusted series for Short Term Statistics in 2003,1 using TRAMO and SEATS. In 2018 the INE migrated to JDemetra
The first revision policy applied is based on two principles:
Identify the proper model (ARIMA model, calendar regressors and outliers) once a year (Using the time series with observations expanding until December in the previous year). Re-estimate all coefficients every time new data become available (monthly or quarterly).
This revision policy is implemented in JDemetra
Canonical decomposition
The TRAMO-SEATS method is considered a model based signal extraction method (MBSE), based on ARIMA models. TRAMO is a program for estimation and forecasting of ARIMA models with regression variables, missing observations and outlier detection. From the ARIMA model obtained by TRAMO, SEATS derives appropriate models for the unobserved components (Trend-cycle, Seasonal, Transitory and Irregular, see [9]).
We consider the regression-ARIMA model:
where
The ARIMA model for
where
We now provide a brief introduction to the canonical decomposition to better understand the new policy adopted.
SEATS decomposes a series that follows model Eq. (2) into several components: the Trend-cycle, Seasonal, Transitory and Irregular (see [2, 9]). The decomposition can be multiplicative or additive. In the following we consider the additive decomposition, because the multiplicative one can be expressed as an additive scheme taking logs.
Let
(where
The decomposition assumes orthogonal components, and each component has an ARIMA model.
If the sum of the minima of the spectra of all the components is non-negative, the decomposition is said to be admissible. In this case, in order to identify the components, as much noise as possible will be extracted from each component, except for the irregular one where all the extracted noise is added. The decomposition so achieved is unique and it is called canonical.
Therefore, the components are determined from the factorization of the AR polynomial in the model for
Let the total AR polynomial
where in the TRAMO-SEATS method
Non-stationary roots:
The roots of Since
The roots of The roots of Stationary roots: If
Roots of
Real positive roots:
If If where Real negative roots:
If If If Where Complex root: Let
If Otherwise it is assigned to the transitory component. By default, Roots of
If
When If If
There are some exceptions to the previous rules (see [9]).
One of the multiple decisions that statisticians have to face on the release of seasonal and calendar adjusted series, is the revision policy when new data become available. There are different revision policies (see [8]) such as:
Current adjustment: Based on the re-identification and re-estimation of the model, filters, outliers and regression parameters at appropriately set review periods. Concurrent adjustment: Based on the re-identification and re-estimation of the model, filters, outliers and regression parameters every time new data become available.
Both of these strategies have some drawbacks. In particular, under current adjustment, we are keeping the model until the next review despite the fact that according to the new evidence perhaps it is no longer acceptable. On the other hand, concurrent adjustment does completely review the model each time we have a new observation of the series. While this ensures that we have a well specified model at each step, it might also result in major revisions from the beginning of the series after each new observation becomes available. This is because re-identification might lead to a model change, thus changing the Wiener-Kolmogorov filter used to extract the seasonal component [10].
Therefore, in practice, the following policies are applied:
Partial concurrent adjustment: The model, filters, outliers and calendar regressors are re-identified once a year and the respective parameters and factors are re-estimated every time new data become available. There are 6 different policies of this type implemented in JDemetra
Fixed model: The ARIMA model, outliers and other regression parameters are not re-identified and the values of all parameters are fixed. The transformation type remains unchanged. Estimate regression coefficients: The ARIMA model, outliers and other regression parameters are not re-identified. The coefficients of the ARIMA model are fixed, other coefficients are re-estimated. The transformation type remains unchanged. Estimate regression coefficients and ARIMA parameters: The ARIMA model, outliers and other regression parameters are not re-identified. All parameters in the RegARIMA model are re-estimated. The transformation type remains unchanged. Estimate regression coefficients and last outliers: The ARIMA model, outliers (except for the outliers in the last year of the sample) and other regression parameters are not re-identified. All parameters in the RegARIMA model are re-estimated. The outliers in the last year of the sample are re-identified. The transformation type remains unchanged. Estimate regression coefficients and all outliers: The ARIMA model and regression parameters, except for outliers) are not re-identified. All parameters of the RegARIMA model are re-estimated. All outliers are re-estimated. All outliers are re-identified. The transformation type remains unchanged. Estimate regression coefficients and ARIMA model: Re-identification of the ARIMA model, outliers and regression variables, except for the calendar variables. The transformation type remains unchanged. Controlled current adjustment: Apply current adjustment, checking the results with the ones obtained by “partial concurrent adjustment”, which is preferred if a significant difference exists.
So, taking into account all the advantages and disadvantages of the range of policies, the INE started applying Partial concurrent adjustment: ARIMA parameters, because this policy has the advantage of the incorporation of the new information when it becomes available, and also fulfills the requirement of presenting comprehensible data to the users. This last advantage disappeared when we observed the effect of this policy on the huge revisions from the beginning of the series.
Monthly growth rates of the seasonally adjusted service sector turnover index
Monthly growth rates of the seasonally adjusted service sector turnover index
Decomposition
Decomposition February
Decomposition March
Monthly growth rates
The INE started to analyze a new policy, which may be considered a compromise between the Partial Concurrent Adjustment: ARIMA Parameters policy and the Partial Concurrent Adjustment: Fixed Model. It can be summarized in the following principles:
Identify the proper model (ARIMA model, calendar regressors and outliers) once a year (In general, with data up to December of the previous year). Re-estimate all coefficients every time new data become available (monthly or quarterly period) avoiding model changes, on the unobserved components, by:
Fixing the last estimation of the model with admissible decomposition when a model change is triggered. Adjusting root assignment parameters to make sure autoregressive roots remain in the same component.
In this way, we still improve the estimation of the model parameters with the new data, while avoiding big revisions, as shown in the example of the next section.
This is an example of the huge revisions from the beginning of the series, applying Partial concurrent adjustment: ARIMA Parameters policy, with the Services Sector Turnover Index. The series starts in January 2000 and ends in March 2016. The model selected at the beginning of 2016 is (2,1,0)*(0,1,1), with 4 calendar regressors (that account for the effects of working days with holidays, Easter working days, Easter holidays and leap year) and one additive outlier in August 2012.
In February 2016, the seasonal and calendar adjusted series was published applying the Partial Concurrent Adjustment: ARIMA Parameters policy. In March 2016, when the seasonal and calendar adjusted series was going to be published, we noticed huge revisions from the beginning of the series, as shown in Table 1.
The second column of the table shows the monthly growth rates of the seasonally adjusted series with data until February 2016, applying Partial concurrent adjustment: ARIMA Parameters. The third column shows the rates with data until March 2016, same policy, which are very different. And the last column shows the rates obtained applying our new policy, which are much more similar to those in the second column.
Our first thought was that the new March 2016 observation could be an outlier, which yielded a drastic change in the coefficients estimation of the ARIMA model between the two periods. But we quickly realized that the new observation was not an outlier, the observed value in March 2016 was 119.3203132
Later on, we understood clearly that the reason for this significant discrepancy was the different assignment of the complex AR roots to the unobserved components, as we have seen in Section 2.
On one hand, the complex AR roots in February are allocated to the seasonal component, because the argument is 121.74 degrees (
On the other hand, the argument of the complex AR roots in March are allocated to the transitory component, because this time the argument is 122,58 degrees (
This different assignment of the complex AR roots in the two periods, yields a different theoretical model for the components (see Tables 3 and 4). This leads to a change in the corresponding Wiener-Kolmogorov filter, with similar consequences to those of a model change.
So, it is difficult to explain to users, that the growth rates between one period and another change from the beginning of the series because of the argument of the inverse AR roots. After all, the seasonal tolerance parameter (EPSPHI) was by default 2, but it could be changed by the statistician.
The new policy applied at the INE, calculates the proper seasonal tolerance in each period, in order to maintain the assignment of the AR roots to the same component over a year, so preserving the theoretical model for the unobserved components.
In this example, it was considered that the complex AR roots were allocated to the seasonal component throughout the year, so the seasonal tolerance in March 2016 was fixed equal to 2.6. The results shown in Table 5 are the monthly growth rates of the seasonal and calendar adjusted series obtained with Seasonal Tolerance, EPSPHI
Another case with a possible change in the theoretical model for the seasonal component, applying Partial Concurrent Adjustment: ARIMA Parameters policy happens when SEATS changes the model selected at the beginning of the year for the series because of a non admissible decomposition for a specific period. Our revision policy implemented checks if SEATS has changed the model, and if that is the case, the estimation of the coefficients of the model obtained in the more recent period (in the current year) with admissible decomposition is used instead of changing the model in the middle of the year. This is the same as applying the Partial Concurrent Adjustment: Fixed Model policy for a specific period.
Conclusions
Although we know that revisions are necessary in Seasonal Adjustment when new data become available, i.e., the adjustment reflects the new information, it is important to verify that these are reasonable.
If revisions in the final period, (and also in the two previous years), appear, this may be considered as reasonable. If, however, we observe huge revisions from the beginning of the series, this should always raise a red flag.
So, the new revision policy applied at the INE, which can be considered a compromise between the Partial Concurrent Adjustment: ARIMA Parameters policy and
the Partial Concurrent Adjustment: Fixed Model, both implemented in JDemetra
Footnotes
Exceptions to this rule have been the Quarterly National Accounts and the Harmonised Labour Cost Index, where the seasonally adjusted data had been disseminated before.
Acknowledgments
The authors would like to thank the reviewers for their useful comments that helped to improve the paper.
