COVID-19

An online discussion has opened on the website of The Statistical Journal of the IAOS about robustness of methods for producing business statistics during economic downturns. 

This is available at the following link:

Robust Official Business Statistics Methodology During COVID-19-related And Other Economic Downturns


It is based on the article "Robust official business statistics methodology during COVID-19-related and other economic downturns" by Paul A. Smith and Boris Lorenc, to be found on the same website.

---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

COVID-19

A report by the Hungarian Central Statistical Office (HCSO) on its activities in response to the Covid-19 crisis, submitted by Agnes Andics: Covid 19 Activities


---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

COVID-19

On behalf of Boris Lorenc, Bright Lynx:

That there are risks for quality of produced business and economic statistics at times of economic downturns has been noted before, not the least on ENBES's first EESW - the 2009 edition in Stockholm - which was held just at the end of the "Great Recession" of 2007-2009. Some of the pointers here on ENBES's site are related to these contributions.

While COVID-19 is a pandemic with catastrophic consequences for populations and countries worldwide, the massive economic downturn in its wake offers yet another opportunity for business survey methodologists to reflect on methods applied in the field and may give them a chance to further improve their methods.

A part of the risks involved stems from the methodologists' reliance on some implied assumptions, expectations or implicit or explicit models.

Generally, to process and produce results on variables of interest, we use and rely on some auxiliary variables. In stratified sampling, a classical example of an auxiliary variable is the preceding period's value of the same variable of interest (say, turnover the year before).

Similarly in estimation, that same auxiliary variable could be used in a ratio-type estimator. In editing, a score for selective editing may employ the preceding period's value to identify for editing those observations with significant deviations from their historical values.

Further examples of this kind can be given. Then there are impacts regarding time series, units' births and deaths, etc (Simkins, Smith and Brand, 2010).

While use of preceding period's values may work well when the economy is performing smoothly, there are clearly risks associated with their use at times of economic turmoil. The preceding period is in times of economic turmoil not a good indicator of how the current period performs. The stratification will be less than optimal, the ratio estimator's bias might become noticeable, the editing efforts might be misdirected and far more resource demanding than actually intended.

Preceding period's value does not have a relation to the current period's value except for a knowledge that they both stem from the same unit (same business). The relation for which the preceding period's value is used in producing the statistics of interest is based on preceding values' "good behaviour" through time, which is in turn based on smooth performance of the economy. Refer to this as the "statistical relation" of an auxiliary variable and a variable of interest.

To this can be contrasted an auxiliary variable from the same time period, for instance turnover as the variable of interest and employment as an auxiliary variable (or v.v). As the current economic downturn clearly demonstrates, if turnover of a business is impacted, also its employment will be impacted. Refer to this as the "intrinsic relation" of an auxiliary variable and a variable of interest. Businesses simply function so that if there is a loss of turnover, there is likely also to be a loss of employees.

The current economic downturn is an opportunity for business survey methodologists to gather empirical evidence on which variables - among those they are using or can get access to - are only statistically related, and thus prone to quality breakdowns in times of economic swings, and which are intrinsically related and thus less risky to use in processing and producing statistics.

Our goal should be to then promote the use of the intrinsically related variables irrespective a downturn or not, as a downturn in general comes without announcing itself in advance.

It need not be that there is an abundance of intrinsically related variables so that the task is just to pick out among a wide offering.

The task may not be simple, but now there is an opportunity - not existing in 'normal' times - to gather empirical evidence and learn. And in that sense make a positive use of the pandemic to better the business survey methodology of the future.

And a reflection/addition that I'd have on this opinion piece is that intrinsically related variables of course don't come packed with a lid saying "intrinsically related". Thus business survey methodologists would have to further their knowledge of business operations in order to _understand_ what business functions are intrinsically related, leading to also variables/indicators of these functions being related.

That theoretical understanding, supported by empirical evidence collected during economically challenging times like these, may permanently bring the practice of business survey methodology to a safer ground.

This is then yet another call to go beyond the statistics itself and gain knowledge of, if not the subject matter, then at least the body that acts: that is, the business. It might be beneficial to have business economists involved.


  • No labels

1 Comment

  1. The ONS has been making exactly this kind of adjustment (admittedly not in a business survey):

    "Imputation used for the LFS was not designed to deal with the changes experienced in the labour market in recent months. Experimental work with adjusted methodology suggests the use of the existing methodology has understated the reduction in the actual numbers of hours worked by approximately 5% to 6%. Figure 5 shows the industries that have experienced the largest reduction in hours because of the coronavirus are also those where this reduction is most understated. For example, using this adjusted imputation methodology, the hours worked in accommodation and food service activities decrease by a further four hours compared with the original imputation method, to an average of 12.0 hours a week in March to May 2020. Further information can be found in the section on Measuring the data.

    "

    (See https://www.ons.gov.uk/employmentandlabourmarket/peopleinwork/employmentandemployeetypes/bulletins/employmentintheuk/latest for the full bulletin).

    paul smith