The suggestions below are based on the discussion of the GSBPM "Task" Task Team.


Sub-process 1.3:

We are talking more about "accessing data" instead of "transmitting data". This change of perspective should be reflected in the text of the GSBPM (maybe also generate additional tasks somewhere?)


Sub-process 1.6:

How to handle decision points in the statistical business process model, such as approval of business cases of action plans (1.6 & 8.3 and possibly even more in the process)?


Sub-process 2.1:

While Phase 7 (Disseminate) has many activities about release and dissemination, nothing about this is explicitly designed anywhere in Phase 2. It should be included as a task in sub-process 2.1, also in GSBPM explicitly.


Sub-process 2.2:

“Statistical unit” is not discussed anywhere, but this is very important when we design variables, this needs to be in GSBPM explicitly. Also, this task comprises design of delineation of "statistical units" (observation and analytical units) from so called "units of collection" (administrative, legal etc. units).


Sub-process 2.4:

The wording "population frame" is used to also cover non-sampling scenarios.

Although GSBPM sub-process 2.4 says “This sub-process only applies to processes which involve data collection based on sampling, such as through statistical surveys.”, even if we use administrative registers (non-direct collection), we think there could be some kind of “filtering” of the entire register depending on the target population, also, for census, we will need some frame for the enumeration.


Sub-process 4.4:

The GSBPM needs to systematically analyse and define what is happening in the "finalise" sub-processes (Phases: 3, 4, 5, 6).


Sub-processes 5.3 & 5.4:

There are some modern approaches/tools that could detect errors and edit them at the same time, which blur the distinction between sub-processes 5.3 and 5.4.


Sub-process 6.4:

GSBPM does not mention ethical considerations here, even though there are. The GSBPM revision team should analyse how the ethical considerations are affecting the statistical work and how those perspectives can be built into the model.


Sub-process 7.1:

The word “system” is a bit confusing. Components or modules may be more appropriate.


Sub-process 7.2:

It is unclear when dissemination actually takes place as 7.2 is about producing dissemination products and 7.3 is on managing release of dissemination products.


Sub-process 7.3:

A suggestion from MWW2022 is that a version number could be added to the product.

It is important to explain and amend the error after dissemination, instead of just retracting a product.

It is noted that GSBPM does not have much discussion on dissemination planning.


Sub-process 7.4:

Doesn’t the core process of data production end with the release of the products? Would product promotion and user support fit better as a corporate level activity (or under Manage Consumers in GAMSO)?

  • No labels

2 Comments

  1. InKyung Choi

    Regarding 6.2 and 6.3, responsibility of NSO explaining ML-based results was mentioned during meetings of the GSBPM "Task" task team and the GeoGSBPM task team: 

    • "Results produced by machine learning techniques have nature quite different from traditional methods, efforts would be needed to explain the results internally and externally" (GeoGSBPM meeting notes from December 16, 2020)
    • "Participants mentioned that sometimes validation means that if a new method/technique is used to produce statistics, then the NSO also needs to explain this to the users, basically needs to be more transparent. This can be considered also as some kind of validation. Example: NSO starts to produce statistics using ML while previously it produced the very same statistics using "traditional" processes. In this case, the use of ML needs to be explained and the NSI needs to validate the use of a new technique. This is especially important when users are not familiar with new techniques or even skeptical about some of them: ML could be an example for this case." (proposal from MWW2022 participant on the GSBPM "Task" task team work)

    Perhaps something to discuss when revising GSBPM?

  2. InKyung Choi

    Regarding 6.2 and 6.3 again, I think the scope of work between these two sub-processes is unclear; groups working on GSBPM always needed to discuss this to clarify e.g., 

    • "For sub-processes 6.2 and 6.3, members discussed the difference between validation and interpretation of outputs. It was mentioned that validation is about checking the requirement with rules/standards, whereas interpretation has to take into account other information and put the results in context." (GSBPM task team meeting notes from 14 March 2022)
    • "While 6.2 is more about intrinsic validation check (e.g., by statistician), this sub-process 6.3 is using domain knowledge and external sources (e.g., by economists). " (Linking GSBPM-GSIM task team meeting note from October 26, 2021)

    Something to discuss when revising GSBPM...