The objective of the evaluation is to assess the progress made after the Key Steps/requirements were identified in the Modernisation Maturity Assessment (based on the self-assessment criteria) and the Gap Analysis was performed.   

This instrument can be used to make easier the evaluation of the results obtained some period after the performance of the Gap Analysis or between two iterations.

A successful strategy for Evaluation is to focus on projects/actions that will deliver short-term pay-offs and so create an impetus for proceeding with longer-term projects/actions

During the evaluation phase new capabilities and practices can be identified. This is a useful input to Consolidation Template.


In the evaluation we perform the following: 

  • Gather evaluation inputs: Modernisation Maturity Assessment, Gap Analysis, what actions did we do after the Gap Analysis, who did them, resources used and Evaluation Report from the previous iteration
  • Conduct evaluation: evaluate the progress made towards the target levels, what worked well/could have been better
  • Plan for next iteration: what should be done in the next iteration

To prepare and carry out the evaluation:

  • Identify a cross-cutting group based on the results of the Gap Analysis, involving, where appropriate, members of the Business, Information, Methods, Applications and Technology functions within the statistical organisation.  This group can have different members from the one that made the Modernisation Maturity Assessment
  • Review Modernisation Maturity Assessment (from Preliminary actions)
  • Review Gap Analysis from the previous stage (from Planning actions)
  • Evaluate the progress made in moving from the current level to the target one using the following table and provide more details if the result is Improvement needed or Successful

Evaluation

DescriptionPossible actions

Improvement needed


Monitoring of the results shows that the action contains possible risks affecting the next action.


 Provide details of what needs to be better.

Need to wait for more resources/higher priority/necessary deliverables from other actions

Unexpected obstacle ahead – choose an alternative route & update work plan

Need to repeat current action until the necessary quality is achieved

Effective


Monitoring of the results shows that the action carried out is adequate to start the next action.Proceed to next action in the workplan

Successful

Monitoring of the results shows that the action has positive effects for the next action.

Inform internal and external stakeholders about the success by 

providing insights in lessons learned.

 

 The output of the evaluation is an Evaluation Report which can be used as an input to the next iteration.

 

Evaluators   
Evaluation date   

Modernisation standard(s)

(GAMSO, GSBPM, GSIM and/or CSPA)

being implemented:


   

Dimensions

Description 

Evaluation      

(Improvement needed, Effective or Successful)                    

Comments on what did / did not go well

                                          

Business

This dimension focuses on the business activity domain i.e. the organisation's

core business practices and policies.



Methods

This dimension focuses on methods i.e. how methods are designed,

structured, implemented and executed. It includes statistical methodology,

IT methods, data collection Methods, process methods and any other

methods needed to support the business.



Information

This dimension focuses on how information and/or metadata are structured

and integrated, how information is modelled, abstraction of the data access

from the functional aspects, data characteristics, data transformation capabilities,

service and process definitions, handling of identifiers and the information model.



Applications

This dimension focuses on the structure and interaction of applications to provide 

business functionality using the methods and  information/data assets needed to

deliver this functionality.



Technology

This dimension focuses on the logical software and hardware capabilities that

are required to support the deployment of business, methods, information, and

application services. This includes IT infrastructure, middleware, networks, etc.






  • No labels