Design Principles (based on http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1027&context=ecis2011)
(1) BASIC
1.1 Basic information
a) Application domain and prerequisites for applicability
The application domain is the implementation of Modernstats standards.
The documentation is in English.
b) Purpose of use
To promote, support and facilitate the implementation of modernisation standards, maintained by the UNECE Modernisation Committee on Standards, in National Statistical Organisations.
The first version should promote, support and facilitate the implementation of GAMSO v1.0, GSBPM v5.0, GSIM v1.1 and CSPA v1.5. See GAMSO, GSBPM, GSIM and CSPA.
c) Target Group
The stakeholders of the different modernisation standards. These range all the way from top management to service developers.
d) Class of entities under investigation
National Statistical Organisations
e) Differentiation from related maturity models
The Open Group Service Integration Maturity Model (OSIMM)
CSPA MM is based on OSIMM and focussed on services.
- The Levels (Silo, Integrated, Componentised, Services, Composite, Virtualised, Dynamically Re-configurable) are not appropriate for all 4 Modernstat standards.
- The Dimensions (Business Activity View, Business Capability View, Statistical Methodology, Information, Application, Infrastructure & Management, Governance & Organisation, Design Practises) were discussed and re-used where appropriate for all 4 Modernstats standards. See 1.2 a)
The Levels (0 None, 1 Initial, 2 Under development, 3 Defined, 4 Managed, 5 Measured) were discussed. 0 and 1 were combined. 4 and 5 were combined. 2 was split into two.
Software Development and Testing MM were used for inspiration
TDWI - Our Level names are based on those of TDWI maturity models. Nascent/Initial -> Initial. Adoption -> Implementation.
f) Design process and extent of empirical validation
Self-assessments without external support.
The maturity model was designed January - May, tested on a small scale April - July amongst participating organisations and tested on a larger scale September before being made available for all stakeholders December 2016.
1.2 Definition of central constructs related to maturity and maturation
a) Maturity and dimensions of maturity
Multi-dimensional approach facilitating the definition of assessment criteria and classification of improvement measures.
Dimensions (Architecture is implicit)
| Name | Description |
| Business | This dimension focuses on the business activity domain ie. the organisation's core business practices and policies. |
| Methods | This dimension focuses on the management of methods ie. how methods are designed, structured, implemented and executed. It includes statistical methodology, quality management, IT methods, process methods e.g. data collection methods and any other methods needed to support the business. |
| Information | This dimension focuses on how information is structured and integrated, how information is modelled, the method of access to data, abstraction of the data access from the functional aspects, data characteristics, data transformation capabilities, service and process definitions, handling of identifiers and the information model. |
| Applications | This dimension focuses on the structure and interaction of applications to provide business functionality using the information/data assets needed to deliver this functionality. |
| Technology | This dimension focuses on the logical software and hardware capabilities that are required to support the deployment of business, information, and application services. This includes IT infrastructure, middleware, networks, etc. |
b) Maturity levels and maturation paths
Levels (Level x Adoption) defined for each Dimension
Name | Description |
|---|---|
| Initial implementation | A few individuals are becoming interested in the potential value of the standard. The organisation as a whole is unaware of the standard. |
| Pre-implementation | Use of the standard is basic and limited to a few individuals. Parts of the organisation are becoming interested in the potential value of the standard. |
Early implementation | Use of the standard is spreading, but it is used in an inconsistent manner by individuals and single business units. A corporate-wide programme/strategy for use of the standard is being prepared. |
| Corporate implementation | A corporate-wide programme/strategy for use of the standard exists. There is a widespread awareness of the standard and it is used in a consistent way across the organisation. |
| Mature implementation | The standard is perceived as an important part of business operations/management, delivering value across the organisation. The standard is well understood, integrated into business processes and practices and used in a consistent manner across the organisation |
c) Available levels of granularity of maturation
There are maturity 5 levels. Assesors should record their current and target levels with the degree of granularity that they consider appropriate for their purposes.
d) Underpinning theoretical foundations with respect to evolution and change
- Stability – The model is stable and new versions are developed in a controlled manner.
- Complete coverage - The model covers all Modernstats Standards GAMSO, GSBPM, GSIM and CSPA.
- Extensible - The model is extensible ie new Modernstats Standards can be added
- User driven – User perspectives inform the model to ensure that it meets the needs of the Modernstats user community.
- Improvements - The model illustrates how to improve from one maturity level to the next along each dimension
- Comparability - The model enables organizations/business units/statistical domains to compare their maturity level with other organizations/business units/statistical domains
- Dependencies - Dependencies between Modernstats standards, levels and dimensions are identified and considered.
- Coherence - The implementation of the standards in a coherent framework, where the inter-relationships among standards are made more evident as opposed to implementing each standard alone, will enhance the synergies among the standards.
- Tool independence – The model is not dependent on any specific IT setting or tool.
1.3 Definition of central constructs related to the application domain
Understandability and language adequacy
- Simplicity – The model is as simple as possible and easily understandable by the Modernstats user community.
- Terminology – The model uses clear terminology and whenever possible, uses existing terms and definitions.
1.4 Target group-oriented documentation
The basic information, the central constructs, and their interrelations are documented in a target group-oriented manner
(2) DESCRIPTIVE
2.1 Intersubjectively verifiable criteria for each maturity level and level of granularity
Assessment criteria are precise, concise, and clear in order to discriminate between Levels
SMART (Specific, Measurable, Achievable, Relevant, Time-Bound )
2.2 Target group-oriented assessment methodology
Assessment methodology features a procedure model that guides users through maturity assessments by elaborating on the
assessment steps, their interplay, and particularly on how to elicit the assessment criteria’s values. Results from an assessment
need to be correct, accurate, and repeatable. Self-assessment is possible without external support.
a) Procedure model
b) Advice on the assessment of criteria
c) Advice on the adaptation and configuration of criteria
d) Expert knowledge from previous application
(3) PRESCRIPTIVE
3.1 Improvement measures for each maturity level and level of granularity
Development of roadmap for improvements.
Includes improvement measures for each maturity level (and available level of granularity) in the sense of good or best practices.
Provides a catalogue of generic improvement measures?
3.2 Decision calculus for selecting improvement measures
Provides basic selection guidelines.for improvement measures?
a) Explication of relevant objectives
b) Explication of relevant factors of influence
c) Distinction between an external reporting and an internal improvement perspective
3.3 Target group-oriented decision methodology
Provides basic selection guidelines for decision methodology?
a) Procedure model
b) Advice on the assessment of variables
c) Advice on the concretization and adaption of the improvement measures
d) Advice on the adaptation and configuration of the decision calculus
e) Expert knowledge from previous application