Chapter 1.3: Following international standards

Context

Standards generally refer to "a comprehensive set of documented agreements containing technical specifications or other precise criteria to be used consistently as rules, guidelines, or definitions of characteristics, to ensure that materials, products, processes and services are fit for their purpose. They are usually established by consensus and approved by a recognized body, generally by International Organizations such as United Nations Statistics Division (UNSD), International Monetary Fund (IMF) and Organization for Economic Co-operation and Development (OECD), and aim at the achievement of the optimum degree of order in a given context.Endnote 1

In the statistical context, there are three types of standards:

  • standards about statistical units, populations, concepts, variables and classifications in statistical programs that define the content and the structure of what is being measured;
  • statistical frameworks, such as the System of National Accounts, that provide a basis for compiling statistical information about certain sectors or dimensions of the economy, society and environment;
  • reference frameworks for modernization that provide a common structure and a shared vocabulary to develop, produce and disseminate statistical information consistently across all statistical programs and statistical organizations.

The motivation behind the adoption and use of standards by statistical agencies includes the following:

  • Informing Canadians, by providing consistent, coherent and relevant statistical information, about the country's economy and society;
  • Producing information compiled according to sound, internationally agreed-upon established approaches and best practices with regard to concepts, data sources and methods;
  • Allowing comparability within and between countries; and
  • Fostering interoperability and greater integration in official statistics by using a common statistical production architecture.

In other words, the use of standards is essential to maximize the effectiveness of statistical outputs and the efficiency of the production process in terms of inter-temporal, national and international comparability. It is key to the coherence and integration of statistics over time and across statistical programs and geographical boundaries.

The use of generally recognized standards should therefore be seen as a key strategic objective for all official statistical organizations, in particular because it has an impact on their legitimacy. Indeed, if statistical outputs are not coherent and comparable, their relevance to users is diminished. Since relevance for users must be the first attribute of high-quality statistics, any reduction in the relevance of a statistical agency's outputs could very negatively affect its credibility.

Moreover, the data revolutionEndnote 2 currently under way is a transformative impetus for official statistics that calls for a standards-based modernization agenda to facilitate exchange of practices and technologies within individual agencies, and within the official statistics "industry" as a whole.

Strategies, mechanisms and tools

This section includes a number of important considerations for the adoption and use of international standards. It focuses on the strategies and processes that national statistical offices (NSOs) should consider when planning and implementing any type of standards. Specific examples about Statistics Canada are provided as additional and complementary content.

This section is divided into four subsections:

  1. Generic strategic considerations in adopting and using international frameworks and standards;
  2. Strategies and processes for the adoption and the use of standardized statistical units, populations, concepts, definitions, variables and classifications;
  3. International statistical frameworks; and,
  4. Reference frameworks for modernization.

1. Generic strategic considerations in adopting and using international standards

Implementing an international standard requires a comprehensive strategic process to better inform statistical production and dissemination. As mentioned earlier in this chapter, there is often a strong link between the use of international frameworks and standards, the relevance for users of the data produced, and the efficiency of statistical systems. Although it is important to adopt international frameworks and standards, doing so can be a costly and demanding endeavour. Decisions about what to implement, when to implement, and how to implement must be well thought through, and must lead to realistic implementation plans.

The followings are a series of questions that NSOs should address prior to the implementation of an international standard:

  • Does the international standard address the realities of the society, the economy and the physical environment of the country?
  • Does the international standard inform the development of statistical programs?
  • Are all components of the standards relevant to local realities and users' needs? What components should be considered and which ones should be ignored? What are the most important components to include? What is the rationale for not following certain aspects of a standard, and what would be the impact? How much does the NSO need to deviate from the standard to meet the needs of its own context while respecting the underlying principle of comparability?
  • Has the NSO widely consulted its key stakeholders and data users to get their feedback? Were their points of view considered and their concerns addressed? Will the resulting data products be relevant in the national context?
  • Does the NSO have the appropriate funds to implement and maintain this new standard and to reconcile what is available now with what is expected to be coming further to the new implementation?
  • Does the NSO have the core infrastructure (statistical, information technology, human resources) to populate statistical data using this new standard?

It is important to emphasize the fact that applicability of any kind of standard or framework should be the object of deep consultations with key users and stakeholders. Consultations, engagement, and open and ongoing communications are crucial, because key users and stakeholders need to be consulted early in the process on potential changes and their impact; and once the NSO decides to implement a new standard or a change a standard, it is imperative that stakeholders and users be made aware, in advance, of the implementation plan and changes.

2. Strategy and process for the adoption and use of standardized statistical units, populations, concepts, definitions, variables and classifications

As previously mentioned, the adoption and use of standardized statistical units, populations, concepts, definitions, variables and classifications is key to ensuring statistical information coherence, integration and comparability across programs and geographical boundaries. Text box 1.3.1, below, provides definitions of the key concepts.

Box 1.3.1: Definitions

A statistical unit refers to the unit of observation or measurement for which data are collected or derived. On the social side, the most common statistical units include person, census family, economic family, household, and dwelling, while business surveys tend to target a location, an establishment, a company, and an enterprise. The universe formed by all statistical units within a dataset is referred to as the population. A concept is a general or abstract idea that expresses the social and/or economic phenomenon to be measured and is usually contained in a definition. A statistical classification is a set of categories that may be assigned to one or more variables registered in statistical surveys or administrative files, and used in the production and dissemination of statistics. Finally, a variable combines a concept with a statistical unit and defines the characteristic that is to be measured.

Good management practices in the use of international standards usually include the following:

  • a governance structure supported by consultation mechanisms ensuring that the impacts of any decision on the internal producers and external users of the statistics to which the standards will apply are taken into account.
  • the creation of specific and specialized organizational units, with the appropriate level of seniority, responsible for (1) taking the lead in the adoption and development of statistical standards, (2) supporting statistical programs/domains in their efforts to develop standards, where such standards do not exist or have become outdated, and (3) providing coherence or mapping between different versions of standards for time series.
  • a process to monitor the extent to which statistical standards are used by the statistical programmes/domains and make them accountable for their application of the standards; and
  • a communications strategy to ensure that all relevant staff are aware of statistical standards and any changes made to them, as well as the degree to which the application of each standard is compulsory.Endnote 3

In Statistics Canada, the use of standardized statistical units, populations, concepts, definitions, variables and classifications benefits from a specific governance structure and a policy that aim for an effective and consistent approach.

Statistics Canada's Policy on Standards provides a framework for reviewing, documenting, authorizing, and monitoring the use of standard names and definitions for populations, statistical units, concepts, variables and classifications used in Statistics Canada's programs. The policy prescribes different levels of implementation requirements for standards approved by the appropriate senior committee (the Methods and Standards Committee):

  • departmental standard – application is compulsory, unless an exemption has been explicitly obtained under the terms of the policy;
  • recommended standard – a standard that has been recognized with or without a trial period of a specified duration, after which it may be declared a departmental standard;
  • program-specific standard – a standard adopted by a statistical program.

Statistics Canada also has a mature and effective governance and management structure that ensures an integrated approach to strategic priority-setting, decision making and accountability (see Chapter 2.2: Integrated Strategic Planning). Responsibilities for adopting and using international standards are shared among three entities: the Standards Division, the Methods and Standards Committee, and program areas. The latter two are expected to ensure that the impact on end users of statistics is understood and factored into any standards-related decision.

The Standards Division's mandate is to develop, maintain and communicate statistical standards, to promote and monitor their implementation, to provide guidance on their interpretation, and to produce bridging mechanisms (for example, concordance tables) that facilitate the comparison or transfer of data across different classification schemes. The Standards Division is also mandated to develop, maintain and disseminate statistical metadata for the agency's surveys and statistical programs, under the terms of the Policy on Informing Users of Data Quality and Methodology.

The Standards Division is guided by international standard developments, by organizational needs or by program needs. The Methods and Standards Committee is the governance mechanism for strategic direction as well as for monitoring compliance and approving exceptions to the standards. It also receives guidance from a number of other internal committees, such as the Information Management Committee (see Chapter 2.7: Information Management), subject-matter committees, and external expert groups. Figure 1.3.1 illustrates the links within and outside the governance structure of the Standards Division.

The Methods and Standards Committee is a senior management committee whose role is to

  • assist and advise on the development and application of statistical standards and metadata within the agency's programs;
  • approve the adoption of statistical concepts, variables and classifications as departmental standards;
  • approve exemptions to departmental standards where appropriate;
  • advise on the development and use of sound statistical methods;
  • provide guidance on priorities for statistical research and innovation; and,
  • act as the focal point for the review and monitoring of corporate data-quality practices and issues.

This committee reports to the agency's senior management board; i.e., the Executive Management Board (EMB), to ensure global coherence of all management practices. Final decisions about departmental standards are the responsibility of the EMB based on recommendations from the Methods and Standards Committee.

Once standards are approved by this committee, they are implemented by survey programs. The program areas are responsible not only for implementing standards and communicating them to users, but also submitting to the Methods and Standards Committee applications for the declaration as standards of names and definitions of populations, statistical units, concepts, variables or classifications.

The illustration 1.3.1 highlights the governance structure for standards in Statistics Canada:

Figure 1.3.1: External and internal governance with regard to standards and classification at Statistics Canada

External and internal governance with regard to standards and classification at Statistics Canada
Description for Figure 1.3.1

This figure explains the external and internal governance with regards to standards and classification at Statistics Canada. The middle of the figure is composed of three components.

  1. Statistics Canada Governance and Management Structure.
  2. Methods & Standards Committee.
  3. Standards Division.

Those three sections have authority on seven other sections. The eight sections are International Expert Groups on Classification & Metadata, Canada-Mexico-U.S Steering Group on NAICS & NAPCS, CANADA-U.S. Steering Group for CIP, Federal / Provincial/ Territorial Groups, Statistics Canada' External Advisory groups, Committees with Other Federal Departments and Public Consultation.

While the Policy on Standards and Governance provides control and balance over the application of international standards within the organization, Statistics Canada has developed tools to support the use of standards and to gain in efficiency in applying them.

First, to facilitate the implementation of standards by program areas, the agency developed harmonized content for social surveys. In addition to providing efficiencies to survey managers who re-use questions and programming for applications rather than re-developing them for every survey or survey cycle, the goal of the harmonized content initiative is to increase comparability of survey data across cycles and surveys. Several concepts have been harmonized. These include a set of standardized questions and response categories, pre-packaged metadata to accompany questions, variables and classifications, automatic retrieval in the Questionnaire Development Tool, pre-programmed computer-assisted applications, and processing rules. The use of harmonized content has been made mandatory for all surveys except where an exemption has been granted.

Coding, which is the procedure for classifying the provided data on a questionnaire to standardized statistical classification—has also been facilitated through the use of a programming tool (G-CodeEndnote 4) and a coding interface (Classification Coding System). G-Code is an automated system which assigns codes to descriptions. It does so by matching input text descriptions, which could be from a questionnaire, with "parsed" or "standardized" descriptions in a G-Code database. The CCS is an electronic, generalized, interactive coding tool designed to assist with the assignment of numeric codes for the specified classification. It is the key corporate tool for computer-assisted "manual" coding. The system offers codes for industry, occupation, instructional classifications and products. It provides a common set of files and rules and thus ensures consistency in coding. It is designed to be easily customizable to suit individual requirements. Other advantages include (1) the ability to code to more than one classification, (2) the ability to search through the reference file or the classification code, title, description, or notes, and (3) the ability to embed CCS into a coding application and import other data sources, such as questionnaire responses.

The ability to code to more than one classification is particularly important when different international organizations require the statistical agency to report the same information according to different standards. In Canada, for example, industries are classified according to the North American Industry Classification System (NAICS). This standard is used to classify enterprises from the bottom up, according to the value-added of the primary unit activity. As per its name, this classification is used in Canada, the United States and Mexico; it is negotiated and revised trilaterally.

However, the international standard for industry is the United Nations International Standard Industrial Classification (ISIC). The primary focus of the ISIC classification system is the type of activity in which establishments or other statistical entities are engaged. The main criteria used are the following: (1) the nature of the goods and services produced; (2) the uses to which the goods and services are put; and (3) the inputs, the process and the technology of production. The third criterion corresponds to the conceptual basis of NAICS. Canada is therefore required to use ISIC to report its data to international organizations such as the UNSD, the IMF, and the OECD. Although the two classifications are moving towards greater coherence, both classifications must be maintained. To achieve this in an efficient manner, concordance tables have been developed. Canada reports industrial data on an ISIC basis using a concordance between NAICS and ISIC and performs the manual resolution of the non-unique match using the CCS.

3. Strategy and process for the use of international statistical frameworks

To ensure that the application of scientifically-based statistical methodology meets the requirements of international standards and the principles of official statistics, NSOs are encouraged to follow international statistical frameworks.

The most commonly used ones are probably those related to the production of national accounts, balance of payments, consumer and production prices indexes, and population censuses. There is also a variety of other frameworks on specific topics, including environment, health, income and wealth, labour.

An effective and strategic approach to adopting and using international frameworks normally involves a five-step process: (1) participating in international forums or committees where new frameworks are developed or revised; (2) planning; (3) consulting users and stakeholders; (4) developing an implementation and maintenance plan; and (5) pro-actively communicating with users and stakeholders "before and after" the implementation of the new framework.

In fact, the starting point is to stay informed of new standards being developed or revised and to participate in their adoption. This can be done at two levels. First, NSOs can participate or be represented in expert groups consisting of international experts in the domain where best practices and new frameworks are defined. Second, NSOs are usually invited to participate in the final discussions prior to the adoption of a new statistical framework. Active participation in international working groups and meetings is an effective vehicle for the agency to make its voice heard, to raise potential concerns, and to influence, to the extent possible, the end result. By doing so, the agency minimizes the need for adjustment to its specific national context. The discussions and developments for new or improved frameworks are usually led by international organizations, such as the UNSD, the IMF, the various regional United Nations economic commissions,Endnote 5 the OECD, the Food and Agriculture Organization (FAO) of the United Nations, the World Health Organization (WHO), and the United Nations Educational, Scientific and Cultural Organization (UNESCO).

When it is time for the agency to consider adopting or implementing a new statistical framework, consultations with users and stakeholders are activated, to ensure it is appropriate to the national context or to discuss appropriate adjustments that can be made. In parallel, designing and developing an implementation and maintenance plan requires agreeing on key milestones, on funds and resources that need to be put in place in advance, and on communications strategies to maintain ongoing dialogue and engagement with key users and stakeholders.

At Statistics Canada, each subject-matter division is responsible for managing and implementing the appropriate international frameworks that are relevant to the data for which the division is responsible. Statistics Canada's System of National Accounts is provided as an example in text box 1.3.2, at the end of this chapter.

4. Strategy and process for the use of reference frameworks for modernization

More recently, there has been growing interest for a standards-based modernization agenda. The High-Level Group for the Modernization of Statistical Production and Services, which reports annually to the Conference of European Statisticians (CES), has reviewed and adopted the standards necessary to support collaboration between agencies. In this respect, the Generic Statistical Business Process Model (GSBPM), the Generic Statistical Information Model (GSIM) and the Common Statistical Production Architecture (CSPA) have been identified as key standards to drive the modernization of official statistics.

The GSBPMEndnote 6 is intended to apply to all activities carried out by producers of statistics, at both national and international levels, which result in data outputs. The GSBPM is designed to be independent of data sources; it can therefore be used for the description and quality assessments of processes based on surveys, censuses, administrative records, and other non-statistical or mixed sources.

The rapid adoption of the GSBPM (or closely related national versions thereof) by statistical agencies around the world shows a wide acceptance of the idea that all statistical production can be modelled in terms of different combinations of less than 50 generic sub-processes. By mapping current and planned statistical processes to the GSBPM, it becomes easier to see where synergies can be found between processes, both within and across agencies. This, in turn, helps to identify good practices and improve efficiency within each sub-process. The GSBPM is also increasingly being used as a tool to identify the cost of different parts of the production process, and to inform strategic decisions on resource allocation.

The GSIM complements the GSBPM and provides a link to data and metadata standards such as the Data Documentation Initiative (DDI) and the Statistical Data and Metadata eXchange (SDMX). The GSIM is a reference framework of internationally agreed-upon definitions, attributes and relationships that describes the pieces of information used in the production of official statistics (information objects). This framework enables generic descriptions of definitions, and management and use of data and metadata throughout the statistical production process. The GSIM provides a common language to describe information that supports the whole statistical production process, from the identification of user needs through to the dissemination of statistical products. GSIM is a strategic approach designed to bring together experts from different disciplines (e.g., information technology, statistics, subject-matter areas.) to modernize and streamline the production of official statistics.

The CSPA provides a blueprint for designing and developing statistical production components in a way that makes them much easier to share within and between organizations.

These frameworks, in particular the GSBPM and the GSIM, have been adopted by the Methods and Standards Committee of Statistics Canada as departmental standards. They support the implementation of the Corporate Business Architecture (CBA) principles that dictate Statistics Canada's modernization strategy. For details refer to Chapter 3.1: Corporate Business Architecture.

Key Success Factors

To ensure efficiency and relevancy in adopting international frameworks and standards, it is very important for NSOs to consider the planning, consultation and communication phases, as outlined in the previous section.

Working closely with international organizations and other NSOs to develop standards for key statistical measures (e.g., economic accounts, labour force characteristics, price indices, environmental accounts), as well as internationally coherent classifications of industries, occupations and other characteristics, greatly contributes to a better understanding of the nature of the characteristics to be measured, as well as how to measure the characteristics more accurately.

Because Statistics Canada has built an expertise in developing and using standards, the organization is well-positioned to support other federal departments in using these standards and classifications for statistical purposes, as well as for administrative purposes. This can greatly contribute to the statistical usability of administrative data produced by these departments.

The fact that Statistics Canada operates in a centralized statistical system helps establish a strong culture of support in implementing statistical standards. It also facilitates the development of standards-based statistical programs, such as the Integrated Business Survey Program, the harmonized content initiatives for social and business statistics, and the adoption of the GSBPM and GSIM as key reference frameworks for modernization.

Challenges

NSOs in general need to continue to balance between the compliance to international standards and their own realities (e.g., maintaining time series, confidentiality of published data, user requirements, flexibility of creating variants, and available resources). When there are multiple standards to measure social, environmental or economic characteristics, it might also be challenging to choose the right one or to comply with all of the applicable ones. Although greater alignment between standards represents the longer-term solution to this issue, the short-term solution might be, as suggested by the guidelines for the implementation of the United Nations Fundamental Principles of Official Statistics, to "use the standard most frequently requested by users, and to maintain documentation on differences, including mappings, where applicable, to facilitate reporting according to alternative standards when necessary."Endnote 7

Looking ahead

With globalization, NSOs are moving towards global-level standards and a greater degree of international collaboration in building common statistical infrastructures. Adopting common frameworks and standards needs to be efficiently, consistently and systematically integrated into and linked with the Quality Assurance Framework (for more details, refer to Chapter 1.5: Quality Management), business/information architectures, and structures for statistical classifications and other statistical metadata.

Box 1.3.2: Example of the use of an international statistical framework at Statistics Canada

The System of National Accounts

The System of National Accounts (SNA) is the internationally agreed-upon standard set of recommendations on how to compile measures of economic activity. The SNA describes a coherent, consistent and integrated set of macroeconomic accounts in the context of a set of internationally agreed-upon concepts, definitions, classifications and accounting rules.

In addition, the SNA provides an overview of economic processes, recording how production is distributed among consumers, businesses, government and foreign nations. It shows how income that originates in production, and that is modified by taxes and transfers, flows to these groups, as well as how they allocate these flows to consumption, saving and investment. Consequently, the national accounts are one of the building blocks of macroeconomic statistics, forming a basis for economic analysis and policy formulation.

The SNA is intended for use by all countries, having been designed to accommodate the needs of countries with economies that vary in nature, complexity and level of development. It also provides an overarching framework for standards in other domains of economic statistics, facilitating the integration into the national accounts of the data produced by these statistical systems.

In Canada, the majority of national, provincial and territorial macroeconomic indicators originate from the Canadian System of Macroeconomic Accounts (CSMA) program. These indicators include such things as gross domestic product, net worth, savings, household disposable income, and government debt.

Statistical revisions are carried out regularly in the CSMA to incorporate the most current information from censuses, annual surveys, administrative statistics, public accounts, for example, and to implement improved estimation methods. These types of revisions are referred to as annual revisions, and are generally restricted to the most recent three to four years of annual estimates.

Statistics Canada also conducts what are often referred to as "historical" or "comprehensive" revisions to the CSMA. These revisions reflect new concepts, accounting treatment, classification systems or methods, as specified by international accounting standards, or are the result of ongoing research at Statistics Canada. Statistics Canada conducted these types of revisions every 10 to 15 years, with major revisions taking place in 1986, 1997 and, most recently, 2012.

The most recent update came from the new SNA manual, released by the United Nations Statistical Commission in 2008. On this basis, Statistics Canada has determined that, following the 2012 release, revisions relating to concepts, methods, classification systems, and accounting standards will be conducted more frequently, and will be rolled into the annual CSMA revision process. Two factors drive this change. The first is to ensure that the CSMA remains relevant and reflects the current state of the Canadian economy. The second is to ensure that the CSMA remains internationally comparable. Most other G-20 nations are conducting comprehensive revisions with increased frequency, and the CSMA is aligning itself accordingly. While the revisions to CSMA concepts, methods and accounting treatment will occur more frequently, they will be smaller in scale than those carried out in the past.

Upcoming revisions are usually included in Statistics Canada's 10-year investment plan to ensure that proper resources will be available. They are also managed by experts from the Macroeconomic Accounts branch using Statistics Canada's Project Management Framework. The use of this framework ensures that the implementation of the revisions stays on budget, in scope and on time and that changes, risks and interdependencies with other statistical programs are properly addressed.

Communication plans are also developed to communicate upcoming revisions well in advance, so that users can understand the revisions and adapt systems, analysis and models to incorporate new estimates.

Endnotes:

Endnote 1

United Nations Statistics Division. 2012.

Return to endnote 1 referrer

Endnote 2

Smith. W. 2015.

Return to endnote 2 referrer

Endnote 3

United Nations Statistics Division. 2012.

Return to endnote 3 referrer

Endnote 4

Picard, V. 2015.

Return to endnote 4 referrer

Endnote 5

The various regional United Nations economic commissions include: United Nations Economic Commission for Africa (UNECA), United Nations Economic Commission for Europe (UNECE), Economic Commission for Latin America and the (ECLAC), United Nations Economic and Social Commission for Asia and the Pacific (UNESCAP), and United Nations Economic and Social Commission for Western Asia (UNESCWA).

Return to endnote 5 referrer

Endnote 6

United Nations Economic Commission for Europe. 2013.

Return to endnote 6 referrer

Endnote 7

United Nations Statistics Division. 2015.

Return to endnote 7 referrer

Bibliography

Picard, Vincent. 2015. High-speed coding, Statistics Canada, Internal publication. Accessible on demand.

Smith, Wayne. 2015. The Data Revolution – Presentation to the 3rd International Open Data Conference Presentation, Wayne Smith, Chief Statistician.

Statistics Canada. 2004. Policy on Standards, Ottawa. Internal document. Accessible on demand.

Statistics Canada. 2000. Policy on Informing Users of Data Quality and Methodology, Ottawa. Consulted on 11th of March 2016 and retrieved from http://www.statcan.gc.ca/eng/about/policy/info-user

United Nations. 2014. Fundamental Principles of Official Statistics: Implementation guidelines. Consulted on 11th of March 2016. Retrieved from http://unstats.un.org/unsd/dnss/gp/impguide.aspx

United Nations Economic Commission for Europe. 2013. Generic Statistical Business Process Model. Consulted on 11th of March 2016 and retrieved from http://www23.statcan.gc.ca/standards-normes/gsbpm-msgpo/2013/index-eng.html

United Nations Statistical Division. 2012. Global Inventory of International Statistical Standards. Prepared by the Committee for the Coordination of Statistical Activities (CCSA). Consulted on 11th of March 2016 and retrieved from http://unstats.un.org/unsd/iiss/MainPage.ashx

Date modified: