Data quality, concepts and methodology: Data quality, concepts and methodology

View the most recent version.

Survey methodology

Foreword

The information in this document is intended primarily to be used by scientific and technological (S&T) policy makers, both federal and provincial, largely as a basis for interprovincial and intersectoral comparisons. The surveys which generate these statistics also provide input for the development of a national aggregate Research and Development (R&D) series. These national R&D estimates are used to complete international questionnaires for the Organization for Economic Co-operation and Development (OECD) and the United Nations Education, Scientific and Cultural Organization (UNESCO).

The statistics are aggregates of the provincial government science surveys conducted by Statistics Canada under contract with the provinces, and cover the period 2003/2004 to 2007/2008. The provincial government sector consists of all provincial government departments, ministries, agencies and provincial research organizations (PRO). The PRO are surveyed separately and included in this paper.

In the past, surveys have been conducted in as many as nine provinces, the exception being Prince Edward Island. Currently, surveys are being done in Ontario, Manitoba, Saskatchewan, Alberta and British Columbia. The following ministries or departments sponsor the scientific surveys: Ontario Ministry of Research & Innovation; Manitoba Department of Science, Technology, Energy & Mines; Saskatchewan Advanced Education, Employment and Labour; Alberta Advanced Education and Technology; and British Columbia Ministry of Advanced Education and Labour Market Development (previously the Ministry of Advanced Education). The Institut de la Statistique du Québec conducts a similar survey collecting only research and development (R&D) data instead of total S&T activities for the province of Quebec.

Science surveys, like other surveys, depend on respondents' interpretation of definitions and methods of calculation. Accounting records are rarely available which use a science-based classification. Recognizing the fact that the data are estimates, they are still a good representation of science expenditures for the provinces. As in any ongoing statistical exercise, revisions will be necessary as definitions and procedures become clarified. It is also important to note that the same standards have been applied to the data of each province as are applied to data of the federal government.

For the national R&D statistics (GERD), no estimates are made for provinces for which there is not a corresponding survey. Gross Domestic Expenditures on Research and Development in Canada and the Provinces, National Estimates 1998 to 2009 Provincial Estimates 2003 to 2007 will be published in Catalogue no. 88-221, volume 2, no. 1 in December 2009.

We want to thank those who responded to each of the provincial and PRO surveys. Without their invaluable help and cooperation, the production of this report would not have been possible.

History of provincial government science and technology surveys

Prior to 1974, estimates were made for provincial government S&T expenditures using provincial estimates and Public Accounts.

In 1974, Ontario, Alberta and Nova Scotia sought the assistance of Statistics Canada in conducting surveys of S&T spending by their respective governments. In 1975, Saskatchewan joined this group, followed by British Columbia in 1977, Manitoba and New Brunswick in 1984, Newfoundland and Labrador in 1986 and Quebec in 1989.

In 1993/1994, three provinces, Newfoundland and Labrador, New Brunswick and Nova Scotia, did not contract with Statistics Canada for a survey due to budget constraints. In 1994/1995, the province of Quebec began collecting only R&D expenditures instead of total S&T. In 2001/2002 Saskatchewan did not contract with Statistics Canada for a survey.

In 2004/2005, British Columbia did not contract Statistics Canada to conduct a survey however in 2005/2006 they returned to the survey activity. In 2006/2007, the province of Newfoundland and Labrador participated in the survey. We are pleased to announce the participation of the province of Prince Edward Island although data are not yet available. In 2008-2009, New Brunswick successfully completed collection for three fiscal years 2007/2008, 2008/2009 and 2009/2010. The data for the province of Saskatchewan has been compiled and is scheduled to be released next year. We are pleased to announce the participation of British Columbia, Alberta, Saskatchewan, Manitoba and Ontario for the 2009-2010 reference years.

Provincial research organizations

All of these organizations have been established by their respective provincial and territorial governments, with a variety of enabling legislation and powers, to provide technical support to primary and secondary industries, to assist in the exploitation of provincial and territorial natural resources and to enhance the economy of their provinces and territories. Small and medium-sized companies with limited in-house technical capability use the services of the provincial research organizations.

In the historical tables you will see other organizations listed that are no longer included in our survey.

As of 2001, the Alberta Research Council Inc. (ARC) is included as an agency under the department of Innovation and Science of the Alberta Provincial Government. Previously, ARC was included in the Provincial Research Organization Survey.

Federal / provincial workshops on S&T statistics

In the fall of 1977, the first federal-provincial meeting was held in Ottawa. Representatives from British Columbia, Alberta, Saskatchewan, Ontario and Nova Scotia attended; as well as Statistics Canada and members of the Ministry of State for Science and Technology (MOSST).

The next meeting was held in 1984 with representatives from British Columbia, Alberta, Saskatchewan, Manitoba, Ontario, Quebec and New Brunswick attending. Statistics Canada sponsored the meeting and invited representatives from MOSST, Energy, Mines and Resources (EMR) and the Science Council. The objectives of the conference were to:

1. Provide provincial science policy and statistical users with an overview of products and services of the Science and Technology Statistics Division (STSD);
2. Provide a forum to allow discussion between STSD and provincial representatives to exchange views on science statistics; and
3. Achieve consensus on how to proceed with future provincial surveys.

In1999, Ontario proposed that Statistics Canada renew federal/provincial conferences and make them an annual event. Statistics Canada agreed and co-hosted the 1999 conference in Toronto. The agenda included topics such as innovation surveys, biotechnology surveys, intellectual properties in higher education, e-commerce and provincial needs and proposals.

Quebec and Statistics Canada co-hosted the 2000 conference held in Québec City. Discussions included economic indicators, an innovation study for Ontario, and biotechnology measurement.

In the fall of 2001, British Columbia and Statistics Canada co-hosted the conference in Victoria. Provincial representatives discussed high technology indicators, innovation index, and user needs and challenges. Statistics Canada presented an overview of current program developments and future plans.

Alberta and Statistics Canada co-hosted the 2002 conference held in Edmonton. Discussions included provincial indicators and an overview of current program developments and future plans.

In the fall of 2003, Statistics Canada was supposed to host the 5th annual conference in Ottawa. Due to budget constraints of many provincial governments, the conference was postponed and has not yet been re-instated.

Definitions

This report covers those scientific and technological activities which involve the generation, dissemination and application of new scientific and technological knowledge. The central activity is research and experimental development (R&D). In addition, there are a number of activities closely related to R&D; these are termed related scientific activities (RSA).

R&D is creative work undertaken on a systematic basis in order to increase the stock of scientific and technical knowledge, including knowledge of humans, culture and society and the use of this stock of knowledge to devise new applications.

It requires the acquisition of knowledge and not just information. New knowledge involves the integration of newly acquired information into existing hypotheses or the re-evaluation of existing observations.

The major related scientific activities are education support, technical surveys, statistical surveys, information services, special services and studies, and museum services. Education support and museum services are largely self-explanatory.

Technical surveys are activities directed towards exploration and systematic description of the earth and its natural resources. The activities include gathering, processing, collating and analyzing of data on natural phenomena except when part of a research project or a museum service. The preparation of maps and survey reports, their printing and cataloguing, are also included.

Statistical surveys are activities directed toward the collecting, processing and disseminating of statistics on humankind, their economic and social activities. Included are the development of technical methodology, statistical analysis and vital statistics.

Information services are all work directed to recording, classifying, translating, and disseminating information resulting from R&D in the social sciences or required in support of such R&D. Included are the operations of specialized libraries and archives, the publication of scholarly journals and bibliographies, and the organizing of scientific conferences. Grants for the publication of scholarly works are also included.

Special services and studies in the natural sciences are activities directed towards the establishment of national and provincial standards for materials, devices, products and processes; the calibration of secondary standards; non-routine quality testing; feasibility studies and demonstration projects.

In the social sciences, special services and studies are systematic investigations carried out in order to provide information needed for planning or policy formulation, including feasibility studies and demonstration projects.

Scientific and technological activities take place in both natural sciences and engineering and the social sciences and humanities. The natural sciences and engineering consist of disciplines concerned with understanding, exploring, developing or utilizing the natural world. The social sciences and humanities embrace all disciplines involving the study of human actions and conditions and the social, economic and institutional mechanisms affecting humans.

Six performing sectors are identified.

Intramural refers to the provincial ministry, department or agency performing a scientific activity.

Business enterprise denotes largely private corporations but also includes crown corporations with a commercial function (e.g., power utilities) and industrial research institutes not controlled by another institution.

The higher education sector covers post secondary educational institutions and affiliated teaching and research facilities.

Hospitals and health organizations – Canadian hospitals and health organizations which are not part of university medical schools, as well as private non-profit organizations.

Provincial research organizations include: New Brunswick Research and Productivity Council, Centre de recherche industriel du Québec, Industrial Technology Centre (Manitoba), Saskatchewan Research Council, Northern Research Institute, Nunavut Research Institute, Aurora Research Institute (Aurora College N.W.T.)

Other includes the federal government, municipal governments, individuals, institutions not identified with any other sector, and foreign performers.

Departmental personnel are classified into three major categories. Scientific and professional includes persons in a job requiring at least one academic degree or nationally recognized professional qualification. The Technical category includes people in jobs requiring specialized vocational or technical training beyond the secondary level. Other includes clerical, secretarial, administrative, operational and other support personnel. Personnel data are reported in full-time equivalent which is simply the portion of a person's time spent on S&T activities.

The objectives listed in this survey do not represent the total range of possible objectives; however, they are intended to cover the major areas of current technological interest. Respondents are asked to report expenditures under the objective which is primary to that expenditure.