The NetSupport software is required for our organization to be able to provide an effective Quality Control Monitoring Program. It will enable supervisors to provide comprehensive feedback to data collection clerks on core competencies in areas that cannot otherwise be addressed via auditory observation alone. This assessment illustrates that the risks involved with using NetSupport are far outweighed by the crucial function it provides. The application is essential for providing the necessary training, support and coaching data collection clerks need to meet our high standards for data quality control.

Objective

A privacy impact assessment was conducted to determine if there were any privacy, confidentiality and security issues associated with using NetSupport for the Quality Control Monitoring Program, and if so, to make recommendations for their resolution or mitigation.

Description

Statistics Canada has a legislative mandate under the Statistics Act to collect survey information from respondents on various topics. To fulfill this mandate, the agency is responsible for the objectives of maintaining high standards for quality control and conducting effective performance management of employees. The current Quality Control Monitoring Program was established in the regional offices in pursuit of achieving these objectives, however the program is rendered ineffective by the absence of visual observation for telephone interviews.

The NetSupport software is a third-party application that will address the need to have visual observation during monitoring sessions of telephone interviews. For our usage, the application will allow a set of users (i.e., Data Collection Supervisors) to conduct visual observation of other users' desktop screens (i.e., data collection clerks) for the sole purpose of performance management and quality control. The software will enable supervisors to evaluate in real-time the data collection clerk's skills, ensure data quality and identify areas for improvement in the interviewing process. As a result, the quality and level of detail supervisors can provide to data collection clerks for their performance feedback is greatly enhanced. At no point will the information viewed via NetSupport be recorded, collected or saved by the software.

For privacy impacts related to NetSupport, measures are in place to ensure that the impacted parties are informed. Data collection clerks are made aware of the possibility of being observed via their collective agreement, the training they receive and the interview script they read. Respondents of Statistics Canada surveys are made aware of monitoring at the beginning of the interview via the standard statement in our survey scripts that indicates a supervisor may listen to the call for quality control purposes.

Although NetSupport will not be saving/recording information, users of the software will have access to view the respondent's personal information while it is visible on the data collection clerks' screen. This may contain personally identifiable information such as names, addresses, ages, and other demographical information, as well as responses to our survey questions. Given the confidential nature of this information, the use of NetSupport will be restricted to supervisors and managers who have taken the Oath of Secrecy. These employees receive training on how to handle and protect confidential information that is subject to the Privacy Act and the Statistics Act.

Our organization is taking the necessary precautions to limit the number of risks involved with using NetSupport for respondents and employees. For example, the use of NetSupport will be limited to observing work-related performance only and for limited durations (e.g., 20 minutes). The user settings for NetSupport will also be restricted so that features that go beyond the purposes of monitoring performance will be disabled (e.g., recording of audio or video) to ensure it meets our security procedures. Furthermore, permissions for user accounts will be standardized and aligned with internal security procedures.

Risk Area Identification and Categorization

The PIA identifies the level of potential risk (level 1 is the lowest level of potential risk and level 4 is the highest) associated with the following risk areas:

a) Type of program or activity Risk scale
Administration of program or activity and services	2
b) Type of personal information involved and context
Only personal information, with no contextual sensitivities, collected directly from the individual or provided with the consent of the individual for disclosure under an authorized program.	1
c) Program or activity partners and private sector involvement
Within the institution (among one or more programs within the same institution)	1
d) Duration of the program or activity
Long-term program or activity.	3
e) Program population
The program's use of personal information for internal administrative purposes affects certain employees.	1
f) Personal information transmission
The personal information is used in a system that has connections to at least one other system.	2
g) Technology and privacy
The NetSupport software will be used to support the existing quality control and performance management program of the regional offices. It will assist supervisors with fulfilling their responsibility of monitoring telephone interviews and provide performance feedback. It does not collect, create or handle personal information. Aside from the request for the NetSupport Manager application itself, no new electronic systems or applications are needed to support the program in terms of creation, collection or handling of personal information. The application will need to be integrated into our networks to allow users to view the activity of the data collection clerks. This will require some modifications to our current firewalls in order to ensure this connection is established. Shared Services Canada (SSC) and Statistics Canada's IT partners have conducted preliminary testing and it has been confirmed that integration is feasible. The NetSupport software will involve surveillance as an administrative tool to measure the performance (via visual observation) of Statistics Canada's data collection clerks. As the information that may be accessed through NetSupport may potentially be personally sensitive for our respondents, it could be perceived as surveillance of respondents as there will be an additional person viewing their responses as they are submitted. To address this concern, the respondents will be made aware during the telephone call that a supervisor may be listening for the purpose of quality control. It is important to note that the surveillance purposes of the program are restricted to improving internal quality control practices only. For example, the NetSupport application will be used to observe if the data collection clerk is following procedures, entering data correctly and using appropriate techniques such as probing. The responses provided in a questionnaire by the respondent are not particularly relevant to the user who is accessing the information. They are a by-product of the quality control work, and not the main focus. Irrespective of the relevance of the data, all confidential information that is observed via NetSupport will be protected under the Statistics Act Oath of Office that is taken by the NetSupport user and the guidelines of the Values and Ethics Code. This protection applies to the data collection clerk's activities as well as the respondent's participation.
h) Potential risk that in the event of a privacy breach, there will be an impact on the individual or employee.
The potential risk of a privacy breach involving our organization's use of NetSupport is very low. The impact of a privacy breach on the individual or employee will be very limited due to the measures in place. Statistics Canada has legislation and practices that reduce and mitigate the potential risks involved in handling confidential information. Data Collection Supervisors will be using the NetSupport software for visual observation while conducting a monitoring session of the data collection clerk's telephone interview. These supervisors are deemed employees who have sworn an Oath of Office to protect the confidential information they encounter during their work activities. For their jobs, they handle and encounter confidential information on a daily basis and must adhere to the guidelines and repercussions of the Statistics Act and the Privacy Act. Statistics Canada is taking precautionary measures to reduce the impacts for individuals and employees regarding the use of NetSupport. For example, we are disabling features within the application that would pose additional privacy risks, such as recording, so that it cannot save or retain information. Also, the application will solely be used for the purpose of monitoring work activities of data collection clerks and helping supervisors conduct performance management. These restrictions provide an accountability framework for limiting the possibility for confidential information to be disclosed improperly. Safeguards are also in place to prevent the risk of a privacy breach coming from unauthorized access to Net Support. In addition to the existing security measures for preventing outside access to our networks, the application will be customized for enhanced security. This will involve requirements for user accounts, as well as passwords, and two-factor authentication, further limiting the group of people who may have access to the application.
i) Potential risk that in the event of a privacy breach, there will be an impact on the institution.
The potential risk for a privacy breach involving NetSupport to impact the institution will be very limited due to the measures in place. The practices and safeguards for using NetSupport will offer reasonable layers of accountability in the event that confidential information viewed via NetSupport is improperly disclosed. This organizational infrastructure will allow for a breach to be dealt with efficiently in a manner that reduces the impact on the institution. For example, the regional offices will be responsible for managing users of the program and ensuring their work activities adhere to the requirements of the Statistics Act. The checks and balances that exist within the reporting structure of the regions will help to ensure that users are held accountable for their use of NetSupport. In the event of wrongful disclosure of confidential information, users of NetSupport will be subject to the same recourse as for activities undertaken for general statistical programs (see Generic Privacy Impact Assessment for Statistics Canada's Statistical Programs.) . Furthermore, since the application will not be used to retain or store data there is a reduced risk for mishandling of information.

Conclusion

This assessment of NetSupport did not identify any privacy risks that cannot be managed using existing safeguards.

Date: March 2024

Program manager: Director General, Census Management Office

Reference to Personal Information Bank (PIB):

Personal information collected through the Census Test is described in Statistics Canada's "Census of Population - Census Program Content Test" Personal Information Bank (Bank number: StatCan PPU 007) which collects information related to individuals who have participated in content tests conducted to test Census of Population Program questions.

The bank describes individuals within households selected to participate in Census Program test surveys. Personal information may include name, contact information, demographic information (including age, date of birth, ethnicity, and religion), Social Insurance Number (SIN), citizenship status, languages spoken or understood, relationship to cohabitant(s), educational information, financial information, work and other social and economic characteristics depending on the particular census or survey.

The "Census of Population - Census Program Content Test" PIB (Bank number: StatCan PPU 007) is published on the Statistics Canada website under the latest Information about Programs and Information Holdings chapter.

Description of statistical activity:

Under the authority of the Statistics Act^Footnote1, Statistics Canada is conducting the mandatory Census Test from April to June 2024. The objectives of the Census Test which involves a sample of dwellings across the country are to determine whether new or revised questions under consideration for the 2026 Census of Population can be easily understood and correctly answered, to assess public reaction to these questions by testing them on a smaller scale basis, and to evaluate behaviour of staff when using new systems and procedures.

The Census of Population's purpose is to provide statistical information, analyses and services that measure changes in the Canadian population and, demographic characteristics. It serves as a basis for public and private decision making, research and analysis in areas of concern to the people of Canada.

The Census of Population is a reliable basis for the estimation of the population of the provinces, territories and municipal areas. The information collected is related to federal and provincial legislative measures and provides a basis for the distribution of federal transfer payments. The census also provides information about the characteristics of the population and its housing within small geographic areas and for small population groups to support planning, administration, policy development and evaluation activities of governments at all levels, as well as data users in the private sector.

Access to trusted statistical information is an essential foundation of democratic societies, both to support evidence-based decision-making in the public and private sectors and to inform debate on public policy issues. Particularly in today’s fast-paced environment, with an unprecedented pace and scope of change, accurate statistical information, comparable over time and across various levels of geography, is essential to help Canadians better understand their country in the context of timely, relevant and high-quality statistical information on Canada’s changing economy and society.

To ensure the continued relevance of the census to Canadians, Statistics Canada conducts a formal consultation at the start of each census cycle. During that time, Statistics Canada invites data users, stakeholders and the general public to provide feedback on what information they use, for what purpose and what, if any, data gaps Statistics Canada should consider addressing in the next census cycle. A Consultation Report, 2026 Census of Population Consultation Results: What we heard from Canadians, will be published on Statistics Canada's website in April 2024^Footnote2.

As in past censuses, extensive consultations on the questions to include in the 2026 Census of Population have been held with Canadians. New and modified questions, developed to reflect new needs identified in the consultations, have been qualitatively tested by Statistics Canada in 2023 using methods such as individual interviews and discussion groups.

Reason for supplement:

While the Generic Privacy Impact Assessment (PIA) addresses privacy and security risks related to statistical activities conducted by Statistics Canada, this supplement describes potential new risks associated with the collection, processing and use of data related to new census content being considered, and the possible concerns of Canadians about the intrusiveness of the collection. As is the case with all PIAs, Statistics Canada's privacy framework ensures that elements of privacy protection and privacy controls are documented and applied.

Statistics Canada uses its Content Determination Framework process to identify potential new census content for inclusion in the Census. The process begins by consulting external stakeholders on their uses of the data and related information needs, including requirements for relevance and quality. Statistics Canada also assesses the Canadian context which encompasses respondent burden and societal privacy concerns, and evaluates other considerations such as costs, operational factors, safeguards against loss of data quality and safeguards against loss of efficiency and/or quality in other Statistics Canada programs. The suitability of alternative sources (i.e., administrative data) is also considered as part of this process.

Key content additions for the 2024 Census Test are:

• Household composition and marital status
  • Modifications have been made to the format of the household composition and marital status module to include new questions and changes to the response options and question wording to reduce respondent burden, use inclusive language, and to better reflect changes in Canada’s social context.
• Second address
  • A two-part question has been added to identify people who live or stay at more than one address, including children in joint custody or students who live elsewhere while studying, to improve measures of family dynamics and living arrangements and to better enumerate fluctuating populations, important for municipal and urban planning.
• General health
  • A new question on general health has been included to collect information on the health status of people in Canada, including vulnerable populations and those living in small areas.
• Homelessness
  • A set of three new questions has been included to capture Canadians’ experiences with homelessness and other housing challenges over the past 12 months and to identify people currently in precarious housing situations. These data aim to help inform governments and organizations on levels of homelessness and other housing challenges particularly for rural and hard to reach communities.
• Commuting
  • A new question has been included to collect more detailed data on which days workers typically commute to work to better understand changes in commuting frequencies as many workplaces shift to hybrid models or remote work.
• Childcare expenses
  • The question has been restructured to ask about the amount paid for childcare per child younger than 12 years in the household and to identify any unpaid childcare. To enhance its analytical and policy relevance in the early learning and childcare domain, the scope of the question was changed to include childcare for reasons beyond enabling parents or guardians to work.

Necessity and Proportionality

The collection and use of personal information for the 2024 Census of Population Test can be justified against Statistics Canada’s Necessity and Proportionality Framework:

1. Necessity: Statistics Canada's mandate is to ensure that Canadians have access to a trusted source of statistics that meet their highest priority information needs. The efficient production of relevant, accessible, high-quality statistics helps to ensure that the Canadian economy functions efficiently and our society is governed effectively. As part of this mandate, Statistics Canada is responsible under the Statistics Act (R.S.C., 1985, c. S-19) for conducting the Census of Population every five years. By law, the government (by an Order-in-Council) prescribes the questions to be asked in the census. By the same law, each person is required to provide the information requested in the census and Statistics Canada must protect the confidentiality of the personal information provided by respondents. The next census will be conducted in May 2026. Being a major statistical operation, the census presents a formidable challenge for Statistics Canada and requires careful planning to ensure its successful completion. An essential element to ensuring this success is the conduct of a census test, which traditionally is scheduled two years prior to the census. The content proposed for the census is the result of a Census Content Determination Framework that begins with consulting external stakeholders on their uses of the data and related information needs including the requirements for relevance and quality, followed by an assessment of the Canadian context which encompasses respondent burden and societal privacy concerns, and an assessment of Statistics Canada considerations including costs, operational factors, data quality and safeguards against loss of efficiency and/or quality in other Statistics Canada programs.

   The specific content under consideration responds to high priority data requirements identified through consultation, for example:

   • Household composition and marital status
     • The family and household data resulting from this question are essential for all levels of government to develop effective policies and legislation regarding the composition of families and households. Data help identify, plan, evaluate and administer federal, provincial and local programs for childcare, schools, support for people with disabilities, older adults living alone, one-parent families and other vulnerable populations.
   • Second address
     • The purpose of this question is to fill a data gap for a variety of census data users (urban planners, municipalities, provincial and federal departments) who require accurate population counts in their regions in order to better plan the delivery of services and programs. This information would also reflect family dynamics and living arrangements, for example, by enumerating populations who spend time at multiple addresses, including children in joint custody or students who live elsewhere while studying.
   • General health
     • General health assessments are unavailable from population-level administrative data sources and although general health assessments are commonly included in health surveys, those surveys have limited sample sizes and population coverage. Including a general health question in the Census would provide necessary health information for key specific and/or vulnerable populations, which can assist in health care planning and policies. General health assessments are unavailable for the entire population which has resulted in significant data gaps for key vulnerable populations (e.g., First Nations people living on reserves, individuals with disabilities, and children and youth living in unique family structures).
   • Homelessness
     • These data will help fulfill reporting requirements under the National Housing Strategy Act, which recognizes housing as a human right and commits the federal government to further the progressive realization of the right to adequate housing.
   • Commuting
     • The Census is the only cross-national source of place of work and journey to work data. It is heavily used by provincial and municipal governments across Canada, in addition to researchers within various organizations.
     • Place of work and journey to work data support numerous federal, provincial, and municipal programs related to infrastructure and public transportation, as well as such things as sustainable development and environmental goals.
   • Childcare expenses
     • Childcare has recently emerged as a critical social policy in Canada. In December 2022, Bill C-35, An Act respecting early learning and child care in Canada, (the Canada Early Learning and Childcare Act)^Footnote3 was introduced in the House of Commons. Bill C-35 declares that the Government of Canada has as a goal to support the establishment and maintenance of a Canada-wide early learning and childcare system where families of varying incomes have access to affordable, inclusive and high-quality early learning and childcare programs and services regardless of where they live.
     • Along with the income data obtained from personal income tax and benefit records through data integration, these questions help determine the disposable income for Canada’s official measure of poverty—the Market Basket Measure.

   Note also that the 2024 Census of Population Test will collect data on sex at birth and gender, which was introduced in the 2021 Census so that more Canadians could see themselves in their census data, and to meet new data needs and adapt to societal changes. It allowed for the dissemination of information on transgender and non-binary populations. The historical question on “sex” was modified in 2021 to ask about “sex at birth”, for added precision.

   StatCan has assessed the Gender-based Analysis Plus implications with respect to the 2026 Census of Population cycle. The Census is representative of Canada’s entire population and data will be collected and presented in a way that allows for gender-based analysis. Data will be presented separately for males and females and by other identity characteristics. Prior to 2016, the census collected sex with binary options of male or female. In the 2016 Census, respondents who could not respond in a binary fashion were asked to leave their answer blank and provide a comment at the end of the questionnaire. After consulting with LGBTQ2+ organizations and conducting focus groups with transgender, non-binary and cisgender individuals, the 2021 Census collected sex at birth and gender. In preparation for the 2026 Census, Statistics Canada will consult with LGBTQ2+ organizations. The results of these discussions will contribute to content determination for the 2026 Census.

   More information on how Statistics Canada balances the protection of confidentiality with the needs for disaggregated census data is available in the Age, Sex at Birth and Gender Reference Guide, Census of Population, 2021.

2. Effectiveness – Working assumptions: The collection and use of this data during the 2024 Census Test will be effective in meeting Statistics Canada's objectives because it is necessary to ensure that the 2026 Census of Population produces relevant, high priority, statistically meaningful information.

   Many of the content changes proposed for the 2026 Census and that will be tested in 2024, affect smaller population groups such as hybrid workers, children in joint custody and students, Veterans, visible minorities, Canadians in housing need, Indigenous populations etc. To be effective, the content test needs to accurately discern statistical differences between 2021 content (benchmark) and modified content to ensure that proposed content can produce relevant and statistically meaningful information.

3. Proportionality: Data from the Census of Population Program provide a comprehensive socioeconomic portrait of Canada's population over time that supports key requirements for policy areas, including labour market conditions, immigration, Indigenous peoples, education, mobility, skills development, official languages, housing and income. This information is vital to all levels of government, the private sector, academia, and non-profit organizations for decision-making and for developing and monitoring of programs and policies. To ensure the efficient and successful conduct of the 2026 Census of Population, Statistics Canada is conducting the 2024 Census Test, which will comprise a sample of approximately 198,000 households across Canada. The test serves multiple purposes, from testing improved or new questions to testing improvements to collection tools and procedures. The sample size and the complex test design were determined in such a way as to ensure that all the test objectives are met, while minimizing as much as possible the respondent burden and the cost. Smaller qualitative tests were previously conducted to help minimize the sample size of the 2024 Census Test. The test is the perfect opportunity to gather data that supports the analysis of the impacts of proposed content changes on data quality, response burden, etc. The data provides a solid foundation upon which Statistics Canada’s final recommendations for census content changes are based, and upon which Cabinet can base their decision on the final content for the next census cycle.
4. Alternatives: The Census of Population is one of the only sources of information for small geographic areas based on the same statistical concepts for the entire country, and the only source of information for many socioeconomic characteristics. The most efficient method for effectively testing possible changes to the Census questionnaire is the mandatory sample survey to be conducted in May 2024.

   Prior to conducting the 2026 Census, extensive testing will be done to assess changes to content, communication materials, field procedures, and collection methodologies. The 2024 Test is designed to accurately measure respondent behaviours to changes in content, field and collection methodologies. Mandatory census tests provide the most accurate impact measurement when studying small sub-groups of the population.

   Voluntary tests in 2024 would increase the chance of inaccurate or inconclusive findings for many of the proposed changes to questionnaire content. If responding to the test was voluntary, non-response bias could occur, specifically for smaller population groups. Similar concerns were raised in the context of the 2011 National Household Survey (NHS). The 2011 NHS demonstrated that in a voluntary context, some respondents tend to skip questions or abandon more often, amplifying non-response for certain questions, especially those closer to the end of the questionnaire. These questions could be more impacted, leading to wrong conclusions being drawn, and, as a result, recommendations for new or changed content for the 2026 Census being based on incomplete test results. In addition, without reducing the risk of non-response bias, a voluntary test would require a larger sample size to account for total non-response. Based on a preliminary design, a significant number of additional dwellings would need to be part of the test, and with anticipated higher proportion of non-response, there would be an increase in the number of reminders and contact attempts for selected households.

   Further, although Statistics Canada continues to explore the use of new administrative sources to replace data collection from respondents, the research has shown the sources of administrative data currently available are not adequate to replace collection of the new content under consideration for the 2026 Census of Population.

Mitigation factors:

The 2024 Census Test will adhere to all Statistics Canada policies on collection, processing, and dissemination of information.

The overall risk of harm to the survey respondents has been deemed manageable with existing Statistics Canada safeguards that are described in Statistics Canada’s Generic Privacy Impact Assessment, including the following that relate to this specific activity.

Storage

Respondents' personal information is transmitted directly to Statistics Canada via secure, web-enabled electronic questionnaires, or, in the case of paper questionnaire formats, through the mail directly to a Statistics Canada secured processing site, where the information is captured, and an electronic record created.

Records are stored in a response database containing household responses, including personal information to perform record linkages to the 2021 Census of Population response files and to tax files.

All electronic records are stored within the secure Statistics Canada information technology environment. Paper questionnaires are securely stored within the Statistics Canada access-controlled processing environment.

Records are retained for a period of five years after the completion of the Census Test and then are destroyed.

As well, Statistics Canada complies with the Policy on Government Security and the Policy on Service and Digital.

Processing and analysis

The Agency's longstanding linkage experience has shown that particular combinations of personal information elements can be used to identify individuals in different data sources with a very high level of confidence, and thus link individuals across various files.

The following personal information will be collected and used to perform record linkages:

• First and last names (collected)
• Date of birth (collected)
• Sex/Gender (collected)
• Full civic address (from frame and collected)
• Phone number (from frame and collected)
• Mobility one and five years (collected)
• Country of citizenship (collected)
• Place of birth (collected)
• Immigrant status (collected for respondents getting Control questionnaire or Test questionnaire version 2; added through linkages for respondents getting Test questionnaire version 1)
• Year of immigration (collected for respondents getting Control questionnaire or Test questionnaire version 2; added through linkages for respondents getting Test questionnaire version 1)
• Frame identifier (from frame)
• Relationship to Person 1 (collected)
• Marital Status (collected)
• Common-law Status (collected)

The linkage of Census of Population Program data and 2024 Census Test data will be used in statistical analyses to evaluate the impact of new or modified questions of the questionnaire by comparing the 2024 Census Test to other existing sources or to the data collected in the 2021 Census. The linkage file will be used only within Statistics Canada, for methodological research, development, and processing. No statistical estimates will be published from the linked data.

Personal identifiers such as name, phone number and address (excluding postal code) will be removed from linked files and replaced with an anonymized statistical identifier.

Access

Access to any confidential data held by Statistics Canada is closely monitored and restricted to designated individuals as per the program's operational requirements. Employees are required to provide the justification for access and obtain the necessary approval. Furthermore, all access permissions are only applicable for a set duration of time and must be regularly renewed including justification for re-approval.

The response database for the 2024 test has not yet been created. The number of employees with access to the 2024 Census Test response database will vary depending on the timing of 2026 Census preparation activities and the need for staff to have access for their job function. Access to the identifying information (names, address, and phone numbers) within this database will be controlled and limited to a small set of staff requiring such access. Most staff who will analyze the data will not have access to any identifying information within the database.

Dissemination

Data collected during the 2024 Census Test will be used for Statistics Canada's analytical purposes only and will not be publicly disseminated. Statistics Canada will not disclose personal information from the 2024 Census Test without the consent of the respondent.

Openness

It is the policy of Statistics Canada to provide all respondents with information about: the purpose of a survey (including the expected uses and users of the statistics to be produced from the survey), the authority under which the survey is taken, the mandatory or voluntary nature of the survey, confidentiality protection, the record linkage plans and the identity of the parties to any agreements for sharing of the information provided by those respondents, where applicable.

For the 2024 Census Test, this information is provided in the letter of invitation to complete the Census Test questionnaire, in the electronic questionnaire itself and in Frequently Asked Questions (FAQs) accessible through the Census website and used by Census Help Line operators to respond to callers’ questions.

This supplemental PIA will be publicly available on the Statistics Canada website as an addendum to the Generic PIA. In addition, Statistics Canada has prepared FAQs and speaking points to assist its internal staff to deal with inquiries from the public regarding the Test.

Other factors:

This section identifies other privacy considerations related to the 2024 Census Test.

Use of administrative data for collective dwellings

Statistics Canada attempts to collect the same information from residents in collective dwellings that is collected from other Canadians and has used various collection approaches in the past. The 2024 Census Test will repeat the methodology used for the 2021 Census whereby the administrators of collective dwellings are required to answer a series of questions about the facility or establishment and complete the Census Test questionnaire for residents. For the 2024 Census Test, administrators will primarily use the electronic questionnaire, whereas data for collective dwellings without administrators will be collected by field enumerators. If the administrator is unable to complete the Census Test questionnaire online, a Census Test employee will follow up by phone or in-person. Residents will also be able to self respond if they wish using the electronic questionnaire.

Test of “informed replacement” letter

As part of the 2024 Census Test, with the goal of reducing response burden, a sample of approximately 8,700 respondents will be provided with an “informed replacement” letter with an offer by Statistics Canada to complete their questionnaire using data already provided to the government. Respondents can still choose to complete their questionnaire themselves if they prefer. The letter states that “Statistics Canada will automatically use information your household has already provided to other government sources about the number of residents, their age, and sex at birth or gender”, and includes a link to the Census website where respondents are provided with an exhaustive list of the administrative data that would be used should the dwelling choose this option. Qualitative testing for the content of this letter demonstrated that the sources of administrative data should be listed on the Census website rather than in the text of the letter itself. The best way to communicate the administrative data sources will continue to be tested. The results will be used to help evaluate the social acceptability and effectiveness of this approach for future censuses (post 2026 cycle).

Cellular phone text message and landline voice broadcast reminders

In 2021, as a final reminder before starting field follow-up activities with non-respondents, the census used text messaging, voice broadcast, and email to remind Canadians living in mailout areas (where mail delivery to a civic style address is possible) to complete their Census. Non-responding dwellings with cellular phone numbers received a single text message reminder. Non-responding dwellings associated only with a landline phone number received a voice broadcast reminder. The census also tested the use of email addresses collected during the 2016 Census (updated by the Labour Force Survey and/or the 2019 Census Test when possible) to send a reminder to non-responding dwellings for which no phone number was listed on the census file.^Footnote4

Results from the 2021 Census demonstrated that there was a clear increase in online responses for non-responding dwellings that received the text message or the voice broadcast reminder. On the other hand, email reminders were not effective to increase self response in the 2021 Census. Based on these results, the census explored opportunities to expand the use of text and voice broadcast messages. To determine email reminders’ full potential, additional testing is required but is being postponed indeterminately due to current operational limitations (maximum number of email reminders that can be sent per day is insufficient). 

Consultations with 2021 Census respondents and non-respondents revealed that some mailout households receive their census invitation letter late because they do not check their community mailboxes regularly. An early text reminder could incite more Canadians to check their mailboxes, complete their census questionnaire earlier, and avoid receiving additional reminders. During January 2023 qualitative testing, participants were asked about their initial reaction to such a text message.  Most of the reactions were quite neutral, while some suggested that it would prompt them to check their mailboxes and felt that it added significance to the letter. Therefore, the 2024 Census Test will attempt to measure the impact of a text message on self-response. On May 16 and 17, 2024, all non-responding dwellings in-scope for the test (approximately 57,000 dwellings) will receive a text message. This timing has been chosen to encourage households to retrieve their census invitation letter from their mailbox close to Census Test reference day (May 14) while accounting for operational capacity. Dwellings selected for the test that have not responded around the end of May could also receive a text reminder on June 3, 2024 (approximately 36,000 dwellings). Additionally, the test will be used to measure the impact of a second text message on self-response. Note that some non-responding dwellings will only receive the June 3rd text reminder because of the design of the test and that approximately 20,000 dwellings associated with a landline phone number will receive a voice broadcast message.

Another area where the Census is considering expanding the use of text message and voice broadcast is outside the mailout areas. Non-responding dwellings located outside mailout areas have their invitation letters delivered by census staff. The only contact with these dwellings prior to the field follow-up activities is a postcard sent to all dwellings to thank respondents and ask non-respondents to complete their census questionnaire as soon as possible. The postcard has not demonstrated to have a significant impact on self-response. The 2024 Census Test will attempt to measure the impact on self-response of sending a text or a voice broadcast reminder to non-responding dwellings. On May 26, 2024, non-responding dwellings outside the mailout areas in scope for the test (approximately 2,000 dwellings) will receive a text or a voice broadcast reminder. The type of reminder received by a dwelling will depend on the type of telephone number present on the census file.

Statistics Canada’s website will provide answers to questions related to the collection of phone numbers and the use of text message and voice broadcast campaigns. Note that on the third mail reminder (only in mailout areas), non-respondents will be informed that they can subsequently be contacted by Statistics Canada by phone, text message, email, or in person.

Statistics Act employee recruitment

Prospective candidates for Census Field Operations are required to complete an application through the secure, web-based Census Online Recruitment Application. The personal information associated with the application is stored in the Collection Management Portal (Statistics Canada's secure corporate tool for field staff), which is addressed in Statistics Canada's Generic PIA. This information includes name, address, contact information, citizenship status, experience, abilities, and references. This information is used by recruiters to screen, test, and interview candidates, as well as to initiate the security clearance process.

In compliance with the Policy on Government Security, all personnel hired for the census must be granted Reliability Status. This process includes verifying personal data, employment history and references. It also involves declaring any criminal convictions for which a pardon has not been granted. A criminal record name check is completed via the Royal Canadian Mounted Police database, and a credit check is conducted by a licensed credit reporting agency. All security checks are performed by personnel security officers on behalf of Statistics Canada. Approximately 600 candidates are expected to undergo security screening for the 2024 Census Test.

Census chatbot:

Statistics Canada will use a new chatbot for the 2026 Census to provide Canadians with timely, accurate, and automatic responses to frequently asked questions and a pathway to a live agent, if needed. The chatbot does not collect personal information and only uses responses that have been written and reviewed by subject-matter experts from Statistics Canada to ensure accuracy. Statistics Canada is developing a separate Privacy Impact Assessment (PIA) for the Census Chatbot which will be tested during the 2024 Census Test. Statistics Canada is committed to using artificial intelligence in a responsible and ethical manner and operates in accordance with governing instruments and frameworks that guide its responsible use including all Government of Canada directives on the responsible use of artificial intelligence.

New tool to retrieve secure access codes:

Respondents are required to provide their secure access code^Footnote5 to complete the Census Test on-line questionnaire. Statistics Canada will test the use of a new on-line tool that enables respondents to retrieve their secure access code using their address. Previously, respondents could only retrieve their code by calling the Census Help Line. The purpose of this initiative is to reduce burden for respondents by offering an alternative to calling the Census Help Line.

Conclusion:

This assessment concludes that, with the existing Statistics Canada safeguards, any remaining risks are such that Statistics Canada is prepared to accept and manage the risk.

Evaluation Report

February 2024

How the report is structured

• The report in short
• Acronyms and abbreviations
• What is covered
• What we learned
  • 1. Performance—achievement of expected outcomes
  • 2. Performance—planning process
  • 3. Performance—communication strategy and activities
• How to improve the program
• Management response and action plan
• Appendix A – Interview quantification scale

The report in short

Statistics Canada has a mandate and legal obligation under the Statistics Act to conduct the Census of Agriculture (CEAG) every five years. The CEAG provides a comprehensive profile of the physical, economic, social and environmental aspects of Canada's agriculture industry. It is the only data source that consistently provides high-quality detailed statistical information on agriculture for small geographic areas and collects a wide range of data at the national, provincial and subprovincial levels.

The CEAG provides both a snapshot in time of the agriculture industry and changes over time that are essential to inform public and private decision making. Its expected outcomes are to provide high-quality data and information that is accessible, available and relevant to all data users.^{Footnote 1} In addition to achieving the CEAG outcomes, the 2021 CEAG was expected to

• decrease response burden on farm operators
• increase integration with Statistics Canada's centralized infrastructure
• increase harmonization between the methods, concepts and processes of the CEAG and other economic statistics programs
• publish more data without compromising the confidentiality of respondents
• align the business model with Statistics Canada's modernization objectives.^{Footnote 2}

The evaluation was conducted in accordance with the Treasury Board Policy on Results and Statistics Canada's Risk-Based Audit and Evaluation Plan (2023/2024 to 2027/2028). The objective of the evaluation is to provide credible and neutral information on the ongoing performance of the CEAG and to identify potential areas to consider for the CEAG's next cycle.

The evaluation methodology consisted of a document review and interviews. Interviews were conducted with Statistics Canada staff, as well as with data users external to Statistics Canada. The findings outlined in this report are based on the triangulation of these data collection methods.

Key findings and recommendations

The CEAG program achieved its expected outcomes of providing high-quality data and information that is accessible, available and relevant to all data users with the timely delivery of the 2021 CEAG.

Compared with 2016, the 2021 CEAG both sustained and improved on various factors that contribute to producing high-quality data and to their relevance to users, their availability and their accessibility. The 2021 CEAG made progress on its objectives to improve operational efficiencies through integration with Statistics Canada infrastructure, increase harmonization with other economic statistics programs and reduce response burden. As with transformational changes, full potential benefits will be realized moving forward as the processes and activities become fully integrated and more familiar to staff.

In general, the main overarching planning processes for the 2021 CEAG were similar to the 2016 cycle, with the addition of several significant methodological and operational changes: the change in the farm definition, the migration to the Integrated Business Statistics Program, the continued development of the electronic questionnaire and adaptations made because of the pandemic. The risk management process contributed to achieving expected results, as well as mitigating the risks that are specific to the changes made in the 2021 cycle. The significant number of changes for the 2021 CEAG made planning more challenging because of some unpredictable implications from the changes, and staff turnover added additional planning constraints. These large-scale changes implemented for the 2021 CEAG have also fundamentally altered many processes, establishing a new baseline moving forward.

Overall, the 2021 CEAG communication strategy and activities were effective in maintaining, and in some cases improving, awareness of CEAG products. New and improved tools increased awareness and facilitated users' understanding of how to interpret CEAG data. Some areas noted for consideration for subsequent cycles of the CEAG are continuing to amplify the CEAG through various communication and engagement channels; empowering users to access, use and interpret the data; and providing clearer information and guidance on changes.

In light of these findings, the following recommendations are proposed:

Recommendation 1

The Assistant Chief Statistician (ACS), Economic Statistics (Field 5), should

1. ensure that the process in place to regularly review resources includes revisiting the balance between upcoming and planned deliverables (including those for communication and engagement) and the corresponding challenges versus available time and resources
2. in addition to the regular review process, given that the 2026 CEAG is not expected to include any new large-scale changes, verify that the planned levels and allocation of resources are correctly aligned with the new baseline resulting from the changes made for the 2021 CEAG; this will help ensure that future core activities are resourced appropriately.

Recommendation 2

The ACS, Economic Statistics (Field 5), should ensure that effective training, retention and succession plans are developed, reviewed regularly and aligned with future needs of the CEAG program.

Recommendation 3

The ACS, Economic Statistics (Field 5), should ensure that the CEAG has a communication and engagement plan in place that includes

1. varied communication approaches to broaden reach and clearly communicate the CEAG's intentions and plans, including the corresponding benefits, to increase stakeholders' understanding and acceptance
2. adequate approaches to improve data users' awareness of and engagement with CEAG data, to further support CEAG tool usage and data interpretation, including working with users with less statistical capacity.

Acronyms and abbreviations

ACS

Assistant Chief Statistician

ASP

Agriculture Statistics Program

ATDP

Agricultural Taxation Data Program

CAMT

Census of Agriculture Management Team

CASC

Census of Agriculture Steering Committee

CEAG

Census of Agriculture

CePop

Census of Population

DPMO

Departmental Project Management Office

EQ

Electronic questionnaire

FPT

Federal-Provincial-Territorial

IBSP

Integrated Business Statistics Program

NFD

New farm definition

OMG

Operations Management Group

PMT

Project Management Team

SMC

Strategic Management Committee

What is covered

The evaluation was conducted in accordance with the Treasury Board Policy on Results and Statistics Canada's Risk-Based Audit and Evaluation Plan (2023/2024 to 2027/2028). The objective of the evaluation is to provide credible and neutral information on the ongoing performance of the Census of Agriculture (CEAG) and to identify potential areas to consider for the CEAG's next cycle.

The Census of Agriculture

Mandate, outcomes and objectives

Statistics Canada has a mandate and legal obligation under the Statistics Act to conduct the CEAG every five years. The CEAG provides a comprehensive profile of the physical, economic, social and environmental aspects of Canada's agriculture industry. It is the only data source that consistently provides high-quality detailed statistical information on agriculture for small geographic areas and collects a wide range of data at the national, provincial and subprovincial levels. The types of data collected include the number of farms and farm operators, farm area and size, land management practices, business operating arrangements, farm operating revenues and expenses, and farm capital. The CEAG provides both a snapshot in time of the agriculture industry and changes over time that are essential to inform public and private decision making.

The expected outcomes for the CEAG are to provide high-quality data and information that is accessible, available and relevant to all data users.^{Footnote 3} To achieve its outcomes, the CEAG is expected to

• provide statistical information and analysis about Canada's economic and social structure to develop, evaluate and improve public policies and private decision making
• promote sound statistical standards and practices to achieve greater efficiency in data collection
• provide critical information to manage federal and provincial governments' expenditures in support of the agriculture sector
• benchmark agriculture information to realign annual and subannual survey estimates and economic data to ensure accuracy and coherence
• provide agriculture information for small geographic areas based on complete enumeration to inform program and policy monitoring
• provide an accurate frame of all farms and farm types to inform the agriculture survey program
• provide measurement of rare or emerging commodities to inform disease control or trade issues.

In addition to achieving the CEAG outcomes, the 2021 CEAG was expected to

• decrease response burden on farm operators
• increase integration with Statistics Canada's centralized infrastructure
• increase harmonization between the methods, concepts and processes of the CEAG and other economic statistics programs
• publish more data without compromising the confidentiality of respondents
• align the business model with Statistics Canada's modernization objectives.^{Footnote 4}

Census cycle

The CEAG is conducted in May to align with the Census of Population (CePop) and take advantage of cost savings achieved by leveraging the CePop's resources and infrastructure. Every CEAG census cycle has a six-year timespan, during which Statistics Canada conducts several activities. Figure 1 below highlights the six broad components that make up the CEAG's six-year cycle. While the activities are presented in a linear progression, many activities across projects happen simultaneously.

Description - Figure 1: The six components and associated key activities of the Census of Agriculture cycle

Figure 1 depicts the six broad components that make up the CEAG's six-year cycle.

1. Content determination: 
   • Consult with user groups across the country to inform Census of Agriculture (CEAG) questions (e.g., identify data gaps and needs of data users).
   • Test content changes, including the proposed questions, electronic questionnaire, edit and imputation processes, and validation tools.
   • Seek Cabinet approval and publish CEAG content in The Gazette.
2. Communications:
   • Develop and launch a campaign to raise awareness of the CEAG, promote self-response through online collection and increase self-response rates.
   • Promote messaging through various communication channels, including outreach, public and media relations, social media, respondent relations, and census website management.
3. Collection:
   • Develop the census frame using Statistics Canada's Business Register and tax remittances.
   • Collect data online or (on demand) on paper (questionnaire forms) from May 3 to August 29, 2021.
   • Distribute email, letter and voice reminders.
   • Follow up with non-respondents to complete the questionnaire.
4. Processing:
   • Conduct initial processing: geo edit to assign province or territory, census agricultural region, division and subdivision; code open-ended responses; remove duplicate questionnaires; and link farm operators with people in the Census of Population database.
   • Import data into the Integrated Business Statistics Program and integrate them with other data sources, address data errors through edit and imputation, and generate estimates through summation.
5. Data quality evaluation:
   • Validate data by finding and correcting significant errors at the provincial and subprovincial levels, then at the farm level, and finally conduct a macro-level review to assess final estimates.
   • Develop and present certification reports summarizing the data validation process and recommendations for publication.
6. Dissemination:
   • Develop and release informational products, including farm and farm operator data, provincial and territorial profile articles, analytical articles, agriculture-population linkage data, the Guide to the Census of Agriculture and reference and thematic maps, a mapping tool, and community profiles.
   • Generate and distribute custom data products requested by data users.

Governance structure

The CEAG is overseen by the Strategic Management Committee (SMC), a senior governance body chaired by the Chief Statistician and composed of assistant chief statisticians (ACSs).

The Census of Agriculture Steering Committee (CASC) reports to the SMC and directs the Census of Agriculture Management Team (CAMT). The CASC is chaired by the Director General, Agriculture, Energy and Environment Statistics Branch (the business sponsor), and consists of the CEAG manager and directors from various Statistics Canada divisions and stakeholders from Agriculture and Agri-Food Canada. Beyond providing direction to the CAMT, the CASC is responsible for monitoring project progress; approving recommendations for changes to scope, schedule and cost; and providing advice and assisting with the resolution of issues between stakeholder groups.

The CAMT is responsible for the ongoing decision making and management of the CEAG, including risk management and mitigation planning. The CAMT is composed of the Census Manager and subproject managers (e.g., content determination, collection, processing, validation, certification and dissemination). The CAMT meets weekly and as necessary, and subproject teams meet biweekly and report progress and issues to the CAMT.

External consulting bodies engaged in the CEAG include the Advisory Committee on Agriculture Statistics and the Federal-Provincial-Territorial (FPT) Committee on Agriculture Statistics. These bodies provide feedback on emerging issues and informational needs within the agricultural sector.

Internal management committees also help direct the CEAG. The Economic Statistics Field Planning Board reviews new project proposals, is responsible for making final decisions for reviews of all projects in the field, and monitors project execution and the allocation of information technology resources. Finally, initiatives related to the Integrated Business Statistics Program (IBSP) fall under the IBSP Project Management Team (PMT).

The evaluation

The scope of the evaluation covered ongoing program performance, including changes made between the 2016 and 2021 census cycles, as well as performance from the lens of planning and communications. The scope was established in collaboration with the office of primary interest. The evaluation was conducted from July to October 2023.

The three evaluation questions that were identified are the following:

1. To what extent has the 2021 CEAG achieved its expected outcomes?^{Footnote 5}
2. To what extent did the 2021 CEAG's planning process effectively support the achievement of expected outcomes?
3. To what extent have the 2021 CEAG's communication strategy and activities effectively supported the achievement of expected outcomes?

The data collection methods outlined in Figure 2 were used.The findings outlined in this report are based on the triangulation of these data collection methods.

Description - Figure 2. Data collection methods

Figure 2 depicts the three data collection methods used for the evaluation: external interviews, internal interviews, and document review.

The external interviews included semi-structured interviews data users from provincial government organizations, academia and agriculture organizations. There were 20 interviews conducted with 26 people.

The internal interviews included semi-structured interviews with Census of Agriculture representatives, as well as partners within Statistics Canada. There were 8 interviews conducted with 8 people.

The document review included a review of Statistics Canada's files, documents, and web trends information.

Two main limitations were identified, and mitigation strategies were employed, as outlined in Table 1.

Table 1. Limitations and mitigation strategies

Limitations	Mitigation strategies
The perspectives gathered through external interviews may not be fully representative.	External interviewees were selected using specific criteria to maximize strategic reach for the interviews. Multiple recruitment strategies were used. Evaluators were able to find consistent overall patterns.
There were a few internal interviewees who were unavailable to participate, and therefore, their perspectives are not represented in the evaluation.	To address this gap, documents—particularly the task evaluation reports—were used to provide additional evidence, and alternate interviews were conducted.

What we learned

1. Performance—achievement of expected outcomes

Summary

The CEAG program achieved its expected outcomes by providing high-quality data and information that is accessible, available and relevant to all data users with the timely delivery of the 2021 CEAG. Compared with 2016, the 2021 CEAG both sustained and improved on various factors that contribute to the expected outcomes. It made progress on its objectives to improve operational efficiencies through integrating with Statistics Canada infrastructure, increasing harmonization with other economic statistics programs and reducing response burden. As with transformational changes, full potential benefits will be realized moving forward as the processes and activities become fully integrated and more familiar to staff.

The 2021 CEAG was expected to provide high-quality statistical information that is relevant to its users, available and accessible. In addition, the 2021 CEAG intended to reduce respondent burden, improve operational efficiencies^{Footnote 6} through integration with Statistics Canada infrastructure and increase harmonization with other economic statistics programs.

Compared with 2016, the 2021 CEAG both sustained and improved on various factors that contribute to producing high-quality data and to their relevance to users, their availability and their accessibility.

Improvements to data quality resulted from the promotion and uptake of the online electronic questionnaire (EQ), achieving 82% uptake and exceeding the target by 12%. The uptake of the EQ contributes to data quality by preventing certain respondent errors. For example, when unlikely or invalid data were entered, the EQ initiated a prompt for the respondent to check their response, and the EQ automatically filled in certain fields based on information from the Business Register. Other factors contributing to data quality include the response rate and coverage errors. While the 2021 response rate was lower than in 2016, and the 2021 farm count undercoverage rate was higher than in 2016, neither of these factors is directly comparable between the two CEAG cycles because of new methodologies used in 2021.^{Footnote 7}

Overall, the 2021 CEAG data coverage and relevance were similar to 2016, with some improvements resulting from the content consultations with census stakeholders (federal departments, provincial ministries, agriculture associations, etc.). The addition and refinement of questions about sustainability practices and technology adoption in the agriculture sector improved the breadth and depth of data coverage, as well as relevance to data users.

The timeliness of releases for some of the 2021 CEAG products was improved, compared with the 2016 CEAG cycle. New products, including reference maps, a mapping tool and the CEAG Guide, were released one to three months ahead of the farm and farm operator data. The timing of the release for the first key CEAG data output, the farm and farm operator data, was similar to that of the 2016 cycle—one year following Census Day, which is the day that the census is rolled out. The following CEAG outputs were also released earlier, compared with the 2016 cycle:

• the agriculture-population dataset that links CEAG and CePop data was released three months earlier
• the reference maps, which provide the geographical boundaries, codes and names for all geographic areas appearing in the data tables, were released approximately three months earlier
• custom data orders requested by end users were reported to be released faster in 2021.

While there were a few end users who reported that timelier CEAG data could better meet their needs, or questioned why the transition to an EQ did not result in faster data releases, the general consensus was that there is always a preference for high-quality data over earlier data, and the timelines for CEAG data were appropriate.

The availability of data was improved by publishing (for the first time) quality indicators in the farm and farm operator data to help data users determine to what extent they may want to use certain data points to inform decisions, policies or programs. Data availability was further improved through the introduction of a new disclosure methodology^{Footnote 8} that decreased data suppression—a noted improvement for a few key external interviewees. Improvements to data access included making microdata available in research data centres for researchers with research proposals to access directly. Additional accessibility improvements are discussed in the "Performance—communication strategy and activities" section.

The maintenance of and improvement to elements of data quality were facilitated by the promotion of an EQ, the content consultation process and the experience level of data users.

As already stated, data quality improvements were facilitated by the promotion and uptake of the EQ. Data coverage and relevance improved too, because of the content consultations that informed questions about sustainability practices and technology adoption. In addition, consultations following the 2016 CEAG cycle with key stakeholders (e.g., federal and provincial or territorial governments, Agriculture and Agri-Food Canada) facilitated improvements in data access and use through the addition of new data visualization and mapping tools. Custom datasets were reported as accessible and timely for long-time data users, given that the requested data were often similar from cycle to cycle and the process was well understood. For less experienced CEAG users (and some smaller producer organizations), the process (e.g., where to direct a request, how to frame the data request) and costs associated with requesting custom data were viewed as barriers.

Operational and methodological changes tempered some of the improvements to data quality and coverage, while other improvements to data quality and availability were facilitated by operational changes.

The methodological change to calculating the CEAG coverage errors generated higher rates of undercoverage; however, the 2021 estimates are considered to be more accurate as a result of the improved methodology. Although planned additional improvements to include detailed revenue data from the Agriculture Taxation Data Program (ATDP) for publication did not go forward because of concerns related to accuracy, the ATDP data replacement improved overall data coverage and quality because it avoided missing values from refusal or false information. Furthermore, the migration to the IBSP enabled the publication of data quality indicators and, as a result, improved data availability.

The 2021 CEAG made progress on its other objectives to improve operational efficiencies through integration with Statistics Canada infrastructure, to increase harmonization with other economic statistics programs and to reduce response burden. Full potential benefits will be realized moving forward as the processes and activities become fully integrated and more familiar to staff.

Operational efficiency gains were realized through the migration of the 2021 CEAG to the IBSP. The migration to the IBSP supports operational efficiencies through data integration from other programs; earlier data validation because of rolling estimates; and the use of an existing corporate tool, expertise and experience, as opposed to a stand-alone processing system. From the perspective of internal interviewees, the new processes, approaches and sustained effort required to address the challenges^{Footnote 9} related to the IBSP migration limited the gains for the 2021 CEAG cycle, but the lessons learned from the migration are expected to yield more efficiencies for subsequent CEAG cycles.

The introduction of a new farm definition (NFD) for the 2021 CEAG increased harmonization with other economic statistics programs.^{Footnote 10} This NFD facilitated the flow of data from other economic programs, such as the ATDP, into the CEAG and supports the comparison and interpretation of data across all agriculture statistics programs that share the same definition. Furthermore, the NFD supports harmonization with tax data and the Statistics Canada Business Register, used to develop the census frame.

The 2021 CEAG decreased response burden through the use of administrative data replacement, filter questions, an optimized online EQ and the use of tax data to inform the sample frame. Data replacement decreased response burden by using existing data to replace questions about revenues and expenses, sex, age, and operating arrangement. Filter questions reduced response burden, since only questions that were relevant to each respondent's operations were asked. Finally, the new census frame decreased response burden for out-of-scope operations (e.g., hobby farms) that no longer receive the CEAG and for CePop respondents who no longer had to answer a question about agriculture revenue. While data replacement theoretically reduced the time to complete the 2021 CEAG by 10% (or 3.3 minutes), the actual time to complete the CEAG decreased by 30 seconds because of additional qualifying questions designed to ensure that respondents were in scope.

The greater integration with Statistics Canada infrastructure and the harmonization with economic statistics programs were both facilitated and hindered to varying degrees by similar factors: the experience level of team members, project management and the COVID-19 pandemic.

Internal interviewees and the documentation review detailed facilitators and hindrances to the tasks involved with, or resulting from, IBSP integration and harmonization with economic statistics programs, such as the following:

• Some activities involved with the migration to the IBSP (e.g., taxes and modelled births added into the population and imputed into the IBSP) were facilitated by strong collaboration and consultation, while other activities could have benefited from more consultation and collaboration with other Agriculture Statistics Program (ASP) teams (e.g., validation of revenues and expenses integrated from the ATDP).
• The presence of some experienced CEAG team members and ASP staff facilitated the necessary process adaptations or workarounds required to accommodate the migration to the IBSP; however, the data validation activities caused several challenges for the validation team, which did not have prior experience with the new iterative process and the interdependencies between detailed, subtotal and total values in the IBSP.
• The larger staff recruitment pool (pan-Canadian) resulting from the remote work policies related to COVID-19 facilitated some production-related activities; however, remote training challenges early on in the pandemic hindered training.
• Some activities benefited from well-defined project schedules, roles and responsibilities (e.g., the NFD to harmonize with economic statistics programs and integrate ATDP data within the IBSP), while for others, there was a feeling that more planning and management would have been beneficial (e.g., last-minute organizational plan for validation of revenue and expense data).

The commitment of staff to the CEAG helped teams address the various challenges associated with the 2021 CEAG changes, but tight timelines did not permit sufficient opportunity to research, develop, test, analyze and revise some activities as thoroughly as staff would have liked (e.g., backcasting, data validation, NFD and sampling frame), leading to unexpected challenges that required additional work, including overtime.

The 2021 CEAG methodological and operational changes impacted the CEAG work environment, and changes to decrease response burden affected data processing.

The number and complexity of operational and methodological changes implemented in 2021 contributed to a heightened level of stress for many team members.

The transition to the new environment required several workarounds that were largely understood and developed by staff who had extensive experience with the CEAG program—many of whom have moved on, or (as of the fall of 2023) are expected to move on, from the program. This gap in institutional knowledge creates challenges for the 2026 Census cycle, which will have fewer team members with experience in the full six-year census cycle.

In addition, the EQ filter questions decrease response burden by asking a series of yes or no questions to determine what questionnaire sections apply to each respondent. However, the number of unexpected answers to these questions was higher than anticipated, resulting in more corrections and higher imputation rates. For example, it was found that a high number of respondents indicated that they had no machinery. This then required the data validation team to identify records that likely did have machinery and manually fix the answer before sending the records to imputation.

The replacement of some CEAG respondent data with those from other administrative sources (part of AgZero^{Footnote 11}) is advancing one of the five pillars of the agency's modernization agenda. Some external interviewees relayed their concern that transitioning to administrative or survey data may limit data at smaller geographic levels, where administrative data may not be available.

2. Performance—planning process

Summary

In general, the main overarching planning processes for the 2021 CEAG were similar to the 2016 cycle, with the addition of several significant methodological and operational changes: the change in the farm definition, the migration to the IBSP, the continued development of the EQ and adaptations made because of the pandemic. The risk management process contributed to achieving expected results, as well as mitigating the risks that are specific to the changes made in the 2021 cycle. The significant number of changes for the 2021 CEAG made planning more challenging, and staff turnover added additional constraints.

The main steps of CEAG planning were the same as in the previous cycle. The addition of several significant methodological and operational changes affected planning: the change in the farm definition, the migration to the IBSP, the continued development of the EQ and adaptations made because of the pandemic.

The overall governance for the CEAG planning process for the 2021 cycle was similar to the 2016 cycle. However, the Operations Management Group (OMG) was introduced in March 2021 to manage the CEAG production. The OMG core members^{Footnote 12} met daily from April 29, 2021, to March 4, 2022, to identify and address CEAG production-related issues. As well, the inclusion of the IBSP PMT provided oversight for all programs migrating to the IBSP framework. Furthermore, the following revisions to the organizational structure occurred in the 2021 cycle:

• the CEAG dissemination unit expanded to do more divisional work
• CEAG processing responsibilities shifted to the Enterprise Statistics Division, which is responsible for the IBSP
• client services (i.e., custom data) transitioned to Statistics Canada's regional data service centres.

The main overarching planning processes for the 2021 CEAG were similar to the 2016 cycle. The content determination project included its usual national consultation process to inform the instrument design with data users in 2017; questions were tested, and the CEAG team continued to explore steps that could be partially or entirely replaced by administrative data. The communication project established a plan to increase awareness and promote participation in the CEAG, while leveraging the communication efforts of the CePop. The collection, data quality and dissemination projects all developed strategies and plans to ensure that their activities were successfully executed. Planning oversight by the CEAG management teams, including the CAMT and unit heads, continued through regular meetings over the course of the CEAG cycle.

In addition, the 2021 planning process had to accommodate several large-scale changes, some of which were related to the agency's modernization and innovation agenda. Specifically, the 2021 CEAG had to plan for the following changes:

• implementing the NFD
• increasing data integration
• executing a new data processing environment
• pursuing further development of the EQ to reduce response burden
• realizing a new disclosure avoidance method.

Planning started prior to the Treasury Board submission for the 2021 CEAG cycle, specifically for activities involving the NFD and migration to the IBSP, and new methodologies were developed for CEAG data validation to accommodate the IBSP circular processing model. However, a few internal interviewees reported that, as a result of the extent and complexity of the changes, they could have benefited from more time to plan and implement them.

The 2021 CEAG risk management process contributed to the achievement of expected results by identifying and planning for risks that are standard to most CEAG cycles, as well as risks specific to the changes planned for the 2021 cycle.

Throughout the CEAG cycle, a risk register was managed by the CAMT, and risks were reported on at the monthly CASC meeting. Risks unique to the 2021 CEAG were primarily related to harmonization with other economic statistics programs, namely the new census frame; the NFD; and migration into the IBSP. These risks, along with their predicted impact and associated mitigation plans, are further described below.

• New census frame: Risks identified with the new definition included potential impacts on data quality. The exclusion of in-scope farms from the census frame was a potential data-quality risk resulting from the NFD and dependency on the Business Register to inform the frame. To mitigate this risk, the new frame was tested against the 2016 Census frame and the Agriculture Frame Update Survey to ensure alignment, and modelled births were included in the CEAG to account for new farms since the 2020 tax data.
• NFD: The effect of the NFD on the comparability of 2021 CEAG data with 2016 CEAG data was a data relevance risk from end users' perspective. To mitigate this risk, a backcasting exercise was undertaken to better understand how to interpret the 2021 CEAG data, compared with 2016.
• Migration to IBSP: One of the key risks reported by a few internal interviewees regarding the IBSP migration was related to the IBSP's ability to process the volume of data involved in the census, possibly disrupting the timelines. To mitigate this risk, the CEAG was tested repeatedly in the IBSP environment prior to production, and CEAG teams consulted with other teams that had undergone the transition to the IBSP, as well as the IBSP managing team.

Other risks classified as being low or moderate and, for the most part, deemed manageable included low response rates, challenges in securing enough skilled human resources at the right time and natural disasters.

In addition to the planned risks, the 2021 CEAG also needed to account for unanticipated risks, namely those pertaining to the COVID-19 pandemic. While the program has a business continuity plan, it did not account for the scale and ramifications of the pandemic. The planning for a variety of 2021 CEAG activities had to pivot because of COVID-19. For example,

• the communication and engagement plan transitioned from including in-person engagement (e.g., attendance at agricultural shows) to being completely online
• the data replacement plan was revised to ensure that industry data impacted by the pandemic were excluded from the replacement strategy
• the training plan was revised to be online and accommodate a pan-Canadian workforce working from home (as opposed to onsite in the National Capital Region).

Facilitators in CEAG planning included the matrix management approach and regular planning meetings. The significant changes for the 2021 CEAG made planning more challenging, given the complexity and magnitude of the changes. Staff turnover was an additional challenge.

The CEAG planning process used a matrix management approach to help ensure the interdependencies across divisions and activities outside the Census Manager's reporting structure were kept on track. A few internal interviewees reported that the regular planning meetings between the unit heads for collection, processing and dissemination, as well as cross-unit planning meetings between the CEAG and CePop, also facilitated the planning process. As already stated, the planning around the IBSP migration was facilitated by consultations with other teams that had undergone the transition. Because of the unique and complex nature of the CEAG, there were unexpected challenges (e.g., dealing with the infrastructure of the processing environment, CEAG descriptive mnemonics versus IBSP naming conventions) that the CEAG team had to address that were not experienced by other teams.

The substantial changes introduced in the 2021 CEAG cycle (e.g., IBSP migration and NFD) were reported to be the most significant planning challenge. A few internal interviewees reported that they felt that the complexity of the changes was not adequately planned for, despite factoring in the potential challenges in the planning process. Other challenges included staff turnover, especially at the critical levels (e.g., key management personnel and subject-matter experts), that left gaps in knowledge and hindered planning.

For the amount and level of change implemented for the 2021 CEAG, resources were viewed as being very tight for the core CEAG team.

Significant effort went into planning for the 2021 cycle. In addition, efforts to identify lessons learned from the various tasks for the 2021 CEAG cycle provided detailed feedback to inform planning for future cycles. Some internal interviewees reported that there was insufficient time to fully plan for the unprecedented scale of changes. It was suggested by some interviewees that incorporating the significant changes more gradually would have alleviated some pressure; however, it was noted during a subsequent discussion that gradual implementation across more than one cycle was not possible for the 2021 CEAG because of the interrelated nature of the changes.

The 2021 CEAG also experienced human resource challenges throughout the development, production and dissemination phases, especially given the activities planned. Key departures during the development and production cycle increased the level of stress for the team and the risk for program delivery. For example, during interviews, it was noted that when a CEAG team member left unexpectedly, their tasks were held up because there was no one available to immediately fill in for the missing resource.

The recruitment of junior and senior validators was delayed because of challenges in securing a sufficient number of qualified validators for the 2021 CEAG.^{Footnote 13} As a result, the recruitment efforts had to use initiatives that were not pre-planned or pre-approved (e.g., exemption from language policy for senior validators). According to the lessons learned document, the planning and resourcing of the dissemination activity cycle occurred too late, making it challenging to take full advantage of the resources.

3. Performance—communication strategy and activities

Summary

Overall, the 2021 CEAG communication strategy and activities were effective in maintaining, and in some cases improving, awareness of CEAG products. New and improved tools increased awareness and facilitated users' understanding of how to interpret CEAG data. Some areas noted for consideration for subsequent cycles of the CEAG are continuing to amplify the CEAG through various communication and engagement channels; empowering users to access, use and interpret the data; and providing clearer information and guidance on changes.

The 2021 CEAG communication and dissemination strategy supported the achievement of high-quality data that are accessible, available and relevant.

CEAG communications prior to Census Day and throughout the collection period contributed to data quality and efficiency by promoting participation through messaging about the benefits of completing the questionnaire and methods used to reduce response burden (e.g., data replacement). Diversifying the communication channels during collection and dissemination, including social media campaigns, the census website and the FPT Committee on Agriculture Statistics, helped to reach the various stakeholder groups. External interviewees who were members of the committee reported being satisfied with the regular CEAG communication updates at their quarterly meetings.

Communication and dissemination efforts also contributed to the accessibility and availability of data through the release of tools and guidance materials before the official data release in May 2022, a new online portal housing all CEAG-related content and publications, new interactive data visualization and mapping tools, and webinars highlighting CEAG products. The dissemination activities also supported data relevance through the publication of analytical reports focusing on cross-cutting themes and emerging sectors.

The COVID-19 pandemic led to the transition of all promotional activities to online engagement, but most external key interviewees did not perceive this transition to have limited promotion and awareness-raising activities, as more people transitioned online. However, a few external interviewees noted that additional methods to increase awareness of the CEAG and its products may be beneficial (e.g., farm shows, radio spots, promotional materials and direct emails).

The 2021 CEAG also used a combination of articles, infographics, and new interactive data visualization and mapping tools to support end users' engagement with the data. Microdata were also made available to researchers at the research data centres. Data users reported that making data available using a variety of methods, especially the infographics and visualization tools, improved data access and use.

The communication strategy and dissemination activities were effective in maintaining, and in some cases improving, awareness of CEAG products.

The majority of external interviewees reported that their awareness of CEAG products was similar to the previous census cycle, because they are often returning to the same products after every census cycle. However, some data users reported being made aware of the new data visualization and mapping tools, and the timeline of releases. Although web analytics data for the 2021 CEAG could not be compared with those from 2016 because of software changes within Statistics Canada, the uptake of the mapping and data visualization tools was relatively stable from month to month, indicating steady and ongoing use.

End users often reported The Daily as the main source of CEAG-related updates, releases and news, and the new CEAG portal as the primary access point to CEAG data. However, users also noted that they would use Google to search for relevant data, as opposed to going through the official Statistics Canada website. A recommendation to improve awareness of CEAG products was to email stakeholder groups a week or two prior to a product's release.

Overall, most data users reported being satisfied with the accessibility of CEAG data. The majority of data users accessed CEAG data directly through the new CEAG portal, which, for the most part, was considered user friendly. While the portal was revised based on early stakeholder consultation, a few data users described challenges finding the relevant data on the portal. In addition to the online portal, some external interviewees accessed CEAG data through custom data requests via email.

End users' understanding of how to use CEAG tools was largely maintained or improved as a result of the new user guide and webinars. Their understanding of how to interpret CEAG data was supported by data visualization tools, infographics and articles.

Most external interviewees reported that their understanding of how to use the CEAG tools remained the same, largely as a result of being long-time users of CEAG data. The publication of the user guide improved understanding of some of the changes to the 2021 CEAG and some of the new analytical tools that were introduced. Although the methodological changes were presented to various partners throughout the planning cycle (e.g., FPT Committee on Agriculture Statistics), a few external interviewees reported that the CEAG could do more to engage with data users early on to help them understand the methodological changes and how they will affect their analysis and interpretation of CEAG data.

Webinars also supported data users' understanding of how to use the CEAG tools. However, there are still opportunities to improve data users' understanding of how to use the tools (e.g., tables), particularly for those who are inexperienced with CEAG data. There was also a request for webinars teaching experienced data users how to use CEAG tools for more advanced analytical purposes.

Most data users reported that their understanding of how to interpret CEAG data remained similar to that for the 2016 CEAG. The continued publication of infographics and the new data visualization tools, along with the analytical articles, were all perceived to enhance understanding and use of CEAG data. A few external interviewees reported a desire for more analytical reports, including sector-specific reports that were available in past CEAG cycles.

Communication strategies and activities to consider for the next CEAG cycle include continuing to amplify and target CEAG promotion and data through social media and other means, for both engagement and dissemination activities, and empowering new and advanced end users to access, use and interpret CEAG data.

CEAG social media engagement was viewed positively by end users and internal interviewees. End users supported the continued use of social media to engage stakeholders and suggested that platform-specific campaigns be considered, depending on the target audience (e.g., X, formerly known as Twitter, was reported to be used more by producers).

Interviewees mentioned that the provision of webinars or other educational tools was useful and noted that tailoring them to levels of expertise (e.g., novice, advanced) would further support CEAG tool usage and interpretation. Additionally, some users commented that there is an opportunity to increase end users' awareness and understanding of what informational needs custom data requests can help fulfill, and the process involved in making a request.

Transitioning to publications that transcend all sectors may be undertaken in conjunction with more end-user education on how to find, use and interpret publicly available or customized data products.

The dissemination plan outlines the transition to a more sector-wide, horizontal approach to publications that are relevant to a wider audience. However, eliminating or limiting commodity-specific reports may need to be partnered with more support to end users to increase their knowledge and skills on how to find, use and interpret data, especially for smaller commodity sectors.

How to improve the program

Proper planning includes identifying, assessing and addressing risks and challenges, and helps to ensure that adequate time and resources are available for a program to deliver on its priorities and commitments to achieve its outcomes. About half of the interviewees noted that there were gaps in planning and resources for the 2021 CEAG, which led to significant pressures on staff. Given the challenges around staffing and the loss of experience and expertise resulting from departures, human resource planning will be critical for subsequent cycles. In addition, the large-scale changes implemented for the 2021 CEAG have fundamentally altered many processes, establishing a new baseline moving forward. The 2026 CEAG will provide an opportunity to verify that the planned resource levels and allocations match this new baseline.

Past initiatives to raise awareness of products and tools have been effective and well received; the CEAG should continue these efforts. Amplifying and targeting communication and engagement efforts will help increase understanding of CEAG products and tools, the intentions and goals of new methodologies and collection vehicles, and the corresponding benefits, thereby supporting further acceptance.

Recommendation 1

The ACS, Economic Statistics (Field 5), should

• ensure that the process in place to regularly review resources includes revisiting the balance between upcoming and planned deliverables (including those for communication and engagement) and the corresponding challenges versus available time and resources
• in addition to the regular review process, given that the 2026 CEAG is not expected to include any new large-scale changes, verify that the planned levels and allocation of resources are correctly aligned with the new baseline resulting from the changes made for the 2021 CEAG; this will help ensure that future core activities are resourced appropriately.

Recommendation 2

The ACS, Economic Statistics (Field 5), should ensure that effective training, retention and succession plans are developed, reviewed regularly and aligned with future needs of the CEAG program.

Recommendation 3

The ACS, Economic Statistics (Field 5), should ensure that the CEAG has a communication and engagement plan in place that includes

• varied communication approaches to broaden reach and clearly communicate the CEAG's intentions and plans, including the corresponding benefits, to increase stakeholders' understanding and acceptance
• adequate approaches to improve data users' awareness of and engagement with CEAG data, to further support CEAG tool usage and data interpretation, including working with users with less statistical capacity.

Management response and action plan

Recommendation 1

The ACS, Economic Statistics (Field 5), should

1. ensure that the process in place to regularly review resources includes revisiting the balance between upcoming and planned deliverables (including those for communication and engagement) and the corresponding challenges versus available time and resources
2. in addition to the regular review process, given that the 2026 CEAG is not expected to include any new large-scale changes, verify that the planned levels and allocation of resources are correctly aligned with the new baseline resulting from the changes made for the 2021 CEAG; this will help ensure that future core activities are resourced appropriately.

Management response

Management agrees with the recommendation.

As a large project, the CEAG currently follows the agency's Departmental Project Management Office (DPMO) planning and reporting procedures and will continue to do so. In addition, the team will conduct a review of its 2026 Census project planning processes, in consultation with the DPMO, to find improvements.

Given the substantial changes that took place during the 2021 Census, the team will ensure that its planning and reporting procedures reflect the new reality to confirm that the expected workload associated with deliverables assigned to a given team does not exceed its resource availability.

In addition to finalizing a 2026 project plan, the CEAG team will add integrated scheduling to its existing planning and also carefully review resources and deliverables using the DPMO dashboard as a key coordination vehicle. The integrated schedule will ensure that the deliverables for both subject-matter and service areas are aligned with the new 2026 baseline and that all activities are resourced appropriately.

The project plan will be regularly monitored using the DPMO monthly dashboard and monthly CASC approvals.

Deliverables and timelines

A project plan approved by the CASC will be available by October 2024, and an integrated schedule, also approved by the CASC, will be available by January 2026.

Recommendation 2

The ACS, Economic Statistics (Field 5), should ensure that effective training, retention and succession plans are developed, reviewed regularly and aligned with future needs of the CEAG program.

Management response

Management agrees with the recommendation.

The CEAG team will review its existing training and documentation activities and, in collaboration with the agency's Workforce and Workplace Branch, create a human resources plan, including training, retention and succession planning activities.

The plan will be reviewed regularly and include the establishment of partnerships with the agency's Workforce and Workplace Branch to ensure that staffing activities occur as required and seek exemptions from policies or directives that may impede human resources activities, e.g., determinate versus indeterminate status. Where possible, the CEAG team will leverage activities within the CePop program.

The plan will also focus on

• attracting and retaining high-performing employees
• developing more robust succession planning to stabilize transitions in times of staff turnover
• implementing practices to improve the integration of new employees, e.g., improving documentation.

Deliverables and timelines

A human resources plan approved by the CASC will be delivered by September 2025.

Recommendation 3

The ACS, Economic Statistics (Field 5), should ensure that the CEAG has a communication and engagement plan in place that includes

1. varied communication approaches to broaden reach and clearly communicate the CEAG's intentions and plans, including the corresponding benefits, to increase stakeholders' understanding and acceptance
2. adequate approaches to improve data users' awareness of and engagement with CEAG data, to further support CEAG tool usage and data interpretation, including working with users with less statistical capacity.

Management response

Management agrees with the recommendation.

1. The CEAG developed a communication and engagement plan for the 2021 cycle, which was approved by the CASC. Within budget constraints, the CEAG will work with partners in Census Communications to review and revamp this plan to create a new 2026 plan, in alignment with the AgZero initiative and its associated benefits. The new plan will explore varied communication approaches to broaden reach and outline the CEAG's benefits to increase stakeholders' and farmers' understanding and acceptance.
2. The 2021 CEAG developed a comprehensive dissemination plan with a vision to continue to meet user needs: more cross-cutting, horizontal stories and more outreach with Canadians via various media. The plan outlined key areas to enhance the CEAG data user experience: data products, data visualization products and mapping tools, analytical products, user guides, and webinars. Similarly, within the approved budget, a new enhanced 2026 dissemination plan will be created in collaboration with communication and dissemination service areas and be approved by the CASC.

A key focus of the plan will be to articulate approaches to improve data users' awareness of and engagement around CEAG data to further support CEAG tool usage and data interpretation, including working with users with less statistical capacity. These approaches could include giving targeted webinars, sending emails and using social media to announce releases, and consulting with users to better meet their needs.

Deliverables and timelines

A 2026 CEAG communications and engagement plan and a 2026 CEAG dissemination plan, developed in collaboration with relevant service areas and both approved by the CASC, will be delivered by September 2025 and December 2026, respectively.

Appendix A – Interview quantification scale

Interview responses are quantified and categorized in this report using the scale shown in the table below.

Appendix A – Examples of data needs on intersectionality

Term	Definition
One	One is used when one participant provided the answer.
Few	Few is used when 4% to 15% of participants responded with similar answers. The sentiment of the response was articulated by these participants but not by other participants.
Some	Some is used when 16% to 45% of participants responded with similar answers.
About half	About half is used when 46% to 55% of participants responded with similar answers.
Most or a majority	Most, or a majority, is used when 56% to 89% of participants responded with similar answers.
Almost all	Almost all is used when 90% to 99% of participants responded with similar answers.
All	All is used when 100% of participants responded with similar answers.

Statistics Canada has a mandate and legal obligation under the Statistics Act to conduct the Census of Agriculture (CEAG) every five years. The CEAG provides a comprehensive profile of the physical, economic, social and environmental aspects of Canada's agriculture industry. It is the only data source that consistently provides high-quality detailed statistical information on agriculture for small geographic areas and collects a wide range of data at the national, provincial and subprovincial levels.

The CEAG provides both a snapshot in time of the agriculture industry and changes over time that are essential to inform public and private decision making. Its expected outcomes are to provide high-quality data and information that is accessible, available and relevant to all data users^{Footnote 1}. In addition to achieving the CEAG outcomes, the 2021 CEAG was expected to

• decrease response burden on farm operators
• increase integration with Statistics Canada's centralized infrastructure
• increase harmonization between the methods, concepts and processes of the CEAG and other economic statistics programs
• publish more data without compromising the confidentiality of respondents
• align the business model with Statistics Canada's modernization objectives^{Footnote 2}.

The evaluation was conducted in accordance with the Treasury Board Policy on Results and Statistics Canada's Risk-Based Audit and Evaluation Plan (2023/2024 to 2027/2028). The objective of the evaluation is to provide credible and neutral information on the ongoing performance of the CEAG and to identify potential areas to consider for the CEAG's next cycle.

Key findings and recommendations

The CEAG program achieved its expected outcomes of providing high-quality data and information that is accessible, available and relevant to all data users with the timely delivery of the 2021 CEAG.

Compared with 2016, the 2021 CEAG both sustained and improved on various factors that contribute to producing high-quality data and to their relevance to users, their availability and their accessibility. The 2021 CEAG made progress on its objectives to improve operational efficiencies through integration with Statistics Canada infrastructure, increase harmonization with other economic statistics programs and reduce response burden. As with transformational changes, full potential benefits will be realized moving forward as the processes and activities become fully integrated and more familiar to staff.

In general, the main overarching planning processes for the 2021 CEAG were similar to the 2016 cycle, with the addition of several significant methodological and operational changes: the change in the farm definition, the migration to the Integrated Business Statistics Program, the continued development of the electronic questionnaire and adaptations made because of the pandemic. The risk management process contributed to achieving expected results, as well as mitigating the risks that are specific to the changes made in the 2021 cycle. The significant number of changes for the 2021 CEAG made planning more challenging because of some unpredictable implications from the changes, and staff turnover added additional planning constraints. These large-scale changes implemented for the 2021 CEAG have also fundamentally altered many processes, establishing a new baseline moving forward.

Overall, the 2021 CEAG communication strategy and activities were effective in maintaining, and in some cases improving, awareness of CEAG products. New and improved tools increased awareness and facilitated users' understanding of how to interpret CEAG data. Some areas noted for consideration for subsequent cycles of the CEAG are continuing to amplify the CEAG through various communication and engagement channels; empowering users to access, use and interpret the data; and providing clearer information and guidance on changes.

In light of these findings, the following recommendations are proposed:

Recommendation 1

The Assistant Chief Statistician (ACS), Economic Statistics (Field 5), should

1. ensure that the process in place to regularly review resources includes revisiting the balance between upcoming and planned deliverables (including those for communication and engagement) and the corresponding challenges versus available time and resources
2. in addition to the regular review process, given that the 2026 CEAG is not expected to include any new large-scale changes, verify that the planned levels and allocation of resources are correctly aligned with the new baseline resulting from the changes made for the 2021 CEAG; this will help ensure that future core activities are resourced appropriately.

Recommendation 2

The ACS, Economic Statistics (Field 5), should ensure that effective training, retention and succession plans are developed, reviewed regularly and aligned with future needs of the CEAG program.

Recommendation 3

The ACS, Economic Statistics (Field 5), should ensure that the CEAG has a communication and engagement plan in place that includes

1. varied communication approaches to broaden reach and clearly communicate the CEAG's intentions and plans, including the corresponding benefits, to increase stakeholders' understanding and acceptance
2. adequate approaches to improve data users' awareness of and engagement with CEAG data, to further support CEAG tool usage and data interpretation, including working with users with less statistical capacity.

Integrated Business Statistics Program (IBSP)

Reporting Guide

This guide is designed to assist you as you complete the 2023 Annual Survey of Research and Development in Canadian Industry – Industrial Non-Profit Organizations. If you need more information, please call the Statistics Canada Help Line at the number below.

Help Line: 1-877-949-9492

Your answers are confidential.

Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act.

Statistics Canada will use information from this survey for statistical purposes.

NOTE:

1. If this organization performs in-house research and development (R&D) and outsources R&D, complete all questions.
2. If this organization performs in-house (R&D) and does not outsource R&D, complete questions 1-6, 9-22.
3. If this organization outsources (R&D) and does not perform in-house R&D, complete questions 1-4, 6-8, 13, 17-22.
4. If this organization does not perform in-house (R&D) and does not outsource R&D, complete questions 1-4, 6, 13, 17, 18 & 20-22.

For this survey

'In-house R&D' refers to

Expenditures within Canada for R&D performed within this organization by:

• employees (permanent, temporary or casual)
• self-employed individuals or contractors who are working on-site on this organization's R&D projects.

'Outsourced R&D' refers to

Payments made within or outside Canada to other organizations, businesses or individuals to fund R&D performance:

• grants
• fellowships
• contracts.

Reporting period information

Here are some examples of common fiscal periods that fall within the targeted dates:

• May 1, 2022 to April 30, 2023
• July 1, 2022 to June 30, 2023
• October 1, 2022 to September 30, 2023
• January 1, 2023 to December 31, 2023
• February 1, 2023 to January 31, 2024
• April 1, 2023 to March 31, 2024

Here are other examples of fiscal periods that fall within the required dates:

• September 18, 2022 to September 15, 2023 (e.g., floating year-end)
• June 1, 2023 to December 31, 2023 (e.g., a newly opened organization)

Definitions and Concepts

Research and experimental development (R&D) comprise creative and systematic work undertaken in order to increase the stock of knowledge – including knowledge of humankind, culture and society – and to devise new applications of available knowledge.

R&D is performed in the natural sciences, engineering, social sciences and humanities. There are three types of R&D activities: basic research, applied research and experimental development.

Activities included and excluded from R&D

Inclusions

Prototypes

Include design, construction and operation of prototypes, provided that the primary objective is to make further improvements or to undertake technical testing. Exclude if the prototype is for commercial purposes.

Clinical Trials

Include clinical trial phases 1, 2, and 3. Include clinical trial phase 4 only if it brings about a further scientific or technological advance.

Pilot plants

Include construction and operation of pilot plants, provided that the primary objective is to make further improvements or to undertake technical testing. Exclude if the pilot plant is intended to be operated for commercial purposes.

New computer software or significant improvements/modifications to existing computer software

Includes technological or scientific advances in theoretical computer sciences; operating systems e.g., improvement in interface management, developing new operating system or converting an existing operating system to a significantly different hardware environment; programming languages; and applications if a significant technological change occurs.

Contracts

Include all contracts which require R&D. For contracts which include other work, report only the R&D costs.

Research work in the social sciences

Include if projects are employing new or significantly different modelling techniques or developing new formulae, analyzing data not previously available or applying new research techniques, development of community strategies for disease prevention, or health education.

Exclude:

• routine analytical projects using standard techniques and existing data
• routine market research
• routine statistical analysis intended for on-going monitoring of an activity.

Exclusions

Routine analysis in the social sciences including policy-related studies, management studies and efficiency studies

Exclude analytical projects of a routine nature, with established methodologies, principles and models of the related social sciences to bear on a particular problem (e.g., commentary on the probable economic effects of a change in the tax structure, using existing economic data; use of standard techniques in applied psychology to select and classify industrial and military personnel, students, etc., and to test children with reading or other disabilities).

Consumer surveys, advertising, market research

Exclude projects of a routine nature, with established methodologies intended for commercialization of the results of R&D.

Routine quality control and testing

Exclude projects of a routine nature, with established methodologies not intended to create new knowledge, even if carried out by personnel normally engaged in R&D.

Pre-production activities such as demonstration of commercial viability, tooling up, trial production, and trouble shooting

Although R&D may be required as a result of these steps, these activities are excluded.

Prospecting, exploratory drilling, development of mines, oil or gas wells

Include only if for R&D projects concerned with new equipment or techniques in these activities, such as in-situ and tertiary recovery research.

Engineering

Exclude engineering unless it is in direct support of R&D.

Design and drawing

Exclude design and drawing unless it is in direct support of R&D.

Patent and license work

Exclude all administrative and legal work connected with patents and licenses.

Cosmetic modifications or style changes to existing products

Exclude if no significant technical improvement or modification to the existing products has occurred.

General purpose or routine data collection

Exclude projects of a routine nature, with established methodologies intended for on-going monitoring of an activity.

Routine computer programming, systems maintenance or software application

Exclude projects of a routine nature, with established methodologies intended to support on-going operations.

Routine mathematical or statistical analysis or operations analysis

Exclude projects of a routine nature, with established methodologies intended for on-going monitoring of an activity.

Activities associated with standards compliance

Exclude projects of a routine nature, with established methodologies intended to support standards compliance.

Specialized routine medical care such as routine pathology services

Exclude projects of a routine nature, with established methodologies intended for on-going monitoring of an activity where results do not further scientific, technological advance, or understanding of the effectiveness of a technology.

In-house R&D expenditures within Canada (Q5 – Q8)

In-house R&D expenditures are composed of current in-house R&D expenditures and capital in-house R&D expenditures.

Current in-house R&D expenditures

Include:

• wages, salaries, benefits and fringe benefits, materials and supplies
• services to support R&D, including on-site R&D consultants and contactors
• necessary background literature
• minor scientific equipment
• associated administrative overhead costs.

a. Wages, salaries of permanent, temporary and casual R&D employees

Include benefits and fringe benefits of employees engaged in R&D activities. Benefits and fringe benefits include bonus payments, holiday or vacation pay, pension fund contributions, other social security payments, payroll taxes, etc.

b. Services to support R&D

Include:

• payments to on-site R&D consultants and contractors working under the direct control of your organization
• other services including indirect services purchased to support in-house R&D such as security, storage, repair, maintenance and use of buildings and equipment
• computer services, software licensing fees and dissemination of R&D findings.

c. R&D materials

Include:

• water, fuel, gas and electricity
• materials for creation of prototypes
• reference materials (books, journals, etc.)
• subscriptions to libraries and data bases, memberships to scientific societies, etc.
• cost of outsourced (contracted out or granted) small R&D prototypes or R&D models
• materials for laboratories (chemicals, animals, etc.)
• all other R&D-related materials.

d. All other current R&D costs including overhead

Include administrative and overhead costs (e.g., office, lease/rent, post and telecommunications, internet, legal expenditures, insurance), prorated if necessary to allow for non-R&D activities within the organization.

Exclude:

• interest charges
• value-added taxes (goods and services tax (GST) or harmonized sales tax (HST)).

Capital in-house R&D expenditures

Capital in-house R&D expenditures are the annual gross amount paid for the acquisition of fixed assets that are used repeatedly, or continuously in the performance of R&D for more than one year. Report capital in-house R&D expenditures in full for the period when they occurred.

Include costs for software, land, buildings and structures, equipment, machinery and other capital costs.

Exclude capital depreciation.

e. Software

Include applications and systems software (original, customized and off-the-shelf software), supporting documentation and other software-related acquisitions.

f. Land acquired for R&D including testing grounds, sites for laboratories and pilot plants.

g. Buildings and structures that are constructed or purchased for R&D activities or that have undergone major improvements, modifications, renovations and repairs for R&D activities.

h. Equipment, machinery and all other capital

Include major equipment, machinery and instruments, including embedded software, acquired for R&D activities.

Outsourced (contracted out or granted) R&D expenditures (Q9 – Q12)

Include payments made through contracts, grants donations and fellowships to another company, organization or individual to purchase or fund R&D activities.

Exclude expenditures for on-site R&D contractors.

1. Companies include all incorporated for-profit businesses and government business enterprises providing products in the market at market rates.
2. Private non-profit organizations include voluntary health organizations, private philanthropic foundations, associations and societies and research institutes. They are not-for-profit organizations that serve the public interest by supporting activities related to public welfare (such as health, education, the environment).
3. Industrial research institutes or associations include all non-profit organizations that serve the business sector, with industrial associations frequently consisting of their membership.
4. Universities include hospitals and clinics when they are affiliated with a university and provide education services or when R&D activity is under the direct control of a university.
5. Federal government includes all federal government departments and agencies. It excludes federal government business enterprises providing products in the market.
6. Provincial or territorial governments include all provincial or territorial government ministries, departments and agencies. It excludes provincial or territorial government business enterprises providing products in the market.
7. Provincial or territorial research organizations are organizations created under provincial or territorial law which conduct or facilitate research on behalf of the province or territory.
8. Other organizations – individuals, non-university educational institutions, foreign governments including ministries, departments and agencies of foreign governments.

Sources of funds for in-house R&D expenditures in 2023 (Q17)

Include Canadian and foreign sources.

Exclude:

• payments for outsourced (contracted out or granted) R&D, which should be reported in question 10
• capital depreciation.

1. Funds from this organization

   Amount contributed by this organization to R&D performed within Canada (include interest payments and other income, land, buildings, machinery and equipment (capital expenditures) purchased for R&D).

2. Funds from member companies or affiliates

   Amount received from member organizations and affiliated organizations used to perform R&D within Canada (include annual fees and sustaining grants, land, buildings, machinery and equipment (capital expenditures) purchased for R&D).

3. Federal government grants or funding

   Funds received from the federal government in support of R&D activities not connected to a specific contractual deliverable.

4. Federal government contracts

   Funds received from the federal government in support of R&D activities connected to a specific contractual deliverable.

5. R&D contract work for companies

   Funds received from companies to perform R&D on their behalf.

6. Provincial or territorial government grants or funding

   Funds received from the provincial or territorial government in support of R&D activities not connected to a specific contractual deliverable.

7. Provincial or territorial government contracts

   Funds received from the provincial or territorial government in support of R&D activities connected to a specific contractual deliverable.

8. R&D contract work for private non-profit organizations

   Funds received from non-profit organizations to perform R&D on their behalf.

9. Other sources

   Funds received from all other sources not previously classified.

Fields of R&D for in-house R&D expenditures within Canada in 2023 (Q19)

Exclude:

• payments for outsourced (contracted out or granted) R&D, which should be reported in question 10
• capital depreciation.

Natural and formal sciences

Mathematics, physical sciences, chemical sciences, earth and related environmental sciences, biological sciences, other natural sciences.

Exclude computer sciences, information sciences and bioinformatics (to be reported at lines s. and t).

1. Mathematics: pure mathematics, applied mathematics, statistics and probability.
2. Physical sciences: atomic, molecular and chemical physics, interaction with radiation, magnetic resonances, condensed matter physics, solid state physics and superconductivity, particles and fields physics, nuclear physics, fluids and plasma physics (including surface physics), optics (including laser optics and quantum optics), acoustics, astronomy (including astrophysics, space science).
3. Chemical sciences: organic chemistry, inorganic and nuclear chemistry, physical chemistry, polymer science and plastics, electrochemistry (dry cells, batteries, fuel cells, metal corrosion, electrolysis), colloid chemistry, analytical chemistry.
4. Earth and related environmental sciences: geosciences, geophysics, mineralogy and palaeontology, geochemistry and geophysics, physical geography, geology and volcanology, environmental sciences, meteorology, atmospheric sciences and climatic research, oceanography, hydrology and water resources.
5. Biological sciences: cell biology, microbiology and virology, biochemistry, molecular biology and biochemical research, mycology, biophysics, genetics and heredity (medical genetics under medical biotechnology), reproductive biology (medical aspects under medical biotechnology), developmental biology, plant sciences and botany, zoology, ornithology, entomology and behavioural sciences biology, marine biology, freshwater biology and limnology, ecology and biodiversity conservation, biology (theoretical, thermal, cryobiology, biological rhythm), evolutionary biology.
6. Other natural sciences: other natural sciences.

Engineering and Technology

Civil engineering, electrical engineering, electronic engineering and communications technology, mechanical engineering, chemical engineering, materials engineering, medical engineering, environmental engineering, environmental biotechnology, industrial biotechnology, nanotechnology, other engineering and technologies.

Exclude software engineering and technology (to be reported at line r).

7. Civil engineering: civil engineering, architecture engineering, municipal and structural engineering, transport engineering.
8. Electrical engineering, electronic engineering and communications technology: electrical and electronic engineering, robotics and automatic control, micro-electronics, semiconductors, automation and control systems, communication engineering and systems, telecommunications, computer hardware and architecture.
9. Mechanical engineering: mechanical engineering, applied mechanics, thermodynamics, aerospace engineering, nuclear-related engineering (nuclear physics under Physical sciences), acoustical engineering, reliability analysis and non-destructive testing, automotive and transportation engineering and manufacturing, tooling, machinery and equipment engineering and manufacturing, heating, ventilation and air conditioning engineering and manufacturing.
10. Chemical engineering: chemical engineering (plants, products), chemical process engineering.
11. Materials engineering: materials engineering and metallurgy, ceramics, coating and films (including packaging and printing), plastics, rubber and composites (including laminates and reinforced plastics), paper and wood and textiles, construction materials (organic and inorganic).
12. Medical engineering: medical and biomedical engineering, medical laboratory technology (excluding biomaterials, which should be reported under Industrial biotechnology).
13. Environmental engineering: environmental and geological engineering, petroleum engineering (fuel, oils), energy and fuels, remote sensing, mining and mineral processing, marine engineering, sea vessels and ocean engineering.
14. Environmental biotechnology: environmental biotechnology, bioremediation, diagnostic biotechnologies in environmental management (DNA chips and bio-sensing devices).
15. Industrial biotechnology: industrial biotechnology, bioprocessing technologies, biocatalysis and fermentation bioproducts (products that are manufactured using biological material as feedstock), biomaterials (bioplastics, biofuels, bioderived bulk and fine chemicals, bio-derived materials).
16. Nanotechnology: nano-materials (production and properties), nano-processes (applications on nano-scale).
17. Other engineering and technologies: food and beverages, oenology, other engineering and technologies.

Software-related sciences and technology

Software engineering and technology, computer sciences, information technology and bioinformatics.

18. Software engineering and technology: computer software engineering, computer software technology, and other related computer software engineering and technologies.
19. Computer sciences: computer science, artificial intelligence, cryptography, and other related computer sciences.
20. Information technology and bioinformatics: information technology, informatics, bioinformatics, biomathematics, and other related information technologies.

Medical and health sciences

Basic medicine, clinical medicine, health sciences, medical biotechnology, other medical sciences.

21. Basic medicine: anatomy and morphology (plant science under Biological science), human genetics, immunology, neurosciences, pharmacology and pharmacy and medicinal chemistry, toxicology, physiology and cytology, pathology.
22. Clinical medicine: andrology, obstetrics and gynaecology, paediatrics, cardiac and cardiovascular systems, haematology, anaesthesiology, orthopaedics, radiology and nuclear medicine, dentistry, oral surgery and medicine, dermatology, venereal diseases and allergy, rheumatology, endocrinology and metabolism and gastroenterology, urology and nephrology, and oncology.
23. Health sciences: health care sciences and nursing, nutrition and dietetics, parasitology, infectious diseases and epidemiology, occupational health.
24. Medical biotechnology: health-related biotechnology, technologies involving the manipulation of cells, tissues, organs or the whole organism, technologies involving identifying the functioning of DNA, proteins and enzymes, pharmacogenomics, gene-based therapeutics, biomaterials (related to medical implants, devices, sensors).
25. Other medical sciences: forensic science, other medical sciences.

Agricultural Sciences

Agriculture, forestry and fisheries sciences, animal and dairy sciences, veterinary sciences, agricultural biotechnology, other agricultural sciences.

26. Agriculture, forestry and fisheries sciences: agriculture, forestry, fisheries and aquaculture, soil science, horticulture, viticulture, agronomy, plant breeding and plant protection.
27. Animal and dairy sciences: animal and dairy science, animal husbandry.
28. Veterinary sciences: veterinary science (all).
29. Agricultural biotechnology: agricultural biotechnology and food biotechnology, genetically modified (GM) organism technology and livestock cloning, diagnostics (DNA chips and biosensing devices), biomass feedstock production technologies and biopharming.
30. Other agricultural sciences: other agricultural sciences.

Social sciences and humanities

Psychology, educational sciences, economics and business, other social sciences, humanities.

31. Psychology: cognitive psychology and psycholinguistics, experimental psychology, psychometrics and quantitative psychology, and other fields of psychology.
32. Educational sciences: education, training and other related educational sciences.
33. Economics and business:micro-economics, macro-economics, econometrics, labour economics, financial economics, business economics, entrepreneurial and business administration, management and operations, management sciences, finance and all other related fields of economics and business.
34. Other social sciences:anthropology (social and cultural) and ethnology, demography, geography (human, economic and social), planning (town, city and country), management, organization and methods (excluding market research unless new methods/techniques are developed), law, linguistics, political sciences, sociology, miscellaneous social sciences and interdisciplinary, and methodological and historical science and technology activities relating to subjects in this group.
35. Humanities: history (history, prehistory and history, together with auxiliary historical disciplines such as archaeology, numismatics, palaeography, genealogy, etc.), languages and literature (ancient and modern), other humanities (philosophy (including the history of science and technology)), arts (history of art, art criticism, painting, sculpture, musicology, dramatic art excluding artistic "research" of any kind), religion, theology, other fields and subjects pertaining to the humanities, and methodological, historical and other science and technology activities relating to the subjects in this group.

In-house R&D personnel in 2023 (Q71 - Q73)

R&D personnel

Include:

• permanent, temporary and casual R&D employees
• independent on-site R&D consultants and contractors working in your organization's offices, laboratories, or other facilities
• employees engaged in R&D-related support activities.

Researchers and research managers are composed of:

1. Scientists, social scientists, engineers and researchers are professionals engaged in the conception or creation of new knowledge. They conduct research and improve or develop concepts, theories, models, techniques instrumentation, software or operational methods. They may be certified by provincial or territorial educational authorities, provincial, territorial or national scientific or engineering associations.
2. Senior research managers plan or manage R&D projects and programs. They may be certified by provincial or territorial educational authorities, provincial, territorial or national scientific or engineering associations.

R&D technical, administrative and support staff are composed of:

3. Technicians and technologists and research assistants are persons whose main tasks require technical knowledge and experience in one or more fields of engineering, the physical and life sciences, or the social sciences, humanities and the arts. They participate in R&D by performing scientific and technical tasks involving the application of concepts, operational methods and the use of research equipment, normally under the supervision of researchers. They may be certified by provincial or territorial educational authorities, provincial, territorial or national scientific or engineering associations.
4. Other R&D technical, administrative support staff include skilled and unskilled craftsmen, and administrative, secretarial and clerical staff participating in R&D projects or directly associated with such projects.

On-site R&D consultants and contractors are individuals hired 1) to perform project-based work or to provide goods at a fixed or ascertained price or within a certain time or 2) to provide advice or services in a specialized field for a fee and, in both cases, work at the location specified and controlled by the contracting company or organization.

Full-time equivalent (FTE)

R&D may be carried out by persons who work solely on R&D projects or by persons who devote only part of their time to R&D, and the balance to other activities such as testing, quality control and production engineering. To arrive at the total effort devoted to R&D in terms of personnel, it is necessary to estimate the full-time equivalent of these persons working only part-time in R&D.

FTE (full-time equivalent): Number of persons who work solely on R&D projects + the time of persons working only part of their time on R&D.

Example calculation: If out of four scientists engaged in R&D work, one works solely on R&D projects and the remaining three devote only one quarter of their working time to R&D, then: FTE = 1 + 1/4 + 1/4 + 1/4 = 1.75 scientists.

Technology and technical assistant payments in 2023 (Q74 - Q76)

Definitions (equivalent to the Canadian Intellectual Property Office: Canadian Intellectual Property Office)

1. Patent

   Government grant giving the right to exclude others from making, using or selling an invention.

2. Copyright

   Legal protection for literary, artistic, dramatic or musical works, computer programs, performer's performances, sound recordings, and communication signals.

3. Trademark

   A word, symbol or design, or combination of these, used to distinguish goods or services of one person or organization from those of others in the marketplace.

4. Industrial design

   Legal protection against imitation of the shape, pattern, or ornamentation of an object.

5. Integrated circuit topography

   Three-dimensional configurations of the elements and interconnections embodied in an integrated circuit product.

6. Original software

   Computer programs and descriptive materials for both systems and applications. Original software can be created in-house or outsourced and includes packaged software with customization.

7. Packaged or off-the-shelf software

   Packaged software purchased for organizational use and excludes software with customization.

8. Databases

   Data files organized to permit effective access and use of the data including access clinical trial registries and administrative health data for research purposes. Includes partnerships supporting the development of databases, such as patient or clinical trial registries or biobanks, to be used for research purposes (e.g., developing a national bladder cancer patient registry with Bladder Cancer Canada for future research).

9. Other technology and technical assistance

   Technical assistance, industrial processes and know-how including technology transfer and know how such as batch pilot production, method develop, and validation related to technology or manufacturing transfer.

Energy-related R&D by area of technology (Q23 - Q70)

Fossil Fuels

Crude oils and natural gas exploration, crude oils and natural gas production, oil sands and heavy crude oils surface and sub-surface production and separation of the bitumen, tailings management, refining, processing and upgrading, coal production, separation and processing, transportation of fossil fuels.

1. Crude oils and natural gas exploration

   Include development of advanced exploration methods (geophysical, geochemical, seismic, magnetic) for on-shore and off-shore prospecting.

2. Crude oil and natural gas production and storage, include enhanced recovery natural gas production

   Include on-shore and off-shore deep drilling equipment and techniques for conventional oil and gas, secondary and tertiary recovery of oil and gas, hydro fracturing techniques, processing and cleaning of raw product, storage on remote platforms (e.g., Arctic, off-shore), safety aspects of offshore platforms.

3. Oil sands and heavy crude oils surface and sub-surface production and separation of the bitumen, tailings management

   Include surface and in-situ production (e.g., SAGD), tailings management.

4. Refining, processing and upgrading of fossil fuels

   Include processing of natural gas to pipeline specifications, and refining of conventional crude oils to refined petroleum products (RPPs), and the upgrading of bitumen and heavy oils either to synthetic crude oil or to RPPs. Upgrading may be done at an oil sands plant, regional merchant upgraders or integrated into a refinery producing RPPs.

5. Coal production, separation and processing

   Include coal, lignite and peat exploration, deposit evaluation techniques, mining techniques, separation techniques, coking and blending, other processing such as coal to liquids, underground (in-situ) gasification.

6. Transportation of fossil fuels

   Include transport of gaseous, liquid and solid hydrocarbons via pipelines (land and submarine) and their network evaluation, safety aspects of LNG transport and storage.

Renewable energy resources

Solar photovoltaics (PV), solar thermal-power and high-temperature applications, solar heating and cooling, wind energy, bio-energy – biomass production and transport, bio-energy – biomass conversion to transportation fuel, bio-energy – biomass conversion to heat and electricity, other bio-energy, small hydro (less than 10 MW), large hydro (greater than or equal to 10 MW), other renewable energy.

1. Solar photovoltaics (PV)

   Include solar cell development, PV-module development, PV-inverter development, building-integrated PV-modules, PV-system development, other.

2. Solar thermal-power and high-temperature applications

   Include solar chemistry, concentrating collector development, solar thermal power plants, high-temperature applications for heat and power.

3. Solar heating and cooling

   Include daylighting, passive and active solar heating and cooling, collector development, hot water preparation, combined-space heating, solar architecture, solar drying, solar-assisted ventilation, swimming pool heating, low-temperature process heating, other.

4. Wind energy

   Include technology development, such as blades, turbines, converters structures, system integration, other.

5. Bio-energy – Biomass production and transport

   Include improvement of energy crops, research on bio-energy production potential and associated land-use effects, supply and transport of bio-solids, bio-liquids, biogas and bio-derived energy products (e.g., ethanol, biodiesel), compacting and baling, other.

6. Bio-energy – Biomass conversion to transportation fuel

   Include conventional bio-fuels, cellulosic-derived alcohols, biomass gas-to-liquids, other energy-related products and by-products.

7. Bio-energy – Biomass conversion to heat and electricity

   Include bio-based heat, electricity and combined heat and power (CHP), exclude multi-firing with fossil fuels.

8. Other bio-energy

   Include recycling and the use of municipal, industrial and agricultural waste as energy not covered elsewhere.

9. Small hydro (less than 10 MW)

   Include plants with capacity below 10 MW.

10. Large hydro (greater than or equal to 10 MW)

    Include plants with capacity of 10 MW and above.

11. Other renewable energy

    Include hot dry rock, hydro-thermal, geothermal heat applications (including agriculture), tidal power, wave energy, ocean current power, ocean thermal power, other.

Nuclear fission and fusion

Materials exploration, mining and preparation, tailings management, nuclear reactors, other fission, fusion.

1. Nuclear materials exploration, mining and preparation, tailings management

   Include development of advanced exploration methods (geophysical, geochemical) for prospecting, ore surface and in-situ production, uranium and thorium extraction and conversion, enrichment, handling of tailings and remediation.

2. Nuclear reactors

   Include nuclear reactors of all types and related system components.

3. Other fission

   Include nuclear safety, environmental protection (emission reduction or avoidance), radiation protection and decommissioning of power plants and related nuclear fuel cycle installations, nuclear waste treatment, disposal and storage, fissile material recycling, fissile materials control, transport of radioactive materials.

4. Fusion

   Include all types (e.g., magnetic confinement, laser applications).

Electric Power

Generation in utility sector, combined heat and power in industry and in buildings, electricity transmission, distribution and storage of electricity.

1. Electric power generation in utility sector

   Include conventional and non-conventional technology (e.g., pulverised coal, fluidised bed, gasification-combined cycle, supercritical), re-powering, retrofitting, life extensions and upgrading of power plants, generators and components, super-conductivity, magneto hydrodynamic, dry cooling towers, co-firing (e.g., with biomass), air and thermal pollution reduction or avoidance, flue gas cleanup (excluding CO2 removal), CHP (combined heat and power) not covered elsewhere.

2. Electric power - combined heat and power in industry, buildings

   Include industrial applications, small scale applications for buildings.

3. Electricity transmission, distribution and storage

   Include solid state power electronics, load management and control systems, network problems, super-conducting cables, AC and DC high voltage cables, HVDC transmission, other transmission and distribution related to integrating distributed and intermittent generating sources into networks, all storage (e.g., batteries, hydro reservoirs, fly wheels), other.

Hydrogen and fuel cells

Hydrogen production for process applications, hydrogen production for transportation applications, hydrogen transport and storage, other hydrogen, fuel cells, both stationary and mobile.

1. Hydrogen production for process applications
2. Hydrogen production for transportation applications
3. Hydrogen transport and storage
4. Other hydrogen

   Include end uses (e.g., combustion), other infrastructure and systems R&D (refuelling stations).

5. Stationary fuel cells

   Include electricity generation, other stationary end-use.

6. Mobile fuel cells

   Include portable applications.

Energy efficiency

Industry, residential and commercial, transportation, other energy efficiency.

1. Energy efficiency applications for industry

   Include reduction of energy consumption through improved use of energy and/or reduction or avoidance of air and other emissions related to the use of energy in industrial systems and processes (excluding bio-energy-related) through the development of new techniques, new processes and new equipment, other.

2. Energy efficiency for residential, institutional and commercial sectors

   Include space heating and cooling, ventilation and lighting control systems other than solar technologies, low energy housing design and performance other than solar technologies, new insulation and building materials, thermal performance of buildings, domestic appliances, other.

3. Energy efficiency for transportation

   Includes analysis and optimisation of energy consumption in the transport sector, efficiency improvements in light-duty vehicles, heavy-duty vehicles, non-road vehicles, public transport systems, engine-fuel optimisation, use of alternative fuels (liquid and gaseous, other than hydrogen), fuel additives, diesel engines, Stirling motors, electric cars, hybrid cars, air emission reduction, other.

4. Other energy efficiency

   Include waste heat utilisation (heat maps, process integration, total energy systems, low temperature thermodynamic cycles), district heating, heat pump development, reduction of energy consumption in the agricultural sector.

Other energy-related technologies

Carbon capture, transportation and storage for fossil fuel production and processing, electric power generation, industry in end-use sector, energy systems analysis, all other energy-related technologies.

1. Carbon capture, transport and storage related to fossil fuel production and processing
2. Carbon capture, transport and storage related to electric power production
3. Carbon capture, transport and storage related to industry in end-use sector

   Include industry in the end-use sector, such as steel production, manufacturing, etc. (exclude fossil fuel production and processing and electric power production).

4. Energy system analysis

   Include system analysis related to energy R&D not covered elsewhere, sociological, economical and environmental impact of energy which are not specifically related to one technology area listed in the sections above.

5. All other energy technologies

   Include energy technology information dissemination, studies not related to a specific technology area listed above.

Environmental and clean technology R&D expenditures in 2023

Air pollution management

Activities aimed at reducing the emissions of pollutants (including greenhouse gases) to the atmosphere. Include pollution abatement and control (i.e., end-of-pipe processes) and pollution prevention (i.e., integrated processes), as well as related measurement, control, laboratories and the like.

Solid waste management

Activities related to the collection, treatment, storage, disposal, and recycling of all domestic, industrial, non-hazardous and hazardous waste (including low-level radioactive waste). Include monitoring activities. Exclude radioactive waste and mine tailings handling and treatment (to be reported under Protection against radiation and Wastewater management, respectively).

Wastewater management

Activities aimed at pollution reduction or prevention through the abatement of pollutants or the reduction of the release of wastewater. Include measures aimed at reducing pollutants before discharge, reducing the release of wastewater, septic tanks, treatment of cooling water, handling and treatment of mine tailings, etc.

Protection and remediation of soil, groundwater and surface water

Activities aimed at the prevention of pollution infiltration: remediation or cleaning up of soils and water bodies; protection of soil from erosion, salinization and physical degradation; monitoring, control, laboratories and the like. Exclude management of wastewater released to surface waters, municipal sewer systems or soil, or injected underground (to be reported under Wastewater management) and protection of biodiversity and habitat (to be reported under Protection of biodiversity and habitat).

Protection of biodiversity and habitat

Activities related to protecting wildlife and habitat from the effects of economic activity, and to restoring wildlife or habitat that has been adversely affected by such activity. Include related environmental measurements, monitoring, control, laboratories and the like.

Noise and vibration abatement

Activities aimed at controlling or reducing industrial and transport noise and vibration for the sole purpose of protecting the environment. Include preventive in-process modifications at the source, construction of anti-noise/vibration facilities, measurement, control, laboratories and the like.

Protection against radiation

Activities aimed at preventing, reducing, or eliminating the negative consequences of radiation on the environment. This includes all handling, transportation, and treatment of radioactive waste (i.e. waste that requires shielding during normal handling and transportation due to high radionuclide content), the protection of ambient media, measurement, control, laboratories and the like, as well as any other activities related to the containment of radioactive waste. Exclude activities and measures related to low-level radioactive waste (to be reported under Solid waste management), the prevention of technological hazards (e.g., external safety of nuclear power plants), and measures taken to protect workers.

Heat or energy savings and management

Activities aimed at reducing the intake of energy through in-process modifications (such as adjustment of production processes or heat and electricity co-generation), as well as reducing heat and energy losses. This includes insulation activities, energy recovery, measurement, control, laboratories and the like.

Renewable energy

Energy obtained from resources that naturally replenish or renew within a human lifespan (i.e. the resource is a sustainable source of energy). This includes wind, solar, aero-thermal, geothermal, hydrothermal and ocean energy, hydropower, biomass, landfill gas, sewage treatment plant gas and biogases.

Integrated Business Statistics Program (IBSP)

Reporting Guide

This guide is designed to assist you as you complete the 2023 Annual Survey of Research and Development in Canadian Industry. If you need more information, please call the Statistics Canada Help Line at the number below.

Help Line: 1-877-949-9492

Your answers are confidential.

Statistics Canada is prohibited by law from releasing any information it collects which could identify any person, business, or organization, unless consent has been given by the respondent or as permitted by the Statistics Act.

Statistics Canada will use information from this survey for statistical purposes.

NOTE:

1. If this business performs in-house research and development (R&D) and outsources R&D, complete all questions.
2. If this business performs in-house R&D and does not outsource R&D, complete questions 1-5, 8-21.
3. If this business outsources R&D and does not perform in-house R&D, complete questions 1-3, 5-7, 12 & 16-21.
4. If this business does not perform in-house R&D and does not outsource R&D, complete questions 1-3, 5, 12, 16, 17 & 19-21.

Difference between Scientific Research and Experimental Development (SR&ED) tax incentive program and this survey

Include the following expenditures in this survey:

• capital R&D expenditures
• R&D expenditures in the social sciences and humanities
• payments for R&D performed by other organizations outside Canada.

For this survey

'In-house R&D' refers to

Expenditures within Canada for R&D performed within this business by:

• employees (permanent, temporary or casual)
• self-employed individuals or contractors who are working on-site on this business's R&D projects.

'Outsourced R&D' refers to

Payments made within or outside Canada to other businesses, organizations or individuals to fund R&D performance:

• grants
• fellowships
• contracts.

Reporting period information

Here are some examples of fiscal periods that fall within the targeted dates:

• May 1, 2022 to April 30, 2023
• July 1, 2022 to June 30, 2023
• October 1, 2022 to September 30, 2023
• January 1, 2023 to December 31, 2023
• February 1, 2023 to January 31, 2024
• April 1, 2023 to March 31, 2024

Here are other examples of fiscal periods that fall within the targeted dates:

• September 18, 2022 to September 15, 2023 (e.g., floating year-end)
• June 1, 2023 to December 31, 2023 (e.g., a newly opened business)

Definitions and Concepts

Research and experimental development (R&D) comprise creative and systematic work undertaken in order to increase the stock of knowledge – including knowledge of humankind, culture and society – and to devise new applications of available knowledge.

R&D is performed in the natural sciences, engineering, social sciences and humanities. There are three types of R&D activities: basic research, applied research and experimental development.

Activities included and excluded from R&D

Inclusions

Prototypes

Include design, construction and operation of prototypes, provided that the primary objective is to make further improvements or to undertake technical testing. Exclude if the prototype is for commercial purposes.

Clinical Trials

Include clinical trial phases 1, 2, and 3. Include clinical trial phase 4 only if it brings about a further scientific or technological advance.

Pilot plants

Include construction and operation of pilot plants, provided that the primary objective is to make further improvements or to undertake technical testing. Exclude if the pilot plant is intended to be operated for commercial purposes.

New computer software or significant improvements/modifications to existing computer software

Includes technological or scientific advances in theoretical computer sciences; operating systems e.g., improvement in interface management, developing new operating system or converting an existing operating system to a significantly different hardware environment, programming languages, and applications if a significant technological change occurs.

Contracts

Include all contracts which require R&D. For contracts which include other work, report only the R&D costs.

Research work in the social sciences

Include if projects are employing new or significantly different modelling techniques or developing new formulae, analyzing data not previously available or applying new research techniques, development of community strategies for disease prevention, or health education.

Exclude:

• routine analytical projects using standard techniques and existing data
• routine market research
• routine statistical analysis intended for on-going monitoring of an activity.

Exclusions

Routine analysis in the social sciences including policy-related studies, management studies and efficiency studies

Exclude analytical projects of a routine nature, with established methodologies, principles and models of the related social sciences to bear on a particular problem (e.g., commentary on the probable economic effects of a change in the tax structure, using existing economic data; use of standard techniques in applied psychology to select and classify industrial and military personnel, students, etc., and to test children with reading or other disabilities).

Consumer surveys, advertising, market research

Exclude projects of a routine nature, with established methodologies intended for commercialization of the results of R&D.

Routine quality control and testing

Exclude projects of a routine nature, with established methodologies not intended to create new knowledge, even if carried out by personnel normally engaged in R&D.

Pre-production activities such as demonstration of commercial viability, tooling up, trial production, and trouble shooting

Although R&D may be required as a result of these steps, these activities are excluded.

Prospecting, exploratory drilling, development of mines, oil or gas wells

Include only if for R&D projects concerned with new equipment or techniques in these activities, such as in-situ and tertiary recovery research.

Engineering

Exclude engineering unless it is in direct support of R&D.

Design and drawing

Exclude design and drawing unless it is in direct support of R&D.

Patent and license work

Exclude all administrative and legal work connected with patents and licenses.

Cosmetic modifications or style changes to existing products

Exclude if no significant technical improvement or modification to the existing products has occurred.

General purpose or routine data collection

Exclude projects of a routine nature, with established methodologies intended for on-going monitoring of an activity.

Routine computer programming, systems maintenance or software application

Exclude projects of a routine nature, with established methodologies intended to support on-going operations.

Routine mathematical or statistical analysis or operations analysis

Exclude projects of a routine nature, with established methodologies intended for on-going monitoring of an activity.

Activities associated with standards compliance

Exclude projects of a routine nature, with established methodologies intended to support standards compliance.

Specialized routine medical care such as routine pathology services

Exclude projects of a routine nature, with established methodologies intended for on-going monitoring of an activity, where results do not further scientific, technological advance, or understanding of the effectiveness of a technology.

In-house R&D expenditures within Canada (Q4 - Q7)

In-house R&D expenditures are composed of current in-house R&D expenditures and capital in-house R&D expenditures.

Current in-house R&D expenditures

Include:

• wages, salaries, benefits and fringe benefits, materials and supplies
• services to support R&D, including on-site R&D consultants and contactors
• necessary background literature
• minor scientific equipment
• associated administrative overhead costs.

a. Wages, salaries of permanent, temporary and casual R&D employees

Include benefits and fringe benefits of employees engaged in R&D activities. Benefits and fringe benefits include bonus payments, holiday or vacation pay, pension fund contributions, other social security payments, payroll taxes, etc.

b. Services to support R&D

Include:

• payments to on-site R&D consultants and contractors working under the direct control of your business
• other services including indirect services purchased to support in-house R&D such as security, storage, repair, maintenance and use of buildings and equipment
• computer services, software licensing fees and dissemination of R&D findings.

c. R&D materials

Include:

• water, fuel, gas and electricity
• materials for creation of prototypes
• reference materials (books, journals, etc.)
• subscriptions to libraries and data bases, memberships to scientific societies, etc.
• cost of outsourced (contracted out or granted) small R&D prototypes or R&D models
• materials for laboratories (chemicals, animals, etc.)
• all other R&D-related materials.

d. All other current R&D costs including overhead

Include administrative and overhead costs (e.g., office, lease/rent, post and telecommunications, internet, legal expenditures, insurance), prorated if necessary to allow for non-R&D activities within the business.

Exclude:

• interest charges
• value-added taxes (goods and services tax (GST) or harmonized sales tax (HST)).

Capital in-house R&D expenditures

Capital in-house R&D expenditures are the annual gross amount paid for the acquisition of fixed assets that are used repeatedly, or continuously in the performance of R&D for more than one year. Report capital in-house R&D expenditures in full for the period when they occurred.

Include costs for software, land, buildings and structures, equipment, machinery and other capital costs.

Exclude capital depreciation.

e. Software

Include applications and systems software (original, customized and off-the-shelf software), supporting documentation and other software-related acquisitions.

f. Land acquired for R&D including testing grounds, sites for laboratories and pilot plants.

g. Buildings and structures that are constructed or purchased for R&D activities or that have undergone major improvements, modifications, renovations and repairs for R&D activities.

h. Equipment, machinery and all other capital

Include major equipment, machinery and instruments, including embedded software, acquired for R&D activities.

Outsourced (contracted out or granted) R&D expenditures (Q8 - Q11)

Include payments made through contracts, grants donations and fellowships to another company, organization or individual to purchase or fund R&D activities.

Exclude expenditures for on-site R&D contractors.

1. Parent and subsidiary companies are companies connected to each other through majority ownership of the subsidiary company by the parent company. Affiliated companies are companies connected to a parent through minority ownership of the affiliated companies by the parent.
2. Companies include all incorporated for-profit businesses and government business enterprises providing products in the market at market rates.
3. Private non-profit organizations include voluntary health organizations, private philanthropic foundations, associations and societies and research institutes. They are not-for-profit organizations that serve the public interest by supporting activities related to public welfare (such as health, education, the environment).
4. Industrial research institutes or associations include all non-profit organizations that serve the business sector, with industrial associations frequently consisting of their membership.
5. Universities include hospitals and clinics when they are affiliated with a university and provide education services or when R&D activity is under the direct control of a university.
6. Federal government includes all federal government departments and agencies. It excludes federal government business enterprises providing products in the market.
7. Provincial or territorial governments include all provincial or territorial government ministries, departments and agencies. It excludes provincial or territorial government business enterprises providing products in the market.
8. Provincial or territorial research organizations are organizations created under provincial or territorial law which conduct or facilitate research on behalf of the province or territory.
9. Other organizations – individuals, non-university educational institutions, foreign governments including ministries, departments and agencies of foreign governments.

Sources of funds for in-house R&D expenditures in 2023 (Q16)

Include Canadian and foreign sources.

Exclude:

• payments for outsourced (contracted out or granted) R&D, which should be reported in question 9
• capital depreciation.

1. Funds from this business

   Amount contributed by this business to R&D performed within Canada (include amounts eligible for income tax purposes, e.g., Scientific Research and Experimental Development (SR&ED) program, other amounts spent for projects not claimed through SR&ED, and funds for land, buildings, machinery and equipment (capital expenditures) purchased for R&D).

2. Funds from parent, affiliated and subsidiary companies

   Amount received from parent, affiliated and subsidiary companies used to perform R&D within Canada (include amounts eligible for income tax purposes, e.g., Scientific Research and Experimental Development (SR&ED) program, other amounts spent for projects not claimed through SR&ED, and funds for land, buildings, machinery and equipment (capital expenditures) purchased for R&D).

3. Federal government grants or funding

   Funds received from the federal government in support of R&D activities not connected to a specific contractual deliverable.

4. Federal government contracts

   Funds received from the federal government in support of R&D activities connected to a specific contractual deliverable.

5. R&D contract work for other companies

   Funds received from other companies to perform R&D on their behalf.

6. Provincial or territorial government grants or funding

   Funds received from the provincial or territorial government in support of R&D activities not connected to a specific contractual deliverable.

7. Provincial or territorial government contracts

   Funds received from the provincial or territorial government in support of R&D activities connected to a specific contractual deliverable.

8. R&D contract work for private non-profit organizations

   Funds received from non-profit organizations to perform R&D on their behalf.

9. Other sources

   Funds received from all other sources not previously classified.

Fields of R&D for in-house R&D expenditures within Canada in 2023 (Q18)

Exclude:

• payments for outsourced (contracted out or granted) R&D, which should be reported in question 9
• capital depreciation.

Natural and formal sciences

Mathematics, physical sciences, chemical sciences, earth and related environmental sciences, biological sciences, other natural sciences.

Exclude computer sciences, information sciences and bioinformatics (to be reported at lines s. and t.)

1. Mathematics: pure mathematics, applied mathematics, statistics and probability.
2. Physical sciences: atomic, molecular and chemical physics, interaction with radiation, magnetic resonances, condensed matter physics, solid state physics and superconductivity, particles and fields physics, nuclear physics, fluids and plasma physics (including surface physics), optics (including laser optics and quantum optics), acoustics, astronomy (including astrophysics, space science).
3. Chemical sciences: organic chemistry, inorganic and nuclear chemistry, physical chemistry, polymer science and plastics, electrochemistry (dry cells, batteries, fuel cells, metal corrosion, electrolysis), colloid chemistry, analytical chemistry.
4. Earth and related environmental sciences: geosciences, geophysics, mineralogy and palaeontology, geochemistry and geophysics, physical geography, geology and volcanology, environmental sciences, meteorology, atmospheric sciences and climatic research, oceanography, hydrology and water resources.
5. Biological sciences: cell biology, microbiology and virology, biochemistry, molecular biology and biochemical research, mycology, biophysics, genetics and heredity (medical genetics under medical biotechnology), reproductive biology (medical aspects under medical biotechnology), developmental biology, plant sciences and botany, zoology, ornithology, entomology and behavioural sciences biology, marine biology, freshwater biology and limnology,  ecology and biodiversity conservation, biology (theoretical, thermal, cryobiology, biological rhythm), evolutionary biology.
6. Other natural sciences: other natural sciences.

Engineering and Technology

Civil engineering, electrical engineering, electronic engineering and communications technology, mechanical engineering, chemical engineering, materials engineering, medical engineering, environmental engineering, environmental biotechnology, industrial biotechnology, nanotechnology, other engineering and technologies.

Exclude software engineering and technology (to be reported at line r).

7. Civil engineering: civil engineering, architecture engineering, municipal and structural engineering, transport engineering.
8. Electrical engineering, electronic engineering and communications technology: electrical and electronic engineering, robotics and automatic control, micro-electronics, semiconductors, automation and control systems, communication engineering and systems, telecommunications, computer hardware and architecture.
9. Mechanical engineering: mechanical engineering, applied mechanics, thermodynamics, aerospace engineering, nuclear-related engineering (nuclear physics under Physical sciences), acoustical engineering, reliability analysis and non-destructive testing, automotive and transportation engineering and manufacturing, tooling, machinery and equipment engineering and manufacturing, heating, ventilation and air conditioning engineering and manufacturing.
10. Chemical engineering: chemical engineering (plants, products), chemical process engineering.
11. Materials engineering: materials engineering and metallurgy, ceramics, coating and films (including packaging and printing), plastics, rubber and composites (including laminates and reinforced plastics), paper and wood and textiles, construction materials (organic and inorganic).
12. Medical engineering: medical and biomedical engineering, medical laboratory technology (excluding biomaterials, which should be reported under Industrial biotechnology).
13. Environmental engineering: environmental and geological engineering, petroleum engineering (fuel, oils), energy and fuels, remote sensing, mining and mineral processing, marine engineering, sea vessels and ocean engineering.
14. Environmental biotechnology: environmental biotechnology, bioremediation, diagnostic biotechnologies in environmental management (DNA chips and bio-sensing devices).
15. Industrial biotechnology: industrial biotechnology, bioprocessing technologies, biocatalysis and fermentation bioproducts (products that are manufactured using biological material as feedstock), biomaterials (bioplastics, biofuels, bioderived bulk and fine chemicals, bio-derived materials).
16. Nanotechnology: nano-materials (production and properties), nano-processes (applications on nano-scale).
17. Other engineering and technologies: food and beverages, oenology, other engineering and technologies.

Software-related sciences and technology

Software engineering and technology, computer sciences, information technology and bioinformatics.

18. Software engineering and technology: computer software engineering, computer software technology, and other related computer software engineering and technologies.
19. Computer sciences: computer science, artificial intelligence, cryptography, and other related computer sciences.
20. Information technology and bioinformatics: information technology, informatics, bioinformatics, biomathematics, and other related information technologies.

Medical and health sciences

Basic medicine, clinical medicine, health sciences, medical biotechnology, other medical sciences.

21. Basic medicine: anatomy and morphology (plant science under Biological science), human genetics, immunology, neurosciences, pharmacology and pharmacy and medicinal chemistry, toxicology, physiology and cytology, pathology.
22. Clinical medicine: andrology, obstetrics and gynaecology, paediatrics, cardiac and cardiovascular systems, haematology, anaesthesiology, orthopaedics, radiology and nuclear medicine, dentistry, oral surgery and medicine, dermatology, venereal diseases and allergy, rheumatology, endocrinology and metabolism and gastroenterology, urology and nephrology, and oncology.
23. Health sciences: health care sciences and nursing, nutrition and dietetics, parasitology, infectious diseases and epidemiology, occupational health.
24. Medical biotechnology: health-related biotechnology, technologies involving the manipulation of cells, tissues, organs or the whole organism, technologies involving identifying the functioning of DNA, proteins and enzymes, pharmacogenomics, gene-based therapeutics, biomaterials (related to medical implants, devices, sensors).
25. Other medical sciences: forensic science, other medical sciences.

Agricultural Sciences

Agriculture, forestry and fisheries sciences, animal and dairy sciences, veterinary sciences, agricultural biotechnology, other agricultural sciences.

26. Agriculture, forestry and fisheries sciences: agriculture, forestry, fisheries and aquaculture, soil science, horticulture, viticulture, agronomy, plant breeding and plant protection.
27. Animal and dairy sciences: animal and dairy science, animal husbandry.
28. Veterinary sciences: veterinary science (all).
29. Agricultural biotechnology: agricultural biotechnology and food biotechnology, genetically modified (GM) organism technology and livestock cloning, diagnostics (DNA chips and biosensing devices), biomass feedstock production technologies and biopharming.
30. Other agricultural sciences: other agricultural sciences.

Social sciences and humanities

Psychology, educational sciences, economics and business, other social sciences, humanities.

31. Psychology: cognitive psychology and psycholinguistics, experimental psychology, psychometrics and quantitative psychology, and other fields of psychology.
32. Educational sciences: education, training and other related educational sciences.
33. Economics and business: micro-economics, macro-economics, econometrics, labour economics, financial economics, business economics, entrepreneurial and business administration, management and operations, management sciences, finance and all other related fields of economics and business.
34. Other social sciences: anthropology (social and cultural) and ethnology, demography, geography (human, economic and social), planning (town, city and country), management, organization and methods (excluding market research unless new methods/techniques are developed), law, linguistics, political sciences, sociology, miscellaneous social sciences and interdisciplinary, and methodological and historical science and technology activities relating to subjects in this group.
35. Humanities: history (history, prehistory and history, together with auxiliary historical disciplines such as archaeology, numismatics, palaeography, genealogy, etc.), languages and literature (ancient and modern), other humanities (philosophy (including the history of science and technology)), arts (history of art, art criticism, painting, sculpture, musicology, dramatic art excluding artistic "research" of any kind), religion, theology, other fields and subjects pertaining to the humanities, and methodological, historical and other science and technology activities relating to the subjects in this group.

In-house R&D personnel in 2023 (Q70 - Q72)

Include:

• permanent, temporary and casual R&D employees
• independent on-site R&D consultants and contractors working in your business's offices, laboratories, or other facilities
• employees engaged in R&D-related support activities.

Researchers and research managers are composed of:

1. Scientists, social scientists, engineers and researchers are professionals engaged in the conception or creation of new knowledge. They conduct research and improve or develop concepts, theories, models, techniques instrumentation, software or operational methods. They may be certified by provincial or territorial educational authorities, provincial, territorial or national scientific or engineering associations.
2. Senior research managers plan or manage R&D projects and programs. They may be certified by provincial or territorial educational authorities, provincial, territorial or national scientific or engineering associations.

R&D technical, administrative and support staff are composed of:

3. Technicians and technologists and research assistants are persons whose main tasks require technical knowledge and experience in one or more fields of engineering, the physical and life sciences, or the social sciences, humanities and the arts. They participate in R&D by performing scientific and technical tasks involving the application of concepts, operational methods and the use of research equipment, normally under the supervision of researchers. They may be certified by provincial or territorial educational authorities, provincial, territorial or national scientific or engineering associations.
4. Other R&D technical, administrative support staff include skilled and unskilled craftsmen, and administrative, secretarial and clerical staff participating in R&D projects or directly associated with such projects.

On-site R&D consultants and contractors are individuals hired 1) to perform project-based work or to provide goods at a fixed or ascertained price or within a certain time or 2) to provide advice or services in a specialized field for a fee and, in both cases, work at the location specified and controlled by the contracting company or organization.

Full-time equivalent (FTE)

R&D may be carried out by persons who work solely on R&D projects or by persons who devote only part of their time to R&D, and the balance to other activities such as testing, quality control and production engineering. To arrive at the total effort devoted to R&D in terms of personnel, it is necessary to estimate the full-time equivalent of these persons working only part-time in R&D.

Full-time equivalent (FTE) = Number of persons who work solely on R&D projects + the time of persons working only part of their time on R&D.

Example calculation: If out of four scientists engaged in R&D work, one works solely on R&D projects and the remaining three devote only one quarter of their working time to R&D, then: FTE = 1 + 1/4 + 1/4 + 1/4 = 1.75 scientists.

Technology and technical assistant payments in 2023 (Q73 - Q75)

Definitions (equivalent to the Canadian Intellectual Property Office: Canadian Intellectual Property Office)

1. Patent

   Government grant giving the right to exclude others from making, using or selling an invention.

2. Copyright

   Legal protection for literary, artistic, dramatic or musical works, computer programs, performer's performances, sound recordings, and communication signals.

3. Trademark

   A word, symbol or design, or combination of these, used to distinguish goods or services of one person or organization from those of others in the marketplace.

4. Industrial design

   Legal protection against imitation of the shape, pattern, or ornamentation of an object.

5. Integrated circuit topography

   Three-dimensional configurations of the elements and interconnections embodied in an integrated circuit product.

6. Original software

   Computer programs and descriptive materials for both systems and applications. Original software can be created in-house or outsourced and includes packaged software with customization.

7. Packaged or off-the-shelf software

   Packaged software purchased for organizational use and excludes software with customization.

8. Databases

   Data files organized to permit effective access and use of the data including access clinical trial registries and administrative health data for research purposes. Includes partnerships supporting the development of databases, such as patient or clinical trial registries or biobanks, to be used for research purposes (e.g., developing a national bladder cancer patient registry with Bladder Cancer Canada for future research).

9. Other technology and technical assistance

   Technical assistance, industrial processes and know-how including technology transfer and know how such as batch pilot production, method develop, and validation related to technology or manufacturing transfer.

Energy-related R&D by area of technology (Q22 - Q69)

Fossil Fuels

Crude oils and natural gas exploration, crude oils and natural gas production, oil sands and heavy crude oils surface and sub-surface production and separation of the bitumen, tailings management, refining, processing and upgrading, coal production, separation and processing, transportation of fossil fuels.

1. Crude oils and natural gas exploration

   Include development of advanced exploration methods (geophysical, geochemical, seismic, magnetic) for on-shore and off-shore prospecting.

2. Crude oil and natural gas production and storage, include enhanced recovery natural gas production

   Include on-shore and off-shore deep drilling equipment and techniques for conventional oil and gas, secondary and tertiary recovery of oil and gas, hydro fracturing techniques, processing and cleaning of raw product, storage on remote platforms (e.g., Arctic, off-shore), safety aspects of offshore platforms.

3. Oil sands and heavy crude oils surface and sub-surface production and separation of the bitumen, tailings management

   Include surface and in-situ production (e.g., SAGD), tailings management.

4. Refining, processing and upgrading of fossil fuels

   Include processing of natural gas to pipeline specifications, and refining of conventional crude oils to refined petroleum products (RPPs), and the upgrading of bitumen and heavy oils either to synthetic crude oil or to RPPs. Upgrading may be done at an oil sands plant, regional merchant upgraders or integrated into a refinery producing RPPs.

5. Coal production, separation and processing

   Include coal, lignite and peat exploration, deposit evaluation techniques, mining techniques, separation techniques, coking and blending, other processing such as coal to liquids, underground (in-situ) gasification.

6. Transportation of fossil fuels

   Include transport of gaseous, liquid and solid hydrocarbons via pipelines (land and submarine) and their network evaluation, safety aspects of LNG transport and storage.

Renewable energy resources

Solar photovoltaics (PV), solar thermal-power and high-temperature applications, solar heating and cooling, wind energy, bio-energy – biomass production and transport, bio-energy – biomass conversion to transportation fuel, bio-energy – biomass conversion to heat and electricity, other bio-energy, small hydro (less than 10 MW), large hydro (greater than or equal to 10 MW), other renewable energy.

1. Solar photovoltaics (PV)

   Include solar cell development, PV-module development, PV-inverter development, building-integrated PV-modules, PV-system development, other.

2. Solar thermal-power and high-temperature applications

   Include solar chemistry, concentrating collector development, solar thermal power plants, high-temperature applications for heat and power.

3. Solar heating and cooling

   Include daylighting, passive and active solar heating and cooling, collector development, hot water preparation, combined-space heating, solar architecture, solar drying, solar-assisted ventilation, swimming pool heating, low-temperature process heating, other.

4. Wind energy

   Include technology development, such as blades, turbines, converters structures, system integration, other.

5. Bio-energy – Biomass production and transport

   Include improvement of energy crops, research on bio-energy production potential and associated land-use effects, supply and transport of bio-solids, bio-liquids, biogas and bio-derived energy products (e.g., ethanol, biodiesel), compacting and baling, other.

6. Bio-energy – Biomass conversion to transportation fuel

   Include conventional bio-fuels, cellulosic-derived alcohols, biomass gas-to-liquids, other energy-related products and by-products.

7. Bio-energy – Biomass conversion to heat and electricity

   Include bio-based heat, electricity and combined heat and power (CHP), exclude multi-firing with fossil fuels.

8. Other bio-energy

   Include recycling and the use of municipal, industrial and agricultural waste as energy not covered elsewhere.

9. Small hydro (less than 10 MW)

   Include plants with capacity below 10 MW.

10. Large hydro (greater than or equal to 10 MW)

    Include plants with capacity of 10 MW and above.

11. Other renewable energy

    Include hot dry rock, hydro-thermal, geothermal heat applications (including agriculture), tidal power, wave energy, ocean current power, ocean thermal power, other.

Nuclear fission and fusion

Materials exploration, mining and preparation, tailings management, nuclear reactors, other fission, fusion.

1. Nuclear materials exploration, mining and preparation, tailings management

   Include development of advanced exploration methods (geophysical, geochemical) for prospecting, ore surface and in-situ production, uranium and thorium extraction and conversion, enrichment, handling of tailings and remediation.

2. Nuclear reactors

   Include nuclear reactors of all types and related system components.

3. Other fission

   Include nuclear safety, environmental protection (emission reduction or avoidance), radiation protection and decommissioning of power plants and related nuclear fuel cycle installations, nuclear waste treatment, disposal and storage, fissile material recycling, fissile materials control, transport of radioactive materials.

4. Fusion

   Include all types (e.g., magnetic confinement, laser applications).

Electric Power

Generation in utility sector, combined heat and power in industry and in buildings, electricity transmission, distribution and storage of electricity.

1. Electric power generation in utility sector

   Include conventional and non-conventional technology (e.g., pulverised coal, fluidised bed, gasification-combined cycle, supercritical), re-powering, retrofitting, life extensions and upgrading of power plants, generators and components, super-conductivity, magneto hydrodynamic, dry cooling towers, co-firing (e.g., with biomass), air and thermal pollution reduction or avoidance, flue gas cleanup (excluding CO2 removal), CHP (combined heat and power) not covered elsewhere.

2. Electric power - combined heat and power in industry, buildings

   Include industrial applications, small scale applications for buildings.

3. Electricity transmission, distribution and storage

   Include solid state power electronics, load management and control systems, network problems, super-conducting cables, AC and DC high voltage cables, HVDC transmission, other transmission and distribution related to integrating distributed and intermittent generating sources into networks, all storage (e.g., batteries, hydro reservoirs, fly wheels), other.

Hydrogen and fuel cells

Hydrogen production for process applications, hydrogen production for transportation applications, hydrogen transport and storage, other hydrogen, fuel cells, both stationary and mobile.

1. Hydrogen production for process applications
2. Hydrogen production for transportation applications
3. Hydrogen transport and storage
4. Other hydrogen

   Include end uses (e.g., combustion), other infrastructure and systems R&D (refuelling stations).

5. Stationary fuel cells

   Include electricity generation, other stationary end-use.

6. Mobile fuel cells

   Include portable applications.

Energy efficiency

Industry, residential and commercial, transportation, other energy efficiency.

1. Energy efficiency applications for industry

   Include reduction of energy consumption through improved use of energy and/or reduction or avoidance of air and other emissions related to the use of energy in industrial systems and processes (excluding bio-energy-related) through the development of new techniques, new processes and new equipment, other.

2. Energy efficiency for residential, institutional and commercial sectors

   Include space heating and cooling, ventilation and lighting control systems other than solar technologies, low energy housing design and performance other than solar technologies, new insulation and building materials, thermal performance of buildings, domestic appliances, other.

3. Energy efficiency for transportation

   Includes analysis and optimisation of energy consumption in the transport sector, efficiency improvements in light-duty vehicles, heavy-duty vehicles, non-road vehicles, public transport systems, engine-fuel optimisation, use of alternative fuels (liquid and gaseous, other than hydrogen), fuel additives, diesel engines, Stirling motors, electric cars, hybrid cars, air emission reduction, other.

4. Other energy efficiency

   Include waste heat utilisation (heat maps, process integration, total energy systems, low temperature thermodynamic cycles), district heating, heat pump development, reduction of energy consumption in the agricultural sector.

Other energy-related technologies

Carbon capture, transportation and storage for fossil fuel production and processing, electric power generation, industry in end-use sector, energy systems analysis, all other energy-related technologies.

1. Carbon capture, transport and storage related to fossil fuel production and processing
2. Carbon capture, transport and storage related to electric power production
3. Carbon capture, transport and storage related to industry in end-use sector

   Include industry in the end-use sector, such as steel production, manufacturing, etc. (exclude fossil fuel production and processing and electric power production).

4. Energy system analysis

   Include system analysis related to energy R&D not covered elsewhere, sociological, economical and environmental impact of energy which are not specifically related to one technology area listed in the sections above.

5. All other energy technologies

   Include energy technology information dissemination, studies not related to a specific technology area listed above.

Environmental and clean technology R&D expenditures in 2023

Air pollution management

Activities aimed at reducing the emissions of pollutants (including greenhouse gases) to the atmosphere. Include pollution abatement and control (i.e., end-of-pipe processes) and pollution prevention (i.e., integrated processes), as well as related measurement, control, laboratories and the like.

Solid waste management

Activities related to the collection, treatment, storage, disposal, and recycling of all domestic, industrial, non-hazardous and hazardous waste (including low-level radioactive waste). Include monitoring activities. Exclude radioactive waste and mine tailings handling and treatment (to be reported under Protection against radiation and Wastewater management, respectively).

Wastewater management

Activities aimed at pollution reduction or prevention through the abatement of pollutants or the reduction of the release of wastewater. Include measures aimed at reducing pollutants before discharge, reducing the release of wastewater, septic tanks, treatment of cooling water, handling and treatment of mine tailings, etc.

Protection and remediation of soil, groundwater and surface water

Activities aimed at the prevention of pollution infiltration: remediation or cleaning up of soils and water bodies; protection of soil from erosion, salinization and physical degradation; monitoring, control, laboratories and the like. Exclude management of wastewater released to surface waters, municipal sewer systems or soil, or injected underground (to be reported under Wastewater management) and protection of biodiversity and habitat (to be reported under Protection of biodiversity and habitat).

Protection of biodiversity and habitat

Activities related to protecting wildlife and habitat from the effects of economic activity, and to restoring wildlife or habitat that has been adversely affected by such activity. Include related environmental measurements, monitoring, control, laboratories and the like.

Noise and vibration abatement

Activities aimed at controlling or reducing industrial and transport noise and vibration for the sole purpose of protecting the environment. Include preventive in-process modifications at the source, construction of anti-noise/vibration facilities, measurement, control, laboratories and the like.

Protection against radiation

Activities aimed at preventing, reducing, or eliminating the negative consequences of radiation on the environment. This includes all handling, transportation, and treatment of radioactive waste (i.e. waste that requires shielding during normal handling and transportation due to high radionuclide content), the protection of ambient media, measurement, control, laboratories and the like, as well as any other activities related to the containment of radioactive waste. Exclude activities and measures related to low-level radioactive waste (to be reported under Solid waste management), the prevention of technological hazards (e.g., external safety of nuclear power plants), and measures taken to protect workers.

Heat or energy savings and management

Activities aimed at reducing the intake of energy through in-process modifications (such as adjustment of production processes or heat and electricity co-generation), as well as reducing heat and energy losses. This includes insulation activities, energy recovery, measurement, control, laboratories and the like.

Renewable energy

Energy obtained from resources that naturally replenish or renew within a human lifespan (i.e. the resource is a sustainable source of energy). This includes wind, solar, aero-thermal, geothermal, hydrothermal and ocean energy, hydropower, biomass, landfill gas, sewage treatment plant gas and biogases.