Collection and questionnaires
Filter results by
Search HelpKeyword(s)
Type
Survey or statistical program
Results
All (39)
All (39) (0 to 10 of 39 results)
- 1. Survey Series on People and their Communities ArchivedArticles and reports: 11-522-X202200100011Description: In 2021, Statistics Canada initiated the Disaggregated Data Action Plan, a multi-year initiative to support more representative data collection methods, enhance statistics on diverse populations to allow for intersectional analyses, and support government and societal efforts to address known inequalities and bring considerations of fairness and inclusion into decision making. As part of this initiative, we are building the Survey Series on People and their Communities, a new probabilistic panel specifically designed to collect data that can be disaggregated according to racialized group. This new tool will allow us to address data gaps and emerging questions related to diversity. This paper will give an overview of the design of the Survey Series on People and their Communities.Release date: 2024-03-25
- Articles and reports: 12-001-X202200100005Description:
Methodological studies of the effects that human interviewers have on the quality of survey data have long been limited by a critical assumption: that interviewers in a given survey are assigned random subsets of the larger overall sample (also known as interpenetrated assignment). Absent this type of study design, estimates of interviewer effects on survey measures of interest may reflect differences between interviewers in the characteristics of their assigned sample members, rather than recruitment or measurement effects specifically introduced by the interviewers. Previous attempts to approximate interpenetrated assignment have typically used regression models to condition on factors that might be related to interviewer assignment. We introduce a new approach for overcoming this lack of interpenetrated assignment when estimating interviewer effects. This approach, which we refer to as the “anchoring” method, leverages correlations between observed variables that are unlikely to be affected by interviewers (“anchors”) and variables that may be prone to interviewer effects to remove components of within-interviewer correlations that lack of interpenetrated assignment may introduce. We consider both frequentist and Bayesian approaches, where the latter can make use of information about interviewer effect variances in previous waves of a study, if available. We evaluate this new methodology empirically using a simulation study, and then illustrate its application using real survey data from the Behavioral Risk Factor Surveillance System (BRFSS), where interviewer IDs are provided on public-use data files. While our proposed method shares some of the limitations of the traditional approach – namely the need for variables associated with the outcome of interest that are also free of measurement error – it avoids the need for conditional inference and thus has improved inferential qualities when the focus is on marginal estimates, and it shows evidence of further reducing overestimation of larger interviewer effects relative to the traditional approach.
Release date: 2022-06-21 - Articles and reports: 75-006-X201800154979Description:
In anticipation of legislation (Bill C-45) legalizing cannabis for non medical use coming into force, Statistics Canada has undertaken a thorough review of its capability to evaluate the bill’s impact. This document focuses on the agency’s social statistics system—specifically, surveys and administrative databases designed to collect information related to health and health care; law enforcement; the justice system and community safety and well-being; education; and labour.
Release date: 2018-10-12 - Articles and reports: 11-522-X201700014744Description:
This presentation will begin with Dr. West providing a summary of research that has been conducted on the quality and utility of paradata collected as part of the United States National Survey of Family Growth (NSFG). The NSFG is the major national fertility survey in the U.S., and an important source of data on sexual activity, sexual behavior, and reproductive health for policy makers. For many years, the NSFG has been collecting various forms of paradata, including keystroke information (e.g., Couper and Kreuter 2013), call record information, detailed case disposition information, and interviewer observations related to key NSFG measures (e.g., West 2013). Dr. West will discuss some of the challenges of working with these data, in addition to evidence of their utility for nonresponse adjustment, interviewer evaluation, and/or responsive survey design purposes. Dr. Kreuter will then present research done using paradata collected as part of two panel surveys: the Medical Expenditure Panel Survey (MEPS) in the United States, and the Panel Labour Market and Social Security (PASS) in Germany. In both surveys, information from contacts in prior waves were experimentally used to improve contact and response rates in subsequent waves. In addition, research from PASS will be presented where interviewer observations on key outcome variables were collected to be used in nonresponse adjustment or responsive survey design decisions. Dr. Kreuter will not only present the research results but also the practical challenges in implementing the collection and use of both sets of paradata.
Release date: 2016-03-24 - Articles and reports: 82-003-X201500514169Description:
The Cancer Risk Management Model incorporates the risk of developing cancer, disease screening and clinical management with cost and labour data to assess health outcomes and economic impact. A screening module added to the lung cancer module enables a variety of scenarios to be evaluated for different target populations with varying rates of participation, compliance, and frequency of low-dose computed tomography screening.
Release date: 2015-05-20 - Articles and reports: 12-001-X201400214092Description:
Survey methodologists have long studied the effects of interviewers on the variance of survey estimates. Statistical models including random interviewer effects are often fitted in such investigations, and research interest lies in the magnitude of the interviewer variance component. One question that might arise in a methodological investigation is whether or not different groups of interviewers (e.g., those with prior experience on a given survey vs. new hires, or CAPI interviewers vs. CATI interviewers) have significantly different variance components in these models. Significant differences may indicate a need for additional training in particular subgroups, or sub-optimal properties of different modes or interviewing styles for particular survey items (in terms of the overall mean squared error of survey estimates). Survey researchers seeking answers to these types of questions have different statistical tools available to them. This paper aims to provide an overview of alternative frequentist and Bayesian approaches to the comparison of variance components in different groups of survey interviewers, using a hierarchical generalized linear modeling framework that accommodates a variety of different types of survey variables. We first consider the benefits and limitations of each approach, contrasting the methods used for estimation and inference. We next present a simulation study, empirically evaluating the ability of each approach to efficiently estimate differences in variance components. We then apply the two approaches to an analysis of real survey data collected in the U.S. National Survey of Family Growth (NSFG). We conclude that the two approaches tend to result in very similar inferences, and we provide suggestions for practice given some of the subtle differences observed.
Release date: 2014-12-19 - 7. Challenges and Lessons Learned with the Implementation of Car Chips in the Fuel Consumption Survey ArchivedSurveys and statistical programs – Documentation: 11-522-X201300014258Description:
The National Fuel Consumption Survey (FCS) was created in 2013 and is a quarterly survey that is designed to analyze distance driven and fuel consumption for passenger cars and other vehicles weighing less than 4,500 kilograms. The sampling frame consists of vehicles extracted from the vehicle registration files, which are maintained by provincial ministries. For collection, FCS uses car chips for a part of the sampled units to collect information about the trips and the fuel consumed. There are numerous advantages to using this new technology, for example, reduction in response burden, collection costs and effects on data quality. For the quarters in 2013, the sampled units were surveyed 95% via paper questionnaires and 5% with car chips, and in Q1 2014, 40% of sampled units were surveyed with car chips. This study outlines the methodology of the survey process, examines the advantages and challenges in processing and imputation for the two collection modes, presents some initial results and concludes with a summary of the lessons learned.
Release date: 2014-10-31 - Surveys and statistical programs – Documentation: 11-522-X201300014278Description:
In January and February 2014, Statistics Canada conducted a test aiming at measuring the effectiveness of different collection strategies using an online self-reporting survey. Sampled units were contacted using mailed introductory letters and asked to complete the online survey without any interviewer contact. The objectives of this test were to measure the take-up rates for completing an online survey, and to profile the respondents/non-respondents. Different samples and letters were tested to determine the relative effectiveness of the different approaches. The results of this project will be used to inform various social surveys that are preparing to include an internet response option in their surveys. The paper will present the general methodology of the test as well as results observed from collection and the analysis of profiles.
Release date: 2014-10-31 - 9. Collecting data for poverty and vulnerability assessment in remote areas in Sub-Saharan Africa ArchivedArticles and reports: 12-001-X201000211383Description:
Data collection for poverty assessments in Africa is time consuming, expensive and can be subject to numerous constraints. In this paper we present a procedure to collect data from poor households involved in small-scale inland fisheries as well as agricultural activities. A sampling scheme has been developed that captures the heterogeneity in ecological conditions and the seasonality of livelihood options. Sampling includes a three point panel survey of 300 households. The respondents belong to four different ethnic groups randomly chosen from three strata, each representing a different ecological zone. In the first part of the paper some background information is given on the objectives of the research, the study site and survey design, which were guiding the data collection process. The second part of the paper discusses the typical constraints that are hampering empirical work in Sub-Saharan Africa, and shows how different challenges have been resolved. These lessons could guide researchers in designing appropriate socio-economic surveys in comparable settings.
Release date: 2010-12-21 - Articles and reports: 11-522-X200800010941Description:
Prior to 2004, the design and development of collection functions at Statistics New Zealand (Statistics NZ) was done by a centralised team of data collection methodologists. In 2004, an organisational review considered whether the design and development of these functions was being done in the most effective way. A key issue was the rising costs of surveying as the organisation moved from paper-based data collection to electronic data collection. The review saw some collection functions decentralised. However, a smaller centralised team of data collection methodologists was retained to work with subject matter areas across Statistics NZ.
This paper will discuss the strategy used by the smaller centralised team of data collection methodologists to support subject matter areas. There are three key themes to the strategy. First, is the development of best practice standards and a central standards repository. Second, is training and introducing knowledge sharing forums. Third, is providing advice and independent review to subject matter areas which design and develop collection instruments.
Release date: 2009-12-03
Data (0)
Data (0) (0 results)
No content available at this time.
Analysis (26)
Analysis (26) (0 to 10 of 26 results)
- 1. Survey Series on People and their Communities ArchivedArticles and reports: 11-522-X202200100011Description: In 2021, Statistics Canada initiated the Disaggregated Data Action Plan, a multi-year initiative to support more representative data collection methods, enhance statistics on diverse populations to allow for intersectional analyses, and support government and societal efforts to address known inequalities and bring considerations of fairness and inclusion into decision making. As part of this initiative, we are building the Survey Series on People and their Communities, a new probabilistic panel specifically designed to collect data that can be disaggregated according to racialized group. This new tool will allow us to address data gaps and emerging questions related to diversity. This paper will give an overview of the design of the Survey Series on People and their Communities.Release date: 2024-03-25
- Articles and reports: 12-001-X202200100005Description:
Methodological studies of the effects that human interviewers have on the quality of survey data have long been limited by a critical assumption: that interviewers in a given survey are assigned random subsets of the larger overall sample (also known as interpenetrated assignment). Absent this type of study design, estimates of interviewer effects on survey measures of interest may reflect differences between interviewers in the characteristics of their assigned sample members, rather than recruitment or measurement effects specifically introduced by the interviewers. Previous attempts to approximate interpenetrated assignment have typically used regression models to condition on factors that might be related to interviewer assignment. We introduce a new approach for overcoming this lack of interpenetrated assignment when estimating interviewer effects. This approach, which we refer to as the “anchoring” method, leverages correlations between observed variables that are unlikely to be affected by interviewers (“anchors”) and variables that may be prone to interviewer effects to remove components of within-interviewer correlations that lack of interpenetrated assignment may introduce. We consider both frequentist and Bayesian approaches, where the latter can make use of information about interviewer effect variances in previous waves of a study, if available. We evaluate this new methodology empirically using a simulation study, and then illustrate its application using real survey data from the Behavioral Risk Factor Surveillance System (BRFSS), where interviewer IDs are provided on public-use data files. While our proposed method shares some of the limitations of the traditional approach – namely the need for variables associated with the outcome of interest that are also free of measurement error – it avoids the need for conditional inference and thus has improved inferential qualities when the focus is on marginal estimates, and it shows evidence of further reducing overestimation of larger interviewer effects relative to the traditional approach.
Release date: 2022-06-21 - Articles and reports: 75-006-X201800154979Description:
In anticipation of legislation (Bill C-45) legalizing cannabis for non medical use coming into force, Statistics Canada has undertaken a thorough review of its capability to evaluate the bill’s impact. This document focuses on the agency’s social statistics system—specifically, surveys and administrative databases designed to collect information related to health and health care; law enforcement; the justice system and community safety and well-being; education; and labour.
Release date: 2018-10-12 - Articles and reports: 11-522-X201700014744Description:
This presentation will begin with Dr. West providing a summary of research that has been conducted on the quality and utility of paradata collected as part of the United States National Survey of Family Growth (NSFG). The NSFG is the major national fertility survey in the U.S., and an important source of data on sexual activity, sexual behavior, and reproductive health for policy makers. For many years, the NSFG has been collecting various forms of paradata, including keystroke information (e.g., Couper and Kreuter 2013), call record information, detailed case disposition information, and interviewer observations related to key NSFG measures (e.g., West 2013). Dr. West will discuss some of the challenges of working with these data, in addition to evidence of their utility for nonresponse adjustment, interviewer evaluation, and/or responsive survey design purposes. Dr. Kreuter will then present research done using paradata collected as part of two panel surveys: the Medical Expenditure Panel Survey (MEPS) in the United States, and the Panel Labour Market and Social Security (PASS) in Germany. In both surveys, information from contacts in prior waves were experimentally used to improve contact and response rates in subsequent waves. In addition, research from PASS will be presented where interviewer observations on key outcome variables were collected to be used in nonresponse adjustment or responsive survey design decisions. Dr. Kreuter will not only present the research results but also the practical challenges in implementing the collection and use of both sets of paradata.
Release date: 2016-03-24 - Articles and reports: 82-003-X201500514169Description:
The Cancer Risk Management Model incorporates the risk of developing cancer, disease screening and clinical management with cost and labour data to assess health outcomes and economic impact. A screening module added to the lung cancer module enables a variety of scenarios to be evaluated for different target populations with varying rates of participation, compliance, and frequency of low-dose computed tomography screening.
Release date: 2015-05-20 - Articles and reports: 12-001-X201400214092Description:
Survey methodologists have long studied the effects of interviewers on the variance of survey estimates. Statistical models including random interviewer effects are often fitted in such investigations, and research interest lies in the magnitude of the interviewer variance component. One question that might arise in a methodological investigation is whether or not different groups of interviewers (e.g., those with prior experience on a given survey vs. new hires, or CAPI interviewers vs. CATI interviewers) have significantly different variance components in these models. Significant differences may indicate a need for additional training in particular subgroups, or sub-optimal properties of different modes or interviewing styles for particular survey items (in terms of the overall mean squared error of survey estimates). Survey researchers seeking answers to these types of questions have different statistical tools available to them. This paper aims to provide an overview of alternative frequentist and Bayesian approaches to the comparison of variance components in different groups of survey interviewers, using a hierarchical generalized linear modeling framework that accommodates a variety of different types of survey variables. We first consider the benefits and limitations of each approach, contrasting the methods used for estimation and inference. We next present a simulation study, empirically evaluating the ability of each approach to efficiently estimate differences in variance components. We then apply the two approaches to an analysis of real survey data collected in the U.S. National Survey of Family Growth (NSFG). We conclude that the two approaches tend to result in very similar inferences, and we provide suggestions for practice given some of the subtle differences observed.
Release date: 2014-12-19 - 7. Collecting data for poverty and vulnerability assessment in remote areas in Sub-Saharan Africa ArchivedArticles and reports: 12-001-X201000211383Description:
Data collection for poverty assessments in Africa is time consuming, expensive and can be subject to numerous constraints. In this paper we present a procedure to collect data from poor households involved in small-scale inland fisheries as well as agricultural activities. A sampling scheme has been developed that captures the heterogeneity in ecological conditions and the seasonality of livelihood options. Sampling includes a three point panel survey of 300 households. The respondents belong to four different ethnic groups randomly chosen from three strata, each representing a different ecological zone. In the first part of the paper some background information is given on the objectives of the research, the study site and survey design, which were guiding the data collection process. The second part of the paper discusses the typical constraints that are hampering empirical work in Sub-Saharan Africa, and shows how different challenges have been resolved. These lessons could guide researchers in designing appropriate socio-economic surveys in comparable settings.
Release date: 2010-12-21 - Articles and reports: 11-522-X200800010941Description:
Prior to 2004, the design and development of collection functions at Statistics New Zealand (Statistics NZ) was done by a centralised team of data collection methodologists. In 2004, an organisational review considered whether the design and development of these functions was being done in the most effective way. A key issue was the rising costs of surveying as the organisation moved from paper-based data collection to electronic data collection. The review saw some collection functions decentralised. However, a smaller centralised team of data collection methodologists was retained to work with subject matter areas across Statistics NZ.
This paper will discuss the strategy used by the smaller centralised team of data collection methodologists to support subject matter areas. There are three key themes to the strategy. First, is the development of best practice standards and a central standards repository. Second, is training and introducing knowledge sharing forums. Third, is providing advice and independent review to subject matter areas which design and develop collection instruments.
Release date: 2009-12-03 - Articles and reports: 11-522-X200800010946Description:
In the mid 1990s the first question testing unit was set-up in the UK Office for National Statistics (ONS). The key objective of the unit was to develop and test the questions and questionnaire for the 2001 Census. Since the establishment of this unit the area has been expanded into a Data Collection Methodology (DCM) Centre of Expertise which now sits in the Methodology Directorate. The DCM centre has three branches which support DCM work for social surveys, business surveys, the Census and external organisations.
In the past ten years DCM has achieved a variety of things. For example, introduced survey methodology involvement in the development and testing of business survey question(naire)s; introduced a mix-method approach to the development of questions and questionnaires; developed and implemented standards e.g. for the 2011 census questionnaire & showcards; and developed and delivered DCM training events.
This paper will provide an overview of data collection methodology at the ONS from the perspective of achievements and challenges. It will cover areas such as methods, staff (e.g. recruitment, development and field security), and integration with the survey process.
Release date: 2009-12-03 - 10. Non-response in a random digit dialling survey: The experience of the General Social Survey's Cycle 21 (2007) ArchivedArticles and reports: 11-522-X200800010994Description:
The growing difficulty of reaching respondents has a general impact on non-response in telephone surveys, especially those that use random digit dialling (RDD), such as the General Social Survey (GSS). The GSS is an annual multipurpose survey with 25,000 respondents. Its aim is to monitor the characteristics of and major changes in Canada's social structure. GSS Cycle 21 (2007) was about the family, social support and retirement. Its target population consisted of persons aged 45 and over living in the 10 Canadian provinces. For more effective coverage, part of the sample was taken from a follow-up with the respondents of GSS Cycle 20 (2006), which was on family transitions. The remainder was a new RDD sample. In this paper, we describe the survey's sampling plan and the random digit dialling method used. Then we discuss the challenges of calculating the non-response rate in an RDD survey that targets a subset of a population, for which the in-scope population must be estimated or modelled. This is done primarily through the use of paradata. The methodology used in GSS Cycle 21 is presented in detail.
Release date: 2009-12-03
Reference (13)
Reference (13) (0 to 10 of 13 results)
- 1. Challenges and Lessons Learned with the Implementation of Car Chips in the Fuel Consumption Survey ArchivedSurveys and statistical programs – Documentation: 11-522-X201300014258Description:
The National Fuel Consumption Survey (FCS) was created in 2013 and is a quarterly survey that is designed to analyze distance driven and fuel consumption for passenger cars and other vehicles weighing less than 4,500 kilograms. The sampling frame consists of vehicles extracted from the vehicle registration files, which are maintained by provincial ministries. For collection, FCS uses car chips for a part of the sampled units to collect information about the trips and the fuel consumed. There are numerous advantages to using this new technology, for example, reduction in response burden, collection costs and effects on data quality. For the quarters in 2013, the sampled units were surveyed 95% via paper questionnaires and 5% with car chips, and in Q1 2014, 40% of sampled units were surveyed with car chips. This study outlines the methodology of the survey process, examines the advantages and challenges in processing and imputation for the two collection modes, presents some initial results and concludes with a summary of the lessons learned.
Release date: 2014-10-31 - Surveys and statistical programs – Documentation: 11-522-X201300014278Description:
In January and February 2014, Statistics Canada conducted a test aiming at measuring the effectiveness of different collection strategies using an online self-reporting survey. Sampled units were contacted using mailed introductory letters and asked to complete the online survey without any interviewer contact. The objectives of this test were to measure the take-up rates for completing an online survey, and to profile the respondents/non-respondents. Different samples and letters were tested to determine the relative effectiveness of the different approaches. The results of this project will be used to inform various social surveys that are preparing to include an internet response option in their surveys. The paper will present the general methodology of the test as well as results observed from collection and the analysis of profiles.
Release date: 2014-10-31 - Surveys and statistical programs – Documentation: 75F0002M1992002Description:
When a survey respondent is asked to recall various events, it is known that the quality of the responses diminishes as the length of recall increases. On the other hand, increasing the frequency of data collection increases both the costs of collection and the burden on the respondents. The paper examines options which attempt to strike a reasonable balance between these factors. As it relates to this decision, the paper also describes how the sample has been designed to ensure that it remains representative of the target population, both for a given year and over time.
The conclusion is that, at this time, SLID should collect labour data in January to cover the previous calendar year and to collect income data in May, again to cover the previous calendar year.
Release date: 2008-02-29 - Surveys and statistical programs – Documentation: 75F0002M2000005Description:
This paper describes the collection method and content of the 1999 Survey of Labour and Income Dynamics (SLID) income interview.
Release date: 2000-10-05 - Surveys and statistical programs – Documentation: 75F0002M1999003Description:
This document presents the questions, responses and interview flow for the Contact and Demographic portions of the Survey of Labour and Income Dynamics (SLID) interviews.
Release date: 1999-09-27 - 6. 1999 Preliminary Interview Questionnaire ArchivedSurveys and statistical programs – Documentation: 75F0002M1999004Description:
This paper presents the questions, possible responses and question flows for the 1999 Survey of Labour and Income Dynamics (SLID) preliminary questionnaire.
Release date: 1999-09-27 - 7. Survey of Labour and Income Dynamics (SLID) Labour Interview Questionnaire: January 1999 ArchivedSurveys and statistical programs – Documentation: 75F0002M1999005Description:
This paper outlines the structure of the January 1999 Survey of Labour and Income Dynamics (SLID) labour interview questionnaire, including question wording, possible responses, and flows of questions.
Release date: 1999-09-27 - Notices and consultations: 13F0026M1999004Description:
During September and October 1997, the Questionnaire Design Resource Centre (QDRC) completed 10 focus groups and 4 in-depth interviews with respondents and 6 debriefing sessions with interviewers in a test of the proposed questionnaires and data collection methodology for the 1998 Asset and Debt Survey (now called the Survey of Financial Security, to be done in 1999).
The main goals of the testing were: to evaluate the data collection methodology and survey instruments (including the introductory materials [guide] and questionnaires [Part 1: background information about family members, Part 2: questions on assets and debts]); to identify problem areas; to make recommendations to ensure that the final survey instruments are respondent-friendly and interview-friendly, that the questionnaires can be easily understood and accurately completed; and finally, to investigate how respondents recall information.
This report summarizes the highlights of the study, including the recommendations based on the findings of the focus groups, in-depth interviews and debriefing sessions, as well as those from the experience of the QDRC in carrying out similar studies for other household surveys.
Release date: 1999-03-23 - 9. Survey of Labour and Income Dynamics (SLID) Questionnaire for Demographics and Contacts: 1998 ArchivedSurveys and statistical programs – Documentation: 75F0002M1998002Description:
This document presents the questions, responses and interview flow for the Contact and Demographic portions of the Survey of Labour and Income Dynamics (SLID) interviews.
Release date: 1998-12-30 - 10. Survey of Labour and Income Dynamics (SLID) Labour Interview Questionnaire January 1998 ArchivedSurveys and statistical programs – Documentation: 75F0002M1998003Description:
This paper provides a written approximation of the 1998 Survey of Labour and Income Dynamics (SLID) labour interview questionnaire.
Release date: 1998-12-30
- Date modified: