Quality assurance
Filter results by
Search HelpKeyword(s)
Type
Survey or statistical program
Results
All (27)
All (27) (0 to 10 of 27 results)
- Surveys and statistical programs – Documentation: 11-522-X201700014726Description:
Internal migration is one of the components of population growth estimated at Statistics Canada. It is estimated by comparing individuals’ addresses at the beginning and end of a given period. The Canada Child Tax Benefit and T1 Family File are the primary data sources used. Address quality and coverage of more mobile subpopulations are crucial to producing high-quality estimates. The purpose of this article is to present the results of evaluations of these elements using access to more tax data sources at Statistics Canada.
Release date: 2016-03-24 - Articles and reports: 11-522-X201700014743Description:
Probabilistic linkage is susceptible to linkage errors such as false positives and false negatives. In many cases, these errors may be reliably measured through clerical-reviews, i.e. the visual inspection of a sample of record pairs to determine if they are matched. A framework is described to effectively carry-out such clerical-reviews based on a probabilistic sample of pairs, repeated independent reviews of the same pairs and latent class analysis to account for clerical errors.
Release date: 2016-03-24 - Articles and reports: 82-003-X201501114243Description:
A surveillance tool was developed to assess dietary intake collected by surveys in relation to Eating Well with Canada’s Food Guide (CFG). The tool classifies foods in the Canadian Nutrient File (CNF) according to how closely they reflect CFG. This article describes the validation exercise conducted to ensure that CNF foods determined to be “in line with CFG” were appropriately classified.
Release date: 2015-11-18 - Articles and reports: 11-522-X201300014288Description:
Probability-based surveys, those including with samples selected through a known randomization mechanism, are considered by many to be the gold standard in contrast to non-probability samples. Probability sampling theory was first developed in the early 1930’s and continues today to justify the estimation of population values from these data. Conversely, studies using non-probability samples have gained attention in recent years but they are not new. Touted as cheaper, faster (even better) than probability designs, these surveys capture participants through various “on the ground” methods (e.g., opt-in web survey). But, which type of survey is better? This paper is the first in a series on the quest for a quality framework under which all surveys, probability- and non-probability-based, may be measured on a more equal footing. First, we highlight a few frameworks currently in use, noting that “better” is almost always relative to a survey’s fit for purpose. Next, we focus on the question of validity, particularly external validity when population estimates are desired. Estimation techniques used to date for non-probability surveys are reviewed, along with a few comparative studies of these estimates against those from a probability-based sample. Finally, the next research steps in the quest are described, followed by a few parting comments.
Release date: 2014-10-31 - Articles and reports: 82-003-X201100111404Geography: CanadaDescription:
This study assesses three child-reported parenting behaviour scales (nurturance, rejection and monitoring) in the National Longitudinal Survey of Children and Youth.
Release date: 2011-02-16 - Surveys and statistical programs – Documentation: 62F0026M2010004Description:
This report describes the quality indicators produced for the 2007 Survey of Household Spending. These quality indicators, such as coefficients of variation, nonresponse rates, slippage rates and imputation rates, help users interpret the survey data.
Release date: 2010-12-13 - Articles and reports: 11-522-X200800010968Description:
Statistics Canada has embarked on a program of increasing and improving the usage of imaging technology for paper survey questionnaires. The goal is to make the process an efficient, reliable and cost effective method of capturing survey data. The objective is to continue using Optical Character Recognition (OCR) to capture the data from questionnaires, documents and faxes received whilst improving the process integration and Quality Assurance/Quality Control (QC) of the data capture process. These improvements are discussed in this paper.
Release date: 2009-12-03 - Surveys and statistical programs – Documentation: 75F0002M2008005Description:
The Survey of Labour and Income Dynamics (SLID) is a longitudinal survey initiated in 1993. The survey was designed to measure changes in the economic well-being of Canadians as well as the factors affecting these changes. Sample surveys are subject to sampling errors. In order to consider these errors, each estimates presented in the "Income Trends in Canada" series comes with a quality indicator based on the coefficient of variation. However, other factors must also be considered to make sure data are properly used. Statistics Canada puts considerable time and effort to control errors at every stage of the survey and to maximise the fitness for use. Nevertheless, the survey design and the data processing could restrict the fitness for use. It is the policy at Statistics Canada to furnish users with measures of data quality so that the user is able to interpret the data properly. This report summarizes the set of quality measures of SLID data. Among the measures included in the report are sample composition and attrition rates, sampling errors, coverage errors in the form of slippage rates, response rates, tax permission and tax linkage rates, and imputation rates.
Release date: 2008-08-20 - 9. Exploring the impact of mode on key health estimates in the National Health Interview Survey ArchivedArticles and reports: 11-522-X200600110421Description:
In an effort to increase response rates and decrease costs, many survey operations have begun to use several modes to collect relevant data. While the National Health Interview Survey (NHIS), a multipurpose household health survey conducted annually by the National Center for Health Statistics, Centers for Disease Control and Prevention, is primarily a face-to-face survey, interviewers also rely on the telephone to complete some interviews. This has raised questions about the quality of resulting data. To address these questions, data from the 2005 NHIS are used to analyze the impact of mode on eight key health indicators.
Release date: 2008-03-17 - 10. Exploring the impact of participant reluctance on data quality in the National Health Interview Survey (NHIS) ArchivedArticles and reports: 11-522-X200600110450Description:
Using survey and contact attempt history data collected with the 2005 National Health Interview Survey (NHIS), a multi-purpose health survey conducted by the National Center for Health Statistics (NCHS), Centers for Disease Control and Prevention (CDC), we set out to explore the impact of participant concerns/reluctance on data quality, as measured by rates of partially complete interviews and item nonresponse. Overall, results show that respondents from households where some type of concern or reluctance (e.g., "too busy," "not interested") was expressed produced higher rates of partially complete interviews and item nonresponse than respondents from households where concern/reluctance was not expressed. Differences by type of concern were also identified.
Release date: 2008-03-17
Data (0)
Data (0) (0 results)
No content available at this time.
Analysis (14)
Analysis (14) (0 to 10 of 14 results)
- Articles and reports: 11-522-X201700014743Description:
Probabilistic linkage is susceptible to linkage errors such as false positives and false negatives. In many cases, these errors may be reliably measured through clerical-reviews, i.e. the visual inspection of a sample of record pairs to determine if they are matched. A framework is described to effectively carry-out such clerical-reviews based on a probabilistic sample of pairs, repeated independent reviews of the same pairs and latent class analysis to account for clerical errors.
Release date: 2016-03-24 - Articles and reports: 82-003-X201501114243Description:
A surveillance tool was developed to assess dietary intake collected by surveys in relation to Eating Well with Canada’s Food Guide (CFG). The tool classifies foods in the Canadian Nutrient File (CNF) according to how closely they reflect CFG. This article describes the validation exercise conducted to ensure that CNF foods determined to be “in line with CFG” were appropriately classified.
Release date: 2015-11-18 - Articles and reports: 11-522-X201300014288Description:
Probability-based surveys, those including with samples selected through a known randomization mechanism, are considered by many to be the gold standard in contrast to non-probability samples. Probability sampling theory was first developed in the early 1930’s and continues today to justify the estimation of population values from these data. Conversely, studies using non-probability samples have gained attention in recent years but they are not new. Touted as cheaper, faster (even better) than probability designs, these surveys capture participants through various “on the ground” methods (e.g., opt-in web survey). But, which type of survey is better? This paper is the first in a series on the quest for a quality framework under which all surveys, probability- and non-probability-based, may be measured on a more equal footing. First, we highlight a few frameworks currently in use, noting that “better” is almost always relative to a survey’s fit for purpose. Next, we focus on the question of validity, particularly external validity when population estimates are desired. Estimation techniques used to date for non-probability surveys are reviewed, along with a few comparative studies of these estimates against those from a probability-based sample. Finally, the next research steps in the quest are described, followed by a few parting comments.
Release date: 2014-10-31 - Articles and reports: 82-003-X201100111404Geography: CanadaDescription:
This study assesses three child-reported parenting behaviour scales (nurturance, rejection and monitoring) in the National Longitudinal Survey of Children and Youth.
Release date: 2011-02-16 - Articles and reports: 11-522-X200800010968Description:
Statistics Canada has embarked on a program of increasing and improving the usage of imaging technology for paper survey questionnaires. The goal is to make the process an efficient, reliable and cost effective method of capturing survey data. The objective is to continue using Optical Character Recognition (OCR) to capture the data from questionnaires, documents and faxes received whilst improving the process integration and Quality Assurance/Quality Control (QC) of the data capture process. These improvements are discussed in this paper.
Release date: 2009-12-03 - 6. Exploring the impact of mode on key health estimates in the National Health Interview Survey ArchivedArticles and reports: 11-522-X200600110421Description:
In an effort to increase response rates and decrease costs, many survey operations have begun to use several modes to collect relevant data. While the National Health Interview Survey (NHIS), a multipurpose household health survey conducted annually by the National Center for Health Statistics, Centers for Disease Control and Prevention, is primarily a face-to-face survey, interviewers also rely on the telephone to complete some interviews. This has raised questions about the quality of resulting data. To address these questions, data from the 2005 NHIS are used to analyze the impact of mode on eight key health indicators.
Release date: 2008-03-17 - Articles and reports: 11-522-X200600110450Description:
Using survey and contact attempt history data collected with the 2005 National Health Interview Survey (NHIS), a multi-purpose health survey conducted by the National Center for Health Statistics (NCHS), Centers for Disease Control and Prevention (CDC), we set out to explore the impact of participant concerns/reluctance on data quality, as measured by rates of partially complete interviews and item nonresponse. Overall, results show that respondents from households where some type of concern or reluctance (e.g., "too busy," "not interested") was expressed produced higher rates of partially complete interviews and item nonresponse than respondents from households where concern/reluctance was not expressed. Differences by type of concern were also identified.
Release date: 2008-03-17 - Articles and reports: 75F0002M2007003Description:
The Survey of Labour and Income Dynamics (SLID) is a longitudinal survey initiated in 1993. The survey was designed to measure changes in the economic well-being of Canadians as well as the factors affecting these changes.
Sample surveys are subject to errors. As with all surveys conducted at Statistics Canada, considerable time and effort is taken to control such errors at every stage of the Survey of Labour and Income Dynamics. Nonetheless errors do occur. It is the policy at Statistics Canada to furnish users with measures of data quality so that the user is able to interpret the data properly. This report summarizes a set of quality measures that has been produced in an attempt to describe the overall quality of SLID data. Among the measures included in the report are sample composition and attrition rates, sampling errors, coverage errors in the form of slippage rates, response rates, tax permission and tax linkage rates, and imputation rates.
Release date: 2007-05-10 - 9. Growth models: an interesting approach to study the evolution of the health status of the elderly ArchivedArticles and reports: 11-522-X20050019491Geography: CanadaDescription:
Evaluating the impact of changes to services on the health status of frail elderly adults calls for longitudinal studies. Many subjects are however lost during follow-up because of the high incidence of death in this population. Traditional methods of repeated measures analysis are thus inappropriate since they ignore subjects with incomplete follow-up data. This leads to a considerable reduction in sample size and to biases.
Release date: 2007-03-02 - Articles and reports: 75F0002M2006005Description:
The Survey of Labour and Income Dynamics (SLID) is a longitudinal survey initiated in 1993. The survey was designed to measure changes in the economic well-being of Canadians as well as the factors affecting these changes.
Sample surveys are subject to errors. As with all surveys conducted at Statistics Canada, considerable time and effort is taken to control such errors at every stage of the Survey of Labour and Income Dynamics. Nonetheless errors do occur. It is the policy at Statistics Canada to furnish users with measures of data quality so that the user is able to interpret the data properly. This report summarizes a set of quality measures that has been produced in an attempt to describe the overall quality of SLID data. Among the measures included in the report are sample composition and attrition rates, sampling errors, coverage errors in the form of slippage rates, response rates, tax permission and tax linkage rates, and imputation rates.
Release date: 2006-04-06
Reference (13)
Reference (13) (0 to 10 of 13 results)
- Surveys and statistical programs – Documentation: 11-522-X201700014726Description:
Internal migration is one of the components of population growth estimated at Statistics Canada. It is estimated by comparing individuals’ addresses at the beginning and end of a given period. The Canada Child Tax Benefit and T1 Family File are the primary data sources used. Address quality and coverage of more mobile subpopulations are crucial to producing high-quality estimates. The purpose of this article is to present the results of evaluations of these elements using access to more tax data sources at Statistics Canada.
Release date: 2016-03-24 - Surveys and statistical programs – Documentation: 62F0026M2010004Description:
This report describes the quality indicators produced for the 2007 Survey of Household Spending. These quality indicators, such as coefficients of variation, nonresponse rates, slippage rates and imputation rates, help users interpret the survey data.
Release date: 2010-12-13 - Surveys and statistical programs – Documentation: 75F0002M2008005Description:
The Survey of Labour and Income Dynamics (SLID) is a longitudinal survey initiated in 1993. The survey was designed to measure changes in the economic well-being of Canadians as well as the factors affecting these changes. Sample surveys are subject to sampling errors. In order to consider these errors, each estimates presented in the "Income Trends in Canada" series comes with a quality indicator based on the coefficient of variation. However, other factors must also be considered to make sure data are properly used. Statistics Canada puts considerable time and effort to control errors at every stage of the survey and to maximise the fitness for use. Nevertheless, the survey design and the data processing could restrict the fitness for use. It is the policy at Statistics Canada to furnish users with measures of data quality so that the user is able to interpret the data properly. This report summarizes the set of quality measures of SLID data. Among the measures included in the report are sample composition and attrition rates, sampling errors, coverage errors in the form of slippage rates, response rates, tax permission and tax linkage rates, and imputation rates.
Release date: 2008-08-20 - Surveys and statistical programs – Documentation: 62F0026M2004001Description:
This report describes the quality indicators produced for the 2002 Survey of Household Spending. These quality indicators, such as coefficients of variation, nonresponse rates, slippage rates and imputation rates, help users interpret the survey data.
Release date: 2004-09-15 - Surveys and statistical programs – Documentation: 62F0026M2002001Description:
This report describes the quality indicators produced for the 2000 Survey of Household Spending. It covers the usual quality indicators that help users interpret the data, such as coefficients of variation, non-response rates, slippage rates and imputation rates.
Release date: 2002-06-28 - 6. Combining census, survey, demographic and administrative data to produce a one number census ArchivedSurveys and statistical programs – Documentation: 11-522-X19990015638Description:
The focus of Symposium'99 is on techniques and methods for combining data from different sources and on analysis of the resulting data sets. In this talk we illustrate the usefulness of taking such an "integrating" approach when tackling a complex statistical problem. The problem itself is easily described - it is how to approximate, as closely as possible, a "perfect census", and in particular, how to obtain census counts that are "free" of underenumeration. Typically, underenumeration is estimated by carrying out a post enumeration survey (PES) following the census. In the UK in 1991 the PEF failed to identify the full size of the underenumeration and so demographic methods were used to estimate the extent of the undercount. The problems with the "traditional" PES approach in 1991 resulted in a joint research project between the Office for National Statistics and the Department of Social Statistics at the University of Southampton aimed at developing a methodology which will allow a "One Number Census" in the UK in 2001. That is, underenumeration will be accounted for not just at high levels of aggregation, but right down to the lowest levels at which census tabulations are produced. In this way all census outputs will be internally consistent, adding to the national population estimates. The basis of this methodology is the integration of information from a number of data sources in order to achieve this "One Number".
Release date: 2000-03-02 - 7. Particulate matter and daily mortality: Combining time series information from eight U.S. cities ArchivedSurveys and statistical programs – Documentation: 11-522-X19990015656Description:
Time series studies have shown associations between air pollution concentrations and morbidity and mortality. These studies have largely been conducted within single cities, and with varying methods. Critics of these studies have questioned the validity of the data sets used and the statistical techniques applied to them; the critics have noted inconsistencies in findings among studies and even in independent re-analyses of data from the same city. In this paper we review some of the statistical methods used to analyze a subset of a national data base of air pollution, mortality and weather assembled during the National Morbidity and Mortality Air Pollution Study (NMMAPS).
Release date: 2000-03-02 - Surveys and statistical programs – Documentation: 11-522-X19990015682Description:
The application of dual system estimation (DSE) to matched Census / Post Enumeration Survey (PES) data in order to measure net undercount is well understood (Hogan, 1993). However, this approach has so far not been used to measure net undercount in the UK. The 2001 PES in the UK will use this methodology. This paper presents the general approach to design and estimation for this PES (the 2001 Census Coverage Survey). The estimation combines DSE with standard ratio and regression estimation. A simulation study using census data from the 1991 Census of England and Wales demonstrates that the ratio model is in general more robust than the regression model.
Release date: 2000-03-02 - 9. Simultaneous calibration of several surveys ArchivedSurveys and statistical programs – Documentation: 11-522-X19990015684Description:
Often, the same information is gathered almost simultaneously for several different surveys. In France, this practice is institutionalized for household surveys that have a common set of demographic variables, i.e., employment, residence and income. These variables are important co-factors for the variables of interest in each survey, and if used carefully, can reinforce the estimates derived from each survey. Techniques for calibrating uncertain data can apply naturally in this context. This involves finding the best unbiased estimator in common variables and calibrating each survey based on that estimator. The estimator thus obtained in each survey is always a linear estimator, the weightings of which can be easily explained and the variance can be obtained with no new problems, as can the variance estimate. To supplement the list of regression estimators, this technique can also be seen as a ridge-regression estimator, or as a Bayesian-regression estimator.
Release date: 2000-03-02 - Surveys and statistical programs – Documentation: 11-522-X19990015690Description:
The artificial sample was generated in two steps. The first step, based on a master panel, was a Multiple Correspondence Analysis (MCA) carried out on basic variables. Then, "dummy" individuals were generated randomly using the distribution of each "significant" factor in the analysis. Finally, for each individual, a value was generated for each basic variable most closely linked to one of the previous factors. This method ensured that sets of variables were drawn independently. The second step consisted in grafting some other data bases, based on certain property requirements. A variable was generated to be added on the basis of its estimated distribution, using a generalized linear model for common variables and those already added. The same procedure was then used to graft the other samples. This method was applied to the generation of an artificial sample taken from two surveys. The artificial sample that was generated was validated using sample comparison testing. The results were positive, demonstrating the feasibility of this method.
Release date: 2000-03-02
- Date modified: