Survey data collection represents a significant expenditure for the federal government. Ten federal statistical agencies alone spent more than $1.3 billion on surveys in 2004. Many of these government-funded survey research projects are essential for advancing scientific knowledge about the health of the United States population; examples include the National Health Interview Study (NHIS), the National Survey of Family Growth (NSFG), the National Survey of Drug Use and Health (NSDUH), and the Health and Retirement Study (HRS). Hundreds of smaller government-funded research projects in the health sciences also rely on survey data collection. Unfortunately, government resources available for continuing and improving these surveys are becoming scarcer, making it essential that researchers from the wide range of disciplines that collect survey data, and especially the health sciences, are using these federal resources efficiently. Growing nonresponse and increasing reliance on less expensive modes of data collection have made planning surveys more difficult, and the great deal of uncertainty associated with survey data collection makes it difficult to efficiently minimize survey errors and survey costs. In response to these problems, survey methodologists have developed a conceptual framework for survey data collection known as responsive survey design (RSD), which is a principled, scientific method for decreasing survey errors and survey costs. Many survey projects, including the surveys mentioned above, are now saving money and better maximizing available resources by taking advantage of RSD concepts.
Unfortunately, the analytic techniques used to implement RSDs to date have been extremely simplistic, and no coherent analytic frameworks for RSD have been proposed in the RSD literature. The Bayesian analysis framework represents a natural fit for RSDs, given its ability to update prior beliefs about uncertain parameters and outcomes using current information. Surprisingly, this framework has not yet been applied in a rigorous fashion to the RSD practices that are often used in health survey research. The Bayesian approach provides a framework for taking advantage of prior information to develop the accurate predictions needed to make RSD function as efficiently as possible. Given that the application of RSD to existing federal data collections has increased cost efficiency by up to 25%, even greater gains in efficiency may be possible by using Bayesian methods to improve the accuracy of predicted data collection outcomes. Combining simulation work and analyses of real health survey data, the proposed research project aims to 1) elicit reasonable prior distributions for the parameters in response propensity models that form the core of many RSD decisions, 2) experimentally evaluate the effectiveness of Bayesian methods in informing adaptive interventions in an RSD framework, and 3) use Bayesian methods to optimize two-phase sampling decisions in a way that minimizes costs and maximizes the quality of survey estimates.
Funding:
Health and Human Services, Department of-National Institutes of Health
Funding Period:
05/01/2018 to 04/30/2022