Replicate Weights in the Current Population Survey
Go Back to IPUMSCPS Documentation
Summary
 What are replicate weights?
 Why might I want to use replicate weights?
 Does using replicate weights make any substantive difference?
 How do I obtain replicate standard errors from ASEC IPUMSCPS data?
 Is there any way to do this automatically in major statistical packages?
 Can I simply divide the full sample into 160 random subsamples from the full sample and calculate replicate standard errors manually?
 How are the CPS replicate weights calculated?
What are replicate weights?
Replicate weights are currently available for the 2005Onward Annual Social and Economic Supplement (ASEC) to the Current Population Survey. In the CPS, there are 160 separate weights at the household and person levels that allow users to generate empirically derived standard error estimates. These standard errors can then be used in hypothesis testing and in the construction of confidence intervals around the sample estimate of interest.
Why might I want to use replicate weights?
In theory, the standard error of an estimate measures the variation of a statistic across multiple samples of a given population. Thus the true standard error of any characteristic calculated from a single sample can never be known with certainty; sample standard errors are simply estimated. Replicate weights allow a single sample to simulate multiple samples, thus generating more informed standard error estimates that mimic the theoretical basis of standard errors while retaining all information about the complex sample design. These standard errors can then be used to obtain more precise confidence intervals and significance test.
Does using replicate weights make any substantive difference?
In IPUMS testing of CPS data, replicate weights usually increase standard errors. This increase is generally not large enough to alter the significance level of coefficients, though marginally significant coefficients may become clearly nonsignificant. The more obvious effect of using replicate weights is on the width of confidence intervals, which can change substantially.
How do I obtain replicate standard errors from IPUMSCPS data?
There are 3 main steps:
 Run your analysis using the fullsample weights for ASEC (WTSUPP and HWTSUPP are the main CPS ASEC weights). Record the statistic you are interested in (e.g., the mean income of veterans, or the coefficient describing the relationship between income and whether one has health insurance coverage).
 Run your analysis again using each set of replicate weights. First, run the analysis using REPWTP1, then again using REPWTP2, then again using REPWTP3, and so on up to the final set of replicate weights. After each set, record the statistic you are interested in. (N.B.: If you are analyzing a householdonly file, be sure to use REPWT1, REPWT2, etc.)

Insert the above results into the following formula:
where X is the result from the analysis using the fullsample weight and Xr is the result from the analysis using the rth set of replicate weights.
Is there any way to do this automatically in major statistical packages?
Yes. Although the replicate standard errors contained in the IPUMSCPS data are calculated using the a combination of the successive difference replication and modified halfsample methods, which are different from the types of replicate weights that most statistical software packages can handle, Stata can process IPUMSCPS replicate weights automatically as of version 11.1 (released June 3, 2010).
To use IPUMSCPS replicate weights in Stata, you must first svyset
the data.
. svyset [iw=wtsupp], sdrweight(repwtp1repwtp160) vce(sdr) mse
 The sample should be treated as a single stratum (the weights contain the relevant information from the sample design), so no PSU should be specified.
 The fullsample weight must be specified; some replicate weights in the CPS are negative, which is why
iweight
s are specified instead ofpweight
s.  You then specify the replicate weights in the
sdrweight()
option. Note that specifying the variable list with a wildcard character (repwtp*
) rather than with a range of variables (repwtp1repwtp160
) will not produce correct results because IPUMSCPS data contain a variable called REPWTP, which merely indicates the presence of replicate weights and is coded 1 for every case. Thefpc()
suboption should not be specified.  You must also specify the
vce(sdr)
option.
Earlier versions of Stata can also handle successive difference replicate weights. Correspondence with StataCorp statisticians and IPUMS testing revealed that successive difference replicate weights can be treated as jackknife replicate weights if the options are specified correctly.
The svyset
command for Stata versions 11.0 and before is slightly different:
. svyset [iw=wtsupp], jkrweight(repwtp1repwtp160, multiplier(.025)) ///
vce(jackknife) mse
 As above, the sample should be treated as a single stratum (the weights contain the relevant information from the sample design), so no PSU should be specified.
 Also as above, the fullsample weight must be specified; some replicate weights in the CPS are negative, which is why
iweight
s are specified instead ofpweight
s.  You then specify the replicate weights in the
jkrw()
option. Note that specifying the variable list with a wildcard character (repwtp*
) rather than with a range of variables (repwtp1repwtp160
) will not produce correct results because IPUMSCPS data contain a variable called REPWTP, which merely indicates the presence of replicate weights and is coded 1 for every case. The
multiplier()
suboption gives the quotient from the above formula (4/160 = 0.025). If you are not using CPS data and have a different number of replicate weights, you will need to adjust the multiplier accordingly.  Neither the
stratum()
nor thefpc()
suboptions should be specified.
 The
 You must also specify the
vce(jack)
andmse
options.
After svyset
ting the data, you run the command using the svy:
prefix, which passes along the options you defined above.
. svy: command
Stata will execute this command using the fullsample weights and again for each set of replicate weights. There are two important things to note:
 Not all Stata commands can be run with the
svy:
prefix. Type. help svy_estimation
to see a list of valid commands. 
If you want to limit your replicate analyses to a subset of the sample (for example, all persons aged 2564 or all African Americans), you should not use
if
orin
. Instead, use thesubpop()
option before the colon, as in. gen byte age25_64 = age>=25 & age<=64 . svy, subpop(age25_64): command
Note that you must first define the subpopulation with a dichotomous variable coded 0 for all cases that should be excluded from the analysis. See this page for a helpful discussion of
subpop()
nuances.
As of March 2010, SAS (version 9.2) and PASW/SPSS (version 18.0) cannot handle successive difference replicate weights. SPSS does not allow for replicatebased variance estimation unless it performs the resampling itself, and SAS's jackknife procedure (available in PROC SURVEYREG and related statements) does not contain the options needed to mimic the above formula. See the Census Bureau's "Estimating ASEC Variances with Replicate Weights" document for sample SAS code that can be adapted to calculate replicate standard errors manually.
Can I simply divide the full sample into 160 random subsamples from the full sample and calculate replicate standard errors manually?
No. Replicate weights contain full information about the complex sample design of the CPS, and this information would be lost when drawing random subsamples. Furthermore, replicate samples incorporate information from all cases in the full sample. In contrast, random subsamples would each be 1/160th the size of a single replicate subsample.
How are the CPS replicate weights calculated?
As mentioned, replicate weights in the CPS are constructed using the successive difference replication method (for cases in selfrepresenting strata) and the modified halfsample technique (for cases in nonselfrepresenting strata). Both involve creating a k x k Hadamard matrix (where k is the number of replicate weights desired), assigning sample cases to rows in the matrix and calculating a replicate factor from the row values, and finally multiplying the fullsample weight by these replicate factors. The replicate samples then undergo the same weighting procedures as the full sampleadjustments for noninterivews, oversampling, and the like. For more details, see the Census Bureau's "Estimating ASEC Variances with Replicate Weights" document as well as the following:
 Fay, Robert, and George Train. 1995. "Aspects of Survey and ModelBased Postcensal Estimation of Income and Poverty Characteristics for States and Counties." Proceedings of the Section on Government Statistics, American Statistical Association, Alexandria, VA, pp. 154159. (pdf)
 Wolter, Kirk. 2007. Introduction to Variance Estimation, 2nd ed. New York: Springer. See Chapter 3.