How Low Can You Go? An Optimal Sampling Strategy for Fair Lending Exams
by Jason Dietrich
This study uses Monte Carlo simulation to examine the impact of nine sampling strategies on the finite sample performance of the maximum likelihood logit estimator. Empirical researchers face a tradeoff between the lower resource costs associated with smaller samples and the increased confidence in the results gained from larger samples. Choice of sampling strategy is one tool researchers can use to reduce costs yet still attain desired confidence levels. The nine sampling strategies examined in this study include simple random sampling and eight variations of stratified random sampling. Bias, mean-square-error, percentage of models that are feasibly estimated, and percentage of simulated estimates that differ statistically from the true population parameters are used as measures of finite sample performance.
The results show stratified random sampling by action (loan approval/denial) and race of the applicant, with balanced strata sizes and a bias correction for choice-based sampling, outperforms each of the other sampling strategies with respect to the four performance measures. These findings, taken together with supporting evidence presented in Scheuren and Sangha (1998) and Giles and Courchane (2000) make a strong argument for implementing such a sampling strategy in future fair lending exams.
As with all OCC Working Papers, the opinions expressed in this paper are those of the author alone, and do not necessarily reflect the views of the Office of the Comptroller of the Currency or the Department of the Treasury.
Any whole or partial reproduction of material in this paper should include the following citation: Jason Dietrich " How Low Can You Go? An Optimal Sampling Strategy for Fair Lending Exams, " Office of the Comptroller of the Currency, E&PA Working Paper 2001-3, August 2001.