The Jackknife and Bootstrap in Biomedical Research—Common Principles and Possible Pitfalls

Abstract

This article briefly reviews the basic principles of two resampling techniques, namely the jackknife and the bootstrap. Small examples are given to address possible failures of these methods. Their application is finally illustrated by two substantial problems, that is, the estimation of a common odds ratio in stratified contingency table analysis and the statistical evaluation of individual bioequivalence. The former is used to demonstrate the benefit of the jackknife in terms of bias reduction and the latter to exhibit the sensitivity of the bootstrap to minor changes in the bootstrap algorithm.

Keywords

Bioequivalence Bootstrap Jackknife Odds ratio

References

Quenouille

Approximate tests of correlation in time series. J Roy Stat Soc B. 1949;11:68–84.

Quenouille

Notes on bias in estimation. Biometrika. 1956;43:353–360.

Tukey

Bias and confidence in not quite large samples (Abstract). Ann Math Stat. 1958;29:614.

Gray

Schucany

The Generalized Jackknife Statistic. New York, NY: Marcel Dekker; 1972.

Efron

Tibshirani

An Introduction to the Bootstrap. New York, NY: Chapman & Hall; 1993.

Efron

Bootstrap methods: Another look at the jackknife. Ann Stat. 1979;7:1–26.

Chernick

Bootstrap Methods: A Practitioner's Guide. New York, NY: Wiley & Sons; 1999.

Davison

Hinkley

Bootstrap Methods and their Application. New York, NY: Cambridge University Press; 1997.

Shao

The Jackknife and Bootstrap. New York, NY: Springer; 1995.

10.

Tibshirani

Bootstrapping computations. In: Proceedings of the SAS Users Group Conference. Reno, NV; 1985.

11.

Mooney

Bootstrapping: A Non-parametric Approach to Statistical Inference. London, UK: Sage; 1993.

12.

Westfall

Simultaneous small-sample multivariate Bernoulli confidence intervals. Biometrics. 1985;41:1001–1013.

13.

Westfall

Young

P value adjustments for multiple tests in multivariate binomial models. J Am Stat Assoc. 1989;84:780–786.

14.

Westfall

Young

Resampling-Based Multiple Testing. New York, NY: Wiley & Sons; 1993.

15.

Mantel

Haenszel

Statistical aspects of the analysis of data from retrospective studies of disease. J Nat Can Inst. 1959;22:719–748.

16.

Breslow

Liang

The variance of the Mantel-Haenszel estimator. Biometrics. 1982;38:943–952.

17.

Pigeot

A jackknife estimator of a combined odds ratio. Biometrics. 1991;47:373–381.

18.

Pigeot

Asymptotic properties of several jackknife estimators of a common odds ratio. J Appl Stat Sci. 1995;2:45–59.

19.

Pigeot

A simulation study of estimators of a common odds ratio in several 2 times 2 tables. J Stat Comput Simul. 1991;38:65–82.

20.

Shao

Kübler

Pigeot

Consistency of the bootstrap procedure in individual bioequivalence. Biometrika. 2000;87:573–585.

21.

Schall

Luus

On population and individual bioequivalence. Stat Med. 1993;12:1109–1124.

22.

Food and Drug Administration. Guidance for Industry, Center for Drug Evaluation and Research, In Vivo Bioequivalence Studies Based on Population and Individual Bioequivalence Approaches. Draft. Rockville, MD; Food and Drug Administration; October 1997.

23.

Carpenter

Bithell

Bootstrap confidence intervals: When, which, what? A practical guide for medical statisticians. Stat Med. 2000;19:1141–1164.

24.

Shao

CFJ

A general theory for jackknife variance estimation. Ann Stat. 1989;17:1176–1197.

25.

Shao

Consistency of jackknife variance estimators. Statistics. 1991;22:49–57.