Testing for treatment effect in the presence of regression toward the mean

Varghese George, William D. Johnson, Aditi Shahane, Todd G. Nick

Research output: Contribution to journalArticle

7 Citations (Scopus)

Abstract

We are often faced with the statistical problem of evaluating the effect of a treatment in the extreme of a population. This requires taking measurements on truncated random variables and, hence, it becomes necessary to take proper account of the effect of regression toward the mean. The usual statistical procedures are inappropriate for testing treatment effect in the presence of regression toward the mean. Likelihood ratio and score tests based on truncated distributions should provide valid statistical inferences in these situations. We conducted simulation studies to investigate the properties of these methods and found that the likelihood ratio test performs well even when the sample size is moderate, whereas the score test does not seem to control the nominal significance level. We compared the likelihood ratio test to a regression-based t-test, assuming the mean of the baseline distribution to be known, and found the likelihood ratio test more powerful. In the case where the baseline mean is unknown, we also investigated Wald's test and compared it with the likelihood ratio test and score test with respect to validity and power using simulation. Wald's test and the score test do not control the nominal significance level unless the sample size is extremely large. Overall, the likelihood ratio test has the best performance among all the methods studied. The proposed likelihood ratio test is illustrated using an example of a cholesterol study.

Original languageEnglish (US)
Pages (from-to)49-59
Number of pages11
JournalBiometrics
Volume53
Issue number1
DOIs
StatePublished - Mar 1997

Fingerprint

Treatment Effects
Likelihood Ratio Test
Regression
Score Test
Sample Size
Testing
Cholesterol
Random variables
testing
Wald Test
Significance level
Categorical or nominal
Baseline
Truncated Distributions
t-test
Population
Statistical Inference
Extremes
Random variable
Simulation Study

Keywords

  • Empirical type I error
  • Likelihood ratio test
  • Power
  • Regression toward the mean
  • Score test
  • Test for treatment effect
  • Truncated distributions
  • Wald's test

ASJC Scopus subject areas

  • Statistics and Probability
  • Biochemistry, Genetics and Molecular Biology(all)
  • Immunology and Microbiology(all)
  • Agricultural and Biological Sciences(all)
  • Applied Mathematics

Cite this

Testing for treatment effect in the presence of regression toward the mean. / George, Varghese; Johnson, William D.; Shahane, Aditi; Nick, Todd G.

In: Biometrics, Vol. 53, No. 1, 03.1997, p. 49-59.

Research output: Contribution to journalArticle

George, Varghese ; Johnson, William D. ; Shahane, Aditi ; Nick, Todd G. / Testing for treatment effect in the presence of regression toward the mean. In: Biometrics. 1997 ; Vol. 53, No. 1. pp. 49-59.
@article{e9836a5a72ab496c80aeb98517561eb8,
title = "Testing for treatment effect in the presence of regression toward the mean",
abstract = "We are often faced with the statistical problem of evaluating the effect of a treatment in the extreme of a population. This requires taking measurements on truncated random variables and, hence, it becomes necessary to take proper account of the effect of regression toward the mean. The usual statistical procedures are inappropriate for testing treatment effect in the presence of regression toward the mean. Likelihood ratio and score tests based on truncated distributions should provide valid statistical inferences in these situations. We conducted simulation studies to investigate the properties of these methods and found that the likelihood ratio test performs well even when the sample size is moderate, whereas the score test does not seem to control the nominal significance level. We compared the likelihood ratio test to a regression-based t-test, assuming the mean of the baseline distribution to be known, and found the likelihood ratio test more powerful. In the case where the baseline mean is unknown, we also investigated Wald's test and compared it with the likelihood ratio test and score test with respect to validity and power using simulation. Wald's test and the score test do not control the nominal significance level unless the sample size is extremely large. Overall, the likelihood ratio test has the best performance among all the methods studied. The proposed likelihood ratio test is illustrated using an example of a cholesterol study.",
keywords = "Empirical type I error, Likelihood ratio test, Power, Regression toward the mean, Score test, Test for treatment effect, Truncated distributions, Wald's test",
author = "Varghese George and Johnson, {William D.} and Aditi Shahane and Nick, {Todd G.}",
year = "1997",
month = "3",
doi = "10.2307/2533096",
language = "English (US)",
volume = "53",
pages = "49--59",
journal = "Biometrics",
issn = "0006-341X",
publisher = "Wiley-Blackwell",
number = "1",

}

TY - JOUR

T1 - Testing for treatment effect in the presence of regression toward the mean

AU - George, Varghese

AU - Johnson, William D.

AU - Shahane, Aditi

AU - Nick, Todd G.

PY - 1997/3

Y1 - 1997/3

N2 - We are often faced with the statistical problem of evaluating the effect of a treatment in the extreme of a population. This requires taking measurements on truncated random variables and, hence, it becomes necessary to take proper account of the effect of regression toward the mean. The usual statistical procedures are inappropriate for testing treatment effect in the presence of regression toward the mean. Likelihood ratio and score tests based on truncated distributions should provide valid statistical inferences in these situations. We conducted simulation studies to investigate the properties of these methods and found that the likelihood ratio test performs well even when the sample size is moderate, whereas the score test does not seem to control the nominal significance level. We compared the likelihood ratio test to a regression-based t-test, assuming the mean of the baseline distribution to be known, and found the likelihood ratio test more powerful. In the case where the baseline mean is unknown, we also investigated Wald's test and compared it with the likelihood ratio test and score test with respect to validity and power using simulation. Wald's test and the score test do not control the nominal significance level unless the sample size is extremely large. Overall, the likelihood ratio test has the best performance among all the methods studied. The proposed likelihood ratio test is illustrated using an example of a cholesterol study.

AB - We are often faced with the statistical problem of evaluating the effect of a treatment in the extreme of a population. This requires taking measurements on truncated random variables and, hence, it becomes necessary to take proper account of the effect of regression toward the mean. The usual statistical procedures are inappropriate for testing treatment effect in the presence of regression toward the mean. Likelihood ratio and score tests based on truncated distributions should provide valid statistical inferences in these situations. We conducted simulation studies to investigate the properties of these methods and found that the likelihood ratio test performs well even when the sample size is moderate, whereas the score test does not seem to control the nominal significance level. We compared the likelihood ratio test to a regression-based t-test, assuming the mean of the baseline distribution to be known, and found the likelihood ratio test more powerful. In the case where the baseline mean is unknown, we also investigated Wald's test and compared it with the likelihood ratio test and score test with respect to validity and power using simulation. Wald's test and the score test do not control the nominal significance level unless the sample size is extremely large. Overall, the likelihood ratio test has the best performance among all the methods studied. The proposed likelihood ratio test is illustrated using an example of a cholesterol study.

KW - Empirical type I error

KW - Likelihood ratio test

KW - Power

KW - Regression toward the mean

KW - Score test

KW - Test for treatment effect

KW - Truncated distributions

KW - Wald's test

UR - http://www.scopus.com/inward/record.url?scp=0030896972&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0030896972&partnerID=8YFLogxK

U2 - 10.2307/2533096

DO - 10.2307/2533096

M3 - Article

C2 - 9147603

AN - SCOPUS:0030896972

VL - 53

SP - 49

EP - 59

JO - Biometrics

JF - Biometrics

SN - 0006-341X

IS - 1

ER -