AJPH EDITORIALS
Editorial: Note About Inaccurate Results Published in the American Journal of Epidemiology and the American Journal of Public Health This article was jointly published in the American Journal of Epidemiology (Am J Epidemiol. 2017;185(6): 407–408) and the AJPH (Am J Pub Health. 2017;107(4):502). In 2013, Masters et al. published articles in the American Journal of Public Health (AJPH) 1 and the American Journal of Epidemiology (AJE) 2 in which they reported results of analyses of data from the National Health Interview Survey that were linked to individual National Death Index mortality records from 1986 to 2006. The two papers, which were related, were about age variation in the association between obesity status and mortality risk in US adults. In the AJE article, Masters et al. reported that contrary to common knowledge, the association between obesity and mortality risk became stronger with age (Figure 2 of Masters et al. 2 ). In the AJPH article, they computed the corresponding population attributable fractions and found that the percentage of mortality attributable to obesity increased with age and across birth cohorts (Figure 3 of Masters et al. 1 ). In a letter to the editor in the AJE and another in the AJPH, Wang3 and Wang and Liu 4 criticized Masters et al. for their approach to correcting for selection bias. According to these authors, Masters et al. underestimated the effect of obesity on mortality among younger people and overestimated it among older people. In both
502
Editorial
Morabia et al.
letters, the authors concluded that the bias was such that instead of increasing with age, as reported by Masters et al., 1,2 the proportion of mortality attributable to obesity should have decreased with older age. Masters et al. responded to Wang in the AJE5 ; however, the letter by Wang and Liu in the AJPH 4 was published alone because Masters et al. declined the invitation to respond.
BIASED RATES When asked to examine the issue, Hanley wrote an article jointly published in the AJE6 and the AJPH7 in which he demonstrated that the criticisms of Masters et al. that were expressed in the letters to the editors were valid. Using two independent simulations based on similar data, Hanley showed that the approach used by Masters et al. not only did not correct for the simulated selection bias but also introduced a new bias in the opposite direction of the true association. Hanley’s report was reviewed internally by several editors, including three editors with strong expertise in biostatistics, and externally by an Ethical Advisory Board comprising three public health scientists. This issue has important public health implications. The
results of Masters et al. could be used by insurance companies to justify increasing the life insurance premiums of obese persons as they grow older. The results could also lead insurance companies to reduce rates for obese persons younger than 50 years of age because they spuriously suggested that younger obese persons are less likely to die than are nonobese persons.
TO WITHDRAW OR NOT As editors, we are convinced by the consistent assessments of Wang3 and Wang and Liu,4 as well as the careful simulations by Hanley,6,7 that the statistical strategy used by Masters et al. to remove selection bias was ill originated and that their hazard ratio estimates were severely biased. We have, however, no reason to suspect misconduct or fraud and will therefore not
withdraw the articles if the authors do not take the initiative to do so. The authors seem to have made genuine errors in their original papers. The errors escaped the review process, and our Journals accepted their papers for publication. All relevant information is now available to the readers. Alfredo Morabia, MD, PhD Moyses Szklo, MD, DrPH, MPH Roger Vaughan, DrPH REFERENCES 1. Masters RK, Reither EN, Powers DA, Yang YC, Burger AE, Link BG. The impact of obesity on US mortality levels: the importance of age and cohort factors in population estimates. Am J Public Health. 2013;103(10):1895–1901. 2. Masters RK, Powers DA, Link BG. Obesity and US mortality risk over the adult life course. Am J Epidemiol. 2013; 177(5):431–442. 3. Wang Z. Re: “obesity and US mortality risk over the adult life course. [letter] Am J Epidemiol. 2014;179(4):529–530. 4. Wang Z, Liu M. Obesity-mortality association with age: wrong conclusion based on calculation error. [letter] Am J Public Health. 2014;104(7):e3–e4. 5. Masters RK, Powers DA, Link BG. The authors reply. [letter] Am J Epidemiol. 2014;179(4):530–532. 6. Hanley J. Correction of selection bias in survey data: is the statistical cure worse than the bias? Am J Epidemiol. 2017;185(6): 409–411. 7. Hanley J. Correction of selection bias in survey data: is the statistical cure worse than the bias? Am J Public Health. 2017; 107(4):503–505.
ABOUT THE AUTHORS Alfredo Morabia is the Editor-in-Chief of AJPH. He is also with the Barry Commoner Center for Health and the Environment, Queens College, CUNY, Flushing, NY, and the Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY. Moyses Szklo is the Editor-in-Chief of the American Journal of Epidemiology. He is also with the Department of Epidemiology, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD. Roger Vaughan is an Associate Editor of AJPH. He is also with the Department of Biostatistics, Mailman School of Public Health, Columbia University. Correspondence should be sent to Alfredo Morabia, MD, PhD, Barry Commoner Center for Health and the Environment, Queens College, CUNY, 65-30 Kissena Blvd, Flushing, NY 11367 (e-mail: [email protected]). Reprints can be ordered at http://www.ajph.org by clicking the “Reprints” link. This editorial was accepted January 18, 2017. doi: 10.2105/AJPH.2016.303643
AJPH
April 2017, Vol 107, No. 4
Editorial: Note About Inaccurate Results Published in the American Journal of Epidemiology and the American Journal of Public Health This article was jointly published in the American Journal of Epidemiology (Am J Epidemiol. 2017;185(6): 407–408) and the AJPH (Am J Pub Health. 2017;107(4):502). In 2013, Masters et al. published articles in the American Journal of Public Health (AJPH) 1 and the American Journal of Epidemiology (AJE) 2 in which they reported results of analyses of data from the National Health Interview Survey that were linked to individual National Death Index mortality records from 1986 to 2006. The two papers, which were related, were about age variation in the association between obesity status and mortality risk in US adults. In the AJE article, Masters et al. reported that contrary to common knowledge, the association between obesity and mortality risk became stronger with age (Figure 2 of Masters et al. 2 ). In the AJPH article, they computed the corresponding population attributable fractions and found that the percentage of mortality attributable to obesity increased with age and across birth cohorts (Figure 3 of Masters et al. 1 ). In a letter to the editor in the AJE and another in the AJPH, Wang3 and Wang and Liu 4 criticized Masters et al. for their approach to correcting for selection bias. According to these authors, Masters et al. underestimated the effect of obesity on mortality among younger people and overestimated it among older people. In both
502
Editorial
Morabia et al.
letters, the authors concluded that the bias was such that instead of increasing with age, as reported by Masters et al., 1,2 the proportion of mortality attributable to obesity should have decreased with older age. Masters et al. responded to Wang in the AJE5 ; however, the letter by Wang and Liu in the AJPH 4 was published alone because Masters et al. declined the invitation to respond.
BIASED RATES When asked to examine the issue, Hanley wrote an article jointly published in the AJE6 and the AJPH7 in which he demonstrated that the criticisms of Masters et al. that were expressed in the letters to the editors were valid. Using two independent simulations based on similar data, Hanley showed that the approach used by Masters et al. not only did not correct for the simulated selection bias but also introduced a new bias in the opposite direction of the true association. Hanley’s report was reviewed internally by several editors, including three editors with strong expertise in biostatistics, and externally by an Ethical Advisory Board comprising three public health scientists. This issue has important public health implications. The
results of Masters et al. could be used by insurance companies to justify increasing the life insurance premiums of obese persons as they grow older. The results could also lead insurance companies to reduce rates for obese persons younger than 50 years of age because they spuriously suggested that younger obese persons are less likely to die than are nonobese persons.
TO WITHDRAW OR NOT As editors, we are convinced by the consistent assessments of Wang3 and Wang and Liu,4 as well as the careful simulations by Hanley,6,7 that the statistical strategy used by Masters et al. to remove selection bias was ill originated and that their hazard ratio estimates were severely biased. We have, however, no reason to suspect misconduct or fraud and will therefore not
withdraw the articles if the authors do not take the initiative to do so. The authors seem to have made genuine errors in their original papers. The errors escaped the review process, and our Journals accepted their papers for publication. All relevant information is now available to the readers. Alfredo Morabia, MD, PhD Moyses Szklo, MD, DrPH, MPH Roger Vaughan, DrPH REFERENCES 1. Masters RK, Reither EN, Powers DA, Yang YC, Burger AE, Link BG. The impact of obesity on US mortality levels: the importance of age and cohort factors in population estimates. Am J Public Health. 2013;103(10):1895–1901. 2. Masters RK, Powers DA, Link BG. Obesity and US mortality risk over the adult life course. Am J Epidemiol. 2013; 177(5):431–442. 3. Wang Z. Re: “obesity and US mortality risk over the adult life course. [letter] Am J Epidemiol. 2014;179(4):529–530. 4. Wang Z, Liu M. Obesity-mortality association with age: wrong conclusion based on calculation error. [letter] Am J Public Health. 2014;104(7):e3–e4. 5. Masters RK, Powers DA, Link BG. The authors reply. [letter] Am J Epidemiol. 2014;179(4):530–532. 6. Hanley J. Correction of selection bias in survey data: is the statistical cure worse than the bias? Am J Epidemiol. 2017;185(6): 409–411. 7. Hanley J. Correction of selection bias in survey data: is the statistical cure worse than the bias? Am J Public Health. 2017; 107(4):503–505.
ABOUT THE AUTHORS Alfredo Morabia is the Editor-in-Chief of AJPH. He is also with the Barry Commoner Center for Health and the Environment, Queens College, CUNY, Flushing, NY, and the Department of Epidemiology, Mailman School of Public Health, Columbia University, New York, NY. Moyses Szklo is the Editor-in-Chief of the American Journal of Epidemiology. He is also with the Department of Epidemiology, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, MD. Roger Vaughan is an Associate Editor of AJPH. He is also with the Department of Biostatistics, Mailman School of Public Health, Columbia University. Correspondence should be sent to Alfredo Morabia, MD, PhD, Barry Commoner Center for Health and the Environment, Queens College, CUNY, 65-30 Kissena Blvd, Flushing, NY 11367 (e-mail: [email protected]). Reprints can be ordered at http://www.ajph.org by clicking the “Reprints” link. This editorial was accepted January 18, 2017. doi: 10.2105/AJPH.2016.303643
AJPH
April 2017, Vol 107, No. 4
