Research

Original Investigation

Cardiovascular Risk Prediction Models for People With Severe Mental Illness Results From the Prediction and Management of Cardiovascular Risk in People With Severe Mental Illnesses (PRIMROSE) Research Program David P. J. Osborn, PhD; Sarah Hardoon, PhD; Rumana Z. Omar, PhD; Richard I. G. Holt, PhD; Michael King, PhD; John Larsen, PhD; Louise Marston, PhD; Richard W. Morris, PhD; Irwin Nazareth, PhD; Kate Walters, PhD; Irene Petersen, PhD

IMPORTANCE People with severe mental illness (SMI), including schizophrenia and bipolar

Supplemental content at jamapsychiatry.com

disorder, have excess rates of cardiovascular disease (CVD). Risk prediction models validated for the general population may not accurately estimate cardiovascular risk in this group. OBJECTIVE To develop and validate a risk model exclusive to predicting CVD events in people with SMI incorporating established cardiovascular risk factors and additional variables. DESIGN, SETTING, AND PARTICIPANTS We used anonymous/deidentified data collected between January 1, 1995, and December 31, 2010, from the Health Improvement Network (THIN) to conduct a primary care, prospective cohort and risk score development study in the United Kingdom. Participants included 38 824 people with a diagnosis of SMI (schizophrenia, bipolar disorder, or other nonorganic psychosis) aged 30 to 90 years. During a median follow-up of 5.6 years, 2324 CVD events (6.0%) occurred. MAIN OUTCOMES AND MEASURES Ten-year risk of the first cardiovascular event (myocardial infarction, angina pectoris, cerebrovascular accidents, or major coronary surgery). Predictors included age, sex, height, weight, systolic blood pressure, diabetes mellitus, smoking, body mass index (BMI), lipid profile, social deprivation, SMI diagnosis, prescriptions for antidepressants and antipsychotics, and reports of heavy alcohol use.

CONCLUSIONS AND RELEVANCE The PRIMROSE BMI and lipid CVD risk prediction models performed better in SMI compared with models that include only established CVD risk factors. Further work on the clinical effectiveness and cost-effectiveness of the PRIMROSE models is needed to ascertain the best thresholds for offering CVD interventions.

Author Affiliations: Division of Psychiatry, UCL (University College London), London, United Kingdom (Osborn, Hardoon, King); Camden and Islington National Health Service Foundation Trust, London, United Kingdom (Osborn, King); Research Department of Primary Care and Population Health, UCL, London, United Kingdom (Hardoon, Marston, Morris, Nazareth, Walters, Petersen); Department of Statistical Science, UCL, London, United Kingdom (Omar); Human Development and Health Academic Unit, Faculty of Medicine, University of Southampton, Southampton, United Kingdom (Holt); Rethink Mental Illness, London, United Kingdom (Larsen).

JAMA Psychiatry. 2015;72(2):143-151. doi:10.1001/jamapsychiatry.2014.2133 Published online December 23, 2014.

Corresponding Author: David P. J. Osborn, PhD, Division of Psychiatry, University College London, Charles Bell House, Riding House Street, London W1W 7EJ, United Kingdom ([email protected]).

RESULTS We developed 2 CVD risk prediction models for people with SMI: the PRIMROSE

BMI model and the PRIMROSE lipid model. These models mutually excluded lipids and BMI. In terms of discrimination, from cross-validations for men, the PRIMROSE lipid model D statistic was 1.92 (95% CI, 1.80-2.03) and C statistic was 0.80 (95% CI, 0.76-0.83) compared with 1.74 (95% CI, 1.63-1.86) and 0.78 (95% CI, 0.75-0.82) for published Cox Framingham risk scores. The corresponding results in women were 1.87 (95% CI, 1.76-1.98) and 0.79 (95% CI, 0.76-0.82) for the PRIMROSE lipid model and 1.58 (95% CI, 1.48-1.68) and 0.77 (95% CI, 0.73-0.81) for the Cox Framingham model. Discrimination statistics for the PRIMROSE BMI model were comparable to those for the PRIMROSE lipid model. Calibration plots suggested that both PRIMROSE models were superior to the Cox Framingham models.

(Reprinted) 143

Copyright 2015 American Medical Association. All rights reserved.

Downloaded From: http://archpsyc.jamanetwork.com/ by a BYU Harold B Lee Library User on 05/18/2015

Research Original Investigation

Cardiovascular Risk Prediction Models

I

t is well established that people with severe mental illnesses (SMIs), such as schizophrenia and bipolar disorder, have excess rates of cardiovascular disease (CVD), including myocardial infarctions and strokes.1 The risk of dying from CVD is 3-fold higher in people with SMI younger than 50 years and 2-fold in those aged 50 to 75 years.2 There has been an increase in clinical and research efforts addressing this problem, but we lack knowledge regarding the most effective ways to predict and manage cardiovascular risk in people with SMI. We know that the conventional cardiovascular risk factors, including smoking, dyslipidemia (with higher levels of total cholesterol and triglycerides and lower levels of high-density lipoprotein cholesterol [HDL-C]), diabetes mellitus, and obesity and possibly a higher prevalence of hypertension, are more common in people with SMI,3,4 especially those with wellestablished mental disorders.5 There may even be a shared genetic predisposition to comorbidities in patients with SMI. People with SMI are less likely to exercise, have unhealthy diets, and may receive inferior physical health care.6 Antipsychotic medications may contribute to cardiovascular risk through weight gain and its effect on glucose and lipid metabolism, although mortality studies2,7,8 that explore the role of antipsychotic medication in premature deaths show inconsistent findings. For example, an 11-year follow up study of people with schizophrenia7 reported reduced cardiovascular mortality in people treated with olanzapine and clozapine, but methodological issues in the study, particularly unmeasured confounding, have been critiqued in detail.9 For the general population, cardiovascular risk is managed by using CVD risk scores to determine the absolute risk for an individual patient and therefore the likely benefit of prescribing lipid-lowering medications and/or other interventions. The most established scores are the Framingham Heart Study risk scores,10 currently available as both a body mass index (BMI) model (including BMI but not laboratory results for blood lipid levels) and a lipid model (including total cholesterol and HDL-C but not BMI). Clinical guidelines, such as the UK National Institute for Health and Clinical Excellence guidelines on schizophrenia, recommend more intensive screening for cardiovascular risk in people with SMI.1,11 However, we do not know how well the modifiable cardiovascular risk factors, included in models such as Cox Framingham, predict CVD risk in people with SMI. There is reason to believe that existing models may not accurately determine the high level of risk conferred by having a longterm SMI. The established scores, such as the Cox Framingham, were developed by excluding people with SMI and since then have not been tested in this population; in addition, the established scores do not consider SMI-specific exposures, such as antipsychotic medication. To our knowledge, no previous studies have assessed the performance of CVD risk prediction models in people with SMI. Using data from a large UK primary care database, The Health Improvement Network (THIN),12 we aimed to develop and validate cardiovascular risk prediction models specific to people with SMI: Prediction and Management of Cardiovascular Risk in People With Severe Mental Illnesses (PRIMROSE) models. These new models developed from the PRIMROSE 144

study included traditional cardiovascular risk factors and additional SMI-specific variables. We compared the performance of these new risk prediction models against existing published Cox Framingham scores in people with SMI since the Cox Framingham scores are widely used internationally and the coefficients of the scores are readily available to allow comparison. This work formed part of a program of research, PRIMROSE, which is funded by the UK National Institute for Health Research (http://www.ucl.ac.uk/primrose).

Methods Study Design A prospective study of anonymous data collected between January 1, 1995, and December 31, 2010, was conducted to develop and validate a 10-year risk score for predicting newly recorded cardiovascular events in people with SMI. The scheme for THIN to obtain and provide anonymous patient data to researchers was approved by the National Health Service SouthEast Multicentre Research Ethics Committee in 2002, and scientific approval for this study was obtained from CMD Medical Research’s Scientific Review Committee in March 2012.

Setting We used THIN,12 a UK primary care database that includes information obtained from routine clinical practice. Primary care physicians and staff use a hierarchical system of Read codes to enter information in THIN, such as symptoms and diagnoses, during clinical appointments and administration13 that creates a longitudinal record for each patient. At the time we developed the PRIMROSE risk models, THIN included almost 10 million patients with geographic coverage broadly representative of the UK population.14 Approximately 98% of the population is registered with a general practitioner in the United Kingdom.15 THIN data are subject to a range of quality assurance procedures16 and have been successfully used in wideranging studies on CVDs,17,18 including cardiovascular risk score validation work in the general population.19 Primary care data are a particularly suitable source for assessing cardiovascular risk in people with SMI in the United Kingdom since most people with SMI are registered with a general practitioner whom they see frequently and most of the required data for risk scores (eg, laboratory and blood pressure measurements) are available owing to policy initiatives that provide incentives for annual cardiovascular screening.20 The SMI diagnoses have been validated in UK general practice.21

Participants We included individuals aged 30 to 90 years with a diagnostic entry in their primary care electronic health record for an SMI at any time during their follow-up period. We defined SMI as (1) schizophrenia and schizoaffective disorder, (2) bipolar affective disorder, and (3) other nonorganic psychoses. We created lists of the diagnostic codes used by general practitioners or administrators. The codes are usually based on assessments by mental health specialists. We extracted anonymous/deidentified data between January 1, 1995, and December 31, 2010.

JAMA Psychiatry February 2015 Volume 72, Number 2 (Reprinted)

Copyright 2015 American Medical Association. All rights reserved.

Downloaded From: http://archpsyc.jamanetwork.com/ by a BYU Harold B Lee Library User on 05/18/2015

jamapsychiatry.com

Cardiovascular Risk Prediction Models

Original Investigation Research

Table 1. Characteristics of Eligible Patients With SMI Data Before Imputation Men (n = 18 417) Characteristic

Women (n = 20 407)

Total (N = 38 824)

No. Observed

Data

No. Observed

Data

No. Observed

Data

18 417

46.2 (14.0)

20 407

52.4 (16.4)

38 824

49.5 (15.6)

Systolic blood pressure, mean (SD), mm Hg

5586

132.5 (17.6)

8977

131.2 (20.3)

14 563

131.7 (19.3)

Weight, mean (SD), kg

3478

84.8 (18.0)

5105

73.5 (18.2)

8583

78.1 (19.0)

11 927

1.76 (0.08)

13 515

1.61 (0.07)

25 442

1.68 (0.10)

2921

27.74 (5.48)

4200

28.37 (6.75)

7121

28.11 (6.27)

Age, mean (SD), y

Height, mean (SD), m BMI, mean (SD) Total cholesterol level, mean (SD), mmol/L

1737

5.37 (1.13)

1971

5.62 (1.12)

3708

5.51 (1.13)

HDL-C level, mean (SD), mmol/L

1127

1.22 (0.37)

1199

1.46 (0.44)

2326

1.34 (0.42)

Predominant smoking history, No. (%)

17 573

19 592

37 165

Never

5030 (28.6)

9219 (47.0)

Former

2317 (13.2)

2376 (12.1)

14 249 (38.3) 4693 (12.6)

Current

10 226 (58.2)

7997 (40.8)

18 223 (49.0)

History of very heavy drinking/alcohol problems at baseline, No. (%)

18 417

2513 (13.6)

20 407

1111 (5.4)

38 824

3624 (9.3)

History of diabetes mellitus at baseline, No. (%)

18 417

597 (3.2)

20 407

759 (3.7)

38 824

1356 (3.5)

Townsend score of social deprivation (quintiles), No. (%)

18 417

20 407

38 824

1 (Least deprived)

2433 (13.2)

3588 (17.6)

6021 (15.5)

2

2849 (15.5)

3750 (18.4)

6599 (17.0)

3

3688 (20.0)

4279 (21.0)

7967 (20.6)

4

4512 (24.5)

4740 (23.2)

9252 (23.8)

5 (Most deprived)

4935 (26.8)

4050 (19.8)

SMI diagnosis, No. (%)

18 417

Schizophrenia

20 407 7606 (41.3)

8985 (23.1) 38 824

5626 (27.6)

13 232 (34.1)

Bipolar disorder

4005 (21.7)

6093 (29.8)

10 098 (26.0)

Other

4967 (27.0)

6238 (30.6)

11 205 (28.9)

Unknown (on severe mental illness register)

1839 (10.0)

2450 (12.0)

4289 (11.0)

Medications at baseline, No. (%) Antidepressants

18 417

5679 (30.8)

20 407

8439 (41.4)

38 824

14 118 (36.4)

Second-generation antipsychotics

18 417

4184 (22.7)

20 407

3760 (18.4)

38 824

7944 (20.5)

First-generation antipsychotics

18 417

3864 (21.0)

20 407

4769 (23.4)

38 824

8633 (22.2)

Lithium

18 417

1626 (8.8)

20 407

299 (1.5)

38 824

4125 (10.6)

Antihypertensive drugs

18 417

1543 (8.4)

20 407

2505 (12.3)

38 824

4048 (10.4)

Abbreviations: BMI, body mass index (calculated as weight in kilograms divided by height in meters squared); HDL-C, high-density lipoprotein cholesterol; SMI, severe mental illness.

SI conversion factor: To convert total cholesterol and HDL-C to milligrams per deciliter, divide by 0.0259.

Main Outcome

In summary, we performed Cox proportional hazards regression with backward elimination to derive the PRIMROSE models. The variables considered in the models are listed in Tables 1, 2, and 3. We compared the performance of different models by calculating the C index22 and D statistic23 for discrimination, by constructing calibration plots, and by assessing the numbers of people classified as having high risk of CVD over the course of 10 years (score >20%) who went on to have a CVD event. After comparing the PRIMROSE risk models against published Cox Framingham models, we performed 2 supplementary comparisons. First, we wanted to ascertain whether our results could be explained by differences between North American and UK source populations. Thus, we reestimated the Cox Framingham model to the UK gen-

Newly recorded fatal and nonfatal cardiovascular events were defined as a diagnostic record for myocardial infarction, angina pectoris, coronary heart disease, major coronary surgery and revascularization, cerebrovascular accident, and transient ischemic attack.

Statistical Analysis We developed 2 PRIMROSE risk models: the BMI model and lipid model. Detailed descriptions of the follow-up period, the variables considered in our analysis, the development of the PRIMROSE risk models and their 10-fold internal crossvalidation, as well as the imputation of missing data and our sample size calculation, are provided in the eAppendix in the Supplement. jamapsychiatry.com

(Reprinted) JAMA Psychiatry February 2015 Volume 72, Number 2

Copyright 2015 American Medical Association. All rights reserved.

Downloaded From: http://archpsyc.jamanetwork.com/ by a BYU Harold B Lee Library User on 05/18/2015

145

Research Original Investigation

Cardiovascular Risk Prediction Models

Table 2. Associations of Predictors With New-Onset CVD After Imputation HR (95% CI)a

Characteristic Sex (female vs male) Age (per log-year increase)

P Value

0.69 (0.64-0.75)

Cardiovascular risk prediction models for people with severe mental illness: results from the prediction and management of cardiovascular risk in people with severe mental illnesses (PRIMROSE) research program.

People with severe mental illness (SMI), including schizophrenia and bipolar disorder, have excess rates of cardiovascular disease (CVD). Risk predict...
227KB Sizes 0 Downloads 8 Views