E DI TO R IA L

BJD

British Journal of Dermatology

Trials are meaningful for clinical decision making only when their endpoints are valid and comparable

Clinicians and their patients with atopic eczema (AE) are free to choose from several different topical and systemic therapies. Although most of these treatment options have been investigated in clinical trials,1,2 evidence-based comparisons of such trials are almost impossible, as trials in the field of AE have typically used different outcome measurement instruments. In 2003, a systematic review identified 56 different instruments to measure clinical signs of AE in 93 AE trials, and 31 different descriptions of clinical signs.3 Because most of the instruments that are available to measure the clinical signs of AE have unclear or even inadequate validity and reliability, systematic reviews that aim to compare the efficacy of interventions for AE have concluded that trial results cannot be pooled in a meta-analysis due to the high heterogeneity in the efficacy endpoints used.2,4 To respond to this challenge, the Harmonising Outcomes Measures for Eczema (HOME) initiative5 set out to critically appraise, validate and recommend a core outcome set (COS) of efficacy outcome measures for all AE trials involving patients, clinical experts, other health professionals, journal editors, regulators, methodologists and manufacturers on an international level. Any person interested in contributing to the HOME initiative is welcome and should contact the HOME project manager ([email protected]). A COS is an evidence-based and consensus-derived minimum set of valid and reliable outcome measures, for use in clinical trials, that allows direct and indirect comparisons of trial results to be performed, and thus contribute to guideline development and clinical decision making.6 COSs are currently being developed throughout medicine for various indications and different settings, for example clinical trials, effectiveness studies and quality assurance. Informed by a Delphi exercise7 including clinical experts and patient representatives from Europe, North America, South America, Asia and Australia, the HOME group identified symptoms of AE, health-related quality of life, clinical signs and long-term control of AE flares as the core outcome set of domains that should always be measured in AE trials.8 Following the guidance of the HOME roadmap,9 the next step after identifying such domains is to identify the most valid, reliable and feasible measurement instruments to measure each core outcome domain. With regard to clinical signs, a systematic review found that the Eczema Area and Severity Index (EASI)10 and objective Severity Scoring of Atopic Dermatitis (oSCORAD)11 are cur-

rently the best measurement instruments to assess the clinical signs of AE.12 EASI and oSCORAD both have adequate validity, internal consistency and sensitivity to change. EASI also has adequate intraobserver reliability and intermediate interobserver reliability, suggesting that the same investigator should perform the EASI scoring in a longitudinal study. The oSCORAD has adequate interobserver reliability and unclear intraobserver reliability.12 Based on this systematic review and following extensive group discussion,13 the international HOME group recommended EASI as the core outcome measurement instrument to be used in all future AE trials.14 Reasons for this broad international consensus among all stakeholders in favour of EASI included difficulties in selecting a representative site for each sign, as requested by the oSCORAD, and the disproportionately high relative weight of the intensity of signs compared with low weight of the extent of skin lesions in the oSCORAD formula.13 Unidimensional measurement instruments [i.e. instruments that assess only a single outcome domain such as EASI for clinical signs or the Patient-Oriented Eczema Measure (POEM) for symptoms] offer important advantages over composite scores to inform patientcentred, individualized clinical care of patients with chronic skin diseases. From psoriasis we know that a mismatch of objective and subjective disease severity as assessed by the physician and the patient is a strong predictor for psychiatric comorbidity15 that offers valuable information for routine patient care.16 SCORAD is a composite score that includes an assessment of clinical signs by the physician and an assessment of the AE symptoms pruritus and sleeping problems by the patient.17 This makes interpretation of specific SCORAD scores difficult as it remains unclear what proportion of the total score is explained by the objective and subjective parts of SCORAD. In the current issue of the BJD, Leshem et al.18 present a feasibility study that closes the last remaining validation gaps of the EASI.12 In addition to the classic psychometric properties of validity and reliability, feasibility is another critically important feature of outcome measurement instruments.19 Feasibility includes interpretability, in other words providing clinically meaningful information for defined score ranges. Other aspects of feasibility are ease of use, availability, cost, practicability and time to administer.19 Leshem et al.18 assessed both EASI and the six-point gestalt Investigator Global Assessment (IGA) in a cohort of 170 children and adults with different degrees of AE severity. Stratifying EASI score ranges by the corresponding IGA scores, the authors identified the best-fitting EASI bandings for each IGA category. According to their findings, EASI scores of

© 2015 British Association of Dermatologists

British Journal of Dermatology (2015) 172, pp1175–1177

DOI: 10.1111/bjd.13806

1175

1176 Editorial

11–7 represent mild AE, scores 71–21 moderate AE, scores 211–50 severe AE, and scores > 50 very severe AE. The study fulfils the current methodological standards as suggested by the COSMIN (Consensus-Based Standards for the Selection of Health Measurement Instruments) guidelines.20 On average, trained investigators needed 6 min to perform the EASI,18 which is similar to the time to administer reported for the objective SCORAD previously.12 For clinical trials, 6 min to undertake an accurate clinical assessment is probably acceptable, but too long for tracking clinical progress in routine clinical practice, where other patient-reported symptom scores like POEM21–23 may be more appropriate, easier and more useful. In summary, the study by Leshem et al.18 strengthens the recommendation to use the EASI score as the preferred instrument to measure the core outcome domain of the clinical signs measure in all future clinical trials on AE, to make trials comparable and meaningful for guideline development and clinical decision making. The recently introduced EASI app (www.easicalc.uk) may help to further increase the feasibility of this instrument. Typically, in previous trials mean changes in EASI from baseline have been calculated and compared between treatment groups. Recently, 50% improvement in EASI (EASI 50) response rates have been reported in a study investigating dupilumab for AE.24 Dichotomizing EASI changes into EASI 50 or EASI 75 response rates offers the advantage that trial results can be interpreted easily by patients and physicians as the chance for a certain benefit in the severity of AE signs. However, such dichotomization loses a lot of valuable information, and mean changes in the EASI score from baseline should also be reported in trials to allow comparisons with previous trials in meta-analyses. Patient-reported outcome measures such as health-related quality of life have been used only rarely as outcome measures in AE trials; only one in 10 AE trials conducted between 1985 and 2010 assessed quality of life.25 The HOME initiative is dedicated to change this situation and to make AE trials more patient relevant. Three of the four core outcome domains for AE trials are patient-reported outcome measures.8 Currently, systematic reviews are under way to summarize the evidence on the psychometric properties of measurement instruments for AE symptoms, quality of life and long-term control of AE flares. These reviews will serve as the evidence base for group discussion and consensus voting to identify the best instrument for these patientreported core outcome domains. All investigators conducting AE trials are certainly free to choose additional outcomes beyond and in addition to those included in the COS, as long as the COS is considered in the trial design. This will help to overcome the current situation in which trials are not comparable and are therefore of only limited use for clinical decision making. The consistent use of patient-relevant, valid, reliable, feasible and comparable outcome measures in AE trials is of particular relevance in the current situation with several new biological treatments being developed for AE. This is critically British Journal of Dermatology (2015) 172, pp1175–1177

important, as choosing inappropriate outcomes may lead to ‘wasted resources or misleading information that overestimates, underestimates, or completely misses the potential benefits of an intervention.’26

Conflicts of interest J.S. is a member of the international HOME initiative. He has received research grants for investigator-initiated studies from Novartis, Pfizer, MSD, ALK and Sanofi, and has consulted for Novartis, Abbott, Sanofi and Regeneron. 1

Centre for Evidence-Based Healthcare, Medizinische Fakult€at Carl Gustav Carus, TU Dresden, Fetscherstraße 74, 01307 Dresden, Germany 2 Centre of Evidence Based Dermatology, University of Nottingham, Nottingham NG7 2NR, U.K. E-mail: [email protected]

J . S C H M I T T 1,2

References 1 Schmitt J, Apfelbacher CJ, Flohr C. Eczema. BMJ Clin Evid 2011; 2011:1716. 2 Roekevisch E, Spuls PI, Kuester D et al. Efficacy and safety of systemic treatments for moderate-to-severe atopic dermatitis: a systematic review. J Allergy Clin Immunol 2014; 133:429–38. 3 Charman C, Chambers C, Williams H. Measuring atopic dermatitis severity in randomized controlled clinical trials: what exactly are we measuring? J Invest Dermatol 2003; 120:932–41. 4 Schmitt J, Schakel K, Schmitt N, Meurer M. Systemic treatment of severe atopic eczema: a systematic review. Acta Derm Venereol 2007; 87:100–11. 5 Schmitt J, Williams HC. Harmonising Outcome Measures for Eczema (HOME). Report from the first international consensus meeting (HOME 1), 24 July 2010, Munich, Germany. Br J Dermatol 2010; 163:1166–8. 6 Kirkham JJ, Gargon E, Clarke M, Williamson PR. Can a core outcome set improve the quality of systematic reviews? A survey of the Co-ordinating Editors of Cochrane review groups. Trials 2013; 14:21. 7 Schmitt J, Langan S, Stamm T et al. Core outcome domains for controlled trials and clinical recordkeeping in eczema: international multiperspective Delphi consensus process. J Invest Dermatol 2011; 131:623–30. 8 Schmitt J, Spuls P, Boers M et al. Towards global consensus on outcome measures for atopic eczema research: results of the HOME II meeting. Allergy 2012; 67:1111–17. 9 Schmitt J, Apfelbacher C, Spuls PI et al. The Harmonizing Outcome Measures for Eczema (HOME) roadmap: a methodological framework to develop core sets of outcome measurements in dermatology. J Invest Dermatol 2015; 135:24–30. 10 Tofte SJ, Graeber M, Cherill R et al. Eczema Area and Severity Index (EASI): a new tool to evaluate atopic dermatitis. J Eur Acad Dermatol Venereol 1998; 11(Suppl. 2):S197. 11 Kunz B, Oranje AP, Labreze L et al. Clinical validation and guidelines for the SCORAD index: consensus report of the European Task Force on Atopic Dermatitis. Dermatology 1997; 195:10–19. © 2015 British Association of Dermatologists

Editorial 12 Schmitt J, Langan S, Deckert S et al. Assessment of clinical signs of atopic dermatitis: a systematic review and recommendation. J Allergy Clin Immunol 2013; 132:1337–47. 13 Chalmers JR, Schmitt J, Apfelbacher C et al. Report from the third international consensus meeting to harmonise core outcome measures for atopic eczema/dermatitis clinical trials (HOME). Br J Dermatol 2014; 171:1318–25. 14 Schmitt J, Spuls PI, Thomas KS et al. The Harmonising Outcome Measures for Eczema (HOME) statement to assess clinical signs of atopic eczema in trials. J Allergy Clin Immunol 2014; 134:800– 7. 15 Schmitt J, Ford DE. Understanding the relationship between objective disease severity, psoriatic symptoms, illness-related stress, health-related quality of life and depressive symptoms in patients with psoriasis – a structural equations modeling approach. Gen Hosp Psychiatry 2007; 29:134–40. 16 Schmitt J, Wozel G, Garzarolli M et al. Effectiveness of interdisciplinary vs. dermatological care of moderate-to-severe psoriasis: a pragmatic randomised controlled trial. Acta Derm Venereol 2014; 94:192–7. 17 Severity scoring of atopic dermatitis: the SCORAD index. Consensus Report of the European Task Force on Atopic Dermatitis. Dermatology 1993; 186:23–31. 18 Leshem YA, Hajar T, Hanifin JM, Simpson EL. What the Eczema Area and Severity Index score tells us about the severity of atopic

© 2015 British Association of Dermatologists

19 20 21

22

23

24

25

26

1177

dermatitis: an interpretability study. Br J Dermatol 2015; 172:1353– 57. Boers M, Brooks P, Strand CV, Tugwell P. The OMERACT filter for outcome measures in rheumatology. J Rheumatol 1998; 25:198–9. de Vet HC, Terwee CB, Mokkink LB et al. Measurement in Medicine. A Practical Guide. New York: Cambridge University Press, 2011. Charman CR, Venn AJ, Williams HC. The patient-oriented eczema measure: development and initial validation of a new tool for measuring atopic eczema severity from the patients’ perspective. Arch Dermatol 2004; 140:1513–19. Schram ME, Spuls PI, Leeflang MM et al. EASI, (objective) SCORAD and POEM for atopic eczema: responsiveness and minimal clinically important difference. Allergy 2012; 67:99–106. Schmitt J, Langan SM, Williams HC. What are the best outcome measurements for atopic eczema? A systematic review. J Allergy Clin Immunol 2007; 120:1389–98. Beck LA, Thacßi D, Hamilton JD et al. Dupilumab treatment in adults with moderate-to-severe atopic dermatitis. N Engl J Med 2014; 371:130–9. Rehal B, Armstrong A. Health outcome measures in atopic dermatitis: a systematic review of trends in disease severity and qualityof-life instruments 1985–2010. PLoS ONE 2011; 6:e17520. Sinha I, Jones L, Smyth RL, Williamson PR. A systematic review of studies that aim to determine which outcomes to measure in clinical trials in children. PLoS Med 2008; 5:e96.

British Journal of Dermatology (2015) 172, pp1175–1177

This document is a scanned copy of a printed document. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material.

Trials are meaningful for clinical decision making only when their endpoints are valid and comparable.

Trials are meaningful for clinical decision making only when their endpoints are valid and comparable. - PDF Download Free
53KB Sizes 0 Downloads 7 Views