pii: jc- 00323-15

http://dx.doi.org/10.5664/jcsm.5878

S CI E NT IF IC IN VES TIGATIONS

Psychometric Comparison of the Full and Abbreviated Versions of the Dysfunctional Beliefs and Attitudes about Sleep Scale Ka-Fai Chung, MBBS, MRCPsych1; Fiona Yan-Yee Ho, MPhil2; Wing-Fai Yeung, PhD3 Department of Psychiatry, The University of Hong Kong, Hong Kong SAR, China; 2Department of Psychology, The University of Hong Kong, Hong Kong SAR, China; 3School of Chinese Medicine, The University of Hong Kong, Hong Kong SAR, China

1

Study Objectives: The different versions of the Dysfunctional Beliefs and Attitudes about Sleep Scale (DBAS) have limited comparison and summary of the findings across studies. We aimed to examine which version and which subscales had better psychometric properties. Methods: Data were derived from a randomized controlled trial of internet-based cognitive-behavioral therapy for insomnia (CBT-I) vs. waitlist in 312 participants with self-report diagnosis of insomnia disorder. The response distribution, internal consistency, construct and concurrent validity, and sensitivity to change were analyzed. Results: Floor or ceiling effects were found in 19 of the 30 DBAS items. Item-total correlation was < 0.30 in 43.3%, 31.3%, and 10.0% of the items in DBAS30, DBAS-16, DBAS-10. Internal consistency was satisfactory for total scores, with Cronbach α ranging from 0.73–0.81, but 2 subscales of DBAS-30 and 1 subscale of DBAS-10 had Cronbach α < 0.35. Factor analysis produced 8, 4, and 3 factors for DBAS-30, DBAS-16, and DBAS-10. Only the factor structure of DBAS-16 was compatible with previous studies. Concurrent validity with insomnia, anxiety, and depressive symptoms was much stronger than with sleep diary parameters. Sensitivities to change of the DBAS scores following CBT-I and with sleep improvement were found, except the DBAS-30 “attributions” subscale and DBAS-16 “medication” subscale. Conclusions: The DBAS-16 possesses better internal consistency, a reproducible factor structure, strong concurrent validity, and sensitivity to change, and therefore is recommended for research use. The DBAS-30 and DBAS-10 have their own strengths, but there are limitations in their application as a quantitative measure in research. Keywords: insomnia, assessment, beliefs, attitudes, sleep, cognitive-behavioral therapy, scales Citation: Chung KF, Ho FY, Yeung WF. Psychometric comparison of the full and abbreviated versions of the dysfunctional beliefs and attitudes about sleep scale. J Clin Sleep Med 2016;12(6):821–828.

I N T RO D U C T I O N

BRIEF SUMMARY

Current Knowledge/Study Rationale: The different versions of the Dysfunctional Beliefs and Attitudes about Sleep Scale (DBAS) have limited comparison and summary of the findings across studies. We aimed to examine which version and which subscales had better psychometric properties. Study Impact: The DBAS-16 possesses better internal consistency, a reproducible factor structure, strong concurrent validity, and sensitivity to change. Future studies should consider the DBAS-16 as a better option to quantify sleep-related cognitions in research settings.

The Dysfunctional Beliefs and Attitudes about Sleep Scale (DBAS), which first appeared in Morin’s insomnia treatment manual as a pre-treatment evaluation tool, has now become one of the most commonly used scales for the assessment of various sleep-related cognitions.1 Studies have shown that people with insomnia have higher DBAS scores than good sleepers. As an outcome measure, several of the DBAS items are sensitive to cognitive-behavioral therapy for insomnia (CBT-I) and their changes correlate with sleep improvement.2 There are different versions of the DBAS, but the most commonly used are the 30, 16, and 10 item versions. The 30-item DBAS covers 5 themes, including (1) consequences of insomnia, (2) control and predictability of sleep, (3) sleep requirement expectations, (4) causal attributions of insomnia, and (5) sleep promoting practices. However, studies have shown that only the subscales on “consequences” and “control and predictability” achieve satisfactory internal consistency. In addition, principal component analysis failed to achieve item convergence.3 For convenience of use and better psychometric properties, abbreviated versions of the DBAS have been developed. The 10-item version was created based on the items which had significant pre-post changes following CBT-I,3 while the 16-item

version was based on response distribution, missing rate, itemtotal correlation, and lack of overlap with other items.4 Preliminary data suggested that DBAS-10 and DBAS-16 were valid and reliable.3,4 However, Carney and Edinger5 found that only 2 of the 30 DBAS items possessed the ability to differentiate insomniacs from good sleepers, were sensitive to change following CBT-I, and correlated with sleep improvement, and the authors remained open to which DBAS version should be used. The DBAS has been translated into several languages, including Chinese. Chen et al.6 in Taiwan showed that only 2 of the 5 subscales of the 30-item version and 2 of the 4 subscales of the 16-item version had satisfactory internal consistency, and 821

Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS

the participants to read the materials and complete the assignments. We found that the self-help CBT-I with or without telephone support was more effective than waitlist for improving sleep at both immediate and 4-week post-treatment.7

the factor structure was not supported by confirmatory factor analyses. To better understand the psychometric properties of the DBAS, we examined the 30, 16, 10 items versions in 312 Chinese subjects with insomnia disorder. The research questions were to find out the strengths and weaknesses of each version and whether the DBAS subscales were valid and reliable.

Measures DBAS A 30-item DBAS on a 10-point Likert scale was used.10 Participants indicated their degree of endorsement of the items with “strongly disagree” at the far left and “strongly agree” at the far right. Higher scores represent stronger endorsement of the beliefs. We edited the language and sentence structure of the Taiwanese version6 to form the Hong Kong Chinese version.

METHODS

Sample

Data of the present study were derived from a randomized controlled trial of self-help CBT-I.7 Adults aged 18 years or above with insomnia disorder compatible with the Diagnostic and Statistical Manual, Fifth Edition (DSM-5) criteria,8 including difficulty initiating or maintaining sleep, early morning awakening, or non-restorative sleep associated with significant distress or impairment in occupational, social and other important areas of functioning ≥ 3 nights per week for > 3 months, participated in our study through the internet. No monetary incentive was provided, but the treatment was free of charge. The only exclusion criterion was report of current suicidal ideation.

Expanded Consensus Sleep Diary for Morning (CSD-M) The CSD-M is a prospective self-report measure developed by a group of experts in an effort to standardize sleep diary assessment. Participants were asked to complete the CSD-M everyday within 1 hour of getting out of bed for 7 consecutive days.11 The sleep parameters were averaged over 1 week. Only total sleep time and sleep efficiency were analyzed in order to avoid multiple comparisons.

Procedure

Insomnia Severity Index (ISI)

All procedures used in the present study were reviewed and approved by the local institutional review board. Subjects who showed an interest in the study were directed to a website. Informed consent was obtained prior to all study procedures. After completing a questionnaire on sociodemographic and clinical variables, eligible subjects were provided with a username and password. Three-hundred twelve participants were randomly assigned to self-help CBT-I with telephone support (n = 103), self-help CBT-I (n = 104), and waiting-list control (n = 105).

The ISI is a 7-item self-rating scale that was used to assess the perceived severity of insomnia and the associated functional impairment in the previous week.12 The items were rated using a 5-point Likert scale with anchor points ranging from “none” to “very severe,” “very satisfied” to “very dissatisfied,” and “not at all noticeable, worried, or interfering” to “very much noticeable, worried, or interfering.” The total score ranges from 0 to 28. We used the Chinese version of ISI, known to be valid and reliable.13 Hospital Anxiety and Depression Scale (HADS)

Intervention

CBT-I was provided over 6 weeks, with treatment materials delivered once per week. The content was adopted from a wellestablished CBT-I manual.9 We summarized the most salient information of the treatment manual and edited the materials to be relevant in the local setting. Most of the information was presented in text, together with some diagrams, and a 15-minute audio clip on relaxation training. Details of the program are available.7 In brief, session 1 consists of a program overview, basic facts about sleep, etiological model of insomnia, and goal setting. Session 2 includes sleep hygiene, activity scheduling, and relaxation training. Session 3 begins with a revision of the sleep hygiene rules, followed by an introduction of stimulus control and sleep restriction. Session 4 begins with a revision of the stimulus control and sleep restriction principles, followed by cognitive therapy. Session 5 focuses on cognitive therapy and relaxation training. The last session summarizes the major points of previous sessions, reviews the treatment goal, and covers relapse prevention. In the group allocated to receive CBT-I with telephone support, a psychology graduate (YYH) contacted the participants weekly for roughly 15 min each time to answer questions about treatment content, review treatment progress, and encourage Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

The HADS is a self-report scale that was used to assess the severity of anxiety and depression in the past week.14 It comprises 2 subscales, each with 7 items, measuring the severity of anxiety and depressive symptoms. The items use different anchor descriptors and are scored on a 4-point scale. The subscale score ranges from 0 to 21, with higher scores indicating more severe symptoms. The HADS was chosen because it was well validated in the Chinese population.15

Data Analysis

All statistical analyses were performed using SPSS version 23 for Windows (SPSS, Chicago, USA). Response distribution and floor and ceiling effects were revealed using the mean, SD, and % with lowest and highest score. The contribution of each item to the total score was assessed using item-total correlation. Internal consistency was evaluated with Cronbach α: as its interpretation depends on the number of scale items,16 the mean and range of inter-item correlations were presented. Factor structure was examined by principal component analysis. If factor correlations exceed 0.32, which is equivalent to more than 10% overlap in variance, promax rotation would be used.17 The factors were selected 822

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS

Table 1—Sample characteristics. Variables Age, y Sex, male/female Full-time education, y Marital status Single Married Divorced/Widowed Occupation Executives or professionals Clerical, service or production workers Students Housemakers Retired Unemployed or others Age of insomnia onset, y Insomnia duration, y Previous professional help Psychiatrists General practitioners or other doctors Chinese medicine practitioners Clinical psychologists Counselors, nurses or other professionals Hypnotics use ≥ 1 time/week ISI total score Sleep diary parameters SOL, min WASO, min TST, min SE, % HADS-A HADS-D DBAS-30 DBAS-16 DBAS-10

All Participants (n = 312) 38.5 ± 12.5 90/222 14.3 ± 5.1

CBT-I (n = 207) 37.7 ± 12.4 64/143 14.5 ± 5.1

Waitlist (n = 105) 39.9 ± 12.7 26/79 14.0 ± 5.3

170 (34.5) 132 (42.3) 10 (3.2)

121 (58.5) 79 (38.2) 7 (3.4)

49 (46.7) 53 (50.5) 3 (2.9)

113 (36.2) 68 (21.8)

71 (34.3) 49 (19.3)

42 (40.0) 19 (18.1)

51 (16.3) 22 (7.1) 22 (7.1) 36 (11.5) 26.9 ± 12.2 8.5 ± 8.6 180 (57.7) 71 (22.8) 86 (27.6) 104 (33.3) 29 (9.3) 38 (12.2)

37 (17.9) 13 (6.3) 13 (6.3) 24 (11.6) 26.8 ± 12.4 8.0 ± 8.4 119 (57.5) 44 (21.3) 64 (30.9) 68 (32.9) 17 (8.2) 23 (11.1)

14 (13.3) 9 (8.6) 9 (8.6) 12 (11.4) 27.1 ± 11.9 9.4 ± 8.9 61 (58.1) 27 (25.7) 22 (21.0) 36 (34.3) 12 (11.4) 15 (14.3)

79 (25.3) 15.7 ± 4.5

52 (25.1) 15.9 ± 4.3

27 (25.7) 15.3 ± 4.7

47.3 ± 36.0 47.5 ± 44.7 377.0 ± 82.9 78.5 ± 13.6 9.7 ± 4.2 7.4 ± 4.3 164.4 ± 33.4 102.4 ± 22.0 71.3 ± 14.2

46.3 ± 36.2 45.7 ± 42.6 376.6 ± 78.7 79.0 ± 12.8 9.6 ± 4.1 7.3 ± 4.3 165.2 ± 33.3 102.9 ± 21.6 71.5 ± 14.1

49.1 ± 35.6 51.0 ± 48.5 377.7 ± 91.0 77.6 ± 15.1 9.9 ± 4.4 7.6 ± 4.3 162.7 ± 33.5 101.2 ± 22.7 71.0 ± 14.4

Values are expressed in n (% of total) or mean ± SD. CBT-I, Cognitive-Behavioral Therapy for insomnia; ISI, Insomnia Severity Index; SOL, sleep onset latency; WASO, wake after sleep onset; SE, sleep efficiency; TST, total sleep time derived from 1-week sleep diary; HADS-A/D, Hospital Anxiety and Depression Scale anxiety/depression subscale; DBAS-30/16/10, 30/16/10-itemed Dysfunctional Beliefs and Attitudes about Sleep Scale.

according to eigenvalues > 1 and the Scree test. The items with rotated loadings ≥ 0.50 were regarded as representing significant item-factor contributions. With a sample size of 312 in this study, the subject-to-item ratio was 10.4, which was well above the minimum of 5 as recommended in textbooks on factor analysis.18 Concurrent validity was assessed by correlating the DBAS scores with clinical parameters that are likely to be associated with sleep-related cognitions, including sleep diary measures, insomnia, depressive, and anxiety symptoms. The baseline data were used to analyze response distribution, internal consistency, factor structure, and concurrent validity. Sensitivity to change was assessed

by comparing the DBAS change scores from baseline to immediate post-treatment between CBT-I and waitlist group and between responders and non-responders. In line with a previous study,19 participants with ISI scores improved by ≥ 8 points were classified as responders. There are different interpretations of the validity and reliability indices; in this study, significant floor or ceiling effect was defined as > 20% of respondents using the lowest or highest score.20 Corrected item-total correlations ≥ 0.30 were considered acceptable.21 The coefficients for internal consistency and concurrent validity were regarded as satisfactory if they were between 0.70 and 0.95 and between 0.30 and 0.70, respectively.22 823

Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS

Table 2—Descriptive statistics, internal consistency and item-total correlation of the DBAS. Item 1. Need 8 hours of sleep 2. Need to catch up on sleep loss 3. Need less sleep because getting older 4. Worried about nervous breakdown 5. Consequences of insomnia on health 6. More time in bed insures more sleep 7. Trying harder will lead to sleep 8. Fear of losing control of sleep 9. Should go to bed earlier because of aging 10. Insomnia interferes with daytime functioning 11. Better taking sleeping pills 12. Mood disturbances due to insomnia 13. Should sleep as well as bed partner 14. Insomnia as the result of aging 15. Afraid of dying in sleep 16. Will have to pay after a good night 17. One poor night disturbs whole week 18. Cannot function without a good night 19. Sleep is unpredictable 20. Unable to manage consequences 21. Lack of energy due to poor sleep 22. No control over nocturnal thoughts 23. Can still lead satisfactory life 24. Insomnia resulting from chemical imbalance 25. Insomnia destroying life 26. Alcohol as a solution 27. Medication as a solution 28. Sleep is getting worse all the time 29. Shows in physical appearance 30. Cancel obligations

Mean 7.28 6.76 3.52 6.91 8.63 5.16 5.92 6.95 4.87 8.37 3.96 7.12 4.48 1.97 1.51 3.13 4.64 7.02 7.82 6.73 8.02 7.63 3.65 4.68 6.78 2.47 2.17 3.31 7.46 5.44

Standard Deviation 2.78 2.82 3.00 3.19 1.87 3.19 3.04 2.98 3.11 2.02 3.65 2.59 3.23 2.46 2.63 3.13 3.17 2.66 2.56 2.67 2.00 2.57 2.77 2.50 2.70 2.82 2.84 2.99 2.57 3.19

% with Lowest Score 2.6 2.2 23.7 4.5 0.3 9.6 6.4 4.5 10.9 0.3 28.5 2.6 20.2 41.3 62.5 32.7 12.8 1.3 1.6 1.6 0.3 2.6 11.5 8.7 1.9 40.1 45.8 24.0 1.9 9.9

% with Highest Score 26.6 17.9 2.9 28.5 46.5 9.3 12.8 25.6 8.7 38.8 9.9 19.9 7.7 1.9 1.9 3.2 7.1 22.1 36.9 17.9 28.2 30.8 5.1 2.2 19.9 1.3 2.6 3.8 26.3 10.6

Item-total r DBAS-30 DBAS-16 DBAS-10 0.30 0.27 0.40 0.35 0.32 0.41 0.002 0.43 0.43 0.45 0.47 0.28 0.21 0.21 0.44 0.48 0.37 0.25 0.45 0.55 0.53 0.32 0.29 0.54 0.55 0.50 0.21 0.11 0.32 0.28 0.52 0.46 0.38 0.47 0.56 0.21 0.27 0.49 0.51 0.47 0.55 0.55 0.31 0.31 0.22 0.17 0.08 0.52 0.38 0.18 0.32 0.24 0.34 0.29 0.44 0.35

Bold numbers represent significant floor or ceiling effect or weak item-total correlation.

(31.3% of total), but only 1 item in DBAS-10 (10.0%) had an item-total correlation < 0.30. The internal consistency of the DBAS-30, DBAS-16, and DBAS-10 were satisfactory, with Cronbach α 0.81, 0.80, and 0.73, respectively (Table 3). Several subscales had Cronbach α > 0.70, including DBAS-30 “consequences” and “control and predictability” subscales, DBAS16 “consequences” and “worry/helplessness” subscales, and DBAS-10 “immediate consequences” subscale, while some subscales, including DBAS-30 “sleep expectations,” “attributions,” and “sleep promoting practices” subscales and DBAS-10 “control and predictability” subscale had poor internal consistency (< 0.40) and low mean inter-item correlation (< 0.20).

R ES U LT S

Sample Characteristics

Table 1 presents the demographics and clinical characteristics of the participants. Participants had a mean age of 38.5 years and 71.1% were female. The mean ISI score was 15.7, the mean sleep efficiency over 7 days was 78.5% (range = 37.7% to 96.7%), and the mean sleep onset latency and wake after sleep onset were both around 47 minutes.

Descriptive Statistics, Item-Total Correlation, and Internal Consistency

Significant floor effect was found in items 3, 11, 13, 14, 15, 16, 26, 27, and 28. Significant ceiling effect happened in 10 items (Table 2). The floor and ceiling effects were most severe in 5 items (items 5, 14, 15, 26, and 27), of which greater than 40% of participants used the extreme scores. There were 13 items (43.3%) of the DBAS-30 having item-total correlation < 0.30; for DBAS-16, items 1, 11, 19, 24, and 27 had similar problems Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

Factor Analysis

Principal component analysis with promax rotation of the DBAS-30 items found 8 factors with eigenvalue > 1 and the same number of factors was indicated by the Scree plot. The 8 factors explained 55.1% of the rotated variance (Table 4). Factor 1 consisted of items 10, 12, 17, 18, 21, and 30 and resembled the 824

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS

Table 3—Internal consistency of the DBAS-30, DBAS-16, and DBAS-10 and their subscales. Scale and Subscales* DBAS-30 DBAS-30 subscales Consequences (4,5,10,12,15,18,21,29,30) Control and predictability (8,16,17,19,20,22,23,25,28) Sleep expectations (1,3,13) Attributions (14,24) Sleep promoting practices (2,6,7,9,11,26,27) DBAS-16 DBAS-16 subscales Consequences (10,12,18,21,30) Worry/helplessness (5,8,17,19,20,25) Sleep expectations (1,2) Medication (11,24,27) DBAS-10 DBAS-10 subscales Immediate consequences (1,2,10,12,21) Long-term consequences (5,8,17) Control and predictability (7,22)

Cronbach α 0.81

Inter-item r mean (range) 0.13 (−0.20 to 0.55)

0.77 0.71 0.19 0.33 0.53 0.80

0.28 (0.06 to 0.57) 0.22 (0.04 to 0.48) 0.06 (−0.14 to 0.17) 0.19 0.14 (−0.06 to 0.53) 0.22 (−0.05 to 0.55)

0.78 0.72 0.58 0.50 0.73

0.44 (0.30 to 0.57) 0.30 (0.06 to 0.48) 0.41 0.24 (0.04 to 0.53) 0.22 (0.04 to 0.48)

0.71 0.50 0.01

0.35 (0.19 to 0.57) 0.28 (0.20 to 0.43) 0.006

*Numbers in parentheses refer to subscale items.

“consequences” subscale, of which 5 of the 9 subscale items were included. Factor 3 consisted of items 1, 2, 6, 7, and 9, which had certain similarities with the “sleep promoting practices” subscale, of which 4 of the 7 subscale items were included. Factors 5 consisted of items 3, 13, and 16, which was similar to the “sleep expectations” subscale. However, Factors 2, 4, and 6–8 were not compatible with any of the DBAS-30 subscales. Several items had rotated loadings marginally above or below the criterion of 0.50, suggesting that the factor structure was not ideal and some items might be relevant to more than 1 factor. For DBAS16, principal component analysis produced 4 factors, which explained 55.5% of the rotated variance. Factor 1 consisted of items 10, 12, 17, 18, 21, and 30, which was similar to the “consequences” subscale. Factor 2 included items 5, 8, 19, 20, and 25, which resembled the “worry/helplessness” subscale. Factor 3 had the same items as the “sleep expectations” subscale. Factor 4 consisted of items 11 and 27, which was similar to the “medication” subscale. Item 24 was not loaded on any of the 4 factors, while items 5, 10, 19, 20, and 25 had rotated loadings marginally above or below 0.50, indicating their relevance to more than 1 factor. Principal component analysis of the DBAS-10 items produced 3 factors, which accounted for 55.6% of the variance. Factor 1 consisted of items 10, 12, 17, and 21, which included 3 of the 5 items of the “immediate consequences” subscale. Factor 2 consisted of items 1, 2, and 7, which had limited resemblance with the DBAS-10 subscales. Factor 3 included items 5 and 8 and resembled “long-term consequences” subscale. Item 22 was not loaded on any of the 3 factors.

HADS-anxiety and HADS-depression subscale scores. However, the correlations with sleep diary-derived total sleep time and sleep efficiency were mostly not significant. The DBAS-30 “attributions” and “sleep promoting practices” subscales were not correlated with any of the insomnia, anxiety, and depressive symptom scales, while the DBAS-30 and DBAS-16 “sleep expectation” subscales were only significantly correlated with ISI total score. The DBAS-10 “immediate consequences” subscale had significant correlation with ISI and HADS-anxiety subscale, but was not related to HADS-depression subscale.

Sensitivity to Change

Significantly greater reduction in DBAS scores was found in participants allocated to CBT-I than those on waitlist, except the DBAS-30 “attributions” subscale and DBAS-16 “medication” subscale. Participants who had improved in ISI scores by ≥ 8 points had significantly greater changes in DBAS total scores, DBAS-30 “control and predictability” and “sleep promoting practices” subscale scores, DBAS-16 “worry/helpfulness” subscale score, and DBAS-10 “long-term consequences” and “control and predictability” subscale scores, compared to those who had not improved. A descriptive summary of the psychometric properties of DBAS-30, DBAS-16, and DBAS10 is shown in Table 5. D I SCUS S I O N Despite the frequent use of the DBAS as a measure of sleeprelated cognitions, we found shortcomings in the psychometric properties of its full and abbreviated versions. Although the full version has a broad coverage and may be suitable for

Concurrent Validity

There were significant correlations between DBAS total and several subscale scores with ISI and PSQI total scores and 825

Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS

Table 4—Principal component analysis (promax rotation) of the DBAS-30, DBAS-16, and DBAS-10. Item 1. 2. 3. 4. 5. 6. 7. 8. 9. 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20. 21. 22. 23. 24. 25. 26. 27. 28. 29. 30.

1 0.36 0.38 −0.26 0.46 0.39 0.23 0.03 0.26 0.17 0.75 0.18 0.69 0.17 −0.20 0.12 0.15 0.61 0.73 0.08 0.46 0.70 0.39 0.20 0.07 0.47 0.05 0.06 0.10 0.55 0.64

Variance, % 18.9 Eigenvalue 5.67

2 3 0.29 0.62 0.25 0.59 −0.08 0.01 0.51 0.29 0.78 0.18 0.02 0.61 0.16 0.71 0.67 0.15 0.14 0.58 0.48 0.21 0.14 0.04 0.34 0.20 0.002 0.30 −0.29 0.22 0.17 0.03 0.08 −0.10 0.19 0.15 0.41 0.21 0.48 0.02 0.60 0.13 0.51 0.24 0.43 0.02 0.21 −0.13 0.06 0.05 0.60 0.07 −0.12 0.16 0.03 0.05 0.11 0.03 0.21 0.07 0.25 0.12 8.8 2.65

7.2 2.15

DBAS-30, Factor 4 5 −0.25 −0.05 −0.23 0.01 0.16 0.63 −0.11 −0.07 −0.07 0.07 0.02 0.09 0.05 0.10 0.31 −0.06 −0.07 0.09 −0.06 −0.22 0.18 0.09 0.16 0.06 −0.17 0.61 0.36 0.54 0.22 0.31 0.28 0.55 0.18 0.26 0.01 −0.14 0.36 −0.35 0.39 −0.19 −0.09 −0.13 −0.09 −0.14 0.59 −0.08 0.11 0.14 0.41 0.04 0.10 0.20 0.33 0.23 0.71 0.20 −0.01 −0.05 0.32 −0.09 5.0 1.49

4.4 1.31

6 0.09 0.28 0.04 0.19 0.05 0.19 −0.10 0.21 −0.11 0.06 0.85 0.09 0.10 0.16 0.17 0.21 0.31 0.06 −0.07 −0.06 0.03 0.12 0.18 0.08 0.02 0.15 0.78 0.25 0.09 0.10 3.9 1.16

7 8 −0.29 0.22 −0.24 0.27 0.16 −0.03 −0.15 0.49 −0.06 0.18 0.06 0.11 0.06 0.03 0.19 0.16 0.17 0.26 −0.15 0.23 0.03 0.19 0.20 0.34 −0.12 0.24 0.41 0.12 0.32 0.55 0.36 0.20 0.18 0.32 0.003 0.23 0.44 0.08 0.15 0.35 −0.01 0.31 −0.14 0.58 −0.16 0.06 0.71 0.08 0.12 0.29 0.03 0.71 0.28 0.20 0.33 0.20 −0.16 0.12 0.01 0.18 3.7 1.11

3.3 1.01

1 0.27 0.30

DBAS-16, Factor 2 3 4 0.19 0.80 −0.06 0.16 0.73 0.12

0.32

0.68

0.47 −0.01

0.28

0.73

0.22

0.71 0.18 0.73

0.42 0.16 0.39

0.50 −0.10 0.11 0.82 0.25 0.11

0.67 0.77 0.17 0.50 0.67

0.21 0.10 0.33 0.37 0.33 −0.01 0.62 −0.14 0.05 0.70 0.19 0.01 0.48 0.48 −0.07

0.15 0.50

0.25 −0.21 0.70 0.21

0.22 0.08

0.11

0.14 −0.06

0.86

0.71

0.31

0.15

0.11

28.7 10.5 4.60 1.68

8.8 1.40

7.5 1.20

0.28

DBAS-10, Factor 1 2 3 0.31 0.77 0.15 0.33 0.77 0.11

0.41

0.30

0.73

−0.09 0.29

0.61 0.15

0.42 0.85

0.77

0.39

0.14

0.74

0.21

0.27

0.58

0.09

0.28

0.77 0.50

0.38 0.08

0.22 0.25

32.5 12.7 10.4 3.25 1.27 1.04

Bold numbers represent factor loadings over 0.50.

pre-treatment evaluation, it has unstable factor structure, many of its items have floor or ceiling effects, and several of its subscales have unsatisfactory internal consistency; hence its use as a research instrument can be problematic. The DBAS-16 has better overall psychometric properties, including better internal consistency, a reproducible factor structure, strong concurrent validity, and sensitivity to change. The DBAS-10 was created based on the items which had significant pre-post changes following CBT-I; hence it may have a restricted indication. As one the subscales of the DBAS-10 has unsatisfactory internal consistency, instead of analyzing its subscales, the DBAS-10 should be used as a global measure. Floor or ceiling effects were found in 19 of the 30 items of DBAS, probably because the DBAS was initially designed to assess dysfunctional cognitions; hence some of the items were worded to identify the most severe kinds of concern. For Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

example, the items “fear of dying in sleep,” “insomnia seriously affects health,” and “medication as the only solution” may produce affirmative negative responses. We replicated the previous findings in Western and Chinese populations that several DBAS subscales had unsatisfactory internal consistency. Two subscales of the DBAS-30 and 1 subscale of the DBAS-10 had the worst internal consistency, ranging from 0.01 to 0.33. Exploratory factor analysis of the DBAS-30 produced 8 factors, which had limited resemblance to its 5 subscales, probably because the subscales were originally constructed based on clinical intuition than on psychometric properties. The DBAS-16 had the most consistent factor structure among the 3 versions tested. We replicated the 4-factor structure of the DBAS-16 found in a Caucasian population with insomnia.4 A difference was observed in item 17 “one poor night disturbs whole week,” which was loaded on the “consequences” factor 826

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS

Table 5—Descriptive summary on the psychometric properties of DBAS-30, DBAS-16, and DBAS-10. Floor and ceiling effects Usage of subscales Factor structure Concurrent validity Sensitivity to change Research use Overall comments

DBAS-30 − − − +/− +/− − Useful as pre-treatment evaluation Less useful as research instrument

DBAS-16 − +/− + + +/− + Useful research instrument Reproducible factor structure Some degree of redundancy and floor and ceiling effects

DBAS-10 + − − + +/− + Useful for treatment outcome studies Less comprehensive structure Best used as total score

+, no significant problems; +/−, some problems; −, significant problems.

in our population, but not the “worry/helplessness” factor in the Caucasian sample; in addition, item 24 “insomnia resulting from chemical imbalance” was not loaded on any of the factors in our sample, perhaps due to a lack of agreement among participants in their perceived causes of insomnia23 and its independence from other sleep-related cognitions. In addition, several items belonging to the “consequences” and “worry/ helplessness” factors had rotated loadings closed to the criterion of 0.50, suggesting that the two constructs may have some overlap in meaning. For DBAS-10, our factor analysis was not entirely compatible with two previous studies,3,24 between which differences in factor structure were also detected. We found that all three versions of DBAS had acceptable concurrent validity. Similar to the finding in a previous study,4 the correlation of DBAS with sleep diary parameters was weaker than with insomnia, anxiety, and depressive symptom scales, suggesting that quantitative measures of insomnia played a limited role in dysfunctional sleep-related cognitions. We showed that the “attributions” and “sleep promoting practices” subscales of the DBAS-30 were not correlated with insomnia, anxiety, and depressive symptoms. The findings were compatible with previous studies that the scores on these 2 subscales were similar between insomniacs and good sleepers.5,25 Although some of the items in these 2 subscales could be regarded as dysfunctional cognitions, e.g., “need to catch up on sleep loss,” “more time in bed insures more sleep,” “trying harder will lead to sleep,” these beliefs may be cultural values held by the general public and are not specific to people with insomnia. The DBAS was found to be sensitive to changes. Except the “attributions” subscale of the DBAS-30 and “medication” subscale of the DBAS-16, all other subscales either improved after CBT-I or changed in line with sleep improvement. The “consequences” and “sleep expectations” subscales of the DBAS-16 improved after CBT-I but not in line with sleep improvement. With better understanding of the psychometric properties of various versions of the DBAS and hopefully a consensus as to which version to use, comparison and summary of the findings from different studies can be made. Further studies on the role of DBAS subscales as mediators of sleep improvement are needed.

There are several methodological limitations in the study. A requirement to have access to the internet and basic computer skills may have limited the participants to better educated individuals. The diagnosis of insomnia disorder may not be accurate as it is based on self-report, without confirmation by clinical interview. Another limitation was that the DBAS-16 and DBAS-10 were not completed on their own, but as part of the DBAS-30, hence we did not know whether item rating was affected. Lastly, we did not include good sleepers to test the discriminant validity of the DBAS in a Chinese population nor conducted test-retest reliability assessment. In conclusion, the DBAS-16 is a valuable quantitative instrument for the assessment and monitoring of sleep-related cognitions in people with insomnia. The DBAS-10 and DBAS30 have relatively weak factor structure and internal consistency, hence the use of their subscales for research purpose is not recommended. Our findings suggest that the DBAS-10 should be used as a global measure, preferably for treatment outcome studies. Additional studies are needed to further validate the DBAS-16 subscales as a classifier of insomnia subtype, an outcome predictor, and for tailoring treatment.26 A B B R E V I AT I O N S CBT-I, cognitive-behavioral therapy for insomnia CSD-M, Consensus Sleep Diary for Morning DBAS, Dysfunctional Beliefs and Attitudes about Sleep Scale DSM, Diagnostic and Statistical Manual of Mental Disorders HADS, Hospital Anxiety and Depression Scale ISI, Insomnia Severity Index R E FE R E N CES 1. Morin CM, ed. Insomnia: psychological assessment and management. New York, NY: Guilford Press, 1993. 2. Schwartz DR, Carney CE. Mediators of cognitive-behavioral therapy for insomnia: a review of randomized controlled trials and secondary analysis studies. Clin Psychol Rev 2012;32:664–75.

827

Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

KF Chung, FY Ho and WF Yeung. Full and Abbreviated Versions of DBAS 3. Espie CA, Inglis SJ, Harvey L, Tessier S. Insomniacs’ attributions: psychometric properties of the Dysfunctional Beliefs and Attitudes about Sleep Scale and the Sleep Disturbance Questionnaire. J Psychosom Res 2000;48:141–8. 4. Morin CM, Vallieres A, Ivers H. Dysfunctional Beliefs and Attitudes about Sleep (DBAS): validation of a brief version (DBAS-16). Sleep 2007;30:1547–54. 5. Carney CE, Edinger JD. Identifying critical beliefs about sleep in primary insomnia Sleep 2006;29:444–53. 6. Chen CW, Jan YW, Yang CM, Lin SC. Dysfunctional Beliefs and Attitudes about Sleep (DBAS): validation of the Chinese version. Arch Clin Psychol 2009;4:59–67. [in Chinese] 7. Ho FY, Chung KF, Yeung WF, Ng TH, Cheng SK. Weekly brief phone support in self-help cognitive behavioral therapy for insomnia disorder: relevance to adherence and efficacy. Behav Res Ther 2014;63C:147–56. 8. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th ed. Arlington, VA: American Psychiatric Publishing, 2013. 9. Morin CM, Espie CA, eds. Insomnia: a clinician’s guide to assessment and treatment. New York, NY: Springer, 2003. 10. Morin CM, Stone J, Trinkle D, Mercer J, Remsberg S. Dysfunctional beliefs and attitudes about sleep among older adults with and without insomnia complaints. Psychol Aging 1993;8:463–7. 11. Carney CE, Buysse DJ, Ancoli-Israel S, et al. The consensus sleep diary: standardizing prospective sleep self-monitoring. Sleep 2012;35:287–302. 12. Bastien CH, Vallières A, Morin CM. Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep Med 2001;2:297–307. 13. Chung KF, Kan KK, Yeung WF. Assessing insomnia in adolescents: comparison of Insomnia Severity Index, Athens Insomnia Scale and Sleep Quality Index. Sleep Med 2011;12:463–70. 14. Zigmond AS, Snaith RP. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand 1983;67:361–70. 15. Leung CM, Wing YK, Kwong PK, Lo A, Shum K. Validation of the ChineseCantonese version of the Hospital Anxiety and Depression Scale and comparison with the Hamilton Rating Scale of Depression. Acta Psychiatr Scand 1999;100:456–61. 16. Cortina JM. What is coefficient alpha? An examination of theory and applications. J Appl Psychol 1993;78:98–104. 17. Gaskin CJ, Happell B. On exploratory factor analysis: a review of recent evidence, an assessment of current practice, and recommendations for future use. Int J Nurs Stud 2014;51:511–21. 18. Watson R, Thompson DR. Use of factor analysis in Journal of Advanced Nursing: literature review. J Adv Nur 2006;55:330–41. 19. Morin CM, Vallières A, Guay B, et al. Cognitive behavioral therapy, singly and combined with medication, for persistent insomnia: a randomized controlled trial. JAMA 2009;301:2005–25.

Journal of Clinical Sleep Medicine, Vol. 12, No. 6, 2016

20. Mao HF, Msueh IP, Tand PF, Sheu CF, Hsieh CL. Analysis and comparison of the psychometric properties of three balance measures for stroke patients. Stroke 2002;33:1022–7. 21. Nunnally J, Bernstein I, eds. Psychometric theory. New York, NY: McGraw-Hill, 1994. 22. Streiner DL. A checklist for evaluating the usefulness of rating scales. Can J Psychiatry 1993;38:140–8. 23. Yung KP, Chung KF, Ho FY, Yeung WF, Ng TH. The experience of chronic insomnia in Chinese adults: a study using focus groups and insomnia experience diaries. Behav Sleep Med 2015 Sep 22. [Epub ahead of print]. 24. Edinger JD, Wohlgemuth WK. Psychometric comparisons of the standard and abbreviated DBAS-10 versions of the dysfunctional beliefs and attitudes about sleep questionnaire. Sleep Med 2001;2:493–500. 25. Edinger JD, Fins AI, Glenn DM, et al. Insomnia and the eye of the beholder: are there clinical markers of objective sleep disturbances among adults with and without insomnia complaints? J Consult Clin Psychol 2000;68:586–93. 26. Sánchez-Ortuño MM, Edinger JD. A penny for your thoughts: patterns of sleep-related beliefs, insomnia symptoms and treatment outcome. Behav Res Ther 2010;48:125–33.

ACK N O W L E D G M E N T S Author contributions: Dr. K.F. Chung designed the study, interpreted the results, and prepared the manuscript. Ms. Y.Y. Ho and Dr. W.F. Yeung collected and analyzed data. We declare that all authors have substantial contributions to the study, including drafting or revising the work.

SUBM I SSI O N & CO R R ESPO NDENCE I NFO R M ATI O N Submitted for publication July, 2015 Submitted in final revised form January, 2016 Accepted for publication January, 2016 Address correspondence to: Dr. K.F. Chung, Clinical Associate Professor, Department of Psychiatry, The University of Hong Kong, Pokfulam Road, Hong Kong SAR, China; Tel: +852-22554487; Fax: +852-28551345; Email: [email protected]

D I SCLO S U R E S TAT E M E N T This was not an industry supported study. The authors have indicated no financial conflicts of interest.

828

Psychometric Comparison of the Full and Abbreviated Versions of the Dysfunctional Beliefs and Attitudes about Sleep Scale.

The different versions of the Dysfunctional Beliefs and Attitudes about Sleep Scale (DBAS) have limited comparison and summary of the findings across ...
302KB Sizes 0 Downloads 7 Views