799

Restorative Neurology and Neuroscience 32 (2014) 799–811 DOI 10.3233/RNN-140399 IOS Press

Contingent capture of involuntary visual spatial attention does not differ between normally hearing children and proficient cochlear implant users Marc R. Kamkea,∗ , Jeanette Van Luynb , Gabriella Constantinescuc and Jill Harrisa,1 a Queensland

Brain Institute, The University of Queensland, Brisbane, QLD, Australia of Psychology, The University of Queensland, Brisbane, QLD, Australia c Hear and Say Research and Innovation, Hear and Say, Toowong, QLD, Australia b School

Abstract. Purpose: Evidence suggests that deafness-induced changes in visual perception, cognition and attention may compensate for a hearing loss. Such alterations, however, may also negatively influence adaptation to a cochlear implant. This study investigated whether involuntary attentional capture by salient visual stimuli is altered in children who use a cochlear implant. Methods: Thirteen experienced implant users (aged 8–16 years) and age-matched normally hearing children were presented with a rapid sequence of simultaneous visual and auditory events. Participants were tasked with detecting numbers presented in a specified color and identifying a change in the tonal frequency whilst ignoring irrelevant visual distractors. Results: Compared to visual distractors that did not possess the target-defining characteristic, target-colored distractors were associated with a decrement in visual performance (response time and accuracy), demonstrating a contingent capture of involuntary attention. Visual distractors did not, however, impair auditory task performance. Importantly, detection performance for the visual and auditory targets did not differ between the groups. Conclusion: These results suggest that proficient cochlear implant users demonstrate normal capture of visuospatial attention by stimuli that match top-down control settings. Keywords: Cochlear implant, selective attention, spatial attention, contingent capture, children

1. Introduction It is well established that deafness is associated with changes in visual perception, cognition and attention. Most notably, deaf observers show enhanced neural ∗ Corresponding author: Dr. Marc R. Kamke, The Queensland Brain Institute, Building 79, The University of Queensland, St Lucia, 4072 QLD, Australia. Tel.: +61 7 3346 6300; Fax: +61 7 3346 6301; E-mail: [email protected]. 1 Minerals Industry Safety and Health Centre, Sustainable Minerals Institute, The University of Queensland, Brisbane, QLD, Australia.

and behavioral responses to moving stimuli that are presented in the peripheral visual field (Neville and Lawson 1987a, 1987b, 1987c; Loke and Song 1991; Armstrong et al., 2002; Stevens and Neville 2006). The specificity of this effect for motion, but not color processing has been taken to suggest that motion-sensitive brain regions are more susceptible to deafness-induced reorganization (for a review, see Bavelier et al., 2006). Interestingly, such reorganization is not restricted to visual cortices (see also, Bavelier et al., 2000, 2001), but can also involve auditory areas being recruited to process visual information (Finney and Dobkins 2001;

0922-6028/14/$27.50 © 2014 – IOS Press and the authors. All rights reserved

800

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

Finney et al., 2003; Fine et al., 2005). Importantly, it has been shown that increased levels of such crossmodal plasticity between the visual and auditory systems are associated with poorer hearing outcomes following implantation of a cochlear prosthesis (e.g., Lee et al., 2001, 2005, 2007; Doucet et al., 2006). It is unclear, however, what role cognitive influences, such as selective attention, play in these effects. Here, we investigate the involuntary orienting of attention to salient visual stimuli in cochlear implant users. Selective attention plays a fundamental role in shaping sensory perception, acting to boost neural and behavioral responses to potentially important stimuli and suppress responses to irrelevant events (for reviews, see Corbetta and Shulman 2002; Knudsen 2007). Numerous studies have shown that visual selective attention is altered in deaf individuals; indeed, many of the changes in visual perception reported for deaf observers arise only under conditions of focused attention. For example, under conditions of focused central attention deaf observers are faster to respond to targets presented extrafoveally and show less interference from central stimuli (Parasnis and Samar 1985). This enhanced attentional sensitivity is accompanied by greater interference from peripheral distractors (e.g., Bosworth and Dobkins 2002; Proksch and Bavelier 2002; Sladen et al., 2005, Dye et al., 2007, 2009). Such changes in visual perception have been explained in terms of a redistribution of attentional resources to more peripheral locations and/or salient stimuli, which may serve a compensatory function for orienting to important environmental events in the absence of hearing (see, e.g., Lavie 2005). In addition to the interference effects of peripheral distractors shown in deaf adults, an impairment of sustained visual attention has been reported for children. Such effects have been shown using a continuous performance task in which target numbers must be detected in a rapid serial visual presentation (RSVP) of distractor items (Quittner et al., 1994; Mitchell and Quittner 1996; Smith et al., 1998; Horn et al., 2005). A similar deficit is found for the detection of colored shapes in RSVP streams (Dye and Bavelier 2010). Importantly, this later study avoided possible confounds due to delayed language development and/or co-morbid neurological disorders, which may have influenced the earlier results (Dye and Bavelier 2010). One explanation for these findings is that deaf children, like adults, maintain a wider focus of visual attention in order to monitor their environment, which is

sub-optimal for centrally presented tasks like the continuous performance task (Quittner et al., 1994; Smith et al., 1998). If this hypothesis is correct, then children with a cochlear implant should show a normalization of sustained visual attention, as they can presumably use audition to monitor their environment. Interestingly, children who use a cochlear implant do generally show improvements in sustained visual attention compared to deaf children without an implant, but not all perform as well as their normally hearing peers (Quittner et al., 1994; Smith et al., 1998; Horn et al., 2005; Yucel and Derim 2008). Although numerous studies have examined sustained visual attention in children who use a cochlear implant, selective visual attention has been scarcely investigated. Importantly, changes in selective visual attention, such as increased distractibility to salient stimuli, may influence how well a child learns to use a cochlear implant. Such changes in attention are also likely to present implant users, especially those attending regular schools, with a range of challenges not experienced by their normally hearing peers (Chute and Nevins 2003; Dye et al., 2008). Previous research in normally hearing adults has shown that the degree to which stimuli capture attention depends not only on the physical properties of a stimulus, but also on whether those properties match task-demands and top-down attentional control settings (e.g., Folk et al., 1992; Remington et al., 2001; Serences et al., 2005, Leblanc et al., 2008). For example, when an irrelevant stimulus shares its color with a to-be-detected target, that stimulus causes stronger interference than does a different colored stimulus or one that moves (e.g., Folk et al., 1994). This effect has been termed contingent attentional capture, as the involuntary capture of attention is contingent on the behavioral goals of the observer. The current study aimed to investigate whether such contingent capture of visual attention is altered in children who use a cochlear implant. Children were presented with simultaneous streams of visual and auditory stimuli and were tasked with detecting targets in each modality. On each trial a visual distractor preceded the presentation of a target, which could occur in either modality (see Fig. 1). Based on the contingent capture hypothesis it was predicted that distractors possessing the target-defining characteristic (a specific color) would interfere with detection of visual targets to a greater extent than distractors without that feature. It was also hypothesized that implant users would show differences in such

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

801

Fig. 1. Stimuli and trial design. Participants were presented with simultaneous streams of colored numbers and tonal stimuli. The task was to detect a number presented in a pre-defined color (shown for green) or a change in tonal frequency. A visual or auditory target was presented on each trial. Prior to the target, one of four lateralized visual distractors was presented (see insert) on the left or right of fixation. The example shows a trial containing a visual target and a target-colored distractor; the black background has been removed for illustrative purposes. Adapted from Kamke and Harris (2014).

contingent capture effects and be more distracted by moving stimuli. Additionally, a key question in this study was whether salient visual stimuli can interfere with auditory perception in children who use a cochlear implant, as was recently shown for adults (Champoux et al., 2009). It was hypothesized that visual distractors would have a greater impact on auditory detection performance in implant users compared to normally hearing children. 2. Methods 2.1. Participants Data from 13 children with a cochlear implant (eight female; aged 8.6–16.0 years, median 12.0) and 13 agematched normally hearing children (six female; aged 8.6–15.9 years, median 12.2) were included in the analysis. Data from an additional three implant users and four normally hearing children were excluded as they did not complete the task or performed at chance level in the visual and/or auditory control (no distractor) conditions (see 2.3 Stimuli). Implant users were recruited on an opportunistic basis over the duration of the study through Hear and Say (Auchenflower, Brisbane,

Australia), a pediatric Auditory-Verbal Therapy early intervention and cochlear implant center. Normallyhearing children included siblings of the implant users as well as children recruited from schools in the Lockyer Valley, Queensland. Experimental procedures were approved by The University of Queensland Medical Research Ethics Committee and fully-informed, written consent was obtained from the parent/guardian of all participants (children were also invited to provide written consent). The demographic and clinical profiles of cochlear implant users are shown in Table 1. All children had severe-to-profound hearing loss that was diagnosed by two years of age (eight from birth) and all but one child had their first implant fitted by the age of four. Implant users had a Cochlear™ prosthesis (see Table 1) and during testing used their own speech processor with their clinically-programmed map and preferred program and settings. All children had undertaken the Auditory-Verbal Therapy early intervention program prior to school entry and none used a signed language. This habilitation program focuses on developing the spoken language of a deaf child through listening and requires the active participation of parents/caregivers as the primary language teachers of their children (AG

802

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

Table 1 Demographic and clinical profile of cochlear implant users Participant

1 2 3 4 5 6 7 8 9 10 11 12 13

Age Gender Age at onset Implanted Age at Age at Hearing Implant/processor (years) of profound ear first implant second implant aide type deafness (years) (years) (years) 8.6 15.8 16.0 15.7 12.0 14.6 10.9 11.2 12.2 10.3 9.8 12.1 11.9

F F F M F F M M F M M F F

Birth Birth 1.0 Birth 2.0 Birth 1.0 Birth 1.5 Birth 1.0 Birth Birth

L L+R L+R L+R R L+R L+R L+R L L+R L+R R L

1.1 1.5 2.0 2.5 4.0 3.0 1.7 1.0 10.5 1.5 3.0 1.3 2.0

N/A 11.3 12.0 13.5 N/A 13.5 8.0 9.0 N/A 8.0 5.0 N/A N/A

Yes N/A N/A N/A No N/A N/A N/A Yes N/A N/A No Yes

N24/Fd (L) Fd/Fd (L); N22/Spectra22 (R) Fd/Fd (L); N24/Fd (R) N22/Fd (L); Fd/Fd (R) N24/Fd (R) N24/Fd (L); Fd/Fd (R) N24/Fd (L); N24/Esprit3G (R) Fd/Fd (L); N24/Fd (R) Fd/Fd (L) Fd/Fd (L); Fd/Fd (R) N24/Fd (L); Fd/Fd (R) N24/Fd (R) N24/Fd (L)

Speech perception score 6 5 6 5 6 5 5 6 4 6 5 6 6

Note. For bilateral CIs, first ear implanted is underlined. Implant type: N22 and N24 = Nucleus 22 and 24, respectively; Fd = Freedom. Speech perception is scored out of nine (0–8), with higher values indicating better performance (see 2.2 Speech perception abilities of cochlear implant users).

Bell Academy for Listening and Spoken Language 2013). 2.2. Speech perception abilities of cochlear implant users The speech perception abilities of the cochlear implant users were determined from a review of their clinical test results. Audition-alone speech perception testing (i.e., without visual cues) included both closedset tests, in which a limited set of response alternatives are provided, and open-set tests, where response alternatives are not provided. Tests were administered in recorded format and/or via live voice. Each participant was assigned a speech perception score according to the Categories of Auditory Performance Index (Black et al., 2012), which has nine hierarchic classifications (numbered 0–8). Higher category numbers reflect better speech perception abilities, with a category of 8 indicating an ability to perceive speech very well through audition alone in both quiet and noisy conditions. The median speech perception score for the children in the present study was 6 (range 4–6; see Table 1), which indicates very good speech perception abilities in quiet conditions (open-set accuracy of ≥75%). A score of 5 denotes good speech perception abilities in quiet conditions (>50% but 0.05). These normalization procedures did not change the significance of any of the ANOVAs (note that whereas inferential results refer to the transformed data, descriptive statistics are reported using the raw data). To investigate whether children with a cochlear implant differed from normally hearing children in their temporal allocation of attention (cf., Dye and Bavelier 2010), responses to visual and auditory targets in the nodistractor control condition were compared using two-tailed t-tests. To determine whether the groups differ in contingent capture effects, responses for each individual in the no-distractor condition were subtracted from the visual distractor conditions. These difference data were then compared using mixed ANOVA with the factors Group (normally hearing, cochlear implant) and Distractor (target-colored, nontarget-colored, motion). Significant main effects were followed-up using planned comparisons and Bonferroni adjusted, two-tailed t-tests (adjusted alpha level = 0.017). Statistical analysis was carried out using SPSS (v19; IBM).

Table 2 Mean (±SE) detection performance in the no-distractor condition

Visual reaction time (ms) Visual accuracy (%) Auditory reaction time (ms) Auditory accuracy (%)

Normally Hearing

Cochlear Implant

810 (44) 91.8 (2.2) 1085 (76) 89.4 (2.7)

964 (152) 87.2 (3.9) 1142 (107) 84.8 (3.0)

3. Results Mean reaction times and accuracy for detecting targets in the absence of visual distractors (i.e., the nodistractor control condition) are presented in Table 2. Overall, reaction times were faster, and accuracy slightly higher, in the visual compared to auditory task. Analysis of performance in the no-distractor condition revealed that there were no differences in reaction times between the groups for either the visual (p = 0.553) or auditory (p = 0.715) stimuli. Similarly, there was no difference in accuracy between groups for detecting visual (p = 0.525) or auditory (p = 0.723) targets. It should be noted that the larger variability in reaction times for the visual task in the cochlear implant group (Table 2) was principally due to lengthy responses from two participants. Removal of these participants (and their matched controls) did not change the significance of any of the t-tests. 3.1. Contingent capture effects: Visual stimuli The mean change in reaction time for detecting visual targets relative to the no-distractor control condition is presented in Fig. 2A. For both groups of children there was little change in reaction times when a motion distractor was presented, but there was a substantial slowing following a target-colored distractor. ANOVA confirmed a difference in reaction times across the distractor conditions, F(2, 48) = 7.344, p = 0.002; ηp 2 = 0.234, but no difference between the groups (all other p > 0.41). Follow-up comparisons revealed that reaction times were significantly longer following presentation of a target-colored distractor compared to both a non-target-colored distractor (p = 0.010) and motion distractor (p = 0.002). There was no difference in reaction times between the nontarget-colored and motion distractors (p > 0.31). Analogous to reaction times, accuracy for detecting visual targets was also affected by the type of distractor presented. As shown in Fig. 2B, relative

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

805

Fig. 2. Mean change in reaction time (A) and accuracy (B) of normally hearing children and cochlear implant users for detecting visual targets preceded by a visual distractor. Data show mean difference scores, obtained by subtracting performance in the no-distractor condition from that in the distractor conditions. ∗ p < 0.05. Error bars show within subjects (normalized) SE (Cousineau 2005).

to the no-distractor condition mean accuracy was reduced maximally following the presentation of a target-colored distractor, and this effect is larger for the normally hearing group. The difference in accuracy across the distractor conditions was found to be reliable, F(2, 48) = 13.823, p < 0.001; =ηp 2 = 0.365, but there was no difference between the groups (all other p > 0.26). Specifically, accuracy was lower following presentation of a target-colored distractor compared to both non-target-colored (p = 0.003) and motion (p < 0.001) distractors. The difference in accuracy between the non-target-colored and motion distractors did not reach significance following correction for multiple comparisons (p = 0.033; adjusted alpha = 0.017). 3.2. Contingent capture effects: Auditory stimuli The mean change in reaction time for detecting auditory targets, relative to the no-distractor condition, is presented in Fig. 3A. For children with a cochlear implant reaction times were faster following the presentation of a distractor compared to the no-distractor condition (negative change in response time). Normally hearing children showed a similar, albeit smaller speeding of reaction times, but their responses were slowed following a target-colored distractor. ANOVA

revealed, however, that there were no reliable differences in reaction times between the groups or across the distractor conditions (all p > 0.29). Unlike reaction times, it can be seen in Fig. 3B that there was little change in accuracy for detecting auditory targets following the presentation of a visual distractor (all p > 0.35). Although the previous analysis on the auditory reaction time data revealed that there was no reliable difference across the distractor conditions, the analysis could not reveal whether reaction times were different from the no-distractor condition, as is suggested by the (negative) difference data in Fig. 3A. Consequently, exploratory analysis using a two-tailed t-test was undertaken in order to determine whether distractors (collapsed over type) were associated with a speeding of reaction time compared to the control condition. For the cochlear implant group, the presentation of a distractor was associated with a substantial speeding of reaction times (M = −58.4 ms, SE = 19.9 ms) that was significantly different from baseline (mean difference = −0.0189, 95% CI, −0.0305 to −0.0074; t(38) = −3.311, p = 0.002). For normally hearing children, overall there was a more modest speeding of reaction times following the presentation of a visual distractor (M = −12.8 ms, SE = 15.3 ms), which did not differ from the no-distractor condition (mean

806

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

Fig. 3. Mean change in reaction time (A) and accuracy (B) of normally hearing children and cochlear implant users for detecting auditory targets preceded by a visual distractor. Data show mean difference scores, obtained by subtracting performance in the no-distractor condition from that in the distractor conditions. Error bars show within subjects SE.

difference = −0.0051, 95% CI = −0.0181 to 0.0080; t(38) = −0.782, p > 0.43).

4. Discussion This study investigated attentional control and capture in normally-hearing children and children who use a cochlear implant. It was found that implant users did not differ from age-matched normally hearing children in their temporal allocation of attention, as indexed by performance in detecting visual targets that were embedded in an RSVP stream. It was also found that there was no difference between groups in the effect of top-down attentional control settings on capture by salient visual stimuli. Specifically, in both groups of children visual target detection was poorest following the presentation of an irrelevant distractor that was the same color as the to-be-detected target. Visual distractors did not, however, interfere with detection of auditory targets. 4.1. Temporal allocation attention Previous studies using the continuous performance task suggest that deaf children are impaired in sustained visual attention. Continuous performance tasks

typically require the allocation of attention in time in order to detect a target from amongst an RSVP of distractor numbers. Dye and Bavelier (2010) have proposed that such studies might therefore point to a deafness-induced deficit in the temporal allocation of attention. In support of this idea, they presented evidence showing that deaf children, who had normal (signed) language development and no co-morbid neurological disorders, were poorer at detecting a target-colored item that was embedded in a discontinuous RSVP of colored geometric shapes. In the present study the control (no-distractor) condition was conceptually the same as that used by Dye and Bavelier (2010), but instead of shapes children searched for a target-colored number. Results showed that implant users do not differ from normally hearing children in speed or accuracy for detecting targets embedded in a stream of distractor numbers. Thus, although the paradigm employed here has not been used with deaf children who do not have an implant, the present results are consistent with studies suggesting that sustained visual attention is improved (Quittner et al., 1994; Smith et al., 1998; Horn et al., 2005), or even normalized (Tharpe et al., 2002; Shin et al., 2007), in deaf children who use a cochlear implant. It has been proposed that access to sound improves sustained visual attention by freeing visual resources

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

from the task of environmental monitoring (Quittner et al., 1994; Smith et al., 1998). If so, then it follows that the extent to which vision will continue to be used for monitoring the environment should depend on the quality of the auditory signal received; indeed, differences in hearing outcomes may help to explain some of the reported variability in the sustained attention of implant users (Quittner et al., 1994; Smith et al., 1998; Tharpe et al., 2002; Horn et al., 2005; Shin et al., 2007; Yucel and Derim 2008). Notably, all the implant users in the present study had very good auditory perception abilities. All but one child was also implanted prior to four years of age, which is typically associated with improved hearing outcomes compared to later implantation (for a review, see Kral and Sharma 2012). Early implantation alone, however, does not appear to guarantee normal sustained visual attention (Yucel and Derim 2008). Nonetheless, in addition to early implantation and high-level hearing abilities, the majority (eight of 13) of the cochlear implant users in the current study also had bilateral implants. Importantly, compared to unilateral implantation, bilateral implants can provide for much improved sound localization abilities (for a recent review, see Litovsky 2011), which would presumably increase the efficacy of using audition for environmental monitoring and thus free visual resources for demanding tasks. In this context, we did not find a significant difference in performance between children with unilateral versus bilateral implants, nor did we find any correlation between speech perception scores and the attention effects (data not shown). Given the small size of these subgroups and the homogeneity of speech perception scores, however, these null effects must be interpreted with caution. Further research is needed to investigate whether sustained visual attention differs between unilateral and bilateral implant users, or for cochlear implant users with poorer hearing abilities. 4.2. Contingent attentional capture The primary aim of this study was to investigate whether children who use a cochlear implant differ from their normally hearing peers in distractibility to salient visual events. To address this question, children searched for a target embedded in an RSVP of numbers while irrelevant distractors were flashed on either side of the central display. It has been shown previously that deficits in the performance of deaf children on tasks of

807

sustained visual attention are exacerbated in the presence of irrelevant items flanking the central stream (Mitchell and Quittner 1996). Similar interference effects from irrelevant flankers on selective attention in deaf adults have been taken to indicate an increased sensitivity to extrafoveally presented items (Sladen et al., 2005; Dye et al., 2007). Accordingly, we predicted that children who use a cochlear implant would show increased capture by the irrelevant (flanking) distractors. Furthermore, because deaf individuals show increased sensitivity to motion stimuli (as detailed in the Introduction), it was expected that cochlear implant users would be especially captured by the moving distractors. Neither of these predictions was supported. In the present study it was found that visual performance was degraded in the presence of target-colored distractors compared to distractors that were presented in a non-target color. Critically, colors did not differ in salience at the sensory level and, across participants, were in fact the same colors. The only difference between the target- and non-target-colored distractors was whether they matched the ‘attentional set’ of the observer. Thus, the present results show for the first time that involuntary capture of attention in children, like adults, is contingent on the behavioral goals of the observer (e.g., Folk et al., 1992; Remington et al., 2001; Serences et al., 2005). In addition, we found that target-colored distractors caused more interference than motion distractors, an effect that has also only been reported previously for normally hearing adults (Folk et al., 1994). This result further supports the contention that involuntary capture of visual attention was contingent on the attentional set of the children. Importantly, we did not find any difference in these contingent capture effects between normally hearing children and children who use a cochlear implant. In a previous study with adults that employed a contingent capture task similar to that used here it was found that irrelevant stimuli presented in the target color elicited a shift of visuospatial attention toward the location of the distractor item, as indexed by the N2pc event-related potential (Leblanc et al., 2008). Thus, our results suggest that as well as normal-like temporal attention, proficient cochlear implant users show involuntary shifts of visuospatial attention that are indistinguishable to those observed in their normally hearing peers. Numerous studies have reported that, compared to proficient cochlear implant users and normally hearing

808

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

observers, non-proficient users show alterations in neural and behavioral responses to visual stimuli (Doucet et al., 2006; Champoux et al., 2009; Tremblay et al., 2010; Landry et al., 2012; Sandmann et al., 2012). Such effects have been explained in terms of deafnessinduced plasticity in visual and auditory brain regions, which may limit the neural capacity for learning to integrate the input provided by a cochlear implant (see also, Lee et al., 2005, 2007). For pre-lingually deafened individuals, early access to sound, even if it is highly impoverished and unnatural (Moore and Shannon 2009), combined with appropriate auditory habilitation may be sufficient to avoid such maladaptive plasticity effects. It does not follow, however, that selective visual attention should also be normal in proficient implant users. Specifically, because of the impoverished nature of the auditory input provided by a cochlear implant, users tend to rely more heavily on visual information than do their normally hearing peers (e.g., Schorr et al., 2005; Rouger et al., 2007). Such dependence, as well as any associated learninginduced plasticity, could alter visual attention even in proficient implant users. The current results suggest, however, that early implantation and good hearing outcomes are also associated with normal visual attentional capture and control. A key question in the present study was whether salient visual stimuli interfere with auditory perception in cochlear implant users. In this context there is a wealth of evidence demonstrating cross-modal links in attention and perception in normally hearing individuals (for reviews, see Driver and Spence 2004, Spence, McDonald et al. 2004), including interference effects in both adults and children (e.g., Escera et al., 1998; Gumenyuk et al., 2004). Recently, Champoux and colleagues reported that the speech perception performance of non-proficient cochlear implant users is degraded in the presence of incongruent lip movements and moving dots, but not by a color change (Champoux et al., 2009). It is perhaps not surprising to find that implant users have an increased susceptibility to incongruent lip movements (see also, Desai et al., 2008; Rouger et al., 2008), as the impoverished sound signal provided by a cochlear implant places a larger reliance on visual speech information (Giraud et al., 2001). It is not so clear, however, why moving dots should interfere with speech perception. One possibility is that cross-modal plasticity between visual motion and auditory areas directly interferes with sound processing. Another (non-mutually exclu-

sive) possibility is that highly salient visual stimuli capture attention and thus interfere with auditory perception. Using the task employed in the present study, we have recently shown that target-colored distractors interfere with detection of both visual and auditory stimuli in normally hearing adults (Kamke and Harris 2014). Accordingly, we hypothesized that, compared to their normally hearing peers, auditory detection in children who use a cochlear implant would be poorer following presentation of a target-colored distractor (exaggerated top-down attention effect) and be impacted by irrelevant moving stimuli (bottom-up plasticity effect). In contrast to this prediction, auditory target detection in cochlear implant users was speeded following the presentation of all visual distractors. This speeding may be explained by the fact that, although the lateral visual distractors were irrelevant to the central task, those distractors were nonetheless temporally predictive of a target. It is therefore possible that all distractors had an alerting value, but for visual targets any related cueing effect (response facilitation) was counteracted by an involuntary shift of visuospatial attention toward the distractor item (Hickey et al., 2006). Moreover, when that distractor matched top-down attentional control settings (i.e., was target colored), the item could have gained access to a limited-capacity stage of processing that interfered with visual target detection (Ghorashi et al., 2003). On this argument, for the auditory task the visual distractors also acted as a cue, but any associated shift in visuospatial attention would not be expected to interfere with tone detection. Thus, nontarget-colored and motion distractors could cue the target and reduce reaction times. The target-colored distractor, however, should still interfere with auditory task performance because it causes a bottleneck at a higher-level stage of processing (Kamke and Harris 2014). We found just such a pattern of decrements for normally hearing children in the present study (viz. poorest performance in both the visual and auditory task following a targetcolored distractor; see Figs. 2A and 3A), whereas cochlear implant users showed a facilitation of auditory target detection across all distractor conditions. This result may indicate a greater degree of independence in the higher-level processing of auditory and visual stimuli in cochlear implant users, but further work is required to test this speculation as a difference between the groups was only found in the exploratory analysis.

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

5. Conclusion In summary, we have shown for the first time that children demonstrate similar visual contingent attentional capture effects as do adult observers. This result suggests that distractibility and attentional control related to task-demands mature at an early age. Importantly, children who use a cochlear implant did not differ from their normally hearing peers in these attention effects. It was also shown that auditory perception in children who are proficient cochlear implant users is not harmed by salient visual stimuli, at least for simple sounds presented in quiet conditions. The same children, however, may show some differences in cross-modal attentional effects compared to their normally hearing counterparts. Ultimately, a better understanding of how selective attention influences visual and auditory processing in individuals who hear with a cochlear implant will help to inform habilitation strategies. Acknowledgments The authors wish to thank Oscar Jacoby for programming assistance. This work was supported by a project grant from The Garnett Passe and Rodney Williams Memorial Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The content is solely the responsibility of the authors and does not necessarily represent the official views of the Foundation. Conflict of interests The authors declare that they have no conflict of interests regarding the publication of this article. Dr Gabriella Constantinescu is employed by Hear and Say. References

809

Bavelier, D., Brozinsky, C., Tomann, A., Mitchell, T., Neville, H., & Liu, G. (2001). Impact of early deafness and early exposure to sign language on the cerebral organization for motion processing. J Neurosci, 21(22), 8931-8942. Bavelier, D., Dye, M.W.G., & Hauser, P.C. (2006). Do deaf individuals see better? Trends Cogn Sci, 10(11), 512-518. Bavelier, D., Tomann, A., Hutton, C., Mitchell, T., Corina, D., Liu, G., & Neville, H. (2000). Visual attention to the periphery is enhanced in congenitally deaf individuals. J Neurosci, 20(17), RC93. Black, J., Hickson, L., & Black, B. (2012). Defining and evaluating success in paediatric cochlear implantation–an exploratory study. Int J Pediatr Otorhi, 76(9), 1317-1326. Bosworth, R.G., & Dobkins, K.R. (2002). The effects of spatial attention on motion processing in deaf signers, hearing signers, and hearing nonsigners. Brain Cogn, 49(1), 152-169. Champoux, F., Lepore, F., Gagne, J.-P., & Theoret, H. (2009). Visual stimuli can impair auditory processing in cochlear implant users. Neuropsychologia, 47(1), 17-22. Chute, P.M., & Nevins, M.E. (2003). Educational challenges for children with cochlear implants. Top Lang Disord, 23(1), 57-67. Corbetta, M., & Shulman, G.L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat Rev Neurosci, 3(3), 201-215. Cousineau, D. (2005). Confidence intervals in within-subject designs: A simpler solution to Loftus and Masson’s method. Tutorials Quant Meth Psych, 1(1), 42-45. Desai, S., Stickney, G., & Zeng, F-G (2008). Auditory-visual speech perception in normal-hearing and cochlear-implant listeners. J Acoust Soc Am, 123(1), 428-440. Doucet, M.E., Bergeron, F., Lassonde, M., Ferron, P., & Lepore, F. (2006). Cross-modal reorganization and speech perception in cochlear implant users. Brain, 129(12), 3376-3383. Driver, J., & Spence, C. (2004). Crossmodal spatial attention: Evidence from human performance, Crossmodal space and crossmodal attention. C. Spence and J. Driver. Oxford. Oxford University Press, pp. 179-220. Dye, M.W.G., Baril, D.E., & Bavelier, D. (2007). Which aspects of visual attention are changed by deafness? The case of the Attentional Network Test. Neuropsychologia, 45(8), 18011811. Dye, M.W.G., & Bavelier, D. (2010). Attentional enhancements and deficits in deaf populations: An integrative review. Restor Neurol Neurosci, 28(2), 181-192. Dye, M.W.G., Hauser, P.C., & Bavelier, D. (2008). Visual attention in deaf children and adults: Implications for learning environments, Deaf cognition: Foundations and outcomes, M. Matschark and P. C. Hauser. New York, Oxford University Press, pp. 250-263.

AG Bell Academy for Listening and Spoken Language (2013). Principles of LSLS Auditory-Verbal therapy. Retrieved 19 June, 2014, from http://www.listeningandspokenlanguage. org/AcademyDocument.aspx?id=563.

Dye, M.W.G., Hauser, P.C., & Bavelier, D. (2009). Is visual selective attention in deaf individuals enhanced or deficient? The case of the useful field of view. PLoS ONE, 4(5), e5640.

Armstrong, B.A., Neville, H.J., Hillyard, S.A., & Mitchell, T.V. (2002). Auditory deprivation affects processing of motion, but not color. Brain Res Cogn Brain Res, 14(3), 422-434.

Escera, C., Alho, K., Winkler, I., & Naatanen, R. (1998). Neural mechanisms of involuntary attention to acoustic novelty and change. J Cogn Neurosci, 10(5), 590-604.

810

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

Fine, I., Finney, E.M., Boynton, G.M., & Dobkins, K.R. (2005). Comparing the effects of auditory deprivation and sign language within the auditory and visual cortex. J Cogn Neurosci, 17(10), 1621-1637. Finney, E.M., Clementz, B.A., Hickok, G., & Dobkins, K.R.C.A. (2003). Visual stimuli activate auditory cortex in deaf subjects: Evidence from MEG. Neuroreport, 14(11), 1425-1427. Finney, E.M., & Dobkins, K.R. (2001). Visual contrast sensitivity in deaf versus hearing populations: Exploring the perceptual consequences of auditory deprivation and experience with a visual language. Brain Res Cogn Brain Res, 11(1), 171-183. Folk, C.L., Remington, R.W., & Johnston, J.C. (1992). Involuntary covert orienting is contingent on attentional control settings. J Exp Psychol Hum Percept Perform, 18(4), 1030-1044. Folk, C.L., Remington, R.W., & Wright, J.H. (1994). The structure of attentional control: Contingent attentional capture by apparent motion, abrupt onset, and color. J Exp Psychol Hum Percept Perform, 20(2), 317-329. Ghorashi, S.M.S., Zuvic, S.M., Visser, T.A.W., & Di Lollo, V. (2003). Focal distraction: Spatial shifts of attentional focus are not required for contingent capture. J Exp Psychol Hum Percept Perform, 29(1), 78-91. Giraud, A.L., Price, C.J., Graham, J.M., Truy, E., & Frackowiak, R.S. (2001). Cross-modal plasticity underpins language recovery after cochlear implantation. Neuron, 30(3), 657-663. Gumenyuk, V., Korzyukov, O., Alho, K., Escera, C., & Naatanen, R. (2004). Effects of auditory distraction on electrophysiological brain activity and performance in children aged 8-13 years. Psychophysiology, 41(1), 30-36. Hickey, C., McDonald, J.J., & Theeuwes, J. (2006). Electrophysiological evidence of the capture of visual attention. J Cogn Neurosci, 18(4), 604-613. Horn, D.L., Davis, R.A.O., Pisoni, D.B., & Miyamoto, R.T. (2005). Development of visual attention skills in prelingually deaf children who use cochlear implants. Ear Hear, 26(4), 389-408. Kamke, M.R., & Harris, J. (2014). Contingent capture of involuntary visual attention interferes with detection of auditory stimuli, Frontiers in Psychology, pp. 5. Knudsen, E.I. (2007). Fundamental components of attention. Annu Rev Neurosci, 30, 57-78. Kral, A., & Sharma, A. (2012). Developmental neuroplasticity after cochlear implantation. Trends Neurosci, 35(2), 111-122. Landry, S., Bacon, B.A., Leybaert, J., Gagne, J.P., & Champoux, F. (2012). Audiovisual segregation in cochlear implant users. PLoS ONE, 7(3), e33113. Lavie, N. (2005). Distracted and confused?: Selective attention under load. Trends Cogn Sci, 9(2), 75-82. Leblanc, E., & Jolicoeur, P. (2005). The time course of the contingent spatial blink. Can J Exp Psychol, 59(2), 124-131. Leblanc, E., Prime, D.J., & Jolicoeur, P. (2008). Tracking the location of visuospatial attention in a contingent capture paradigm. J Cogn Neurosci, 20(4), 657-671. Lee, D.S., Lee, J.S., Oh, S.H., Kim, S.K., Kim, J.W., Chung, J.K., Lee, M.C., & Kim, C.S. (2001). Cross-modal plasticity and cochlear implants. Nature, 409(6817), 149-150.

Lee, H.J., Giraud, A.L., Kang, E., Oh, S.H., Kang, H., Kim, C.S., & Lee, D.S. (2007). Cortical activity at rest predicts cochlear implantation outcome. Cereb Cortex, 17(4), 909-917. Lee, H.J., Kang, E., Oh, S.H., Kang, H., Lee, D.S., Lee, M.C., & Kim, C.S. (2005). Preoperative differences of cerebral metabolism relate to the outcome of cochlear implants in congenitally deaf children. Hear Res, 203(1-2), 2-9. Litovsky, R.Y. (2011). Review of recent work on spatial hearing skills in children with bilateral cochlear implants, Cochlear Implants Int, 12(Suppl 1), S30-34. Loke, W.H., & Song, S. (1991). Central and peripheral visual processing in hearing and nonhearing individuals. Bull Psychonomic Soc, 29(5), 437-440. Mitchell, T.V., & Quittner, A.L. (1996). Multimethod study of attention and behavior problems in hearing-impaired children. J Clin Child Adolesc Psychol, 25(1), 83-96. Moore, D.R., & Shannon, R.V. (2009). Beyond cochlear implants: Awakening the deafened brain. Nat Neurosci, 12(6), 686-691. Neville, H.J., & Lawson, D. (1987a). Attention to central and peripheral visual space in a movement detection task. III. Separate effects of auditory deprivation and acquisition of a visual language. Brain Res, 405(2), 284-294. Neville, H.J., & Lawson, D. (1987b). Attention to central and peripheral visual space in a movement detection task: An event-related potential and behavioral study. I. Normal hearing adults. Brain Res, 405(2), 253-267. Neville, H.J., & Lawson, D. (1987c). Attention to central and peripheral visual space in a movement detection task: An event-related potential and behavioral study. II. Congenitally deaf adults. Brain Res, 405(2), 268-283. Parasnis, I., & Samar, V.J. (1985). Parafoveal attention in congenitally deaf and hearing young adults. Brain Cogn, 4(3), 313-327. Proksch, J., & Bavelier, D. (2002). Changes in the spatial distribution of visual attention after early deafness. J Cogn Neurosci, 14(5), 687-701. Quittner, A.L., Smith, L.B., Osberger, M.J., Mitchell, T.V., & Katz, D.B. (1994). The impact of audition on the development of visual attention. Psychol Sci, 5(6), 347-353. Remington, R.W., Folk, C.L., & McLean, J.P. (2001). Contingent attentional capture or delayed allocation of attention? Percept Psychophys, 63(2), 298-307. Rouger, J., Fraysse, B., Deguine, O., & Barone, P. (2008). McGurk effects in cochlear-implanted deaf subjects. Brain Res, 1188, 87-99. Rouger, J., Lagleyre, S., Fraysse, B., Deneve, S., Deguine, O., & Barone, P. (2007). Evidence that cochlear-implanted deaf patients are better multisensory integrators. Proc Natl Acad Sci U S A, 104(17), 7295-7300. Sandmann, P., Dillier, N., Eichele, T., Meyer, M., Kegel, A., PascualMarqui, R.D., Marcar, V.L., Jancke, L., & Debener, S. (2012). Visual activation of auditory cortex reflects maladaptive plasticity in cochlear implant users. Brain, 135(2), 555-568. Schorr, E.A., Fox, N.A., van Wassenhove, V., & Knudsen, E.I. (2005). Auditory-visual fusion in speech perception in children

M.R. Kamke et al. / Contingent capture of involuntary visual spatial attention

with cochlear implants. Proc Natl Acad Sci U S A, 102(51), 18748-18750. Serences, J., T., Shomstein, S., Leber, A., B., Golay, X., Egeth, H., E. & Yantis, S. (2005). Coordination of voluntary and stimulusdriven attentional control in human cortex. Psychol Sci, 16(2), 114-122. Shin, M.-S., Kim, S.-K., Kim, S.-S., Park, M.-H., Kim, C.-S., & Oh, S.-H. (2007). Comparison of cognitive function in deaf children between before and after cochlear implant. Ear Hear, 28(2 Suppl), 22S-28S. Sladen, D.P., Tharpe, A.M., Ashmead, D.H., Grantham, D.W., & Chun, M.M. (2005). Visual attention in deaf and normal hearing adults: Effects of stimulus compatibility. J Speech Lang Hear Res, 48(6), 1529-1537. Smith, L.B., Quittner, A.L., Osberger, M.J., & Miyamoto, R. (1998). Audition and visual attention: The developmental trajectory in deaf and hearing populations. Dev Psychol, 34(5), 840-850.

811

Spence, C., McDonald, J., & Driver, J. (2004). Exogenous spatialcueing studies of human crossmodal attention and multisensory integration, Crossmodal space and crossmodal attention. C. Spence and J. Driver. Oxford, Oxford University Press, pp. 277-320. Stevens, C., & Neville, H. (2006). Neuroplasticity as a double-edged sword: Deaf enhancements and dyslexic deficits in motion processing. J Cogn Neurosci, 18(5), 701-714. Tharpe, A.M., Ashmead, D.H., & Rothpletz, A.M. (2002). Visual attention in children with normal hearing, children with hearing aids, and children with cochlear implants. J Speech Lang Hear Res, 45(2), 403-413. Tremblay, C., Champoux, F., Lepore, F., & Th´eoret, H. (2010). Audiovisual fusion and cochlear implant proficiency. Restor Neurol Neurosci, 28(2), 283-291. Yucel, E., & Derim, D. (2008). The effect of implantation age on visual attention skills. Int J Pediatr Otorhi, 72(6), 869-877.

Copyright of Restorative Neurology & Neuroscience is the property of IOS Press and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use.

Contingent capture of involuntary visual spatial attention does not differ between normally hearing children and proficient cochlear implant users.

Evidence suggests that deafness-induced changes in visual perception, cognition and attention may compensate for a hearing loss. Such alterations, how...
315KB Sizes 0 Downloads 5 Views