Accepted Manuscript Social Media Metrics and Bibliometric Profiles of Neurosurgical Departments and Journals: Is There a Relationship? Naif M. Alotaibi, M.D., Daipayan Guha, M.D., Aria Fallah, M.D., M.S.c., Abdulrahman Aldakkan, M.D., Farshad Nassiri, M.D., Jetan H. Badhiwala, M.D., George M. Ibrahim, M.D., Ph.D., Mohammed F. Shamji, M.D., Ph.D., R. Loch Macdonald, M.D., Ph.D., Andres M. Lozano, MD, Ph.D. PII:
S1878-8750(16)00175-3
DOI:
10.1016/j.wneu.2016.01.087
Reference:
WNEU 3691
To appear in:
World Neurosurgery
Received Date: 14 December 2015 Revised Date:
26 January 2016
Accepted Date: 27 January 2016
Please cite this article as: Alotaibi NM, Guha D, Fallah A, Aldakkan A, Nassiri F, Badhiwala JH, Ibrahim GM, Shamji MF, Macdonald RL, Lozano AM, Social Media Metrics and Bibliometric Profiles of Neurosurgical Departments and Journals: Is There a Relationship?, World Neurosurgery (2016), doi: 10.1016/j.wneu.2016.01.087. This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Alotaibi
ACCEPTED MANUSCRIPT 1
Title: Social Media Metrics and Bibliometric Profiles of Neurosurgical Departments
2
and Journals: Is There a Relationship?
3
Authors: Naif M Alotaibi, M.D.1,2,3, Daipayan Guha, M.D.1,2, Aria Fallah, M.D.,
5
M.S.c.4, Abdulrahman Aldakkan, M.D.1,5, Farshad Nassiri, M.D.1, Jetan H Badhiwala,
6
M.D.1, George M Ibrahim, M.D., Ph.D.1, Mohammed F Shamji, M.D., Ph.D. 1,6, R.
7
Loch Macdonald, M.D., Ph.D. 1,7, Andres M Lozano, MD, Ph.D.1,6
RI PT
4
8 9
Affiliations: 1
Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
11
2
Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
12 13
3
14
4
Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
15
5
Division of Neurosurgery, King Saud University, Riyadh, Saudi Arabia.
16 17 18 19
6
Division of Neurosurgery, Toronto Western Hospital, Toronto, Ontario, Canada.
7
Division of Neurosurgery, St Michael's Hospital, Toronto, Ontario, Canada
SC
10
TE D
M AN U
Department of Neurosurgery, National Neuroscience Institute, King Fahad Medical City, Riyadh, Saudi Arabia.
20 21
Corresponding Author:
Andres M Lozano, MD, Ph.D
23
Professor and Dan Family Chairman of Neurosurgery University of Toronto
24
RR Tasker Chair in Functional Neurosurgery, Toronto Western Hospital
25
Senior Scientist, Toronto Western Research Institute
26
399 Bathurst St., WW 4-447 Toronto, ON M5T 2S8
28 29 30
AC C
27
EP
22
Tel: (416) 603-5800 ext. 3712 Fax: (416) 603-5298 Email: [email protected]
31
Submission: Ms. Ref. No.: WNS-15-1710 - World Neurosurgery - Revised
32
Manuscript word count: 1880
33
Title character count: 114
34
Figures: 0
35
Tables: 6
36
Supplementary tables: 2
37
Keywords: Social Media; Neurosurgery; Bibliometric,
Page 1
Alotaibi
ACCEPTED MANUSCRIPT 38 39
INTRODUCTION Social media is a relatively recent online phenomenon, encompassing text and multimedia-based communication. With the recent surge in use of social media
41
networks, the association between social media metrics and academic productivity for
42
institutions, journals and individual researchers has become a topic of interest. Our
43
research group recently published a descriptive analysis of the current use of social
44
media in neurosurgery and found important variability in popularity of social media
45
networks across different neurosurgical institutions, journals, and societies.1
46
However, the association of this variability on academic productivity has yet to be
47
determined.
SC
M AN U
48
RI PT
40
Herein, we report an exploratory analysis to investigate the relationship between social media metrics and academic indices of neurosurgical programs and
50
journals with a focus on both cranial and spine surgery. In the current academic
51
climate, this is especially important given the emphasis placed on productivity within
52
neurosurgical departments and recently-identified associations between social media
53
visibility and measures of academic impact, such as journal citations.1-3
54
56 57
METHODS
AC C
55
EP
TE D
49
Social Media Accounts Here, we utilized a comprehensive two-stage search strategy in order to
58
determine the number of social media accounts for academic neurosurgical
59
departments and journals. The full details of the search strategy have been previously
60
published.1 Briefly, the first stage involved an online search using Facebook and
61
Twitter search engines in November 2015 using the following general keywords in
62
combination: "neurosurgery, neurosurgical, neurological, neurology, brain, spine,
Page 2
Alotaibi
ACCEPTED MANUSCRIPT surgery, surgical, department, division, institute, journal". In the second stage, the
64
official websites for academic neurosurgical departments that were accredited by the
65
Accreditation Council for Graduate Medical Education (ACGME) and the Royal
66
College of Physicians and Surgeons of Canada (RCPSC), were searched for external
67
links to dedicated Facebook and Twitter.
68
RI PT
63
For journals, we searched the SCImago Journal and Country Rank website
(http://www.scimagojr.com/ ) with the above mentioned keywords to identify those
70
journals focused on neurosurgery and spine. SCImago includes the journals and
71
country scientific indicators reflective of the data from the Scopus Database.
72
M AN U
SC
69
73
Social Media Metrics
74
The following data were collected from each social media account identified:(1) metrics of attendance/popularity, the number of “likes” for Facebook
76
pages, and “followers” for Twitter accounts; and (2) metrics of account activity and
77
engagement, the "number of tweets", "twitter likes" or "favorite", as well as the
78
"Klout score". The Klout score is a social media engagement metric between 1-100
79
that measures Twitter's accounts influence on social networks (https://klout.com). 4, 5
81 82
EP
AC C
80
TE D
75
Academic Metrics
After identifying all official social media accounts for neurosurgical
83
departments and journals, we extracted academic productivity indices of US and
84
Canadian neurosurgical programs from recently published data.6, 7 We included the
85
following metrics: ih(5)-index, summed h-index, total publications and number of
86
citations. Definitions of these metrics are detailed in the original publications.6-8 For
87
journals, we included the most updated numbers for h index and SCImago Journal
Page 3
Alotaibi
ACCEPTED MANUSCRIPT 88
Rank (SJR) indicator as listed in their website. SJR indicator was selected instead of
89
the Thomson Reuters's Impact Factor because it was available to all our screened
90
journals.
91
93
Statistical Analysis
RI PT
92
Statistical analysis was performed only for departments with a
bibliometric profile listed in Taylor et al /Lozano et al publications and for all journals
95
that had SJR indicator/h-index. 6, 7 The mean, median, standard deviation (SD) and
96
interquartile range (IQR) for social media metrics were calculated. Our statistical
97
approach acknowledged that our data violated assumptions for parametric analysis,
98
which has been previously described in studies involving social media metrics. 3, 9, 10
99
For this reason, we performed non-parametric tests with bootstrapping to evaluate: (1)
M AN U
SC
94
if there were any differences in academic indices of departments and journals based
101
on their presence on social media (Mann- Whitney U test), and (2) to look for
102
correlation between social media and academic metrics among departments and
103
journals that were present on social media (Spearman's rank-order correlation test).
104
Bootstrapping is a distribution-independent resampling method for data with
105
insufficient sample size and complicated distribution. The strength of the relationship
106
was described by the correlation coefficient. P values are based on two-sided tests and
107
values less than 0.05 were considered significant. All statistical analyses were
108
performed with SPSS version 21 (IBM SPSS Statistics, Chicago, IL).
AC C
EP
TE D
100
109 110 111 112
Page 4
Alotaibi
ACCEPTED MANUSCRIPT 113
RESULTS Social Media and Academic Metrics
115
Academic departments: There were 119 programs accredited by the
116
ACGME and RCPSC. Our search yielded 36 social media accounts officially
117
affiliated with academic neurosurgical institutions (20 Facebook, and 16 Twitter).
118
Fourteen departments had both Facebook and Twitter accounts, 6 departments with
119
Facebook accounts, and 2 departments with Twitter account. These accounts
120
represented 22 out of 119 neurosurgical programs in North America (18.4%). One
121
hundred and four departments had bibliometric profiles listed in Taylor et al/Lozano
122
et al publications.6, 7 Fifteen departments (All without social media presence except
123
one) were excluded from our analysis as they were not listed among departments with
124
academic metrics. Supplementary table 1 shows all 119 academic departments that
125
were included or excluded from our analysis.
SC
M AN U
The total number of likes on Facebook was 23,997 (mean: 1199.85, SD:
TE D
126
RI PT
114
1368.9, range: 208-6085, median: 793, IQR 865) and total number of followers on
128
Twitter was 13,121 (mean: 874.7, range: 66-2071, SD: 618, median: 650, IQR 900).
129
All departments with both social media and academic metrics in neurosurgery are
130
shown in Table 1. University of Southern California was the most followed
131
department on Facebook and Twitter, followed by University of Toronto on Facebook
132
and University of Texas Health Science Center, San Antonio on Twitter. All eligible
133
social media accounts in our analysis belonged to US programs except one account
134
from Canada (University of Toronto).
AC C
EP
127
135 136 137
Journals: We identified 38 journals in the SCImago Journal and Country Rank website with interest in neurosurgery and spine surgery. All journals had
Page 5
Alotaibi
ACCEPTED MANUSCRIPT available SJR/h-index records. Supplementary table 2 shows a complete list of all
139
screened journals. Eleven out of 38 screened neurosurgical journals (28.9%) had
140
social media accounts (11 Facebook, and 11 Twitter). The total number of likes on
141
Facebook was 50,157 (mean: 4559.7, SD: 4892.8, range: 28-16500, median: 3410,
142
IQR 3371) and total number of followers on Twitter was 31,906 (mean: 2900.5, SD:
143
2635.4, range: 10-8290, median: 3672, IQR 3956). All neurosurgical and spine
144
journals with both social media and academic metrics are shown in Table 2.
RI PT
138
SC
145
Associations among social media metrics and bibliometric profiles
147
Academic departments: As mentioned above, 15 departments were
M AN U
146
excluded. Therefore, 104 departments were compared against each other based on
149
social media presence. The presence of a social media account for departments was
150
associated with statistically significantly higher values of academic impact metrics
151
(ih(5)-index, summed h-index, total publications, and total citations) on Mann-
152
Whitney U test (Table 3). Among the 21 departments with both types of metrics,
153
none of the social metrics had statistically-significant correlation values with any of
154
the academic indices; the number of tweets had the most positive correlation values
155
with academic metrics. Table 4 shows Spearman's rank-order correlation test values
156
for all metrics in our analysis.
158
EP
AC C
157
TE D
148
Journals: Journals with social media accounts had significantly higher values
159
of H-index and SJR on Mann-Whitney U test (P
S1878-8750(16)00175-3
DOI:
10.1016/j.wneu.2016.01.087
Reference:
WNEU 3691
To appear in:
World Neurosurgery
Received Date: 14 December 2015 Revised Date:
26 January 2016
Accepted Date: 27 January 2016
Please cite this article as: Alotaibi NM, Guha D, Fallah A, Aldakkan A, Nassiri F, Badhiwala JH, Ibrahim GM, Shamji MF, Macdonald RL, Lozano AM, Social Media Metrics and Bibliometric Profiles of Neurosurgical Departments and Journals: Is There a Relationship?, World Neurosurgery (2016), doi: 10.1016/j.wneu.2016.01.087. This is a PDF file of an unedited manuscript that has been accepted for publication. As a service to our customers we are providing this early version of the manuscript. The manuscript will undergo copyediting, typesetting, and review of the resulting proof before it is published in its final form. Please note that during the production process errors may be discovered which could affect the content, and all legal disclaimers that apply to the journal pertain.
Alotaibi
ACCEPTED MANUSCRIPT 1
Title: Social Media Metrics and Bibliometric Profiles of Neurosurgical Departments
2
and Journals: Is There a Relationship?
3
Authors: Naif M Alotaibi, M.D.1,2,3, Daipayan Guha, M.D.1,2, Aria Fallah, M.D.,
5
M.S.c.4, Abdulrahman Aldakkan, M.D.1,5, Farshad Nassiri, M.D.1, Jetan H Badhiwala,
6
M.D.1, George M Ibrahim, M.D., Ph.D.1, Mohammed F Shamji, M.D., Ph.D. 1,6, R.
7
Loch Macdonald, M.D., Ph.D. 1,7, Andres M Lozano, MD, Ph.D.1,6
RI PT
4
8 9
Affiliations: 1
Division of Neurosurgery, Department of Surgery, University of Toronto, Toronto, Ontario, Canada
11
2
Institute of Medical Science, Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
12 13
3
14
4
Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
15
5
Division of Neurosurgery, King Saud University, Riyadh, Saudi Arabia.
16 17 18 19
6
Division of Neurosurgery, Toronto Western Hospital, Toronto, Ontario, Canada.
7
Division of Neurosurgery, St Michael's Hospital, Toronto, Ontario, Canada
SC
10
TE D
M AN U
Department of Neurosurgery, National Neuroscience Institute, King Fahad Medical City, Riyadh, Saudi Arabia.
20 21
Corresponding Author:
Andres M Lozano, MD, Ph.D
23
Professor and Dan Family Chairman of Neurosurgery University of Toronto
24
RR Tasker Chair in Functional Neurosurgery, Toronto Western Hospital
25
Senior Scientist, Toronto Western Research Institute
26
399 Bathurst St., WW 4-447 Toronto, ON M5T 2S8
28 29 30
AC C
27
EP
22
Tel: (416) 603-5800 ext. 3712 Fax: (416) 603-5298 Email: [email protected]
31
Submission: Ms. Ref. No.: WNS-15-1710 - World Neurosurgery - Revised
32
Manuscript word count: 1880
33
Title character count: 114
34
Figures: 0
35
Tables: 6
36
Supplementary tables: 2
37
Keywords: Social Media; Neurosurgery; Bibliometric,
Page 1
Alotaibi
ACCEPTED MANUSCRIPT 38 39
INTRODUCTION Social media is a relatively recent online phenomenon, encompassing text and multimedia-based communication. With the recent surge in use of social media
41
networks, the association between social media metrics and academic productivity for
42
institutions, journals and individual researchers has become a topic of interest. Our
43
research group recently published a descriptive analysis of the current use of social
44
media in neurosurgery and found important variability in popularity of social media
45
networks across different neurosurgical institutions, journals, and societies.1
46
However, the association of this variability on academic productivity has yet to be
47
determined.
SC
M AN U
48
RI PT
40
Herein, we report an exploratory analysis to investigate the relationship between social media metrics and academic indices of neurosurgical programs and
50
journals with a focus on both cranial and spine surgery. In the current academic
51
climate, this is especially important given the emphasis placed on productivity within
52
neurosurgical departments and recently-identified associations between social media
53
visibility and measures of academic impact, such as journal citations.1-3
54
56 57
METHODS
AC C
55
EP
TE D
49
Social Media Accounts Here, we utilized a comprehensive two-stage search strategy in order to
58
determine the number of social media accounts for academic neurosurgical
59
departments and journals. The full details of the search strategy have been previously
60
published.1 Briefly, the first stage involved an online search using Facebook and
61
Twitter search engines in November 2015 using the following general keywords in
62
combination: "neurosurgery, neurosurgical, neurological, neurology, brain, spine,
Page 2
Alotaibi
ACCEPTED MANUSCRIPT surgery, surgical, department, division, institute, journal". In the second stage, the
64
official websites for academic neurosurgical departments that were accredited by the
65
Accreditation Council for Graduate Medical Education (ACGME) and the Royal
66
College of Physicians and Surgeons of Canada (RCPSC), were searched for external
67
links to dedicated Facebook and Twitter.
68
RI PT
63
For journals, we searched the SCImago Journal and Country Rank website
(http://www.scimagojr.com/ ) with the above mentioned keywords to identify those
70
journals focused on neurosurgery and spine. SCImago includes the journals and
71
country scientific indicators reflective of the data from the Scopus Database.
72
M AN U
SC
69
73
Social Media Metrics
74
The following data were collected from each social media account identified:(1) metrics of attendance/popularity, the number of “likes” for Facebook
76
pages, and “followers” for Twitter accounts; and (2) metrics of account activity and
77
engagement, the "number of tweets", "twitter likes" or "favorite", as well as the
78
"Klout score". The Klout score is a social media engagement metric between 1-100
79
that measures Twitter's accounts influence on social networks (https://klout.com). 4, 5
81 82
EP
AC C
80
TE D
75
Academic Metrics
After identifying all official social media accounts for neurosurgical
83
departments and journals, we extracted academic productivity indices of US and
84
Canadian neurosurgical programs from recently published data.6, 7 We included the
85
following metrics: ih(5)-index, summed h-index, total publications and number of
86
citations. Definitions of these metrics are detailed in the original publications.6-8 For
87
journals, we included the most updated numbers for h index and SCImago Journal
Page 3
Alotaibi
ACCEPTED MANUSCRIPT 88
Rank (SJR) indicator as listed in their website. SJR indicator was selected instead of
89
the Thomson Reuters's Impact Factor because it was available to all our screened
90
journals.
91
93
Statistical Analysis
RI PT
92
Statistical analysis was performed only for departments with a
bibliometric profile listed in Taylor et al /Lozano et al publications and for all journals
95
that had SJR indicator/h-index. 6, 7 The mean, median, standard deviation (SD) and
96
interquartile range (IQR) for social media metrics were calculated. Our statistical
97
approach acknowledged that our data violated assumptions for parametric analysis,
98
which has been previously described in studies involving social media metrics. 3, 9, 10
99
For this reason, we performed non-parametric tests with bootstrapping to evaluate: (1)
M AN U
SC
94
if there were any differences in academic indices of departments and journals based
101
on their presence on social media (Mann- Whitney U test), and (2) to look for
102
correlation between social media and academic metrics among departments and
103
journals that were present on social media (Spearman's rank-order correlation test).
104
Bootstrapping is a distribution-independent resampling method for data with
105
insufficient sample size and complicated distribution. The strength of the relationship
106
was described by the correlation coefficient. P values are based on two-sided tests and
107
values less than 0.05 were considered significant. All statistical analyses were
108
performed with SPSS version 21 (IBM SPSS Statistics, Chicago, IL).
AC C
EP
TE D
100
109 110 111 112
Page 4
Alotaibi
ACCEPTED MANUSCRIPT 113
RESULTS Social Media and Academic Metrics
115
Academic departments: There were 119 programs accredited by the
116
ACGME and RCPSC. Our search yielded 36 social media accounts officially
117
affiliated with academic neurosurgical institutions (20 Facebook, and 16 Twitter).
118
Fourteen departments had both Facebook and Twitter accounts, 6 departments with
119
Facebook accounts, and 2 departments with Twitter account. These accounts
120
represented 22 out of 119 neurosurgical programs in North America (18.4%). One
121
hundred and four departments had bibliometric profiles listed in Taylor et al/Lozano
122
et al publications.6, 7 Fifteen departments (All without social media presence except
123
one) were excluded from our analysis as they were not listed among departments with
124
academic metrics. Supplementary table 1 shows all 119 academic departments that
125
were included or excluded from our analysis.
SC
M AN U
The total number of likes on Facebook was 23,997 (mean: 1199.85, SD:
TE D
126
RI PT
114
1368.9, range: 208-6085, median: 793, IQR 865) and total number of followers on
128
Twitter was 13,121 (mean: 874.7, range: 66-2071, SD: 618, median: 650, IQR 900).
129
All departments with both social media and academic metrics in neurosurgery are
130
shown in Table 1. University of Southern California was the most followed
131
department on Facebook and Twitter, followed by University of Toronto on Facebook
132
and University of Texas Health Science Center, San Antonio on Twitter. All eligible
133
social media accounts in our analysis belonged to US programs except one account
134
from Canada (University of Toronto).
AC C
EP
127
135 136 137
Journals: We identified 38 journals in the SCImago Journal and Country Rank website with interest in neurosurgery and spine surgery. All journals had
Page 5
Alotaibi
ACCEPTED MANUSCRIPT available SJR/h-index records. Supplementary table 2 shows a complete list of all
139
screened journals. Eleven out of 38 screened neurosurgical journals (28.9%) had
140
social media accounts (11 Facebook, and 11 Twitter). The total number of likes on
141
Facebook was 50,157 (mean: 4559.7, SD: 4892.8, range: 28-16500, median: 3410,
142
IQR 3371) and total number of followers on Twitter was 31,906 (mean: 2900.5, SD:
143
2635.4, range: 10-8290, median: 3672, IQR 3956). All neurosurgical and spine
144
journals with both social media and academic metrics are shown in Table 2.
RI PT
138
SC
145
Associations among social media metrics and bibliometric profiles
147
Academic departments: As mentioned above, 15 departments were
M AN U
146
excluded. Therefore, 104 departments were compared against each other based on
149
social media presence. The presence of a social media account for departments was
150
associated with statistically significantly higher values of academic impact metrics
151
(ih(5)-index, summed h-index, total publications, and total citations) on Mann-
152
Whitney U test (Table 3). Among the 21 departments with both types of metrics,
153
none of the social metrics had statistically-significant correlation values with any of
154
the academic indices; the number of tweets had the most positive correlation values
155
with academic metrics. Table 4 shows Spearman's rank-order correlation test values
156
for all metrics in our analysis.
158
EP
AC C
157
TE D
148
Journals: Journals with social media accounts had significantly higher values
159
of H-index and SJR on Mann-Whitney U test (P
