Home » 51 (2010), Featured Articles, Research

Satisfaction of JELIS Subscribers and Users: Comparative Analysis By Sung Jae Park and Janet L. Capps

9 September 2011 No Comment

Keywords: JELIS, JELIS website, satisfaction survey, online questionnaire

Introduction

This  is  a  year  two  report  of  a  3-­year  longitudinal  design  that  tracks  the  Journal   of   Education   for   Library   and   Information   Science   (JELIS)   subscribers/readers’   satisfaction  with  the  scholarly,  double-­blind,   peer-­reviewed  publication  of  the  Association   for   Library   and   Information   Science   Education   (ALISE).   According   to   Park   and   Capps,   last   year’s   2009   JELIS   survey   indicated   “that   relevance   and   quality   of   content   are   major   factors   contributing   to   the   dissatisfaction   with   JELIS”   (2010,   p.  7).  This  year’s  JELIS  2010  Satisfaction   Survey   addresses   these   factors   and   highlights   the   changes   noted   in   user   satisfaction   as   indicated   by   the   feedback   of   the   anonymous  participants  (n  =  76).
As  part  of  their  stated  editorial  goals  to   make   JELIS   a   communication   dissemination  hub,  Burnett  and  Kazmer  demonstrated  a  concerted  effort  over  the  past  year  to   raise  the  acceptance  standards  of  the  manuscript   publications.   They   also   initiated   the  process  of  activating  the  evaluation  of   JELIS   for   inclusion   in   ISI.   In   addition   to   keeping   the   journal   publication   on   schedule,   the   Editors   continued   to   improve   the   journal’s  presentation  format;  e.g.,  reducing  the  table  size  and  adding  the  month.
The   web   presence   role   of   the   jelis.org   community   was   expanded   to   meet   the   needs   of   a   dynamic   research   community.   Operating   within   copyright   boundaries,   the   site   provides   high-­quality   content   online   and   communication   tools   that   may   be   used  to  initiate  scholarly  debate  on  current   issues.   The   jelis.org   site   is   designed   to   address  the  information  needs  of  JELIS  readers,  reviewers,  and  future  contributors.

Research  Design

The   JELIS   Satisfaction   survey   was   designed  to  assess  the  satisfaction  of  readers   and   to   inform   the   editorial   decision   processes.  The five major categories devised for   the   2009   survey   were   carried   over   to   the  2010  administered  online  survey.  The   areas   were:   (1)   JELIS   use,   (2)   degree   of   satisfaction,  (3)  topics  on  demand,  (4)  loyalty,   and   (5)   demographic   questions.   The   questionnaire   scope   covered   the   JELIS   subscribers/readers’  satisfaction  on  the  issues  published  during  the  2009  golden  anniversary  year,  50(1–4),  and  on  the  newly   revised  JELIS  website.
There  were  minor  2010  survey  revisions  to reflect participant comments received from  the  previous  year’s  questionnaire  administration.  To  investigate  the  sharing  of   JELIS  copies  with  others,  a  Yes/No  option   was  adopted  over  the  previous  year’s  multiple-­choice  response  format.  The  instructions   for   the   question   related   to   journal   ranking  were  revised  to  improve  readability plus a grammatical error was fixed. In addition   to   these   basic   readability   changes,   questions   on   the   recently   redesigned   JELIS  website  were  added  to  capture  user   satisfaction  with  the  website,  the  purposes   of  site  visitations,  and  future  site  enhancement  recommendations  that  would  address   currently  unmet  JELIS  community  needs.
The  survey  was  announced  at  the  2010   ALISE   conference   and   on   the   jESSE   listserv.  A  recruitment  blurb  was  also  posted on   the   JELIS   website.   The   respondents   were  asked  to  indicate  their  reading  and   use   patterns   plus   their   overall   satisfaction   with  JELIS.  The  survey  was  available  online   between   January   13th   and   February   12th,  2010.

Results  and  Discussion

The   questionnaire   data   was   exported   to   an   Excel   spreadsheet   from   the   online   survey   system   and   analyzed   with   SPSS.   Open-­ended   question   responses   were   manually   coded.   In   compliance   with   the   Internal  Review  Board  to  obtain  informed   consent,   the   one   negative   consent   response  participant  data  was  removed  from   the  study  prior  to  analysis.

Demographic  Characteristics

The   demographic   questions   gathered   occupational   position,   organizational   affiliation, and geographic region information.  The  characteristics  of  respondents  to   the   2010   survey   were   similar   to   those   in   the   2009   survey.   As   shown   in   Appendix   A,  70%  of  this  year’s  respondents  reported   to   be   faculty   members.   The   faculty   classification included professors and dean/department   chairs.   The   remaining   participants were self-identified as students (17%)  or  librarians  (6%).   Most  of  the  respondents  were  from
doctorate-­granting   universities   or   master’s   college   and   universities,   67%   and   22%   respectively.   Eighty-­three   percent   of   the   re-­ spondents   lived   in   the   United   States   at   the   time  of  the  survey;  the  remaining  11%  per-­ cent  of  respondents  were  distributed  across   two   categories,   Canada   (7%)   and   Asia   and   Pacific (4%). The demographic characteristics were used to obtain readership profile information.   Similar   to   the   2009   results,   Appendix   A  illustrates  that  the  majority  of   respondents   in   the   2010   respondents’   profile were from an academic setting.

JELIS  Use

Respondents   were   asked   how   they   use   JELIS  in  terms  of  reading,  citation,  publication,  length  of  subscription,  sharing,  and  retention of the journal. Ninety-five percent  of   respondents   this   year   reported   to   have  either  read  or  looked  through  an  issue   of   JELIS.   This   was   a   substantial   increase   over  last  year’s  89%;  5%  reported  spending  more  than  an  hour  on  an  issue  upon  receipt  while  72%  spent  30  minutes  or  less.   In   addition,   68%   of   the   respondents   indicated  that  they  skim  the  titles  to  be  aware   of  the  contents  and  read  the  articles  of  interest  (see  Figure  1).
46%   of   respondents   reported   that   they had  cited  an  article  from  JELIS.  This  was   a   substantial   gain   over   the   30%   reported   in   the   previous   year.   When   asked   how   often   they   cite   an   article   in   JELIS,   there   was   little   change   over   last   year.   Twenty-­ one   percent   still   responded   ‘never,’   40%   responded  ‘less  than  once  a  year,’  24%  responded  ‘once  a  year,’  and  16%  responded   ‘more  often  than  once  a  year.’  There  was   a  slight  downward  shift  from  34%  to  30%   of  the  respondents  that  indicated  they  had   previously   published   in   JELIS.   Fifty-­one   percent  reported  that  not  sharing  a  copy  of   JELIS  with  others.  When  asked  how  long   they  keep  a  copy  of  JELIS,  this  year’s  57%   was   in   keeping   with   last   year’s   58%   that   responded ‘indefinitely.’ Appendix B contains   additional   2009–2010   comparison   results  related  to  JELIS  use.

JELIS  Satisfaction

Figure   2   shows   the   changes   of   JELIS   subscribers/readers’   satisfaction   on   six   constructs   as   well   as   overall   satisfaction.   Based  on  these  numbers,  the  respondents’   satisfaction   rates   on   all   measurements   in   2010  are  higher  than  in  2009  and  they  may   be   interpreted   as   a   positive   indication   of   JELIS  subscribers/readers  satisfaction  rate   increases.
To test the statistical significance of rate increase  between  2009  and  2010,  T-­tests   were  conducted,  and  the  results  reveal  that  there was a statistically significant increase in  overall  satisfaction  from  2009  to  2010  (t   =  –2.681,  p  <  0.05).  In  terms  of  constructs,   in  particular,  the  mean  value  of  JELIS  subscribers’   satisfaction   for   three   constructs,   including   relevance,   timeliness,   and   layout, was significantly increased. However, there was no statistically significant change  in  2009  and  2010  in  terms  of  quality   and   breadth   of   topics,   which   suggests   editors   and   board   members   need   to   continue  their  effort  to  enhance  the  quality  of   the   journal   and   to   improve   the   breadth   of   journal  topics.

JELIS  Website

The  JELIS  editors  redesigned  the  web-­ site  to  include  blog  communication  tools   to   facilitate   an   interactive   relationships   between   readers-­authors   and   readers-­ readers.   The   redesign   of   the   JELIS   website  was  announced  in  the  jESSE  listserv   on   January,   2010.   Due   to   the   short   time   period   between   the   launching   of   the   revised  jelis.org  site  and  the  survey  administration   period,   the   readers’   ability   to   access   the   website,   only   36.8   %   of   total   respondents   had   visited   the   JELIS   web-­ site.   Overall,   the   majority   of   these   respondents were satisfied with the website contents  and  design.
The   most   frequently   stated   purpose   of   those   visiting   the   JELIS   website   was   to   ‘Find  author  guidelines’  (n  =  16).  This  was   followed   by   ‘Read   full-­text   articles   of   in-­ terest’  (n  =  12),  ‘Find  reviewer  guidelines’   (n   =   11),   ‘Find/Verify   citation   information’  (n  =  11),  and  ‘Review  recent  trends   in  LIS  education  research’  (n  =  10).
The   questionnaire   included   an   open-­ ended   question   to   identify   needs   of   website  users.  Even  though  there  are  only  seven   comments,   three   of   them   were   related   to  open  access  and  full-­text  service.  As  the   two  results  indicate,  open  access  is  a  topic   of  interest  to  JELIS  readers,  and  an  objective  of  the  editors.

Conclusion

This   article   reported   on   survey   results  that reflected respondent perceptions prior to  January  2010.  Satisfaction  is  a  dynamic   process.   The   JELIS   editors,   staff,   and   the   authors   continue   to   work   toward   the   production  goal  of  a  high  quality  journal  that   meets   the   needs   of   the   ALISE   members   and  the  research  community  at  large.  Your   participation   and   feedback   will   assist   in   improving   the   readability   and   reputation   of   JELIS.   If   you   missed   the   opportunity   to   share   your   thoughts   in   2010,   we   look   forward   to   hearing   from   you   in   the   2011   JELIS  Satisfaction  survey.

Acknowledgement

The  JELIS  co-­editors  and  editorial  staff   sincerely   thank   all   of   the   respondents   of   the   JELIS   2010   Satisfaction   survey.   Special   thanks   to   Lorna   Peterson   (ALISE   President)   and   Kathleen   Combs   (Executive  Director)  for  their  support  in  publicizing  the  survey.

References

Park,   S.,   &   Capps,   J.   (2010).   2009   JELIS   Satisfaction   Survey.   Journal   of   Education   for   Library   and  Information  Science, 51(1),  4–8.

Leave your response!

Add your comment below, or trackback from your own site. You can also subscribe to these comments via RSS.

Be nice. Keep it clean. Stay on topic. No spam.

You can use these tags:
<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

This is a Gravatar-enabled weblog. To get your own globally-recognized-avatar, please register at Gravatar.