<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.0 20120330//EN" "JATS-journalpublishing1.dtd">
<article article-type="research-article" xml:lang="EN" xmlns:xlink="http://www.w3.org/1999/xlink">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">LIBER</journal-id>
<journal-title-group>
<journal-title>LIBER QUARTERLY</journal-title>
</journal-title-group>
<issn pub-type="epub">2213-056X</issn>
<publisher>
<publisher-name>Uopen Journals</publisher-name>
<publisher-loc>Utrecht, The Netherlands</publisher-loc>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">lq.10320</article-id>
<article-id pub-id-type="doi">10.18352/lq.10320</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Article</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Applied and Conceptual Approaches to Evidence-Based Practice in Research and Academic Libraries</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-0974-4087</contrib-id>
<name>
<surname>Thorpe</surname>
<given-names>Clare</given-names>
</name>
<email>Clare.Thorpe@usq.edu.au</email>
<xref ref-type="aff" rid="aff1"/>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">http://orcid.org/0000-0002-1300-9544</contrib-id>
<name>
<surname>Howlett</surname>
<given-names>Alisa</given-names>
</name>
<email>Alisa.Howlett@usq.edu.au</email>
<xref ref-type="aff" rid="aff1"/>
</contrib>
<aff id="aff1">Library Services, University of Southern Queensland</aff>
</contrib-group>
<pub-date pub-type="epub">
<month>4</month>
<year>2020</year>
</pub-date>
<volume>30</volume>
<fpage>1</fpage>
<lpage>17</lpage>
<permissions>
<copyright-statement>Copyright 2020, The copyright of this article remains with the author</copyright-statement>
<copyright-year>2020</copyright-year>
<license license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/4.0/">
<license-p>This is an open-access article distributed under the terms of the Creative Commons Attribution 4.0 International License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. See <uri xlink:href="http://creativecommons.org/licenses/by/4.0/">http://creativecommons.org/licenses/by/4.0/</uri>.</license-p>
</license>
</permissions>
<self-uri xlink:href="https://www.liberquarterly.eu/article/10.18352/lq.10320"/>
<abstract>
<p>Evidence-based practice is an approach to professional practice that involves a structured process of collecting, interpreting and applying valid and reliable research and evidence to support decision-making and continuous service improvement in professional practice. This paper reports on emerging initiatives in evidence-based practice at the University of Southern Queensland (USQ) Library, a regional multi-campus university in Australia. It demonstrates how evidence-based practice forms part of our organisational strategy to engage with our community and society.</p>
<p>The case study describes a new model of embedding evidence-based practice through a role explicitly dedicated to developing the library&#x2019;s evidence base. While other libraries may have a person responsible for assessment, performance metrics or data analysis, the Coordinator (Evidence-Based Practice) has a broader mandate &#x2013; to work with library staff to develop tools, skills and expertise in evidence-based practice. The paper will describe why this role was created and how the Coordinator is working to engage with library staff to understand their business and the evidence needed to support service improvement for the Library. By doing this, USQ Library is building the capacity to demonstrate value to stakeholders, gain a deeper understanding of clients&#x2019; needs and experiences, promote robust decision-making and improve service delivery.</p>
<p>The paper also outlines a research project led by the Coordinator (Evidence-Based Practice) to develop a conceptual model of evidence-based practice within academic libraries at the organisational, rather than individual level. Current models of evidence-based library and information practice apply predominantly to individuals. Informed by relevant literature and 16 semi-structured interviews with library professionals from Australian and New Zealand university libraries, three themes emerged to describe how evidence-based practice might be experienced at the organisational level. The lived experience at USQ Library and our research investigations suggest that being evidence-based provides benefits to an academic library&#x2019;s culture, practice and impact.</p>
</abstract>
<kwd-group>
<kwd>evidence-based practice</kwd>
<kwd>university libraries</kwd>
<kwd>academic libraries</kwd>
</kwd-group>
</article-meta>
</front>
<head>
<style>
       th {line-height:15px;}
       tr {line-height:15px;}
</style>
</head>
<body>
<sec id="s1">
<title>1. Introduction</title>
<p>Evidence-based practice is an approach that can support libraries in demonstrating value and impact to stakeholders. It is a structured way of working that brings rigour to the processes of collecting, interpreting and applying valid and reliable evidence to support decision-making and continuous service improvement in librarianship (<xref ref-type="bibr" rid="r15">Howlett &#x0026; Thorpe, 2018</xref>). This case study describes the development of a culture of evidence-based practice at a multi-campus, regional university library in Australia. Through organisational change, dedicated champions and defined expectations of staff, University of Southern Queensland (USQ) Library is building capacity in evidence-based practice to demonstrate value to stakeholders, to gain a deeper understanding of clients&#x2019; needs and experiences, to promote robust decision-making and to improve service delivery.</p>
</sec>
<sec id="s2">
<title>2. Theoretical framework</title>
<p>Evidence-based practice in librarianship first appeared as a term in the late 1990s (<xref ref-type="bibr" rid="r6">Eldredge, 2000</xref>) building on the experiences of health librarians who were supporting clinicians practising evidence-based medicine. Many other professions have adopted and embraced evidence-based approaches, including management, executive coaching, career development, public policy and education (<xref ref-type="bibr" rid="r20">Miller, Partridge, Bruce, Yates, &#x0026; Howlett, 2017</xref>). Evidence-based practice is not just about defining measures and undertaking data analysis, nor does it end with gathering and reporting data. Rather, evidence-based practice promotes applied approach that is ongoing and reflective, in which library staff position themselves to respond to challenges and leverage opportunities within their library&#x2019;s local context (<xref ref-type="bibr" rid="r24">Thorpe, 2018</xref>). Measures are the means through which service is improved and professional practice is continuously developed (<xref ref-type="bibr" rid="r15">Howlett &#x0026; Thorpe, 2018</xref>). It is ongoing, iterative and reflective in nature. <xref ref-type="bibr" rid="r18">Koufogiannakis &#x0026; Brettle (2016)</xref> argue that evidence-based practice is more than just &#x201C;doing&#x201D;; it is a way of being. By being evidenced-based, librarians can question their practice, gather or generate evidence and use evidence to make informed decisions about value and impact. Within academic research environments, library staff need to demonstrate value to stakeholders and decision makers within the university with the power or influence to support projects, fund initiatives and prioritise capital works. <xref ref-type="bibr" rid="r21">O&#x2019;Sullivan and Partridge (2016)</xref> suggest that much of this work happens outside of formal reporting to the university&#x2019;s executive, often by library staff who may not have a deep understanding of the value proposition of the library. Rather, it happens via the myriad of interactions library staff at all levels have with students, staff and community members of all kinds (<xref ref-type="bibr" rid="r21">O&#x2019;Sullivan &#x0026; Partridge, 2016</xref>).</p>
</sec>
<sec id="s3">
<title>3. An applied approach to evidence-based practice in academic libraries</title>
<p>University of Southern Queensland (USQ) is a regional university in south-east Queensland, Australia, with more than 27,000 undergraduate students (<xref ref-type="bibr" rid="r27">University of Southern Queensland, 2019</xref>). More than 75&#x0025; of the student cohort study online or via distance. USQ has been a higher education institution for over fifty years and is known for a strong social justice focus as the largest provider of higher education to Australian incarcerated students (<xref ref-type="bibr" rid="r7">Farley &#x0026; Hopkins, 2018</xref>). USQ Library supports students on three campuses, those studying online across Australia and the world, and students studying in offline mode in Australian correctional centres. In 2016, the Library underwent a transformational change process culminating in a new organisational structure (<xref ref-type="bibr" rid="r21">O&#x2019;Sullivan &#x0026; Partridge, 2016</xref>). The four principles underpinning the organisational renewal were:</p>
<list list-type="bullet">
<list-item><p>To engage with clients in new and different ways around the future of the Library</p></list-item>
<list-item><p>To enable library staff to identify trends that may impact services into the future</p></list-item>
<list-item><p>To explore alternative futures and devise strategic responses to the identified trends</p></list-item>
<list-item><p>To establish an evidence base to inform and guide workforce and strategic planning (<xref ref-type="bibr" rid="r21">O&#x2019;Sullivan &#x0026; Partridge, 2016</xref>).</p></list-item>
</list>
<p>This approach reflected the broader context of Australian academic libraries, with the Council of Australian University Librarians identifying a long-term aspirational goal to nurture a culture of evidence-based thinking and communication across the nation (<xref ref-type="bibr" rid="r22">Owen, Peasley &#x0026; Paton, 2017</xref>). As part of the transformational change, the Director, Library Services, articulated the expectation of evidence-based practice as relevant in all staff roles, by including in every position description a statement that staff will participate in a culture of evidence-based practice, use scholarship to inform and innovate their practice and, at higher levels, contribute scholarly work to the higher education and library and information science domains. A dedicated role was created to champion and build skills and capacity across the Library and to focus on enhancing the Library&#x2019;s capacity to innovate and deliver services in an informed and effective way. The role was designed with a mandate that went beyond the scope and capabilities of a data analyst who might focus only on data collection and reporting. Rather the Coordinator (Evidence-Based Practice) has a mandate to work with library staff to develop their skills as evidence-based practitioners and to communicate the value and impact of the library to stakeholders (<xref ref-type="bibr" rid="r15">Howlett &#x0026; Thorpe, 2018</xref>). The incumbent is charged with engaging with library staff to understand their business, identifying the evidence needed to support business improvement for the Library, and advising and supporting staff to engage in evidence-based practice.</p>
<p><xref ref-type="fig" rid="fg001">Figure 1</xref> visualises how we describe and conceptualise the Coordinator&#x2019;s position within USQ Library (<xref ref-type="bibr" rid="r12">Howlett, 2018a</xref>). It is conceived of and viewed as an enabling role. Evidence-based practice is acknowledged as an iterative or cyclical process when applied in the academic library context through a series of interrelated activities. As Library staff interpret, apply, measure and communicate evidence, our services become better aligned with our strategy and goals and our outcomes and impact lead to greater influence and advocacy on behalf of our clients. Evidence underpins all our work and our staff are central to our success.</p>
<fig id="fg001">
<label>Fig. 1:</label>
<caption><p>Evidence-based practice at USQ Library (<xref ref-type="bibr" rid="r15">Howlett &#x0026; Thorpe, 2018</xref>).</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="figures/LIBER_2020_30_Thorpe_fig1.jpg"/>
</fig>
<p>Much of the work of the Coordinator role is in building relationships, building staff expertise and capacity, fostering awareness and communicating the benefits of evidence-based practice to teams. The role enables, encourages and empowers USQ Library staff to:</p>
<list list-type="bullet">
<list-item><p>Access and use the best available evidence</p></list-item>
<list-item><p>Interpret and apply evidence to practice</p></list-item>
<list-item><p>Evaluate and measure outcomes to build and maintain a robust local evidence base</p></list-item>
<list-item><p>Be evidence-based as routine.</p></list-item>
</list>
<p>Applied and practical examples of evidence-based practice at USQ Library have included:</p>
<list list-type="bullet">
<list-item><p>The development of a Selection and Evaluation of Electronic Content tool. An evidence-based decision-making tool for the purchase and decommissioning of electronic content (<xref ref-type="bibr" rid="r10">Hay &#x0026; Pearse, 2018</xref>). The evidence generated by the adoption of this evidence-based tool has been successfully used to both identify opportunities for increasing usage of content and to identify cost savings through cancellation of subscriptions that are no longer relevant, affordable or useful for the university&#x2019;s teaching and research priorities. The tool generates more robust evidence to not only making collection decisions, but also communicate these decisions to stakeholders. It provides the right evidence, based on rigorous data, for decision-making.</p></list-item>
<list-item><p>The increasing use of low cost, user experience (UX) techniques in designing the refurbishments of library spaces that are student-centred, sustainable and fit-for-purpose (<xref ref-type="bibr" rid="r13">Howlett, 2018b</xref>). An activity to choose furniture for the Springfield campus library had the added benefit of changing the way students viewed the Library. The Library was subsequently described as &#x2018;caring&#x2019; by students who participated in this activity. UX techniques provide an opportunity to communicate and collaborate with the student community in improving their university experience.</p></list-item>
<list-item><p>The adoption of evidence-based approaches to decisions, such as library opening hours, using analysis of multiple data sources to inform options and solutions. This has included better use and understanding of datasets available from Library information systems, including usage and process analytics. Using data visualisations and reporting tools, staff can &#x2018;see&#x2019; the evidence and understand how evidence-based practice is relevant for their work.</p></list-item>
<list-item><p>The use of qualitative and quantitative methods to generate evidence to support funding applications, such as the Student Amenities Fees grants. The use of evidence has led to a higher success rate in annual funding applications.</p></list-item>
</list>
<p>Through a people-centred, evidence-based approach that encourages experimentation, we believe we have fostered a culture of problem-solving and collaboration. In a 2018 university-wide survey of staff satisfaction, 83&#x0025; of Library staff agreed with the statement: &#x201C;My co-workers take the initiative in solving problems&#x201D;, an eight point increase on the previous survey from 2016.</p>
</sec>
<sec id="s4">
<title>4. A conceptual approach to evidence-based practice in academic libraries</title>
<p>One of the challenges faced in implementing the Coordinator (Evidence-Based Practice) role has been to identify the evidence that demonstrates how this role is making a contribution to the performance of USQ Library. How does an academic library as an organisation become evidence-based? How might an academic library holistically grow in its maturity as an &#x00AD;evidence-based organisation? Existing literature has focused on understanding evidence-based practice within the individual experiences of library and information science practitioners (<xref ref-type="bibr" rid="r8">Gillespie, 2014</xref>; <xref ref-type="bibr" rid="r9">Gillespie, Partridge, Bruce, &#x0026; Howlett, 2016</xref>; <xref ref-type="bibr" rid="r14">Howlett &#x0026; Howard, 2015</xref>; <xref ref-type="bibr" rid="r16">Koufogiannakis, 2013</xref>; <xref ref-type="bibr" rid="r19">Luo, 2018</xref>; <xref ref-type="bibr" rid="r20">Miller et al., 2017</xref>; <xref ref-type="bibr" rid="r23">Partridge, Edwards, &#x0026; Thorpe, 2010</xref>). While the individual experience is important, a culture of continuous improvement requires supportive organisational dynamics and workplace contexts &#x2014; a whole-of-library approach to evidence-based practice which guides and develops library services and collections (<xref ref-type="bibr" rid="r9">Gillespie et al., 2016</xref>; <xref ref-type="bibr" rid="r16">Koufogiannakis, 2013</xref>). Within the academic context, the value of university and research libraries is increasingly judged by its demonstrated ability to help students learn and researchers research.</p>
</sec>
<sec id="s5">
<title>5. Methodology</title>
<p>To explore evidence-based practice at the organisational library level, the Coordinator (Evidence-Based Practice) and Associate Director (Library Experience) interviewed 16 professional library staff from 10 different university libraries across Australia and New Zealand. A qualitative approach with semi-structured interviews was used to develop an initial understanding of evidence-based practice at the whole-of-library level (<xref ref-type="bibr" rid="r5">Creswell, 2012</xref>). Participant recruitment used a convenience and purposive sampling approach, drawing on our professional networks to recruit participants who were available during the data collection period. The aim was to capture perspectives from across a range of library roles and functions, to encompass a whole of library experience. Full ethics clearance was obtained from the University of Southern Queensland&#x2019;s Ethics Committee.</p>
<p>Fourteen women and two men were interviewed. Most participants were employed at Australian universities with one person working at a New Zealand institution. Participants were employed as:</p>
<list list-type="bullet">
<list-item><p>Liaison/Subject/Outreach Librarians (5)</p></list-item>
<list-item><p>Team Leaders/Managers (5)</p></list-item>
<list-item><p>Associate Directors/Deputy University Librarians (4)</p></list-item>
<list-item><p>Directors/University Librarians (2)</p></list-item>
</list>
<p>Interviewees reflected on their own experiences with evidence-based practice and the level of evidence-based practice maturity demonstrated by their library. Interviewees were also asked to describe the characteristics of an evidence-based library. Appendix A provides a list of sample interview questions that guided discussion. Interviews recordings were transcribed verbatim and analysed using a thematic, iterative approach (<xref ref-type="bibr" rid="r3">Braun &#x0026; Clarke, 2006</xref>). The data analysis provided description about what evidence-based practice might look like at a whole-of-library level. Through the development and refining of codes the findings evolved into three dimensions of experience, mapped across five levels of organisational maturity.</p>
</sec>
<sec id="s6">
<title>6. Findings</title>
<p>Together with existing research, knowledge and frameworks, thematic analysis of the interview transcripts identified three focus areas or dimensions through which an academic library can demonstrate evidence-based practice. These dimensions, <italic>Process, Engagement and Evidence,</italic> have their foundations in existing evidence-based library and information practice frameworks. The dimensions were mapped to five levels of maturity, ranging from least mature (<italic>Ad Hoc/Sporadic</italic>) through to most mature (<italic>Transforming</italic>). <xref ref-type="fig" rid="fg002">Figure 2</xref> outlines the five tiers of maturity in the <italic>Evidence Based Library and Information Practice Capability Maturity Model</italic> (<xref ref-type="bibr" rid="r25">Thorpe &#x0026; Howlett, 2020</xref>). This paper will focus on exploring the dimensions of experience in detail. The tiers of maturity are discussed in an earlier publication (<xref ref-type="bibr" rid="r25">Thorpe &#x0026; Howlett, 2020</xref>).</p>
<fig id="fg002">
<label>Fig. 2:</label>
<caption><p>The Evidence Based Library and Information Practice Capability Maturity Model (<xref ref-type="bibr" rid="r25">Thorpe &#x0026; Howlett, 2020</xref>).</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="figures/LIBER_2020_30_Thorpe_fig2.jpg"/>
</fig>
<sec id="s6a">
<title>6.1. Process</title>
<p>The <italic>Process</italic> dimension articulates how evidence-based practice was applied within university libraries. Experiences ranged from not at all, as &#x2018;one off&#x2019; or semi-regular basis, to integrated into day-to-day ways of working. Evidence-based practice processes were observed as either reactive or proactive, meaning that the purpose of gathering and applying evidence was not always clearly defined from the onset. Some participants described data collection methods in detail. Others focused on the process associated with making evidence usable or communicating it effectively to appropriate audiences. Experiences of, and exposure to evidence-based practice within their libraries reflected a range of staff skills in assessing and applying evidence to particular needs or practice questions. How the evidence-based practice process manifests correlated with the model proposed by <xref ref-type="bibr" rid="r18">Koufogiannakis &#x0026; Brettle (2016)</xref>, sometimes referred to as the 5As model. As well as the five elements from this model &#x2013; Articulate, Assemble, Assess, Agree and Adapt &#x2013; the importance of communicating evidence to inform or influence decision making was highlighted as a key element of the <italic>Process</italic> dimension. At lower levels of maturity within the <italic>Process</italic> dimension, evidence may be collected but is not used to inform decision making. At higher levels of maturity, gathering and using evidence is a strategic priority and underpins how the library operates and makes decisions. <xref ref-type="table" rid="tb001">Table 1</xref> demonstrates how the <italic>Process</italic> dimension was experienced by interviewees at the varying maturity levels.</p>
<table-wrap id="tb001">
<label>Table 1:</label>
<caption>
<p>Interviewees&#x2019; experience of the Process dimension, Evidence Based Library and Information Practice Capability Maturity Model.</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 1: Ad hoc/ Sporadic</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">I&#x2019;m not convinced at this stage that in a lot of cases it&#x2019;s the right data or the right evidence. A lot of it seems to just be traffic. We&#x2019;re counting traffic. We&#x2019;re not actually looking at why there is traffic. (Interview 16)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 2: Justifying</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Quite often we are looking for the evidence to support a decision that we already have a gut feel about. (Interview 2)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 3: Emerging</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Every project, you&#x2019;ve got to make sure that you have a sense of what is happening, and possible solutions, and how things have been applied and how you might apply them. (Interview 7)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 4: Experimenting</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Having a really good understanding of what our client needs are actually and then putting those together to really evaluate, test any sort of decisions with your client base to confirm that they are the right decisions that you may need to be making. (Interview 10)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 5: Transforming</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">(Evidence) can help you influence. It can help you make decisions. It can help give you a more sophisticated understanding of things. It can give you a different relationship, especially with academia. (Interview 13)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s6b">
<title>6.2. Engagement</title>
<p>The <italic>Engagement</italic> dimension describes how the library as a whole engages with evidence-based practice: how staff and leaders promote, prioritize and enable evidence-based practice approaches, capacity and capability. Engaging in evidence-based practice included the extent to which library staff were supported to develop their capabilities and skills; whether leaders explicitly prioritized evidence-based practice as a way of working, and whether there was a shared understanding of how evidence-based practice approaches were used to improve services and practice. The role of leadership as a driver of evidence-based practice was highlighted by interviewees and aligned with the five categories of experience proposed by <xref ref-type="bibr" rid="r23">Partridge et al. (2010)</xref>. The level to which academic library leaders championed, sponsored or modelled evidence-based practice strongly influenced the extent to which the organisation engaged with evidence-based practice. <xref ref-type="table" rid="tb002">Table 2</xref> demonstrates how the <italic>Engagement</italic> dimension was experienced by interviewees at the varying maturity levels.</p>
<table-wrap id="tb002">
<label>Table 2:</label>
<caption>
<p>Interviewees&#x2019; experience of the Engagement dimension, Evidence Based Library and Information Practice Capability Maturity Model.</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 1: Ad hoc/Sporadic</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">It was so informal&#x2026;it says &#x201C;We&#x2019;re just making decisions on an ad hoc basis at this stage.&#x201D; (Interview 9)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 2: Justifying</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">They&#x2019;re using systems to actually collate and store data basically. The bit where it falls down is it&#x2019;s actually probably not being analysed really well. (Interview 16)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 3: Emerging</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">If you want your team to be evidence-based in practice, then you have to allow a bit more time in your projects so they can do what they need to do to make sure that they&#x2019;ve gathered evidence. (Interview 7)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 4: Experimenting</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">I think it&#x2019;s going to be about also the leadership expecting &#x2013; this does happen, but just saying, &#x201C;Okay, I&#x2019;m not going to make a decision on that until you give me this data.&#x201D; It does happen. (Interview 14)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 5: Transforming</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">I see it in terms of the library conducting itself, and being managed, and being driven forward, on the basis of evidence-based practice&#x2026;.something approximating a kind of an ethos of the way people practice things and the way the library is managed. (Interview 11)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
<sec id="s6c">
<title>6.3. Evidence</title>
<p>The third dimension which emerged from the interviews examined which evidence sources were used within academic libraries to make decisions and improve practice. This included the types of evidence involved in a library&#x2019;s process, how evidence is identified and perceived, and an awareness of the limitations of evidence to different situations and contexts. Though closely linked to <italic>Process</italic>, this element describes an awareness of, and capability to identify, gather and apply appropriate evidence to practice and service delivery. The types of evidence identified by participants indicated those most valued in making decisions within their libraries. Examples ranged from research literature, benchmarking studies and environmental scans to &#x00AD;systems-generated statistics, focus groups and qualitative feedback. The interview data demonstrated a variance in the ability of librarians at all levels to use different types and combinations of evidence. The variety of evidence sources mentioned in the interviews correlated with the three categories of evidence defined by <xref ref-type="bibr" rid="r18">Koufogiannakis &#x0026; Brettle (2016)</xref>, which is local evidence, research evidence and professional knowledge. The ability to apply evidence from multiple and various sources to the specific local context was highly valued by participants. <xref ref-type="table" rid="tb003">Table 3</xref> demonstrates how the <italic>Evidence</italic> dimension was experienced by interviewees at the varying maturity levels.</p>
<table-wrap id="tb003">
<label>Table 3:</label>
<caption>
<p>Interviewees&#x2019; experience of the Evidence dimension, Evidence Based Library and Information Practice Capability Maturity Model.</p>
</caption>
<table frame="hsides" rules="groups">
<tbody>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 1: Ad hoc/ Sporadic</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">I can see when I first came on board a lot of decisions were just made on people&#x2019;s personal opinion, and that still happens to quite an extent, actually. (Interview 10)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 2: Justifying</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Narrowing down our key performance indicators to a more realistic set of things that are actually performance indicators rather than just statistics&#x2026;.we&#x2019;ve blobbed them all together and say that&#x2019;s something&#x2019;s a KPI when in fact, it&#x2019;s a statistic. (Interview 2)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 3: Emerging</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">There are different kinds of evidence. I could go out and find a bunch of unrelated information and say &#x201C;This is my evidence&#x201D;, but clearly that&#x2019;s not it, is it? It has to be related to something in particular. (Interview 1)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 4: Experimenting</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">We&#x2019;re making business decisions based on a perfect world and data that has actually been cleansed intelligently, analysed appropriately and is tailored to actually answering the business question that is associated to a strategic goal or even an operational goal. (Interview 16)</td>
</tr>
<tr>
<td valign="top" align="left" style="LINE-HEIGHT:15px">Tier 5: Transforming</td>
<td valign="top" align="left" style="LINE-HEIGHT:15px">(Evidence) is more than data. It is information, so if you think about information that is within &#x2013; contextualised, so within the context it&#x2019;s valuable information that enables some decision making to take place. (Interview 14)</td>
</tr>
</tbody>
</table>
</table-wrap>
</sec>
</sec>
<sec id="s7">
<title>7. Discussion</title>
<p>Some library professionals in academic libraries have adopted evidence-based practice as an applied approach because they are driven by curiosity, aspire to do better, feel a professional responsibility, and want to keep up to date (<xref ref-type="bibr" rid="r2">Booth, 2002</xref>; <xref ref-type="bibr" rid="r6">Eldredge, 2000</xref>; <xref ref-type="bibr" rid="r8">Gillespie, 2014</xref>; <xref ref-type="bibr" rid="r23">Partridge et al., 2010</xref>). Understanding how a library as a whole fosters a culture of evidence-based practice provides insight into the various factors required to influence the ways in which evidence is conceived, encountered and used to improve service delivery and decision making. Regardless of how evidence-based practice is experienced as an individual phenomenon (<xref ref-type="bibr" rid="r26">Thorpe, Partridge, &#x0026; Edwards, 2008</xref>), the variation of individual experiences is highly influenced by the workplace. <xref ref-type="bibr" rid="r17">Koufogiannakis&#x2019;s (2015)</xref> study identified that organisational dynamics and the workplace context are the largest obstacle faced by academic librarians in applying evidence-based practice principles and processes. Library leadership and a customer-centred organisational culture were two of the enablers that supported the development of evidence-based practices in libraries (<xref ref-type="bibr" rid="r11">Hiller, Kyrillidou, &#x0026; Self, 2008</xref>). A culture of evidence-based practice, requires all library staff, not just leaders, to appreciate the importance of the qualitative and quantitative evidence that they handle and to understand how such evidence can help demonstrate the value of library services (<xref ref-type="bibr" rid="r28">Urquhart, 2018</xref>). Shared organisational approaches to evidence-based practice, guide and develop library services and collections through an attitude and culture of continuous improvement (<xref ref-type="bibr" rid="r9">Gillespie et al., 2016</xref>).</p>
<p>As university libraries face increasing scrutiny of their role and value to the institution (<xref ref-type="bibr" rid="r1">Baker &#x0026; Allden, 2017</xref>; <xref ref-type="bibr" rid="r4">Council of Australian University Librarians, 2016</xref>), responsibility for evidence-based practice approaches to service delivery and communication lies with the whole library organisation, not just individual practitioners. Individual librarians need organisational supports to enable evidence-based practice and related capabilities. Our research shows that the variation of experience, originally found by <xref ref-type="bibr" rid="r23">Partridge et al. (2010)</xref>, appears to also be valid at an organisational level. The lived experience of USQ Library and the research interviews reinforce the role of the workplace context in building a culture of evidence-based practice (<xref ref-type="bibr" rid="r12">Howlett, 2018a</xref>). Library leadership in evidence-based practice is also essential to achieving organisational growth. The adoption of evidence-based practice should be achievable and aspirational at an organisational level, and not just reliant on the skills and interest of individual practitioners.</p>
</sec>
<sec id="s8">
<title>8. Conclusion</title>
<p>USQ Library is seeing the benefits of having explicit focus on building the capacity of library staff as evidence-based practitioners and developing tools to measure and sustain our success. These emerging initiatives demonstrate an applied approach by which research and academic libraries can become better informed and more adaptable to client and community needs in an ever-changing society. We have committed to establishing evidence-based practice as a focus and driver of excellence within our library service. The experience at USQ Library suggests that being evidence-based provides both intrinsic benefits to the library&#x2019;s organisational culture and extrinsic benefits in demonstrating value and impact to stakeholders. Initial findings from research into evidence-based practice at the organisational level in academic libraries indicates that developing skills in the process, engagement and application of evidence may create a mature culture across all levels, not just among individual practitioners.</p>
</sec>
</body>
<back>
<ack>
<p>The authors would like to acknowledge the library professionals who willingly participated in this research. This research was conducted on the lands of the Jagera, Yuggera and Ugarapul peoples of the Springfield region, Queensland, Australia.</p>
</ack>
<ref-list>
<title>References</title>
<ref id="r1"><mixed-citation>Baker, D., &#x0026; Allden, A. (2017). <italic>Leading libraries: The view from above</italic>. London: SCONUL. Retrieved March 31, 2020, from <ext-link ext-link-type="uri" xlink:href="https://www.sconul.ac.uk/publication/the-view-from-above">https://www.sconul.ac.uk/publication/the-view-from-above</ext-link></mixed-citation></ref>
<ref id="r2"><mixed-citation>Booth, A. (2002). From EBM to EBL: Two steps forward or one step back? <italic>Medical Reference Services Quarterly, 21</italic>(3), 51&#x2013;64. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1300/J115v21n03_04">https://doi.org/10.1300/J115v21n03_04</ext-link></mixed-citation></ref>
<ref id="r3"><mixed-citation>Braun, V., &#x0026; Clarke, V. (2006). Using thematic analysis in psychology. <italic>Qualitative Research in Psychology, 3</italic>(2), 77&#x2013;101. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1191/1478088706qp063oa">https://doi.org/10.1191/1478088706qp063oa</ext-link></mixed-citation></ref>
<ref id="r4"><mixed-citation>Council of Australian University Librarians. (2016). <italic>Principles and guidelines for Australian higher education libraries, 2016</italic>. Retrieved March 31, 2020, from <ext-link ext-link-type="uri" xlink:href="https://www.caul.edu.au/sites/default/files/documents/best-practice/principles-guidelines2016public.pdf">https://www.caul.edu.au/sites/default/files/documents/best-practice/principles-guidelines2016public.pdf</ext-link></mixed-citation></ref>
<ref id="r5"><mixed-citation>Creswell, J. W. (2012). <italic>Educational research: Planning, conducting and evaluating quantitative and qualitative research</italic> (4th ed.). Boston: Pearson.</mixed-citation></ref>
<ref id="r6"><mixed-citation>Eldredge, J. (2000). Evidence-based librarianship: An overview. <italic>Bulletin of the Medical Library Association, 88</italic>(4), 289&#x2013;302. Retrieved March 31, 2020, from <ext-link ext-link-type="uri" xlink:href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC35250/">https://www.ncbi.nlm.nih.gov/pmc/articles/PMC35250/</ext-link></mixed-citation></ref>
<ref id="r7"><mixed-citation>Farley, H., &#x0026; Hopkins, S. (2018). Moving forward together: Supporting educators to support incarcerated students in Australian prison-based higher education<italic>.</italic> <italic>Advancing Corrections: Journal of the International Corrections and Prisons Association</italic>, <italic>6</italic>, 145&#x2013;152.</mixed-citation></ref>
<ref id="r8"><mixed-citation>Gillespie, A. (2014). Untangling the evidence: Introducing an empirical model for evidence-based library and information practice. <italic>Information Research, 19</italic>(3), n.p. Retrieved March 31, 2020, from <ext-link ext-link-type="uri" xlink:href="http://www.informationr.net/ir/19-3/paper632">http://www.informationr.net/ir/19-3/paper632</ext-link></mixed-citation></ref>
<ref id="r9"><mixed-citation>Gillespie, A., Partridge, H., Bruce, C., &#x0026; Howlett, A. (2016). The experience of evidence-based practice in an Australian public library: An ethnography. <italic>Information Research</italic>, <italic>21</italic>(4), n.p. Retrieved March 31, 2020, from <ext-link ext-link-type="uri" xlink:href="http://www.informationr.net/ir/21-4/paper730.html">http://www.informationr.net/ir/21-4/paper730.html</ext-link></mixed-citation></ref>
<ref id="r10"><mixed-citation>Hay, C., &#x0026; Pearse, T. (2019). <italic>SEECing a Solution: A recipe for the selection and evaluation of electronic content</italic>. Paper presented at the ALIA Information Online 2019, Sydney.</mixed-citation></ref>
<ref id="r11"><mixed-citation>Hiller, S., Kyrillidou, M., &#x0026; Self, J. (2008). When the evidence is not enough, <italic>Performance Measurement and Metrics</italic>, <italic>9</italic>(3), 223&#x2013;230. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/14678040810928444">https://doi.org/10.1108/14678040810928444</ext-link></mixed-citation></ref>
<ref id="r12"><mixed-citation>Howlett, A. (2018a). Time to move EBLIP forward with an organizational lens. <italic>Evidence Based Library &#x0026; Information Practice, 13</italic>(3), 74&#x2013;80. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.18438/eblip29491">https://doi.org/10.18438/eblip29491</ext-link></mixed-citation></ref>
<ref id="r13"><mixed-citation>Howlett, A. (2018b). The Goldilocks experiment. <italic>Incite</italic>, 39, 27.</mixed-citation></ref>
<ref id="r14"><mixed-citation>Howlett, A., &#x0026; Howard, Z. (2015). Exploring the use of evidence in practice by Australian special librarians. <italic>Information Research, 20</italic>(1), n.p. Retrieved March 31, 2020, from: <ext-link ext-link-type="uri" xlink:href="http://www.informationr.net/ir/20-1/paper657.html&#x0023;.XlhaPigzaM8">http://www.informationr.net/ir/20-1/paper657.html&#x0023;.XlhaPigzaM8</ext-link></mixed-citation></ref>
<ref id="r15"><mixed-citation>Howlett, A., &#x0026; Thorpe, C. (2018). <italic>&#x2018;It&#x2019;s what we do here&#x2019;: Embedding evidence-based practice at USQ Library</italic>. Paper presented at the Asia-Pacific Library and Information Conference, Gold Coast, Australia. Retrieved March 31, 2020, from: <ext-link ext-link-type="uri" xlink:href="https://eprints.usq.edu.au/34729/">https://eprints.usq.edu.au/34729/</ext-link></mixed-citation></ref>
<ref id="r16"><mixed-citation>Koufogiannakis, D. (2013). Academic librarians use evidence for convincing: A qualitative study. <italic>SAGE Open, 3</italic>(2), 1&#x2013;12. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1177/2158244013490708">https://doi.org/10.1177/2158244013490708</ext-link></mixed-citation></ref>
<ref id="r17"><mixed-citation>Koufogiannakis, D. (2015). Determinants of evidence use in academic librarian decision making. <italic>College &#x0026; Research Libraries</italic>,<italic> 76</italic>(1), 100&#x2013;114. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5860/crl.76.1.100">https://doi.org/10.5860/crl.76.1.100</ext-link></mixed-citation></ref>
<ref id="r18"><mixed-citation>Koufogiannakis, D., &#x0026; Brettle, A. (Eds.). (2016). <italic>Being evidence based in library and information practice</italic>. London: Facet Publishing.</mixed-citation></ref>
<ref id="r19"><mixed-citation>Luo, L. (2018). Experiencing evidence-based library and information practice (EBLIP): Academic librarians&#x2019; perspective. <italic>College &#x0026; Research Libraries, 79</italic>(4), 554&#x2013;567. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.5860/crl.79.4.554">https://doi.org/10.5860/crl.79.4.554</ext-link></mixed-citation></ref>
<ref id="r20"><mixed-citation>Miller, F., Partridge, H., Bruce, C., Yates, C., &#x0026; Howlett, A. (2017). How academic librarians experience evidence-based practice: A grounded theory model. <italic>Library &#x0026; Information Science Research, 39</italic>(2), 124&#x2013;130. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1016/j.lisr.2017.04.003">https://doi.org/10.1016/j.lisr.2017.04.003</ext-link></mixed-citation></ref>
<ref id="r21"><mixed-citation>O&#x2019;Sullivan, C., &#x0026; Partridge, H. (2016). Organizational change and renewal: Can strategic communication methods ease the pain? A case study from the University of Southern Queensland, <italic>New Review of Academic Librarianship</italic>, <italic>22</italic>(2&#x2013;3), 282&#x2013;293. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1080/13614533.2016.1195418">https://doi.org/10.1080/13614533.2016.1195418</ext-link></mixed-citation></ref>
<ref id="r22"><mixed-citation>Owen, S., Peasley, J., &#x0026; Paton, B. (2017). Principles and guidelines for Australian higher education libraries: Capturing value. <italic>Students, Quality, Success: Second Annual TEQSA Conference</italic>, Melbourne, Australia, 146&#x2013;158. Retrieved March 31, 2020, from: <ext-link ext-link-type="uri" xlink:href="https://www.hes.edu.au/sites/default/files/uploaded-content/field_f_content_file/teqsa_2017_conference_proceedings.pdf">https://www.hes.edu.au/sites/default/files/uploaded-content/field_f_content_file/teqsa_2017_conference_proceedings.pdf</ext-link></mixed-citation></ref>
<ref id="r23"><mixed-citation>Partridge, H., Edwards, S. L., &#x0026; Thorpe, C. (2010). Evidence-based practice: Information professionals&#x2019; experience of information literacy in the workplace. In A. Lloyd &#x0026; S. Talja (Eds.), <italic>Practising information literacy: Bringing theories of learning, practice and information literacy together</italic> (pp. 273&#x2013;297). Wagga Wagga, New South Wales: Centre for Information Studies.</mixed-citation></ref>
<ref id="r24"><mixed-citation>Thorpe, C. (2018). Evidence-based practice: Evaluating our collections and services. <italic>ANZTLA EJournal</italic>, <italic>21</italic>, 87&#x2013;96. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.31046/anztla.v0i21.953">https://doi.org/10.31046/anztla.v0i21.953</ext-link></mixed-citation></ref>
<ref id="r25"><mixed-citation>Thorpe, C., &#x0026; Howlett, A. (2020). Understanding EBLIP at an organizational level: An initial maturity model, <italic>Evidence Based Library and Information Practice</italic>, <italic>15</italic>(1), 90&#x2013;105. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.18438/eblip29639">https://doi.org/10.18438/eblip29639</ext-link></mixed-citation></ref>
<ref id="r26"><mixed-citation>Thorpe, C., Partridge, H., &#x0026; Edwards, S. L. (2008). <italic>Are library and information professionals ready for evidence based practice?</italic> Paper presented at ALIA Biennial Conference: Dreaming 08, Alice Springs, Australia. Retrieved March 31, 2020, from <ext-link ext-link-type="uri" xlink:href="https://eprints.qut.edu.au/28370/1/28370.pdf">https://eprints.qut.edu.au/28370/1/28370.pdf</ext-link></mixed-citation></ref>
<ref id="r27"><mixed-citation>University of Southern Queensland. (2019). <italic>About USQ</italic>. Retrieved December 3, 2019, from <ext-link ext-link-type="uri" xlink:href="https://www.usq.edu.au/about-usq">https://www.usq.edu.au/about-usq</ext-link></mixed-citation></ref>
<ref id="r28"><mixed-citation>Urquhart, C. (2018). Principles and practice in impact assessment for academic libraries. <italic>Information and Learning Science, 119</italic>(1/2), 121&#x2013;134. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.1108/ILS-06-2017-0053">https://doi.org/10.1108/ILS-06-2017-0053</ext-link></mixed-citation></ref>
</ref-list>
<app-group>
<app id="app1">
<title>Appendix A: Sample interview questions</title>
<p><list list-type="order">
<list-item><p>Can you tell me about any challenges you or the library have faced in making decisions about the library&#x2019;s services? Can you identify any evidence that might have helped resolve the challenge?</p></list-item>
<list-item><p>Does the library regularly produce or revise a strategic plan, its goals and objectives? If so, can you tell how the library does this? If not, can you tell me why?</p></list-item>
<list-item><p>Can you tell me about any processes or evidence that is collected and analysed to evaluate:
<list list-type="bullet">
<list-item><p>The library&#x2019;s services and programs?</p></list-item>
<list-item><p>The collections?</p></list-item>
<list-item><p>The achievement of the library&#x2019;s goals and objectives?</p></list-item>
</list></p></list-item>
<list-item><p>Are there any routine or regular processes in place to collect evidence related to the library&#x2019;s services and programs? If so, can you describe them?</p></list-item>
<list-item><p>Are there any routine or regular processes in place to analyse and report on the library&#x2019;s services and programs? If so, can you describe them? (e.g. reporting schedule)</p></list-item>
<list-item><p>How does the library communicate its performance, value and impact to its stakeholders? Do you think this is an area where the library could improve?</p></list-item>
<list-item><p>What does evidence based practice mean:
<list list-type="bullet">
<list-item><p>to you?</p></list-item>
<list-item><p>to the library?</p></list-item>
</list></p></list-item>
<list-item><p>What is &#x2018;evidence&#x2019;?</p></list-item>
<list-item><p>What potential benefits do you think evidence based practice has, or can have, to your library?</p></list-item>
<list-item><p>How confident do you feel the library can, or is operating in an evidence based way? How do you think the library can improve in being evidence based?</p></list-item>
</list></p>
</app>
</app-group>
</back>
</article>
