Skip to Main Content

Information Literacy (LIBR 2100)

LIBR 2100 Course Materials

Introduction

Where does "authority" come from? What makes someone an expert in their field? This can come from:

  • scholarship (developing subject expertise during an academic career of research, writing, teaching)
  • societal position (public office, leadership responsibilities)
  • experience

Many disciplines have well-known scholars and publications that are "the standard" but even those can be challenged. New ideas are almost always treated with skepticism; time and testing generally leads to acceptance

Authoritative content has traditionally been packaged formally, in journals, books, conferences and dissertations. However, in the networked world of today, academic content is being packaged in a much wider variety of media. Old measures of authority may no longer be applicable.

Video:Credibility is contextual

What about our elders and story-tellers? Where does traditional knowledge fit in the information ecosystem? How does the voice of ancient wisdom and cultural practice get recognized? Does it get properly recognized?

What about your voice? Your own authority will develop over time as you study, join a field of practice, and participate in scholarly communications. Where will you "publish?"

It's important to understand that authority is constructed (created by a community) and contextual (dependent on the situation).

What is Peer Review?

"This means that before an article is published, it undergoes a review process in order to confirm that the information is accurate and the research it discusses is valid. This process adds a level of credibility to the article that you would not find in a magazine or news article" (Bernnard et al., 2014, p. 67).

"The peer-review process is based on the notion that, because much of academic inquiry is relatively specialized, peers with similar expertise are in the best position to judge one another's work.

For much of the last century, peer review has been the principal mechanism by which the quality of research is judged. In general, the most respected research findings are those that are known to have faced peer review. Most funding decisions in science are based on peer review. Academic advancement is generally based on success in publishing peer-reviewed research and being awarded funding based on peer review; further, it involves direct peer review of the candidate's academic career. In short, research and researchers are judged primarily by peers" (Kalichman, 2001).

Bernnard, D., Bobish, G., Hecker, J., Holden, I., Hosier, A., Jacobson, T., ... Bullis, D. (2014). The information literacy user's guide: An open, online textbook. G. Bobish & T. Jacobson (Eds.). Retrieved from http://textbooks.opensuny.org/the-information-literacy-users-guide-an-open-online-textbook/

Kalichman, M. (2001). Peer review. In Resources for research ethics. Retrieved from University of California San Diego Research Ethics Program website: http://research-ethics.net/topics/peer-review/

Video: Peer Review in 3 Minutes

We mentioned the peer review process  when we were looking at different formats and types of information. Let's review the peer review process before examining its pros and cons.

Peer Review Benefits

Peer review benefits
  • Building community and dialogue among scholars worldwide
  • Peer review was "largely designed to evaluate the relative quality of research.
  • With appropriate feedback, it can also be a valuable tool to improve a manuscript, a grant application, or the focus of an academic career" (Kalichman, 2001).

Kalichman, M. (2001). Peer review: background. In Resources for research ethics. Retrieved from University of California San Diego Research Ethics Program website: http://research-ethics.net/topics/peer-review/#backgroun

Peer Review Critiques

Peer review critiques

Critics of peer review worry that reviewers may:

  • be biased in favor of well-known researchers, or researchers at prestigious institutions (to the detriment of those in developing countries with limited research resources)
  • be unconsciously biased in favor of work that supports their views (also called "confirmation bias")
  • review the work of their competitors unfairly
  • not be qualified to provide an authoritative review
  • be too busy with their own research to devote enough time to properly review an article
  • take advantage of ideas in unpublished manuscripts and grant proposals that they review (Kalichman, 2001).
  • dismiss arts-based research (which incorporates "visual, performative,
    poetic, musical, and narrative forms of inquiry in their innovative research projects..."). One such critic is Pariser himself (2009).

Some of these critiques have been linked to the rise in article retractions in recent years. (see the next section on retractions).

Kalichman, M. (2001). Peer review: background. In Resources for research ethics. Retrieved from University of California San Diego Research Ethics Program website: http://research-ethics.net/topics/peer-review/#backgroun

Pariser, D. (2009). Arts-based research: Trojan horses and Shibboleths. The liabilities of a hybrid research approach. "What Hath Eisner Wrought?" Canadian Review of Art Education: Research and Issues, 36, 1-18. Retrieved from http://eric.ed.gov

Oops! Retractions

A retraction is more than just a correction. It is considered a serious error in academic publishing. A retraction is a "public statement made about an earlier statement that withdraws, cancels, refutes, or reverses the original statement or ceases and desists from publishing the original statement" ("Retraction," 2016, para. 1).

"In science, a retraction of a published article indicates that the original article should not have been published and that its data and conclusions should not be used as part of the foundation for future research. The most common reasons for the retraction of articles are scientific misconduct, including plagiarism, serious errors, and duplicate/concurrent publishing (self-plagiarism). The retraction may be initiated by the editors of the journal, or by the author(s) of the papers (or their institution)" (para. 4, emphasis added).

As you can see, a retraction can destroy the reputation of an author and their publisher but can harm all the other authors who referred to an article before knowing it was retracted.

Unfortunately, sometimes the information from a retracted article is accepted as fact and continues to persist, even after a retraction. This can even have public health effects. A recent example is the MMR vaccine controversy. Medical researcher Andrew Wakefield linked the Mumps, Measles, Rubella vaccine to Autism Spectrum Disorders in an article published in The Lancet. Dr. Wakefield was barred from practicing as a physician in the UK after his research was found to be fraudulent. Despite retractions and repeated statements by The Lancet that the study results were completely false, the public remains deeply divided on this issue with strong vaccination and anti-vaccination advocates.

The Medline (EBSCO) database allows users to filter articles that have been retracted.

Screeshot of the PubMed database Retraction filter under Publicaton Type

Retraction Watch is a site which reports retractions in scientific publishing.

Retraction Watch also has a Facebook page.

 

Neimark, J. (December 2014) The retraction war - Scientists seek demigod status, journals want blockbuster results, and retractions are on the rise. Aeon  Retrieved from https://aeon.co/essays/are-the-retraction-wars-a-sign-that-science-is-broken

 

Attribution Decay

Attribution identifies the original source or cause of something. In research, this would be the person who first said or wrote something, and we cite, quote and make reference to that original work.

Attention Psychology students: This kind of attribution has nothing to do with the field of psychology and attribution theory!

Attribution decay, then, can be thought of as the loss of attributions over time. In other words, a story gets shared so often or for so long that the source of the original information gets lost. The information can be taken out of context and completely misunderstood. The authority of the information becomes questionable and attribution decay can in many ways be considered the end result of plagiarism.

While it's very common in social media, [Note: this link depicts animals prepared for surgery] even with peer-reviewed publications, attribution decay can happen.

Heady (2014, slide 11) defines attribution decay this way:

When information is shared to the point that

  • the original creator’s name is lost
  • someone else gets credit for the work
  • when information is orphaned [work whose owner can no longer be identified]
  • when information is used incorrectly leading to confusion and sometimes misleading communication to promote certain views

This breakdown of attribution and proper citation can lead to questions about the overall reliability and credibility of our information. (Note: This is also why APA style discourages the use of secondary sources. It is better to find the original source, and interpret it ourselves, than to rely on those who are quoting that source.)

This is another example of why academic integrity is so important - not only in scholarly settings but also in our personal lives.

The following fact checking sites can help track the original sources of information viewed on social media.

  1. Snopes: fact-checks Internet rumours and stories.
  2. PolitiFact: verifies political news stories.
  3. FactCheck.org: monitors the accuracy of political stories (U.S.A. focused)
  4. Cross check the source or image using an Internet Search Engine (e.g. Google). Is the source collaborated or debunked?

Heady, C. (2014). Attribution decay [Presentation slides]. Annual Instruction Showcase Presentations. Retrieved June 26,, 2016 from Consortium of Academic and Research Libraries in Illinois (CARLI) website: https://www.carli.illinois.edu/products-services/pub-serv/instruction/InstructionShowcase#2014Heady

Measures of Scholarly Impact

Is there a way to quantify how important an author or journal is?

Possibly. The field of bibliometrics is increasingly being used to evaluate:

  • the impact of a scholar's work (citation counts)
  • the importance of a journal within a particular field (impact factor)

But are these the only measures? Are they still realistic in 2016, when we are immersed in social media and other disruptive technologies?

  • altmetrics are a promising method of measuring scholarly impact in a meaningful way

Arizona State University Libraries. (2015, December 8). Citation Research: Overview. Retrieved June 28, 2016 from http://libguides.asu.edu/citation/overview

Article Citation Counts

Article citation counts measure the impact of:

  • a journal article
  • an author

"by counting the number of times either is cited by other works. Although this sounds simple, it is complicated by the fact that there is no single citation analysis source that covers all journal articles and their cited references" (Arizona State University Libraries, para 1).

Arizona State University Libraries. (2015, December 8). Article Citation Counts. Retrieved June 28, 2016 from http://libguides.asu.edu/citation/articles

Non-Article Citation Counts

There is some limited citation count information available for non-article formats such as books, conference papers, and even patents.

Books, Conference Papers & Thesis/Dissertations

  • Google Scholar
  • Search for the book, paper, or thesis title "in quotes"
  • If the book or paper has been cited by publications found by Google Scholar, the "Cited by" notice will appear [see Week 2 Google Scholar "Cited by" chapter]

Patents

A patent is "a government document that proves that an invention is yours and yours alone" ("Patents," 2016, para 1). For scientists and engineers patents are valuable intellectual property, providing the ability to keep others from making or using the same patented invention for a period of time.

  • Espacenet is a worldwide patent database developed and maintained by the European Patent Office
  • You enter the patent number and find its citing documents
  • It is not a complete database of all the world's patents and while
  • some of the patent records are available in full text, some only include an abstract

Arizona State University Libraries. (2015, December 8). Non-article citation counts. Retrieved June 28, 2016 from http://libguides.asu.edu/citation/non_articles

Patents. (2016). Retrieved from https://www.vocabulary.com/dictionary/patent

Video: Citation Numbers

This very short video points out that citation numbers vary widely depending on the database we use. No single database can tell you the exact count. Citation counts are a measure of popularity of an article. But ask yourself: Are citation counts reliable measures of how "good" an article is?

University of Ontario Institute of Technology Library. (2013, April 8). Citation numbers vary in each database [Video file]. Retrieved June 28, 2016 from https://youtu.be/pUUsGgbQdT4

Impact Factor

What is the Impact Factor (IF) ?

The impact factor (IF) of an academic journal was devised by the Institute for Scientific Information (now part of Thomson Reuters), a leading indexer of science and social science journals, to compare different journals within a certain discipline. The higher the impact factor, the higher the journal's relative importance.

In the early (undergraduate) stages of your academic career, you will probably not be concerned with the Impact Factor (IF). But if you decide to pursue graduate or doctoral level research, the impact factor can be a measure of the scholarly importance of the journals in which you publish.

As a researcher, you might be interested in the IF of a journal which contains an article you want to cite as a measure of authority. Is the journal considered "important" in the discipline?

How is the IF calculated?

An impact factor is measured over a period of years. The 2013 impact factor of a journal is:

A.= the number of times that articles published in that journal in 2011 and 2012 were cited by articles in journals indexed by ISI during 2013.

B= the total number of articles, reviews, research notes (referred to as "citable items" ) published by that journal in 2011 and 2012.

The 2013 IF is A/B where A is the numerator and B is the denominator.

Impact factors are published in Journal Citation Reports and they are often used by the publishers of academic journals to establish the authority of their journal in the academic field.

Altmetrics

What are altmetrics?

ALT + METRICS = Alternative Metrics

These are other or "alternative" measures of impact, moving away from the traditional approaches such as citation counts and impact factors.

These are gathered "online from social media and mainstream media" (Winkler, J., 2015, slide 6).

Examples of altmetrics include:

  • social media discussion
  • downloads
  • saves to reference managers like RefWorks
  • news articles
  • use in policy and other non-academic documents (e.g., patents)

The benefits of altmetrics include:

  • are available faster than traditional citation counts/impact factors
  • provide a broader way to think about "impact"
  • give incentives for people to publish online
  • give incentives for people to publish in Open Access sources in particular

The drawbacks of altmetrics include:

  • they may reward sensationalism or controversy (something "going viral")
  • the way altmetrics are collected is inconsistent
  • some types of research are better suited to altmetrics than others
  • it isn't yet clear what altmetrics really mean (Winkler, 2015, slide 7)

Winkler, J. (2015, December 17). Altmetrics: Concepts and practices [Presentation slides]. In Library and Information Science Commons. Retrieved June 26, 2016 from http://network.bepress.com/social-and-behavioral-sciences/library-and-information-science/

Traditional Knowledge

"Traditional knowledge (TK) is knowledge, know-how, skills and practices that are developed, sustained and passed on from generation to generation within a community, often forming part of its cultural or spiritual identity.

While there is not yet an accepted definition of TK at the international level, it can be said that:

  • TK in a general sense embraces the content of knowledge itself as well as traditional cultural expressions, including distinctive signs and symbols associated with TK.
  • TK in the narrow sense refers to knowledge as such, in particular the knowledge resulting from intellectual activity in a traditional context, and includes know-how, practices, skills, and innovations.

Traditional knowledge can be found in a wide variety of contexts, including: agricultural, scientific, technical, ecological and medicinal knowledge as well as biodiversity-related knowledge" (World Intellectual Property Organization, n.d., paras. 1-3).

Questions to consider:

Much traditional knowledge is passed down orally: through stories and songs, which may never appear in written form.

"In societies that depend on their traditions, knowledge is passed down only by people qualified to do so, and unregulated production of new information is not encouraged. There is an emphasis within traditional societies on memorizing the information that exists rather than using existing information to create new knowledge." (Badke, 2008, p. 2).

How do story-tellers and elders receive credit for these knowledge traditions? Are the stories and legends "personal communication" or something more?

Is there such a thing as attribution (or attribution decay) in traditional knowledge? Or is the knowledge owned by everyone?

How does traditional knowledge get "peer-reviewed?" Does it need to be? That very question has arisen at University of British Columbia in 2016. Read more in the next section.

Badke, W.B. (2008). Research strategies: Finding your way through the information fog. New York: iUniverse, Inc.

World Intellectual Property Organization. (n.d.). Traditional knowledge. Retrieved from http://www.wipo.int/tk/en/tk/

Indigenousness vs The Academy

Inside Higher Ed

(https://www.insidehighered.com)

Indigenous professor denied tenure claims narrow focus on peer-reviewed
publications is discriminatory


Submitted by Elizabeth Redden on January 27, 2016


A former professor at the University of British Columbia who lost her tenure bid because of a poor publication record is arguing that the university discriminated against her in discounting the nontraditional scholarship she did as an indigenous woman. The case is moving forward after British Columbia’s Human Rights Tribunal rejected the university's request to dismiss the complaint filed by Lorna June McCue, a former UBC assistant professor of law who is of Ned’u’ten ancestry.


“The complainant states that peer review for nontraditional indigenous scholars, like her, goes beyond traditional journals to include publication in nontraditional journals and oral dissemination,” tribunal member Norman Trerise wrote in a 71-page decision [1] allowing the case to proceed. “The complainant states that her approach to scholarship is based on her Aboriginal identity, and for her community, the oral dissemination of knowledge is comparable to the dissemination of knowledge through written publications. The complainant states that her oral scholarship was not considered or weighed appropriately by the university, in that a significant amount of her work was excluded because of the way she does her work as an indigenous female scholar.”


UBC, a leading research university, argues that it was “as flexible as possible” in evaluating McCue, but says her “output fell far short of any reasonable standards for granting tenure.”


In his decision, issued Jan. 15, Trerise summarized UBC’s position that McCue was “reckless with her career” and that she did not take advantage of reductions in teaching and administrative duties granted to give her time to focus on publishing.
“They say the evidence demonstrates that she was repeatedly and explicitly warned over several years that she had not been meeting the standard required for meeting promotion at the Faculty of Law,” Trerise wrote of UBC's position. “They say that she had been told that she was to produce five to six significant and original peer-reviewed papers well in advance of her application for tenure and promotion, but she produced none.” (McCue maintains she produced two.) “They say she was explicitly told not to focus on book chapters and conferences and to focus on peer-reviewed papers. They say that Ms. McCue ignored that direction, refused the formal mentoring put in place to assist her in meeting the standard and that she was irresponsible when she chose to ignore those warnings.”


“UBC says that it was only at the 11th hour, after Ms. McCue received the Faculty Committee’s letter of concern respecting the material that she had presented, that she asked UBC to redefine and reinterpret the standard so that all of her work ‘would count.’ They say that this would require not merely a more liberal interpretation of the standard but an abdication from the standard,” Trerise wrote.


“UBC says that the evidence is that none of the complainant’s work, when viewed in the most generous light, met the standard interpreted in the broadest possible way.”
McCue, meanwhile, objects to what she describes as the university's failure to count her community-based research as scholarship.


“Ms. McCue points out that the evidence establishes that she was hired to perform a role of carrying out academic and community-based research to develop a program, connect with indigenous peoples and engage with them in their communities, and identify their legal needs so that the university can be involved in connecting faculty, students and indigenous communities together,” Trerise wrote.


“Ms. McCue says that the evidence establishes that she got penalized for continuing to do her work in that fashion and that the university began to factor out her specialized work when assessing her achievement. She says that in ignoring her work in the indigenous community and paying attention only to the traditional law approach to assessment, UBC was trying to change who she was.”


“Ms. McCue’s position, succinctly stated, is that there is nothing in the standard that requires five to six significant peer-reviewed publications in her curriculum vitae in order to be successful in her tenure and promotion application. She also says that there is nothing in the standard that requires a 40-40-20 approach to evaluating scholarship, teaching and service” (in which scholarship and teaching together account for 80 percent of the weight granted to the tenure decision and service the other 20 percent).


According to Trerise, McCue argued for a more “fluid and flexible” approach to weighing her scholarship, teaching and service achievements. In a letter McCue wrote to her dean, excerpted in Trerise’s decision, she suggested that her service contributions were undervalued and proposed that “my activities that are scholarly and teaching in nature, but which may have been conducted under my service hat, be measured as evidence for meeting the criteria for scholarly activities and teaching.”
Trerise’s decision notes that the conclusions of the faculty committee charged with reviewing McCue’s tenure bid “seem to have been equivocal” in regards to her teaching, while her colleagues found she met the established criteria for service. The faculty committee recommended against tenure, a decision upheld at higher levels of the university, based on its assessment of the quality and quantity of her scholarship.

A UBC spokeswoman declined to comment on the case on Tuesday. McCue could not be reached for comment.


In his Jan. 15 decision, Trerise did not reach a judgment about McCue’s claim of discrimination but merely concluded that “the evidence is present which could allow Ms. McCue’s complaint to succeed and that it would be inappropriate, in any event, to end this matter without a full examination of the evidence of both parties.” Ultimately at issue, Trerise wrote, will be whether cultural traits associated with McCue’s indigenous identity contributed to her failure to meet the university’s tenure and promotion standard.


UBC argues that McCue’s decision not to publish in peer-reviewed venues was her choice. According to Trerise's summary, university officials point to McCue’s own admission that “there is nothing about indigeneity that prevents an indigenous person from having the capability of meeting the university’s requirements. They also point to the fact that each and every one of the three indigenous witnesses called to support Ms. McCue’s case had, in order to establish their own educational credentials, met such standards. Further, UBC relies on evidence from those witnesses that there are good reasons for peer-reviewed publication in terms of the ability to disseminate information which it is important to the indigenous community be disseminated. Ms. McCue answers by submitting that, while she may have chosen not to publish in the Western sense, that choice was driven by her indigeneity and that UBC should have responded to her requests that the criteria that make up the standards for UBC be re-evaluated to overcome her difficulties with them.”


Trerise concludes that “there is evidence which supports Ms. McCue’s argument that her choices were compelled by her identity as an indigenous woman. There is evidence before the tribunal to support that Ms. McCue is an indigenous person and that the communication patterns of indigenous persons are quite different than that of much of the population of North America which is not indigenous. That indigenous communication style, on the evidence, is one of an oral tradition rather than a tradition of writing. It is one of an oral tradition to the point that even the communication of the results of research into community issues is or can be accomplished orally rather than by a written report. Ms. McCue’s evidence suggests that she places herself very much in that oral tradition. The evidence of [two supporting witnesses] Dr. [Frances] Henry and Dr. [Jo-Ann] Archibald supports that adherence to an indigenous communication style is often necessary to carry out research in the indigenous community.”


“It also supports that, for indigenous scholars, there can be significant compromise involved in meeting the traditional research and publication requirements required for tenure and promotion in the university environment,” Trerise wrote. “While this is not a systemic complaint, Ms. McCue has, in her evidence, set out that, for her personally, meeting those requirements would constitute a substantial compromise. As she has put it, it would require her to be a round peg in a square hole.”

Source URL: https://www.insidehighered.com/news/2016/01/27/indigenous-professor-denied-tenure-claims-narrow-focus-peer-reviewed-publications?width=775& height=500&iframe=true


Links:
[1] http://www.bchrt.bc.ca/decisions/2016/pdf/jan/9_McCue_v_UBC_No_3_2016_BCHRT_9.pdf

Reproduced for this course with the permission of the author. Thank you!

Redden, E. (2016, January 27). Is it discriminatory to require peer review? Inside Higher Ed. Retrieved June 23, 2016 from https://www.insidehighered.com/news/2016/01/27/indigenous-professor-denied-tenure-claims-narrow-focus-peer-reviewed-publications?width=775& height=500&iframe=true

This guide is licensed under a Creative Commons Attribution License. You may copy the guide as long as credit is included. We encourage you to license your derivative works under Creative Commons as well to encourage sharing and reuse of educational materials. Please be aware that many of our guides contain links to subscription-based services for which access is restricted, and collections of resources that may have additional rights reserved. Please consult the licenses and terms of use for each resource.