Skip to main content

Critical evaluation: Overview

Overview

Evaluation

 

The purpose of this guide is to:

give you effective techniques you can apply when evaluating information;

make you aware of the biases that you can introduce to evaluation.

 

Advice to students on evaluating webpages often takes a checklist approach such as the CRAAP test (Meriam Library, 2019) - currency, relevance, authority, accuracy and purpose; RADAR (Mandalios, 2013) - relevance, authority, date, appearance, reason for writing; and, in a health context, the Trust in Online Health Information (TOHI) scale that features brand, content, credibility, ease of use, recommendation, style, usefulness and verification (Rowley et al., 2015). Using these features is a "fairly reliable process for evaluating sources" (Chinn and Rinehart, 2017: 1714). However, although the checklist approach is an efficient way of evaluating sources, can easily be applied and uses memorable acronyms, this efficiency encourages surface evaluation, can exclude sources that may be relevant and ignores the actual claims made in the source (Kim and Hannafin, 2016).

The checklist approach therefore needs to be augmented by emphasizing the processes used by the source in its creation. "Knowing the processes used by sources provide a more accurate evaluation of the credibility of the source's claims than relying solely on the source feature" (Chinn and Rinehart, 2017: 1711). You will therefore find that this dual approach is taken in these pages and is illustrated by a model evaluation process.

Evidence

"Interpreting sourced material is difficult and time-intensive...students need to engage in more critical thinking about what kinds of sourced material lend authority" (Silva et al., 2018: 37).  In a survey of 8,353 college students in the U.S., evaluating sources was "time-consuming and arduous, though it was perceived as essential. The process is fundamental to building a sound argument, but also selecting valid and reliable sources for an assignment was important to their credibility" (Head and Eisenberg, 2010: 18). 

Bias

Be aware that you bring your own biases to the source evaluation process. The third most used behaviour when evaluating sources in Silva et al.'s 2018 study of 84 first year undergraduates at Brigham Young University was judgment based on their own political, social, economic or religious beliefs. Students examined whether the source did or did not fit with their own beliefs and evaluated the source accordingly. Similarly, in an eye-tracking study of 79 students at a major German university (van Strien et al., 2016), participants with strong prior attitudes ranked websites that supported those attitudes as more credible than those websites that did not. These findings support the tendency for students to evaluate sources as credible if the information confirms their pre-existing beliefs and not credible if the information does not, regardless of how well-argued, well researched and referenced the information is (Metzger and Flanagin, 2013: 215). 

Academic skills guides

We have a wide range of guides to help you with academic skills: