Skip to Main Content
It looks like you're using Internet Explorer 11 or older. This website works best with modern browsers such as the latest versions of Chrome, Firefox, Safari, and Edge. If you continue with this browser, you may see unexpected results.

Critical evaluation: Processes in source creation

Processes in source creation

‚ÄčSource credibility is " a function of the reliability of the processes used by the source" (Chinn and Rinehart, 2017: 1710). Whether an expert is credible in what they write will depend on the processes used to generate the evidence. The processes used to generate the evidence will vary depending upon the subject. The research methods used and their validity is a more accurate evaluation of the credibility of the source than relying just on source features. Initial evaluation criteria of both qualitative and quantitative studies are detailed in Tables 3.6 and 3.7 of Hart (2018: 83) and appear in Fig. 1 below. These can be used as a basis of your own criteria:

Fig. 2 Initial evaluations of quantitative and qualitative studies
Key evaluation criteria Key questions to probe deeper
Credibility

Is there sufficient primary data to warrant the author's interpretation? Is the interpretation plausible?

Does the evidence support the claims? Are the claims framed against the existing literature?

Does the interpretation explain existing as well as new evidence?

Transparency What research methods were used to create the source? Are the methods suited to the aims of the study?
Corroboration

Are there multiple sources of evidence? How reliable are these? Are there alternative sources of data that could have been used? Does the author refer to other sources? Have you checked these sources to corroborate the evidence? 

Checking that other sources corroborate the information presented takes more effort than other strategies but remains "a fast and frugal means of arriving at a credibility judgment" (Metzger and Flanagin, 2013: 215). Out of 84 first year students in a study at Brigham Young University, 81 used sources in the article as a way to evaluate its reliability. This varied from commenting on what facts were sourced, whether a specific institution or organization was named as the source of the evidence or when an opinion had no supporting evidence (Silva et al., 2018).

Defined and measurable variables Have these variables been isolated and defined? Can the variables be measured? Is there a standard way of doing so and has it been used?
Validity Is the sample representative of the population being studied? Has the sample selection minimized the possibility of bias? What is the significance that the sample gives to the results?
Reliability How were threats to the accuracy of the samples and the research methods used addressed? Are the research methods transparent? Has the reliability of the research methods been confirmed?

You are more likely to rate more highly sources that produce empirical evidence based on sound research methods.

Accessibility Statement