Artificial Intelligence (AI) and the literature review process: Quality assurance
Application of AI tools such as ChatGPT to searching and all aspects of the literature review process
AI tools have limited utility for academic quality assessment due to potential training biases and inability to contextualise research significance.
Can I use AI to assess the quality of a paper?
AI tools are not recommended when reviewing or assessing the quality of academic papers for flaws in methodology or other sources of bias (Tingelhoff et al., 2024).
The key issue is that the data on which the LLM is trained may introduce biases by giving a higher priority to certain types of research. They may also fail to capture the significance of a study in its own context. There is therefore a low-to-moderate potential for semi-automated quality assessment (Wagner et al, 2022).