Using deep learning to evaluate the efficiency and accuracy of study selection for psychiatric systematic reviews


This is a virtual seminar. For a Zoom link, please see "Venue details". Please consider subscribing to mailing list: web.maillist.ox.ac.uk/ox/subscribe/ai4mch

Scientific publications in mental health are rapidly growing in number and complexity, making curation and synthesis of abstracts for systematic reviews in the field increasingly time-consuming and challenging. With the expansion of the scientific corpus, systematic reviews on broad topic have also complicated human review, in part, due to variations and lack of objectivity among multiple human reviewers in interpretation and suitability for inclusion/exclusion. Resolving these complexities can themselves be time-consuming and impact topic selection, as well as the accuracy and breadth of systematic reviews. To address challenges in efficiency and accuracy, we propose and evaluate multiple machine learning-based approaches to capture inclusion and exclusion criteria and automate the abstract selection process. We fine-tuned or trained models for four systematic review topic areas (i.e., Resilience, Biomarkers & Disease, Stressors, and Conditions) from psychiatry abstracts selected by trained human reviewers. The trained or fine-tuned machine learning models were then applied to abstracts derived from an independently curated oncology literature database. Transformer-based machine learning models outperformed trained human reviewers in abstract screening for three out of four topic areas. Such artificial intelligence-augmented approaches may facilitate the sharing and synthesis of research expertise across disciplines.