Topic detection using paragraph vectors to support active learning in systematic reviews

Hashimoto, Kazuma, Kontonatsios, Georgios, Miwa, Makoto and Ananiadou, Sophia (2016) Topic detection using paragraph vectors to support active learning in systematic reviews. Journal of Biomedical Informatics, 62. pp. 59-65. ISSN 2041-1480 DOI https://doi.org/10.1016/j.jbi.2016.06.001

[img]
Preview
Text
1-s2.0-S1532046416300442-main.pdf - Accepted Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

Systematic reviews require expert reviewers to manually screen thousands of citations in order to identify all relevant articles to the review. Active learning text classification is a supervised machine learning approach that has been shown to significantly reduce the manual annotation workload by semi-automating the citation screening process of systematic reviews. In this paper, we present a new topic detection method that induces an informative representation of studies, to improve the performance of the underlying active learner. Our proposed topic detection method uses a neural network-based vector space model to capture semantic similarities between documents. We firstly represent documents within the vector space, and cluster the documents into a predefined number of clusters. The centroids of the clusters are treated as latent topics. We then represent each document as a mixture of latent topics. For evaluation purposes, we employ the active learning strategy using both our novel topic detection method and a baseline topic model (i.e., Latent Dirichlet Allocation). Results obtained demonstrate that our method is able to achieve a high sensitivity of eligible studies and a significantly reduced manual annotation cost when compared to the baseline method. This observation is consistent across two clinical and three public health reviews. The tool introduced in this work is available from https://nactem.ac.uk/pvtopic/.

Item Type: Article
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Divisions: Computing and Information Systems
Date Deposited: 25 Jan 2017 16:12
URI: http://repository.edgehill.ac.uk/id/eprint/8448

Archive staff only

Item control page Item control page