Biomedical Informatics Insights

Three Hybrid Classifiers for the Detection of Emotions in Suicide Notes

Submit a Paper

Biomedical Informatics Insights 2012:5 (Suppl. 1) 175-184

Original Research

Published on 30 Jan 2012

DOI: 10.4137/BII.S8967

Further metadata provided in PDF

Sign up for email alerts to receive notifications of new articles published in Biomedical Informatics Insights


We describe our approach for creating a system able to detect emotions in suicide notes. Motivated by the sparse and imbalanced data as well as the complex annotation scheme, we have considered three hybrid approaches for distinguishing between the different categories. Each of the three approaches combines machine learning with manually derived rules, where the latter target very sparse emotion categories. The first approach considers the task as single label multi-class classification, where an SVM and a CRF classifier are trained to recognise fifteen different categories and their results are combined. Our second approach trains individual binary classifiers (SVM and CRF) for each of the fifteen sentence categories and returns the union of the classifiers as the final result. Finally, our third approach is a combination of binary and multi-class classifiers (SVM and CRF) trained on different subsets of the training data. We considered a number of different feature configurations. All three systems were tested on 300 unseen messages. Our second system had the best performance of the three, yielding an F1 score of 45.6% and a Precision of 60.1% whereas our best Recall (43.6%) was obtained using the third system.




BibTex citation   (BIBDESK, LATEX)


What Your Colleagues Say About Biomedical Informatics Insights
The publication process was efficient and well-organized. I am pleased with my decision to submit my manuscript to Biomedical Informatics Insights and highly recommend others to submit their work to the journal.
Dr Mindy Ross (University of California, San Diego, CA, USA)
More Testimonials

Quick Links

New article and journal news notification services