2012a) MEDLINE MeSH indexing: lessons learned from machine learning and future directions

Due to the large yearly growth of MEDLINE, MeSH in-dexing is becoming a more difficult task for a relatively small group of highly qualified indexing staff at the US Na-tional Library of Medicine (NLM). The Medical Text In-dexer (MTI) is a support tool for assisting indexers; this tool relies on MetaMap and a k-NN approach called PubMed Related Citations (PRC). Our motivation is to improve the quality of MTI based on machine learning. Typical machine learning approaches fit this indexing task into text catego-rization. In this work, we have studied some Medical Subject Headings (MeSH) recommended by MTI and analyzed the issues when using standard machine learning algorithms. We show that in some cases machine learning can improve the annotations already recommended by MTI, that machine learning based on low variance methods achieves better per-formance and that each MeSH heading presents a different behavior. In addition, there are several factors which make this task difficult (e.g. limited access to the full-text of the citations) which provide direction for future work