A linguistic approach for determining the topics of Spanish Twitter messages

This manuscript version is made available under the CC-BY-NC-ND 4.0 license https://creativecommons.org/licenses/by-nc-nd/4.0/. This version of the article: Vilares, D., Alonso, M. A., & Gómez-Rodríguez, C. (2015). ‘A linguistic approach for determining the topics of Spanish Twitter messages’ has been accepted for publication in Journal of Information Science, 41(2), 127-145. Copyright © 2014 The Authors. DOI: https://doi.org/10.1177/0165551514561652.[Abstract]: The vast number of opinions and reviews provided in Twitter is helpful in order to make interesting findings about a given industry, but given the huge number of messages published every day, it is important to detect the relevant ones. In this respect, the Twitter search functionality is not a practical tool when we want to poll messages dealing with a given set of general topics. This article presents an approach to classify Twitter messages into various topics. We tackle the problem from a linguistic angle, taking into account part-of-speech, syntactic and semantic information, showing how language processing techniques should be adapted to deal with the informal language present in Twitter messages. The TASS 2013 General corpus, a collection of tweets that has been specifically annotated to perform text analytics tasks, is used as the dataset in our evaluation framework. We carry out a wide range of experiments to determine which kinds of linguistic information have the greatest impact on this task and how they should be combined in order to obtain the best-performing system. The results lead us to conclude that relating features by means of contextual information adds complementary knowledge over pure lexical models, making it possible to outperform them on standard metrics for multilabel classification tasks.The research reported in this article was partially funded by Ministerio de Economía y Competitividad and FEDER (grant TIN2010-18552-C03-02), Ministerio de Educación, Cultura y Deporte (FPU13/01180) and by Xunta de Galicia (Grants CN2012/008, CN2012/319).Xunta de Galicia; CN2012/008Xunta de Galicia; CN2012/31