Hybrid Tiled Convolutional Neural Networks (HTCNN) Text Sentiment Classification

The tiled convolutional neural network (TCNN) has been applied only to computer vision for learning invariances. We adjust its architecture to NLP to improve the extraction of the most salient features for sentiment analysis. Knowing that the major drawback of the TCNN in the NLP field is its inflexible filter structure, we propose a novel architecture called hybrid tiled convolutional neural network (HTCNN) that applies a filter only on the words that appear in similar contexts and on their neighbouring words (a necessary step for preventing the loss of some n-grams). The experiments on the IMDB movie reviews dataset demonstrate the effectiveness of the HTCNN that has a higher level of performance of more than 3% and 1% respectively than both the convolutional neural network (CNN) and the TCNN. These results are confirmed by the SemEval-2017 dataset where the recall of the HTCNN model exceeds by more than six percentage points the recall of its simple variant, CNN.