TripletMAML: A metric-based model-agnostic meta-learning algorithm for few-shot classification

Abstract:This study presents a new algorithm called TripletMAML which extends the Model-Agnostic Meta-Learning (MAML) algorithm from a metric-learning perspective. The same optimization procedure of MAML is adopted, but the neural network model is replaced with a triplet network which enables the utilization of metric-learning through the embeddings. In order to be able to incorporate the metric loss during meta-learning, we have developed a triplet-task generation scheme that creates tasks consisting of triplets for both 1-shot and 5-shot settings. To the best of our knowledge, TripletMAML is the first meta-learning algorithm that is both an optimization-based and a metric-based method for few-shot image classification. We have investigated the performance of TripletMAML which is trained using a loss function that combines a classification and a metric loss on four few-shot image classification benchmarks and compared its performance to several baseline methods. The experimental results yield that TripletMAML with no data augmentation and no hyper-parameter tuning improves MAML by a large margin, and also outperforms all other baseline methods in both 1-shot and 5-shot settings. Please note that in all of those experiments, TripletMAML is trained from scratch using the tasks consisting of triplets. We have also shown that the performance of TripletMAML can be further improved via hyper-parameter optimization, and it can achieve competitive results with complex state-of-the-art algorithms. As a future study, we are planning to develop a new version of TripletMAML for few-shot image retrieval problems