Add to ORKGInternational audienceOver the last five years, transfer approaches using Transformer-like models have established the state of the art on many tasks in Natural Language Understanding. These approaches are becoming increasingly popular and require large amounts of data and computational resources. Most of the pre-trained language models have been extensively studied in English and only a few of them have been evaluated on a French spoken language understanding task. In this paper, we propose a baseline overview, focusing on the quality evaluation of thirteen well-established models based on Transformers models. The two spoken language understanding tasks considered are MEDIA and ATIS-FR.Au cours des cinq dernières années, les approches par ...
Depuis plusieurs années, les approches neuronales ont régulièrement amélioré l'état de l'art du trai...
National audienceContextualized language models based on the Transformer architecture such as BERT (...
Transformers have taken the centre stage for most NLP applications after LSTM’s were established as ...
International audienceOver the last five years, transfer approaches using Transformer-like models ha...
International audienceIn the last five years, the rise of the self-attentional Transformerbased arch...
International audienceFor many tasks, state-of-the-art results have been achieved with Transformer-b...
In the last five years, the rise of the self-attentional Transformer-based architectures led to stat...
This paper presents an overview of the state of the art in natural language processing, exploring on...
Web site: https://camembert-model.frPretrained language models are now ubiquitous in Natural Languag...
For many tasks, state-of-the-art results have been achieved with Transformer-based architectures, re...
International audienceIn this article we provide a linguistic analysis of a corpus of machine-transl...
International audienceRecent advances in spoken language understanding benefited from Self-Supervise...
RÉSUMÉ: En raison de la popularité croissante des modèles de langage à base de Transformers (TLMs), ...
The purpose of language models is in general to capture and to model regularities of language, there...
Le développement de la traduction automatique implique non seulement des documents plus variés, mais...
Depuis plusieurs années, les approches neuronales ont régulièrement amélioré l'état de l'art du trai...
National audienceContextualized language models based on the Transformer architecture such as BERT (...
Transformers have taken the centre stage for most NLP applications after LSTM’s were established as ...
International audienceOver the last five years, transfer approaches using Transformer-like models ha...
International audienceIn the last five years, the rise of the self-attentional Transformerbased arch...
International audienceFor many tasks, state-of-the-art results have been achieved with Transformer-b...
In the last five years, the rise of the self-attentional Transformer-based architectures led to stat...
This paper presents an overview of the state of the art in natural language processing, exploring on...
Web site: https://camembert-model.frPretrained language models are now ubiquitous in Natural Languag...
For many tasks, state-of-the-art results have been achieved with Transformer-based architectures, re...
International audienceIn this article we provide a linguistic analysis of a corpus of machine-transl...
International audienceRecent advances in spoken language understanding benefited from Self-Supervise...
RÉSUMÉ: En raison de la popularité croissante des modèles de langage à base de Transformers (TLMs), ...
The purpose of language models is in general to capture and to model regularities of language, there...
Le développement de la traduction automatique implique non seulement des documents plus variés, mais...
Depuis plusieurs années, les approches neuronales ont régulièrement amélioré l'état de l'art du trai...
National audienceContextualized language models based on the Transformer architecture such as BERT (...
Transformers have taken the centre stage for most NLP applications after LSTM’s were established as ...