The expressive power of analog recurrent neural networks on infinite input streams

International audienceWe consider analog recurrent neural networks working on in nite input streams, provide a complete topological characterization of their expressive power, and compare it to the expressive power of classical in nite word reading abstract machines. More precisely, we consider analog recurrent neural networks as language recognizers over the Cantor space, and prove that the classes of !-languages recognized by deterministic and non-deterministic analog networks correspond precisely to the respective classes of 02 -sets and 11 -sets of the Cantor space. Furthermore, we show that the result can be generalized to more expressive analog networks equipped with any kind of Borel accepting condition. Therefore, in the deterministic case, the expressive power of analog neural nets turns out to be comparable to the expressive power of any kind of Buchi abstract machine, whereas in the non-deterministic case, analog recurrent networks turn out to be strictly more expressive than any other kind of Buchi or Muller abstract machine, including the main cases of classical automata, 1-counter automata, k-counter automata, pushdown automata, and Turing machines