Differentiable Neural Network Architecture Search

The aim of this work is to propose a system for differentiable architecture search, which can be used for design of some neural network types. The work is based on the DARTS (Differentiable architecture search) approach and implements similar system in TensorFlow. Experiments with regular convolution neural networks, convolution neural networks using approximate multipliers and neural networks combining attention and convolution machanisms are presented. The main contribution of this work is novel implementation of a diferentiable architecture search system supporting various layers from the recent versions of the TensorFlow library