Deep neural networks: a theory, application and new trends

Over the last decade the deep neural networks are the revolutionary technique in the domain of artificial intelligence and machine learning. In the general case a deep neural network consists of multiple layers of neural units and can accomplish a deep hierarchical representation of their input data. The first layer extracts low-level features; the second layer detects higher level features, and as a result the deep neural network performs deep non-linear transformation of input data into more abstract level of representation. This paper provides an overview of deep neural networks and deep learning. Different deep learning techniques, including well-known and new approaches are discussed