Optimisation problems typically involve finding the ground state (i.e. the minimum energy configuration) of a cost function with respect to many variables. If the variables are corrupted by noise then this maximises the likelihood that the solution is correct. The maximum entropy solution on the other hand takes the form of a Boltzmann distribution over the ground and excited states of the cost function to correct for noise. Here we use a programmable annealer for the information decoding problem which we simulate as a random Ising model in a field. We show experimentally that finite temperature maximum entropy decoding can give slightly better bit-error-rates than the maximum likelihood approach, confirming that useful information can be e...
Estimation of Distribution Algorithms (EDA) have been proposed as an extension of genetic algorithms...
The maximum entropy method is a theoretically sound approach to construct an analytical form for the...
We present an extension to Jaynes’ maximum entropy principle that incorporates latent variables. The...
Optimisation problems typically involve finding the ground state (i.e. the minimum energy configurat...
We propose a framework for learning hidden-variable models by optimizing entropies, in which entropy...
International audienceMaximum entropy models provide the least constrained probability distributions...
Entropy is a central concept in physics and has deep connections with Information theory, which is o...
We present a new statistical learning paradigm for Boltzmann machines based on a new inference princ...
The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sam...
Abstract. The channel capacity of a deterministic system with confidential data is an upper bound on...
The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only rec...
The combination of mathematical models and uncertainty measures can be applied in the area of data m...
Abstract. The principle of maximum entropy is a powerful framework that can be used to estimate clas...
International audienceThe channel capacity of a deterministic system with confidential data is an up...
Efficient approximation lies at the heart of large-scale machine learning problems. In this paper, w...
Estimation of Distribution Algorithms (EDA) have been proposed as an extension of genetic algorithms...
The maximum entropy method is a theoretically sound approach to construct an analytical form for the...
We present an extension to Jaynes’ maximum entropy principle that incorporates latent variables. The...
Optimisation problems typically involve finding the ground state (i.e. the minimum energy configurat...
We propose a framework for learning hidden-variable models by optimizing entropies, in which entropy...
International audienceMaximum entropy models provide the least constrained probability distributions...
Entropy is a central concept in physics and has deep connections with Information theory, which is o...
We present a new statistical learning paradigm for Boltzmann machines based on a new inference princ...
The need to estimate smooth probability distributions (a.k.a. probability densities) from finite sam...
Abstract. The channel capacity of a deterministic system with confidential data is an upper bound on...
The concept of maximum entropy can be traced back along multiple threads to Biblical times. Only rec...
The combination of mathematical models and uncertainty measures can be applied in the area of data m...
Abstract. The principle of maximum entropy is a powerful framework that can be used to estimate clas...
International audienceThe channel capacity of a deterministic system with confidential data is an up...
Efficient approximation lies at the heart of large-scale machine learning problems. In this paper, w...
Estimation of Distribution Algorithms (EDA) have been proposed as an extension of genetic algorithms...
The maximum entropy method is a theoretically sound approach to construct an analytical form for the...
We present an extension to Jaynes’ maximum entropy principle that incorporates latent variables. The...