The routine definitions of Shannon entropy for both discrete and continuous probability laws show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that: (1) they no longer show incongruities; and (2) they go one into the other in a suitable limit as the result of a renormalization. The properties of the new quantities would slightly differ from that of the usual entropies in a few other respects
Properites of the the conditional entropy are studied and it is shown that Hartley's conditional ent...
In a previous note (1) we suggested the existence of a quantum entropy associated with a free quantu...
Shannon’s entropy is calculated using probabilities P(i) i.e. S= - Sum over i P(i) ln(P(i)). A proba...
The routine definitions of Shannon entropy for both discrete and continuous probability laws show in...
Based on the non-standard analysis by Robinson, a new definition of the entropy of general distribut...
Convergence properties of Shannon Entropy are studied. In the di erential setting, it is known that...
In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatia...
We live in the information age. Claude Shannon, as the father of the information age, gave us a theo...
The discrete Shannon entropy H was formulated only to measure indeterminacy effected through a set o...
The Boltzmann–Gibbs–Shannon (BGS) entropy S d of a system with discrete states is inherently non-neg...
This paper deals with the measurement of entropy when an indistinguishability relation on the set of...
Shannon entropy of a probability measure P, defined as $- \int_X(dp/d \mu) \hspace{2} ln (dp/d \mu)d...
In this note, we examine the behaviour of Shannon’s entropy density for some examples in quantum mec...
Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system ba...
Burg’s entropy plays an important role in this age of information euphoria, particularly in understa...
Properites of the the conditional entropy are studied and it is shown that Hartley's conditional ent...
In a previous note (1) we suggested the existence of a quantum entropy associated with a free quantu...
Shannon’s entropy is calculated using probabilities P(i) i.e. S= - Sum over i P(i) ln(P(i)). A proba...
The routine definitions of Shannon entropy for both discrete and continuous probability laws show in...
Based on the non-standard analysis by Robinson, a new definition of the entropy of general distribut...
Convergence properties of Shannon Entropy are studied. In the di erential setting, it is known that...
In the literature (e.g. (1)), the expression - density(x) ln(density(x)) is used as Shannon’s spatia...
We live in the information age. Claude Shannon, as the father of the information age, gave us a theo...
The discrete Shannon entropy H was formulated only to measure indeterminacy effected through a set o...
The Boltzmann–Gibbs–Shannon (BGS) entropy S d of a system with discrete states is inherently non-neg...
This paper deals with the measurement of entropy when an indistinguishability relation on the set of...
Shannon entropy of a probability measure P, defined as $- \int_X(dp/d \mu) \hspace{2} ln (dp/d \mu)d...
In this note, we examine the behaviour of Shannon’s entropy density for some examples in quantum mec...
Thermodynamic entropy, as defined by Clausius, characterizes macroscopic observations of a system ba...
Burg’s entropy plays an important role in this age of information euphoria, particularly in understa...
Properites of the the conditional entropy are studied and it is shown that Hartley's conditional ent...
In a previous note (1) we suggested the existence of a quantum entropy associated with a free quantu...
Shannon’s entropy is calculated using probabilities P(i) i.e. S= - Sum over i P(i) ln(P(i)). A proba...