In diagnostic decision-support systems, test selection amounts to selecting, in a sequential manner, a test that is expected to yield the largest decrease in the uncertainty about a patient’s diagnosis. For capturing this uncertainty, often an information measure is used. In this paper, we study the Shannon entropy, the Gini index, and the misclassification error for this purpose. We argue that the Gini index can be regarded as an approximation of the Shannon entropy and that the misclassification error can be looked upon as an approximation of the Gini index. We further argue that the differences between the first derivatives of the three functions can explain different test sequences in practice. Experimental results from using the measur...
AbstractFor qualitative data models, Gini–Simpson index and Shannon entropy are commonly used for st...
Objective: Successful use of classifiers that learn to make decisions from a set of patient examples...
The combination of mathematical models and uncertainty measures can be applied in the area of data m...
The use of gold standard procedures in screening may be costly, risky or even unethical. It is, ther...
Paper presented at the 4th Strathmore International Mathematics Conference (SIMC 2017), 19 - 23 June...
Information theory has gained application in a wide range of disciplines, including statistical inf...
In decision-making systems, how to measure uncertain information remains an open issue, especially f...
Although more than sixty years have elapsed since Shannon's seminal information entropy paper t...
Relative entropy is a concept within information theory that provides a measure of the distance betw...
Searching for information is critical in many situations. In medicine, for instance, careful choice ...
The most widely used forms of model selection criteria, the Bayesian Information Criterion (BIC) an...
Multi-label classifiers allow us to predict the state of a set of responses using a single model. A ...
In medical emergency situations, the triage process allows patients in potentially life-threatening ...
A probabilistic network built for an application domain often has a single output variable of intere...
Many algorithms of machine learning use an entropy measure as optimization criterion. Among the wide...
AbstractFor qualitative data models, Gini–Simpson index and Shannon entropy are commonly used for st...
Objective: Successful use of classifiers that learn to make decisions from a set of patient examples...
The combination of mathematical models and uncertainty measures can be applied in the area of data m...
The use of gold standard procedures in screening may be costly, risky or even unethical. It is, ther...
Paper presented at the 4th Strathmore International Mathematics Conference (SIMC 2017), 19 - 23 June...
Information theory has gained application in a wide range of disciplines, including statistical inf...
In decision-making systems, how to measure uncertain information remains an open issue, especially f...
Although more than sixty years have elapsed since Shannon's seminal information entropy paper t...
Relative entropy is a concept within information theory that provides a measure of the distance betw...
Searching for information is critical in many situations. In medicine, for instance, careful choice ...
The most widely used forms of model selection criteria, the Bayesian Information Criterion (BIC) an...
Multi-label classifiers allow us to predict the state of a set of responses using a single model. A ...
In medical emergency situations, the triage process allows patients in potentially life-threatening ...
A probabilistic network built for an application domain often has a single output variable of intere...
Many algorithms of machine learning use an entropy measure as optimization criterion. Among the wide...
AbstractFor qualitative data models, Gini–Simpson index and Shannon entropy are commonly used for st...
Objective: Successful use of classifiers that learn to make decisions from a set of patient examples...
The combination of mathematical models and uncertainty measures can be applied in the area of data m...