Analysis on Limitation Origins of Information Theory

Part 2: Machine LearningInternational audienceThe limitations of Shannon information theory are pointed out from new perspectives. The limitations mainly exist in the neglects of the information reliability and completeness. The significances of the information reliability to the information measurements are further illustrated through example analysis. It is pointed out that such limitations originate from neglects of multi-level information uncertainties, uncertainty of the model and other objects of information system, and insufficient knowledge on uncertainties of probability values