All Title Author
Keywords Abstract

Publish in OALib Journal
ISSN: 2333-9721
APC: Only $99


Relative Articles


Analysis and Enlightenment of the Relationship between Information Sources in Information Theory

DOI: 10.12677/ISL.2023.73015, PP. 104-113

Keywords: 信息论,信源关系,信息熵,维恩图
Information Theory
, Information Sources Relationship, Information Entropy, Venn Diagram

Full-Text   Cite this paper   Add to My Lib


With the development of modern information technology, information theory, as a communication theory and methodology, has been widely studied and applied, playing an important role. Under-standing the relationship between information sources can better grasp the basic concepts and connotations of information theory, and understand its methods. In response to the insufficient discussion of information source relationships in various textbooks, this article adopts the Venn di-agram representation of event to event relationships, systematically analyzes the three relation-ships of information sources: union, condition, and interaction, as well as their corresponding in-formation entropy. It focuses on explaining their various meanings and inspirations in communica-tion systems.


[1]  Togneri, R. and de Silva, C.J.S. (2006) Fundamentals of Information Theory and Coding Design. CRC Press, Boca Ra-ton.
[2]  鲍宗博, 高莹, 刘建伟. 从Venn图看信息论中各信息量之间的关系[J]. 高等数学研究, 2020, 23(1): 69-72+75.
[3]  贺志强, 吴伟陵. 信息处理与编码(第三版) [M]. 北京: 人民邮电出版社, 2012.
[4]  王育民, 李晖. 信息论与编码理论[M]. 北京: 高等教育出版社, 2013.
[5]  田宝玉, 杨洁, 贺志强, 许文俊. 信息论基础[M]. 北京: 人民邮电出版社, 2016.
[6]  于秀兰, 王永, 陈前斌. 信息论与编码[M]. 北京: 人民邮电出版社, 2014.
[7]  姚善化, 许恒迎, 许耀华, 苏静明. 信息理论与编码[M]. 北京: 人民邮电出版社, 2015.


comments powered by Disqus

Contact Us


WhatsApp +8615387084133

WeChat 1538708413