An overview of the development and applications of information entropy

With information entropy gradually taking the lead in modern information theory development, it begins to hold greater influence over multiple research areas as well as technology innovation. This paper aims to clarify peoples confusion with the development of entropy theory and provide a brief overview of the origin of entropy theory, including the original Shannons proposal, variants such as relative entropy and conditional entropy, and entropy concepts proposed by other scientists, such as Rnyi Tsallis entropy. The paper also includes the current application of entropy, studies hotspots, and predicts future entropy development trends. This research paper is able to add more coherence and consistency to information entropys development, helping more people to better understand the concept of entropy and its derivation. At the same time, with hotspots of entropy fields of study, this paper hopes to attract more people to devote themselves to studying entropy-related fields, and boost technological development.