Abstract: In this simple and heuristic talk using Huffman and Arithmetic compression, we will give a motivation as to why Shannon’s entropy is defined as is. Then, we will show how arithmetic compression naturally gives rise to some of the exotic functions of real analysis and measure theory. This talk will be elementary and geared towards undergrads.