For discrete random variable X, with probability distribution ,

is the Shannon Entropy.