Binomial Distribution and Hypergeometric Distribution

Both binomial distribution and hypergeometric distribution is used to measure the probability of having \(k\) successes in \(n\) draws from a population containing \(N\) objects, with \(K\) objects are considered...

Cross-Entropy and Kullback-Leibler Divergence

In the context of information theory, cross-entropy is used to calculate the expected length of code representation for a message given we’re assuming a probability distribution \(q\) of the message’s...

Deriving Poisson Probability Function from Binomial Distribution

The following is the formula to calculate the probability of an event \(X\) happening \(k\) times in a time period given that the rate of occurence of the event in...

Konigsberg Bridge Problem

This article is originally a test page for a few JavaScript libraries and plugins I can use to write code to be processed as rendered graph on the client side....

Shannon Entropy and Uncertainty of Information

Shannon entropy is commonly used in malware analysis, and I actually started writing this article after an attempt to better understand Shannon entropy after reading this paper by Duc-Ly Vu...