uniform distribution
completely correlated distribution
anti-correlated distribution
generate random values
\(P_{XY} (x,y) \)
\(x=0\)
\(x=1\)
\(y=0\)
→
←
\(P_Y(0)=\)
↓
↘
↙
↓
\(y=1\)
↑
↗
↖
↑
\(P_Y(1)=\)
→
←
\(P_X(0)=\)
\(P_X(1)=\)
Entropic Quantities
H(X) =
H(Y) =
H(X|Y) =
H(Y|X) =
I(X;Y) =
\(H(X)\)
\(H(Y)\)
Entropy Diagram