정보이론-5(2)W

• Entropy

 

# Properites of Entropy

• Decomposability

• Gibb's Inequality

• Convex Function

• Jensen's Inequality

• Evidence Lower Bound

• Joint Entropy

• Conditional Entropy

• Mutial Information

 

---