
## Venn Diagram of Entropy

![Entropy Venn](/img/Uni/CaC/InfTheo/entropy_venn.png)

$I(X,Y)$ is the **mutual information**

$H(Y|X)$ is the information Y provides given that X is known. This is expected to be less than $H(Y)$ as by having joint entropy, the value of X provides some information about Y.


Mutual Information

Architecture_and_Service.md

Compute.md

Core_Cloud_Services.md

Costs_and_Spending.md

Creating_an_account.md

Data_Storage.md

Managing_Services.md

Networking.md

Policy.md

Principles_of_cloud_computing.md

Resource_Manager.md

Security.md

AZ900

Certifications

Commands.md

GitKraken.md

Introduction.md

Fork_and_PR.md

GitHub

Boilerplate.md

Links_and_Images.md

Lists.md

Tables.md

Text_Formatting.md

HTML

Code.md

Markdown

Open_Source

Information_Theory

Cuckoo_Hashing.md

Probability.md

DADS

University_Illustrations

notes