
## Discrete random variables

![Discrete random variable](/img/Uni/CaC/InfTheo/drv.png)

![Expectation of a DRV](/img/Uni/CaC/InfTheo/drv_expectation.png)

## Entropy

![Entropy of a DRV](/img/Uni/CaC/InfTheo/entropy.png)

## Jensen's inequality

![Convex](/img/Uni/CaC/InfTheo/convex.png)

Jensen's inequality states

$$
\mathbb{E}(f(Y))\geqslant f(\mathbb{E}(Y))
$$

This can be shown in the below diagram

![Jensen's inequality](/img/Uni/CaC/InfTheo/jensen.png)


Introduction to Information Theory

Architecture_and_Service.md

Compute.md

Core_Cloud_Services.md

Costs_and_Spending.md

Creating_an_account.md

Data_Storage.md

Managing_Services.md

Networking.md

Policy.md

Principles_of_cloud_computing.md

Resource_Manager.md

Security.md

AZ900

Certifications

Commands.md

GitKraken.md

Introduction.md

Fork_and_PR.md

GitHub

Boilerplate.md

Links_and_Images.md

Lists.md

Tables.md

Text_Formatting.md

HTML

Code.md

Markdown

Open_Source

Information_Theory

Cuckoo_Hashing.md

Probability.md

DADS

University_Illustrations

notes

CaC

Introduction to Information Theory

CaC

Discrete random variables

Entropy

Jensen’s inequality