Pr [x £ E] = ∑ Pr ⁡[ x ]

x∈ E

TEORI 3.1 (Teorema Bayes) Jika Pr [y] > 0, maka

Pr [ x ] Pr [ y ∨x]
Pr[x | y] =
Pr [ y ]

C(K)={eK(x) : x ≠ P}

Pr [K =K ]
Pr [y = y | x = x] = { K : y∑
∈C ( K ) }
Pr[ x = dK(y)]

Pr [ x=x ] × ∑ Pr ⁡[ K =K ]
{K : x=d K ( y ) }
Pr [x = x | y = y]=
∑ Pr ⁡[ K =K ]Pr ⁡[x=d K ( y ) ]
{ K : y∈C ( K ) }

  Pr [K = K] Pr [x = d K (y)].

{K: yEC (K)}

Z26

Pr [y = y] = K∑ Pr [ K =K ] Pr [ x=d K ( y)]
∈Z 26

1
= ∑ Pr [ x= y −K ]
K ∈Z 26 26
1
= 26 ∑ Pr ⁡[ x= y−K ]❑
K ∈Z 26
 ∑ Pr [ x= y −K ] = K∑ Pr [ x=x ]
K ∈Z 26 ∈Z 26

= 1

1
Pr[y]= 26

Pr [y | x] = Pr[K=(y-x) mod 26]

1
= 26

Pr [ x ] Pr [ y ∨x]
Pr [x | y] = Pr [ y ]

1
Pr [ x ]
2 ≤ ≥6
= 1
ε
26

| 𝒞 | = | {eK(x): K ∈ 𝒦} |
≤| 𝒦 |

εℇ

𝒦𝒞𝒫𝛦£≤ ≥

|{eK(x) : K → ∈ 𝒦 }| = | 𝒦 |
eKi

eK(x)=( x1 + K1, ... , xn + Kn) mod 2

dK(y)=( y1 + K1, ... , yn + Kn) mod 2
∑ Pr [ x ] log2 Pr ⁡[x ]
H(X) = - x∈ X

limy→0 y log2 y=0

1 1 3 3
H(P) = - 4 log2 4 - 4 log2 4

1 3
= - 4 (-2) - 4 (log2 3 – 2)

3
= 2 - 4 (log2 3)

≈ 0.81

x+ y f ( x )+ f ( y )
𝑓( 2 ) ≥
2

∑ ai = 1
i=1

n n

∑ ai f(x i ) ≤ f ( ∑ a i x i)
i=1 i=1
 n

H(X)= - ∑ p i log2 p i
i=1

n
1
=∑ p i log2 p i
i=1

n
≤ log2 ∑ ¿¿ )
i=1

m
q j=∑ r ij
i =1

H(X) + H(Y) = −¿log2q j )

m n n m
= −¿ ∑ ∑ r ij log 2 p i + ∑ ∑ r ij log 2 q j)
i=1 j=1 j=1 i=1

m n

= −¿ ∑ ∑ r ij log 2 p i q j
i=1 j=1

m n

H(X,Y) = −¿ ∑ ∑ r ij log 2 r ij
i=1 j=1

m n m n
1
H(X,Y) – H(X) – H(Y) = ∑ ∑ r ij log 2 rij
+ ∑ ∑ r ij log 2 p i q j
i=1 j=1 i=1 j=1

m n
piqj
= ∑ ∑ r ij log 2
i=1 j=1 rij
m n
≤ log 2 ∑ ∑ p i q j
i=1 j=1

= log 2 1
=0
 n m n m

∑ ∑ r ij=∑ ∑ p i q j = 1
j=1 i=1 j=1 i=1

H(X | y) = −∑ Pr [ x∨ y ]log 2 Pr [ x∨ y ]
x

H(X | y) = −∑ ∑ Pr [ y ] Pr [x∨ y ] log 2 Pr [x∨ y ]

y x

´ ∞
+ Sn
∃

H ( P n)
HL = lim
n→∞ n

HL
RL = 1− log
2|P|

Sn=
´ ∑ Pr ⁡[ y ]¿ ¿
n
y ∈c

¿ ∑ Pr ⁡[ y ]¿ ¿
n
y ∈c

H(Pn) ≈ nHL = n (1 - RL) log2 | P |,

H (Cn) ≤ ≥n log2 | 𝒞 |.

H(K | Cn) ≥ H(K) – nRL log2 | 𝒫 |.

 Pr [ y ] H ( K| y ¿ ¿
H(K | Cn) = y∑
∈c
n

≤ ∑ Pr [ y ] log2∨¿ ( K| y ¿
n
y ∈c

≤ log 2 ∑ Pr [ y ] ∨K ( y )∨¿ ¿
n
y ∈c

= log 2( śn +1)

H(K | Cn) ≤ log 2( śn +1)

log 2 ( ś n +1 ) ≥⊆ H ( K )−¿ nRL log2 | 𝒫 |

śn ≥ log 2∨P∨ ¿ ¿

RL log 2∨K∨¿ ¿