Professional Documents
Culture Documents
Diakrita PDF
Diakrita PDF
ISBN: 978-960-603-361-2
Copyright , 2015
Creative Commons -
- 3.0.
https://creativecommons.org/licenses/by-nc-nd/3.0/gr/
9, 15780
www.kallipos.gr
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
11
11
11
15
16
19
21
23
25
28
28
32
35
37
43
47
2.1 , . . . . . . . . . . . . . . . . . . . . . . . . . . . .
2.2 , , . . .
2.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
51
51
53
56
3.1 . . . . . . . . .
3.1.1 . . .
3.1.2 A B . . .
3.2 - . . . . . .
3.2.1 .
3.2.2 . . . . . . . . .
3.3 . . . . . . . . . . . . . . .
3.4 Video . . . . . . . . . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
63
63
66
68
69
70
73
77
80
4.1 . . . . . . . . . . . . . . . . . . . . . . . .
4.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
4.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
83
83
86
88
1.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.4 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.5 . . . . . . . . . . . . . . . . . . . . . . . . . . .
1.6 . . . . . . . . . . . . . . . . . . . . .
1.7 . . . . . . . . . . . . . . . . . . . . . . . . . .
1.8 . . . . . . . . . . . . .
1.9 . . . . . . . . . . . . . . . . . . . . . . . . .
1.9.1 . . . . . . . . . . . . . . . .
1.9.2 . . . . . . . . . . . . . .
1.9.3 : (Hall) . . . . . . . . . . .
1.10 . . . . . . . . . . . . . . . . . . . . . . . . .
1.11 . . . . . . . . . . . . . . . . .
1.12 Video . . . . . . . . . . . . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
4.4
4.5
4.6
. . . . . . . . . . . . . . . . . . . . . . . . . . . 91
. . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Video . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93
5.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.3.1 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.3.2 . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.4 . . . . . . . . . . . . . . . . . . .
5.5 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
5.6 . . . . . . . . . . . . . . . . . . . . . . . . .
5.7 Kruskal
5.8 Floyd-Warshall . . . . . .
.
.
.
.
.
.
.
.
.
.
97
97
101
101
101
103
106
110
115
117
119
6.1 . . . . . . . . . . . . . . .
6.2 . . . . . . .
6.3 . . . . . . . . . . . . . .
6.4 Euler Hamilton
6.4.1 . . . . . . . . . . . . . . . . . .
6.4.2 / Euler
6.5 . . . . . . . . . . . . . . . . . .
6.5.1 . . . . . . . . . . . . . . . . . .
6.5.2 .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
125
125
129
131
135
135
136
137
137
138
7.1 , . . . . . . . . . . . . . . .
7.2 . . . . . . . . . . . . . . . . .
7.3 . . . . . . . . . . . . . . .
7.4 NFA DFA. . . . . . . . . . . . . . . . . .
7.5 NFA - . . . . . . . . . . . . . . . . . . . . .
7.6 -NFA NFA . . . . . . . . . . . . . . . .
7.7 . . . . . . . . .
7.8 . . . . . . . . . .
7.9
7.10 . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
143
143
146
151
154
157
159
160
162
165
167
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
173
8.1 DFA . . . . . . . . . . . . . . . . . . . . 173
8.2 . MyhillNerode . . . . . . . 175
8.3 DFA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 177
Context free
9.1 . . . . . .
9.2 context free . . . . .
9.3 . . . . . . . . . . .
9.4 context free . . . . . . . . . . . . .
9.5 (Push Down Automaton) . . . . . . . . . .
9.6 PDA . . . . . . . . . . . . . . . . . . . . . . . . . .
9.7 context free ,
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
181
181
182
183
185
186
189
190
10
10.1 . . . . . . . . . . . . .
10.2 . . . . . . . . . . . . . . . . . . . . . . . .
10.3 Halting Problem. .
10.4 (..) . . . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
195
195
196
198
200
11
11.1 . . . . . . . . . . . . . . . . . . . . . .
11.1.1 . . . . . . . . . . . . . .
11.1.2 . . . . . . . . . . . . . . . . .
11.1.3 . . . . . . . . . . . . .
11.1.4 . . . . . . . . . . . . . .
11.1.5 . . . . . . . . . . . . . .
11.1.6 . . . . . . . . . . . . . .
11.2 , ,
11.2.1 . . . .
11.2.2 0 . . . . . . . .
11.3 . . . . . . . . . . . . . .
11.4 . . . . . . . . . . . . .
11.5 Video . . . . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
207
207
207
207
207
208
208
208
209
214
215
215
218
224
12
12.1 . .
12.2 . . . . . . . . . . . . . .
12.3
12.4 . . . . . . . . . . .
12.5 Video . . . . . . . . . . . . . . .
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
229
229
237
243
246
248
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
253
ASCII
CFG
CFL
DFA
NFA
NP
PDA
http://mk.eigen-space.org/discretebook
,
, , , .
. PDF (links)
video youtube,
online ( ) .
PDF
browser . copy
PDF paste browser .
:
.
Online video. video ( youtube)
.
python.
.
10
Kamke 1950, Halmos 1960 C. L.
Liu and C. Liu 1985.
1.1
1.2
. . p A, :
pA
(: p A). A :
p
/A
(: p A).
1.1
( ) , ,
.
: :
1. , ..
a, b, c
{a, b, c}.
a {a} .
11
12
1.
2. Venn. ..,
A = {1, 2, 3, 4, 5},
B = {1, 3, 5},
1.1.
1.1: A B Venn
3. () P (x)
, , ( .. ),
x .
{x : P (x)},
x P (x).
:
{x : x S & P (x)},
:
{x S : P (x)}.
1.1
100.
x Z : x2 < 100 .
( )
{9, 8, . . . , 8, 9}
-9 9.
1.2
(, ) A, B . A
B, A B B B :
A B, B A.
A B, B A.
, A B, A A.
Venn B A 1.2.
1.2.
13
1.2: Venn B A
:
B
B. A B & B A
A = B. .
1.2
2. A = {x}. :
() x A,
() y A = y = x.
A B & A 6= B A B A $ B. A
B : A * B.
1.1
1.2
:
A = {2, 3, 4},
B = x : x2 = 4 & x > 0 ,
C = {x : x2 6x + 8 = 0},
D = {x Z : x o}.
, ( ), .
1. A . . . B
2. A . . . C
3. B . . . C
14
1.
4. A . . . D
5. B . . . D
6. C . . . D
1.3
:
1. {1, 4, 3} {1, 3, 4},
2. {4} {{4}},
3. {4} {{4}},
4. {{4}}.
1.3
( ) X . X
X 2X P(X). :
2X = P(X) = {A : A X}.
1.3
X = {1, 2}. , 2X = {, {1}, {2}, {1, 2}}.
1.4
( ) , x, y,
. , , , x,
, , , y (x, y).
.
:
(x, y) = (u, v) x = u & y = v.
{x, y} = {y, x} (x, y) =
6 (y, x).
1.5
( ) X, Y . X, Y
:
X Y = {(x, y) : x X & y Y }.
X = Y X 2 . :
X X = X 2 = {(x, y) : x X & y X}.
. n- n
. n- :
(x1 , x2 , ..., xn ).
X1 , X2 , ..., Xn , :
ni=1 Xi = X1 X2 Xn = {(x1 , x2 , . . . , xn ) : x1 X1 , x2 X2 , . . . , xn Xn }.
X1 = X2 = ... = Xn = X
X n.
1.3.
1.3
15
1.6
( ) AB
A, B P (x, y) ,
x, y (a, b) A B, P (a, b)
.
1.4
P (x, y) = x y, A B,
A = {x : x }, B = {y : y }.
P (, ) =
P (, ) =
1.5
P (x, y) = (x < y) R2 , x, y
R.
1.7
() R A B A
B. , ,
A B
R A B.
P (x, y) :
R = {(a, b) A B : P (a, b) = }.
(a, b) R, aRb.
1.6
A = {x N : x < 20}, B = {3, 6, 21}.
A B:
P (x, y) = ( x y).
:
R = {(3, 3), (6, 3), (9, 3), (12, 3), (15, 3), (18, 3), (6, 6)(12, 6), (18, 6)}.
: 12R6, 12R3.
A B :
{3, 6, 7, 9, 12, 15, 18}.
.
B A:
{3, 6},
.
16
1.
1.8
( , ) R A B
:
dom R = {a A : b B (a, b) R},
1.4
1.4
f A B A ( , , f )
B. ( f ). ,
.
1.11
() f A B f A B :
x dom f {y B : (x, y) f } .
(x, y) f y = f (x).
1.4.
17
1.7
A = {a, b, c, d}, B = {1, 2, 3, 4}
f = {(a, 1), (b, 2), (c, 3), (a, 3)}, g = {(a, 1), (b, 1), (c, 1)}, h = {(a, 1), (b, 2), (c, 4), (d, 3)}.
g h dom g = {a, b, c}, dom h = A.
f : A B A.
f (x) x A.
1.8
A = {x : x }, B = {y : y }. f : A B
f (x) = x.
, f ()=.
1.5
R R:
f = {(x, y) : x + 3y = 1}, g = {(x, y) : x2 + y 2 = 1}, h = {(x, y) : x2 + y 2 = 1 & y > 0}.
.
.
1.12
f : A B E A. f E :
f |E = {(x, y) : x E & y = f (x)}.
, dom f = E f |E (x) = f (x), x E.
1.13
(, ) X A Y B X f
Y f , :
f (X) = {y B : y = f (x), x A}, f 1 (Y ) = {x A : f (x) Y }.
1.9
f : A = {a, b, c, d} B = {1, 2, 3} f (a) = f (b) = f (c) = 1 f (d) = 3. :
f (A) = f ({a, d}) = {1, 3}
1.6
f A B. f 1
f 1-1.
18
1.
1.7
f : R R
(
2x 1
f (x) =
x2 + x
x < 12
x 12 .
) f 1-1 .
) f 1 .
:
)
x1 < x 2 <
1
2x1 < 2x2 < 1 2x1 1 < 2x2 1 < 0.
2
(1.1)
1
3
x1 < x2 f (x1 ) < f (x2 ) .
(1.2)
2
4
(1.1), (1.2) 0 < y < 34 x R f (x) = y. f .
(1.1), (1.2) 1-1 .
) 43 y
1 + 4 + 4y
1
2
f (x) = y x + x y = 0 x =
.
(1.3)
2
2
y < 0
1
y+1
< .
(1.4)
f (x) = y x =
2
2
(1.1), (1.2), (1.3), (1.4)
3
f (R) = {y R : y < 0 0 y }
4
y+1
1 + 4 + 4y
3
1
1
f (y) =
y < 0 f (y) =
y .
2
2
4
f 1 :f 1 (y) = x f (x) = y. dom f 1 =
range f .
1.8
f, g, h : R R
f (x) = 3x 4
(
x2 + 3x x 2
g(x) =
.
x+2
x < 2
h(x) = x2 + |x|.
1-1 .
g g(A), g(B) A = [2, ), B = (, 2) .
1.15
( ) . f :
A B, g : B C. g f : A C g f (x) = g(f (x)).
1.9
f : A B, g : B C 1-1. g f 1-1.
1.5.
1.5
19
1.16
( ) A, B :
1. A, B A B
A B , :
A B = {x : x A 0 x B}.
1.3: A, B () Venn
2. A, B A B
A B:
A B = {x : x A x B}.
1.4: A, B () Venn
3. A, B, A \ B
A B:
A \ B = {x : x A x
/ B}.
, , , . A , Ac ,
:
Ac = {x : x
/ A}.
20
1.
1.5: A \ B () Venn
1.6: A () Venn
1.11
.
= {1, 2, 3, 4, 5, 6} {1, 2, 3, 4, 5, 6} = {(x, y) : x, y N & 1 x, y 6}.
36 . :
A = {(x, y) : x + y = 7}, B = {(x, y) : x = 6 0 y = 6}.
1.6.
21
4. :
) A (B C) = (A B) (A C), ) A (B C) = (A B) (A C).
5. :
) A = A, ) A U = A
) A U = U , ) A = .
6. :
) A Ac = U , ) A Ac = ,
) (Ac )c = A, ) U c = , c = U .
7. De Morgan:
) (A B)c = Ac B c , ) (A B)c = Ac B c .
8. : ) A B A B = A, ) A B A B = A.
1.12
(A B) (A B c ) = A.
(A B) (A B c ) = A (B B c )
(1.5)
B Bc =
(1.6)
(A B) (A B c ) = A .
(1.7)
A=A
(1.8)
( 7).
( 5). , (1.8) (1.7) .
, , U, ,
.
.
.
.
.
1.1
( ) ,
.
1.13
1.12 (A B) (A B c ) = A,
.
1.12.
1.6
F , .
( .)
A : I F , 1-1 .
A(i) Ai F {Ai : i I} {Ai }iI .
22
1.
:
[
F =
A=
AF
Ai = {x : i I x Ai }
iI
F =
A=
AF
Ai = {x : x Ai i I}.
iI
F
T
F .
1.14
I = N = {n : n = 1, 2, 3, . . .} An = [0, n] = {x R : 0 x n}.
[
An = {x R : x 0},
nN
An = [0, 1] .
nN
, F
{A1 , A2 , ..., An }. :
[
F =
n
[
Ai = A1 A2 ... An ,
i=1
F =
n
\
Ai = A1 ... An .
i=1
,
. {Ai }iI B . U
. :
1. :
[
Ai =
iI
(B Ai ).
iI
Ai =
iI
(B Ai ).
iI
2. De Morgan:
!c
[
Ai
iI
B\
1.10
[
iI
Ai =
!c
\
iI
\
iI
Aci ,
Ai =
Ai
iI
(B \ Ai ), B \
\
iI
Aci .
iI
(B \ Ai ).
iI
f : X Y X1 , X2 X Y1 , Y2 Y .
f (X1 \ X2 ) f (X1 ) \ f (X2 ), f 1 (Y1 \ Y2 ) = f 1 (Y1 ) \ f 1 (Y2 ).
.
, y f (X1 ) \ f (X2 ).
x1 X1 f (x1 ) = y x X2 , f (x) 6= y.
1.7.
23
1.11
!
f
Ai
f (Ai ), f 1
iI
iI
Bj =
jJ
f 1 (Bj ).
jJ
!
f
Ai
iI
\
iI
f (Ai ), f 1
Bj =
jJ
f 1 (Bj ).
jJ
) ) .
) , ..
.
, ,
, .
, ,
. .
1.17
() A {Ai }iI . {Ai }iI
A :
1. Ai Aj = i 6= j, i, j I, .
S
2. iI Ai = A.
1.7: =
1.7
S6
i=1 Ai
Venn
1.18
( ) X R X X, R X X.
R X :
1. (x, x) R, x X ( ).
2. (x, y) R (y, x) R ( ).
3. (x, y) R & (y, z) R (x, z) R ( ).
24
1.
1 , R X ,
dom R = range R = X.
O . .
1.15
Q = {(a, b) : a Z & b N}. , (a, b) ab .
a c
R ad = cb.
b d
1.18.
.
1.16
R Z Z, R = {(x, y) Z : x y 3 }. :
xRy x y = 3l
l Z.
().
modulo 3 Z.
1.19
( ) R X x X.
x, R(x),
R(x) = {y X : xRy}.
1.17
1.15
2
2 4 6
R
=
, , ,... .
3
3 6 9
1.18
1.16 (
):
1. R(1) = {k Z : k = 3l + 1 oo l Z}.
2. k R(1) R(k) = R(1).
3. R(0), R(1), R(2) Z.
:
.
. 1.2.
1.2
( ) R X,
{R(x)}xX X.
, {Xi }iI X, R
R .
1.8. . .
25
.
:
xRy x, y Xi oo i I.
1.12
A = {a, b, c, d}.
P1 = {{a}, {b, c, d}},
P2 = {{a, b}, {c, d}},
P3 = {{a}, {b}, {c}, {d}}
A, A.
1.8
. .
1.20
( . .) A, B
1-1 f : A B.
A B 0 #A = #B 0 |A| = |B|.
A B f : A B
1-1 A B .
|A| < |B| 0 #A < #B.
, ,
, :
1. A A,
2. A B B A,
3. A B B C A C.
1.19
A = {1, 2, 3}, B = {a, b, c}, C = {1, 2}.
#A = #B, |C| < |B|.
C B, .
, . ,
. .
1.20
N = {1, 2, 3, . . .} A = {2, 4, 6, . . .}. f : N A,
f (x) = 2x 1-1 .
N A.
26
1.
1.20
, .
, .
,
I1 = {1}, I2 = {1, 2}, . . . , In = {1, 2, 3, ..., n}, . . . .
1.21
( , ) A
. A In
A n #A = n | A |= n.
.
.
1.3
) .
) A ,
| N |=| A | 0 | N |<| A | .
( .)
) A B A | B |<| A |,
| A \ B |=| A | .
, .. Halmos 1960 .
1.22
( )
N. .
.
1.1
1.
|N| < |R| = |I|,
1.8. . .
27
.
1.4
) .
) {Xi }iI
I Xi
S
i I. iI Xi .
1.13
1.4.
( ). , .. () E
( ) A E
E
n
o
i
A. () Xi xj : j N .
( )
Xi , i I.
1.21
N N .
N (
N):
B1 = {1}, B2 = {2, 3}, B3 = {4, 5, 6}, B4 = {7, 8, 9, 10}, . . . .
N N ( N N):
Z1 = {(1, 1)},
Z2 = {(2, 1), (1, 2)},
Z3 = {(3, 1), (2, 2), (1, 3)},
Z4 = {(4, 1), (3, 2), (2, 3), (1, 4)},
...
f , k N
n(n 1)
k=
+ l,
2
l {0, 1, . . . , n 1},
f : k f (k) = (n l + 1, l),
n = 1, 2, ..., 1-1 .
,
X1 X2 Xn ,
X1 , X2 , ..., Xn .
, ( ) Halmos 1960.
Z ,
a
Q = {(a, b) = : a Z, b N} Z Z,
b
Q .
1.4 R \ Q
, , R = Q (R \ Q) .
28
1.
1.9
1.9.1
, , , , ,
n. P (n) . , P (0)
n = 0, P (1) n = 1, ... P (n), n n0 , n0 , , .
P (n0 ), P (n0 + 1), P (n0 + 2), . . . .
, ,
n n0 : P (n),
(1.9)
:
P (n0 )
(1.10)
n n0 : P (n) P (n + 1).
(1.11)
. n , . n n0 ,
n = n0 n
, . n + 1. (1.10) (1.11)
. P (n) .
1.22
, n 1,
1
1 + 2 + + n = n(n + 1).
(1.12)
2
n n = 1,
n = 1. 1 , ,
. .
(1.12) ( n 1) n n + 1,
1
1 + 2 + + n + (n + 1) = (n + 1)(n + 2).
2
(1.13)
1.9.
29
P (x) : x .
P (0) P (x) P (x + 1),
() x,
0 1, .
.
1.14
n 1
1
12 + 22 + + n2 = n(n + 1)(2n + 1).
6
(1.14)
1.23
2n > n3 n 10.
n = 10
210 = 1024 > 103 = 1000,
.
n 10 2n > n3 2n+1 >
(n + 1)3 .
2 2n+1 > 2n3 . , n 10, 2n3 (n + 1)3 .
(21/3 n)3 (n + 1)3 ,
21/3 n n + 1,
1
,
1
n 10 n = 10 ( ).
n
21/3
1.15
: n (n 1) .
n = 1 . .
n n + 1. a1 , a2 , . . . , an , an+1 .
n a1 , . . . , an .
n a2 , . . . , an+1 . . (
1.8.)
;
1.16
Fibonacci Fi , i 1,
F1 = F2 = 1, Fn = Fn1 + Fn2 n > 2.
n 1 F3n .
1.17
Fibonacci 1.16 n 1
2
2
Fn+2
Fn+1
= Fn Fn+3 .
30
1.
1.8: ;
4
5
7
10
11
8
2
1
1.9: 11
1.18
n . ; ( 1.9.)
1.19
n 2 . . A
B A B B A,
.
, , (
).
1.20
x R \ {1}
1 + x + x2 + + xn =
1 xn+1
, n 1.
1x
(1.15)
, |x| < 1,
1.21
k=0
xk = 1 + x + x2 + + xn + =
1
.
1x
(1.16)
1.20,
(1.15);
A (1.15) A xn+1
A .
1.9.
31
1.22
R > 0, n 0
(R(cos x + i sin x))n = Rn (cos nx + i sin nx).
i i2 = 1. i
( cos(a + b), sin(a + b)
a, b).
1.23
n 0 2n 2n
( ). ,
3 ( ) .
, .
1.24
n 1 7 2
1.25
n+2
+ 32n+1 .
f (x1 , x2 , . . . , xn ) n . 0.
f 0, . x1 , x2 , . . . , xn Rn f (x1 , x2 , . . . , xn ) 6= 0.
P (n), n n0 , P (n0 ) (
)
P (n0 ), P (n0 + 1), . . . , P (n 1), P (n) P (n + 1).
, P (n + 1)
, .
1.24
1 1
. n 2 (
).
n = 2. 2 .
n > 2 . .
2 k < n k .
, , n .
n . n
. k, 1 n,
n. 1 < k < n, , , k
n/k ( 1 < n/k < n) .
n .
1.26
n 0
n = nk 2k + nk1 2k1 + + n1 2 + n0
k 1 n0 , n1 , . . . , nk {0, 1}. (
n .)
32
1.
1.27
n 12 4 5.
1.28
an , n 1,
a1 = 1, a2 = 3, an = an1 + an2 (n 3).
an < (7/4)n , n 1.
1.29
an , n 1,
a1 = 1, a2 = 1, an = an1 + an2 (n 3).
n 1 an =
1.9.2
an bn
ab
a = (1 +
5)/2, b = (1
5)/2
-
P (n)
P (n) P (n + 1), , P (n) P (k) k
n + 1, P (n + 1) P (n).
n,
n
.
1.25
- : n 1 a1 , a2 , . . . , an 0
(a1 a2 an )1/n
a1 + a2 + + an
.
n
(1.17)
(1.17) a1 , a2 , . . . , an
.
n = 2
(a1 a2 )1/2
a1 + a2
,
2
, , (a1 a2 )2 0 .
(1.17) n 2n.
a1 , a2 , . . . , a2n 0
1
(a1 + + an ),
n
a = (a1 a2 an )1/n ,
1
(an+1 + + a2n ),
n
A=
B=
1.9.
33
2 n
a1 + + a2n
A+B
=
2n
2
a+b
2
(ab)1/2
(: , : n, : 2).
n 2.
n n 1,
n.
(1.17) n a1 , . . . , an1 0
n1
. an = C := a1 ++a
, (1.17),
n1
C ( ).
. , , P (m, n) m, n 0. .
.
P (0, 0),
P (m, n) P (m + 1, n).
(1.18)
n = 0.
(m 0 k < n P (m, k)) P (0, n),
(1.19)
(m, n).
( ) . P (m, n)
m, n 0 . 1.10
.
P (, ) (0, 0).
(1.18) P (, ) ()
A, (, 0).
(1.18) .
P (, )
P (, )
. (1.19). , ,
P B, . (m, k), m
k < n, P (0, n) ( C) .
C 1.18 P
B.
.
34
1.
C
B
n
(0, 0)
A
m
1.10:
, .
(m n )
. :
m n
m = 0 n = 0 ( ). ,
m n 1,
(m 1, n 1) (m 1, n) (
- (m, n) 1.10). m, n 0
, .
1.30.
1.30
a(n, k) n, k 0, .
a(n, 0) = 1, (n 0),
a(n, k) = 0, (n < k),
n(n 1)(n 2) (n k + 1)
.
1 2 3k
, ,
P Q, .
n Q(n) P (n).
(1.11) P . .
1.9.
35
( P Q) ,
.
.
1.26
1 + 3 + 5 + + 2n 1 ( n )
n 1.
Sn = 1 + 3 + + 2n 1, Sn+1 = Sn + 2n + 1. n = 1
S1 = 1 = 12 .
Sn = t2 t.
Sn+1 = Sn + 2n + 1 = t2 + 2n + 1.
t2 + 2n + 1
.
P (n) : Sn ,
Q(n) : Sn = n2 ,
P (n), ,
t = n t2 + 2n + 1 (n + 1)2 ,
.
1.31
( Bernoulli) n n 0
x 1
(1 + x)n 1 + nx.
(1.20)
(1 + x)n nx.
1.9.3
: (Hall)
X , , A1 , . . . , An X X.
X ,
X ( Ai ).
1.23
( ) x1 A1 , . . . , xn An
() A1 , . . . , An x1 , . . . , xn .
F = {A1 , . . . , An }.
: n 1 , . . . , n Ai i .
( 1.11.) , , .
A1 , . . . , An ( )
.
36
1.
1.11: Ai A(J)
1.24
J [n] := {1, 2, . . . , n}
A(J) = AF (J) =
Aj .
jJ
F .
F {x1 , . . . , xn }
J [n] : |A(J)| |J|.
(1.21)
A(J) xj , j J, .
(1.21) Hall
F.
1.5
( )
F Hall (1.21).
n. n = 1 . n 1.
F = {A1 , . . . , An } X (1.21).
J [n], J =
6 , [n], |A(J)| = |J|.
1: J.
(1.21) A1 , x1 .
X \ {x1 }
F 0 = A02 , . . . , A0n ,
1.10.
37
/ A(J),
. Hall
F 0 = A0k+1 , . . . , A0n X \ A(J),
A0j = Aj \ A(J), j = k + 1, . . . , n.
I {k + 1, . . . , n}. |AF 0 (I)| |I|.
Hall F
|AF (I J)| |I J| = |I| + |J|.
AF (I J) = AF 0 (I) AF (J),
.
|AF 0 (I)| = |AF (I J)| |AF (J)|
= |AF (I J)| |J|
|I J| |J|
= |I| + |J| |J|
= |I|,
. F 0
{x1 , . . . , xk } A1 , . . . , Ak , F.
1.10
1.25
() (
38
1.
), . ( ):
p, q, r, p1 , . . .
1.27
,
p : ,
q :
, p q .
.
:
() ().
1.28
:
;
, .
p, . :
v(p) = 0 1 0 T
v(p) = 0 0 0 F
. ( ) p =
v(p) = .
.
, .
1.29
,
p : ,
q : ,
r : .
1. p q ,
p q : ,
p q, p q ( p q)
.
2. q,
q : ,
q, q ( q) q
.
1.10.
39
3. p, r
p r : ,
p, r, p r ( p r)
p r.
4. , , p q.
( p) ( q)
p q.
p q : .
.
, . .. p q
p : p
q. , . , 1.29.
,
.
p, q
, p, q p q ( p q ).
p q p, q (
):
p q pq
p, q
p q p q ( p q). :
p q pq
p p p
p p . :
p p
40
1.
p q, p, q , p q. p p
. :
p q pq
,
.
.
. , .
.
1.30
:
p : ,
q : 2 + 2 = 4.
p q, ( p) q, q p, p q;
1. v(p q) = q ( .
2. v[( p) q] = p, q .
3. v(q p) = q p .
4. v(p q) = ( ).
1.31
, , p q . :
p q.
p q, :
p q = (p q) (q p)
p q.
p q p q q p p q
1.32
p, q p Y q, :
p q pYq
1.10.
41
, ,
, .
1.32
p : , q : .
:
1.33
p, p q, p q, p q, p q, p (p q).
P, Q, . . ., p, q, . . ..
.
P :
Q :
R :
S :
.
p :
q :
r :
s :
1.26
( ) .
1.33
p, q ( , )
pq
(1.22)
.
p
q, . .
p, q ,
(1.22).
, . , .., (1.22) C(p, q)
C(p, q) = p q.
C(p, q) p, q. ..
42
1.
p = ,
q = ,
C(p, q) = .
1.34
:
f (p, q) = p (p q),
g(p, q) = (p q) q,
h(p, q) = f (p, q) g(p, q)
p = q = . f (p, q) = , g(p, q) =
h(p, q) = ( ).
( )
, . f (p, q)
1.34 :
p q p p q p (p q)
1.27
(. .) P (p, q, . . .) , P (p, q, . . .)
p, q, . . .. P (p, q, . . .)
p, q, . . . (: P (p, q, . . .) P (p, q, . . .) ).
1.28
( ) P (p, q, . . .), Q(p, q, . . .)
P (p, q, . . .) Q(p, q, . . .),
P (p, q, . . .) Q(p, q, . . .)
, .
1.35
( De Morgan) .
1. (p q) p q.
2. (p q) p q.
, .
(p q) p q:
p q p q p q (p q) p q
(p q), p q . (p q)
( p q) . .
1.11.
43
1.34
,
;
1. p p
2. p p
3. p p q
4. p q
5. p p
6. (p q) (q p)
7. (p (p q)) q
8. ((p q) (q r)) (p r)
9. (p q) (p q)
10. (p q) (q p)
1.35
python.
python and, or, not
True False. ( )
(), () Y ( (xor)).
def implies(p, q):
return q or not p
def equivalent(p, q):
return implies(p, q) and implies(q, p)
def xor(p, q):
return (p and not q) or (q and not p)
a = True
b = False
print
print
print
print
"a
"b
"a
"a
1.11
1.36
8 9
1.37
1 k 1.
n 0 0 k n
dk n
n!
x =
xnk .
k
(n k)!
dx
44
1.
1.38
n 1
1.39
13 + 23 + + n3 = (1 + 2 + + n)2 .
(1.23)
X
{a1 ,...,ak }[n]
1
= n + 1,
a1 a2 ak
{a1 , . . . , ak }
[n] = {1, 2, . . . , n}.
: {a1 , . . . , ak }
[n] 1. 1,
, 0,
.
1.12:
1.40
n . ( 1.12.) . (
) .
: (
) .
1.41
m n
. ( )
.
.
. m n ,
. , k n
1.11.
45
(m k) n, . ,
, m k m (n k). (
1.13.)
.
; m n. (.. )
(mn).
1.42
n . n
( ) .
.
.
n , ( ).
1.43
(
) . ,
, .
:
, , .
(..
,
, ).
.
.
.
;
46
1.
1.44
Aj X, j = 1, 2, . . . , N, k ,
k + 1 Aj .
Aj .
. A1 = {x1 , x2 , . . . , xk }
A2 , . . . , AN x1 , x2 , .
1.14: 1.45
1.45
F X. E X
k, F E
F E
( F F ), 2k . . E F E.
F N = |F| N
X.
1.46
;
1. (p q) ( p q)
2. p q
3. (p q) (q p)
4. (p q)
5. (q p) p
6. p q
7. p q
8. q p
1.12. VIDEO
47
9. p p
10. q q
1.47
88 ( . 62 ). ( .
) ;
1.12
Video
1.1
. (video , 5:27 ).
48
1.
[1]
Paul Richard Halmos. Naive set theory. Springer Science & Business Media, 1960.
[2]
[3]
Chung Laung Liu and CL Liu. Elements of discrete mathematics. McGraw-Hill New York, 1985.
49
50
Hardy and Wright 1979 Graham,
Knuth, and Patashnik 1994.
2.1
2.1
a, b Z, b > 0,
q Z,
( ),
r {0, 1, . . . , b 1},
( ),
a = b q + r.
2.1
(, ) 0 a = bq b
a. b | a. b (
).
a1 , a2 r b
b modb.
a1 a2 (b)
a1 = a2 mod b.
modb b .
2.1
5/3 -5/3.
python /
% . python.
[ 2.1:] Z ()
{kb, kb + 1, kb + 2, . . . , kb + (b 1)},
51
52
2.
. b . a
,
[qb, (q + 1)b) Z.
r {0, 1, . . . , b 1}
a = qb + r.
a
a = q0 b + r0 ,
q 0 Z, r {0, 1, . . . , b 1}.
r r0 = (q 0 q)b,
. r r0 b.
0 r < b, 0 r0 < b,
b < r r0 < b,
b 0. r = r0 q = q 0 ,
, .
2.2
:
1. a | a
2. a | b, b | a = a = b
3. a | b, b | c = a | c
4. a | b, a | c = a | kb + lc, k, l Z
5. a = b mod c, a0 = b0 mod c = a a0 = b b0 mod c
6. a = b mod c, a0 = b0 mod c = a a0 = b b0 mod c
2.3
a | b k 1 ak | bk .
2.2
( , ) bxc
x, . k k x. {x}
x, . {x} = x bxc.
2.4
n n = 2bn/2c.
2.5
1000 3 5.
2.6
3 | n3 n.
n3 n . 2.2: r
n 3 n3 n = r3 r mod 3 r.
2.2. , , 53
2.7
8n + 1.
2.8
6n + 5 6n + 1.
2.9
5 | n5 n.
2.2 n 5.
2.10
9 | n3 + (n + 1)3 + (n + 2)3 .
2.2. 9
python.
for r in range(9):
k = r**3+(r+1)**3+(r+2)**3
print k%9
2.6.
2.11
Fibonacci :
f1 = f2 = 1, fn = fn1 + fn2 n 3.
:
() 2 | fn 3 | n.
() 3 | fn 4 | n.
() 4 | fn 6 | n.
2.12
(2 + 3)n .
(a + b)N =
(2 +
3)n + (2
j=0
N
j
aj bN j
3)n
. 1 < (2
2.2
PN
3)n < 0.
, ,
2.3
( ) a, b
a, b d a b. (a, b).
2.4
( ) a, b a, b n a b n. [a, b].
.
54
2.
2.1
S = {xa + yb : x, y Z} a, b.
S (a, b). d S. d = ka + lb
d S. ,
S . d.
u = xa + yb, x, y Z u/d:
u = qd + r, 0 r < d.
r = uqd S ( S ).
r > 0 d S. r = 0
u = qd .
a, b S d a, b , , (a, b) | d,
d a, b, d (a, b). , , (a, b) | d,
d = (a, b) (a, b) S a, b.
2.13
k
.
k 2.2.
2.1
a, b d | a, d | b d | (a, b).
O d a, b (a, b) 2.2.
2.5
( mod ) x, y
modb xy = 1 mod b. y = x y = x1 b .
2.3
a, b 1 . x ax = 1 mod b
(a, b) = 1. ( . a mod b.)
2.2. , ,
55
d = (a, b) > 1 x Z d - ax 1, b
ax 1.
, (a, b) = 1 2.2 x, y
1 = ax + by ax = 1 mod b.
2.14
x, y modb a x = y mod b.
;
2.1
a b
1. b | a (a, b) = b.
2. b - a (a, b) = (b, r) r > 0 a/b.
.
a = qb + r a/b r = a qb (a, b) | r , (a, b) | b
(a, b) | (b, r). (b, r) | a (b, r) | (a, b),
(a, b) = (b, r),
.
a, b. .
, a, . 0 (.
b | a) b. (b, a mod b)
a mod b 0.
python:
def gcd(a, b): # find the gcd of a, b, where a >= b
print a, b
r = a % b # if a < b then this will reverse them at the next call
if r == 0:
return b
else:
return gcd(b, r)
print
. ..
7735, 3003
7735 3003
3003 1729
1729 1274
1274 455
455 364
364 91
91
(91).
56
2.
2.3
2.6
( ) n > 1 ,
.
a | n, a > 1 = a = n.
n > 1 .
2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47, 53, 59, 61, 67, 71, 73, 79, . . . .
4, 6, 8, 9, 10, 12, 14, 15, 16, 18, 20, 21, 22, 24, 25, 26, 27, 28, 30, 32, 33, 34, . . . .
2.15
101, 103, 107, 111, 113, 121 .
2.16
n > 1 ( 1 n .)
d <= n.
k. k >
n/k.
2.17
2.16 n
2 b nc.
python.
def isprime(n):
if n<=1:
return False
d = 2
while d*d <= n: # Check only up to the square root of n
if n%d == 0:
return False
d = d+1
return True
.
49
print [x for x in range(2,50) if isprime(x)]
[2, 3, 5, 7, 11, 13, 17, 19, 23, 29, 31, 37, 41, 43, 47]
d*d (
, ).
def isprime(n):
if n<=1:
return False
d = 2
2.3.
57
d2 = 4
while d2 <= n: # Check only up to the square root of n
if n%d == 0:
return False
d2 = d2 + d + d +1
d = d+1
return True
2.18
n p n > n1/3 .
n ( ).
2.4
.
, p1 , p2 , . . . , pn ,
k = p1 p2 pn + 1.
k , s,
s k. s ,
, k
s, s k.
s p1 , p2 , . . . , pn , s = pt . k = 1 mod pt ,
.
2.19
[a, b] N .
10! + 2, 10! + 3, 10! + 4, . . . , 10! + 10;
2.20
5 . 106
.
2 3 4 5 6 7 8 9 10 + 2 8 .
2.21
p1 = 2, p2 = 3, p3 = 5, p4 , . . . .
( , 2.4)
n1
p n 22
.
2.5
p p | ab p | a p | b.
58
2.
ab = kp, k Z, p - a. p (p, a) = 1, ,
2.2, 1 = xa + yp x, y Z. b
b = xab + ypb = xkp + ybp = p(ak + yb)
p | b .
2.1
p | a1 a2 ak p aj ( k).
2.6
( ) n > 1
n = pe11 pe22 perr
p1 < p2 < < pr r, e1 , e2 , . . . , er .
2.2
( )
. . a
n n = a na a na
( ).
[ 2.6] ( )
n > 1 . , .
. ( )
n.
.
n = 2 ( n).
n n.
n = p1 p2 pr = q1 q2 qs ,
p1 , p2 , . . . , q1 , q2 , . . . , . , 2.5 , q1 q1 , q2 , . . .. p1 n0 = n/p1
. .
2.2
a, b 1 a | b a
b a.
p a e 1:
a = pe
2.3.
59
( ). a | b b = ka, k Z,
b = ka = kpe
p b e.
a = pe11 pe22 pekk
e0 e0
e0
e0
k+1
b = p11 p22 pkk pk+1
perr
e0j ej , j = 1, 2, . . . , k, b a.
2.22
a, b 1 .
(a, b) a
b a, b.
[a, b]
a b a, b.
.
2.2.
2.23
a, b 1
(a, b)[a, b] = a b.
2.24
2.25
2.26
2.27
xn + cn1 xn1 + cn2 xn2 + + c1 x + c0 ,
c0 , c1 , . . . , cn1 Z,
.
2, 3 5, 10 17 .
=
2.28
k
l
(k, l) = 1 l > 1. p l.
4849845 .
2.29
10!.
2.30
30
10
3 ( 1
). 4 . 5 .
60
2.
2.31
( p2 p).
2.32
p n!
bn/pc + n/p2 + n/p3 + .
j n/pj < 1.
20! .
1000!;
8- ;
2.33
a, b (a, b) = 18
[a, b] = 240;
2.34
2.35
2.36
2+
3
/ Q.
log2 3
/ Q.
2.37
1+
1 1 1
1
+ + + +
2 3 4
n
n 2.
2.38
2.39
a, b [a, b] = n.
n .
2.40
6k + 5.
6k+1 6k+5.
6k + 5, p1 , p2 , . . . , pr , n = 6p1 p2 pr 1.
2.41
n + 1 1 2n
.
[1]
Ronald L Graham, Donald E Knuth, and Oren Patashnik. Concrete Mathematics. 1994.
[2]
Godfrey Harold Hardy and Edward Maitland Wright. An introduction to the theory of numbers.
Oxford University Press, 1979.
61
62
C. L. Liu and C. Liu 1985, Graham,
Knuth, and Patashnik 1994, Cameron 1994 Stanley 1986.
3.1
3.1, . ;
3.1: ;
, . (
. .)
;
4:
1. ,
2. ,
3. ,
4. ,
4 = 2 2
63
64
3.
3.1
, , , , ;
3.2
,
, ;
:
, k ,
, .
.
k .
( |X| X):
3.1
k E k-
(x1 , . . . , xk )
x1 E1 , x2 E2 , . . . , xk Ek , Ej .
|E| = |E1 | |E2 | |Ek |.
k. k = 1 , E = E1 .
k = n k = n + 1.
(x1 , . . . , xn , xn+1 )
(3.1)
(3.2)
G2 e2 , ...
, , .. G1 1-1 G2
G1 G2
(x1 , . . . , xn , e1 ) (x1 , . . . , xn , e2 ).
(3.1)
|G1 | r = |G1 | |En+1 |.
(3.3)
3.1.
65
, , G1
(x1 , . . . , xn ), xj Ej ,
, , |E1 | |En |. (3.3)
.
3.3
python (x, y) x A, y B,
. A B.
A = ['Sweet', 'Medium', 'No Sugar']
B = ['With milk', 'No milk']
for x in A:
for y in B:
print "Sugar: ", x, " Milk: ", y
. ;
, , :
C = ['Large', 'Medium', 'Small']
3.4
.
2 3 . 9 .
;
3.5
2,3,5;
, ;
3.6
- ( 14, 1,2 );
3.7
;
( .
14 .)
( 0)
;
: 3
, 0.
3.8
, ; ;
.
N
1/N ( . 1/N ). N :
; . (x, y),
x, y {1, 2, 3, 4, 5, 6};
x y .
.
66
3.1.1
3.
.
3.2
A n , P(A) A, .
A.
|P(A)| = 2n .
n, .
A = {a1 , . . . , an } 1-1
n-
(x1 , . . . , xn ) x1 , . . . , xn {0, 1}.
(3.4)
, 1-1 B A n-
(x1 , . . . , xn ) xj = 1 j B ( 1-1
).
P(A) = {B : B A}
n- (3.4). .
n- (3.4) :
n- n , xj ,
. , 2| 2{z 2} = 2n .
n
3.9
( n) 3.2.
3.10
python . ( ).
def subsets(s):
n = len(s)
# empty set contains only the empty set
if n==0:
return [[]]
# s1 is set s without its first element
s1 = s[1:]
f = s[0] # f is the first element of set s
# all subsets of s not containing its first element, f
p1 = subsets(s1)
# p2 will contain all subsets of s containing f
p2 = []
for x in p1:
p2.append([f]+x)
return p2+p1
subsets. (
(recursive), . .) :
3.1.
67
output
[['a', 'b', 'c', 'd'], ['a', 'b', 'c'], ['a', 'b', 'd'],
['a', 'b'], ['a', 'c', 'd'], ['a', 'c'], ['a', 'd'], ['a'],
['b', 'c', 'd'], ['b', 'c'], ['b', 'd'],
['b'], ['c', 'd'], ['c'], ['d'], []]
3.1
A B
[n] = {1, 2, . . . , n};
.
,
.
, , .
,
,
(
, ) .
. i = 1 i = n
i A, B .
A B . ( 3.2.)
3.2: 1, 2, . . . , n
n ,
, . A, B [n]. ,
. n
, , ,
i, . i A, i B i
/ A B. ,
3| {z
3} = 3n .
3.11
A B [n] A B;
68
3.
3.3: 3.11
3.12
3.1 A B
;
3.1 .
3.1.2
A B
A B A
B. |A| = m |B| = n ;
nm :
3.3
A B , B A
A B,
A
B = |B||A| .
A B ( . B A ) A B.
(.., 1-1
).
|B| |B| = |B||A| .
| {z }
|A|
3.13
3.14
m n 0, 1 3;
3.15
3.2. -
69
3.16
A = {n, n + 1, . . . , n 1, n} A A ,
. f (x) = f (x) x A;
3.17
, 106 , 2 ;
;
3.18
n = p11 pkk ;
(3.5)
n pj . (
1 1. ..
2, 3, 5, 7, 11, 13, 6 , . .) ( 2.6)
n (3.5),
.
100 -
.
3.2
3.1
, , .
, .
.
. ( ) ,
. .
, . - (
).
3.2
, 3.1,
(2 ) .
2 2 (, )
70
3.
, 1
2 0 1 .
. ,
, . .
3.1
-
.
3.2
, -. ( )
: . 1
, 2 1 : .
1 + 2 + 1 = 4 .
,
.
, .
3.3
10- () .
;
10 9 = 90 .
. 10 . , x, x, . 9 .
, . .
-.
3.19
5 7 .
5 7; ( ).
3.20
3.21
3.19
.
.
3.2.1
, , r n;
3.4
r- (r n)
(x1 , . . . , xr ),
xj [n] ,
n(n 1)(n 2) (n r + 1).
(3.6)
3.2. -
71
x1 . n . x1
x2 . x2 ,
. n1. x1 , x2 x3 n2, .
-. .
. ,
xr n r + 1 = n (r 1)
r 1 n.
3.1
n
n! = 1 2 3 n.
.
n- . 3.4 r = n.
3.22
python ( , ,
).
def permutations(s):
"""
Returns a list of all perumatations of the set (list) s.
Each element of this list is a permutation of s (again, a list).
The list s is assumed to be nonempty.
"""
n = len(s)
if n==1:
return [s] # One permutation only
else:
result = [] # we will return this variable
for x in s: # list all permutations of s with first element x
ss = s[:] # make a copy of s
ss.remove(x) # now ss is the original list with x removed
for l in permutations(ss):
result.append([x] + l) # we add each of them to result
return result
..
print permutations(['a', 'b', 'c', 'd'])
output
[['a', 'b', 'c', 'd'], ['a', 'b', 'd', 'c'],
['a', 'c', 'b', 'd'], ['a', 'c', 'd', 'b'],
['a', 'd', 'b', 'c'], ['a', 'd', 'c', 'b'],
['b', 'a', 'c', 'd'], ['b', 'a', 'd', 'c'],
['b', 'c', 'a', 'd'], ['b', 'c', 'd', 'a'],
72
3.
['b',
['c',
['c',
['c',
['d',
['d',
['d',
'd',
'a',
'b',
'd',
'a',
'b',
'c',
'a',
'b',
'a',
'a',
'b',
'a',
'a',
'c'],
'd'],
'd'],
'b'],
'c'],
'c'],
'b'],
['b',
['c',
['c',
['c',
['d',
['d',
['d',
'd',
'a',
'b',
'd',
'a',
'b',
'c',
'c',
'd',
'd',
'b',
'c',
'c',
'b',
'a'],
'b'],
'a'],
'a'],
'b'],
'a'],
'a']]
(recursive). .
3.23
python n,
. n n < 0
( ). 0! = 1.
:
def factorial(n):
# n should be >= 0
if n<0:
.............
else:
t=1
.............
return t
..
print factorial(5)
3.24
{A, B, C}.
3.22.
3.25
1,2,3,4,5; 1,1,3,4,5;
1,
1, 3, 4, 5.
1, 1, 3, 4, 5;
1, 1, 1, 2, 2, 3, 4, 5;
3.26
3.27
Morse ( ) ,
. 7 , 3 2 .
;
3.28
3.2. -
73
A, B, C, D, , Z, 0, 1, , 9
(36 ) username
. ( .) N
100
;
3.29
3.2.2
n!
2n
, n .
[n] (, , n )
k;
3.5
0 k n [n] ( n )
n
n(n 1) (n k + 1)
:=
k!
k
k ( 0 1,
0! = 1).
nk : n k.
3.2
n, k , 0 k n,
n(n 1) (n k + 1)
k!
.
k-
[n]. k- k-
,
. , . k-
, 3.4, . n(n 1) (n k + 1).
k-, . k- [n],
k! k-,
k- ( 3.1). , n(n1) (nk +1) k-
[n] k! . k-
[n] k!.
3.2
k-
n(n1) (nk+1),
.
3.30
python
52 :
n
k
74
3.
def binomial(n,k):
if k<0:
print "Error"
return -1
else:
t=1.0
for i in range(k):
t = t*(n-i)/(k-i)
return t
print binomial(5,2)
.
n
k .
x
x(x 1)(x 2) (x k + 1)
, x R.
(3.7)
=
k!
k
x = n nk
. x
x ( )
x.
3.31
f (x) =
k 0
x
k
(3.7) , .
x Z = f (x) Z.
. n
k , n
, Nk , N .
3.32
s = ['a', 'b', 'c', 'd']
print subsets2(s)
[['a', 'b'], ['a', 'c'], ['a', 'd'], ['b', 'c'], ['b', 'd'], ['c', 'd']]
3.2. -
75
3.4
( )
()
;
. ,
.
:
xa, ya, zb, wb
(3.8)
a, b {0, . . . , 9}, x, y, z, w {1, . . . , 9}, a > b, x > y, z > w.
(3.9)
(3.8). .
,
.
.
(a, b, x, y, z, w)
(3.9).
a, b, x, y z, w. ,
(3.9), .
a, b {0, . . . , 9} a > b
{0, . . . , 9}
a b .9
10
. 2 , , x, y 2
z, w.
2
10 9
.
2
2
3.5
(); .
.
.
13 .
13
.
3
,
. 3 13 = 39 , 39
3 .
( )
13
39
.
3
3
3.6
3.5
(
: )
,
76
3.
.
,
.
, 3.5.
.
(
).
. 13
.
3
49,
. 49
.
3
- ( )
13
49
.
3
3
!
. , 1 , 2 , 3
4 , 1 2 . 1 , 2 , 4
3 , 1 2 . .
13
49
3 3 ( )
.
; : 3, 4, 5
6 . ,
3.5, .
13 39
13 39
13
13
+
+
39 +
3
3
4
2
5
6
. (
.)
3.7
( . a0 + a1 x + a2 x2 + + an xn ) (1 + x)10
x4 ;
, (a + b)2 =
(a + b)(a + b) 10 .
, . ab ,
ab .
ab ba.
ab , a
b . . ba
b a . ab
1+1 = 2. a2 b2 . a2 , ..,
a , b2 .
(a + b)2 = a2 + 2ab + b2 .
a2 b (a + b)3
b a (a + b)
3.3.
77
.
b. a.
x4
(1 + x)10 . , , 1 x
10 . x4
4 , x.
10
.
4
3.33
10 ,
; 5 , 3 ;
, ,
, , .
3.34
, 52 (
4 13 ), 2 ( ) 3 ;
.
3.35
n k {0, 1, . . . , n}
3.36
n
k
; n ;
n
X
n
k=0
n
n
n
n
+
+ +
+
= 2n ,
0
1
n1
n
n 0.
3.37
n
n
=
k
nk
n 0 0 k n.
3.38
r, s, k r s s!
(k + 1)(k + 2) (k + r).
3.3
3.39
3.40
8 8 ;
() .
.
3.5.
78
3.
3.5: 8 8
3.41
1, 2, . . . , 9 1 2 ;
3.42
1, 2, . . . , 9 1 2 2
3;
3.43
1, 2, 3, . . . , 2n1, 2n
;
;
3.44
{1, 2, . . . , 2n} k ;
3.45
12 10 .
5 5 ;
, .
3.46
,
, n ;
3.47
{1, 2, 3, . . . , 2n} n ()
() ;
3.48
3.19
.
5 7 .
3.49
n n n ;
3.50
2m ; 2m 3n ;
3.3.
79
3.51
[n] ; [n]
( ),
.
, n = 4, (1243) (3124) . ( 3.6.)
2
4
4
1
2
1
3.6: 1,2,3,4
90 ,
3.52
n
n
n
n
n
n
n
n
n
+
+
+ +
=
+
+
+ +
.
0
2
4
n1
1
3
5
n
[n].
[n] (
) 1-1 .
3.53
6 (
) ( ) ( ),
().
:
3.54
1, 1, 2, 1, 2, 3
10 ,
( 24 );
. n n
.
3.55
100
.
.
N 100
N . (
, N .)
.
80
3.
N
, ;
3.56
n (n > 2) , , ,
, (
).
A B
( ).
A 6= B.
3.57
7 .
.
.
.. ;
. ;
.
. 4 4
7. 3 .
;
.
.
:
1. 4
.
2. 3 .
; ;
3.4
Video
3.1
(video , 6:12 ).
3.2
. . (video , 16:29
).
3.3
. . . (video
, 11:00 ).
3.4
n k. . (video , 15:51
).
3.5
: ; (video , 14:07 ).
[1]
[2]
Ronald L Graham, Donald E Knuth, and Oren Patashnik. Concrete Mathematics. 1994.
[3]
Chung Laung Liu and CL Liu. Elements of discrete mathematics. McGraw-Hill New York, 1985.
[4]
81
82
C. L. Liu and C. Liu 1985, Graham,
Knuth, and Patashnik 1994, Cameron 1994 Stanley 1986.
4.1
P (n, r)
n r x1 , . . . , xr :
n = x1 + + xr .
, n = 3 r = 2
3=3+0=2+1=1+2=0+3
(4.1)
P (3, 2) = 4. x1 , . . . , xr . P (n, r)
n r . r
n 0.
4.1
n 0 r 0
n+r1
n+r1
P (n, r) =
=
.
n
r1
(4.2)
n n n, .
n = x1 + +xr , r1
( 4.1).
x2 = 0
x1 = 3
x8 = x9 = x10 = 0
x3 = 2
x4 = 1
x5 = 2
x6 = 1
x7 = 2
4.1: n = 11 r = 10 9
83
84
4.
x1 ,
x2 , . xr
( r 1) +.
, P (n, r) 4.1 ,
, .
; : n + r 1
n
r 1 . n+r1
.
n
a
a
4.1 b = ab
( 3.37).
4.1 P (3, 2) = 3+21
= 43 = 4
3
(4.1).
4.1
4 3 .
n r ,
:
k n
n ,
;
.
n . . k :
.
.
k , .
;
n k .
nk .
4.1
{A, B} 3
AAA, AAB, ABB, BBB.
, ABB BAB
.
4.2
4.3
n
1
= n. , n 2,
n
2
=n+
n
2
X
DnE
3
n
=
+ X.
3
. 4.2
.
n4 n4 .
4.1.
85
k k , ,
{1, . . . , n}. xi , i = 1, . . . , n, i. ,
,
x1 + + xn = k
(4.3)
n- x1 , . . . , xn (4.3). .
4.2
k n
k n .
DnE
k
=
n+k1
.
k
4.4
k n (..,
3 , ,
), ;
4.5
n n
;
.
4.6
8 .
( 0) 6.
8
1. 8 .
2. 5 3 . .
3.
6 ( ) , ,
( . 6,
).
4.7
x1 , x2 , . . . , xk .. 1 x1 < x2 <
< xk n;
4.8
, k ,
n
k
k
DnE
n , k ,
n . .
86
4.
4.2
( DNA Gamow) DNA .
A, C, G T. DNA
20 .
, 1 2.
4 1 ( A, C, G T) 42 = 16 2 (
4 ). DNA
3 43 = 64, . 20.
1954 G. Gamow DNA
. . ACC CAC, , . Gamow
DNA 3;
A, C, G
T , . .
4
4+31
6
654
=
=
=
= 20,
3
3
3
3!
. Gamow 20
. , , Gamow .
4.9
n k
1 k;
.
4.3
( Bose-Einstein )
t p , .. p .
.
t .
Bose-Einstein.
Bose-Einstein ;
xi , i = 1, . . . , p, i, xi t.
t p , .
t+p1
.
t
4.10
Fermi-Dirac t
( p ). t p
; ( 4.3 4.9.)
4.2
k n, ,
n
n(n 1) (n k + 1)
n!
=
=
.
k
k!
k!(n k)!
4.2.
87
, , {1, . . . , n} k1 , k2 , , kr , j = 1, . . . , r
0 kj n k1 + + kr = n; .
{1, . . . , n} k1 , k2
kr ;
4.3
n r k1 , . . . , kr , k1 +
+ kr = n, ,
n
n!
=
.
(4.4)
k1 , . . . , kr
k1 !k2 ! kr !
n
n!
=
k1 !(n k1 )!
k1
. n k1 ,
n k1
(n k1 )!
=
k2
k2 !(n k1 k2 )!
. (
kr1 )
(n k1 kr2 )!
(n k1 kr2 )!
=
kr1 !(n k1 kr1 )!
kr1 !kr !
. , r 1
kr
.
r 1 ,
(4.4).
n
n
k1 ,...,k
k r
).
n
n
n
=
=
.
k, n k
k
nk
4.1
n
k1 ,...,k
k1 , . . . , kr
r
( . ).
4.2
,
, .
k1 , k2 , . . . , km
. . ,
9
3, 3, 3
88
4.
1, 2, . . . , 9 .
.
{1, 2, 3}, {4, 5, 6}, {7, 8, 9} {3, 2, 1}, {4, 5, 6}, {7, 8, 9}
.
. , ..,
{1, 2, 3}, {4, 5, 6}, {7, 8, 9} {4, 5, 6}, {1, 2, 3}, {7, 8, 9}
.
4.11
10 5, 3 2 .
; (
.)
4.12
12 4 ( )
3 ;
4.13
5 , 3 4 ;
.
4.3
( 4.4 .
.
.
4.4
a, b R, n 0
(a + b)n =
n
X
n
k=0
ak bnk .
(4.5)
n (a + b). , . ,
(
3.7) , .
, a b n,
ak bnk , (0 k n).
a k .
k
n
n, . k , .
4.3.
89
4.14
(1 + x)5 x;
( 4.4) .
4.4
a = b = 1 (4.5) ( 3.36)
n
X
n
n
2 =
.
k
k=0
4.5
a = 1, b = 1 (4.5)
n nk k k
X n
X n
.
(4.6)
=
k
k
0kn
0kn
k o
k o
n , k
n
k ( nk = nk
3.37), k.
4.6
a = x, b = 1 (4.5) x.
n
X
n k1
n1
n(1 + x)
=
k
x .
k
k=1
x = 1
n
X
n
k
= n2n1 .
k
4.15
P
4.16
P
4.17
k=1
n
k n
k=0 2 k .
n
k=2 k(k
1)
n
k
a(x) = aN xN + aN +1 xN +1 + + a0 + a1 x + aN xN
b(x) = bN xN + bN +1 xN +1 + + b0 + b1 x + bN xN
aj bj . ( 0) Laurent .
aj a(x), .
.
c(x) = a(x)b(x) c(x) Laurent
min {N,N s}
cs =
X
max {N,sN }
2N s 2N .
ak bsk ,
90
4.
4.18
a = x, b = 1/x 2n n (4.5)
X
n 2
2n
n
=
,
n
k
k=0
4.17.
4.19
x3 y 5 (1 + x + y)12 ; . ( 4.2.)
4.7
n
X
1
n
.
k+1 k
k=0
. 4.6 x
n
X
n k
x
(1 + x) =
k
n
k=0
k nk ,
1/(k + 1) .
n
X
1
n k
f (x) =
x .
k+1 k
k=0
f (1) f (x)
x = 1. x
x
n
X
n k
0
(xf (x)) =
x = (1 + x)n
k
k=0
, , C
xf (x) =
(1 + x)n dx + C
xf (x) =
(1 + x)n+1
+ C.
n+1
x = 0 C = 1/(n + 1)
xf (x) =
x = 1 f (1) =
2n 1
n+1
(1 + x)n+1 1
n+1
4.4.
4.4
91
, ( ).
, .
4.8
( Pascal)
n
n1
n1
=
+
.
k
k1
k
(4.7)
n1
[n 1], k, k .
4.9
.
P1 , . . . , Pn . (Pi , Pj ) Pi
Pj , xi Pi y
P . (Pi , Pj ) , , ni=1 xi , ,
, 2y, (Pi , Pj ) (Pj , Pi ).
n
X
2y =
xi
i=1
xi .
4.10
n1 , n2 0
m
X
n1
n2
n1 + n2
=
, (m min {n1 , n2 }).
k
mk
m
k=0
m [n1 +n2 ]. n1
. m m + 1 Ck ,
k = 0, . . . , m. Ck
m-
[n1 + n2 ]
n1
n2
k . |Ck | = k mk Ck
P k n k .
m
k=0 |Ck |.
4.11
n 2 :
2n
n
=2
+ n2 .
2
2
[2n]. n 2n
. [2n] : () ,
() , () . () n2
n . (). ()
n n, n n .
.
92
4.
4.12
n1
n2
n
X
n
=
k
k
(4.8)
k=1
( 4.6) (x, M )
x M [n].
nk M [n] k, x
k , (x, M ) x M [n]
(4.8).
x
M , . M \ {x}. [n] x
M \ {x}, 2n1 ,
n2n1 , .
4.20
0 i k n
n ni
k
n
=
.
i
ki
i
k
4.21
X
n
n
i1
=
.
k
k1
i=k
[n] k .. i;
4.22
n, m, k1 , . . . , km .. k1 + +km = n
X
m
n
n1
=
.
k1 , k 2 , . . . , k m
k1 , . . . , ki1 , (ki 1), ki+1 , . . . , km
4.23
i=1
0
1
n
n+1
+
+ +
=
m
m
m
m+1
0 m n. ( ab a < b 0.)
4.5
4.24
21 , ,
;
4.25
20 , , 6, 5 4
. ( .)
;
4.6. VIDEO
93
4.26
n
X
k=1
4.27
n
k
.
k
2
, n 1
2n + 2
2n
2n
2n
=
+2
+
.
n+1
n+1
n
n1
4.6
Video
4.1
k n . (video , 14:35 ).
4.2
. (video , 19:09 ).
(4.9)
94
4.
[1]
[2]
Ronald L Graham, Donald E Knuth, and Oren Patashnik. Concrete Mathematics. 1994.
[3]
Chung Laung Liu and CL Liu. Elements of discrete mathematics. McGraw-Hill New York, 1985.
[4]
95
96
C. L. Liu and C. Liu 1985, Cameron
1994, Diestel 2005 Stanley 1986.
5.1
( ) , (
) , .
,
.
5.1
( ) G = (V, E) V
E, V . V = V (G)
E = E(G) G.
u v .
G.
.
(
) .
, 5.1
.
() .
V = { , , , , }
E = { { , }, { , }, { , }, { , }, {
, }, { , } }.
,
.
.
97
98
5.
5.1:
2
5.2: 6 7
5.1
. ..
5.2
V = {1, 2, 3, 4, 5, 6}
5.1
E = {{1, 2}, {1, 4}, {2, 3}, {3, 5}, {3, 6}, {4, 6}, {5, 6}}.
G1 = (V, E) G2 = (V, E2 ) E1 E2 = E1 E2 V .
V G1 G2 .
5.3 .
5.1.
5.2
5.4 3 .
5.2
n ; n k ; (0 k n)
u v G (. {u, v} E) u v
G
u v . e1 e2
e1 e2 .
5.1.
99
5.3:
V = {1, 2, 3, 4, 5}. .
V .
5.4: 3
5.2
( , ) (.
) (.
) u u N (u).
5.5 .
5.3
5.2
N (1) = {2, 4}, N (2) = {1, 3}, N (3) = {2, 5, 6}, N (4) = {1, 6}, N (5) = {3, 6}, N (6) = {3, 4, 5}.
{3, 6}
N ((3, 6)) = {{2, 3}, {3, 5}, {4, 6}, {4, 5}, {3, 6}}.
,
(
).
5.3
( , . .) u V (
deg u) u . . deg u = |N (u)|.
.
.
r r-.
100
5.
5.5: 3 ( 2, 5,
7) 8 ( 5, 6, 9)
5.6: 4 6
5.6 .
5.4
5.2, {3, 6}, 2,
2-. 5.1 3
2.
5.3
;
n 0, 1, . . . , n 1.
0 n 1 ;
5.4
G = (V, E) 2|E|.
5.5
r- n ; 3- 7 ;
5.4.
5.6
.
5.7
n > 0 n- 2n .
5.8
. ,
.
5.2.
101
G = (V, E) A V
V \ A .
5.7 .
5.7:
, ,
5.2
n [n] = {1, . . . , n} E = .
En .
n [n] , . E =
.
[n]. Kn n2 = n(n1)
2
. 5.10 K5 .
m n V = A B, A =
{a1 , . . . , am }, B = {b1 , . . . , bn }, ai bj , i = 1, . . . , m, j = 1, . . . , n.
Km,n m n . 5.8 .
5.3
5.3.1
5.4
() G0 = (V 0 , E 0 ) G = (V, E)
V 0 V E 0 E.
102
5.
5.9: C6
, G0 G G
. G
u u,
.
5
2
1
4
1
2
5.10:
5.5
5.10 . .
, .
( ) .
.
5.9
Kn ; Kn ;
,
. , () (
[n]) () . ()
(). .. () 5 ()
5
, 2 .
, ( k = 0, 1, . . . , n, k
()) .
, .
5.5
V 0 V , G = (V, E) V 0
5.3.
103
G0 = (V 0 , E 0 ),
E 0 = e = {u, v} E :
u, v V 0 .
5.11 .
5.10 {2, 4}
{1, 3}.
V = {1, 2, 3, 4}.
5.11:
5.10
n ;
G G ( V 0 5.5).
5.3.2
5.6
G = (V, E) G0 = (V 0 , E 0 ), , 1-1 f : V V 0
G
G0
(5.1)
u, v V : u v f (u) f (v) .
,
1-1 .
5.12 .
5.12: ( f
5.6) 1, 2, 3, 4, 5
5.11
. . F , G H :
: F F ,
104
5.
: F G G F ,
: F G G H F
H.
5.13:
5.14: - 3
5.6
5.14 - 3 . .
3 ( 5.4) 4 .
3 , .
f ( )
. .. f 5.16
6.1
f (1) = 1, f (2) = 5, f (3) = 6, f (4) = 7, f (5) = 4, f (6) = 3, f (7) = 2,
.
,
. .. G G0 G
G0 .
( ) 6.1
6.1.
5.12
G Kn ,
n G.
5.13
.
5.14
5.13 .
5.3.
105
5.15
( . 5.1)
.
5.16
5 ( . 5.1).
5 52 = 10 , ,
, , . 5 .
5.17
W ,
. S
{0, 1, . . . , 6}
mod 7 3 4 ( 3 -3 mod 7).
.
5.18
Q ,
B {0, 1}3 , . 0 1.
Q . B
. Q B .
5.15.
5.15: 5.18
,
, ,
.
, 5.19.
5.19
G H .
.
1. |V (G)| 6= |V (H)|
2. |E(G)| 6= |E(H)|
3. G H.
4. G , H
.
106
5.
G H
.
5.1
, ,
.
5.20
- .
5.21
. 6.1 .
5.4
5.7
( ) G
e
en1
1
2
u2
un ,
u1
ej uj uj+1 , j = 1, . . . , n 1. (n 1)
.
.
5.7
uj
. .. 5.2 1 2 3 6 .
5.1 .
5.22
5.4.
2
1
3
107
6
4
7
5.16: 3
5.10
5.16 {1}, {2, 3, 4}
{5, 6, 7}.
5.10
( ) ,
. .
5.11
5.1 5.2 5.16 .
5.23
n n
1.
5.4.
5.24
,
, . , ,
( ).
5.17:
( 5.24)
d : V V R .
. d(u, v) u v .
5.11
( ) u v
d(u, v) = d(v, u) = +,
. u v .
d(u, v) u v, .
.
108
5.
5.12
5.16 d(2, 4) = d(5, 7) = 2, d(3, 2) = 1, d(1, x) = +, x {2, . . . , 7}.
5.10, , d(u, v) = 1, u, v {1, . . . , 5}, u 6= v.
,
:
u, v, w V :
(5.2)
, o u w
o w v,
u v. .
5.25
(5.2) .
, G = (V, E), diam G.
5.12
() G
G:
diam G = max d(u, v).
(5.3)
u,vV
G diam G < . ,
4 1 2.
5.26
B 5.18;
5.27
n n 1.
, , n n 1.
n 2 1.
u, v G d = d(u, v)
.
d ( ).
5.28
, 10 ,
6. 106 . G ,
, G;
.
. G
;
5.29
64 ,
. ;
5.4.
109
5.18: 5.29.
5.30
.
a, b G d(a, b) = diam G. a, b
.
5.31
, .
5.6.
5.32
, ,
. G = (V, E)
V = {v1 , . . . , vn }. A n n
1 vi vj ,
Aij =
0 .
. 1 i, j i- j- .
A 0 . ( , .
.
.)
k Ak , k 0, ( A k
) i, j s k
i j s. (: k u v
. , u u1 v, u u1 u u1 v
u v 4.)
X, Y n n Z = XY ( n n )
n
X
Zi,j =
Xi,r Yr,j , i, j = 1, 2, . . . , n.
r=1
110
5.
Aki,j
n
X
k1
Ai,r
Ar,j , i, j = 1, 2, . . . , n.
(5.4)
r=1
Ak1
i,r
i r k 1. (5.4)
i j k.
5.33
G n , d
n1+d
(d 1)diam G 1
.
d2
u G.
V (k) = {v V : d(u, v) = k}, k = 0, 1, . . . , diam G,
V . k
|V (k)| d(d 1)k1 k 1.
k = 0, 1, . . . , diam G (1.15).
5.5
, , .
5.13
(, ) . ,
, .
5.5.
111
5.20: 4
.
( ), , . (. ) .
, , , .
, , :
G = (V, E) ,
( ). ( 5.1.)
5.13
( 5.21)
N . ,
, ...
5.21: ,
.
, .
N . , ,
, .
5.21 . :
7 6 ( ).
,
,
112
5.
(,
, ).
5.14
( ) T , G ,
G (spanning tree). T ,
G T , T G.
5.1
G .
G = (V, E)
e
en1
1
2
C : u1
u2
un = u1 .
, .. e1 , .
. ( 5.24.) ,
e1 G L
v u, . 5.22.
u
L
e1
v
5.22: e1
, e1 ,
v u e1
C.
, ,
C e1 .
, , ( ) G ( ), ,
. .
G ( )
5.1 , .
5.5.
113
, ,
.
5.2
n n 1 .
n. n = 1 . G n .
: G 1.
2 ( 0 ).
G
e
e
u v u
, .
.
u
.
5.23: u
5.23. u
u
, , ,
. ( 5.23.)
deg u = 1 G0 G
V \ {u}, . u u. (
5.24.)
, G0
, u 1, .
G0 n 1 n 2 .
G n 1 ( G0 u).
5.34
n m (m )
n m .
5.2 (. ).
114
5.
G0
G
5.24: u
G0 G.
5.35
. G
.
(.. ).
. , ,
.
( ) ,
, u, v G
1 , 2 . 1 , 2 .
1 2 .
u, 1 v,
u p2 , ,
. . (= ).
1 2
.
5.36
.
n n 1 .
n ,
. .
:
5.1
G n n 1 .
G , T , n 1
5.2. G = T .
5.6.
115
5.37
3
. , ,
n ; .
5.1.
5.38
G 3 . , , . . (
5.37) .
() .
() G G .
5.6
5.15
( ) (V, E), V
, E
V V , . E V V .
(v, v) ( ). i
j .
5.16
( ) ( )
, , , .
.
5.17
( ) ( )
. .
5.18
( ) / ( )
/.
, . ,
, .
5.25 .
V = {1, 2, 3, 4}
E = {(2, 3), (2, 4), (3, 1), (4, 2), (4, 3)}
, .
.
,
.
( ) .
116
5.
0.9
0.1 2
0.1
1
5
0.1
0.2
0.1
0.1
3
3
0.1
5.25:
5.19
( ) ,
.
u v u v (+
), G
G, .
5.39
(5.2) (
).
.
5.26: 5.40
5.40
N N , ,
5.26.
.
Z E
( 0 ). 5.26
Z = 2 E = 4.
2Z E.
5.7
Kruskal
G = (V, E)
w : E R+ .
T G
, . , .
.
X
w(T ) =
w(e),
eT
e (e T ), T
G, . G.
5.20
( ) w(T ) , .
G.
G.
Kruskal
1. F G .
2. S G,
.
3. S 6= :
() S (
S).
() F , F , F .
.
F G. ( Kruskal
O(m log m) , m G.)
5.3
Kruskal
G.
Kruskal
,
,
.
F , , . F
C1 , . . . , Ck , k > 1, , ,
118
5.
G Cj .
G , .
F G F
G. T
G F
( S)
. F = T F
. e
F T T F . e
.
e F \ T.
(5.5)
Kruskal
F . ,
T F , e T ,
e T .
(5.5).
F1
F2
e
5.27: 5.3
e
F1 F2 () F . e
/ T
T C
C \ {e}, f ,
w(f ) w(e).
C \ {e}
e, , F T ,
C \ {e} T , F ,
e F1 F2 . ( 5.27.)
T 0 = T {e} \ f.
F T ,
T . F = T F
.
1.0
3.0
1.5
2.5
1.5
1.0
0.5
1.0
1
3.0
5.28:
5.41
Kruskal 5.28
.
5.42
Kruskal
m log m, m (
n 1, n , .
.
Kruskal (greedy) (
) , ,
.
,
.
5.8
Floyd-Warshall
, G ( ) .
. . ( , ) i j
;.
, .., , , 1 ,
. overkill
: .
, , [n] = {1, 2, . . . , n}
w(i, j) (i, j) ( +
).
n n A
1 n 3.
120
5.
FloydWarshall
(0)
(k)
(k)
k Aij Lij =
i j {1, . . . , k}.
(0)
k = 0 Aij
(i, j) i j
(i, j) . k = 0.
k 1,
i j {1, . . . , k},
.
() k.
() k.
(k)
(k1)
Lij = Lij .
().
i j k ( k). ,
i k i k (k1)
{1, . . . , k 1}. Lik
, ,
(k1)
k j Lkj .
(k)
(k1)
(k1)
Lij = Lik
+ Lkj .
, ,
(k)
(k1)
Lij Lij
(k)
(k1)
Lij Lik
(k1)
+ Lkj
L
i j ( [k]) i
k k j ( [k 1]).
n
o
(k)
(k1)
(k1)
(k1)
Lij = min Lij , Lik
+ Lkj
(k)
(k)
5.43
( ) Floyd-Warshall ; ( ) ;
5.44
Floyd-Warshall
5.28.
122
5.
[1]
[2]
[3]
Chung Laung Liu and CL Liu. Elements of discrete mathematics. McGraw-Hill New York, 1985.
[4]
123
124
C. L. Liu and C. Liu 1985, Cameron
1994, Diestel 2005 Stanley 1986.
6.1
. : A,
, B, .
V = AB , .
u, v V u v .
A B. .
A B. ,
,
(servers) (clients).
6.1
( ) G = (V, E)
V = A B, A B = ,
A B (
B A). . A A B B.
6.1
. .
V ,
, A
B .
6.1
( ) (A B)
, . , . 6.1(a)
A = {1, 3, 6}, B = {2, 4, 5, 7}.
, , . .
6.1(b) (a) .
6.2
V = A B , , , 1 B A.
125
126
6.
1
2
3
4
5
6
7
(a)
7
(b)
6.1: ,
6.1
G G
.
6.2
.
, (
6.1). G = (V, E) u
V (k) = {v V : d(u, v) = k}, k = 0, 1, . . . , diam G,
V . V (k) G
k u. G
ab, a V (i), b V (j),
i j mod 2, . i, j .
6.1
.
n = |V |. n = 1,
u . V = {u} A = {u}
B = .
, n 1
T n . .
( 5.2)
1. u T , v . T
u uv, , T 0 (
, ) n 1 .
T 0 A0 B 0 ( T 0 .
A0 B 0 ). v , A0 .
T A = A0
B = B 0 {u}. , A0
6.1.
127
B 0 , u B 0 .
u , v, A.
6.2: A B
u
, ,
.
6.3
6.4
Cn {1, 2, . . . , n}
E = {(1, 2), (2, 3), . . . , (n 1, n), (n, 1)}.
Cn n .
6.5
m n , Kmn
A = {a1 , . . . , am } B = {b1 , . . . , bn },
.
5.8 .. K4,3 .
1. Kmn ;
2. m n Kmn ; (
.)
3. Kmn . ( G
G0 G0
G.) ;
6.6
; ( 6.5.)
:
6.2
.
128
6.
G C :
C : u1 u2 un u1 .
C n .
u1 A. u2 B, u3 A,
. . uj j B j A. un
u1 , B, n .
, G , V ,
. G u.
A = {v V : d(u, v) o}
B = V \ A.
G A B.
A B. a1
a2 A ( B) ,
, G a1 a2 . 1 2
G u a1 a2 . C
1 a1 a2 2 .
C
|C| = |1 | + 1 + |2 |,
, .
G . G , G ( 6.1).
6.7
G, (G), k
k G,
.
(K3 ) 3. G
(G) 2.
6.8
A = {a1 , . . . , am } B = {b1 , . . . , bn },
A B;
A B .
6.9
A = {a1 , . . . , am } B = {b1 , . . . , bn }, m, n r r-
A B;
A.
A r m r .
B.
.
6.10
(
);
6.2.
6.2
129
.
6.2
( , ) .
M (matching).
A B M A ( B)
A M .
5
4
5
1
3
6
7
8
A
(a)
B
(b)
6.3:
6.2
. 6.3(a) . . 6.3(b)
A ( ).
B 9 B
.
6.3
J1 , . . . , Jn
C1 , . . . , Cm , m n.
, .
.
.
A = {J1 , . . . , Jn } B = {C1 , . . . , Cm } Jk
Cl Cl Jk .
A .
6.11
A B A |B| |A|.
X A1 , . . . , An . :
A1 , . . . , An
X. Ai x x Ai .
130
6.
6.3 6.4: X = {, , , , , , }, A1 , . . . , A5
X. ( ,
, ) ,
X
.
X
.
6.4 .
6.3
, J , N (J)
J.
.
6.3
A B A
J A
|N (J)| |J|.
(6.1)
6.3 ( 1.5).
B,
6.3. 6.3 (1.21) Hall.
A B
, , ,
Hall, . 6.3.
6.12
A B
|N (J)| |J| 5, J A.
6.3.
131
M |A| 5 A.
5 B A.
Hall (6.1). 6.3
.
:
6.1
( , ).
G = (A B, E) r-, r 1.
6.3. J A E1 J.
G r- |E1 | = r|J|.
E2 N (J), .
J. |E2 | = r|N (J)|.
E1 E2 . r|J| r|N (J)|,
|N (J)| |J|.
6.13
r- r .
6.1.
. ;
6.14
6.3
A. ,
. (, ).
6.4
( , )
( ).
A B M ,
, A
E \ M M , .
B .
132
6.
6.5: 1243
6.4
. 6.5 1243 .
6.4
6.6: (). M .
M M
. ,
M , M , M , ...,
M , B M .
M
M M , M 0
M . M 0 ( 6.15 ),
, .
6.6 6.5.
6.5
. 6.5 24 12 34
.
6.15
6.4, M 0 .
M .
6.3.
133
6.15, .
6.4
.
M1 ( G, A B)
, M2 . G0
M1 4 M2 ( M1 M2 , G .
M1 M2 ).
M1 M2 G0 0, 1 2 (
G0 , G). G0 3
M1 M2 ,
.
G0
( 0, ).
M1 M2 .
M1 M2 .
, M1 - M2 -
M2 -
M1 , A B.
( ) M1 -
M2 . M2 M1
M2 , .
6.5
6.4 : (.. )
.
6.4
. ,
6.4 .
6.5
( ) U G G
G U .
6.6
. 6.3(a) {1, 6, 8} .
6.16
G M U .
|U | |M |.
M U .
M ;
6.5
(Knig, 1931, Egervry, 1931)
.
134
6.
G A B M G . U , |U | = |M |,
G. G
|M |. , ( 6.16)
|M | , 6.5 .
U M ,
.
:
uv M , u A, v B.
v v U , u.
|U | = |M |.
U . ab a A, b B.
a, b U . ab M ab
/ M .
M a0 b0 M , a = a0 b = b0 , a0 b0
M M , . a b = b0 ab
, a0 b0 U b0 = b,
.
a = a0 . a = a0 U b0 U ,
b0 . (
6.7.)
M .
0 b: b b 0 = ab (
b0 ab). M 0
, b M U
0 b.
6.6
6.5 . ,
, . .
() ,
135
.
. , M ,
U , , o U
( .
U ). U 6.4. ,
6.4, ( |U | = |M |
U ) M .
6.17
6.4
6.4.1
Euler Hamilton
6.6
( Euler, Hamilton) Euler (. Euler) (. ) .
Hamilton (. Hamilton) (. )
.
G Euler Hamilton.
Hamilton. Hamilton
. NP- (Nondeterministic Polynomial
Time, NP) .
, Hamilton G n
, G,
Hamilton , ,
( ) nC C
, , ( . n).
, , .
NP- : , .
136
6.
. ,
.
6.4.2
/ Euler
Euler.
( , ) .
6.6 () G Euler
G .
() G Euler G
G 2 .
().
G Euler
: v1 vn = v1 ,
v v
< v, 2 v,
, .
(. ) v, v
.
, k k Euler.
k k = 3,
3 .
3 ,
Euler.
,
k G k +1 ,
. Euler.
G ( ,
. 1) G , C.
G0 ,
. G0
( ) C G
Euler. G0 .
G0 . G1 , G2 , . . . , Gr .
G1 , G2 , . . . , Gr (,
) k . ,
G1 , G2 , . . . , Gr Euler, Ci .
Ci C. (
G .) ui C
Ci . Euler G C
ui C
Ci . 6.8.
() () ( 6.18).
6.5.
137
6.8: , 6.6, Ci
C ( ) ( ).
6.18
() 6.6.
() .
6.5
6.5.1
6.7
A r
: A [r] = {1, . . . , r}.
. , , , .
6.8
( , ) G = (V, E) .
G r : V [r]
u, v V : u v = (u) 6= (v).
. .
G r : E [r] ..
e, e0 E : e e0 = (e) 6= (e0 ).
. .
n n , .
.
6.9
( ) (G) G r
G.
6.7
n , Kn , n ((Kn ) = n), ((En ) = 1).
6.19
Cn (Cn ) = 2 n 3 n .
138
6.5.2
6.
(G)
.
.
6.7
G Ks (G) s.
. G s s G, .
.
6.8
G d (G) d + 1.
n G. n = 1 .
G n d u G.
G0 G u
. n 1 , d. ,
, (G0 ) d + 1, . G0
1, 2, . . . , d + 1.
u G0 , u1 , . . . , uk , k d.
1, 2, . . . , d + 1 u1 , . . . , uk , c. u c
G0 . G d + 1 .
6.20
(G) = k > 1 V G V = V1 V2
, Gi G Vi , i = 1, 2,
6.21
(G1 ) + (G2 ) = k.
G1 , G2 V .
(G1 G2 ) (G1 )(G2 ).
G1 G2 V G1
G2 .
6.22
G n s
(G) n s + 1.
6.23
k
(, ).
6.5.
139
6.9: 6.23.
4
.
k. .
140
6.
[1]
[2]
[3]
Chung Laung Liu and CL Liu. Elements of discrete mathematics. McGraw-Hill New York, 1985.
[4]
141
142
Hopcroft, Motwani, and Ullman 2007.
7.1
7.1
() ,
.
7.1
2 = {0, 1}. .
. 2 .
.
7.2
GR = {A, B, , . . . , , , , . . . , , . . .}
.
7.2
()
= 1 . . . n
i , (. n = 0).
n 0 ||.
.
.
7.3
w = 0101 2 , |w| = 4.
7.3
() L ,
, . |L| L.
7.4
.
7.5
, ,
, . .
143
144
7.
7.6
.
()
.
7.7
E 2015
GR
( ).
E .
7.8
Q = w 2 : k N : |w| = k 2
.
.
7.9
Lk 2 k, k ,
2 . k, k 0 Lk , Lk0 .
w 2 k, k = |w|, w Lk . Lk , k 0,
2 .
7.1
python
.
def words_of_length(S, k):
""" Return a list with all words over alphabet S of length k"""
if k==0:
return ['']
result = []
tails = words_of_length(S, k-1)
for first in S:
for t in tails:
result.append(first+t)
return result
S = ['a', 'b']
print words_of_length(S, 3)
SS = ['a', 'b', 'c']
print words_of_length(SS, 3)
print words_of_length(SS, 0)
:
['aaa',
['aaa',
'bab',
'cac',
['']
'aab',
'aab',
'bac',
'cba',
'aba',
'aac',
'bba',
'cbb',
'abb',
'aba',
'bbb',
'cbc',
'baa',
'abb',
'bbc',
'cca',
'bab',
'abc',
'bca',
'ccb',
'bba', 'bbb']
'aca', 'acb', 'acc', 'baa',
'bcb', 'bcc', 'caa', 'cab',
'ccc']
. k.
7.2
|Lk |. Mk 2 k,
|Mk |.
7.1. ,
145
7.3
n k ;
7.10
A , ,
, , , , (space) (
), (carriage return),
.
American Standard Code For Information Interchange ASCII. ( ASCII
standard 0-127.
standard .)
LC A python. ,
.
. , LC
.
LC
, .
7.4
( , ) = 1 . . . m = 1 . . . n
m n, (concatenation)
= 1 . . . m 1 . . . n ,
.
(prefix) .. = .
(suffix) .. = .
, w , , ,
w = .
7.11
= {a, b, c} abc bb abcbb.
7.12
abcd ( )
, a, ab, abc, abcd. abcd, bcd, cd, d, .
7.1
= = , .
n n + 1 .
, , , = 01
= 00 = 0100 =
6 0001 = .
7.2
, , .
7.5
( ) L1 , L2 L1 L2
L1 L2 = {xy : x L1 , y L2 }.
. L1 L2 L1
L2 .
146
7.
L0 = {} , n 1, Ln = LL L ( L n
).
L =
Lk
k=0
L =
Lk .
k=1
7.13
L = {00, 11, }. L = L+ 0
1 , .
L .
7.4
1 2 .
7.5
L m, n Lm+n = Lm Ln .
7.6
L ,
L L+ ; L;
7.7
B
{+, , }1{0, 1} .
( .) , , ,
, =
{0, 1, +, }.
7.2
Q ,
,
7.2.
147
0
A
START
0
0
D
C
0
FINAL STATE
7.1:
(transition function) Q
Q,
q0 Q ,
F Q .
7.3
DFA
Q. / q a
(q, a).
7.14
7.1 Q = {A, B, C, D}, = {0, 1}, q0 = A, F = {C}.
. , ,
L . .
w , w = w1 . . . wn , n (wi ).
q0 .
, .
w1 wn .
q
r q r (label) .
.
(q, ) = r, .
q
. .
.
,
. F . .
148
7.
7.7
( DFA)
M L(M ).
7.15
L 7.1;
L {0, 1}
0 1.
. 0,
A .
.
(A B) 1. ,
C () ,
C ( ) ( ).
.. {0, 1}
F
{A, B, C}.
7.8
DFA = {0, 1}
3.
7.2.
7.2: 7.8 6 .
7.9
7.2.
149
: 7.3, ,
( , )
.
: 7.3
( ,
). ,
a .
, .
.
. K,
, ,
x K.
K K.
.
7.17
7.4 L {0, 1}
1. ,
111.
0
1
7.4: DFA 1
, , .
, 0 1.
, , ,
1,
1 .
7.18
: L {0, 1}
, 0 0
. , 11111111111, 11111110111101111 L 111111011111
( 0). 7.5.
;
, ,
. , I
0 . ( ) , I
150
7.
I
1
0
0
0
1
0
0
A
7.5: DFA 0 , 0
. , I, ,
0,
L .
. , ,
. -,
, ,
L. ,
,
, .
.
5 ,
1.
A 0
1. B 0
2, ..., E 0 5
. E
1: 0 5 1
1. , , ,
.
7.5 , . , , A, . . . , E
0 A 0
1 , A.
7.10
DFA = {0, 1}
5 5 1.
7.11
DFA = {0, 1}
5 5 1.
7.12
L {0, 1} , 0
0 . DFA L.
7.3.
151
7.13
DFA {0, 1} :
1. 00
2. 0
7.14
DFA
() 00 1 1,
() {w {a, b} : 6 | A(w) + 2B(w)},
A(w), B(w) a b w x|y x y.
7.15
7.3
,
(Non-deterministic Finite Automata NFA). , , , , , DFA
NFA, NFA
DFA.
,
, . ,
NFA DFA, DFA .
NFA. NFA
DFA , .
7.8
( (NFA) )
(Q, , , q0 , F )
Q ,
,
(transition function) Q
2Q , . Q.
q0 Q ,
F Q .
DFA
. ( (q, ) =
q .)
152
7.
, ,
.
q Q .
(q, ) Q.
7.4
q NFA (q, ) =
q .
7.9
( NFA) w = w1 w2 . . . wn , wj ,
NFA , w,
. q0 w1
wn . wj ,
q, (q, wj ). (
.)
,
.
w .
7.10
( NFA) M L(M ).
7.19
00{0, 1} 11.
0,1
0
A
0
C
NFA DFA 1.
: (loop)
0 1.
0 1.
, 0 1.
.
NFA 7.6 L = 00{0, 1} 11; L
00 11.
NFA : 0 ,
. 1
.
1 ,
.
.
7.3.
153
, w NFA 0 (
) 1 (
).
DFA :
0
0
0
1
1
00{0, 1} 11.
,
DFA 7.5 .
7.5
NFA DFA 00{0, 1} 11
NFA DFA.
, . , ,
NFA DFA, . , NFA DFA
().
7.20
7.6 Q = {A, B, C, D, E}, = {0, 1}, q0 = A,
154
7.
F = {E},
(A, 0) = {B}
(A, 1) =
(B, 0) = {C}
(B, 1) =
(C, 0) = {C}
(C, 1) = {C, D}
(D, 0) =
(D, 1) = {E}
(E, 0) =
(E, 1) =
7.16
NFA 7.11.
7.17
NFA = {0, 1}
4.
, 4.
7.4
NFA DFA.
NFA
. . q Q ,
(q, ) Q NFA
q .
7.11
( ) A Q B
[
(A, B) =
(q, ).
qA,B
. (A, B) A B.
f : C D f (X), X C,
X f .
.
155
7.12
( ) q Q w
( ) (q, w) :
{q}
w =
(q, w) =
(7.1)
((q, v), ) w = v, v , .
7.6
(7.1) ,
. . , (q, w)
(q, x) x |x| < |w|,
0 . (q, w)
, (7.1)
. , (q, abc), a, b, c ,
(7.1) :
(q, abc) = ((q, ab), c)
= (((q, a), b), c).
. (7.1)
.
(q, w), w ,
q w. ,
R Q , (R, w)
R
w.
7.7
w
(q0 , w) F =
6 ,
F NFA. .
.
7.13
( ) M1 M2 L(M1 ) = L(M2 ), . .
7.1
( NFA DFA) NFA M DFA M 0 .
NFA M DFA M 0 .
NFA M (Q, , , q0 , F ). DFA M 0 = (Q0 , , 0 , q00 , F 0 )
Q0 = 2Q ( ) Q,
q00 = {q0 },
M
F 0 = {A Q : A F 6= }.
156
7.
0 : Q0 Q0 M 0
0 (q 0 , ) = (q 0 , ).
q 0 M 0 M ,
M , .
: DFA M 0 q1 ( Q)
q2 ,
M q1
M . 7.21 .
7.18
|w| w q M 0
0 (q, w) = (q, w).
w L(M ) w L(M 0 )
(7.2)
0,1
1
A
7.8: M , NFA
M 0 M .
{A, B}. .
Q0 = {X = {A}, Y = {B}, Z = {A, B}, W = }.
F 0 = {Y, Z}, .
M . X.
7.5. NFA -
157
1
X
Y
1
0,1
0,1
Z
7.19
7.20
DFA NFA
1. (Q = {p, q, r, s}, = {0, 1}, 1 , q0 = p, F = {s})
2. (Q = {p, q, r, s}, = {0, 1}, 2 , q0 = p, F = {q, s})
1 :
7.21
p
q
r
s
0
1
0
1
{p, q} {p}
p {q, s}
{q}
{r} {r} 2 : q
{r} {q, r}
r
{s}
{s}
{p}
s
{s} {s}
{p}
NFA n ,
DFA;
7.5
NFA -
-. NFA , ,
.
-
.
- .
-NFA.
7.14
( - (-NFA) )
- (-NFA)
(Q, , , q0 , F )
158
7.
Q ,
,
(transition function) Q ( {})
2Q , . Q.
q0 Q ,
F Q .
7.8
NFA
.
7.9
- q1 q2 : NFA
q1 q2
.
7.15
( -NFA) w = w1 w2 . . . wn , wj ,
-NFA , w,
. q0 w1
wn . wj
.
wj , q, (q, wj ). (
.)
-, . (q, ), q . (
.)
,
. w
.
7.16
( -NFA)
M L(M ).
7.22
-NFA 7.10 0 1 2 .
0
7.10: -NFA 0 1 2 .
, 02 13 25 ( 0011122222);
0,
159
, 1, ,
2.
7.22
7.23
M1 M2 DFA
-NFA L(M1 ) L(M2 ).
M1 M2 -
DFA.
7.24
M1 M2 DFA
-NFA L(M1 )L(M2 ). M1 DFA
.
M1 M2 . M1
-.
7.6
-NFA NFA
-NFA M NFA M 0 :
M 0 M .
M 0 M .
M 0 , F 0 ,
F (
M ) -. -,
F F 0 .
q M 0 M 0 (q, ) q M -.
-.
160
7.
w = w1 w2 wn , n 0. w M
M .
w L(M ) M ,
w -, q0 f F .
M
q0 F 0 .
w L(M ). M
q0 , q1 , . . . , qk1 , qk , k 0, qk F qj qj+1 , 0 j < k,
wj -, wj ,
, .
q0 q1 , q1 q2 , . . . , qk1 qk
qa0 qa1 , qa1 qa2 , . . . , qan1 qan ( a0 = 0, an = k)
w1 -, w2 -, ., wn -.
NFA M 0 M 0 qa0 qa1
w1 -, qa1 qa2 w2 -, . qk
M 0 w L(M 0 ).
L(M 0 ) L(M ) ( 7.25).
7.25
NFA M 0 -NFA M .
7.23
7.2 -NFA 7.10
0
0,1
1,2
0,1,2
7.7
DFA.
.
(regular
expression) .
7.19
( ) . ( L() .)
7.7.
161
, L() = ( , )
, L() = {} ( , )
, , L() = {}.
, r s .
1. (r), L((r)) = L(r).
2. (r + s), L((r + s)) = L(r) L(s),
3. (rs), L((rs)) = L(r)L(s),
4. (r ), L((r )) = L(r) .
L r L = L(r).
7.10
. ,
. 01 + 10 (0(1 )) + (1(0 )). r
r+ rr .
7.24
.
00
{00}
(0 + 1)
= {0, 1}
(0 + 1) 00(0 + 1) = {0, 1}
(1 + 10)
1 0
(0 + )(1 + 10)
0
0 1 2
0 1 2.
7.26
:
1. 101.
2. 0 1.
7.27
:
1. (11 + 0) (00 + 1)
2. (1 + 01 + 001) ( + 0 + 00)
3. (00 + 11 + (01 + 10)(00 + 11) (01 + 10))
7.28
r, s, t .
( , ,
) .
1. r + s = s + r
162
7.
2. (r + s) + t = r + (s + t)
3. (rs)t = r(st)
4. r(s + t) = rs + rt
5. (r + s)t = rt + st
6. =
7. (r ) = r
8. ( + r) = r
9. (r s ) = (r + s)
7.8
.
7.3
( )
.
7.11
7.3 .
-NFA NFA NFA DFA.
.
() -NFA, ()
DFA .
() r .
, a, a ,
7.12.
a
(a)
(b)
(c)
7.8.
163
(a)
(b)
(d)
(e)
(c)
(d) M -
N . N .
(e) M - M .
.
() DFA M = (Q, , , q1 , F ), Q = {q1 , . . . , qn }. i, j = 1, . . . , n, k =
k
0, . . . , n, Ri,j
qi qj
ql l > k.
[
n
L(M ) =
R1,j
.
(7.3)
qj F
, ,
q1 , qj F ,
( n, , , ql ,
l > n.
k .
k Ri,j
L(M ) (7.3) ,
.
k
k = 0 , , Ri,j
, l > 0
ql Q.
{ : (qi , ) = qj }
(i =
6 j)
0
Ri,j =
{ : (qi , ) = qi } {} (i = j)
0 .
Ri,j
0 .
Ri,j
k1
, Ri,j
164
7.
k
Ri,j
k1
k1 k1
k1
k
Ri,j
= Ri,k
(Rk,k
) Rk,j Ri,j
.
(7.4)
(7.4);
k Rk1 , l k,
Ri,j
i,j
k , ( ) k.
Ri,j
k Rk1 , ()
Ri,j
i,j
k \ Rk1 ; q q ,
Ri,j
i
j
i,j
ql , l > k, qk
7.14.
q
k
qi
qj
k \ Rk1
7.14: DFA Ri,j
i,j
DFA
qk , ( 7.14 ).
w , w qi qk ,
qk , w qk qj qk ,
w
w = v1 vt ,
v1 , . . . , vt qk ,
k1
k1
k1
, l = 1, . . . , t, Rk,j
,
, vl Rk,k
qk . . Ri,k
k1
k1
k1 k1
k
Ri,j
\ Ri,j
Ri,k
(Rk,k
) Rk,j .
.
7.29
DFA :
1. 10 + (0 + 11)0 1
2. 01 (((10) + 111) + 0) 1
3. ((0 + 1)(0 + 1)) + ((0 + 1)(0 + 1)(0 + 1))
7.30
7.15.
7.31
7.16.
7.9.
165
a,b
7.15: 7.30
0
1
1
0
7.16: 7.31
7.9
L1 L2
L1 L2 L1 .
Lc1 = {w : w
/ L1 }
. 7.3
DFA . DFA
M L1 . DFA M 0 M ,
, M M
M M 0 . (
M ,
DFA, .
.) M 0
M , M 0 DFA Lc1 .
L1 L2 .
,
(L1 L2 )c = Lc1 Lc2 ,
.
7.20
(substitution)
, .
f : 2 ,
166
7.
. . f (a)
, .
f : 2
. w = 1 n , i , , ( f )
f (w) = f (1 ) f (n ),
. f (1 ), . . . , f (n ).
L
[
f (L) =
f (w).
wL
7.4
L , f , f (L) .
( .)
L r.
( ) f (L)
r r
f (). f (L) ,
.
7.32
7.4 .
L.
7.21
f f () .
( )
.
7.22
f L , L
f 1 (L) = {w : f (w) L}.
7.5
f L f 1 (L) .
M DFA L. DFA M 0 :
M :
q M
M 0 (q, ) = M (q, f ()).
7.10.
167
. M 0 M
q f (). w
M 0 f (w) M , DFA
f 1 (L), .
7.33
L
LR = x : xR L
. xR x . .. 011R = 110.
L.
7.10
. ,
,
.
, DFA , .
;
( ..
), .
, .
: 1, 2, ..., , ...,
.
( )
.
n, n. , ||n
. ,
1, 2, ,
.
( ) . ,
, . .
, .
, ,
, , , ,
,
. , .. f : N N , .
,
python .
, , f : N N ,
, . .
. . ( )
,
, ..
L1 = {0n 1n : n = 0, 1, 2, . . .}.
168
7.
, .
L1 . ( ):
, . .
L1 ,
. ,
()
L1 .
, ,
, ( ) .
, L1 . .
7.6
( Pumping Lemma) L . n (
DFA L) z L |z| n,
z = uvw, (u, v, w , |v| 1, |uv| n),
i = 0, 1, 2, . . ., uv i w L ( u
v 0 w).
Pumping Lemma .
() .
M DFA L, n
M . z
q0 z, |z| = m n, q1
M :
q0 = qi1 qi2 qim+1 = q1
m ( z)
m + 1 > n.
. q
v q, u
z q w z
q (. 7.17).
|v| 1 |uv| n, n-
z ,
q.
q ( uw L)
, i. uv i w L, .
L1 ;
. , , ,
n, z L1 |z| n . z = 0n 1n L1 |z| n, z = uvw, |uv| n v,
7.10.
169
u
q
q
0
7.17: uvw
i = 0, 1, . . . uv i w L1 . uv 2 w = uvvw
0 1, , |uv| n, u v
.
.
x = 1 n , i , xR = n 1 , x .
L2 = x (0 + 1) : x = xR ,
.
L2 . n
. z = 1n 01n
L2 . z z = uvw, v |uv| n, u, v
1, uv i w L2 , i = 0, 1, 2, . . .. uw
/ L2 v
,
, L2 .
7.34
{xx : x {0, 1} } .
7.35
(0 + 1) ;
1. 02n : n 1
2. {0m 1n 0m+n : m, n 1}
3.
4. .
5. xwxR : x, w (0 + 1)+
170
7.
[1]
John E Hopcroft, Rajeev Motwani, and Jeffrey D Ullman. Introduction to automata theory,
languages, and computation. Pearson, 2007.
171
172
Hopcroft, Motwani, and Ullman 2007.
8.1
DFA
DFA M
1. M ,
2. M .
,
( ) .
. M ,
(L(M ) = ; |L(M )| = ;). , .
, ,
. ( )
() () .
() ().
L(M ) = :
. 0 ( , ),
1 ( , . ||),
2 ( ||2 ), ... , .
.
M . M
( L(M ) = ), .
, , ,
, , ,
L(M ) , ..
, . , ,
, .
;
, M , ( )
L(M ), ,
173
174
8.
L(M ), . ,
, ,
.
8.1
M DFA n
1. L(M ) 6= w L(M ) |w| < n.
2. |L(M )| = w L(M ) n |w| < 2n.
6
1. w L(M ) |w| < n L(M ) 6= . , L(M ) =
w L(M ) . |w| n , , w = uvz
v =
6 i 0 uv i z L(M ). i = 0 uz L(M ),
w = uvz ,
, |w| < n.
2. w L(M ) n |w| < 2n ( n |w|)
w w = uvz, v 6= , uv i z, i 0,
L(M ). , |L(M )| = . , |L(M )| =
w n 2n 1, w
2n ( L(M )
). |w| 2n n
w w = uvz, |uv| n v =
6 uv i z L(M ) ( i 0). uz L(M )
|uvz| 2n |v| n |uz| n, (
L(M ) n 2n 1) |uz| 2n, w
L(M ) 2n.
.
8.2
:
1. DFA M ;
2. DFA M ;
3. DFA M1 M2 ;
1. n 1 (
1 + || + ||2 + + ||n1 ) M .
, .
8.1.1.
2. n 2n 1 .
, .
8.1.2.
3.
L(M1 ) 6= L(M2 ).
(L(M1 ) L(M2 )c ) (L(M1 )c L(M2 )).
(8.1)
8.2
. Myhill
Nerode
1. L RL : x RL y z
xz L yz L,
. xz, yz L .
2. M DFA x RM y
(q0 , x) = (q0 , y),
q0 M (, ) M .
. x RM y M x
y, .
8.1
RL RM .
8.2
L RL (
L ). RL - . L L.
8.1
R R.
8.3
RM M
q0 . v w ..
(q0 , w) = v.
8.2
R (right invariant) x, y, z
x R y xz R yz.
(8.2)
8.4
RL RM .
176
8.
8.5
M DFA L(M ) M .
RM .
8.3
( MyhillNerode) L :
1. L .
2. L R .
3. RL .
12
L DFA M 8.5.
23
L R
t < . RL t, .
x R y x RL y: z , xz L x R y. R
xz R yz. yz R- xz. xz L,
L R, R- xz L, yz L.
. xz L yz L, ,
x RL y, .
(x R y x RL y) R RL . , x K, K R-, x S,
S RL - x. K S. y K. x R y
x RL y, y S.
R- RL - RL - R-, RL - R-
, .
31
RL L
DFA M , . x [x] RL - x.
M Q RL -,
.
[] .
:
([x], ) = [x], ( ).
(8.3)
RL L (
8.2).
8.6
8.3. DFA
177
(8.3) ( w )
([x], w) = [xw],
([], w) = [w] = [w] M w L, M
L.
8.3
DFA
, DFA M , DFA,
N , M (. L(M ) = L(N ) )
.
Myhill-Nerode DFA,
RL , L = L(M ),
([x], ) = [x] ( MyhillNerode) [x] x .
Myhill-Nerode RM RL ,
, DFA M , M
M RL ,
, RL .
DFA , M ,
RL -. RL - M . u v M RL -
.
, f (u, v) u v M , 1 u v
0 . ,
u, v Q, u =
6 v, f (u, v) = 0,
(8.4)
Q M .
RL x y
RL - z xz, yz L
. ( z = ) u F v
/ F u v
.
u F, v
/ F f (u, v) = 1.
(8.5)
RL u v
, a b u = (a, )
v = (b, ) a, b RL -.
: S
(u, v) u F , v
/ F , .
. T
(a, b) f (a, b) = 0 ( . )
((a, ), (b, )) S.
178
8.
T f (a, b) = 1 (a, b) T , T S, , (
T S, ...), T .
.
, . f (u, v) = 1
(u, v) RL - .
MyhillNerode: M .
M -
M . M - .
M ( F )
M .
[1]
John E Hopcroft, Rajeev Motwani, and Jeffrey D Ullman. Introduction to automata theory,
languages, and computation. Pearson, 2007.
179
180
Context free
Hopcroft, Motwani, and Ullman 2007.
9.1
.
( )
(+) (*), .
x. x (x + x) + x
xx + () .
= {+, , (, ), x}
, .
:
, , .
.
9.1
x . w v ,
(w), w + v, w v. ,
.
x (x + x) + x x (x + x) + x ,
(x + x) x
x + x , , x .
( )
context free . context free :
1. S x
2. S (S)
3. S S + S
4. S S S
181
182
9. CONTEXT FREE
S ,
(S . . .) .
S
. , ,
context free context free .
.. x (x + x) + x
S S+S
( 3)
SS+S
( 4)
S (S) + S
( 2)
S (S + S) + S ( 3)
x (x + x) + x ( 1, )
S xx + ().
9.2
context free
9.2
context free G ( )
, ,
S ( )
X w, X w
( w ).
G Context Free Grammar(CFG), Context Free , w, v
,
G
wv
X v w.
X w
( )
v.
, G
G
x + S x + (S)
2.
G
wv
v1 , . . . , vn
G
w v1 vn v,
. v w
G. , ,
G
S (S + S)
S (S + S) 3
2.
( ).
9.3.
183
9.3
G CFG w G w
n
o
G
L(w) = LG (w) = x : w x .
. L(w) w G.
G.
9.4
G CFG L(G) L(S). L Context
Free Language (CFL), Context Free , context free .
. G
S.
X w1 |w2 | . . . |wn
X w1 , X w2 , . . . , X wn ,
.
9.1
S | 0S0 | 1S1;
9.2
9.3
. ,
, = {a, b}, CFG .
9.3
CFG . {a, b} a b. (
( 7.6)).
G1 :
1. S aB | bA |
2. A aS | bAA
3. B aBB | bS
9.1
L(G1 ) {a, b} a b.
184
9. CONTEXT FREE
G1 a b,
L(G1 ) {a, b} .
w {a, b} A(w) B(w) a b
.
G
A(w) = B(w) S 1 w.
.
.
w .
1. w L(S) A(w) = B(w).
2. w L(A) A(w) = B(w) + 1.
3. w L(B) B(w) = A(w) + 1.
. A B G1
a ( A) b ( B).
n w n. n = 0,
w = w S S
A B, A B .
w = , n = 0.
w |w|
n 1.
w n. : w L(S) A(w) =
B(w).
w L(S) = A(w) = B(w)
w L(S) G1 S w.
w a
S aB. w = ax x x L(B),
|x| n 1. B(x) = A(x) + 1 A(w) = B(w).
, w b S w
S bA, w = by, y L(A) |y| = n 1.
A(y) = B(y) + 1 A(w) = B(w).
A(w) = B(w) = w L(S)
w a w = ax A(x) = B(x)1, |x| = n1.
x L(B), x
B. S, S aB
B x. w S
w L(S). , w b w = by |y| = n 1
A(y) = B(y) + 1, , , y L(A).
w S S bA, A y,
w.
.
w L(A) A(w) = B(w) + 1.
a b
w.
w L(A) = A(w) = B(w) + 1
w a. A
w A aS, w = ax |x| = n 1 x
S, x L(S) A(x) = B(x),
A(w) = B(w) + 1.
185
w b
w A A bAA, w = bx1 x2 x1 , x2 L(A), ,
, |x1 |, |x2 | n 1. A(x1 ) = B(x1 ) + 1
A(x2 ) = B(x2 ) + 1, A(w) = B(w) + 1.
A(w) = B(w) + 1 = w L(A)
w a w = ax A(x) = B(x), |x| = n 1,
x L(S). A A
aS S x, w
A, . w L(A).
w b w = bx |x| = n 1 A(x) = B(x) + 2.
.
9.1
x {a, b} A(x) = B(x) + 2 x x = x1 x2 A(x1 ) =
B(x1 ) + 1 A(x2 ) = B(x2 ) + 1.
9.4
9.1.
x x1 x2 , x = x1 x2 , n 2
A(xi ) = B(xi ) + 1, i = 1, 2. x1 , x2 L(A).
A w A bAA
A x1 x2 ,
w A.
, a, b A, B .
9.4
context free
9.2
context free.
, .. {0n 1n : n = 1, 2, . . .}.
L . r .
context free .
.
. . r 1,
= {1 , . . . , k }, (
7.19). . r = j j {1, . . . , k},
L(r) {j }, CFG S j . r = L(r) = {}
CFG S , r = L(r) = CFG
S S, .
r 1 ,
, r
r = (st), s, t .
context free G1 G2 L(G1 ) = L(s) L(G2 ) = L(t). CFG L(r) = L(s)L(t)
G1 G2 S,
186
9. CONTEXT FREE
S1 S2 G1 G2 .
CFG L(r) G1 G2
S S1 S2 , S.
r = (s + t).
S S1 S2 S S1 | S2 .
r = (s ). CFG s S1 (
) S | S1 S.
9.5
. DFA NFA
. DFA NFA ( )
, .. {0, 1}
( 7.1).
CFG . DFA
NFA ( ) CFG,
.
9.5
READ HEAD
STACK
9.1:
PDA ( 9.1)
1. NFA .
NFA DFA
.
187
188
9. CONTEXT FREE
READ()
POP()
PUSH(x)
-1
.
x ,
NF .
, ,
, .
L .
NF(x)
0, 1, . . . , x 1.
,
o
, . ,
NF.
NF python
number vector True number () vector ( 1000 , vector[0], , vector[999])
False .
def NumberInVector(number, vector):
location = NF(1000)
if number == vector[location]:
return True
else:
return False
NumberInVector :
number vector NF
, . True.
number vector , , NF,
(
number vector[location] ) False.
NF , -,
.
! NumberInVector
vector
True False, . . True False,
False True.
.
,
. .
9.6. PDA
9.6
189
PDA
L1 = {0n 1n : n = 1, 2, . . .}
L1 = {0n 1n : n = 1, 2, . . .} context free ( : S | 0S1).
PDA . , PDA
python, .
READ(), POP(), PUSH() .
NF().
-PDA . f True ( INP()) L1 False .
. .
. 0
1. .
# .
def f():
SeenOne = False # Have not seen a 1 yet
while True:
letter = INP() # Read next letter
if letter == 0:
if SeenOne:
return False # Reject after having seen a 1
PUSH(0) # Push 0s onto stack
elif letter == 1:
SeenOne = True
if -1 == READ():
return False # The stack has emptied prematurely
POP() # For each 1 pop a 0 from stack
else:
if -1 == READ():
return True # Accept if end of word and empty stack
else:
return False # Reject if stack not empty
190
9. CONTEXT FREE
.)
( input) .
! NF(),
. NF()
( , )
. ,
. .
( ).
def g():
mid = False # We have not reached the middle of the input yet
while True:
letter = INP() # Read next letter
if not mid:
mid = (1 == NF(2)) # Is this letter after the middle;
if not mid: # Have not passed the middle yet
if letter == -1:
return False # Premature end of input. Reject
PUSH(letter) # No, push letter onto stack
continue # Go back to while loop
else: # We have passed the middle
top = READ() # Read top of stack
if (letter != -1) and (top == -1):
return False # Empty stack. Reject
POP() # Stack not empty. Pop top element.
if top != letter:
return False # Letters do not match. Reject.
continue # Letters do match. Keep going.
if -1 == READ():
return True # Stack emptied with no problem. Accept.
mid =
(1 == NF(2)), ( mid True,
) mid False True NF(2).
NF(2) 1 ,
, .
(letter, mid, top)
{0, 1, 1} {True, False}
bits .
9.7
context free ,
context free ,
<
context free.
.
9.3
( context free ) L context free.
n z L |z| n
z = uvwxy,
191
() |vx| 1,
() |vwx| n,
() i 0 uv i wxi y L.
, context free.
9.1
L1 = {an bn cn : n 0} context free
L1 context free. n 9.3
z = a2n b2n c2n L1 . 9.3 z z = uvwxy
. vwx,
n, a c, b
z. a (
c). 9.3 uwy L1 (
i = 0). z uwy u x,
a , a uwy 2n. uwy
6n ( () ),
uwy L1 , . L1 context free.
9.6
9.7
(ab)k (cd)k : k N .
192
9. CONTEXT FREE
[1]
John E Hopcroft, Rajeev Motwani, and Jeffrey D Ullman. Introduction to automata theory,
languages, and computation. Pearson, 2007.
193
194
10
10.1
: (regular)
context free . .
: ( )
(push-down automata) context free .
( context-free)
( )
.
DFA L
( python)
L ( . 1 L 0 ),
,
L. , python
( )
(.. 32 bits ).
, python
, ,
. context free
,
python .
.
10.1
( ) . f :
python P x
f (x).
, .
. k
, , (
R ).
195
196
10.
0 1 . ..
.
.
.
x x + 1 (N N),
x x2 (N N).
10.2
( ) . L
L (x) = 1 (x L)
( 1 x L, 0) .
, .. N .
x
. , (
, )
,
,
.
, .
context free ,
.
( ) (context free ) ( ).
, . context free
(.. xxR )
context free. {an bn cn : n N}.
9.7 context free ,
python an bn cn .
a, b c , b
a c b.
python , ..,
a, . .
. x log2 x , log2 x
( ) x , python
( , context free).
10.1
A, B N A B, A B, Ac .
10.2
.
, f :
N N .
10.2.
197
10.1
f : N N .
, . N N
f1 , f2 , . . . , fn , . . .
( fi =
6 fj i =
6 j,
).
. ,
(
, ).
.
; ,
, , . ,
python
, , ,
, , . 1,
2, 3, ...,
, ( .
).
k ,
k k + 1.
.
.
N N , .
g1 , g2 , . . . , gn , . . .
f (k) = gk (k) + 1.
N N ,
gi , i N f (k) = gi (k) k N.
gk (k)+1 = gi (k). k = i . (
.)
, , , . ,
.
, ,
, , , ,
. , 10.1,
198
10.
, .
.
10.2
10.1 N N.
, , N {0, 1} ,
( ).
10.3
Halting Problem. .
,
python ,
python . ; , python
, . .
= {b7 b6 b1 b0 : bi {0, 1}, i = 0, . . . , 7}.
(bytes) (bits)
0, . . . , 255. P
P = w1 wN , w i
wi P
8N
P = b8N 1 b8N 2 b1 b0
,
(P ). , n ( )
8, 8k. k
.
python (n), , (n) return
True. ( .
.)
P (P ) ( ,
),
n (n) ,
, .
. (P ) , (n)
python .
( ) python .
compilers interpreters () python
.
. : S(n, x, t) ()
P = (n) () P (x) t
t . P (x) S(n, x, t)
. python
interpreter
(loop) .
.
, P , P P P
P .
10.2
H(n, x) =
1 ((n))(x)
0 ((n))(x)
H(n, x) P
. Q(x) P :
def Q(x):
if P(x, x)==0:
return 1
else:
while True:
x = 1 # This does nothing and runs forever
Q(x) ((x))(x)
.
Q((Q)); ; (((Q)))((Q)) .
((Q)) = Q, Q((Q)) ,
. H .
, , H(n, x)
(n) input x .
10.1. H(x)
, , , .
, .
200
10.
1.
( )
X
P (x1 , . . . , xn ) =
cj1 ,...,jn xj11 xjnn , cj1 ,...,jn Z,
0j1 ,...,jn D
() , . x1 , . . . , xn
P (x1 , . . . , xn ) = 0.
Z ..
2. ( ),
. x1 , . . . , xn R .. P (x1 , . . . , xn ) = 0,
.
3. , ( 1) , .
10.1 .
10.1:
. , ,
. , 10.1 (: tiling) ,
, ,
.
. .
.
10.4
(..) .
10.3
10.4. (..) .
201
( ) A N (..) P (x) A, .
A = {P (1), P (2), P (3), . . .},
A . , a A
n N, , a = P (n).
10.1
, , 10.3, N
, .. , .
.. , 6= A N Q(x) Q(x) = 1 x A.
A (m , .., A):
def P(x):
if Q(x):
return x
else:
return m
10.3
A, B N .. A B, A B.
.. .
,
A = {x N : (x) }
( ,
) .. . x N (x) . ,
A, .
1: () (1) 1 .
2: () (1), (2) 2
...
k: (1), (2), . . . , (k) k ,
.
k (1), . . . , (k)
k , x .
x (x) ,
x (. A). x A
(x) t x max {x, t},
.
:
10.3
.
202
10.
( ) (context free ) ( ) (.. )
.
.. .
10.4
A N A, Ac ..
A Ac , .. ,
A, Ac .., P Q , .
A = {P (1), P (2), . . .}, Ac = {Q(1), Q(2), . . .}.
R(x), P Q , 1
x A 0 .
def R(x):
i=1
while True:
if P(i) == x:
return 1
if Q(i) == x:
return 0
i = i+1
P A:
A = {P (1), P (2), . . .}.
Q(x) :
def Q(x):
i=1
while True:
if P(i)==x:
return 1
i = i+1
10.4. (..) .
203
Q(x) 1 x P ,
.
10.5 .
10.4
10.5 .
204
10.
[1]
John E Hopcroft, Rajeev Motwani, and Jeffrey D Ullman. Introduction to automata theory,
languages, and computation. Pearson, 2007.
205
206
11
Ross 1976, Grinstead and Snell 2012
Hoel, Port, and Stone 1971.
11.1
11.1.1
: .
: () ()
N .
1/2. p .
. . N
pN . p
[0, 1].
11.1.2
: .
: 1 6.
N
2 N /6 . . 2 1/6.
1 3 .
() ()
.
( )
1.
:
N 1.
11.1.3
: ( ) .
: (x, y) x, y .
(,), (,), (,) (,) 1/4.
N
207
208
11.
,
, .
(,) 1/4.
11.1.4
: , .
.
: N , N = 1, 2, 3, . . ., .
, .
N = 1,
N = 2, . ,
N = 1 1/2 ( 1/2), N = 1
.
N = k, k, 2k .
1:
2k = 1.
k=1
(
) z = 1/2:
X
1
zk = 1 + z + z2 + z3 + =
,
(11.1)
1z
k=0
11.1
PN 1
k=0
kz k = z + 2z 2 + 3z 3 + + (N 1)z N 1 .
1.20.
11.1.5
:
.
: t 0.
.
t.
( ). ( N )
, .. 2 3 . .
2 t 3.
11.1.6
: .
. .
: H W . 0 H 2.5 () 0
W 300 ().
11.2. , ,
209
(H, W ), H W
. 11.1.5
.
11.2 , ,
.
11.1
( ) .
.
p
.
11.2
= {1 , 2 , . . .} . p : [0, 1]
||
X
p(j ) = 1.
(11.2)
j=1
|| ||.
, , ,
11.1.5
() (11.2)
p .
.
11.1
( . ) (
11.1.1) = {K, }. p(K) = p() = 1/2.
11.2
11.1.2 = {1, 2, 3, 4, 5, 6}
p : [0, 1] , . p(1) = p(2) = p(3) = p(4) = p(5) =
p(6) = 1/6. 1/6 (11.2) ()
.
11.3
( ) p : [0, 1]
.
, .
210
11.
11.3
11.1.4 = N {} = {1, 2, 3, . . . , }.
:
( ) .
p : [0, 1]
0
=
p() =
2
. p(1) = 1/2
,
1/2.
= , 0 .
, ,
0 ,
0 = N.
11.4
() , . P().
A
A.
11.2
|| = n < |P()| = 2n .
p : [0, 1] (.
). ,
, .
11.5
( ) p : [0, 1]
P : P() [0, 1]
X
Pr [A] =
p(a).
(11.3)
aA
Pr [A] A p(a)
A.
11.4
(11.1.2) A = {2, 4, 6}
.
Pr [A] = p(2) + p(4) + p(6) =
1 1 1
+ + = 1/2.
6 6 6
11.5
11.1.4 A = {1, 2, 3}
.
Pr [A] = p(1) + p(2) + p(3) =
11.3
1 1 1
+ + = 7/8.
2 4 8
11.1.4 A = {2k : k = 1, 2, 3, . . .}
. Pr [A].
1.20.
11.2. , ,
211
11.1
A B . A B
A B ( ).
A B A B.
11.4
11.5
11.1.3
.
11.6
, , .
, ,
, .
;
;
: ,
, .
11.6
( )
N = N {} = {1, 2, 3, . . . , }.
n N n . ..,
N
X
an
n=1
N N, .
11.1
(m N):
1. Pr [] = 0, Pr [] = 1.
2. Pr [Ac ] = 1 Pr [A], A.
3. () A1 , A2 , . . . , Am
m
m
[
X
Pr
Aj =
Pr [Aj ].
j=1
(11.4)
j=1
4. () A1 , A2 , . . . , Am , ,
m
m
[
X
Pr
Aj
Pr [Aj ].
(11.5)
j=1
j=1
5. A B
Pr [A B] = Pr [A] + Pr [B] Pr [A B].
(11.6)
212
11.
(11.3) (11.2).
4 (11.3)
,
p(x)
S
x m
A
,
j=1 j , p(x) Aj x .
p(x) 0.
5 :
p(x) x A B Pr [A] + Pr [B] p(x)
x A B p(x) . Pr [A B]
.
11.2
( )
A B Pr [A] Pr [B].
Pr [A] > 0 = A 6= .
, 0,
, , ,
.
.
11.7
Ai , i = 1, . . . , m, m N, Pr [Ai Aj ] = 0 i 6= j
( Ai Aj = )
"m
#
m
[
X
Pr
Ai =
Pr [Ai ].
i=1
11.8
i=1
A, B, C
Pr [A B C] = Pr [A] + Pr [B] + Pr [C]
Pr [A B] Pr [B C] Pr [C A] + Pr [A B C].
11.6
A B , Pr [A] = 3/4 Pr [B] = 1/3. Pr [A B];
.
.
1
1
Pr [A B] .
12
3
11.1
1
Pr [A B] = Pr [A] + Pr [B] Pr [A B] Pr [B] = ,
3
11.2. , ,
213
Pr [A B] Pr [A]. .
Pr [A B] = Pr [A] + Pr [B] Pr [A B]
3 1
1
+ 1= .
4 3
12
Pr [A B] 1.
11.9
c
m
m
[
\
Aj =
Acj
(11.7)
j=1
m
\
j=1
c
Aj =
j=1
m
[
Acj
(11.8)
j=1
(11.7). .
x ,
c .
S
Sm
x
/ m
j=1 Aj . x
j=1 Aj x
c
Aj . x Aj , ,
. ( ) x
.
(11.7) (11.8) ( (11.8) (11.7)). ,
A (Ac )c = A
Aj (11.7) Acj (11.8).
11.10
A, B, C . , A, B, C , :
1. A.
2. A B C.
3. A, B, C.
4. A, B, C.
214
11.
5. A, B, C.
11.11
A
B C.
A B.
11.12
.
4; ;
11.13
. ,
. .
.
: () , ()
,
() .
:
1. .
2. .
3. .
;
11.2.1
: R .
: (x, y) .
, 11.1.5 , , .
A B, . ,
.
A
Pr [A] = ( A) / R2 .
p : [0, 1] ; p(x) 0,
.
p.
.
p : [0, 1] Pr [] (
):
1. 0 Pr [A] 1 A.
2. Pr [] = 1
3. A1 , A2 , . . . Pr
hS
i P
Aj = j Pr [Aj ].
11.3.
215
11.2.2 0
11.7
A Pr [Ac ] = 0. Pr [A] = 0.
( .) 1.
11.7
11.1.4
, , , 0.
11.3
() Ai , i = 1, 2, . . . , m,
.
. 0 0.
() .
11.14
Ek , k 1, Pr [Ek ] 0. E =
.
k1 Ek
11.15
E , k 1. E .
11.16
k
Ak , k 1.
\ [
[ \
lim sup Ak =
An lim inf Ak =
An .
k
k1 nk
(11.9)
k1 nk
lim supk Ak Ak
lim infk Ak Ak , . k0
Ak , k k0 .
11.17
Ak , k 1,
Ak .
k=1 Pr [Ak ]
<
11.3
: 1 10.
.
: X 5. ( , X 5 , ,
. X 5 .) X
.
X 5 = {1, . . . , 10}
p(x) = 0.1 x . X 5
5 10, 1/6.
11.8
( )
A, B, Pr [B] > 0. A B
Pr [A | B] =
Pr [B] = 0.
Pr [A B]
.
Pr [B]
(11.10)
216
11.
11.8
, A = {X 5} B = {X o}
Pr [A | B];
(11.10) A B = {2, 4} Pr [A | B] =
2/10
2
5/10 = 5 . 5
.
11.18
A Pr [A | A], Pr [A | Ac ], Pr [A | ].
11.9
. .
, . .
. ;
A1 , A2 A3
. B .
. .
Pr [A1 B]
Pr [A1 | B] =
.
Pr [B]
A1 B, . A1 B, A! B = A1 Pr [Ai ] = 1/3
. Pr [B] = 1/2
2
. Pr [A1 | B] = 1/3
1/2 = 3 .
11.3
( ) Bi , i = 1, . . . , m, m N,
=
m
[
Bi
i=1
Pr [Bi ] > 0 i. A
Pr [A] =
m
X
Pr [A | Bi ]Pr [Bi ].
(11.11)
i=1
(11.12)
(11.11) , 11.8
"
#
m
m
X
[
Pr [A Bi ] = Pr A
Bi = Pr [A ] = Pr [A].
i=1
i=1
(11.4) Pr []
A Bi ,
E (F G) = (E F ) (E G).
(11.12) m = 2, B1 = B, B2 = B c .
11.3.
217
11.9
()
.
11.19
(11.11) , Bi
0, Bi (11.11).
, Pr [A | B] , Pr [A | B]Pr [B] =
Pr [A B] .
11.4
Bi
Bi .
11.5
S
Bi , i = 1, . . . , m, m
i=1 Bi = \ E, Pr [E] = 0. .
Bi , ,
, E, 0.
. 1 ( )
Bi .
11.20
11.5 Bi
Bi .
.
Bi
Bi .
11.10
, 30%, 50% 20% .
2/3 .
, ;
Ar , Ag , Ab , .
:
Pr [Ar ] = 0.3, Pr [Ag ] = 0.5, Pr [Ab ] = 0.2.
H
Pr [H] = Pr [H | Ar ]Pr [Ar ] + Pr [H | Ag ]Pr [Ag ] + Pr [H | Ab ]Pr [Ab ]
=
1
2
2
0.3 + 0.5 + 0.2
2
3
3
= 0.616
11.21
.
;
.
218
11.
11.4
11.10
( ) A B Pr [A B] = Pr [A]
Pr [B].
Aj , j J, ( J ) ,
Aj1 , . . . , AjN , :
Pr [Aj1 AjN ] = Pr [Aj1 ] Pr [AjN ].
11.6
A B
Pr [A | B] = Pr [A].
Pr [B],
0. B
A . . .
, , ()
Pr [B] > 0, () A B
() .
11.22
A B Ac , B Ac , B c .
11.23
Pr [E H] = Pr [(A B) (C D)]
= Pr [(A C D) (B C D)]
= Pr [A C D] + Pr [B C D] Pr [A B C D].
11.4.
219
220
11.
11.8
, , . .
n .
= {(x1 , . . . , xn ) : xi {K, }}
p : [0, 1]
11.11 .
n = .
,
p : [0, 1] ( 11.2.1) Pr []
11.2.1. .
11.24
11.11
11.14.
11.25
n . n 2
11.26
n .
, Aij i- j-
, i < j, i, j = 1, 2, 3.
.
11.27
N ,
;
11.28
R.
, . A B
A B . 11.2.1.
.
11.15
11.1.4 k
, k 1.
, .
Ak k , k N.
Bi Gi i- , ,
i N. (
, Bi Gi i N.
: ,
, .)
k N
Ak = G1 G2 Gk1 Bk .
. k k 1 .
11.4.
221
G1 , G2 , . . . , Gk1 , Bk .
Pr [Ak ] = Pr [G1 ]Pr [G2 ] Pr [Gk1 ]Pr [Bk ] = 2k .
A , . , ,
, ; k N
A G 1 G 2 G k .
(11.13)
A
k , k N. ,
(11.13) 2k , , k N, Pr [A ] 2k ,
Pr [A ] = 0.
11.16
10 . 6;
E 6, Ei , i = 1, . . . , 10,
i. Ei E, Pr [E] =
P10
i=1 Pr [Ei ].
Aki , k = 1, . . . , 6, i-
k.
\
Ei = (A61 )c (A62 )c A6i (A6i+1 )c (A610 )c = A6i (A6j )c .
(11.14)
j6=i
. Ei 6 i-
6. (11.14)
,
9
5
1
,
Pr [Ei ] =
6
6
A6j 1/6 (A6j )c 5/6, j.
P
5 9 1
Pr [E] = 10
i=1 Pr [Ei ] = 10 6
6.
11.29
10
5 9 1
6
6
1 .
11.17
. Xn , n = 1, 2 . . ., Xn {1, . . . , 6}. 6; E
.
Ei , i = 1, 2, . . ., 6 i- .
Pr [Ei ] = 5/6 i 6;
Ei , i = 1, 2, . . ., 6 i- .
Pr [Ei ] = 5/6 i.
T Ei Ei . E =
i=1 Ei ,
Pr [E] =
N
Y
Y
(5/6) = lim
(5/6) = lim (5/6)N = 0,
i=1
limN N = 0 ( ) || < 1.
i=1
222
11.
11.18
Xn , n =
1, 2 . . ., Xn {1, . . . , 6}. 1,
2, 3; (
123 X1 X2 X3 ;) E
.
Ei (Xi , Xi+1 , Xi+2 ) =
6 (1, 2, 3), .
i-
.
T
E =
E
.
Ei
i=1 i
, , , Ei Ei+1
i + 1.
Pr [E] = 0 E3i , i =
1, 2, . . ., ,
E
E3i .
i=1
Q
Q E3i i 1, p. Pr [E]
Pr
[E
]
=
3i
i=1
i=1 p = 0.
11.30
p 11.18.
11.31
11.18 Xn Xn
( ) {1, . . . , K} Xn ,
w1 , w2 , , wn {1, . . . , K} ,
Xn , 0.
11.32
0 an 1 .
0=
Y
i=1
i=1 (1
an = lim
N
Y
an
i=1
an ) = .
2(x 1) log x x 1,
x 1 ( (0,1)
).
11.33
En
En .
n=1 Pr [En ]
= .
11.32
11.9
11.17 11.33 Borel-Cantelli.
11.34
11.4.
223
.
/ .
.
, .. 10.000 , , . ,
,
.
.
( ) .
,
( , ).
. , ,
.
. .
.
11.35
f (x1 , . . . , xn ) , d , S R
.
X1 , . . . , Xn S S.
d
Pr [f (X1 , . . . , Xn ) = 0]
.
|S|
n.
, .
11.1: 11.36
11.36
N N 4
( ).
p,
, . ( 11.1.)
224
11.
E
(
).
E p.
( p p). .
11.5 Video
11.1
(video , 4:00 ).
11.2
(video , 8:48 ).
11.3
(video , 8:24 ).
11.4
(video , 8:24 ).
11.5
: (video , 8:24 ).
11.6
. (video , 7:24 ).
11.7
: . (video , 5:04 ).
11.8
: n . (video , 10:45 ).
11.9
: n . . (video , 9:51 ).
11.10
: . (video , 9:36 ).
11.11
liminf limsup . (video , 13:30 ).
11.12
. (video , 8:39
).
11.13
. (video , 6:49 ).
11.5. VIDEO
11.14
: . (video , 8:39 ).
11.15
. (video , 9:58 ).
11.16
Bayes. (video , 10:45 ).
11.17
: . (video , 14:27 ).
11.18
. (video , 7:34 ).
11.19
. (video , 5:47 ).
11.20
. (video , 22:28 ).
11.21
. (video , 11:35 ).
225
226
11.
[1]
Charles Miller Grinstead and James Laurie Snell. Introduction to probability. American
Mathematical Soc., 2012.
[2]
Paul Gerhard Hoel, Sidney C Port, and Charles J Stone. Introduction to probability theory. Vol. 12.
Houghton Mifflin Boston, 1971.
[3]
Sheldon Ross. A first course in probability. Macmillan, New York, NY, 1976.
227
228
12
Ross 1976, Grinstead and Snell 2012
Hoel, Port, and Stone 1971.
12.1
12.1
, X1
1 (X1 {1, . . . , 6}) X2 2 . X = X1 +X2
. X, X1 , X2
. , ,
.
12.1
( )
() . X : R X : Z
X X : Rd X : Zd X
.
X : T T X
.
A f : N A
A. , A
a1 , a2 , . . . .
.
N, Z,
S Q, A B, A B
,
j=1 Aj , Aj .
.. R (a, b), a < b.
, .
1.8 .
12.1
(
) X1 , . . . , Xn
1 , . . . , n R Z = 1 X1 + + n Xn .
.
j
. ,
P Xj , j =
1, 2, . . ., Xj 0, 2
, Z = j=1 Xj
, Xj ,
229
230
12.
( Xj 12.4
)
P (0, 1)j . ,
x (0, 1) , x x =
j=1 xj 2 , xj {0, 1},
Z = x Xj .
12.2
12.1 . Z = (X1 , X2 )
{1, . . . , 6}2 .
12.3
. ()
[0, ).
12.4
( p (0, 1)) X
. {1, 2, . . .} , .
12.2
, ..
( ),
, 1 0 ,
.
.
,
, , ,
.
( 11.2),
. p : [0, 1], .. p()
. X : T (T ) X
T , X(). .
( ), ,
X() T . T
p : T [0, 1]
p(t) = Pr [ : X() = t].
X
T , X.
.
, T ,
, .
12.2
( ) X T
X fX : T [0, 1]
fX (t) = Pr [X = t].
( ) X R X
FX : R [0, 1]
FX (x) = Pr [X x].
12.1.
231
12.3
FX ( )
limk FX (k) = 0 limk FX (k) = 1.
X Z n Z
FX (n) =
n
X
fX (k).
(12.1)
k=
n= fX (n)
= 1.
12.4
X x
X . FX (x) = FX (bxc)
FX .
12.3
( ) X Y .
12.5
X Y X() = Y () . .
X Y . . ,
( ) . ,
X Y ,
X Y
.
12.5
X {K, } p (0, 1)
X fX : {K, } [0, 1]
fX (K) = p, fX () = 1 p.
12.6
X Z
1/6 n {1, . . . , 6}
fX (n) =
,
0
232
12.
12.1
R c c.
;
12.9
X () T Pr [X = t]
t T . 1/|T |
T .
12.2
X [n] Y = 2X fY FY .
12.3
X Z fX . fX
:
1. {X 0}
2. {X o}
3. {|X| 100}.
12.4
Y = X + b, b , fY , FY , fX , FX .
12.10
p (0, 1). X
. X {1, 2, . . .} {},
. (
, .. . .
X = 0 X = .) Xi = 1 i-
Xi = 0 . , n = 1, 2, . . .,
fX (n) = Pr [X = n] = Pr [X1 = 0, X2 = 0, . . . , Xn1 = 0, Xn = 1],
, {X1 = 0}, . . . , {Xn1 = 0}, {Xn = 1},
fX (n) = Pr [X1 = 0] Pr [Xn1 = 0] Pr [Xn = 1] = p(1 p)n1 ,
(12.2)
n 0 fX (n) = 0. {X = } {X1 = 0, . . . , Xk = 0}
k 1, (1 p)k ,
0 k,
fX () = Pr [X = ] = 0.
X.
X , . ,
X X
Y = X 1 (X ) =
,
0
X (
) Pr [X 6= Y ] =
12.1.
233
Pr [X = ] = 0. (12.1). n 0 FY (n) = 0.
n 0
FY (n) =
n
X
fX (k)
k=
n
X
p(1 p)k1
k=1
= p
n1
X
(1 p)l
l=0
= p
1 (1 p)n
1 (1 p)
= 1 (1 p)n
(: l = k 1, : . ).
(12.2) p.
12.11
X [0, 1], X
[0, 1]. A B [0, 1] Pr [X A] =
Pr [X B].
X , .
X ,
Pr [X [0, x]] = x. x 0 FX (x) = 0, x 1 FX (x) = 1
0 x 1 FX (x) = x.
12.12
N p (0, 1) X
. X {0, . . . , N }. fX (k) =
Pr [X = k], 0 k N , . B [N ]
k, B B
EB = { t t B}.
EB , B B, {X = k}.
B B EB pk (1 p)N k EB
k B
N k , . |EB | = Nk
N k
fX (k) =
p (1 p)N k , (0 k N ).
(12.3)
k
FX (k) 0 k < 0 1 k > N . 0 k N
k
X
N l
FX (k) =
p (1 p)N l ,
l
l=0
.
(12.3) p N .
234
12.
12.5
n . X .
X.
12.13
> 0 ,
f (n) = e
n
1 (n 0)
n!
(12.4)
Poisson . (12.4)
ex =
X xn
n0
n!
x R.
12.6
X p. X .
12.7
2
X p C . Y = X1 (X C)+
C1 (X > C). Y .
12.4
X1 , . . . , Xn .
x1 , . . . , xn
Pr [X1 = x1 , . . . , Xn = xn ] = Pr [X1 = x1 ] Pr [Xn = xn ].
.
12.6
Xi Ti (X1 , . . . , Xn ) T1 Tn .
Xi
12.8
X Y A B
Pr [X A, Y B] = Pr [X A]Pr [Y B].
12.9
X Y f (X), g(Y ) , f g
.
12.10
X Y Pr [X = 1] = Pr [X = 1] = 1/2. Z = XY .
X, Y, Z .
12.11
X Y Pr [X = k] = 2k , k = 1, 2, . . ..
1. Pr [min {X, Y } n],
12.1.
235
2. Pr [Y > X],
3. Pr [X = Y ],
4. Pr [X kY ], k,
5. Pr[X Y ],
6. Pr [X = rY ], r.
12.12
P
P
f g Z R F =
n= |f (n)| < G =
n= |g(n)| <
X
X
f g(n) =
f (k)g(n k) =
f (n k)g(k)
k=
k=
n Z
|f g(n)| F G.
n=
f, g 0 f g 0 .
12.5
P
() f, g : Z R
n= |f (n)| <
g. f g 12.12 f g.
12.13
f g = g f f (g + h) = f g + f h, .
12.7
12.12 f g , . X Y f = fX g = fY , , , f g
1. f (n) 0, n Z,
2.
n= f (n)
= 1,
f g .
12.1
X Y
fX+Y (n) = fX fY (n),
n Z.
236
12.
fX+Y (n) = Pr [X + Y = n]
Pr [X + Y = n | Y = k]Pr [Y = k]
k=
Pr [X = n k]Pr [Y = k]
k=
fX (n k)fY (k)
k=
= fX fY (n)
(: 11.3).
12.14
X, Y {0, . . . , m}. Z = X +
Y;
1/(m + 1)
12.1: {0, . . . , m}
fX fY fX fX , X Y
( . ). X {0, . . . , m}
1
1 (0 n m) .
fX (n) =
m+1
X
fZ (n) =
fX (k)fX (n k)
k
X
1
1 (0 k m, 0 n k m)
2
(m + 1)
k
X
1
1 (0 k m, n m k n)
(m + 1)2
k
X
1
1 (max {0, n m} k min {m, n})
(m + 1)2
k
12.2.
237
|{k : A k B}| = (B A + 1)1 (A B) ,
fZ (n) =
1
(min {m, n} max {0, n m} + 1)1 (max {0, n m} min {m, n}) .
(m + 1)2
fZ (n) n < 0, 0 n m,
m < n 2m 2m < n.
max {0, n m}, min {m, n},
0
n<0
n+1
0
nm
(m+1)2
fZ (n) =
2mn+1
m < n 2m
(m+1)2
0
2m < n
2m
12.2: X + Y
12.14
fY (n) fX (n) Y = X + t, t .
12.2
12.6
( ) X
X
X
EX =
nfX (n),
(12.5)
n=
(12.6)
n=
, X : T R , T ,
X
EX =
t Pr [X = t],
(12.7)
tT
X
tT
|t| Pr [X = t] < ,
(12.8)
238
12.
12.8
(12.7) ,
, (12.5).
As , s S, S,
X As
cs
X
EX =
cs Pr [As ].
sS
12.9
X (12.5)
. , X ,
fX (n) = 61 1 (1 n 6)
1
1
1
EX = 1 + 2 + + 6 = 3.5.
6
6
6
, X {0, . . . , m} EX = m/2.
: X, , X.
( ) a1 , a2 , . . .
1 a1 + 2 a2 + ,
j [0, 1] j
j = 1.
j=1
P 1. EX =
jZ jPr [X = j] j X, .
Pr [X = j], 1, X
X ( .).
12.15
m
P aj M j x =
j = 1)
j=1 j aj
aj (. j j [0, 1]
m x M.
X m X M
m EX M.
X ;
12.10
(12.6) (12.8) (12.5) (12.7)
(12.6) (12.8) (12.5) (12.7)
, , ,
(12.5) (12.7).
X (12.6) (12.8) ( +),
EX = .
12.16
A X() = 1 ( A) EX.
12.2.
239
12.17
X Poisson ( (12.4)) EX = .
12.18
12.19
X x R, .
f (n) = f (2x n), n Z,
, EX EX = x.
12.15
T {1, 2, . . .}
p, T
fT (n) = p(1 p)n1 1 (n 1) ,
ET =
p(1 p)n1 n.
n=1
n=0
xn
= (1
x)1
nxn1 =
n=1
1
.
(1 x)2
x = 1 p
ET = p
1
1
= .
2
p
p
. .
.
, 12.4 , 12.2 .
.
12.2
X Y , R , Z = X + Y
EZ = EX + EY .
X : T1 Y : T2 , T1 , T2 .
At = {X = s}, (s T1 ),
Bt = {Y = t} (t T2 ),
Cs,t = {X = s, Y = t}, (s T1 , t T2 ).
EX =
X
sT1
sPr [As ] =
X
sT1
X
tT2
Pr [Cs,t ],
240
12.
EY =
sPr [Bt ] =
tT2
X X
t
Pr [Cs,t ],
tT2
sT1
EX + EY =
sT1 ,tT2
Cs,t , s T1 , t T2 , Z
( 12.8).
12.16
12.14 EX + Y
X + Y . X 12.19
EX = m/2 {0, . . . , m} m/2.
EX + Y = EX + EY = 2EX = 2 m
2 = m.
12.17
X ( 12.12) p N ,
N k
fX (k) =
p (1 p)N k1 (0 k N ) .
k
X N
p. , Xj = 1( j )
X = X1 + + XN ,
EX = EX1 + + EXN = N EX1 = N p.
12.18
N ,
. N .
;
X, , .
Xj , j = 1, . . . , N , Xj = 1( j ). ( Xj
. ;)
X = X1 + X2 + + XN .
P
, 12.2 EX = N
j=1 EXj . , , Xj
, EX = N EX1 . EX1 = Pr[ 1 ] = 1/n,
. EX = 1. EX N .
X , ,
.
.
12.3
X ( ) f
T X f (X)
X
|f (t)|Pr [X = t] < ,
tT
Ef (X) =
X
tT
f (t)Pr [X = t].
12.2.
241
12.8 =
tT
{X = t}.
12.11
12.3 (12.6) (12.8)
E|X| < (
+).
12.20
-.
c
. .
j-
(j + 1)- ; c
;
12.4
X Y XY EXY =
EXEY .
X : T1 Y : T2 , T1 , T2 .
12.2
Cs,t = {X = s, Y = t}, (s T1 , t T2 ).
E|XY | =
|st|Pr [Cs,t ]
sT1 ,tT2
|st|Pr [X = s]Pr [Y = t]
sT1 ,tT2
|s|Pr [X = s]
sT1
|t|Pr [Y = t]
tT2
= E|X|E|Y | <
(: X, Y ), XY .
X
EXY =
stPr [Cs,t ]
sT1 ,tT2
stPr [X = s]Pr [Y = t]
sT1 ,tT2
sPr [X = s]
sT1
= EXEY
X
tT2
tPr [Y = t]
242
12.
(: X, Y ).
12.12
X1 , . . . , XN EX1 XN =
EX1 EXN .
12.13
X, Y 12.4. , ,
A B , X = 1A , Y = 1B
( 12.8). XY = 1AB = 1 EXY = 0
EX = Pr [A] > 0 EY = Pr [B] > 0.
12.19
: 0 0
. , . Xj
j Xj {1, +1} Pr [Xj = 1] = Pr [Xj = +1] =
1/2, EXj = 21 (1) + 12 1 = 0. n, Sn ,
Sn = X1 + + Xn ,
, ESn = 0 n.
p 0
n. ESn2
Sn2 = (X1 + + Xn )2 =
n
X
j=1
Xj2 + 2
Xi Xj ,
i<j
i, j = 1, . . . , n, i < j. Xi Xj
i =
6 j EXi = 0
0. EXj2 = 1 Xj2 = 1 . ESn2 = n
0 n.
12.21
n . X
EX.
12.22
n 2n m .
.
12.23
n n .
, . k .
k
.
12.24
X fX (n). X
. . , t,
X b y , y = |X t|. a y.
a, b fX (n) . t
;
12.3.
243
12.25
12.4: 12.26.
12.26
1000 ( 1, 2, 3, , 1000).
, .. ,
20 . (
12.4.)
12.3
12.7
( ) X = EX
2
2
X Var
p[X] = (X) = E(X ) . X
(X) = Var [X].
244
12.
12.14
12.7
X .
12.15
(X )2 0 X
+, X , . E|X| < .
12.27
12.28
EX < Var [X] = EX EX .
12.29
c Var [X c] = Var [X] = Var [X].
12.30
2
Var [X] = 0 X = EX .
12.20
X {0, . . . , m}
2
EX =
m
X
k=0
1
1
k 2 = m(2m + 1)
m+1
6
1.14. EX = m/2 X
m/2. , 12.28
m2
m(m + 2)
1
=
.
Var [X] = m(2m + 1)
6
4
12
12.5
X1 , . . . , Xn
Var [X1 + + Xn ] = Var [X1 ] + + Var [Xn ] .
j = EXj , j = 1, . . . , n. S = X1 + + Xn
= 1 + + n ,
Var [S] = E(S )2
= E
n
X
2
(Xj j )
j=1
n
X
X
= E (Xj j )2 + 2
(Xi i )(Xj j )
j=1
n
X
j=1
Var [Xj ] + 2
i<j
X
i<j
E(Xi i )(Xj j ).
12.3.
245
E(Xi i )(Xj j ) = 0 i 6= j, Xi i
Xj j 0.
12.21
X ( 12.12) p N . X
N
p. , Xj = 1(i j )
X = X1 + + XN ,
Var [X] = Var [X1 ] + + Var [XN ] = N Var [X1 ] = N p(1 p),
Var [X1 ] = p(1 p).
12.6
( Markov) X 0 R
Pr [X ]
1
.
A = {X }. T X ,
EX,
X
=
tPr [X = t]
tT
tPr [X = t] +
tT,t<
tPr [X = t]
tT,t
tPr [X = t]
tT,t
Pr [X = t]
tT,t
= Pr [A].
.
12.1
( Chebyshev) X 2
Pr [|X | ]
1
.
2
- Y = (X )2 EY = 2
Markov ( 12.6).
1
Pr [|X | ] = Pr Y 2 2 2 .
246
12.
12.31
12.32
Eg(|X|)
.
g()
( 12.19.)
Chebyshev Pr [|Sn | > n/10].
12.33
X (12.2) p = 1/2.
Pr [X 10] Markov
Chebyshev .
12.34
. ,
EX 2 (X) X
, .
N (N ) , xi , i = 1, . . . , N .
N
1 X
x=
xi .
N
i=1
, ,
:
N
1 X
S2 =
(xi x)2 .
N 1
i=1
N .
;
12.4
12.8
( ) X N = {0, 1, 2, . . .}
X
X (t) = EtX =
n=0
12.16
12.8 t |t| 1.
12.22
An X = c X (t) = tc .
12.4.
247
12.23
X (12.2) p
X (t) =
tn p(1 p)n1
n=1
p X
(t(1 p))n
1p
n=1
1
1
1 t(1 p)
p
1p
pt
.
1 (1 p)t
12.24
X (12.3) N p,
X (t) =
N
X
n=0
N n
t
p (1 p)N n
n
n
N
X
N
=
(tp)n (1 p)N n
n
n=0
= (1 p + pt)N ,
( 4.4.
12.25
X Poisson (12.4) > 0
X (t) =
X
n=0
tn e
X (t)n
n
== e
= e et = e(1t) .
n!
n!
n=0
12.7
X1 , . . . , Xr Y = X1 + + Xr
Y (t) = X1 (t) Xr (t).
248
12.
12.9
() X1 , . . . , Xr Xi Ni
p Y = X1 + + Xr N1 + + Nr p.
() X1 , . . . , Xr Xi Poisson i > 0
Y = X1 + + Xr Poisson 1 + + r .
() Xi (t) = (1 p + pt)Ni
Y (t) = X1 (t) Xr (t) = (1 p + pt)N1 ++Nr .
N1 + +Nr p ,
( 12.8) Y .
() Xi (t) = ei (1t)
Y (t) = X1 (t) Xr (t) = e(1 ++r )(1t) .
Poisson 1 + + r ,
( 12.8) Y .
12.35
12.36
X X (t)
X (t2 );
12.5
Video
12.1
(). (video , 9:35 ).
12.2
. . (video , 12:51 ).
12.3
. (video , 16:35 ).
12.4
. (video , 19:37 ).
12.5
. (video , 13:02 ).
12.6
. (video , 24:51 ).
12.7
n . (video , 4:52 ).
12.5. VIDEO
249
12.8
m n . (video , 8:04 ).
12.9
. (video , 17:35 ).
12.10
. (video , 10:22 ).
12.11
. . (video , 14:15
).
12.12
. . (video , 12:07
).
12.13
. (video , 13:36 ).
12.14
. (video , 14:29 ).
12.15
. (video , 13:27 ).
12.16
Poisson(). (video , 8:57 ).
12.17
. (video , 7:57 ).
12.18
3 4 . (video , 20:03 ).
12.19
Markov. (video , 17:51 ).
12.20
Markov. Chebyshev. (video , 20:38 ).
12.21
. (video , 4:40 ).
12.22
Cauchy-Schwarz. . (video , 31:38
).
12.23
. . (video , 16:16 ).
250
12.
12.24
. (video , 8:59 ).
12.25
. (video , 17:49 ).
12.26
. (video , 17:14 ).
12.27
. (video , 40:22 ).
12.28
. (video , 12:53 ).
12.29
. (video , 23:16 ).
[1]
Charles Miller Grinstead and James Laurie Snell. Introduction to probability. American
Mathematical Soc., 2012.
[2]
Paul Gerhard Hoel, Sidney C Port, and Charles J Stone. Introduction to probability theory. Vol. 12.
Houghton Mifflin Boston, 1971.
[3]
Sheldon Ross. A first course in probability. Macmillan, New York, NY, 1976.
251
252
2Q ( Q), 151
Km,n , 127
L(M ), 148, 152, 155, 158
L , 146
L+ , 146
LR
, 167
N (J), J, 130
GR , 143
Var [X], 243
-, 159
-, 159
N, 211
(X), 243
-NFA, 157
ASCII, 145
Bose, 86
CFG, 182
, 183
CFL, 183
Cantor, 11
DFA, 146
, 173
, 174
DFA, 174
, 174
, 177
, 177
, 147
, 147
DNA, 86
Dedekind, 11
Egervry, 133
Einstein, 86
Erds, 243
Fibonacci
, 29
Floyd, 120
Gamow, 86
FloydWarshall, 120
Kruskal, 117
NFA DFA, 155
, 55
, 119
, 143
ASCII, 145
, 143
, 65
253
254
(GR ), 143
, 65
, 58
, 200
, 201
, 201
, 202
, 196
, 160
, 23
, 219
, 68
, 63, 64
, 26
Bernoulli, 35
Chebyshev, 245
, 246
Markov, 245
,
32
, 108, 116
, 164, 166
, 42
, 165
, 166
, 166
, 166
, 26
, 66
, 65
, 181
, 32
, 26
N, 146
, 178
, 151
, 152
, 152
, 152
, 151, 154, 158
-, 157
-
, 158
, 158
, 158
, 147
, 147
, 148
, 147
, 149
, 147
, 150
, 149
, 165
, 147
, 147
, 149
, 186
, 187
, 187
, 187
, 187
De Morgan, 22
, 22
, 26
, 233
, 30
, 30, 110
, 32
, 143
Context-Free, 181, 183
, 159
, 148, 152, 158
Context-Free, 185
, 186
, 143
, 145
, 144
python, 145
, 145, 146, 159
, 151
, 165
, 165
, 56
, 143
, 97
, 129
, 137
, 115
Kruskal, 117
, 97
, 98
, 115
, 115
, 110
, 113
, 112
, 110
, 113
, 117
, 112
, 125
, 126
KnigEgervry, 133
, 127
, 128
, 127
, 129
, 101
, 102
,
103
, 103
, 103
, 99
, 115
, 97
, 100
, 100
, 107
, 99
, 133
, 100
, 100
, 137
, 116
, 106
, 106
, 115
, 106
, 106
Euler, 135
Hamilton, 135
, 109
, 115
, 106
, 98
, 106
, 106, 107
, 129
255
, 129
, 101
, 128, 137
, 138
Context-Free, 181
, 182
, 182
, 182
, 182
G
w v, 182
G
w v, 182
, 182
, 182
, 209
, 214
, 69
, 39
, 40
, 71
, 197
, 69
, 51
, 52
,
83
, 83
, 71
n-, 14
, 14
, 199
, 91
, 233
, 53, 88
, 88
, 73
, 74
, 31
, 151, 155, 158
, 17
, 17
, 53
, 210
liminf, 215
limsup, 215
, 218
256
0, 215
, 145
, 28
, 28
, 28
, 28
, 31
, 34
-, 32
, 33
, 162
, 211
, 85
, 21
, 65, 207
, 69
, 69
, 58
Myhill-Nerode, 176
Hall, 35
, 35
, 201
, 40
-NFA NFA, 159
DFA NFA, 154
, 155, 159
, 51
, 231
, 160
, 161
, 161
, 161
, 162
, 65
Bose-Einstein, 86
Poisson, 234
A, 146
, 146, 147, 151, 158
, 151, 158
, 146, 147, 151, 158
, 146
, 52
, 238
Morse, 72
, 143
, 143
, 143
Borel-Cantelli, 222
Context Free , 190
, 191
, 167
, 168
, 168, 169, 174
, 53
, 54
, 23
, 71
, 79
, 20
-, 159
-, 159
De Morgan, 21
, 21
, 20
, 21
, 209
, 166
, 164, 166
, 166
m n, 68
, 39
, 71
, 207
, 207
, 51
, 212
, 65
, 209
, 230
, 230
, 216
, 215
, 215
, 65
, 145
, 64
mod
, 54
, 86
, 200
Laurent, 89
, 20
, 15
, 15
, 198
, 199
NF, 188
, 198
, 198
, 188
, 145
, 37
, 41
, 42
, 42
, 56
, 31
-, 65
, 86
, 145
, 145
, 146
, 23
, 16
python
, 66
1-1, 17
, 70
, 69
, 17
, 74
, 17
, 68
{0, 1}, 68
, 154
, 235
, 18
, 73
, 84
257
, 91
, 39, 40
, 40
, 40
Hall, 36
, 210
, 214
, 211
, 211
, 211
, 15
dom, 16
range, 16
, 16
, 175
, 24
, 23
RL RM , 175
, 175
, 175
, 24
, 15
, 16
, 15
, 39
, 143
, 56
, 11
, 26
, 26
, 19
, 20
, 26
, 27
, 21
Venn, 12
, 23
, 19
, 14
, 21
, 25
, 12
, 20
, 14
, 11
, 21
, 11
, 22
, 26
, 25
258
, 19
, 19
, 19
, 26
, 12
, 12
, 13
, 26
, 35
, 229
, 209
, 42
, 91
, 39
, 14
, 14
Pascal, 91
, 31
, 241
, 240
, 229
, 246
, 247
, 231
, 229
, 229
, 243
, 237
, 243
, 234
,
247
, 244
, 235
, 239
, 242
De Morgan, 42
, 144
, 195
, 195
, 51