빠측 IL " ,

nnzk
: l: )
[(
(a) F(
( x) =
5) 가
t
기 )
I

Ef ( x ) = E (*, (* 지 ,
tzuyX
(
: ]] =
m *
*
EI( " -
측, 어
트 .

지 " )(
4 :)

없 St f
x저 ch 12 )

=
"
n 최미 )
fly ) dy =

니.
(y )
dy

E (5
로

V (* (x )) = (기 ) ) -
E (5 ()
)
ECf ( ) 링 EL ( * )]
쳐
x = - I( ( a;
가 "

) niv )

3]
*
Elnzh 우
n ]
X :] I (
: I( p 4 I(
) (X : (: )
=
-

,
pxtzh
2
+
고
r← , x
+ 차 )( 7 - zn ,
tn

h +[체서 ( I (
E

해 카* , ati * h
,(V :J .
다 [ I[ 2
(
** > (
원하
X :1 I ( rih,
기
tin1
(Xv ' ) ]

태까 n러 ty ↓> )
)
E [I 까*세나 ]) E ( rn .
=
(
.
+
철 . iin( -

1(일떠다 fnb)
-

m] 어까 .
-n
: " ↓) t *
nn

( f ()) E (5()2) E(fix )

=

라 = -

nm러다flph . - Nf) 다다파아했

F

J 까제사 "
(
"[
=
f ] )=
사 *
. nn n

'
없다
Jr -
f
(yLy- (

"
제"

n
t",) )

b) assume f is continuous . und put F be ←

FCx =
dx
) f
(2 )
.
2무 (( 15 ) 5마기
))
, P ( 15
-

by chebyshev c마 )
-f -
12 zE 미 드

) ?

=
(E f[E )-
구카 I

5( n72[
)

+ 2E ~ (
frn ( E 5717 fki E -E )
n)) ( )- )+
( ( Ef (70 fti )) - "

= 2 ( U (5 가
(
)] * E
5( ( 0x )
-fcxx )
E
 tupfcy
htfa npu
-
(
and E 5 17- f

(x ]= ) dy -

f( x ) - ①
-

assume be confinuous and define wih FC 기) =

5cx로
f F
dxd

소 S왔 f * L hz) 터 URF
터*
F -
dy h [ F( 2 n (x) (7
then )] ny
-
-F(
-

1y) 카t
)
=
÷ 2 t
-

!.

- >
( f( x) + fcx ) ) = fCx) us h - ro - So ① - → 0 ash →
-

oa

nm("
xt h /z

and U ( 5( x ) )

~
= nfo unfiy dy h (i *unnthn5
-
) = -

m…
k
-
( " 0

-
3 D -
> 5 c가 ) -
←x .)
75
2

as h -

ooand nh -

rco
,

카
( 5m)+ ( Ef"-*
→ -
( 1f " )
브

.P -5 c라 )( ? E ) ≤ * 0

as
*
V

fr
h -> 0 anz nm - → : 비 E 7
o 에

p
=> 5 cx ) -
→ fcx )
 Kxc 9
(,
1
* 1 *
(
(i 7
(a) h (x) = r ( x) =
P (냐) =

. . Dim
D .
uw

이상 0
[ 가스자 크더스카 2 i n0
do
*
h l)
가

s.

. Koxc "

bC) R
*
= RCh
←
) =
P ( * ( XFY ) ( =
Jp h * (
x ) FyY
) * =
cij fex) dc
) …
D

I
whefc % )
= ⑤
(, 7
Cx
).
put= 01
CA , 0
. 9 ) then
① =
SAP ( h
*
(X ] FYIX 가 0
)
x+ =
SA .
P
( h *cx ty IX] =x ) ido

ht * ( x ) = IA( ) x
,
S,

=
1AP ( Y = . lX t =
)
0 dx f / A
. P ( X -미d 에

=
/ Aooidn tSAco ∞↓ n =[ .
.8) …
.
+
( .b.
"

. tli+ 3
0

. g

터* * .-
* =

01
*
* 0
씨 .
네 = B 7□
,
만
,

β d
pBin
.
(
1 x 5

pipo orl
Kz
BotB
(.
-

,
-

xz
-

Bi
cc h )( ) =
B
' poTB , k
.

. ㅇ xc -
0 ox > -
-

B ,

hcx ) is eqwiwlun T .
I ( xzk ) 가 I ( xEK ) .
pat A =
(이 ,
0 a
) p

Cee 1 ) ILx 크 C )

RFP ( hcx > 4 ) =

P ( = 이 X : KJP (X = K)
tP ( iX < K ) P ( Xck )
"

f
"

량 P (y =
olX = 0 ) dx ( rik ) +

.
P ( (X = x
) du ik

[3
.
+
. . "

( ]( r -
.
(a ) kco " ) R =
..
6 n +
f aodn +
f 71 d . i ) k. udi*
. . . q f

( 1-r
r 9 =
akl
) ii - 1s
n (
8
0(
- .8
( 1 - 1 ky
0
.

) +
t 1 0- k
)

=
k
r t kk
t 0 (

oi tb ,
4 tnl
 = 0 k ttris
2s -

)
1
k
x
(
2

= 10 k - 29 6 .
K + 156 = 2

-
.

1
Lp .
.

10 .

d. . .

(I . ]( )c
.

( b) (
0 . 이 ≤ KEn ) R =

.
. dntf
a "
1 dn - i )
+[ )
제 .
adctf .
" z 6i

=
1 lir9
↓
- k

)+
ii( o - in ) ) ( 나 l aiit * ( ) ) 5
음의 +
.
k
-
2

. ktuk
163 " .- in
kzf
-

여 이인
1
-
63
-
.
. . V
(
-
ik ) (

+
n
+ iik . 사) =
-
1
-

(. .
8
63 )
ti kt .
8

-
=
=
1
k
990
k t
.
2
-
-

. 0
= 000
1 O

ll * +ll
.
+
. n n

(c) ( ko . a ) R = " . 1
dn ] ( ri ) .9
" dn
f
:
dn f
.
. "
.
adbnc
)
e
lirai ti . ( k -. ) )
9 a

=*
-
( 1 o
-k ) (1 10 + .
6
t "

. - s
6 i okzz 256 00

= .( 10- 2 ktiicz )
+ li
.
9n
- )
k
= 1 1
~↓
1
o . .
- -

i . 0

dkR "
씨… ca )

(
= 0
t
때
02 C
(
이.
.
" 다때
다
 hi argmin ( Y
'

la ) for each h :) +↓a :

로
i = ,
n = .
-

t
…
,
P:
z
p( 4
2
=> -

2ki
c fh :( txh
-
:
2 )
=
- 2( -M
E 의 +2
xfhcZN .
( ) = 2 +2 x > 0

So
axi
(L( : Ki
② - )
'- XH: )Iai=oi = 2( Hxli -2 : = 0<> ui =
**
1 +

yields grolbul ninimun- >ui *.

= ,
1, z
" … n
.

( b ) fov mi urgmin (4
aiu 2 txlu : ≡ avyminv
each : 의 ,
" n
= :
-

) LiCac )
, , :
=

Uc 7 O L: 또 Ca ) = (c : d: ] p fxHi
-

L
.ca. li- :) + X -2
ahi ) = - 2
( u

X = 2 :
+ x-
2 :
> 만

Lich:) =
]

:< o : ( : -h: - λfa :

*
ak
L : LH . ) = -
2 ( y. -
Ki ) - λ = 2Mc -
A -
24: < - A 2
Y:

: ( m. ) la
. Licuiil
L
=> - X - 2
Y . <λ -
2. 짱
ahcr :c . S
<
: ' o

)lai=hi
.
) c4 thenfuvi makesshir Li
- (oa :
cusel : co : - 2
70
=
X

o
=
Y
:
2
and -

aK :
z
L . Um
:
Im .. = 270 =⇒ L
: mi )is l, cnl minimnmm

and since ( L . Duicjp and

-
Xlh : l un bth onvex ,

sol . (h: ) = [ i- ta: p+ λ la: 의 is alss onvex ,

So local mininmm

is globul mininm ,
=>fvi =
Y
← -* i5 Y . 차

case 2 )
- x -
24 :
.
20 thenai =Ydtz
o *
mukes
c )
Li(K : o
lai=ki
=
sx :

22
and -

2
L : (k: ) m = 220 L : ( ui) is lbcul nivinumans globu 케 min
2M: , k .
.

⇒ i =
et * if :S - 차
cae 3
) -
X -
2Y
:
<o < X -

29 : then -

akt
a L: Ca :
lD: k.
<o <
L
ani
나(
hv 기다 .. .

=> ( Xlh inhi <

p
. -
θi] + : 의 is strictly decreasivy o …

D
 2
②
end stvictly incrajuy ( Y = R ) ptfluil
indh : so .
since -
: is

continurus ,
5 ~ om Dand ②
2 ui = o
yields global minimumm
,

=> ai = o if - KY : < <= 기 : 1 < 차

genermlly , fhi .= )
sign ( * -L ) IY
. π ( IY :
17
*
) "
, … "

f uc argmin ( l
)

CC ) 0 v each 더 ,
… ,
=
←
-

u: + ☆ ICa = Fo )
n
hc

i 5 Y: ( y : a : ] +↓ I (HiF )
'
(
= 0
,
. =
uizt NI acF . ) S 0

fai =
o 부
=
- svafhi = argmn .Mcz argmin = λI(
u : Fo )
.

if = o consider µc
F
, = o
arh : Fo

case 1 )
kFa, M := . ⇒ ( yc DipfxI cu: Fo
-
) = Y *2 hi
& = .

casc 2 ) Y :Fo . h :F ) ⇒( Y -a:

.
)

<+ , IchiF. ) = (Yy- :p + X

⇒
ai =
argmin(( y - Mi ) rt ↓ ) = argmin [ y .
-

hip =
G
LiFO H= FfO
+
> ( 4. -
dip I*) ( aito ↓

Yi = YKX < ⇒ hi
>
S 0
x
. Ki
= , > : = o

=→ui EI ( Y: . I l 11 ), ,
=
2 X) = = …
n
.

2 .
여
 g

-sosn

-
~
o 0 o

* assune XCFX * ,
려고

ficx
)

c n 크 I (.) =
" 예충
0
1
X :
S . c 7여 *( E
dX : S ← x = *: 승 닭 I( x =
di ) -
0

.
*

출"I 여) ≡ I
then
+
Pu (
ix ,

f .
( 기 ) =
닭소 +1 ( I (=← ) Y .
)( " V -I *,) " ic
n
z비지
=
찾어 ( I
*
n, I( x =. ) +
바 ] Y: : l: (x ) =
( Ʃ
=
Ix =X :) ]( 니) i) + t

(b ) L = I

CC ) =
tvCC) =
tvCI) = n
v

6]
(d cae ( I ] : xGEX " : L로 => x= Xk fovsom k

=→ fic x ) =
q .
bias= ( E (f* (a ) - f
(xx)' = ( E (Yc ) -

f ( xx )
로

그
( E (f ( X. ) + Ec ) -

f ( Xc ) ) = ( f< Xk ) -
f ( xa ) ) = 0

vaviunce =
Elf( i ( 기 )- E

( fr. ") )] = ELY (. -

E

( y .l ) ] = ECEcy
= UCEc ) = G2

case a) : x 134 " ,

X 서로 => frix ) =
두
)

bias =
[ E (ficn ) ) -
fcm ) = ( E ( π ) -f ( y ) = :
마도타이녀 fuc " -

(" 측 (X : i )
=
= -

fcxx)

(jfnr(
)
vuriauce = E x)
- E(fii"(P ] = El
π -C E ( π ) ] ] =EC 없도는녀
( ]
E

=
XE
둥시 (E +
=
( Ei .ni ( n
)l ?
끝 6 p ) =
함
-
 Z
(6
Vcxx >

buyes rule P ( IX )
*

L = whve rcx) = =x

Diw
5 cx 로 f
P(XFx 녀) P (며 ) )
,
cx )

-
1

Fanitf
=
( tfonM
~

P (x pllP (1계 FP . u f = 7
=
(X==기 pi ;= ( *

So rcx ) > 2 =→ fi (x > f . (

x ) and R
=P ( h *(X ) FY ]
P(h ( X ) 계=) P (h
* *
=
P (Y -o ) + (X = 이며 ) P ( 디 )
= * CE ( I (X 1 Y = 0 ) +
EL ( I- I (x ] IY
며
) ](I = x (
) I( f
.(1 ) ' f )
. =
I (rcxpz))

=
황*( I
f 5
. pxdct + y .

f 그
ficond] …

= * -

*
f
(기오
fic . )d 00- f

c
"'

and = t - =ffc dn 5 .bodn ffican

" - f
= - focnidc

=
f 2
fum - f .
(n) d " +
Szfic f d cu - ,
( n) 승

=> J[ f
.c ) -
f .
cn ) dn I . ,d =

.
f
ca ) -
f

( 가

since fica 7 -
f .
c 170 if xEI , f .cn 7 - xf : 0 : f
,
. xGIC

⇒
/It .cn - f
.c " 7 dn = S
도 Ifi (7 - . " d=
f
(
다
. 1 ficn ) -
f .
n 에 d김

=
* ( 5zl 사 .
n " -
f
. nnl ↓ n
+
fz .ltun -t
. onnk . ) =* S
1. " - 5
. "기
네
" .

- i )z + 크 - 451 .
*
k = i
6u -
f .
n7 kn = 게
- ' 다
"