Professional Documents
Culture Documents
16 haozhiheng 机器学习的实验设计初探
16 haozhiheng 机器学习的实验设计初探
uR [~f
S O&
China R Conference
, Hm
1 {0
O{0
OXA^ S
uR [~f
2 uR [~f
~1
~2
o O?
R. A. Fisher3X C f O u
.
Xz1 u Ou"m
J S0 Og^ "
X8 . uu . ` OA- O
u5"
O uv ^ 5&l
f-f I"
O u mW O)! O
.N O u"
o O?
Xe 8 L O
'
C
A-&
X`z
X-
More about experimental design, please refer to Wu and Hamada
(2009) and Fang, Li and Sudjianto (2006).
R' % O
Package AlgDesign
Package FrF2
Package rsm
Package lhs
rSw
S^ l "
I8u8"
|^ O5 8"XJ
O @oSk O("
, 3S eA G
p[ "
e5 ^uR [~f5 y
{"
o^R
3RpU A I "
~a COS 4 "
-X = (X1 , . . . , Xp )T f. APY . Y l
. P(Y = 1|x0 ) = F (x0 ) x0 :? Y = 1 V.
Y a>.:
F"UL5 Ol .
e (z)/
F (x|) = , (2)
1 + e (zu)/
= (, , w )T . K Y a>.:
wx1 + (1 w )x2
l (x1 , x2 ) = {(x1 , x2 ) : = log( )}. (3)
1
n i i
!Yi
Y e (wx1 +(1w )x2 )/
f (|Y ) i i
i=1 1 + e (wx1 +(1w )x2 )/
1Yi
1
i i
1 + e (wx1 +(1w )x2 )/
(0 )2
0 e 0 w 0 1 (1 w )0 1 .
2
2
e (5)
d BL4q,{5 O
ALSD
3Sng , O5 a>.Xe:
l,n = {wn x1 + (1 wn )x2 = + log( )}, (7)
1
I (, x) 3:x? X Fisher&E .
[~f
exp( z )
)gF (x) =
1+exp( z )
\lN(0, 0.1)
. )100. K = 0.7, KvF (x) >
x IPaO1K IPaO2.
I :numDeriv
The complete code will not share here. If you are interested,
you can contact me later.
[(J
[(J
[(J
CJ (^5, P.
-A() = {j : j 6= 0, j = 1, . . . , p}, K
cX { . U? O
. McKay et al. (1979) .N (LHS), T
3kC?1 .
Owen (1992) showed that when using the LHS for Monte-Carlo
integration, the estimator is less variate than the estimator from
IID sampling. So we expect that using the LHS for Lasso can
improve the solution. Also, when running a variable selection
procedure, it is better the variables are less correlated so that the
active variables are less correlated to the inactive variables.
Orthogonal Latin hypercube design (OLHD) or nearly orthogonal
latin hypercube design (NOLHD) would be a good choice. We are
also motivated by Fang, Ge and Liu (2002), their result of the
connection between discrepancy and E (fNOD ) in supersaturated
designs maybe helpful here. Supersaturated designs are usually
used for screening designs.
I: lars,lhs
Gendex software is also needed
Also refer to
http://www.math.hkbu.edu.hk/UniformDesign/
[(J
THANK YOU
ANY QUESTION???