Professional Documents
Culture Documents
flon.T nTTd.
G'A,d' 8 9//d')m9/dB99ipq 3)I1YNBq(
o SSI4NlENT 3
o)o)o hNrT?2bTInNrc
xOUR iUPYTER NOTEBOOj ASSIGNMENT WILL OFTEN HAuE t ELEMENTSc WRITTEN ANSWERS: CODE ANSWERS: AND QUIy
ANSWERS% =OR WRITTEN ANSWERS: YOU MAY INSERT IMAGES OF YOUR HANDWRITTEN WORj IN CODE CELLS: OR WRITE
YOUR ANSWERS IN MARjDOWN AND kA/Ew% =OR QUIy ANSWERS: YOUR 'dC9',)/X/ LE WILL RECORD YOUR ANSWER
CHOICES IN THE QUIy MODULES FOR SUBMISSION% aOTH YOUR QUIy ANSWERS AND CODE ANSWERS WILL BE AUTOGRADED ON
4RADESCOPE% /HIS ASSIGNMENT DOES NOT HAuE THE QUIy PORTION%
=OR ALL ELEMENTS: ,9 m9/ l9,-=x /gd bdkkr% 1UT YOUR ANSWERS nNLY IN THE ANSWER CELLS GIuEN: AND
:n NnT :ELETE bELLr% -F YOU FAIL TO FOLLOW THESE INSTRUCTIONS: YOU WILL LOSE POINTS ON YOUR SUBMISSION%
lAjE SURE TO SHOW THE STEPS OF YOUR SOLUTION FOR EuERY QUESTION TO RECEIuE CREDIT: NOT JUST THE NAL ANSWER%
xOU MAY SEARCH INFORMATION ONLINE BUT YOU WILL NEED TO WRITE CODE6ND SOLUTIONS TO ANSWER THE QUESTIONS
YOURSELF% xOU WILL SUBMIT YOUR %IPYNB LE AND RECORD%TXT TO GRADESCOPE WHEN YOU ARE NISHED%
) REDUCTION FOR THE RST DAY AND oz) REDUCTION AFTERWARDS FOR EuERY EXTRA DAY PAST DUE%
xOU COULD USE INLINE k /dw IN MARjDOWN pRECOMMENDED( OR USE MARjDOWNS” INCLUDE IMAGE FUNCTIONALITY TO
SUBMIT YOUR WRITTEN RESPONSES%
i sdw P?EbnMMEN:E:( gERE IS A FANTASTIC TUTORIAL FROM bAL/ECH ABOUT USING k /dw IN iUPYTER mOTEBOOj%%
xOU COULD ALSO ND uARIOUS k /dw TUTORIALS AND CHEAT SHEETS ONLINE%
hNbL2:E hMA5Er -F YOU ARE STILL GETTING FAMILIAR WITH USING kA/Ew: HANDWRITE THE RESPONSE ON PAPER OR THE
STYLUS% /AjE A PICTURE OR SCREENSHOT OF YOUR ANSWER: AND INCLUDE THAT IMAGE IN THE iUPYTER mOTEBOOj% aE SURE
o
TO INCLUDE THAT IMAGE IN THE bIMGr DIRECTORY% kET”S SAY YOU HAuE YOUR +o RESPONSE SAuED AS IMGr6+o)1NGs
THE MARjDOWN SYNTAX TO INCLUDE THAT IMAGE IS =\+o[pIMGr6+o)1NG(%
xOU MUST CHECj BOTH SUBMISSION OUTPUT ON THE GRADESCOPE p rrIGNMdN/ 3 h m9/dB99i AND rrIGNMdN/ 3
h <AN2Ak 4'A,ING( CORRECTLY REECTS YOUR WORj AND RESPONSES% -F YOU NOTICE INCONSISTENCIES BETWEEN YOUR
NOTEBOOj AND THE lANUAL 4RADING PORTION: YOU NEED TO MAjE A 1IAyyA POST: AND WE CAN HELP YOU WITH THAT%
3)o o)o
-S THE FOLLOWING STATEMENT TRUE OR FALSEq 𝑏 𝑤( IS LINEAR WITH RESPECT TO 𝑤: GIuEN 𝑏 𝑤( < 𝑝2 ) 𝑝4 𝑤 ) 𝑝3 𝑤3
WHERE 𝑤+ 𝑝2 + 𝑝4 + 𝑝3 ≥ 𝑃%
% /RUE
a% =ALSE
onhlTrc 3
-N \ [c G'A,d')C>dCipq ouoq(
3)3 o)3
…9NEhHOT ENCODING“ IS A STANDARD TECHNIQUE THAT TURNS CATEGORICAL FEATURES INTO GENERAL REAL NUMBERS% -F WE
HAuE A DATASET 𝑅 CONTAINING 𝑘 DATA POINTS WHERE EACH DATA POINT HAS o CATEGORICAL FEATURE% rPECICALLY: THIS
3
CATEGORICAL FEATURE HAS 𝑗 POSSIBLE CATEGORIES% /HUS: THE SHAPE OF THE ONEhHOT ENCODING MATRIX THAT REPRESENTS
THE DATASET 𝑅 ISc
% 𝑗⋅𝑗
a% ⋅ 𝑗
b% 𝑘 ⋅ 𝑗
,% 𝑘 ⋅ 𝑘
onhlTrc 3
-N \ [c G'A,d')C>dCipq ou3q(
3)t o)t
)+ 𝑝 − 𝑤 ) 𝑋 ≤ .+
𝑏 X( <
⎤+ 𝑝 − 𝑤 ) 𝑋 ; .
WHERE THE FEATURE uECTOR 𝑤 < 𝑤4 + 𝑤3 ( ≥ 𝑃3 : BIAS 𝑋 ≥ 𝑃: WEIGHT uECTOR 𝑝 < 𝑝4 + 𝑝3 ( ≥ 𝑃3 % /HE DECISION
BOUNDARY OF THE CLASSICATION MODEL ISc
𝑝−𝑤)𝑋 <.
-F THE PREDICTIONS OF THE CLASSIER F AND ITS DECISION BOUNDARY 𝑝 − 𝑤 ) 𝑋 < . ARE SHOWN IN THE GURE BELOW:
WHICH ONE BELOW CAN BE A POSSIBLE SOLUTION OF WEIGHT uECTOR 𝑝 AND BIAS 𝑋q
t
% 𝑝 < )+ .(9 𝑋 < ⎤
onhlTrc 3
-N \ [c G'A,d')C>dCipq outAq(
-F THE PREDICTIONS OF THE CLASSIER F AND ITS DECISION BOUNDARY 𝑝 − 𝑤 ) 𝑋 < . ARE SHOWN IN THE GURE BELOW:
WHICH ONE BELOW CAN BE A POSSIBLE SOLUTION OF WEIGHT uECTOR 𝑝 AND BIAS 𝑋q
5
% 𝑝 < )+ .(9 𝑋 < ⎤
onhlTrc 3
-N \ [c G'A,d')C>dCipq outBq(
3)5 o)5
,% NONE OF THE ABOuE
onhlTrc 3
-N \ [c G'A,d')C>dCipq ou5q(
3)e)o 3)o
vE ARE GIuEN A CLASSIER THAT PERFORMS CLASSICATION IN 𝑃3 pTHE SPACE OF DATA POINTS WITH 3 FEATURES p𝑤4 + 𝑤3 ((
WITH THE FOLLOWING DECISION RULEc
)+ 𝑤4 ) 𝑤3 ⎤ ≤ .+
𝑓 𝑤+ 𝑤( <
⎤+ OTHERWISE
WHERE 𝑓 X( ≥ ]⎤+ )| IS THE PREDICTED LABEL% 1LEASE SOLuE THE FOLLOWING PROBLEMS%
,RAW THE DECISION BOUNDARY OF THE GIuEN CLASSIER AND SHADE THE REGION WHERE THE CLASSIER PREDICTS .o%
lAjE SURE YOU HAuE MARjED THE 𝑤4 AND 𝑤3 AXES AND THE INTERCEPTS ON THOSE AXES%
onhlTrc t
7
GENEq TE SOlE q NDOl D T POINTS
N1)'AN,9M)rdd,pz(
murAM1kdr 8 7z
rAM1kduXor 8 N1)'AN,9M)'AN,pmurAM1kdr( a e h 3
rAM1kduX3r 8 N1)'AN,9M)'AN,pmurAM1kdr( a 7 h 3
PqEDIbT TgE L BELS po Oq ho( Oe TgE S lPLESc gEqE TgE SIGNEDuDIST NbE IS GI_EN Bx TgE E U TIO
rsd1 3
rIGNd,u,Ir/ANCd 8 rAM1kduXor . 3 a rAM1kduX3r h 5 r#i2s-#m
rsd1 t
19rI/I_d 8 rIGNd,u,Ir/ANCd g8 z
NdGA/I_d 8 rIGNd,u,Ir/ANCd l z
AX 8 1k/)GCAp(
AX)r1INdr\"/91"[)rd/uC9k9'p"N9Nd"(
AX)r1INdr\"B9//9M"[)rd/u19rI/I9Np"yd'9"(
AX)r1INdr\"kd!/"[)rd/u19rI/I9Np"yd'9"(
AX)r1INdr\"'IG>/"[)rd/uC9k9'p"N9Nd"(
AX)rd/uX/ICirp \h5: h3: z: 3: 5: 7[(
AX)rd/uY/ICirp \h3: ho: o: 3: t[(
AX)rd/uAr1dC/po(
;
3)7 3)3
vE ARE GIuEN A CLASSIER THAT PERFORMS CLASSICATION ON 𝑃3 pTHE SPACE OF DATA POINTS WITH 3 FEATURES pXo:
X3(( WITH THE FOLLOWING DECISION RULEc
)+ 𝑝4 𝑤4 ) 𝑝3 𝑤3 ) 𝑋 ≤ .+
𝑓 𝑤+ 𝑤( <
⎤+ OTHERWISE
po( bOMPUTE THE PARAMETERS 𝑝: 𝑝 AND 𝑋 FOR THE DECISION BOUNDARY IN THE GURE BELOW% 1LEASE MAjE SURE
THE PREDICTIONS FROM THE OBTAINED CLASSIER ARE CONSISTENT WITH THE GURE%
gINTc 1LEASE USE THE INTERCEPTS IN THE GURE BELOW TO ND THE RELATION BETWEEN 𝑝: 𝑝 AND 𝑋% /HEN:
SUBSTITUTE IT INTO THE NORMALIyATION CONSTRAINT TO SOLuE FOR PARAMETERS%
p3( 2SE PARAMETERS FROM THE ABOuE QUESTION TO COMPUTE PREDICTIONS FOR THE FOLLOWING TWO DATA POINTSc
, < + (+ 𝐴 < ⎤+ .(%
e
onhlTrc n
po( =ROM THE GIuEN GURE: WE CAN DEDUCE THAT THE 𝑤4 INTERCEPT IS po: z( AND THE 𝑤3 INTERCEPT IS pz: o(
rOLuING FOR 𝑝4 AND 𝑝3 WITH RESPECT TO B IN THE GIuEN FUNCTION USING THE INTERCEPTS YIELDSc 𝑝4 < ⎤𝑋: 𝑝3 < ⎤𝑋:
THEREFORE 𝑝4 < 𝑝3
𝑝4 𝑤4 ) 𝑝 3 𝑤3 ) 𝑋 < . ) . ) 𝑋 < 𝑋 ; .
W3 < 𝑝4 (3 ) 𝑝4 (3
< 𝑝43
∑
< 𝑝4
∑
< 𝑝4 < pSINCE 𝑝4 = .(
∑
𝑝4 < ∑ <
∑ ∑
rINCE 𝑝4 < 𝑝3 : 𝑝3 < ∑4
3
< 3 %
3
rINCE 𝑝4 < ⎤𝑋: 𝑋 < ⎤ 3
3
∑ ∑ ∑
3 : 3 :
3 3 3
𝑝4 < 𝑝3 < 𝑋<⎤ 3
3)s 3)t
vE ARE GIuEN A CLASSIER THAT PERFORMS CLASSICATION ON √1 pTHE SPACE OF DATA POINTS WITH t FEATURES
𝑤4 + 𝑤3 + 𝑤1 (( WITH THE FOLLOWING DECISION RULEc
+ IF 𝑝4 𝑤4 ) 𝑝3 𝑤3 ) 𝑝1 𝑤1 ) 𝑋 ≤ .
𝑓 𝑤4 + 𝑤 3 + 𝑤 1 ( <
.+ OTHERWISE
gERE: THE NORMAL uECTOR W OF THE DECISION BOUNDARY IS NORMALIyED: I%E%c
n
-N ADDITION: WE SET 𝑋 ∗ . TO HAuE AN UNIQUE EQUATION FOR THE DECISION BOUNDARY%
po( bOMPUTE THE PARAMETERS 𝑝4 : 𝑝3 : 𝑝1 AND 𝑋 FOR THE DECISION BOUNDARY THAT PASSES THROUGH THREE POINTS
, < + + (: 𝐴 < ⎤+ .+ (: 𝐵 < + + ( IN THE GURE BELOW%
gINTc 1LEASE USE THE INTERCEPTS IN THE GURE BELOW TO ND THE RELATION BETWEEN 𝑝4 + 𝑝3 + 𝑝1 AND 𝑋% /HEN:
SUBSTITUTE IT INTO THE NORMALIyATION CONSTRAINT TO SOLuE FOR PARAMETERS%
p3( 2SE PARAMETERS FROM THE ABOuE QUESTION TO COMPUTE PREDICTIONS FOR THE FOLLOWING TWO DATA POINTSc
𝐶 < .+ .+ .(: 𝐷 < + .+ (%
onhlTrc oz
oz
,𝐵 < + ⎤+ (
ℎ 𝑗
,𝐴 ⋅ ,𝐵 < ⎢
⎣ ⎤ ⎤ ⎤⎥
⎦
{ ⎤ ⎡
< ⎤( ( ⎤ ⎤( ⎤((ℎ ⎤ ⎤( ( ⎤ ( ⎤(( ) ⎤ ⎤((𝑗
< ⎤ℎ ) ) 5𝑗
mORMALIyING THIS uECTORc
∑ ∑ ∑
W < ⎤(3 ) 3 ) 53 < 5 ) ) 5 < 5 <
⎤3 ∑4 ∑1 𝑗
,𝐴 ⋅ ,𝐵 < ∑
48
ℎ ) 48
) 48
⎤
∑ 𝑝4 ) ( ) ∑ 𝑝3 ) ∑ 𝑝1 ⎤ ( < .
⎤ 5
∑ 𝑝4 ⎤ ∑ ) ∑ 𝑝3 ) ∑ 𝑝1 ⎤ ∑ < .
⎤ 7
∑ 𝑝4 ) ∑ 𝑝3 ) ∑ 𝑝1 ⎤ ∑ < .
𝑝4 < ⎤3
∑
48
: 𝑝3 < ∑4 :
48
𝑝1 < ∑1 :
48
𝑋< ⎤}
∑
48
3)e 3)5
-N THIS PROBLEM: WE ATTEMPT TO OBTAIN THE OPTIMAL PARAMETERS W× AND 𝑋× BY USING A STANDARD GRADIENT DESCENT
ALGORITHM% SSUME 𝑚𝑇 < 𝑚 𝑥𝑇 𝑤𝑇 (: SOLuE FOR THE GRADIENT FOR W AND THE GRADIENT FOR B%
vE ARE GIuEN A CLASSIER THAT PERFORMS CLASSICATION IN √3 pTHE SPACE OF DATA POINTS WITH 3 FEATURES 𝑤4 + 𝑤3 ((
WITH THE FOLLOWING DECISION RULEc
)+ IF 𝑤34 ) 𝑤33 ⎤ ≤ .
𝑓 𝑤4 + 𝑤 3 ( <
⎤+ OTHERWISE
,RAW THE DECISION BOUNDARY OF THE CLASSIER AND SHADE THE REGION WHERE THE CLASSIER PREDICTS .o% lAjE
SURE YOU HAuE MARjED THE 𝑤4 AND 𝑤3 AXES AND THE INTERCEPTS ON THOSE AXES%
oo
onhlTrc t
Xz 8 z r#i2s-#m
Yz 8 z r#i2s-#m
' 8 t r#i2s-#m
CI'Ckd 8 1k/)]I'Ckdpp Xz : Yz (: ': !Ikk8e krd( pvzc xz( IS TgE bENTEq Oe TgE bIqbLE ND q IS
PqEDIbT TgE L BELS po Oq ho( Oe TgE S lPLESc gEqE TgE SIGNEDuDIST NbE IS GI_EN Bx TgE E U TIO
rsd1 3
rIGNd,u,Ir/ANCd 8 rAM1kduXor aa 3 . rAM1kduX3r aa 3 h n r#i2s-#m
rsd1 t
19rI/I_d 8 rIGNd,u,Ir/ANCd g8 z
NdGA/I_d 8 rIGNd,u,Ir/ANCd l z
AX 8 1k/)GCAp(
AX)A,,uA'/Ir/pCI'Ckd(
AX)r1INdr\"/91"[)rd/uC9k9'p"N9Nd"(
AX)r1INdr\"B9//9M"[)rd/u19rI/I9Np"yd'9"(
AX)r1INdr\"kd!/"[)rd/u19rI/I9Np"yd'9"(
AX)r1INdr\"'IG>/"[)rd/uC9k9'p"N9Nd"(
AX)rd/uX/ICirp \h5: h3: z: 3: 5[(
AX)rd/uY/ICirp \ht: h3: ho: o: 3: t[(
AX)rd/uAr1dC/po(
o3
t .2ESTION t
ℝ𝑏 𝑝(
po( 4IuEN A FUNCTION 𝑏 𝑝( < 𝑥4 ⎤ 𝑝𝑤4 (3 WHERE 𝑤4 + 𝑥4 ( < + ( REPRESENTS A DATA POINT: DERIuE %
ℝ𝑝
p3( 4IuEN A FUNCTION 𝑏 𝑝( < ∈𝑇≥]403| 𝑥𝑇 ⎤ 𝑝𝑤𝑇 (3 WHERE 𝑤4 + 𝑥4 ( < + (+ 𝑤3 + 𝑥3 ( < + ( ARE TWO DATA
ℝ𝑏 𝑝(
POINTS: DERIuE %
ℝ𝑝
onhlTrc e
po(
ot
ℝ𝑏 𝑝(
< 𝑥4 ⎤ 𝑝𝑤4 ( ⎤𝑤4 (
ℝ𝑝
< ⎤ 𝑝( ⎤(
< ⎤ 𝑝( ⎤(
< 𝑝 ⎤
p3(
ℝ𝑏 𝑝(
< 𝑥𝑇 ⎤ 𝑝𝑤𝑇 ( ⎤𝑤𝑇 (
ℝ𝑝 𝑇≥]403|
ℝ𝑏 𝑝(
4IuEN A FUNCTION 𝑏 𝑝( < Y ⎤ 𝑝X(𝑦 Y ⎤ 𝑝X( WHERE X < >+ [𝑦 AND Y < >+ [𝑦 : DERIuE %
ℝ𝑝
onhlTrc ;
lETHOD oc
o5
lETHOD 3c
ℝ𝑏 𝑝( ℝ Y ⎤ 𝑝X( ℝ Y ⎤ 𝑝X(
< ( − Y ⎤ 𝑝X( ) Y ⎤ 𝑝X( − (
ℝ𝑝 ℝ𝑝 ℝ𝑝
< ⎤X(𝑦 Y ⎤ 𝑝X( ) Y ⎤ 𝑝X(𝑦 ⎤X(
mOW PLUG IN FOR X < >+ [𝑦 AND Y < >+ [𝑦
< >+ [ >+ [𝑦 ⎤ 𝑝>+ [𝑦 ( ) >+ [𝑦 ⎤ 𝑝>+ [𝑦 (𝑦 >⎤+ ⎤[𝑦
< >+ [ >+ [𝑦 ⎤ 𝑝>+ [𝑦 ( ) >+ [ ⎤ 𝑝>+ [(>⎤+ ⎤[𝑦
< ⎤6 ) 𝑝( ) ⎤6 ) 𝑝(
< .𝑝 ⎤
5 .2ESTION 5
-N THIS QUESTION: WE STILL USE THE -RIS DATASET FROM gOMEWORj o +UESTION 7% -N FACT: YOU CAN SEE THE SHAPE OF
ARRAY 𝑆 IS .+ ( BY RUNNING wprg P,: WHICH MEANS IT CONTAINS oz DATA POINTS WHERE EACH HAS 5 FEATURES%
gERE: WE WILL PERFORM SOME BASIC DATA MANIPULATION AND CALCULATE SOME STATISTICSc
iO D -qIS , T SET
I'Ir 8 ,A/Ard/r)k9A,uI'Irp(
w 8 I'Ir),A/A
x 8 I'Ir)/A'Gd/
/HEN CALCULATE THE MEAN OF FEATURE uECTORS IN EACH GROUP% xOUR RESULTS SHOULD BE uE 5hDIMENSIONAL uECTORS
pI%E% SHAPE OF mUM1Y ARRAY CAN BE + (: + ( OR + (%
o
onhlTrc
X3 8 N1)A''AYpA''AY\tzc7z: c[(
MdANuG'9213 8 N1)MdANpX3: AXIr 8 z(
Xt 8 N1)A''AYpA''AY\7zcnz: c[(
MdANuG'921t 8 N1)MdANpXt: AXIr 8 z(
X5 8 N1)A''AYpA''AY\nzco3z: c[(
MdANuG'9215 8 N1)MdANpX5: AXIr 8 z(
Xf 8 N1)A''AYpA''AY\o3zc: c[(
MdANuG'921f 8 N1)MdANpXf: AXIr 8 z(
dm, r#i2s-#m
.dTt.m MdANuG'921o: MdANuG'9213: MdANuG'921t: MdANuG'9215: MdANuG'921f
5)o 5)3
?EMOuE 3ND AND tRD FEATURES FROM ARRAY 𝑆: RESULTING A . ⋅ MATRIX% /HEN CALCULATE THE MEAN OF ALL
FEATURE uECTORS% xOUR RESULT SHOULD BE A 3hDIMENSIONAL uECTOR%
onhlTrc t
5)3 5)t
?EMOuE LAST oz DATA POINTS FROM ARRAY 𝑆: RESULTING A . ⋅ MATRIX% /HEN CALCULATE THE MEAN OF FEATURE
uECTORS% xOUR RESULT SHOULD BE A 5hDIMENSIONAL uECTOR%
onhlTrc t
o7
d -m r#i2s-#m
wu,dkoz 8 A''AY\choz: c[
MdANu,dk 8 N1)MdANpwu,dkoz: AXIr 8 z(
dm, r#i2s-#m
.dTt.m MdANu,dk
dND OF 3
-N \ [c
)o r2BlISSION
lAjE SURE YOU HAuE RUN ALL CELLS IN YOUR NOTEBOOj IN ORDER BEFORE RUNNING THE CELL BELOW: SO THAT ALL
IMAGES6GRAPHS APPEAR IN THE OUTPUT% /HE CELL BELOW WILL GENERATE A yIP LE FOR YOU TO SUBMIT%
1LEASE MAjE SURE TO SEE THE OUTPUT OF THE GRADESCOPE AUTOGRADER% xOU ARE RESPONSIBLE FOR WAITING AND
ENSURING THAT THE AUTOGRADER IS EXECUTING NORMALLY FOR YOUR SUBMISSION% 1LEASE CREATE A CAMPUSWIRE POST IF
YOU SEE ERRORS IN AUTOGRADER EXECUTION%
o;