5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU...

177
/( &7 85( 1 27 ( 6 $SSOLHG 6WDWLVWLFV DQG 3 U REDELOLW\ IRU ( QJLQHHU V =HOGD =DELQVN\ 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU LDO ( QJLQHHU LQJ 3 U RJU DP 8QLYHU VLW\ RI :DVKLQJWRQ &RS\U LJKW F q $OO 5LJKWV 5HVHU YHG

Transcript of 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU...

Page 1: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

/( &7 85( 1 27 ( 6

$SSOLHG 6WDWLVWLFV DQG3 U REDELOLW\ IRU ( QJLQHHU V

=HOGD =DELQVN\5LFKDU G 6WRU FK.DLODVK .DSXU5REHU W 6PLWK

, QGXVWU LDO ( QJLQHHU LQJ 3 U RJU DP8QLYHU VLW\ RI :DVKLQJWRQ

&RS\U LJKW Fq ����� $OO 5LJKWV5HVHU YHG�

Page 2: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU �

'HVFU LSWLYH 6WDWLVWLFV

Page 3: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU �

s 5 DQGRP 6DPSOLQJ

s 3LFWXULQJ WKH ' LVWULEXWLRQ

s 6DPSOH 6WDWLVWLFV

Page 4: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 U REDELOLW\ DQG 6WDWLVWLFV

Population

Sample

([DPSOH� ;L KRXUV XQWLO IDLOXUH RI D SDUWLFX�ODU OLJKWEXOE

Page 5: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5HODWLYH )U HTXHQF\ + LVWRJU DP

&RQYH\V D VHQVH RI KRZ ; LV GLVWULEXWHG�

Page 6: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6DPSOH 0 HDQ

s /HW ;� � ;� � � � � � ;Q E H D UDQGRP VDPSOH IURPWKH GLVWULEXWLRQ RI ;�

s 7KH VDPSOH PHDQ LV D VWDWLVWLF DQG LVJLYHQ E\

z;

Q;L �

;L

Q

s 7KH SRSXODWLRQ PHDQ� z� LV XVXDOO\ HVWL�PDWHG E\ z;

s 7KH REVHU YHG YDOXH RI WKH VDPSOH PHDQLV WKH QXPE HU JLYHQ IURP WKH GDWD�

z[

Q;L �

[L

Q

Page 7: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6DPSOH 0 HGLDQ�7KH VDPSOH PHGLDQ LV IRXQG E\ DUUDQJLQJ WKHUDQGRP VDPSOH ;� �;� � � � � � ;Q LQ RUGHU� IURPVPDOOHVW WR ODUJHVW� DQG pQGLQJ WKH PLGGOH�

a[

�!!!!�!!!!�[Q��

�LI Q LV RGG

[Q��[Q

� ��

� LI Q LV HYHQ

6DPSOH 0 RGH�7KH VDPSOH PR GH RI D UDQGRP VDPSOH LV WKHYDOXH WKDW RFFXUV PRVW RIWHQ�

Page 8: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6DPSOH 9DU LDQFH DQG

6DPSOH 6WDQGDU G 'HYLDWLRQ

/HW ;� � ;� � � � � � ;Q EH D UDQGRP VDPSOH RI VL]HQ IURP WKH GLVWULEXWLRQ RI ; � 7KHQ WKH VDPSOHYDU LDQFH LV WKH VWDWLVWLF

V � Q;

L �

�[L b z[��

Qb �

ZKLFK FDQ EH FDOFXODWHG E\

V�

Q;L �

[�L b�

Q;L �

[L��

QQb �

7KH VDPSOH VWDQGDU G GHYLDWLRQ LV WKH VWDWLV�WLF

V SV�

7KH S RSXODWLRQ YDULDQFH� � � � DQG WKH S RSXOD�WLRQ VWDQGDUG GHYLDWLRQ � DUH HVWLPDWHG E\ V�

DQG V UHVSHFWLYHO\�

Page 9: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU �

3 U REDELOLW\

Page 10: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU �

s ,QWHUSUHWLQJ 3UREDELOLWLHV

s 6DPSOH 6SDFHV DQG (YHQWV

s 3HUPXWDWLRQV DQG &RPELQDWLRQV

s $[LRPV RI 3UREDELOLW\

s 3UREDELOLW\ 5 XOHV

s &RQGLWLRQDO 3UREDELOLW\

s ,QGHSHQGHQFH DQG WKH 0 XOWLSOLFDWLRQ 5 XOH

s % D\HV 7KHRUHP

� �

Page 11: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

:KDW LV 3 U REDELOLW\"

s 3 U REDELOLW\� WKH DVVLJQPHQW RI D ZHLJKWEHWZHHQ � DQG � WR LQGLFDWH WKH OLNHOLKRR GRI WKH RFFXUHQFH RI DQ HYHQW�

s 7KH SU REDELOLW\ RI DQ HYHQW LV GHpQHGLQ WHUPV RI DQ H[SHU LPHQW DQG D VDPSOHVSDFH�

^ &RQVLGHU DQ H[SHU LPHQW WKDW JHQHUDWHVREVHUYDWLRQV�

^ 7KH VDPSOH VSDFH RI DQ H[SHULPHQW�GHQRWHG 6� LV WKH VHW RI DOO S RVVLEOH RXW�FRPHV� RU VDPSOH SRLQWV�

^ $Q HYHQW LV D VXEVHW RI WKH VDPSOH VSDFH6�

� �

Page 12: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH� &RLQ 7 RVV ( [SHU LPHQW

s &RQVLGHU DQ H[SHU LPHQW WKDW JHQHUDWHVREVHUYDWLRQV�

^ ([DPSOH� 7RVV D IDLU FRLQ � WLPHV LQ DURZ

s 7KH VDPSOH VSDFH RI DQ H[SHULPHQW� GH�QRWHG 6� LV WKH VHW RI DOO S RVVLEOH RXWFRPHV�RU VDPSOH SRLQWV�

^ ([DPSOH� 7KH VDPSOH VSDFH IRU WKLV H[�S HULPHQW KDV � VDPSOH S RLQWV�

6

�!!!!!!!!!!�!!!!!!!!!!�

+++� 7++�++7� 7+7�+7+� 77+�+77� 777

�!!!!!!!!!! !!!!!!!!!!�

� �

Page 13: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH� &RQWLQXHG

s $Q HYHQW LV D VXEVHW RI WKH VDPSOH VSDFH6�

^ ([DPSOH� /RRN DW � GLoHUHQW HYHQWV DVH[DPSOHV�

^ 7KH HYHQW RI � KHDGV�

$ I+++J^ 7KH HYHQW RI � KHDGV�

% I++7�+7+� 7++J^ 7KH HYHQW WKDW WKH ODVW WRVV LV D KHDG�

& I+++�+7+� 7++� 77+J

� �

Page 14: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH� &RQWLQXHG

s 7KH SU REDELOLW\ RI DQ HYHQW LQGLFDWHV WKHOLNHOLKRRG WKH HYHQW RFFXUV

^ ([DPSOH� /R RN DW WKH SUREDELOLW\ RI WKHVDPH � HYHQWV�

^ 7KH SUREDELOLW\ RI JHWWLQJ � KHDGV3 �$� � �

^ 7KH SUREDELOLW\ RI JHWWLQJ � KHDGV3 �%� � �

^ 7KH SUREDELOLW\ WKDW WKH ODVW WRVV LV DKHDG3 �&� � � � �

� �

Page 15: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5HYLHZ 6HWV�7 HU PLQRORJ\ 1 RWDWLRQ

s $ VHW LV D ZHOO�GHpQHG FROOHFWLRQ RI RE MHFWV�(DFK RE MHFW LQ D VHW LV FDOOHG DQ HOHPHQWRI WKH VHW�

s 7KH XQLYHU VDO VHW 6 LV WKH VHW RI DOO RE�MHFWV XQGHU FRQVLGHUDWLRQ� 7KH QXOO VHW� RUHPSW\ VHW� �� FRQWDLQV QR HOHPHQWV�

s 7ZR VHWV DUH HTXDO LI WKH\ FRQWDLQ WKH VDPHHOHPHQWV�

^ ([� $ I�� �� �� �J HTXDOV % I�� �� �� �J

� �

Page 16: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5HYLHZ 6HW 5HODWLRQV

6XSSRVH 6 LV WKH XQLYHUVDO VHW� ZLWK WZR VXEVHWV�$ DQG %�

s $ VHW� $� LV D VXEVHW RI % LI DOO HOHPHQWV RI$ EHORQJ WR %� $ ~ %

S

AB

s 7KH XQLRQ $>% I[ M [ � $ RU [ � %J

S

A B

� �

Page 17: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

s 7KH LQWHU VHFWLRQ $ ? % I[ M [ �$ DQG [ � %J

S

A B

s 7KH FRPSOHPHQW RI $ ZLWK UHVS HFW WR 6LV GHQRWHG $&

S

A AC

� �

Page 18: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

s 6HWV $ DQG % DUH PXWXDOO\ H[FOXVLYH RUGLVMRLQW� LI DQG RQO\ LI $ ?% ��

S

A B

s $Q\ QXPEHU RI VHWV� $� � $� � $� � � � � DUH PX�WXDOO\ H[FOXVLYH LI DQG RQO\ LI $L?$M �IRU L � M�

S

A1

A2

A3

A4

s $� ?$� � $� ?$ � �$� ?$� � $� ?$ � �$� ?$� � $� ?$ � �

� �

Page 19: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

9HQQ 'LDJU DP ( [DPSOH

��� DVVHPEOHG PDFKLQH SDUWV DUH LQVSHFWHG E H�IRUH WKH\ DUH VKLSS HG� 7KH LQVSHFWLRQ FDQ GHWHFWZKHWKHU�

s D SDUW FRQWDLQV DW OHDVW RQH GHIHFWLYH FRP�SRQHQW �' �� DQG�RU

s D SDUW LV LPSURS HUO\ DVVHPEOHG �,�

' DWD�

s �� SDUWV FRQWDLQ DW OHDVW RQH GHIHFWLYH FRP�SRQHQW

s �� SDUWV KDYH EHHQ LPSURSHUO\ DVVHPEOHG

s �� SDUWV FRQWDLQ DW OHDVW RQH GHIHFWLYH FRP�SRQHQW DQG KDYH EHHQ LPSURSHUO\ DVVHPEOHG

s ��� SDUWV DUH pQH� L�H� KDYH QR GHIHFWLYHFRPSRQHQWV DQG DUH SURSHUO\ DVVHPEOHG

� �

Page 20: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

Fine: 465

ID

s ' HIHFWLYH� �� LQ '

s ,PSURSHUO\ DVVHPEOHG� �� LQ ,

s ' HIHFWLYH DQG ,PSURS HUO\ DVVHPEOHG� �� LQ' ? ,

s ' HIHFWLYH DQG 3URSHUO\ DVVHPEOHG� � LQ '?,&

s ,PSURSHUO\ DVVHPEOHG DQG 1RW ' HIHFWLYH� ��LQ , ?'&

s ' HIHFWLYH RU ,PSURSHUO\ DVVHPEOHG� �� LQ' > ,

� �

Page 21: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

' HVFULSWLYH 6WDWLVWLFV�

s :KDW LV WKH SUREDELOLW\ WKDW � SDUW VHOHFWHGDW UDQGRP LV pQH"3 �D SDUW LV pQH� ��� ��� ����7KH S HUFHQWDJH RI SDUWV WKDW DUH pQH LV ����

s +RZ PDQ\ SDUWV DUH UHMHFWHG IRU VKLSPHQW"7KH SDUWV WKDW DUH UHMHFWHG DUH SDUWV WKDW DUHHLWKHU GHIHFWLYH RU LPSURSHUO\ DVVHPEOHG� '>, )&� VR �� SDUWV DUH UHMHFWHG IRU VKLS�PHQW�

� �

Page 22: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RXQWLQJ 5XOHV

3 HU PXWDWLRQ� $ SHUPXWDWLRQ LV DQ DUUDQJH�PHQW RI RE MHFWV LQ D GHpQLWH RUGHU�

&RPELQDWLRQ� $ FRPELQDWLRQ LV D VHOHFWLRQ RIRE MHFW ZLWK QR UHJDUG WR RUGHU�

� �

Page 23: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

0 XOWLSOLFDWLRQ 3 U LQFLSOH

&RQVLGHU DQ H[SHULPHQW WDNLQJ SODFH LQ N VWDJHV�/HW QL GHQRWH WKH QXPEHU RI ZD\V LQ ZKLFK VWDJHL FDQ R FFXU� IRU L �� �� � � � � N�$OWRJHWKHU WKH H[S HULPHQW FDQ RFFXU LQ

N<L �

QL Q � e Q� e c c c e QN ZD\V�

,OOXVWUDWH ZLWK WUHH GLDJUDP� RU VORWV

1

2

n1

1

2

n2

1

2

nk

Q � Q� c c c QN

6WDJH � 6WDJH � 6WDJH N

� �

Page 24: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH

7RVV D FRLQ � WLPHV LQ D URZ

H

H

H

H

H

H

H

T

T

T

T

T

T

T

+�7 +�7 +�7� � �

�VW �QG �UGWRVV WRVV WRVV

�� �

� �

Page 25: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 HU PXWDWLRQV

6XSSRVH ZH KDYH 1 GLVWLQFW RE MHFWV� DQG ZH DUHJRLQJ WR DUUDQJH� LQ VRPH RUGHU� Q RI WKHP� +RZPDQ\ SHUPXWDWLRQV DUH WKHUH"6LQFH ZH DUH DUUDQJLQJ Q RI WKHP� ZH QHHG QVORWV� $OVR� WKH RE MHFWV DUH GLVWLQFW� DQG UHS HWL�WLRQ LV 12 7 DOORZHG�

1 �1 b �� c c c �1 b Q � ���VW RE MHFW �QG RE MHFW QWK RE MHFW

31Q 1�1b���1b�� � � � �1bQ� ��

1 �

�1 b Q��

� �

Page 26: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPELQDWLRQV

6XSSRVH ZH KDYH 1 GLVWLQFW RE MHFWV� DQG ZHVHOHFW Q RE MHFWV IURP WKHP� �RUGHU GR HV 12 7PDWWHU�� +RZ PDQ\ FRPELQDWLRQV"

&1Q

�%%# 1Q

�&&$ 1 �

Q��1 b Q��

� �

Page 27: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 RNHU + DQGV

�� FDUGV LQ D GHFN� � VXLWV� �� FDUGV LQ D VXLW�a�`�_��

:KDW LV WKH SUREDELOLW\ RI EHLQJ GHDOW � DFHVDQG � NLQJV"

:KDW LV WKH SUREDELOLW\ RI E HLQJ GHDOW D UXQ RI� FDUGV LQ VHTXHQFH �$�. �4 �-����

� �

Page 28: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

$[LRPV RI 3 U REDELOLW\

�� /HW 6 GHQRWH D VDPSOH VSDFH IRU DQ H[S HUL�PHQW�

3 �6� �

�� ) RU HYHU\ HYHQW $�

3 �$� y �

�� /HW $� � $� � � � � � $Q� � � � EH D pQLWH RU LQpQLWHVHTXHQFH RI PXWXDOO\ H[FOXVLYH HYHQWV� 7KHQ3 �$�

6$� 6$� c c c�

3 �$� � � 3 �$� � � 3 �$� � � c c c([DPSOH� ' UDZ D FDUG IURP D GHFN

0 1/4 1/2 3/4

AGet A Diamond

S P(S)=1

P(A)=1/4

� �

Page 29: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5XOHV RI 3 U REDELOLW\

s 7KH SUREDELOLW\ RI LPSRVVLEOH HYHQWV LV ��

3 ��� �

s &RPSOHPHQW UXOH�

3v$&

w � b 3 �$�

S

A

AC

s $GGLWLRQ UXOH�

3 �$�6$� � 3 �$� �� 3 �$� �b3 �$�

7$� �

A1A2

� �

Page 30: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

0 RU H 5XOHV RI 3 U REDELOLW\

'HpQLWLRQ� /HW $ DQG % EH HYHQWV ZLWK 3 �$� � �� 7KH FRQGLWLRQDO SUREDELOLW\ RI % JLYHQ $LV

3 �%M$� 3 �$ 7%�

3 �$�

1RWH�3 �%M$� LV XQGHpQHG LI 3 �$� ��

0 XOWLSOLFDWLRQ 5XOH�

3 �$ 7%� 3 �%M$�3 �$�

� �

Page 31: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

, QGHSHQGHQFH

'HpQLWLRQ� 7ZR HYHQWV $ DQG % DUH LQGH�SHQGHQW LI DQG RQO\ LI

3 �$ 7%� 3 �$�3 �%�

2 WKHUZLVH WKH\ DUH GHSHQGHQW�

7 KHRU HP� 7ZR HYHQWV $ DQG % DUH LQGHS HQ�GHQW LI DQG RQO\ LI

3 �%M$� 3 �%� LI 3 �$� � �

DQG 3 �$M%� 3 �$� LI 3 �%� � �

� �

Page 32: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% D\HV 7 KHRU HP

/HW $� � $� � � � � � $Q EH D FROOHFWLRQ RI HYHQWV ZKLFKSDUWLWLRQ 6� /HW % E H DQ HYHQW� 3 �%� � ��7KHQ� IRU DQ\ HYHQW $M� M �� � � � � � Q�

3 �$MM%� 3 �%M$M�3 �$M�

3 �%M$� �3 �$� � � � � � � 3 �%M$Q�3 �$Q�

A7A2 A3 A4 A5 A6A1

B

� �

Page 33: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% D\HV 7 KHRU HP� 7 U HH 'LDJU DP

/HW $� � $� � � � � � $Q EH D FROOHFWLRQ RI HYHQWV ZKLFKSDUWLWLRQ 6� 7KHVH HYHQWV IRUP WKH pUVW EUDQFKHVRI WKH WUHH� /HW % EH DQ HYHQW� 3 �%� � ��7KH HYHQWV % DQG %& DUH OHDYHV Ro RI HDFK $M

EUDQFK�

� �

Page 34: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU ��

'LVFU HWH 5DQGRP 9DU LDEOHV

� �

Page 35: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU �

' HpQLWLRQ DQG 3URSHUWLHV�

s ' LVFUHWH UDQGRP YDULDEOHV

s ' LVFUHWH SUREDELOLW\ GLVWULEXWLRQV

s ([S HFWHG YDOXH� PHDQ� YDULDQFH�VWDQGDUG GHYLDWLRQ

' LVFUHWH 3UREDELOLW\ ' LVWULEXWLRQV�

s 8QLIRUP GLVWULEXWLRQ

s * HRPHWULF GLVWULEXWLRQ

s % LQRPLDO GLVWULEXWLRQ

s 1HJDWLYH ELQRPLDO GLVWULEXWLRQ

s +\SHUJHRPHWULF GLVWULEXWLRQ

s 3RLVVRQ GLVWULEXWLRQ

� �

Page 36: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LVFU HWH 5DQGRP 9DU LDEOHV

) RU D JLYHQ VDPSOH VSDFH 6 RI VRPH H[SHULPHQW�D U DQGRP YDU LDEOH LV DQ\ UXOH WKDW DVVR FLDWHVD QXPEHU ZLWK HDFK RXWFRPH LQ 6�

([DPSOH� $JH6 I��� ��� ��� ��� � � � � ��� ���J< DJH

([DPSOH� &RLQ 7RVV WKUHH WLPHV6 I+++� ++7� +7+� +77�

7++� 7+7� 77+� 777J< QXPEHU RI KHDGV

$ UDQGRP YDULDEOH LV GLVFU HWH LI LWV VHW RISRVVLEOH YDOXHV LV D GLVFUHWH VHW� L�H� KDV DpQLWH� RU FRXQWDEO\ LQpQLWH� QXPEHU RI HOHPHQWV�([DPSOH� 0 DNH EDOO E HDULQJV XQWLO RQH ZRUNV

6 � VXFFHVV� ) � IDLOXUH6 I6� ) 6� ) ) 6� ) ) ) 6� � � � J< QXPEHU RI EDOO EHDULQJV PDGH

� �

Page 37: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LVFU HWH 3 U REDELOLW\ 'LVWU LEXWLRQ

7KH GHQVLW\ IXQFWLRQ IRU D GLVFUHWH UDQGRPYDULDEOH < LV D IXQFWLRQ S JLYHQ E\

S�\� 3 �< \��

7KH FXPXODWLYH GLVWU LEXWLRQ IXQFWLRQ ) �\��IRU D GLVFUHWH UDQGRP YDULDEOH < ZLWK GHQVLW\S� LV GHpQHG E\

) �\� 3 �< x \� ;[x\

S�[��

� �

Page 38: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% DOO % HDU LQJ ( [DPSOH

s 0 DNH EDOO EHDULQJV XQWLO RQH LV JR RG �VXF�FHVVIXO�

s < � RI EDOO EHDULQJV PDGH

s /HW S SUREDELOLW\ D EDOO E HDULQJ LV VXFFHVV�IXO� ,Q WKLV H[DPSOH� S ����

s $VVXPH WKH EDOO E HDULQJV DUH LQGHS HQGHQW�

3 �< �� S��� S

3 �< �� S��� �� b S�S

3 �< �� S��� �� b S�� S���

3 �< \� S�\� �� b S�\b� S

� �

Page 39: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% DOO % HDU LQJ ( [DPSOH FRQWLQXHG

\ GHQVLW\ FXPXODWLYH GLVWULEXWLRQS�\� 3 �< \� ) �\� 3 �< x \�

� ��� ���� ���� ����� ����� ������ ������ ������

��� ��� ���\ �����\b� ����� 3\

[ � �����[b� �������� ��� ���

' HQVLW\ ' LVWULEXWLRQ ) XQFWLRQ S�\�

p(y)

y

� �

Page 40: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% DOO % HDU LQJ ( [DPSOH FRQWLQXHG

\ GHQVLW\ FXPXODWLYH GLVWULEXWLRQS�\� 3 �< \� ) �\� 3 �< x \�

� ��� ���� ���� ����� ����� ������ ������ ������

��� ��� ���\ �����\b� ����� 3\

[ � �����[b� �������� ��� ���

&XPXODWLYH ' LVWULEXWLRQ ) XQFWLRQ ) �< �

y2 3 41

0.6

p(y)1.0

� �

Page 41: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDU DFWHU LVWLFV RI WKH &XPXODWLYH'LVWU LEXWLRQ )XQFWLRQ� ) �\��

s ) �< � LV GHpQHG IRU DOO UHDO YDOXHV� QRW MXVWRXWFRPHV�

s ) �< � LV QRQ�GHFUHDVLQJ �LQFUHDVLQJ RU qDW�

s OLP\��) �< � �

s OLP\�b� ) �< � �

� �

Page 42: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LFH ( [DPSOH

5 ROO D SDLU RI GLFH< WRWDO VKRZLQJ RQ WKH SDLU RI GLFH

< GHQVLW\ FXP� GLVW�S�\� 3 �< \� ) �\� 3 �< x \�

� ���� ����� ���� ����� ���� ����� ���� ������ ���� ������ ���� ������ ���� ������ ���� �����

�� ���� ������� ���� ������� ���� �����

� �

Page 43: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LFH ( [DPSOH FRQWLQXHG

' HQVLW\ S�\� 3 �< \�

2 3 4 5 6 7 8 9 10 11 12

6/36

3/36

p(y)

y

2 3 4 5 6 7 8 9 10 11 12

36/36F(y)

y

30/36

24/36

18/36

12/36

6/36

&XPXODWLYH ' LVWULEXWLRQ ) �< � 3 �< x \�

� �

Page 44: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 KH ( [SHFWHG 9DOXH� RU 0 HDQ� RI <

/HW < E H D GLVFUHWH UDQGRP YDULDEOH� ZLWK VHWRI S RVVLEOH YDOXHV '� DQG ZLWK GHQVLW\ IXQFWLRQS�\� 3 �< \��7KH H[S HFWHG YDOXH RI < LV�

( >< @ ;

\�'\ c S�\�

;\�'

\ c 3 �< \�

,W LV DOVR FDOOHG WKH PHDQ� DQG ZULWWHQz RU z\�

([DPSOH� < WRWDO VKRZLQJ RQ D SDLU RI GLFH( >< @ �� �� � � � �� �� � � � �� �� � � � �� �� � ��

�� �� � � � �� �� � � � �� �� � � � �� �� � ��

��� �� � � � ��� �� � � � ��� �� � �

� �

Page 45: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% DOO % HDU LQJ ( [DPSOH�*HRPHWU LF 'LVWU LEXWLRQ�

S SUREDELOLW\ D EDOO EHDULQJ LV VXFFHVVIXO

3 �< �� S

3 �< �� �� b S�S

3 �< �� �� b S�� S���

3 �< \� �� b S�\b� S

( >< @ �;\ �

\ c �� b S�\b� S �

S

� �

Page 46: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 U RRI RI WKH *HRPHWU LF ( >< @

7R HYDOXDWH WKH LQpQLWH VHULHV� QRWLFH WKDW

G��� b S�\�

GS b\�� b S�\b�

DOVR UHFDOO WKDW 3�\ � U

\ �� bU IRU � x U � ��

7KHUHIRUH� ZH KDYH

( >< @ �;\ �

\ c �� b S�\b� S

�;\ �

SbG��� b S�\�

GS bS �;

\ �

G��� b S�\�

GS

,QWHUFKDQJLQJ WKH VXP DQG WKH GHULYDWLYH

bSGv3�

\ � �� b S�\w

GS bS G

��

� b� � bS � b ��

GS

bSG�� bSS

GS bS

�%%#bSb �� b S�

S �

�&&$ bS�%%#b�

S �

�&&$

S

� �

Page 47: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 KH ( [SHFWHG 9DOXH RI D )XQFWLRQ

/HW < E H D GLVFUHWH UDQGRP YDULDEOH� ZLWK VHWRI S RVVLEOH YDOXHV '� DQG ZLWK GHQVLW\ IXQFWLRQS�\� 3 �< \��

7KHQ WKH H[S HFWHG YDOXH RI DQ\ IXQFWLRQ +�< ��GHQRWHG ( >+�< �@� RU z+ � < � � LV

( >+�< �@ ;

\�'+�\� c 3 �< \�

� �

Page 48: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

*DPEOLQJ *DPH ( [DPSOH

([DPSOH� +RZ PXFK ZRXOG \RX EH ZLOOLQJ WRSD\ LQ RUGHU WR SOD\ WKH IROORZLQJJDPEOLQJ JDPH"

* DPH� 5 ROO D SDLU RI GLFH� ,I \RX JHW DQHYHQ QXPEHU� ZLQ ��� ,I \RX JHWD � RU DQ ��� ZLQ ���

+�\�

�!!!!!!�!!!!!!�

�� LI \ �� �� �� �� ��� ���� LI \ �� ���� RWKHUZLVH

( >+�< �@ � �;\ �

+�\�3 �< \�

���

��� � ��

��� � ��

��� � ��

��� �

���

��� � ��

��� � ��

��� � ��

���

��

�� ����

� �

Page 49: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 U RSHU W\ RI ( [SHFWHG 9DOXH

,I D DQG E DUH FRQVWDQWV� WKHQ

( >D< � E@ D( >< @ � E

3URRI�

( >D< � E@ ;

\�'�D\ � E� c 3 �< \�

D;

\�'\ c 3 �< \�

_ ^] `� E

;\�'

3 �< \�_ ^] `

( >< @ �

D( >< @ � E

([DPSOH� 6XSS RVH < LV WKH QXPE HU RI GD\V XQWLO DPDFKLQH IDLOV� DQG ( >< @ �� $OVR� WKHFRVW RI XVLQJ WKH PDFKLQH LV ����GD\ SOXV�� HDFK WLPH LW IDLOV� :KDW LV WKH FRVWRI XVLQJ WKH PDFKLQH XQWLO LW IDLOV"

+�< � ��< � �

( >+�< �@ ��( >< @ � � ���

� �

Page 50: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

0 RU H 3 U RSHU WLHV RI ( [SHFWDWLRQ

s ( >D< � E@ D( >< @� E D�E FRQVWDQWV

s ( >F< @ F( >< @ F FRQVWDQW

s ( >F@ F

s ( >< � ;@ ( >< @ � ( >;@

s ( >J�< � � K�< �@ ( >J�< �@ � ( >K�< �@

s 1RWLFH� ( >K�< �@ � K�( >< @� IRU JHQHUDOIXQFWLRQV�

s ) RU LQGHS HQGHQW UDQGRP YDULDEOHV ;� < �( >< c;@ ( >< @ c ( >;@

� �

Page 51: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 KH 9DU LDQFH RI <

/HW < E H D GLVFUHWH UDQGRP YDULDEOH ZLWK GHQ�VLW\ S�\� DQG ( >< @ z� 7KH YDULDQFH RI < �GHQRWHG 9 DU �< �� RU � �< � RU � � LV

9 DU �< � ;

\�'�\ b z�� S�\�

(x

�< b z��y

7KH VWDQGDUG GHYLDWLRQ RI < � �< RU �< � HTXDOVWKH VTXDUH URRW RI WKH YDULDQFH RI <

� S� �

6PDOO � � RU � /DUJH � � RU �

0 RVW YDOXHV FORVH 0 RVW YDOXHV IDU

WR PHDQ IURP PHDQ

� �

Page 52: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

9DU LDQFH ( [DPSOHV

([DPSOH� < WRWDO VKRZLQJ RQ D SDLU RI GLFH�( >< @ �9 DU �< � �� b ��� �� � � �� b ��� �� �

� c c c � ��� b ��� �� �} ������ } �����

([DPSOH� < � RI EDOO EHDULQJV PDGH�VWRS ZKHQ RQH LV VXFFHVVIXO

S SUREDELOLW\ D EDOO EHDULQJ LVVXFFHVVIXO3 �< \� �� b S�\b� S IRU \ �� �� � � �( >< @ �

S

9 DU �< � � � � bSS �

* HRPHWULF GLVWULEXWLRQ ZLWK SDUDPHWHU S�

� �

Page 53: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6SHFLDO ( [SHFWDWLRQV

0 RPHQWV DE RXW WKH RULJLQ�7KH H[SHFWHG YDOXH RI < N LV FDOOHG WKH

NWK PRPHQW DERXW WKH RULJLQ RI < �(

x< N

y 3

\�' \NS�\�ZKHQ N �� WKLV LV VLPSO\ WKH PHDQ�

z ( >< @

0 RPHQWV DE RXW WKH PHDQ�7KH IXQFWLRQ +�< � �< b z�N LV FDOOHG

WKH NWK PRPHQW DERXW WKH PHDQ RI <(

x�< b z�N

y 3

\�'�\ b z�NS�\�ZKHQ N �� WKLV LV WKH �QG PRPHQW DERXWWKH PHDQ� RU WKH YDULDQFH�

0 RPHQW * HQHUDWLQJ ) XQFWLRQP< �W� (

xHW<

y

� �

Page 54: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5XOHV IRU 9DU LDQFH

s 9 DU �F� � F FRQVWDQW

s 9 DU �F< � F� 9 DU �< �

s 9 DU �D< � E� D� 9 DU �< � D�E FRQVWDQWV

s 9 DU �< � (x

�< b z��y

(x< �

yb z�

(x

�< b z��y

(x< � b �z< � z�

y (

x< �

yb �z( >< @ � z�

(x< �

yb z�

s ,I < DQG ; DUH LQGHSHQGHQW�WKHQ 9 DU �< � ;� 9 DU �< � � 9 DU �;�

� �

Page 55: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LVFU HWH 'LVWU LEXWLRQV

8QLIRUP ' LVFUHWH ' LVWULEXWLRQ�,I < DVVXPHV WKH YDOXHV \� � \� � � � � � \QZLWK HTXDO SUREDELOLW\� WKHQ LW KDV DGLVFUHWH XQLIRUP GLVWULEXWLRQ

S�\� �

QIRU \ \� � \� � � � � � \Q

( >< @ 3QL � \LQ

9 DU �< � 3QL � �\L b z��

Q

� �

Page 56: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH� 8QLIRU P 'LVFU HWH 'LVWU LE�

([DPSOH� 7RVVLQJ D VLQJOH GLH�< QXPE HU VKRZLQJS�\� � � IRU \ �� �� c c c � �

( >< @ � �� �� �� �� ��� ���

9 DU �< � � � b� � � � � �ccc�� � b� � � � ��

� �� � ���

p(y)

1 2 3 4 5 6

1/6

y

F(y)

1 2 3 4 5 6

1/6

y

2/63/64/65/66/6

� �

Page 57: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

*HRPHWU LF 'LVWU LEXWLRQ

$ JHRPHWULF H[S HULPHQW KDV � SURSHUWLHV�

s 7KH H[SHULPHQW FRQVLVWV RI UHSHDWHG WULDOV�HDFK FKDUDFWHUL]HG DV HLWKHU DVXFFHVV �V� RU D IDLOXUH �I��

s 7KH WULDOV DUH LGHQWLFDO LQGHSHQGHQW RIHDFK RWKHU� HDFK KDV WKH VDPH SUREDELOLW\RI VXFFHVV� S� ZLWK � � S � ��

s 7KH UDQGRP YDULDEOH < GHQRWHV WKH QXPE HURI WULDOV QHHGHG WR REWDLQ WKH pUVW VXFFHVV�

� �

Page 58: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

*HRPHWU LF 'LVWU LEXWLRQ FRQWLQXHG

) RU < | * HRPHWULF�S�

S�\� 3 �< \� �� b S�\b� S \ �� �� � � �

) �< � 3 �< x \� \;

[ ��� b S�[b� S

( >< @ �

S

9 DU �< � T

S �ZKHUH T � b S

� �

Page 59: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% LQRPLDO 'LVWU LEXWLRQ

$ ELQRPLDO H[S HULPHQW KDV � SURSHUWLHV�

s 7KH H[S HULPHQW FRQVLVWV RI Q UHS HDWHG WULDOV�

s (DFK WULDO KDV WZR RXWFRPHV� 6XFFHVV RU ) DLO�XUH� 7KH WULDOV DUH LQGHSHQGHQW�

s 7KH SUREDELOLW\ RI VXFFHVV IRU D WULDO LV S�� � S � �� DQG LV LGHQWLFDO IRU DOO WULDOV�

s $ ELQRPLDO UDQGRP YDULDEOH < LV WKH QXP�EHU RI VXFFHVVHV LQ Q WULDOV RI D ELQRPLDO H[�SHULPHQW�

� �

Page 60: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

% LQRPLDO 'LVWU LEXWLRQ FRQWLQXHG

) RU < | % LQRPLDO�Q� S�

S�\�

�!!!!!!!!!!�!!!!!!!!!!�

�%%# Q\

�&&$ S\�� b S�Qb\ IRU \ �� �� �� � � � � Q

� RWKHUZLVH

) �< � >\@;[ �

�%%# Q[

�&&$ S[�� b S�Qb[

ZKHUH >\@ PHDQV WKH JUHDWHVW LQWHJHU OHVV WKDQRU HTXDO WR \�

( >< @ QS

9 DU �< � QS�� b S�

� �

Page 61: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 HJDWLYH % LQRPLDO 'LVWU LEXWLRQ

s 6DPH DV D ELQRPLDO H[S HULPHQW� EXW LQVWHDGRI FRXQWLQJ WKH QXPE HU RI VXFFHVVHV LQ Q WUL�DOV� ZH DUH LQWHUHVWHG LQ

s < � RI WULDOV QHHGHG WR REWDLQ U VXFFHVVHV

3 �< \� SURE� WKDW WKH UWK VXFFHVV RFFXUV RQ

WKH \WK WULDO� IRU \ y U�

�%%# \ b �U b �

�&&$ �� b S�\bUSU

DQG U FRXOG E H �� �� �� � � �

( >< @ U

S

9 DU �< � U�� b S�

S �

1RWH� LQ WKH VSHFLDO FDVH ZKHQ U �� WKLV UH�GXFHV WR WKH JHRPHWULF GLVWULEXWLRQ�

� �

Page 62: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

+ \SHU JHRPHWU LF 'LVWU LEXWLRQ

s $ UDQGRP VDPSOH RI VL]H Q LV FKRVHQ IURP1 LWHPV �WKH SRSXODWLRQ�� Q x 1 � VDPSOHGZLWKRXW UHSODFHPHQW�

s (DFK LWHP LV HLWKHU D VXFFHVV RU D IDLOXUH� DQGWKHUH DUH U VXFFHVVHV LQ WKH S RSXODWLRQ�

s < LV WKH QXPEHU RI VXFFHVHV LQ WKH VDPSOH�

� �

Page 63: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

+ \SHU JHRPHWU LF 'LVWU LEXWLRQ FRQW�

< � RI VXFFHVVHV LQ WKH VDPSOH

3 �< \�

QXPEHU RI ZD\V WR VHOHFW \VXFFHVVHV DQG Qb \ IDLOXUHV

IURP WKH S RSXODWLRQ

QXPE HU RI S RVVLEOH RXWFRPHVLQ WKH H[S HULPHQW

�%%# U\

�&&$�%%# 1 b UQb \

�&&$�%%# 1Q

�&&$

ZKHUH PD[ ��� Qb �1 b U�� x \ x PLQ�Q� U�

( >< @ Q�# U1

�$

9 DU �< � Q�# U1

�$�%#1 b U

1

�&$�%#1 b Q

1 b �

�&$

� �

Page 64: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 RLVVRQ 'LVWU LEXWLRQ

7KH 3RLVVRQ GLVWULEXWLRQ LV EDVHG RQ FRXQWLQJHYHQWV WKDW RFFXU GXULQJ D WLPH LQWHUYDO ZKHUH�

s 7KH SUREDELOLW\ RI � HYHQWV R FFXULQJ LQ DYHU\ VKRUW WLPH LQWHUYDO LV QHJOLJLEOH�

s 7KH SUREDELOLW\ RI D VLQJOH HYHQW R FFXULQJ LQD VKRUW WLPH LQWHUYDO LV SURSRUWLRQDO WR WKHOHQJWK RI WKH LQWHUYDO�

s 7KH QXPEHU RI HYHQWV RFFXULQJ LQ RQH WLPHLQWHUYDO DUH LQGHSHQGHQW RI WKRVH R FFXULQJLQ D GLVMRLQW WLPH LQWHUYDO�

s < LV WKH QXPE HU RI R FFXUHQFHV RI WKH HYHQWLQ D JLYHQ WLPH LQWHUYDO�

� �

Page 65: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 RLVVRQ 'LVWU LEXWLRQ FRQWLQXHG

< QXPEHU RI HYHQWV LQ D WLPH LQWHUYDO�y H[S HFWHG � RI HYHQWV LQ DQ LQWHUYDO�PHDQ DUULYDO UDWH� DQG y ! ��

) RU < | 3RLVVRQ�y�

3 �< \� Hbyy\

\�\ �� �� �� � � �

( >< @ y

9 DU �< � y

� �

Page 66: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5HODWLRQVKLSV

s 3RLVVRQ ' LVW� LV D OLPLWLQJ FDVH RI WKH % LQR�PLDO ' LVW� DV Q��� S� � LQ VXFK D ZD\WKDW y QS�

s % LQRPLDO ' LVW� LV D VS HFLDO FDVH RI WKH0 XOWLQRPLDO ' LVW�

s * HRPHWULF ' LVW� LV D VSHFLDO FDVH RI WKH1HJDWLYH % LQRPLDO ' LVW�

s &RPSDUH� % LQRPLDO ZLWK +\S HUJHRPHWULF�VDPSOLQJ ZLWK YV� ZLWKRXW UHSODFHPHQW�

� �

Page 67: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU ��

&RQWLQXRXV 5DQGRP 9DU LDEOHV

� �

Page 68: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU �

' HpQLWLRQ 3URS HUWLHV�

s &RQWLQXRXV GHQVLWLHV

s ([S HFWDWLRQ DQG GLVWULEXWLRQ SDUDPHWHUV

&RQWLQXRXV 3UREDELOLW\ ' LVWULEXWLRQV�

s 8QLIRUP GLVWULEXWLRQ

s 1RUPDO GLVWULEXWLRQ

s 1RUPDO 3UREDELOLW\ 5 XOH DQG &KHE\VKHYV,QHTXDOLW\

s $SSUR[LPDWLRQV

s * DPPD GLVWULEXWLRQ

s :HLEXOO GLVWULEXWLRQ

� �

Page 69: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

8QLIRU P 'LVWU LEXWLRQ�IU RP GLVFU HWH WR FRQWLQXRXV

' LVFUHWH 8QLIRUP ' LVWULEXWLRQ< DVVXPHV YDOXHV \� � \� � � � � � \NZLWK HTXDO SUREDELOLW\3 �< \� �

N IRU \ \� � \� � � � � � \N

p(y)

yk

1/k

y4y3y2y1

&RQWLQXRXV 8QLIRUP ' LVWULEXWLRQ< DVVXPHV YDOXHV LQ LQWHUYDO >$�% @ZLWK HTXDO SUREDELOLW\�I�\� �

%b$ LI $ x \ x %

f(y)

B

1/(B-A)

A

� �

Page 70: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQWLQXRXV 5DQGRP 9DU LDEOHV

/HW < EH D FRQWLQXRXV UDQGRP YDULDEOH� $SUREDELOLW\ GHQVLW\ IXQFWLRQ �SGI � RI < LV D IXQF�WLRQ I�\� VXFK WKDW� IRU DQ\ WZR QXPEHUV D DQGE ZLWK D x E�

3 �D x < x E� = ED I�\�G\

1RWH�5��b� I�\�G\ � DQG � x I�\�

IRU DOO \

bay

f(y)

� �

Page 71: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQWLQXRXV 5DQGRP 9DU LDEOHV FRQW�

,I < LV D FRQWLQXRXV UDQGRP YDULDEOH� WKHQ 3 �< F� � IRU DQ\ QXPE HU F� $OVR� IRU DQ\ � QXPEHUV D�E ZLWK D � E� WKHQ

3 �D x < x E� 3 �D � < x E�

3 �D x < � E�

3 �D � < � E�

1RWLFH WKLV ZDV QRW WUXH IRU D GLVFUHWH UDQGRPYDULDEOH�

� �

Page 72: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&XPXODWLYH 'LVWU LEXWLRQ )XQFWLRQ

/HW < E H D FRQWLQXRXV UDQGRP YDULDEOH� 7KHFXPXODWLYH GLVWULEXWLRQ IXQFWLRQ ) �\� LV GHpQHGIRU HYHU\ QXPE HU \ E\

) �\� 3 �< x \� = \b� I�[�G[

bay

f(y)

ay

F(y)

� �

Page 73: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

' LVFUHWH &RQWLQXRXV

GHQVLW\ IXQFWLRQ GHQVLW\ IXQFWLRQS�\� 3 �< \� I�\�

&XP� ' LVW� ) Q� &XP� ' LVW� ) Q�) �\� ) �\�

p(y)

F(y)

f(y)

F(y)

) �\� LV ) �\� LV WKHWKH VXP RI S�\� LQWHJUDO RI I�\�

S�\� LV WKH GLoHUHQFH I�\� LV WKH GHULYDWLYHE HWZHHQ WZR RI ) �\��) �\� YDOXHV I�\� ) ��\�

� �

Page 74: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

' LVFUHWH &RQWLQXRXV

) �\� \;b�

S�[� ) �\� = \b� I�[�G[

( >< @ ��;b�

\S�\� ( >< @ = ��b� \I�\�G\

( >+�< �@ ( >+�< �@

��;b�

+�\�S�\� = ��b� +�\�I�\�G\

9 DU �< � 9 DU �< �

��;b�

�\ b z�� S�\� = ��b� �\ b z�� I�\�G\

(x

�< b z��y

(x

�< b z��y

(x< �

yb z� (x< �

yb z�

� U9 DU �< � �

U9 DU �< �

� �

Page 75: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQWLQXRXV 'LVWU LEXWLRQV ( [DPSOH

6XSSRVH WKH GHQVLW\� I�\�� RI WKH PDJQLWXGH <RI D G\QDPLF ORDG RQ D EULGJH �LQ QHZWRQV� LVJLYHQ E\

I�\�

�!!�!!��� � �

� \ LI � x \ x �� RWKHUZLVH

21 y

1/8

7/8

f(y)

) LQG WKH SUREDELOLW\ WKH ORDG H[FHHGV �� DQGpQG WKH H[SHFWHG ORDG�

3 �< ! �� � b 3 �< x �� � b ) ���

( >< @ = �� \I�\�G\

� �

Page 76: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQWLQXRXV 'LVW� ( [DPSOH &RQW�

' HWHUPLQH ) �\��

) �\� 3 �< x \� = \b� I�[�G[

= \� �

��

�[�G[

�[ �

� c �[ �

ppppppp\

\

��

��\ � IRU � x \ x �

21 y

1

F(y)

� �

Page 77: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQWLQXRXV 'LVW� ( [DPSOH &RQW�

3 �< ! �� SURE� WKH ORDG H[FHHGV �

� b ) ��� � b ��

��

���

��

�� �����

( >< @ z = �� \I�\�G\

= �� \

�%#�

��

�\�&$ G\

� c �\ � �

� c �\ �

ppppppp�

���

� �

� �

Page 78: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 RU PDO 'LVWU LEXWLRQ

$ FRQWLQXRXV UDQGRP YDULDEOH < KDV D QRUPDOGLVWULEXWLRQ ZLWK SDUDPHWHUV z DQG � �RU � � ��ZULWWHQ < | 1�z� ��� ZKHUH b� � z � � �DQG � � � � � �� LI WKH SUREDELOLW\ GHQVLW\IXQFWLRQ LV�

I�\� z� �� �S

�}�Hb� \bz�

� � � � b� � \ � � �7KHQ�

( >< @ z� 9 DU �< � � � DQG

) �\� LV JLYHQ LQ WDEOHV� RU HYDOXDWHG QXPHUL�FDOO\�

µ σ y

f(y)

� �

Page 79: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6WDQGDU G 1 RU PDO 'LVWU LEXWLRQ

= | 1��� �� KDV D VWDQGDUG QRUPDO GLVWULEXWLRQ�z �� � ��

I�]� �S

�}Hb]

� � b� � ] � � �) �]� 3 �= x ]� j�]�

0 z

f(z)

a

<bz� KDV D VWDQGDUG QRUPDO GLVWULEXWLRQ� LI

< | 1�z� ��� WKHQ <bz� | 1��� ��

� �

Page 80: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

]U 1 RWDWLRQ

7KH QRWDWLRQ ]U GHQRWHV WKH YDOXH RQ WKH D[LVRI D VWDQGDUG QRUPDO GHQVLW\ IRU ZKLFK

3 �= y ]U� U

0 z

f(z)

zr

r

,W LV VDLG WKDW ]U LV WKH �����b U�WK SHUFHQWLOHRI WKH VWDQGDUG QRUPDO GLVWULEXWLRQ�

� �

Page 81: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( YDOXDWH < | 1�z� ��

XVLQJ = | 1��� ��

,I < | 1�z� ��� D QRUPDO GLVWULEXWLRQ� WKHQ= <bz

� KDV D VWDQGDUG QRUPDO GLVWULEXWLRQ�

&KHFN ( >=@� ( >=@ (x<bz�

y

( >< @ b z

zb z

� �

&KHFN 9 DU �=�� 9 DU �=� 9 DUv<bz�

w 9 DU

v<� b z

w

� �9 DU �< �

� �

� � �

&KHFN FXPXODWLYH GLVWULEXWLRQ IXQFWLRQ� VHH WH[W

� �

Page 82: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 RU PDO 'LVWU LEXWLRQ ( [DPSOH

6XSSRVH < LV WKH EUHDNLQJ VWUHQJWK �QHZWRQV�RI D PDWHULDO� DQG

< | 1�z ���� � ����

:H QHHG WKLV PDWHULDO WR KDYH D EUHDNLQJ VWUHQJWKRI DW OHDVW ����

) LQG 3 �< y �����7UDQVIRUP < WR = XVLQJ = <bz

3 �< y ���� 3 �\ b z y ��� b ����

3v<bz� y � � � b� � �

� �

w 3

v= y b� �

� �

w 3 �] y b����

� b 3 �] x b���� � b ������

������

800 y

f(y)

772 0 z

f(z)

−2.8

� �

Page 83: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5HODWLQJ � WR GHQVLW\

1RUPDO 3UREDELOLW\ 5 XOH�

,I < | 1�z� �� WKHQ

3 �b � � < b z � �� } ����

3 �b�� � < b z � ��� } ����

3 �b�� � < b z � ��� } ����

µ y

f(y)

µ+σ µ+2σµ+σµ+2σ

� �

Page 84: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

5HODWLQJ � WR 'HQVLW\ FRQWLQXHG

&KHE\VKHYV ,QHTXDOLW\�

,I < LV DQ\ UDQGRP YDULDEOH� ZLWK PHDQ z DQGVWDQGDUG GHYLDWLRQ �� WKHQ IRU N ! ��

3 �M< b zM � N�� y � b �

N ��

N � 3 �b� � < b z � �� y � b �

� �

N � 3 �b�� � < b z � ��� y � b �

N � 3 �b�� � < b z � ��� y � b �

µ y

f(y)

µ+σ µ+2σµ+σµ+2σ

� �

Page 85: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

8VLQJ 1 RU PDO 'LVWU LEXWLRQ 7 R

$SSU R[LPDWH % LQRPLDO 'LVWU LEXWLRQ

6XSS RVH < | %LQRPLDO�Q� S�

z QS

� � QST

DQG VXSSRVH WKH ELQRPLDO GLVWULEXWLRQ LV IDLUO\V\PPHWULF �QS y � DQG QT y ���

7KHQ 3 �< x \� } 3�#= x \�� � � bQSS

QST

�$

µ y

f(y)

y+0.5

� �

Page 86: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

)DPLO\ RI *DPPD 'LVWU LEXWLRQV

< | * DPPD�o� p�

I�\� o� p� �

pob�o�\ob� Hb\ p LI \ y �

z op

� � op �

< | ([S RQHQWLDO�y� < | &KL�6TXDUHG�{�I�\� y� yHby\ I�\� {� �

� { � b � {� �\{� b� Hb\ �

z �y z {

� � �y�

� � �{6S HFLDO FDVH RI 6S HFLDO FDVH RI

* DPPD�o �� p �y� * DPPD�o {

� � p ��8VHG LQ UHOLDELOLW\� 8VHG LQ K\S RWKHVLV WHVWLQJ

TXDOLW\ TXHXHLQJ �{ GHJUHHV RI IUHHGRP�

� �

Page 87: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'HpQH *DPPD )XQFWLRQ� b�o�

' HpQLWLRQ�) RU o ! �� WKH JDPPD IXQFWLRQ LV GHpQHG E\

b�o� = �� \ob� Hb\G\

3URSHUWLHV�

s ) RU DQ\ o ! �� b�o� �ob ��b�ob ��

s ) RU DQ\ SRVLWLYH LQWHJHU Q�

b�Q� �Qb ���

s b� �� � S}

s b��� �

� �

Page 88: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

*DPPD )XQFWLRQ ( [DPSOH

([DPSOH�

< VXUYLYDO WLPH �ZHHNV� RI D PRXVH

H[S RVHG WR JDPPD UDGLDWLRQ

< | * DPPD�o �� p ���

0 HDQ VXUYLYDO WLPH ( >< @ op

������� ��� ZHHNV

9DULDQFH 9 DU �\� op � ����

6WDQGDUG ' HYLDWLRQ � S

���� ����� ZHHNV

3URE� D PRXVH VXUYLYHV DW OHDVW �� ZHHNV

3 �< y ��� � b 3 �< x ������ HYDOXDWH QXPHULFDOO\

} � b ����� b �����

� �

Page 89: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [SRQHQWLDO 'LVWU LEXWLRQ

< | ([S RQHQWLDO�y� �* DPPD�o �� p �

y��

I�\� y�

�!!�!!�yHby\ LI \ y �� RWKHUZLVH

z �

y

� � �

y�

) �\� y�

�!!�!!�� \ x �� b Hby\ \ y �

8VHIXO LQ VWDWLVWLFDO TXDOLW\ FRQWURO� UHOLDELOLW\DQG TXHXHLQJ�

y

f(y)

y

F(y)

1

� �

Page 90: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KL�6TXDU HG 'LVWU LEXWLRQ

< | &KL�6TXDUHG�{� �* DPPD�o {

�� p ���

RIWHQ GHQRWHG �� � { LV FDOOHGGHJUHHV RI IUHHGRP

I�\� {�

�!!!�!!!��

� { � b � { � �\ � { � � b� Hb\ � \ y �

� RWKHUZLVH

z {

� � �{

8VHIXO LQ K\S RWKHVLV WHVWLQJ�

� �

Page 91: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

:HLEXOO 'LVWU LEXWLRQ

< | :HLEXOO�o� p�

I�\� o� p�

�!!!�!!!�opo\ob� Hb� \ p �

o\ y �

� \ � �

z pb�� � � o�

� � p � b�� � � o� b p � �b�� � � o���

) �\� o� p�

�!!�!!�� \ � �� b Hb� \ p �

o\ y �

1RWLFH� 7KH H[S RQHQWLDO GLVWULEXWLRQ �y� LVDOVR D VSHFLDO FDVH RI WKH :HLEXOOGLVWULEXWLRQ ZLWK �o �� p � y��

8VHIXO LQ UHOLDELOLW\�

� �

Page 92: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU �

-RLQW 3 U REDELOLW\ 'LVWU LEXWLRQV

� �

Page 93: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU �

s -RLQW ' HQVLWLHV DQG ,QGHSHQGHQFH

s ([S HFWDWLRQ DQG &RYDULDQFH

s &RUUHODWLRQ

s &RQGLWLRQDO ' HQVLWLHV

� �

Page 94: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

-RLQW 3 U REDELOLW\ 'LVWU LEXWLRQVIRU 'LVFU HWH 5DQGRP 9DU LDEOHV

/HW ; DQG < E H GLVFUHWH UDQGRP YDULDEOHV� 7KHMRLQW GHQVLW\ IXQFWLRQ IRU ; DQG < LV�

S;< �[� \� 3 �; [ DQG < \��

s 7ZR &RQGLWLRQV�

��� S;< �[� \� y ����

;DOO [

;DOO \

S;< �[� \� �

s 7KH GLVFUHWH PDUJLQDO GHQVLW\ IRU ; LV�

S;�[� ;DOO \

S;< �[� \�

s 7KH GLVFUHWH PDUJLQDO GHQVLW\ IRU < LV�

S< �\� ;DOO [

S;< �[� \�

� �

Page 95: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH� 6XSS RVH ZH KDYH ��� OLJKW EXOEV�ZH FKRRVH � UDQGRPO\ DQG � DWWULEXWHV DUH WHVWHG�

��� ' RHV WKH OLJKW ZRUN" �HOHPHQW�

��� ' RHV LW pW WKH VRFNHW" �WKUHDG�

; QXPEHU RI OLJKW EXOEV ZLWK GHIHFWLYHHOHPHQWV

< QXPEHU RI OLJKW EXOEV ZLWK GHIHFWLYHWKUHDGV

6XSSRVH �� OLJKWEXOEV KDYH GHIHFWLYH HOHPHQWV� OLJKEXOEV KDYH GHIHFWLYH WKUHDGV�� OLJKWEXOEV KDYH GHIHFWLYH HOHPHQWVDQG WKUHDGV�

3 Def. Threads2

Def. Elements7

88 Nondef.

� �

Page 96: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

:KDW LV WKH MRLQW SUREDELOLW\ GLVWULEXWLRQ"

3�; [�< \� \ � \ � \ �

[ �

[ �

[ �

3 Def. Threads2

Def. Elements7

88 Nondef.

� �

Page 97: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH FRQWLQXHG�

3�; [�< \� \ � \ � \ � S;�[�

[ � ������ ������ ������ ������[ � ������ ������ ������ ������[ � ������ ������ ������ ������S< �\� ������ ������ ������ ������

1RWLFH WKDW[ �;[ �

\ �;\ �

S�[� \� ���

� �

Page 98: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'HQVLW\ )XQFWLRQV

s -RLQW ' HQVLW\ ) XQFWLRQ

0 0 1 2

1

2

fxy(x,y)

s 0 DUJLQDO ' HQVLW\ ) XQFWLRQV

0

1

2

y

fy(y)

0 1 2

fx(x)

x

� �

Page 99: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

-RLQW 3 U REDELOLW\ 'LVWU LEXWLRQ

IRU &RQWLQXRXV 5DQGRP 9DU LDEOHV

/HW ; DQG < E H FRQWLQXRXV UDQGRP YDULDEOHV�7KH MRLQW GHQVLW\ IXQFWLRQ IRU ; DQG < LV�

I;< �[� \��

s 7ZR FRQGLWLRQV�

��� I;< �[� \� y �

���= ��b�

= ��b� I;< �[� \�G[G\ �

s 7KH FRQWLQXRXV PDUJLQDO GHQVLW\ IRU ;�

I;�[� = ��b� I;< �[� \�G\

s 7KH FRQWLQXRXV PDUJLQDO GHQVLW\ IRU < �

I< �[� = ��b� I;< �[� \�G[

� �

Page 100: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH� $ EDQN RS HUDWHV D GULYH�LQ IDFLOLW\DQG D ZDON�XS ZLQGRZ�

/HW ; SURS RUWLRQ RI WLPH WKH GULYH�LQ LV XVHG< SURSRUWLRQ RI WLPH WKH ZDON�XS LV XVHG

I;< �[� \�

�!!�!!��� �[ � \ � � IRU � x [ x �� � x \ x �

� RWKHUZLVH

1RWH�= ��b�

= ��b�

��[ � \ � �G[G\ �

1

y

x

1

fxy(x,y)

1

fxy(x,y)

x

1

y

1

fxy(x,y)

x

y

f(0,0)=0 f(0,1)=6/5f(1,1)=12/5 f(1,0)=6/5

� � �

Page 101: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH FRQWLQXHG�

0 DUJLQDO GHQVLW\ IXQFWLRQV�

I;�[� = ��b� I;< �[� \�G\

= ��

��[ � \ � �G\

�!!�!!��� �[ � �

� � IRU � x [ x �� � x \ x �� RWKHUZLVH

I< �\� = ��b� I;< �[� \�G[

= ��

��[ � \ � �G[

�!!�!!��� �\ � � �

� � IRU � x [ x �� � x \ x �� RWKHUZLVH

x

fx(x)

y

fY(y)

� � �

Page 102: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

, QGHSHQGHQFH

/HW ; DQG < EH UDQGRP YDULDEOHV ZLWK MRLQWGHQVLW\ I;< �[� \� DQG PDUJLQDO GHQVLWLHV I;�[�DQG I< �\� UHVSHFWLYHO\�

7KH WZR UDQGRP YDULDEOHV ; DQG < DUH LQGHSHQGHQWLI DQG RQO\ LI

I;< �[� \� I;�[�I< �\�

IRU DOO [ DQG \�

� � �

Page 103: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [SHFWHG 9DOXH

/HW ; DQG < E H � UDQGRP YDULDEOHV� 7KHQ WKHH[S HFWHG YDOXH RI D IXQFWLRQ +�;� < � GHQRWHGDV (>+�;�< �@ LV�

(>+�;�< �@

�!!!!!!!!!!!!!!!!!�!!!!!!!!!!!!!!!!!�

;DOO [

;DOO \

+�[� \�S;< �[� \� LI ;�<

GLVFUHWH

= ��b�

= ��b� +�[� \�I;< �[� \�G\G[ LI ;�<

FRQWLQXRXV

([DPSOHV�

+�;� < � ; � <

+�;� < � M; b < M+�;� < � ; <

+�;� < � ;<

� � �

Page 104: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RYDU LDQFH

$ PHDVXUH RI KRZ VWURQJO\ ; DQG < DUH UHODWHGWR RQH DQRWKHU�

&RY�;� < � �;< (>�; b z;��< b z< �@

(>;< @ b z;z<

�!!!!!!!!!!!!!!!!!�!!!!!!!!!!!!!!!!!�

;DOO [

;DOO \

�[�z[��\�z\�S;< �[� \� LI ;�<

GLVFUHWH

= ��b�

= ��b� �[�z[��\�z\�I;< �[� \�G[G\ LI ;�<

FRQWLQXRXV

,I ; DQG < DUH LQGHSHQGHQW� WKHQ

&RY�;�< � ��

% XW &RY�;�< � FDQ �� ZKHQ ; DQG < DUHGHSHQGHQW�

� � �

Page 105: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RU U HODWLRQ

7KH FRUUHODWLRQ FRHrFLHQW RI ; DQG < GHQRWHG&RUU�;� < �� RU ~;�< LV�

~;�< &RY�;�< �

�;�<

s ,I D� F DUH HLWKHU ERWK S RVLWLYH RU E RWK QHJD�WLYH� &RUU�D; � E� F< � G� &RUU�;�< �

s ) RU DQ\ ;� < � WKHQ

b� x &RUU�;�< � x �

s ,I ;� < DUH LQGHSHQGHQW� WKHQ ~;�< �

1RWH� ~;< � GRHV QRW LPSO\ ;�< DUH LQGH�SHQGHQW

� � �

Page 106: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQGLWLRQDO 3 U REDELOLW\

/HW ; DQG < E H WZR UDQGRP YDULDEOHV ZLWK MRLQWGHQVLW\ I;< DQG PDUJLQDO GHQVLWLHV I; DQG I< �

7KH FRQGLWLRQDO GHQVLW\ IRU ; JLYHQ < \ LV�

I;M< �[� I;< �[� \�

I< �\�

7KH FRQGLWLRQDO GHQVLW\ IRU < JLYHQ ; [ LV�

I< M;�\� I;< �[� \�

I;�[�

� � �

Page 107: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU V � DQG �

3 RLQW DQG , QWHU YDO ( VWLPDWLRQ

� � �

Page 108: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU V � DQG �

s 3RLQW (VWLPDWLRQ

s 8QELDVHG (VWLPDWRUV

s ,QWHUYDO (VWLPDWRUV �&RQpGHQFH ,QWHUYDOV�

s (VWLPDWLRQ RI D 3RSXODWLRQ 0 HDQ

s (VWLPDWLRQ RI D 3RSXODWLRQ 9DULDQFH

s (VWLPDWLRQ RI D 3RSXODWLRQ 3URS RUWLRQ

� � �

Page 109: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 RLQW ( VWLPDWLRQ

$ S RLQW HVWLPDWH RI D SDUDPHWHU v LV REWDLQHGE\ VHOHFWLQJ DQ DSSURSULDWH VWDWLVWLF� DQG FRP�SXWLQJ LWV YDOXH XVLQJ WKH VDPSOH GDWD� 7KHVHOHFWHG VWDWLVWLF LV FDOOHG WKH SRLQW HVWLPDWRU�

([DPSOH�3DUDPHWHU RI LQWHUHVW� z� WKH SRS� PHDQ

6WDWLVWLF RU HVWLPDWRU� z< Q;

L �<L Q Az

3RLQW HVWLPDWH� ����

([DPSOH�3DUDPHWHU RI LQWHUHVW� S� SURE� RI VXFFHVV6WDWLVWLF RU HVWLPDWRU� < Q AS3RLQW HVWLPDWH� ����

([DPSOH�3DUDPHWHU RI LQWHUHVW� � � � YDULDQFH

6WDWLVWLF RU HVWLPDWRU� V� Q;

L �

�<L b z< ��

Qb �3RLQW HVWLPDWH� ���

� � �

Page 110: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

8QELDVHG ( VWLPDWRU V

$Q HVWLPDWRU Av LV DQ XQELDVHG HVWLPDWRU IRU DSDUDPHWHU v LI DQG RQO\ LI

(> Av@ v�

s ([DPSOH�

^ ,I < | % LQRPLDO�Q� S�� WKHQ WKH VDPSOHSURS RUWLRQ� < Q LV DQ XQELDVHG HVWLPDWRURI S� SUREDELOLW\ RI VXFFHVV

^ 7R FKHFN�

(>< Q@ �

Q(>< @

QS

Q S

� � �

Page 111: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

s ([DPSOH�

^ ,I <� � <� � � � � � <Q LV D UDQGRP VDPSOH� WKHQz<

Q;L �

<L Q LV DQ XQELDVHG HVWLPDWRU RIz�

^ 7R FKHFN�

(> z< @ (>Q;

L �<L Q@

�Q�(><� @ � (><� @ � � � � � (><Q@�

�Q�z � z � � � � � z� Qz

Q

z

� � �

Page 112: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

s /HW V� E H WKH VDPSOH YDULDQFH EDVHG RQ DUDQGRP VDPSOH RI VL]H Q� IURP D GLVWULEXWLRQZLWK PHDQ z DQG YDULDQFH � � �

s V� LV DQ XQELDVHG HVWLPDWRU IRU � � � EXW V LVD ELDVHG HVWLPDWRU IRU �� �DV ORQJ DV Q LVODUJH� WKH ELDV LV QHJOLJLEOH�

s 7R FKHFN�

(>V� @ �Qb� (>

Q;L �

�<L b z< � � @

���

�Qb� �Q� � b � � �

� �

� � �

Page 113: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

s 7KHUH PD\ EH VHYHUDO XQELDVHG HVWLPDWRUVIRU D SDUDPHWHU�

s ) RU H[DPSOH�

z< � a< �PLQ<L � PD[<L

�� z< W U LP P H G

DUH DOO XQELDVHG HVWLPDWRUV IRU z�

s +RZ WR FKRRVH DPRQJ WKHP"

^ 0 HWKRG RI 0 RPHQWV

^ 0 D[LPXP /LNHOLKR RG (VWLPDWRUV

^ 0 98( 0 LQLPXP 9DULDQFH 8QELDVHG (V�WLPDWRU

� � �

Page 114: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQpGHQFH , QWHU YDOV

s ,QVWHDG RI D SRLQW HVWLPDWRU� DQ LQWHUYDO HV�WLPDWRU �RU FRQpGHQFH LQWHUYDOV� JLYHV PRUHLQIRUPDWLRQ�

s $ �����bo�� FRQpGHQFH LQWHUYDO IRU D SD�UDPHWHU v LV D UDQGRP LQWHUYDO >/� � /� @� VXFKWKDW

3 �/� x v x / � � } � b o�

s 7R pQG / � DQG /� � ZH QHHG WR NQRZ WKHGLVWULEXWLRQ RI D UDQGRP YDULDEOH LQYROYLQJv�

s ) RU H[DPSOH� z< b Az� DQG ZH QHHG GLVWULEX�WLRQ RI z< �

s /HW <� � <� � � � � � <Q EH D UDQGRP VDPSOH RIVL]H Q IURP D QRUPDO GLVWULEXWLRQ ZLWK PHDQz DQG YDULDQFH � � � 7KHQ

z< | 1RUPDO�z z< z� � � z< � � Q�

� � �

Page 115: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6XPV RI 1 RU PDO 5�9�V

s ,I <� � <� � � � � � <Q DUH LQGHS HQGHQW UDQGRP YDUL�DEOHV ZLWK <L | 1�zL� �L� WKHQ

< D � <� � D � <� � � � � � DQ<Q

< | 1�z< � �< �

s ZKHUH

z< z � � z � � � � � � zQ

� �< D �� ��� � D�� �

�� � � � � � D�Q�

�Q

� � �

Page 116: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 KH &HQWU DO /LPLW 7 KHRU HP

s /HW <� � <� � � � � � <Q EH D UDQGRP VDPSOH ZLWKPHDQ z DQG YDULDQFH � � �

s ) RU VXrFLHQWO\ ODUJH Q�

z< | 1�z z< z� � � z< � � Q�

s DQG

7R | 1�z7R Qz� � �7R Q� � �

s 7KH ODUJHU Q� WKH EHWWHU WKH DSSUR[LPDWLRQ��LI Q ! ��� &/7 FDQ EH XVHG�

� � �

Page 117: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH�

�� VDPSOHV RI RQH�JDOORQ FDQV RI SDLQW ZHUH WHVWHGWR VHH KRZ PDQ\ VTXDUH IHHW FRXOG EH FRYHUHGZLWK � FDQ� 7KH UHVXOWV RI WKH H[S HULPHQW DUHJLYHQ EHORZ� &RQVWUXFW D FRQpGHQFH LQWHUYDOIRU DYHUDJH VTXDUH IR RWDJH FRYHUHG E\ � FDQ RISDLQW�

��� ��� ��� ��� ������ ��� ��� ��� ������ ��� ��� ��� ������ ��� ��� ��� ������ ��� ��� ��� ������ ��� ��� ��� ������ ��� ��� ��� ������ ��� ��� ��� ���

� � �

Page 118: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

��� &RQpGHQFH , QWHU YDO IRU z

s 6XSSRVH ZH KDYH D UDQGRP VDPSOH <� � <� � � � � � <Q

ZKHUH <L | 1�z� � � � DQG z LV XQNQRZQ DQG� LV NQRZQ� 7KHQ

3 � z<b����� SQ x z x z< � �����

SQ� ���

s 1RZ VXSSRVH ZH REVHUYH <� \� � <� \� � � � � � <Q \Q DQG ZH FRPSXWH z\ DQG VXE�VWLWXWH z\ IRU z< � 7KHQ

� z\ b ����� SQ� z\ � �����

SQ�

LV FDOOHG D ��� FRQpGHQFH LQWHUYDO IRU z RU

z< b ����� SQ x z x z< � �����

SQ

ZLWK ��� FRQpGHQFH

� � �

Page 119: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

, QWHU SU HWLQJ &RQpGHQFH , QWHU YDOV

6XSSRVH ZH VDPSOHG DQRWKHU �� SDLQW FDQV DQGFRQVWUXFWHG D FRQpGHQFH LQWHUYDO� $QG LI ZH GLGWKLV DJDLQ DQG DJDLQ� DSSUR[LPDWHO\ ��� RI WKHFRQVWUXFWHG LQWHUYDOV ZRXOG FRQWDLQ z� DQG ��RI WKH FRQVWUXFWHG LQWHUYDOV ZRXOG QRW FRQWDLQz�

True Value of µ

530520510500490

Interval 1

Interval 2

Interval 3

Interval 4

Interval 5

Interval 6

Interval 7

Interval 8

� � �

Page 120: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQpGHQFH , QWHU YDO IRU z

$ ����� b o�� FRQpGHQFH LQWHUYDO� � � o � ��IRU WKH PHDQ z RI D 1RUPDO SRSXODWLRQ �ZKHQ� LV NQRZQ� LV JLYHQ E\�

� z< b =o � � SQ x z x z< � =o � �

SQ�

fz(z)

1-α

0 zα/2-zα/2

α/2α/2

� � �

Page 121: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'HU LYLQJ D &RQpGHQFH , QWHU YDO

s :H FDQ GHULYH D FRQpGHQFH LQWHUYDO IRU DQ\VWDWLVWLF

s 6XSSRVH <� � <� � � � � � <Q LV D UDQGRP VDPSOHDQG ZH ZDQW WR HVWLPDWH v

s ) LQG DQ HVWLPDWRU Av DQG LWV GLVWULEXWLRQ

s 7KLV VXJJHVWV D IXQFWLRQ K�< � � <� � � � � � <Q� v�ZLWK

3 �D x K�<� � <� � � � � � <Q� v� x E� � b o

s ,VRODWH v�

3 �O� �< � � < � � � � � � <Q� x v x O� �<� � < � � � � � � <Q�� �bo

s 7KH ORZHU DQG XSS HU FRQpGHQFH OLPLWV IRU D�����bo�� FRQpGHQFH LQWHUYDO DUH JLYHQ E\

O � �<� � <� � � � � � <Q� DQG O� �<� � <� � � � � � <Q�

� � �

Page 122: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ WKH 0 HDQ

s z< LV RXU HVWLPDWRU IRU WKH SRSXODWLRQ z

s ,I WKH SRSXODWLRQ � � LV NQRZQ� DQG WKH VDP�SOH FRPHV IURP D QRUPDO GLVWULEXWLRQ� WKHQ=

z<bz� SQ KDV D VWDQGDUG QRUPDO GLVWULEX�

WLRQ

s ,I WKH S RSXODWLRQ � � LV XQNQRZQ EXW WKHVDPSOH FRPHV IURP D QRUPDO GLVWULEXWLRQ�WKHQ 7

z<bz6 SQ KDV D W�GLVWULEXWLRQ ZLWK

q Qb � GHJUHHV RI IUHHGRP

� � �

Page 123: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

W�GLVWU LEXWLRQ

7KH W�GLVWULEXWLRQ �7 �� LV VLPLODU WR WKH VWDQ�GDUG QRUPDO GLVWULEXWLRQ �=�

s ERWK PHDQV HTXDO ]HUR �z= zWq ��

s ERWK DUH EHOO�VKDS HG

s WKH QRUPDO GLVWULEXWLRQ KDV WZR SDUDPHWHUV�z� ��� EXW WKH W�GLVWULEXWLRQ KDV RQO\ RQHSDUDPHWHU �q ' 2 ) �

s WKH GHQVLW\ Wq LV VSUHDG RXW PRUH WKDQ WKHVWDQGDUG QRUPDO� �Wq ! �= �

0

Z curve

t25 curve

t5 curve

s DV q � � �� Wq � VWDQGDUG QRUPDO

� � �

Page 124: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ WKH 0 HDQ FRQWLQXHG

,I WKH SRSXODWLRQ � � LV NQRZQ� DQG WKH VDPSOHFRPHV IURP D QRUPDO GLVWULEXWLRQ� ZH KDG�

3 �b]o � x = z<bz� SQ x � ]o � � � b o

JLYHV

3 � z< b ]o ��SQ x z x z< � ]o �

�SQ� � b o

,I WKH S RSXODWLRQ � � LV XQNQRZQ EXW WKH VDP�SOH FRPHV IURP D QRUPDO GLVWULEXWLRQ� ZH KDYH�

3 �bWo � x 7 z<bz6 SQ x � Wo � � � b o

JLYHV

3 � z< b Wo �6SQ x z x z< � Wo �

6SQ� � b o

1-α

0 tα/2-tα/2

α/2α/2

� � �

Page 125: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ WKH 0 HDQ VXPPDU L]HG

������o�� &, RQ z ZKHQ � � LV NQRZQ�

/HW <� � <� � � � � � <1 E H D UDQGRP VDPSOH IURP DQRUPDO GLVWULEXWLRQ ZLWK PHDQ z DQG YDULDQFH� � � $ ����� b o�� FRQpGHQFH LQWHUYDO RQ z LVJLYHQ E\

z< h ]o ��SQ

������o�� &, RQ z ZKHQ � � LV XQNQRZQ�

/HW <� � <� � � � � � <1 E H D UDQGRP VDPSOH IURP DQRUPDO GLVWULEXWLRQ ZLWK PHDQ z DQG YDULDQFH� � � $ ����� b o�� FRQpGHQFH LQWHUYDO RQ z LVJLYHQ E\

z< h Wo �6SQ

� � �

Page 126: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ WKH 9DU LDQFH

s V� LV RXU HVWLPDWRU IRU WKH S RSXODWLRQ � �

s ,I WKH VDPSOH FRPHV IURP D QRUPDO GLVWULEX�WLRQ� WKHQ

�Qb ��V�

� �

Q;L �

�<L b z< � �

� �

KDV D FKL�VTXDUHG GLVWULEXWLRQ ZLWK Q b �GHJUHHV RI IUHHGRP

&KL�VTXDUHG ��� � GLVWULEXWLRQ�

fx(x)

x

8 degrees of freedom

12 degrees of freedom

20 degrees of freedom

� � �

Page 127: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ WKH 9DU LDQFH FRQWLQXHG

1-α

α

χ2χα2

f(χ)

� � �

Page 128: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ WKH 9DU LDQFH FRQFOXGHG

s ,I WKH VDPSOH FRPHV IURP D QRUPDO GLVWULEX�WLRQ� ZH KDYH�

3 ���� bo � x�Qb ��V�

� �x ��o � � � b o

DQG ZH LVRODWH � � XVLQJ� � � x � Qb� � V���� bo �

DQG

� Qb� � V���o �

x � � REWDLQLQJ D

s ����� b o�� &RQpGHQFH ,QWHUYDO RQ � �

3

�%%%#�Qb ��V �

��o �x � � x �Qb ��V �

��� bo �

�&&&$ � b o

/HW < � � <� � � � � � <Q EH D UDQGRP VDPSOH IURP DQRUPDO GLVWULEXWLRQ ZLWK PHDQ z DQG YDULDQFH� � � $ ����� b o�� FRQpGHQFH LQWHUYDO RQ � � LVJLYHQ E\

�Qb ��V�

��o ��

�Qb ��V �

��� bo �

� � �

Page 129: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ 3 U RSRU WLRQV

s /HW S EH WKH SURS RUWLRQ RI ?VXFFHVVHV� LQ DSRSXODWLRQ�

s /HW < E H WKH QXPEHU RI VXFFHVVHV LQ D VDP�SOH RI VL]H Q� 7KH VDPSOH SURSRUWLRQ� AS <

QLV RXU HVWLPDWRU IRU S� ,W LV DQ XQELDVHG HV�WLPDWRU E HFDXVH

( > AS@ (x<Q

y

( >< @

Q

QS

Q S

9 DU � AS� 9 DUv<Q

w

Q�9 DU �< �

QST

Q �

S�� b S�

Q

� � �

Page 130: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ 3 U RSRU WLRQV &RQWLQXHG

s % \ WKH &HQWUDO /LPLW 7KHRUHP�

AS <

Q|

�!!�!!�DSSUR[� 1RUPDO GLVWULEXWLRQ

ZLWK PHDQ S YDULDQFH S � � bS �Q �

�!! !!�VR

= <Q b SVS � � bS �

Q

LV DSSUR[� 6WDQGDUG 1RUPDO

s :KHQ Q LV ODUJH HQRXJK�

3�%#b]o � x

<QbSS

S � � bS� Q x � ]o �

�&$ � b o

3�#<Q b ]o �

VS � � bS �

Q x S x <Q � ]o �

VS � � bS �

Q

�$ � b o

s ,W LV VR GLrFXOW WR FRPSOHWHO\ LVRODWH S WKDWZH UHSODFH S E\ LWV XQELDVHG HVWLPDWRU AS < Q WR REWDLQ WKH

&RQpGHQFH , QWHU YDO RQ S�

ASh ]o �U

AS�� b AS� Q

� � �

Page 131: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6DPSOH 6L]H IRU ( VWLPDWLQJ S

d d

ASb]o �TAS � � b AS � Q AS AS�]o �

TAS � � b AS � Q

:H DUH ����� b o�� FRQpGHQW WKDW S LV LQ WKHDERYH LQWHUYDO� RI OHQJWK �G� ZKHUH

G ]o � cU

AS�� b AS� Q

6ROYH IRU Q�

Q } ] �o � c AS�� b AS�

G�x ] �o �

�G�

�VLQFH AS�� b AS� x � � ��

� � �

Page 132: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( VWLPDWLQJ 3 U RSRU WLRQV ( [DPSOH

$ FHUWDLQ WUHDWPHQW ZDV HoHFWLYH LQ �� RXW RI ��FDVHV LQ ZKLFK LW ZDV WULHG� ) LQG D ��� FRQp�GHQFH LQWHUYDO IRU WKH SUREDELOLW\ RI HoHFWLYHQHVVLQ D VLQJOH WUHDWPHQW�

AS <

Q

��

��6LQFH �� LV ODUJH� D ��� FRQpGHQFH LQWHUYDO LVJLYHQ E\�

�ASb ]o � c

UAS�� b AS� Q � AS � ]o � c

UAS�� b AS� Q

�%%%#��

��b ����

YXXXXW��

��c ��

�� �� �

��

��� ����

YXXXXW��

��c ��

�� ��

�&&&$

����� b ����� � ���� � ������

������ � ������

� � �

Page 133: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&KDSWHU �

7 HVW RI + \SRWKHVHV

� � �

Page 134: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

2YHU YLHZ RI &KDSWHU �

s (OHPHQWV RI D 6WDWLVWLFDO 7HVW

s &KRRVLQJ WKH 1XOO DQG $OWHUQDWLYH +\S RWKH�VHV

s 7HVWLQJ D 3RSXODWLRQ 0 HDQ

s 7HVWLQJ D 3RSXODWLRQ 3URS RUWLRQ

s &RPSDULQJ 7ZR 3RSXODWLRQ 0 HDQV

s &RPSDULQJ 7ZR 3RSXODWLRQ 3URS RUWLRQV

s &RPSDULQJ 7ZR 3RSXODWLRQ 9DULDQFHV

s &RPSDULQJ 0 HDQV ZLWK 3DLUHG ' DWD

� � �

Page 135: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

+ \SRWKHVLV 7 HVWLQJ

�� 6WDWH WKH QXOO K\SRWKHVLV� + � DQG WKH DOWHU�QDWLYH K\S RWKHVLV +$�

([� 7ZR�WDLOHG WHVW 2 QH�WDLOHG WHVW+ � � z z� + � � z z � �z x z� �+$� z � z� +$� z y z�

�� 6HOHFW WKH DSSURSULDWH WHVW VWDWLVWLF([� 8VH < WR HVWLPDWH z� DQG XVH 7 <bz �

V SQ

�� 6S HFLI\ WKH UHVW RI WKH H[SHULPHQW� VXFK DV�

�L� &KRRVH WKH FULWLFDO UHJLRQ IRU VS HFLpF oDQG Q� RU

�LL� &KRRVH Q IRU VSHFLpF o DQG p�

� � �

Page 136: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

+ \SRWKHVLV 7 HVWLQJ &RQWLQXHG

�� &RPSXWH WKH YDOXH RI WKH WHVW VWDWLVWLF IURPWKH GDWD([� &RPSXWH \ DQG W�

�� ' HFLVLRQ�

s LI WKH YDOXH RI WKH WHVW VWDWLVWLF LV LQ WKHFULWLFDO UHJLRQ� UHMHFW +� ZLWK o OHYHO RIVLJQLpFDQFH� RU

s pQG WKH 3 �YDOXH� L�H� WKH VPDOOHVW OHYHORI VLJQLpFDQFH DW ZKLFK +� ZRXOG EH UH�MHFWHG� RU

s FRQFOXGH WKHUH LV LQVXrFLHQW HYLGHQFH WRUHMHFW +�

� � �

Page 137: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

� 7 \SHV RI ( U U RU V

No Error Type II Error

Type I Error No ErrorReject H0

Accept H0

H0 is True H0 is False

o 3 �W\SH , HUURU� � OHYHO RI VLJQLpFDQFH 3 �UHMHFW+� M+� LV WUXH�

p 3 �W\SH ,, HUURU� � SRZHU RI WKH WHVW 3 �DFFHSW +� M+� LV IDOVH�

Critical Values

Rejection Region Rejection RegionAcceptance Region

� � �

Page 138: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

6WDWLQJ WKH 1 XOO + \SRWKHVLV

,Q VWDWLVWLFV� ZH FDQ RQO\ U HMHFW K\SRWKHVHV�:H FDQ QHYHU SURYH D K\SRWKHVLV� DOO ZH FDQVD\ LV� ZH KDG LQVXrFLHQW HYLGHQFH WR UHMHFW WKHK\SRWKHVLV� 7KH VWURQJ FRQFOXVLRQ LV WR SURYLGHVXrFLHQW HYLGHQFH WR UHMHFW WKH K\S RWKHVLV�

6WDWH WKH QXOO K\S RWKHVLV� KRSLQJ ZH FDQ UHMHFWLW�

( [DPSOH�$ EHHU FRPSDQ\ LV JRLQJ WR FRQWUDFW D JODVVFRPSDQ\ WR VXSSO\ E RWWOHV� 7KH PHDQ EXUVWLQJVWUHQJWK VKRXOG H[FHHG ��� SVL� 7KH\ ZLOO GR DQH[S HULPHQW GHFLGH ZKHWKHU WR VLJQ WKH FRQ�WUDFW�

� � �

Page 139: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

�� +� � z x ���SVL �� + � � z y ���SVL+$� z ! ���SVL +$� z � ���SVL

,I WKH GDWD DOORZV ,I WKH GDWD DOORZVXV WR UHMHFW +� � XV WR UHMHFW + � �

ZH FRQFOXGH WKH ZH FRQFOXGH WKHERWWOHV DUH ERWWOHV DUH

VWURQJ HQRXJK WRR ZHDN

7KLV IRUPXODWLRQ 7KLV IRUPXODWLRQIRUFHV WKH JODVV FR� IRUFHV D

WR GHPRQVWUDWH WKH GHPRQVWUDWLRQ RI DQERWWOHV DUH XQXVXDO QXPEHU

VWURQJ HQRXJK� RI ZHDN E RWWOHV�

� � �

Page 140: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LDJU DP RI o )RU 7 HVWV RQ 3 RS� 0 HDQ

o 3 �W\S H , HUURU� 3 �UHMHFW +� M+ � LV WUXH�XVLQJ < WR HVWLPDWH z�o 3 �< LV LQ UHMHFWLRQ UHJLRQMz z� �

s 8SSHU�WDLOHG WHVW�+� � z z � �z x z� � +$ � z ! z�

µ00

ctα

_y-scalet-scale

Acceptance Region Rejection Region

� � �

Page 141: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LDJU DP RI o IRU 3 RS� 0 HDQ &RQW�

s /RZHU�WDLOHG WHVW�+� � z z � �z x z� � +$ � z � z�

µ00

-c-tα

Acceptance RegionRejection Region

s 7ZR�WDLOHG WHVW�+� � z z � +$ � z � z �

µ0-c-tα

ctα

AcceptanceRejection Rejection

� � �

Page 142: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

( [DPSOH RI 1 HZ 'HVLJQ 7 HVWLQJ

$ FRPSDQ\ SURGXFHV ELDV�SO\ WLUHV LV FRQVLG�HULQJ D FKDQJH LQ WKH WUHDG GHVLJQ� 7KH WLUH OLIHVKRXOG E H DEOH WR H[FHHG ������ PLOHV�

,Q RUGHU WR FRQYLQFH PDQDJHPHQW WKDW WKH QHZGHVLJQ VLJQLpFDQWO\ FKDQJHV WKH DYHUDJH WLUH OLIHWR H[HHG ������ PLOHV� ZH IRUPXODWH WKH IROORZ�LQJ QXOO K\SRWKHVLV�

�� + � � z ��� ��� �z x ��� ����+$� z ! ��� ���

�� &KR RVH WKH WHVW VWDWLVWLF LGHQWLI\ GLVWULEX�WLRQ�XVH < WR HVWLPDWH z�VLQFH RXU SRSXODWLRQ LV E HOO�VKDS HG� ZH ZLOOXVH

7 < b z

V SQ

ZLWK Qb � GHJUHHV RI IUHHGRP�

� � �

Page 143: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 HZ 'HVLJQ 7 HVWLQJ &RQW�

�� 6S HFLI\ WKH UHVW RI WKH H[S HULPHQW� Q� FULWLFDOUHJLRQ� o� p� � � �

�L� ) LUVW� p[ o ���� OHYHO RI VLJQLpFDQFH�DQG pQG WKH FULWLFDO UHJLRQ IRU D p[HG Q�

µ00

ctα

_x-scalet-scale

α

3 �< ! FMz z � � 3�7 <bz �

V SQ ! Wo

3 �< ! z� � Wo�V SQ� o

� � �

Page 144: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 HZ 'HVLJQ 7 HVWLQJ &RQW�

) RU H[DPSOH� LI Q ��� V �����DQG z� ��� ���� o �����

Wo W � � � � ������FKHFN WDEOH� �� GHJ� RI IUHHGRP�DQG WKHQF ��� ��� � ������ � � � �S

� �� ��� ���

� � �

Page 145: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 HZ 'HVLJQ 7 HVWLQJ &RQW�

�� &DOFXODWH WHVW VWDWLVWLF IURP WKH GDWD

([DPSOH� \ ��� ���� V ����DQG Q ���

&DOFXODWH W�

W \ b z�V SQ

��� ��� b ��� ���

���� S

�� �����

µ00

c=20,976t0.01=2.602

_x-scalet-scale

DATA: 20,8572.285

� � �

Page 146: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

1 HZ 'HVLJQ 7 HVWLQJ &RQW�

�� ' HFLVLRQ�7KHUH LV LQVXrFLHQW HYLGHQFH WR UHMHFWWKH QXOO K\SRWKHVLV DW D ���� OHYHO RI VLJQLp�FDQFH�

+RZHYHU� ZH ZRXOG E H DEOH WR UHMHFW WKH QXOOK\SRWKHVLV DW D ���� OHYHO RI VLJQLpFDQFH�

�7R FKHFN WKLV� XVH WDEOH WR JHW W � �� � ������ZLWK �� GHJUHHV RI IUHHGRP��

) LQG WKH 3 �YDOXH� WKH YDOXH DW ZKLFK ZHFRXOG MXVW UHMHFW WKH QXOO K\S RWKHVLV�

� � �

Page 147: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7KH H[DFW 3 �YDOXH LV KDUG WR FDOFXODWH� 6RPHFRPSXWHU SDFNDJHV QXPHULFDOO\ HVWLPDWH 3 �YDOXHTXLWH ZHOO�

7KH WDEOH LQ WKH WH[W RQO\ JLYHV FHUWDLQ YDOXHVIRU o�

q Q ) ���� ���� ����� ������ ����� ����� ����� �����

0

0.05

0.0250.01

1.753 2.131 2.602

6LQFH RXU FDOFXODWHG W�YDOXH LV ������ ZKLFKLV LQEHWZHHQ W � � � � � ����� DQG W� � � � ������WKHQ ZH FRQFOXGH WKDW ZH FDQ UHMHFW WKH QXOOK\SRWKHVLV DW D ����� OHYHO RI VLJQLpFDQFH �RXU3 �YDOXH LV �������

� � �

Page 148: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 RVVLQJ D &RLQ ( [DPSOH�( VWLPDWLQJ D 3 U RSRU WLRQ S

, ORVW D JDPEOLQJ JDPH ZLWK FRLQ WRVVHV DQG ,VXVSHFW WKDW WKH FRLQ ZDV ZHLJKWHG� , ZDQW WRFRQGXFW DQ H[SHULPHQW WR GHPRQVWUDWH WKH FRLQLV XQIDLU�

�� + � � S � � S�

+$� S � � �

�� 6HOHFW WKH DSSURSULDWH WHVW VWDWLVWLF�XVH AS < Q WR HVWLPDWH S�

LI Q LV ODUJH�AS | 1RUPDO�z AS S� � � AS

US � �� b S� � Q�

�DQG QS� y � DQG Q�� b S� � y ��

LI Q LV VPDOO�< | % LQRPLDO�z; QS� �;

SQST�

�RU QS� �y � RU Q�� b S� � �y ��

� � �

Page 149: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 RVVLQJ D &RLQ ( [DPSOH� &RQW�

�� 6S HFLI\ WKH UHVW RI WKH H[S HULPHQW� ) RU H[DP�SOH� VXSS RVH WKH FULWLFDO YDOXHV DUH ��� DQG����

0.4 0.5 0.6

Reject Accept Reject

DQG VXSSRVH Q ��� ) LQG o DQG p�����

o 3 �UHMHFW +� M+� LV WUXH�

3v

��� � <Q RU <

Q � ���MS ���w

3 �� � < RU < ! �MS ����

� b �;\ �

�%%# ��\

�&&$ �����\������ � b\

�b�%%#�%%# ��

�&&$ ����� � �

�%%# ���

�&&$ ����� � �

�%%# ���

�&&$ ����� ��&&$

� b ���� � ��� � ��������� � �

� b ����� | �����

� � �

Page 150: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 RVVLQJ D &RLQ ( [DPSOH� &RQW�

p����� 3 �DFFHSW +� M+ � LV IDOVH�

3 �� x < x �MS ����

�;

\ �

�%%# ��\

�&&$ �����\������ � b\ ����

6LQFH WRVVLQJ D FRLQ LV DQ LQH[S HQVLYH H[S HUL�PHQW� ZH PD\ ZLVK WR KDYH Q EH YHU\ ODUJH�DQG KDYH D QDUURZ FULWLFDO UHJLRQ�

,I Q LV ODUJH� WKHQ

AS <

Q

KDV DQ DSSUR[� 1RUPDO GLVWULEXWLRQ�ZLWKz AS S DQG � AS

US�� b S� Q

�DOVR XVHG IRU FRQI� LQWHUYDO� RU

= ASb SU

S�� b S� Q

� � �

Page 151: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 RVVLQJ D &RLQ ( [DPSOH� &RQW�

1RZ� pQG Q VR WKDW o ���� DQG ZH ZDQW DWLJKW LQWHUYDO RI h����$V EHIRUH�

�� +� � S � �

+$� S � � �

�� AS LV HVWLPDWRU IRU S� DQG XVH =�VWDWLVWLF�

�� o ����� b]o � b����

EHFDXVH 3 �= x b����� ����

8VH WKH H[SUHVVLRQ Q | ] �o ��G�

ZLWK ]o �

���� DQG G ���

Q | �������

������� �����

8VH Q ���

�� &RQGXFW WKH H[SHULPHQW ZLWK Q ���� GH�WHUPLQH AS < Q�

�� 8VH 3 �YDOXH WR UHMHFW WKH K\S RWKHVLV ZLWK DVSHFLpF OHYHO RI VLJQLpFDQFH�

� � �

Page 152: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 7 ZR 0 HDQV�3 U RSRU WLRQV� RU 9DU LDQFHV

7KLV VHFWLRQ VKRZV KRZ WR GUDZ VWDWLVWLFDO LQIHU�HQFHV ZKHQ FRPSDULQJ � UDQGRP YDULDEOHV� 7KHEDVLF VWHSV IRU GHYHORSLQJ FRQpGHQFH LQWHUYDOV K\SRWKHVLV WHVWLQJ UHPDLQ WKH VDPH�

Population 1µ1 σ1

2

Random samplesize n1

Population 2µ2 σ2

2

Random samplesize n2

� � �

Page 153: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

s :KDW DUH \RX WU\LQJ WR HVWLPDWH RU ZKDW LV\RXU K\S RWKHVLV"

^ ' LoHUHQFH E HWZHHQ PHDQV� z� b z� �

^ 5 DWLR RI YDULDQFHV� � �� ��� �

^ ' LoHUHQFH EHWZHHQ SURSRUWLRQV� S� b S � �

s :KDW LV \RXU WHVW VWDWLVWLF DQG ZKDW LV LWVGLVWULEXWLRQ"

^ ' LVWULEXWLRQ RI <� b <� � 6 �� 6�� �

AS � b AS � � GHS HQG RQ DVVXPSWLRQV�

� � �

Page 154: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LoHU HQFH % HWZHHQ � 3 RS� 0 HDQV

([DPSOH� &RPSDUH WKH VWUHQJWK RI FROG�UROOHGVWHHO �z� � ZLWK JDOYDQL]HG VWHHO �z� �� ZKHUH ZHVXVSHFW WKDW JDOYDQL]HG VWHHO LV VWURQJHU�

3RSXODWLRQ �� 3RSXODWLRQ ��&ROG 5 ROOHG 6WHHO * DOYDQL]HG 6WHHO

z� � ��� z� � �

��

UDQGRP VDPSOH UDQGRP VDPSOHRI VL]H Q � RI VL]H Q�

Population 1µ1 σ1

2

Random samplesize n1

Population 2µ2 σ2

2

Random samplesize n2

s :H ZDQW WR HVWLPDWH z� b z�

s 7HVW VWDWLVWLF� <� b <�:KDW LV WKH GLVWULEXWLRQ RI <� b <� "

� � �

Page 155: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LVWU LEXWLRQ RI <� b <�

,I WKH VDPSOH PHDQV <� DQG <� DUH IURP UDQGRPVDPSOHV WKDW DUH LQGHSHQGHQW� DQG VDPSOHGIURP QRU PDO GLVWULEXWLRQV ZLWK PHDQV z� DQGz� DQG YDULDQFHV � �� DQG � �� � UHVSHFWLYHO\� DQGVDPSOH VL]HV Q � DQG Q � � WKHQ

<� b <� | 1RUPDO

�%%%#PHDQ z� b z�

YDULDQFH � ��Q �

� � ��Q �

�&&&$

� � �

Page 156: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LoHU HQFH RI � 0 HDQV

,QGHS HQGHQW VDPSOHV� SRSXODWLRQ KDV D EHOO�VKDS HGGLVWULEXWLRQ�

�<� b <� � b �z� b z� �YXXW� ��Q �

� � ��Q �

|�!!�!!�

6WDQGDUG 1RUPDO�=� ' LVWULEXWLRQ

�!! !!�

8VLQJ 6 �� 6 �� WR HVWLPDWH � �� � �� �

�<� b <� � b �z� b z� �YXXW6 ��Q �

� 6 ��Q�

|�!!�!!�

7�GLVWULEXWLRQZLWK q GHJ� RI IUHHGRP

�!! !!�

q | �#6 ��Q �

� 6 ��Q �

�$��#6 ��Q�

�$�Q � b� �

�#6 ��Q�

�$�Q � b�

� � �

Page 157: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LoHU HQFH RI � 0 HDQV� ( [DPSOH

&ROG�UROOHG VWHHO�$ UDQGRP VDPSOH RI Q � �� JLYHV DQDYHUDJH VWUHQJWK RI \� ����NVL�ZLWK V �� ��

* DOYDQL]HG VWHHO�$ UDQGRP VDPSOH RI Q � �� JLYHV DQDYHUDJH VWUHQJWK RI \� ����NVL�ZLWK V �� ��

�� 1XOO +\S RWKHVLV + � �

z� b z� � �z� y z� �

$OWHUQDWLYH +\SRWKHVLV +$�

z� b z� � � �z� � z� �

� � �

Page 158: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LoHU HQFH RI � 0 HDQV ( [�� &RQW�

�� 6HOHFW WKH WHVW VWDWLVWLF�

<� b <� b �z� b z� �YXXW6 ��Q �

� 6 ��Q �

| W�GLVWULEXWLRQ

ZLWK

q

�#6 ��Q �

� 6 ��Q �

�$��#6 ��Q�

�$�Q � b� �

�#6 ��Q �

�$�Q � b�

v� �� � � � �

� �

w�� � �� � �

� � �� � �� � �

� �

} �� �URXQG GRZQ�

� � �

Page 159: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LoHU HQFH RI � 0 HDQV ( [�� &RQW�

�� &DOFXODWH WKH YDOXH RI WKH WHVW VWDWLVWLF�

�<� b <� � b �z� b z� ��YXXW6 ��Q �

� 6 ��Q �

����� b ����� b �V

� �� � � � �

� �

�QXOO K\S RWKHVLV LV z� b z� ��

b������

� � �

Page 160: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

'LoHU HQFH RI � 0 HDQV ( [�� &RQW�

�� ' HFLVLRQ�

) c c c ���� ���� c c c ����� ������q

�� ����� ����� ����� ������� ����� ����� ����� �����

���� ����� ����� ����� �����

:H FDQ UHMHFW WKH QXOO K\S RWKHVLV DW D YHU \ KLJKOHYHO RI VLJQLpFDQFH �3 �YDOXH OHVV WKDQ ��������7KHUHIRUH ZH FRQFOXGH WKDW ZLWK D YHU\ KLJKSUREDELOLW\� JDOYDQL]HG VWHHO LV VWURQJHU WKDQ FROG�UROOHG VWHHO�

� � �

Page 161: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RQpGHQFH , QWHU YDO IRU z� b z�

$VVXPLQJ�<� b <� � b �z� b z� ��YXXW6 ��

Q �� 6 ��

Q �

KDV D W�GLVWULEXWLRQ� XSSHU ORZHU FRQpGHQFHOLPLWV IRU �����bo�� FRQpGHQFH� DUH JLYHQ DV�

\� b\� bWo �YXXXXXW6

��

Q��

6 ��Q�

� \� b\� � Wo �

YXXXXXW6��

Q ��

6 ��Q�

([DPSOH� ) RU VWHHO H[DPSOH� D ��� FRQpGHQFHLQWHUYDO ZRXOG JLYH o ����� VR Wo � W � �� � � ������ �) URP EHIRUH� q ��� EXW , XVHG q ��LQ WKH WDEOHV WR E H FRQVHUYDWLYH��

\� b \� h �������

YXXXXW��

���

��

�� ����� b ����� h ����

b��� h ����

b���� x z� b z� x b���� ZLWK ��� FRQp�GHQFH�

� � �

Page 162: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 RROHG W�WHVW

7R FRPSDUH z� b z� � DVVXPLQJ�LQGHSHQGHQW VDPSOHVQRUPDO SRSXODWLRQVHTXDO YDULDQFHV� � �� � ��

<� b <� b �z� b z� �V6 �S� �Q � � �

Q ��

|�!!!!!!�!!!!!!�

W�GLVWULEXWLRQ ZLWKQ � � Q � b �

GHJUHHV RI IUHHGRP

�!!!!!! !!!!!!�

ZKHUH 6 �S �Q � b ��6 �� � �Q� b ��6 ��

Q � � Q � b �

� � �

Page 163: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 7 ZR 3 U RSRU WLRQV

/HW�AS� E H WKH SURS RUWLRQ IURP SRS� �� DQGAS� E H WKH SURS RUWLRQ IURP SRS� ��

) RU ODUJH VDPSOH VL]HV �Q � Q � ��

AS� <�Q�

DQG AS� <�Q�

DQG

GS� bS� AS � b AS� <�Q�b <�

Q �

) RU ODUJH VDPSOH VL]HV� WKH HVWLPDWRU AS� b AS �LV DSSUR[� QRUPDO ZLWK PHDQ S� b S � DQG YDUL�

DQFHS� �� b S � �

Q ��

S � �� b S� �

Q ��

7KH ����� b o�� &�,� IRU AS � b AS� LV�

� AS� b AS� � h ]o �

YXXXXW AS � �� b AS� �

Q ��

AS � �� b AS � �

Q�

� � �

Page 164: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 7 ZR 3 U RSRU WLRQV�+ \SRWKHVLV 7 HVWLQJ

7KUHH ) RUPV�

�� +� � S � b S� �S� b S � �� ULJKW�WDLO WHVW

+� � S � b S� ! �S� b S� ��

�� +� � S � b S� �S� b S � �� OHIW�WDLO WHVW

+� � S � b S� � �S� b S� ��

�� +� � S � b S� �S� b S � �� WZR�WDLO WHVW

+� � S � b S� � �S� b S � ��

:H XVH� AS� b AS� � b �S � b S� ��YXXW AS � � � b AS� �

Q�� AS � � � b AS � �

Q �

DV DQ DSSUR[� VWDQGDUG QRUPDO�

� � �

Page 165: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 9DU LDQFHV

+\SRWKHVLV WHVWV RQ WZR S RS� YDULDQFHV�

5 LJKW�WDLOHG� + � � � �� � ��+$� � �� ! � ��

/HIW�WDLOHG� + � � � �� � ��+$� � �� � � ��

7ZR�WDLOHG� + � � � �� � ��+$� � �� � � ��

7HVW 6WDWLVWLF� 6 �� 6��

s ,I � �� � �� � WKHQ 6 �� 6�� LV FORVH WR ��

s ,I � �� � � �� � WKHQ 6 �� 6�� LV FORVH WR ��

s ,I � �� ! � �� � WKHQ 6 �� 6�� LV PXFK ODUJHU WKDQ

��

6 �� 6�� |

�!!!!!!!!!!�!!!!!!!!!!�

) �GLVWULEXWLRQ�UDWLR RI � LQGHS� ��VTXDUHG U�Y�V�

ZLWK q� Q� b � DQG q� Q � b �DVVXPLQJ QXOO K\S� LV WUXH� � �� � ��

�!!!!!!!!!! !!!!!!!!!!�

� � �

Page 166: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 9DU LDQFHV

s 7KH WHVW LV QRW YHU\ S RZHUIXO �RIWHQ IDLO WRUHMHFW WKH QXOO +\SRWKHVLV � �� � �� � ZKHQLQGHHG WKH YDULDQFHV DUH GLoHUHQW��

s 7KH WHVW S HUIRUPV E HVW ZKHQ VDPSOH VL]HVDUH HTXDO �Q � Q� � ODUJH�

s 7KH WHVW LV YHU\ VHQVLWLYH WR WKH QRUPDOLW\ DV�VXPSWLRQ� ,I D KLVWRJUDP LV QRW E HOO�VKDS HG�GR QRW XVH WKH WHVW�

� � �

Page 167: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 9DU LDQFHV ( [DPSOH

:H ZLVK WR GHWHUPLQH ZKHWKHU WKHUH LV OHVV YDUL�DELOLW\ LQ WKH VLOYHU SODWLQJ GRQH E\ &RPSDQ\ �WKDQ &RPSDQ\ �� ,QGHSHQGHQW VDPSOHV RI ZRUNGRQH E\ WKH WZR FRPSDQLHV \LHOG�

&RPSDQ\ �� Q � ��� V � �����PLO&RPSDQ\ �� Q � ��� V � �����PLO

7HVW WKH K\SRWKHVLV DW ���� VLJ OHYHO�

+� � � �� � �� �� �� � �� �+$� � �� � � ��

' HWHUPLQH WHVW VWDW� GLVW�

6 �� 6�� ) �GLVWULEXWLRQ

q� Q � b � �� q� Q� b � �

� � �

Page 168: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 9DU LDQFHV ( [DPSOH &RQW�

&DOFXODWH WHVW VWDWLVWLF IURP GDWD�

V�� V�� ������ ������ �����

5 HMHFWLRQ UHJLRQ�

0.95

F15,9

0.05

f0.95 (15,9 deg. of f reedom)

5 HFLSUR FDO UHODWLRQVKLS�

I� � � � ���� � GI� �

I� � � ��� �� GI�

DQG I� � � ��� �� GI� ����

VR I� � � � ���� � GI� �

���� ������

� � �

Page 169: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 9DU LDQFHV ( [DPSOH &RQW�

' HFLVLRQ� 7KH WHVW VWDWLVWLF ����� LV OHVV WKDQ������� VR ZH U HMHFW WKH QXOO K\SRWKHVLV� 7KHGDWD VXSSRUW WKH FRQFOXVLRQ WKDW WKH VLOYHU SODW�LQJ GRQH E\ &RPSDQ\ � LV OHVV YDULDEOH WKDQ&RPSDQ\ ��

� � �

Page 170: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 0 HDQV� 3 DLU HG 'DWD

% HIRUH� ZH KDG D UDQGRP VDPSOH RI VL]H Q� IURPSRSXODWLRQ �� DQG DQ LQGHSHQGHQW UDQGRPVDPSOH RI VL]H Q� IURP S RSXODWLRQ ��

1RZ� ZH PDNH Q REVHUYDWLRQV� DQG FROOHFW WZRW\SHV RI GDWD S HU REVHUYDWLRQ�

([DPSOH� 6DPSOH � ULYHU ORFDWLRQV PHDVXUH]LQF FRQFHQWUDWLRQ LQ E RWWRP ZDWHUDQG VXUIDFH ZDWHU� ' R HV WKH GDWDVXJJHVW WKDW WKH DYHUDJH FRQFHQWUD�WLRQ LQ ERWWRP ZDWHU H[FHHGV WKDW RIVXUIDFH ZDWHU"

/RFDWLRQ � � � � � �

=LQF E RW� \� ����� ����� ����� ����� ����� �����

=LQF VXUI� \� ����� ����� ����� ����� ����� �����

� � �

Page 171: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

&RPSDU LQJ 0 HDQV� 3 DLU HG 'DWD ( [�

7ZR GLoHUHQW PHWKR GV �pQLWH HOHPHQW PHWKR G�DQG D QHZ DSSUR[LPDWLRQ PHWKRG� DUH E HLQJFRPSDUHG WR SUHGLFW EXFNOLQJ ORDG RI D FHUWDLQVWUXFWXUH XQGHU �� GLoHUHQW FRQGLWLRQV� ,V WKHDYHUDJH GLoHUHQFH HTXDO WR ]HUR" $UH WKH �PHWKRGV FRQVLVWHQW"

� � �

Page 172: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

7 KH 3 DLU HG W�WHVW

7KH GDWD FRQVLVW RI Q SDLUV RI REVHUYDWLRQV�

�;� � <� �� �;� � <� �� c c c � �;Q� <Q�

/HW 'L GLoHUHQFH ;Lb<L IRU L �� �� � � � � Q:H FDQ JHW '� � '� � c c c � 'Q DQG' 3Q

L � 'L Q

DQG' b �

6G SQ|

�!!�!!�W�GLVWULEXWLRQ

ZLWK Q�� GHJUHHV RI IUHHGRP

�!! !!�6G VDPSOH VWDQGDUG GHYLDWLRQ

U6 �G

YXXXXXW3QL � �'L b'��

Qb �

����� b o�� &RQpGHQFH OLPLWV RQ z; b z< IRUSDLUHG GDWD�

' h Wo �

�%%#6'SQ

�&&$

� � �

Page 173: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 DLU HG W�WHVW ( [DPSOH

z' z% RWWRP b z6XUIDFH+� � z' �+$� z' ! ��L�H�� PRUH ]LQF FRQF� LQ E RWWRP ZDWHU WKDQ VXU�IDFH�

7HVW 6WDWLVWLF�G

6G SQ

' DWD� G ������� V �G ��������� Q �

G

VG SQ

����

� � �

Page 174: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

3 DLU HG W�WHVW ( [DPSOH &RQW

) RU W�WHVW� XVLQJ � Q � � GHJUHHV RI IUHHGRP�W � � � � ������ 6LQFH ���� ! ������ ZH UHMHFW WKHQXOO K\S RWKHVLV DW D ���� OHYHO RI VLJQLpFDQFH�:H FRQFOXGH WKDW ]LQF FRQFHQWUDWLRQ LQ E RWWRPZDWHU GRHV H[FHHG ]LQF FRQFHQWUDWLRQ LQ VXUIDFHZDWHU�

� � �

Page 175: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

S� b S� + \SRWKHVLV 7 HVW

,Q WKH ���� 6DON S ROLR YDFFLQH H[SHULPHQW� RQHJURXS KDG D SODFHE R RQH JURXS KDG WKH QHZYDFFLQH�

/HW�S� SUREDELOLW\ RI JHWWLQJ SDUDO\WLF SROLR IRUFRQWURO JURXSS� SUREDELOLW\ RI JHWWLQJ SDUDO\WLF SROLR IRUYDFFLQDWHG JURXS

+� � S � b S� �+$� S � b S � ! �

�L�H�� D YDFFLQDWHG FKLOG LV OHVV OLNHO\ WR FRQWUDFWSROLR WKDQ DQ XQYDFFLQDWHG FKLOG��

� � �

Page 176: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

S� b S� + \SRWKHVLV 7 HVW &RQW

) LQG VDPSOH VL]H LI o ���� DQG p ���� ZKHQS� ������ DQG S� �������

Q

v]o

U�S� � S � ��T� � T� � � � ]p

SS � T� � S � T�

w�G�} ���� ���

ZKHUH G S� b S� ������ b �������

]o ]� �� � �����]p ]� � � ����

� � �

Page 177: 5LFKDU G 6WRU FK .DLODVK .DSXU 5REHU W 6PLWK , QGXVWU …courses.washington.edu/stats315/315LectureNotes.pdf · 1999-04-04 · s 7kh xqlyhu vdo vhw6 lv wkh vhw ri doo re mhfwv xqghu

S� b S� + \SRWKHVLV 7 HVW &RQW

$FWXDO GDWD� 3ODFHER� Q � ���� ���\ � ��� SROLR FDVHV

9DFFLQH� Q� ���� ���\ � �� SROLR FDVHV

&DOFXODWH ] AS� b AS�V

ASAT� �Q� � �Q �

�} ����

ZKHUH AS� ���

���� ���� AS�

��

���� ���

AS \� � \�Q� � Q�

��� � ��

���� ��� � ���� ���

7KH S�YDOXH LV OHVV WKDQ ������� VR ZH UHMHFW WKHQXOO K\SRWKHVLV �S � b S � ��� DQG FRQFOXGHWKDW WKH SUREDELOLW\ RI FRQWUDFWLQJ SROLR ZLWKWKH YDFFLQH LV GLoHUHQW IURP WKH FRQWURO JURXS�

� � �