BIOL1462 Equations & Tables 1

THE UNIVERSITY OF THE WEST INDIES

ST AUGUSTINE

BIOL1462 GENERAL ECOLOGY & BIOMETRY - THEORY
BIOL1462 EQUATIONS AND TABLES FOR BIOMETRY

Candidates must return these to the instructor at the end of the examination.


1.
n n
d 6
1
s
r
3
2
i

=


where d
i
= the difference between X and Y ranks for observation i


2.
2 1 2 1
2
2 2
2
1 1
2 1
n
1
n
1
2 n n
s ) 1 n ( s ) 1 n (
x x
t
+
+
+

= with df = n
1
+ n
2
- 2


3. SD =
1 n
n
) X (
X
1 n
) x X (
s
2
2
2
i

4. T
+
= positive signed ranks
T_ = negative signed ranks


5.

+
+
= ) 1 N ( 3
n
R
) 1 N ( N
12
H
i
2
i
with df = k-1
where: k = number of groups compared
n
i
= number of observations in group i
N = n
i
, number of observations in all groups
R
i
= sum of ranks in group i
= sum over the k groups


6.
| |
| |

=
n / X) ( X
n / Y) ( X) ( XY
b slope
2 2



BIOL1462 Equations & Tables 2
7.
) D B ( ) C A ( ) D C ( ) B A (
) 2 / N BC AD ( N

2
2
+ + + +

= with df = (r-1)(c-1) = 1

8.
2
2
2
1
2
1
2 1
n
s
n
s
x x
t
+

= with
) 1 n (
n
s
) 1 n (
n
s
n
s
n
s
df
2
2
2
2
2
1
2
1
2
1
2
2
2
2
1
2
1

+
=

9.
1
1 1
2 1
R
2
) 1 n ( n
n n U
+
+ = with U
unknown
= n
1
n
2
- U
known



10. a = Y - bX where a = intercept, b = slope


11.
1 n
n
X) (
X
1 n
) x (X
s
2
2
2
i
2

12.
n
X
x
i

=

13.

=
e
) 5 . 0 e o (

2
corrected
2
where df = (n-1) = 1

14.
n
s
n
s
SE
2
= =


15.

=
e
) e o (

2
2
with df = (r-1)(c-1), expected frequency = (column total) (row total)
N
16.
(

n
) Y (
Y
n
) X (
X
n
) Y ( ) X (
XY
r
2
2
2
2
with df = n - 2


BIOL1462 Equations & Tables 3
17.
MSW
MSB
F = where
1 k
SSB
MSB

= and
k N
SSW
MSW

=

( )
N
x
....
n
T
n
T
n
T
SSB
2
3
2
3
2
2
2
1
2
1

|
|
.
|

\
|
+ + + =

|
|
.
|

\
|
+ + + = ...
n
T
n
T
n
T
x SSW
3
2
3
2
2
2
1
2
1 2


where MSB = Variance between samples
MSW = Variance within samples
SSB = Between-sample sum of squares
SSW = Within-sample sum of squares
k = number of groups or treatments
n
i
= size of sample i
T
i
= sum of values in sample i
N = number of observations in all samples (n
1
+ n
2
+ n
3
+ )
x = sum of values in all samples (T
1
+ T
2
+ T
3
+)
x
2
= sum of squares of values in all samples

18.
d
d
SE
x
t = with df = n - 1 where n = number of samples and
d
x = the mean difference in values (d
i
) between the paired samples
SE
d
= the standard error of d, i.e.
n
s
2
d
where
1 n
) x d (
s
2
d i 2
d

=

=
1 n
n
) d (
d
2
i 2
i

19.
SE
) x x (
q
A B

= where
n
MS Error
SE = for Error df, k groups


20. R
2
= r
2
= regression SS / total SS


21.
C
H
H
C
= where
N N
) t t (
1 C
3
i
3
i

=


where t
i
= the number of ties in the ith group of ties




BIOL1462 Equations & Tables 4
22.
SE
R R
q
A B

= where
12
) 1 nk ( ) nk ( n
SE
+
= for df, k groups


23. Expected frequency = [(column total) (row total)] / N

24.
2
2
2
1
s
s
F = where 1 F > and df = (n
1
- 1) and (n
2
- 1)

25. Coefficient of Variation % 100
x
SD
CV =

26. ( ) SE t x CI % 95 x
) 1 n , 05 . 0 (
=

27. (1) calculate Total SS as: Y
2
- [(Y)
2
/ n]
(2) calculate Regression SS as: b [XY - [(X)(Y) / n]] where b = slope
(3) calculate Residual SS as: total SS - regression SS (step #1 - step #2)
(4) calculate Total degrees of freedom as: n - 1
(5) calculate Regression degrees of freedom as the number of parameters being estimated
minus 1 (df = 1 for simple linear regression)
(6) calculate Residual degrees of freedom as: Total df - Regression df
(7) calculate Regression MS as: Regression SS / Regression df (step #2 divided by step
#5)
(8) calculate Residual MS as: Residual SS / Residual df (step #3 divided by step #6)
(9) calculate F as: Regression MS / Residual MS (step #7 divided by step #8) with
Regression df above, Residual df below


28. (1) calculate n
i
(number of samples for each group)
(2) calculate N (total sample size)
(3) calculate X
ij
or T
i
(sum of data for each group)
(4) calculate x
i
(mean for each group)
(5) calculate (X
ij
)
2
/ n
i
or T
i
2
/ n
i
(step #3 squared and divided by sample size for each
group)
(6) calculate [(X
ij
)
2
/ n
i
] or (T
i
2
/ n
i
) (sum of step 5)
(7) calculate X
ij
or G (sum of step #3)


BIOL1462 Equations & Tables 5
(8) calculate X
ij
2
(all observations squared and summed)
(9) calculate correction term (C) as C = (X
ij
)
2
/ N or G
2
/ N
(step #7 squared and divided by step #2)
(10) calculate Total SS as X
ij
2
C (step #8 minus step #9)
(11) calculate Groups SS as:

C
n
) X (
i
2
ij
or (T
i
2
/ n
i
) - C (step #6 minus step #9)
(12) calculate Error SS as Total SS - Group SS (step #10 - step #11)
(13) calculate Total df as N 1 (step #2 minus 1)
(14) calculate Groups df as k - 1 where k is the number of groups compared
(number of groups minus 1)
(15) calculate Error df as N k (step #2 minus number of groups)
(16) calculate Groups MS as: Groups SS / Groups DF (step #11 divided by step #14)
(17) calculate Error MS as: Error SS / Error DF (step #12 divided by step #15)
(18) calculate F as Groups MS / Error MS (step #16 divided by step #17)



BIOL1462 Equations & Tables 6

TABLE 1. Critical values of the chi-square (_
2
) distribution.





Probability (P)


df

0.90

0.70

0.50

0.30

0.20

0.10

0.05

0.01

0.001

1

0.02

0.15

0.46

1.07

1.64

2.71

3.84

6.64

10.83

2

0.21

0.71

1.39

2.41

3.22

4.60

5.99

9.21

13.82

3

0.58

1.42

2.37

3.66

4.64

6.25

7.82

11.34

16.27

4

1.06

2.20

3.36

4.88

5.99

7.78

9.49

13.28

18.47

5

1.61

3.00

4.35

6.06

7.29

9.24

11.07

15.09

20.52

6

2.20

3.83

5.35

7.23

8.56

10.64

12.59

16.81

22.46

7

2.83

4.67

6.35

8.38

9.80

12.02

14.07

18.48

24.32

8

3.49

5.53

7.34

9.52

11.03

13.36

15.51

20.09

26.12

9

4.17

6.39

8.34

10.66

12.24

14.68

16.92

21.67

27.88

10

4.86

7.27

9.34

11.78

13.44

15.99

18.31

23.21

29.59

BIOL1462 Equations & Tables 7
TABLE 2. Critical values of the two-tailed t distribution.




Probability (P)

df

0.50

0.20

0.10

0.05

0.01

0.001

1

1.00

3.08

6.34

12.71

63.66

636.62

2

0.82

1.89

2.92

4.30

9.93

31.60

3

0.77

1.64

2.35

3.18

5.84

12.92

4

0.74

1.53

2.13

2.78

4.60

8.61

5

0.73

1.48

2.02

2.57

4.03

6.87

6

0.72

1.44

1.94

2.45

3.71

5.96

7

0.71

1.42

1.90

2.37

3.50

5.41

8

0.71

1.40

1.86

2.31

3.36

5.04

9

0.70

1.38

1.83

2.26

3.25

4.78

10

0.70

1.37

1.81

2.23

3.17

4.59

11

0.70

1.36

1.80

2.20

3.11

4.44

12

0.70

1.35

1.78

2.18

3.06

4.32

13

0.69

1.35

1.77

2.16

3.01

4.22

14

0.69

1.34

1.76

2.15

2.98

4.14

15

0.69

1.34

1.75

2.13

2.95

4.07

16

0.69

1.34

1.75

2.12

2.92

4.02

17

0.69

1.33

1.74

2.11

2.90

3.97

18

0.69

1.33

1.73

2.10

2.88

3.92

19

0.69

1.33

1.73

2.09

2.86

3.88

20

0.69

1.33

1.73

2.09

2.85

3.85

21

0.69

1.32

1.72

2.08

2.83

3.82

22

0.69

1.32

1.72

2.07

2.82

3.79

23

0.69

1.32

1.71

2.07

2.81

3.77

24

0.69

1.32

1.71

2.06

2.80

3.75

25

0.68

1.32

1.71

2.06

2.79

3.73

26

0.68

1.32

1.71

2.06

2.78

3.71

27

0.68

1.31

1.70

2.05

2.77

3.69

28

0.68

1.31

1.70

2.05

2.76

3.67

BIOL1462 Equations & Tables 8
TABLE 3. Critical values of the two-tailed Mann-Whitney U distribution for P = 0.05.





n
1
(number of cases in the smaller group)


n
2



2

3

4

5

6

7

8

9

10

11

12

13

14

4

-

-

16





















5

-

15

19

23



















6

-

17

22

27

31

















7

-

20

25

30

36

41















8

16

22

28

34

40

46

51













9

18

25

32

38

44

51

57

64











10

20

27

35

42

49

56

63

70

77









11

22

30

38

46

53

61

69

76

84

91







12

23

32

41

49

58

66

74

82

91

99

107





13

25

35

44

53

62

71

80

89

97

106

115

124



14

27

37

47

57

67

76

86

95

104

114

123

132

141

15

29

40

50

61

71

81

91

101

111

121

131

141

151


BIOL1462 Equations & Tables 9
TABLE 4. Critical values of the Wilcoxon T distribution.





Probability (P)


n

0.50

0.20

0.10

0.05

0.01

0.001

6

6

3

2

0





7

9

5

3

2





8

12

8

5

3

0



9

16

10

8

5

1



10

20

14

10

8

3



11

24

17

13

10

5

0

12

29

21

17

13

7

1

13

35

26

21

17

9

2

14

40

31

25

21

12

4

15

47

36

30

25

15

6

16

54

42

35

29

19

8

17

61

48

41

34

23

11

18

69

55

47

40

27

14

19

77

62

53

46

32

18

20

86

69

60

52

37

21

BIOL1462 Equations & Tables 10
TABLE 5. Critical values of the two-tailed F distribution for P = 0.05.





Numerator (groups) (regression) df


Denominator
(error)
(residual) df

1

2

3

4

5

6


1

648.0

800.0

864.0

900.0

922.0

937.0

2

38.5

39.0

39.2

39.2

39.3

39.3

3

17.4

16.0

15.4

15.1

14.9

14.7

4

12.2

10.6

9.98

9.60

9.36

9.20

5

10.0

8.43

7.76

7.39

7.15

6.98

6

8.81

7.26

6.60

6.23

5.99

5.82

7

8.07

6.54

5.89

5.52

5.29

5.12

8

7.57

6.06

5.42

5.05

4.82

4.65

9

7.21

5.71

5.08

4.72

4.48

4.32

10

6.94

5.46

4.83

4.47

4.24

4.07

11

6.72

5.26

4.63

4.28

4.04

3.88

12

6.55

5.10

4.47

4.12

3.89

3.73

13

6.41

4.97

4.35

4.00

3.77

3.60

14

6.30

4.86

4.24

3.89

3.66

3.50

15

6.20

4.77

4.15

3.80

3.58

3.41

16

6.12

4.69

4.08

3.73

3.50

3.34

17

6.04

4.62

4.01

3.66

3.44

3.28

18

5.98

4.56

3.95

3.61

3.38

3.22

19

5.92

4.51

3.90

3.56

3.33

3.17

20

5.87

4.46

3.86

3.51

3.29

3.13

21

5.83

4.42

3.82

3.48

3.25

3.09

22

5.79

4.38

3.78

3.44

3.22

3.05

23

5.75

4.35

3.75

3.41

3.18

3.02

24

5.72

4.32

3.72

3.38

3.15

2.99


BIOL1462 Equations & Tables 11
TABLE 6. Critical values of the two-tailed Pearson correlation coefficient, r.





Probability (P)


df

0.50

0.20

0.10

0.05

0.01

0.001

1

0.71

0.95

0.99

1.00

1.00

1.00

2

0.50

0.80

0.90

0.95

0.99

1.00

3

0.40

0.69

0.81

0.88

0.96

0.99

4

0.35

0.61

0.73

0.81

0.92

0.97

5

0.31

0.55

0.67

0.76

0.88

0.95

6

0.28

0.51

0.62

0.71

0.83

0.93

7

0.26

0.47

0.58

0.67

0.80

0.90

8

0.24

0.44

0.55

0.63

0.77

0.87

9

0.23

0.42

0.52

0.60

0.74

0.85

10

0.22

0.40

0.50

0.58

0.71

0.82

11

0.21

0.38

0.48

0.55

0.68

0.80

12

0.20

0.37

0.46

0.53

0.66

0.78

13

0.19

0.35

0.44

0.51

0.64

0.76

BIOL1462 Equations & Tables 12
TABLE 7. Critical values of the two-tailed Spearman rank correlation coefficient, r
s
.





Probability (P)


n

0.50

0.20

0.10

0.05

0.01

0.001

4

0.60

1.00

1.00







5

0.50

0.80

0.90

1.00





6

0.37

0.66

0.83

0.89

1.00



7

0.32

0.57

0.71

0.79

0.93

1.00

8

0.31

0.52

0.64

0.74

0.88

0.98

9

0.27

0.48

0.60

0.70

0.83

0.93

10

0.25

0.46

0.56

0.65

0.79

0.90

11

0.24

0.43

0.54

0.62

0.76

0.87

12

0.22

0.41

0.50

0.59

0.73

0.85

13

0.21

0.39

0.48

0.56

0.70

0.82

14

0.20

0.37

0.46

0.54

0.68

0.80

15

0.19

0.35

0.45

0.52

0.65

0.78

16

0.18

0.34

0.43

0.50

0.64

0.76

17

0.18

0.33

0.41

0.49

0.62

0.75