Coliittitiiii llnxtitr^itp Class _kj3 Book 66 Gop3Ti^litN". COPYRIGHT DEPOSnv \j': A Comparative Study of Achievement in Country and Town Schools By Norman Frost, Ph.D. TEACHERS COLLEGE, COLUMBIA UNIVERSITY CONTRIBUTIONS TO EDUCATION, NO. Ill Published by "Vmthtrs (Snllsg?, dnlutnbta Ulmtisrattg New York City 1921 "f-'onoi ■'•aofr Copyright, 1921, by Norman Frost i^^y;;; (^ilG i5 1921 m'quiddy printing CO. NASHVILLE g)ClA6305 1 324 13 — - 5 3 1 1 2 15 26 20 36 29 31 21 30 16 11 13 5 7 2 3 2 2 2 1 26 310 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. in 4.02 .23 6.42 .10 3.16 Mil— M10=2.74 .184 11 6.76 .19 9.31 3.73 2.79 M12— Mll = 1.13 .162 n 7.89 .18 10.76 5.39 2.68 M13— M12 = 1.65 .162 13 9.54 .20 12.78 7.12 2.83 M13— M10=5.52 .184 TABLE XVII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Subtraction Rights in Certain Schools in Louisiana Scores Age Total XI X2 X3 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 X9 XIO xu 10 11 n 24 46 52 5' '>^ 38 13 I"! in W 1 3 1 297 14 24 46 46 35 30 99 ''I IP P f 4 5 1 1 ? 1 289 7 14 24 42 23 28 36 35 29 20 S 11 9 8 6 1 1 1 1 304 13 7 14 36 18 29 29 34 21 25 11 12 12 5 3 i 16 1 i 277 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 .31 .13 3.75 0.00 1.87 Mil— M10=1.10 .120 11 1.41 .14 3.98 0.00 1.99 M12— Mll = 1.97 .134 u 3.38 .17 5.65 .73 2.41 M13— M12= .78 .156 13 4.16 .19 6.79 1.68 2.55 M13— M12 = 3.85 .144 TABLE XVIII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Subtraction Rights in Arkansas City Age Scores Total XI X2 X3 1 2 3 4 5 6 7 8 9 10 11 12 13 14 X9 10 18 5'' 60 37 31 25 '>5 ?3 16 7 8 1 2 305 11 8 18 52 33 31 22 ?4 16 18 7 17 3 1 2 5 257 12 4 8 18 29 22 31 26 45 25 25 19 16 7 2 3 2 1 283 13 1 4 8 21 10 18 25 31 20 37 26 25 11 7 a 4 2 ---- 1 254 P. E. true Median — obtained median 75 per- centile 25 per centile Q P.E. 10 .60 .11 3.23 0.00 1.61 Mil— M10= .96 .122 11 1.56 .16 4.29 0.00 2.14 M12— Mll = 2.51 .141 17. 4.07 .17 6.17 1.53 2.32 M13— M12 = 1.38 .148 13 5.45 .17 7.59 3.06 2.26 M13— M10=4.85 .130 Achievement Measured by Courtis Arithmetic Tests 43 TABLE XIX Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Subtraction Rights in Salina, Kan. Age Scores Total XI 15 4 3 X2 19 15 4 3 X3 46 19 15 4 17 11 3 5 1 21 19 5 3 2 33 13 10 4 3 30 14 27 8 4 41 40 36 17 5 35 32 27 31 6 31 3fi 45 »5 7 23 23 28 37 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 X9 XIO in 20 30 33 28 6 18 27 20 4 8 19 24 341 11 7 11 13 4 8 6 9 3 7 295 1^ I 3 3 1 1 1 2 1 "~2 309 13 2 1 266 Median P. E. true —obtained median 75 per- centile 25 per- centile Q P.E. 10 n 12 13 3.65 5.39 6.54 7.35 .19 .19 .16 .15 5.96 7.79 8.87 9.72 .30 2.44 4.28 5.72 2.83 2.62 2.29 2.00 Mil— M10=1.74 M12— Mll = 1.15 M13— M12= .81 M13— M10=3.70 .162 .148 .134 .150 TABLE XX Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Subtraction Rights in Hibbing, Minn. Scores Age Total X2 16 X3 35 16 33 20 3 1 9 6 6 2 10 11 3 12 9 13 4 14 25 11 5 22 15 12 6 20 1 20 1 n 1 7 8 6 16 6 22 q IS 9 15 18 IS 10 4 19 19 11 9 12 25 12 6 6 11 13 5 7 7 14 3 4 13 1 5 16 . 3 2 4 fi 7 17 18 19 20 21 22 X9 XI 10 248 11 2 ? 1 3 2 1 238 12 1 1 4 227 13 — - 2 2 4 4 10 9 3 9 16 13 10 19 15 5 7 6 1 4 2 — 1 32 4 179 P. E. true Median — obtained 75 per- 25 per- Q P.E. median centile centile 10 4.64 .30 7.93 .33 3.80 Mil— M10=2.16 .240 11 6.80 .25 10.02 3.72 3.15 M12— Mll=2.39 .212 12 9.19 .23 11.93 6.26 2.83 M13— M12=2.15 .260 13 11.34 .36 15.87 8.10 3.88 M13— M10=6.70 .284 reported, and also the median ability of each 13-year-old group. As in addition, so in subtraction, this median for the 13-year-old group may be considered in a v^ay as a measure of the result obtained in any system with children up to the age of 13. School Systems Total gain 10 to 13 inclusive Medians 13-year-old children Hibbing Louisville Arkansas City Louisiana Salina Madison County, 9-month schools Madison County, 6-month schools 6.70 5.52 4.85 3.85 3.70 3.61 1.16 11.34 9.54 5.45 4.16 7.35 5.27 1.70 44 Study of Achievement in Country and Tozvn Schools The ranking in order of total gain made for the three-year period from ages 10 to 13 inclusive corresponds quite well with the ranking in order of medians for the 13-year-old children. This correspond- ence is not so close as was the case with addition ; there are four dis- placements in the ranking. As was the case with addition, the rank- ing in order of total gain for the three-year period is the more sig- nificant, since the use of a diflference as a measure tends to neutralize errors in the giving and scoring of the test. It is interesting to note that the rank in gain in ability to subtract is not the same as that in ability to add. Arkansas City and Louisiana both come ahead of Salina in subtraction, and not in addition. This difference between the rank of these systems for the two processes would seem to indicate that subtraction needs to be taught ; that im- provement in addition does not necessarily carry with it exactly pro- portionate ability to subtract. The following summary shows the gain for each yearly age-period in the systems studied : School Systems Yearly Gains 10 to 11 11 to 12 12 to 13 Hibbing- ._ .-.. 2.21 2.74 .96 1.10 1.74 .34 .13 2.34 1.13 2.51 1.97 1.15 2.50 .30 2.15 Louisville __ _- 1.65 Arkansas City ._ . 1.38 Louisiana ..- .78 Salina . . . .81 Madison County, 9-month schools . .77 Madison County, 6-month schools . - _ - .73 Total 9.22 11.90 8.27 The variations are as great in the amount of yearly gain as they were shown to be in addition. As in addition, so in subtraction, the greatest yearly gain seems to be between the ages of 11 and 12. In subtraction the next greatest gain seems to be between the ages of 10 and 11, while in the case of addition the second greatest gain was be- tween the ages of 12 and 13. The smallest gain is made between the ages of 12 and 13. CONCLUSIONS 1. The conclusions reached in regard to addition (p. 39) hold in the case of subtraction. Achievement Measured by Courtis Arithmetic Tests 45 2. Improvement in addition does not necessarily carry with it pro- portionate ability to subtract. Section 3. Multiplication The data presented in multiplication are from the same sources as those for addition and subtraction, and the method of treatment has been the same throughout. Table XXI gives the facts in regard to multiplication in the Madison County 6-month schools. TABLE XXI Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in the 6-Month White Schools OF Madison County, Ky. Scores Age Total XI X2 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 X9 XIO Xll in 9 8 4 2 19 9 6 4 82 75 62 57 16 11 12 15 3 11 16 8 5 8 12 9 4 2 9 5 1 2 3 3 1 140 11 2 4 10 """2 4 .... 124 1? 4 1 1 1 136 18 4 124 P. E. true Median —obtained 75 per- 25 per- Q P.E. median centile centile 10 .51 .04 .93 .08 .42 Mil— M10=.ll .036 11 .62 .05 1.27 .21 .53 M12— Mll = .31 .094 12 .93 .14 3.16 .38 1.39 M13— M12 = .05 .142 13 .98 .18 3.77 .43 1.67 M13— M10 = .47 .111 The median of each of the age-groups given falls below 1, and even the 75 percentile of the 10-year-old group falls between and 1. It seems that most of the children in these schools below the age of 14 have an ability in multiplication that is less than can be measured by the Courtis Standard Research Tests in Arithmetic Series B. The total gain in ability to multiply during the three-year period, ages 10 to 13 inclusive, is only .47. The P.E. of this statement of gain is .111, something over 25 per cent of the gain itself. The gain noted is very slight. Apparently these 6-month schools in Madison County are failing to teach most of the pupils under 14 how to multiply. The improvement from year to year necessarily is very slight, since the total improvement is so small. From ages 10 to 11 the improve- ment is .11 ; from ages 11 to 12 it is .31 ; and from ages 12 to 13 it is .05. The greatest gain in any one-year period is .31 from ages 11 to 12. The results of instruction in multiplication in these schools are very meager. 46 Study of Achievement in Country and Town Schools TABLE XXII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in the 9-Month White Schools OF Madison County, Ky. Scores Asje Total XI X2 1 2 3 4 5 6 7 8 9 10 11 X9 XIO Xll 10 9 1 3 16 9 1 37 31 32 4 10 14 12 7 14 14 10 7 12 23 16 12 11 10 6 4 120 11 3 '"2 — - 1 1 96 12 3 2 i 131 18 4 3 13 10 11 1 9 12 11 5 2 8 1 1 101 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 .94 .21 3.85 .13 1.86 Mil— M10= .76 .206 11 1.70 .26 4.58 .45 2.06 M12-M11 = 1.36 .200 12 3.06 .20 4.56 .87 1.84 M13— M12 = .80 .216 13 3.86 .29 6.25 1.52 2.36 M13— M10= 2.92 .222 Table XXII gives the facts in regard to multiplication in the 9- month schools of Madison County. The median ability in multiplication in these schools for 10-year-old children is .94; a Httle less than 1. The 25 percentile of the 10-, 11- and 12-year-old groups is less than 1 in each case. The situation here presented is materially better than that in the 6-month schools. The total gain in ability to multiply for the three-year period from ages 10 to 13 inclusive is 2.92. The contrast between this gain and that in the 6-month schools (.47) is marked. The P.E. of this gain of 2.92 is .222, a little over 7 per cent of the gain. The probable actual de- viation of the true from the obtained measure is greater in the case of the 9-month schools than in the case of the 6-montli schools, but in proportion to the gain made it is much less. The improvement in ability to multiply from ages 10 to 11 is .76; from ages 11 to 12 it is 1.36; and from ages 12 to 13 it is .80. The gain during any one of the year periods is much greater than the gain for the entire three-year period in the 6-month schools. The great- est gain is from ages 11 to 12, as is the case in the 6-month schools. Tables XXIII to XXVII inclusive give comparative data in regard to multiplication from other school systems. In the following sum- mary the total improvement in ability to multiply during the three-year period from ages 10 to 13 inclusive is given for each of the school sys- tems studied, and also the median ability for the respective groups of 13-year-old children. The schools are listed in the order of amount of improvement made. Achievement Measured by Courtis Arithmetic Tests 47 TABLE XXIII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in Certain White Schools in Louisville, Ky. Age Scores Total XI 10 5 X2 10 5 X3 43 16 10 5 7 10 2 3 1 15 8 9 3 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 10 11 12 13 23 11 U 9 34 17 18 18 32 37 31 22 30 41 34 32 26 36 38 43 21 35 35 40 12 32 41 38 5 21 34 34 7 14 15 18 3 3 17 13 284 7 9 13 5 6 8 1 2 2 309 ""■4 2 1 320 305 Median P. E. true — obtained median 75 per- centile 25 per- centile Q P.E. 10 11 12 13 3.82 5.98 7.05 7.43 .21 .14 .15 .14 6.11 8.17 9.17 9.46 .28 4.00 4.80 5.50 2.91 2.08 2.18 1.98 Mil— M10 = 2.16 M12— Mll = 1.07 M13— M12= .38 M13— M10=3.61 .158 .127 .120 .152 TABLE XXIV Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in Certain White Schools in Louisiana Age Scores Total XI 24 13 7 X2 42 24 13 7 X3 61 43 24 13 69 63 74 50 1 2 3 4 5 6 7 8 9 10 11 12 X9 XIO Xll 10 11 12 13 24 31 36 33 21 30 28 35 21 26 34 25 12 16 34 27 8 11 21 23 4 9 12 17 2 7 5 16 289 4 6 3 1 3 2 '"3 1 1 1 1 1 1 17 280 1 1 300 1 275 Median P. E. true — obtained median 75 per- centile 25 per- centile Q P.E. 10 11 12 13 .23 .95 1.88 2.98 .06 .12 .13 .17 1.85 3.23 4.26 5.70 0.00 0.00 .41 .97 .92 1.61 1.92 2.86 Mil— M10= .72 M12-M11= .93 M13— M12 = 1.10 M13— M10=2.75 .080 .106 .136 .117 TABLE XXV Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in Arkansas City Age Scores Total XI X2 X3 1 2 3 4 5 6 7 8 9 10 11 12 X9 10 11 12 13 14 8 4 1 51 14 8 4 61 51 14 8 63 41 49 30 44 21 25 13 24 40 38 22 24 22 50 24 11 21 31 3C 6 15 22 22 298 9 28 28 6 16 16 2 2 24 8 4 4 258 2 3 1 6 2 4 . 296 245 Median P. E. true — obtained median 75 per- centile 25 per- centile Q P.E. 10 11 12 13 .36 1.71 3.20 4.51 .06 .14 .15 .19 1.78 3.84 5.13 6.88 0.00 0.00 .97 2.01 .89 1.92 2.08 2.43 Mil— M10=1.35 M12— Mll = 1.49 M13— M12 = 1.31 M13— M10=4.15 .098 .127 .150 .126 48 Study of Achievement in Country and Town Schools TABLE XXVI Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in Salina, Kan. Scores Age Total XI X2 X3 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 X9 XIO. 10 16 3 3 22 16 3 1 48 22 16 3 31 19 8 6 27 17 8 8 20 22 11 13 23 23 29 11 18 21 29 31 48 52 45 27 24 22 .51 46 10 8 19 29 9 10 33 28 4 17 27 1 19 1 4 334 11 i 5 9 19 15 2 3 7 "7 4 2 1 8 1 1 267 1? 2 4 "i 333 13 - — 2 2 275 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 3.13 .18 5.32 0.00 2.66 Mil— M10=1.41 .155 11 4.54 .18 6.23 1.39 2.44 M12-M11 = 1.64 .148 12 6.28 .16 8.84 4.18 2.33 M13— M12= .53 .156 13 6.81 .20 9.18 4.86 2.66 M13— M10 = 3.68 .162 TABLE XXVII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Multiplication Rights in Hibbing, Minn. Scores Age Total X2 18 X3 35 16 34 19 1 23 11 in 2 29 24 1? 3 35 25 17 4 20 23 27 5 21 42 29 6 16 25 27 7 12 19 26 8 9 10 18 9 5 15 18 10 4 8 10 11 1 1 3 12 1 2 9 13 14 15 16 17 X9 no in 261 11 2 6 1 1 "4 1 1 244 12 1 4 230 13 3 6 4 12 12 13 13 17 16 11 12 12 8 3 2 33 4 181 p. E. true Median —obtained median 75 per- centile 25 per- centile Q P.E. 10 2.77 .18 5.17 .41 2.38 Mil— M10=2.32 .140 11 5.09 .17 6.92 2.62 2.15 M12— Mll = 1.39 .140 12 6.48 .18 8.97 4.42 2.27 M13— M12 = 2.17 .220 13 8.65 .32 12.59 5.63 3.48 M13— M10=5.88 .220 As is the case in addition and subtraction, the ranking in order of gain made in abiHty for the three-year period from ages 10 to 13 inclu- sive does not correspond exactly with the ranking in order of ability of School Systems Hibbing Arkansas City Salina Louisville Madison County, 9-month schools. Louisiana Madison County, 6-month schools. Total gain Medians 10 to 13 13-year-old inclusive children 5.88 8.65 4.15 4.51 3.68 6.81 3.61 7.43 2.92 3.86 2.75 2.98 .47 .98 Achievement Measured by Courtis Arithmetic Tests 49 13-year-old children. The measure of gain made is probably the more significant measure, as for addition and subtraction. It must be borne in mind that the steps of improvement are not necessarily of equal value. It may be more difficult to teach a child who cannot multiply to multiply well enough to do one example cor- rectly than it is to teach a child who can do one example correctly to do two examples correctly. In other words, because Hibbing makes twice as much improvement as Louisiana does not necessarily mean that the teaching in Hibbing is twice as good as that in Louisiana. This dif- ficulty in evaluating the results of this test is not due to the fact that a difference between the median abilities of age-groups is used as a measure, but rather to the manner in which the test is constructed. The unit in which the result is stated is not one of the relative diffi- culty with which those results are obtained. The following summary shows the gain for each yearly age period in the systems studied: School Systems Yearly Gains 10 to 11 11 to 12 12 to 13 Hibbing. . _.._. . 2.32 1.35 1.41 2.16 .76 .72 .11 1.39 1.49 1.64 1.07 1.36 .93 .31 2.17 Arkansas City _. . _ . .. 1.31 Salina .53 Louisville- ._.--_ .38 Madison County, 9-month schools .80 Louisiana .. - . _ .. 1.10 Madison County, 6-month schools. . .05 Total 8.83 8.19 6.34 The variations in amount of yearly gain are as great as they are in addition and subtraction. The greatest gain seems to be between ages 10 and 11 in this case, while in both addition and subtraction the greatest gain seems to come between ages 11 and 12. The smallest gain appears between ages 12 and 13. The conclusions in regard to multiplication are the same as those for addition (p. 38) and subtraction (p. 44). Section 4. Division The data presented in division are from the same sources as those for addition, subtraction and multiplication, and the same method of treatment has been followed. 50 Study of Achievement in Country and Tozvn Schools Table XXVIII gives the facts in regard to division in the 6-month schools of Madison County. TABLE XXVIII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Division Rights in the 6-Month White Schools of Madison County, Ky. Scores Age Total XI X2 1 2 3 4 5 6 7 8 X9 XIO Xll in 10 6 17 10 98 83 7 15 4 1 1 5 2 2 139 n 1 1 2 126 12 3 6 78 16 9 7 6 4 1 4 2 138 1'^ 2 3 70 16 8 5 1 1 11 4 2 123 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 .43 .03 .78 0.07 .35 Mil— M10= .13 .028 11 .56 .04 .94 .18 .38 M12— Mll= .20 .053 12 .76 .09 2.05 .32 .86 M13-M12= .04 .078 13 .80 .10 2.15 .36 .89 M13-M10= .37 .072 In these schools the median ability in division of each of the age- groups from ages 10 to 13 inclusive is between and 1. For the ages 10 and 11 the 75 percentiles are in the same interval. It seems that in division, as in multiplication, the majority of the children under 14 years of age in the Madison County 6-month schools are unable to work correctly any of the examples given in the Courtis Standard Research Tests in Arithmetic Series B for division. The total gain in ability to divide during the three-year period from ages 10 to 13 inclusive is from .43, the median for the 10-year-old chil- dren, to .80, the median for the 13-year-old children, a difference of .37. The P.E. of this difference is .072 — about 20 per cent of the gain. This gain is very small for so long a period of time at the age when material progress is being made in this ability in other school systems. As would be expected where the total improvement is so small, the yearly gains are very small and uneven. From ages 10 to 11 the gain is .13; from ages 11 to 12 it is .20; and from ages 12 to 13 it is .04. The P.E. of the gain from ages 12 to 13 is .072, which is almost twice as much as the gain. This means that the gain in this year is almost negligible. Table XXIX gives the facts in regard to division in the Madison County 9-month schools. Achievement Measured by Courtis Arithmetic Tests 51 TABLE XXIX Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Division Rights in the 9-Month White Schools of Madison County, Ky. Age Scores Total XI X2 1 2 3 4 5 6 7 8 9 10 11 12 13 X9 XIO Xll 10 9 1 3 5 16 9 1 3 60 46 45 17 5 6 13 15 8 11 9 8 5 3 10 11 9 7 13 7 4 2 11 6 3 2 8 6 1 2 8 3 1 4 2 3 1 1 1 3 1 1 1 1 1 124 11 1 1 8 96 12 2 — .... 1 1 129 13 1 99 Media n P. E. true — obtained median 75 per- centile 1 j 25 per ! centile Q P.E. 10 11 12 13 .61 .82 2.27 3.13 .12 .16 .21 .33 2.37 2.90 5.31 6.37 .11 .30 .63 .98 1.13 1.30 2.34 2.69 Mll-M10= .21 M12— Mll = 1.45 M13— M12= .86 M13— M10=2.52 .122 .190 .264 .210 In these schools the 25 percentile of each of the age-groups from ages 10 to 13 inclusive falls between and 1, and the medians for the 10- and 11-year-old groups each fall in the same interval. A much larger proportion of the children reported are able to work some of the ex- amples correctly than is the case in the 6-month schools. The total gain from ages 10 to 13 inclusive in this case is 2.52 as against .37 in the case of the 6-month schools in the same county. The P.E. of the gain for the 9-month schools is .21, about 8.5 per cent of the gain. The probable actual deviation of the true measure of gain from the measure of gain given is almost three times as great as the like probable deviation in the case of the 6-month schools, but the gain in the case of the 9-month schools is so much greater that proportion- ately the probable deviation is smaller. As in the 6-month schools, so in these, the yearly gains are unequal. From ages 10 to 11 the gain is .21 ; from ages 11 to 12 it is 1.45 ; and from ages 12 to 13 it is .86. The gain for each year after the first is much greater than the total gain in the 6-month schools for the entire three-year period. Tables XXX to XXXIV inclusive give comparative data from other school systems in regard to division. In the following summary the total gain in ability to divide during the three-year period from ages 10 to 13 inclusive is given for each of the systems studied, and also the median abihty of the 13-year-old children in the respective systems. The schools are listed in the order of the amount of improvement made. In this table it is interesting to note that the ranking in order of amount of total gain corresponds exactly to ranking in order of the 52 Study of Achievement in Country and Town Schools TABLE XXX Age Distribution, 10 to 13 Inclusi\'e, of Courtis Series B Arithmetic Tests Division Rights in Certain White Schools of Louisville, Ky. Scores Age Total XI 10 5 X2 16 10 5 X3 43 3 16 2 10 1 5 1 1 24 3 12 6 12 1 9 2 31 16 15 13 3 24 23 18 16 4 32 28 22 13 5 21 25 22 21 6 20 22 23 34 7 13 20 27 23 8 9 18 27 30 9 11 19 23 25 10 3 21 23 26 U 3 12 10 25 12 4 12 17 18 13 2 9 11 13 14 1 7 12 6 1 5 16 17 18 19 20 21 22 23 24 X9 10 297 11 3 3 i 3 2 6 2 6 2 1 4 1 1 ""26 308 12 ] 319 13 ) 336 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 2.82 .19 5.60 .17 2.71 Mil— M10 = 3.02 .192 11 5.84 .24 9.68 2.68 3.50 M12— Mn = 1.77 .204 12 7.61 .23 10.83 4.17 3.33 M13— M12 = 1.15 .191 13 8.76 .21 12.05 5.80 3.12 M13— M10=5.94 .176 TABLE XXXI Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Division Rights IN Certain White Schools IN Louisiana Scores Age Total XI X2 X3 1 2 3 4 5 6 7 8 9 10 11 12 13 14 X9 XIO XI 1 in 24 14 7 43 24 14 59 43 24 106 90 103 16 27 32 17 19 31 9 16 22 4 16 23 4 9 13 2 7 8 '"h 7 1 3 8 1 3 7 286 11 1 1 2 2 1 1 1 282 12 1 1 1 305 13 .... 7 14 75 37 18 15 26 22 13 10 12 6 4 3 1 16 1 1 281 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 .16 .02 .83 0.00 .33 Mil— M10= .50 .060 11 .66 .09 2.70 0.00 1.35 M12— Mll= .48 .092 12 1.14 .12 3.80 .30 1.75 M13— M12=1.27 .138 13 2.41 .19 5.85 .65 2.60 M13— M10=2.25 .120 TABLE XXXII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Division Rights in Arkansas City Scores Age Total XI X2 X3 1 3 3 4 5 6 7 8 9 10 11 12 13 14 15 X9 in 16 8 49 16 60 49 86 81 43 38 22 10 1 9 7 6 9 2 9 "'6 "5 - 7 1 1 295 11 2 257 n 4 8 16 82 45 37 1 9 19 11 15 1? 6 in q 1 294 13 1 4 8 42 29 25 2 3 19 25 23 15 5 8 10 5 1 3 — - 1 1 248 P. E. true Median — obtained median 75 per- centile 25 per- centile Q P.E. 10 .26 .04 1.23 0.00 .61 Mil— M10= .42 .053 11 .68 .08 2.07 0.00 1.03 M12— Mll = 1.14 .102 12 1.82 .14 4.50 .55 1.97 M13— M12=1.83 .150 13 3.85 .20 6.43 1.24 2.59 M13— M10=3.39 .121 Achievement Measured by Courtis Arithmetic Tests 53 TABLE XXXIII Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Division Rights in Salina, Kan. ARe Scores Total 335 297 10 11 XI 16 3 3 X2 21 16 3 3 X3 47 21 16 3 48 36 22 11 1 41 21 18 17 2 39 29 28 20 3 27 37 25 27 4 28 17 32 25 5 21 29 33 29 6 21 16 29 31 7 9 16 25 14 8 12 25 28 20 9 10 11 2 .. 2 7 5 4 9 21 8 11 18 14 12 1 4 10 8 13 5 5 10 14 15 16 2 V. "2 2 1 2 2 ._ 2 17 18 19 20 21 22 "2 23 24 "2 X9 XIO 12 13 2 5 ""2 322 275 Median P. E. true — obtained median 75 per- centile 25 per- centile Q P.E. 10 11 12 13 1.86 3.60 5.45 6.80 .15 .21 .19 .22 4.43 6.85 8.26 9.56 0.00 .95 2.86 3.54 2.21 2.95 2.80 3.01 Mil— M10= 1.74 M12— Mll = 1.85 M13— M12 = 1.35 M13— M10=1.96 .158 .176 .176 .166 TABLE XXXIV Age Distribution, 10 to 13 Inclusive, of Courtis Series B Arithmetic Tests Division Rights in Hibbing, Minn. Age Scores Total X2 X3 1 2 3 4 5 6 7 8 9 10 11 I 2 13 14 15 16 17 18 19 20 21 22 23 24 X9 XIO 10 16 35 16 98 60 28 14 11 22 10 10 14 21 20 4 11 16 12 4 17 13 26 11 11 15 19 8 12 1 13 1 18 1 9 1 1 4 3 11 3 14 3 12 4 10 16 9 5 12 13 10 1 7 4 1 5 1 5 2 9 1 3 3 8 i 3 6 1 '5 2 — ~" — — — — — — — 258 11 1 3 1 "2 2 1 "i 243 1' 2 1 1 1 1 4 32 "1 229 178 13 Median P. E. true —obtained median 75 per- centile 25 per- centile Q P.E. 10 11 12 13 .79 3.15 5.97 9.44 .17 .27 .27 .45 4.50 7.48 9.73 15.12 .13 .74 2.96 5.18 2.18 3.37 3.38 4.92 Mil— M10=2.36 M12— Mll=2.82 M13— M12 = 3.47 M13— M10=8.65 .172 .220 .327 .172 size of the median for the 13-year-old children. This is not true in the case of addition, subtraction, or multiplication, though in each case there is a marked similarity in the ranking. School Systems Total gain 10 to 13 inclusive Medians 13-year-old children Hibbing Louisville Salina Arkansas City Madison County, 9-month schools Louisiana Madison County, 6-month schools 8.65 5.94 4.96 3.39 2.52 2.25 .37 9.44 8.76 6.80 3.65 3.13 2.41 .80 CHAPTER V ACHIEVEMENT AS MEASURED BY THE THORNDIKE SILENT READING SCALE ALPHA 2 The Thomdike Silent Reading Scale Alpha 2 was used to measure reading in the schools of Madison County at the same time that the tests were given in Language and Arithmetic. This scale is designed to be used as a group test, and the directions for scoring are given on the basis of groups of pupils such as would be found in one room of a city school system. In country schools such groups do not exist, and therefore individual scores were assigned each pupil, on the basis of tables prepared by Dr. Truman Lee Kelley.^ Using the individual scores assigned on the basis of these tables, the remaining problems involved in finding the differences in performance in reading of different age-groups are practically the same as in the work with the Trabue Language Scale and the Courtis Standard Re- search Tests in Arithmetic. Distributions for the respective age- groups are completed on the same assumptions, and the same age- groups are used throughout. Scores used are in terms of difficulty as assigned by Thorndike. Table XXXV gives the facts in regard to reading in the Madison County 6-month schools. The table reads, there are estimated to be 8 children 10 years old in the first grade (XI) whose scores in read- ing are unknown, 10 children 10 years of age with scores unknown are estimated to be in the second grade (X2), 1 child 10 years old made a score of 2.0, 5 made a score of 2.2, 3 a score of 2.6, 3 a score of 2.9, 2 a score of 3.2, etc. The total gain in ability to read for the three-year period from ages 10 to 13 inclusive is from 4.50 to 5.26, a difference of .76. The P.E. of this difference is .09, or about 12 per cent of the total. This gain is very small for a three-year period, and the P.E. of the gain is relatively quite large. The improvement from year to year is very uneven. From ages 10 to 11 it is .03 ; from ages 11 to 12 it is .59; and from ages 12 to 13 it is .14. The results indicate rather indefinite work in reading. ^ Kelley, T. L. : "Thorndike's Reading Scale Alpha 2 Adapted to Individual Testing," Teachers College Record, XVIII: 253#. (May, 1917). 56 TABLE XXXV Age Distribution, 10 to 13 Inclusive, of Thorndike Silent Reading Scale Alpha 2 Scores in the 6-Month White Schools of Madison County, Ky. Scores Age XI X2 2.0 2.1 2.2 2.3 2.4 2.5 2.6 2.7 2.8 2.9 3.0 3.1 3.2 3.3 3.4 3.5 3.6 3.7 3.8 3.9 4.0 4.1 4.2 4.3 4.4 4.5 4.6 4.7 4.8 4.9 5.0 5.1 5.2 5.3 5.4 5.5 5.6 5.7 5.8 5.9 6.0 6.1 0.2 6.3 6.4 6.5 6.6 6.7 6.8 6.9 7.0 7.1 7.2 7.3 7.4 7,, 5 7.6 7.7 X9 XIO XII 10 8 10 1 _._ 5 -.- .._ 3 ... 3 2 6 4 1 1 12 1 2 2 11 2 18 3 5 4 1 ? ? ? 4 •-> " — — — — — — — — — — — — — — 11 12 4 3 8 4 4 2 2 i ... 4 1 2 4 1 5 6 6 4 1 4 1 1 5 6 ... 5 1 ... 9 in 1 1 2 3 9 in 1 5 5 10 7 8 1 1 9 ] 2 9 '3 ■^ 1 3 4 2 3 4 7 2 2 2 4 2 1 7 7 ""2 1 "'3 "I ' i — "'2 — — 13 1 3 z. z. 1 z. i i: 2 i: 2 :i 1 Z 2 5 2 1 9 ... 7 10 1 8 4 2 3 1 2 4 2 1 "i 1 ::: '" "i 1 3" "1 P. E. true Age Total Median — obtained 75 per- 25 per- Q P E median centile centile 10 122 4.50 .10 5.01 3.22 .89 Mil— M10= .03 .09 11 107 4.53 .12 5.23 3.24 .99 M12— Mll= .59 .09 12 131 5.12 .09 6.06 4.37 .84 M13— M12= .14 .09 13 117 5.26 .11 6.59 4.59 1.00 M13— M10= .76 .09 TABLE XXXVI Age Distribution, 10 to 13 Inclusive, of Thorndike Silent Reading Scale Alpha 2 Scores in the 9-Month White Schools of Madison County, Ky. Afp Scores 10 XI 6 '"'3 3 X2 13 6 2.2 2 1 2.3 2.4 2.5 2.6 1 1 2.7 1 2.8 2.9 5 1 3 3.0 "i 3.1 3.2 2 2 3.3 5 2 3 3.4 "i 3.5 1 1 2 3.6 5 2 2 3.7 "2 3.8 3.9 4.0 2 1 4.1 4 5 2 1 4.2 4.3 4 1 2 4.4 "I 1.5 7 5 3 2 4.6 1.7 2 "i 4.8 3 1 2 3 4.9 2 3 5 2 5.0 5 "3 2 5.1 ' 8 "i 2 5.2 3 3 4 2 5.3 "2 5.4 "2 1 5.5 5 5 3 4 5.6 2 2 2 5.7 1 2 4 2 5.8 1 1 4 3 5.9 1 2 1 1 6.0 3 4 6 3 6.1 "i 1 6.2 1 4 6 3 6.3 "2 3 6.4 1 ""i 1 6.5 1 2 3 8 6.6 3 4 9 3 6.7 3 1 5 7 6.8 2 "3 2 6.9 "i "3 7.0 1 2 1 3 7.1 1 2 1 1 7.2 i 3 1 7.3 1 2 2 7.4 7.5 7.6 7.7 7.8 7.9 8.0 8.1 8.2 8.3 8.4 8.5 8.6 8.7 1 X9 XlO xu 11 1 2 1 7 ""2 I 1? 1 1 1 1 1 13 3 1 2 9 P. E. true Age Total Median —obtained median 75 per- centile 25 per- centile Q P. E. 10 109 4.55 .15 5.51 2.98 1.26 Mil— M10= .75 .14 11 84 5.30 .17 6.25 3.75 1.25 M12— Mll = .66 .13 12 107 5.86 .10 6.65 4.95 .85 M13— M12 = .59 .10 13 83 6.45 .13 7.01 5.14 .93 M13— M10=l .90 .12 Achievement Measured by Thorndike Reading Scale 57 Table XXXVI gives the facts in regard to reading in the 9-month schools of Madison County. The total gain for the three-year period in this case is from 4.55, the median ability of the 10-year-old children, to 6.45, the median ability of the 13-year-old children, a difference of 1.90. This gain is just 2.5 times as great as that made in the 6-month schools of the same county. The median abilities of the 10-year-old children are about alike. The comparison of amount of gain in the two cases is valid, since the scores given are in terms of difficulty for the children. It must be remembered, however, that there is no proof that the gain in each case can be attributed solely to school work. It is possible that influences outside of the school contribute materially to the re- sult. The conclusion can only be that school influence on reading and other possible influence on reading accomplish between them 2.5 times as much in places having a 9-month school term as do the same in- fluences in places having a 6-month school term. The P.E. of the gain in the 9-month schools (1.90) is .12, about 7 per cent of the gain. The probable actual deviation of the true dif- ference from the obtained difference in these schools is a little larger than the like deviation in the 6-month schools, but in proportion to the gains made in the respective schools the deviation is less in the 9-month schools. The yearly gains are much more nearly uniform than in the 6-month schools. From ages 10 to 11 the gain is .75 ; from ages 11 to 12 it is .56; and from ages 12 to 13 it is .59. Tables XXXVII to XXXIX inclusive give comparative data in re- gard to reading from certain other school systems. The data from Louisville are based upon tests given by the Psychological Laboratory of the Louisville Board of Education. Data for Hamilton Town- ship, New Jersey, were collected by the Psychology Department of the Trenton State Normal School. The data from Amsterdam, New York, were collected by the Department of Educational Administra- tion of Teachers College, Columbia University. In the following summary the total improvement in silent reading dur- ing the three-year period from ages 10 to 13 inclusive is given for each of the school systems studied, and also the median ability for the re- spective groups of 13-year-old children. The schools are listed in the order of the amount of improvement made. 58 Study of Achievement in Country and Town Schools Total gain Medians School Systems 10 to 13 inclusive 13-year-old children Amsterdam. _ -- -- 2.85 1.90 1.81 1.58 .76 6 55 Madison County, 9-month schools -. 6 45 Louisville . - -- 6.90 Hamilton Township.. .. . 6.77 Madison County, 6-month schools . . 5.25 The ranking in order of amount of improvement for the three-year period from ages 10 to 13 inclusive does not correspond exactly with the ranking in order of abihty of 13-year-old children. As has been pointed out in the case of language and arithmetic, the medians for 13-year-old children may be affected by constant errors in any of the respective systems, such as a tendency to overrun the time allowance, a little greater leniency in scoring papers in one place than in another either by the teachers or by the examiner, in giving directions, etc. Such errors are compensating when the difference between the medians for two ages is used as a measure, since these errors would be constant for any given place and time for pupils of the diiTerent ages. In view of this, it is probable that the ranking in order of total gain in the above table is the more significant ranking. The amount of gain in the respective systems is directly comparable, since the scale used is expressed in terms of units of difficulty for the children. We can say that the results in Amsterdam for the three- year period from 10 to 13 inclusive are about four times as good as are the results in the Madison County 6-month schools, and about twice as good as the results in Hamilton Township. However, not all of the improvement noted is known to be the result of school pro- cedure. A good share of the gain in ability to read silently may be due to forces outside of the school, such as library facilities, home in- fluence, newspapers, etc. Indeed, it is sometimes charged that school work in reading stresses oral work too much.^ The conclusion from the above table is therefore limited to the statement that the sum of school influence in reading and outside influences in reading is about four times as great in Amsterdam as in the Madison County 6-month schools for the equal period of time from ages 10 to 13. If equality of outside influences making for improvement in silent reading might be assumed for the different systems studied, there would be left the single variable element in the school work on silent reading. It does ^ For an example of this see Klapper, Teaching Children to Read. Achievement Measured by Thorndike Reading Scale 59 not seem probable, however, that influences other than those of the school which make for improvement in silent reading are equal in cases such as Amsterdam, New York, and the smaller schools of Mad- ison County, Kentucky. The following summary shows the gain for each age period of a year in the systems studied : School Systems Yearly Gains 10 to 11 11 to 12 12 to 13 Amsterdam.. . . __. 1.67 .75 .94 .72 .03 .62 .56 .42 .34 .59 .56 Madison County, 9- month schools .59 Louisville.. . ._ ._ . _ . .45 Hamilton Township . .52 Madison County, 6-month schools . . .14 Total 4.11 2.53 2.26 The variations in the amount of yearly gain are large, as is the case in language and arithmetic. The greatest gain seems to be from ages 10 to 11, and each year after this shows less gain than the preceding year. It appears that greater gain is made by younger children than by older ones within the limits of the age-groups studied. CONCLUSIONS 1. The difference in ability in silent reading, as measured by the Thorndike Silent Reading Scale Alpha 2, can be obtained for children of different ages. 2. Since the function measured by this scale may be improved by influences outside of the school, as well as by school training, this dif- ference cannot be considered as a wholly reliable measure of school efficiency in teaching silent reading. 3. This difference does give a reliable measure of the improvement in silent reading due to all causes during the three-year period from ages 10 to 13 inclusive. 4. Since the improvement measured by this scale is stated in terms of difficulty for the children, the differences obtained in the respective systems studied may be compared directly. 5. The differences obtained may be compared for two systems of schools, even though the testing was done at different times in the re- spective systems. 60 Study of Achievement in Country and Town Schools 6. The diflferences obtained are valid, even though there may be constant errors in the giving of the tests, such as might be caused by having the tests given by the teachers. 7. Greater gain in silent reading seems to be made by the younger children within the age limits studied (ages 10 to 13 inclusive). 8. Material gain in silent reading may be made during any part or all of the period from ages 10 to 13 inclusive. 9. The results in the Madison County 6-month schools are much poorer than in any other system studied. 10. The results in the Madison County 9-month schools compare favorably with those in the other systems studied. CHAPTER VI SUMMARY AND CONCLUSIONS This study was undertaken with four specific objects in mind. These objects are set forth in Chapter II, and are stated as follows : First : To show that the diflFerence in performance in school sub- jects of children of different ages can be obtained. Second: To show that this difference is a measure of school effi- ciency which may be used to measure schools or school systems. Third : To apply this measure to a system of country schools. Fourth : To compare the results in this country school system with the results in certain city school systems. The results of the study are considered in the light of these aims. Sections 1, 2, 3 and 4 of this chapter deal respectively with the pur- poses stated. Section 1 The purpose as stated is "to show that the difference in perform- ance in school subjects of children of different ages can be obtained." With the tests used such differences have been obtained for chil- dren from 10 to 13 years of age inclusive. As the work progressed, certain difficulties became apparent which seem to justify the following statements : The tests to be used in obtaining age differences in performance must be of such a nature that identical tests can be given in identical manner to all of the grades tested. Such a spelling scale as that de- vised by Ayres could not give age differences because the 12-year-old child in the third grade would have a score on a test different from the test used for the 12-year-old child in the sixth grade. The results for children of like age, but in different grades, would be in terms that could not be directly compared. The tests should be given in as many as possible of the grades of the elementary school. The tabulations in this study include results for grades 3 to 8 inclusive and in some cases for grades 4 to 8. With results from children in these grades it was found necessary to esti- mate the number of children in the lower grades of the respective ages studied, and it seemed unwise to attempt to find medians for 61 62 Study of Achievement in Country and Tozvn Schools groups of children under 10 years of age because of the limited num- ber of children of the lower ages tested. If the tests could have been given in grade 2, it would have been possible to calculate medians for children under 10, and the necessity of calculating the probable num- ber of 10-to- 11 -year-old children in grade 2 would have been avoided, and scores could have been assigned them. Full age-grade tables of all the children in all the grades of the systems studied should be prepared. Such tables give a very desirable check on the number of children tested, and furnish a basis for esti- mation of the number of children of any given age in grades not tested. Tests used should be such as will test the ability of the children in the lower grades as well as the ability of those in the higher grades. The work with Courtis Standard Research Tests in Arithmetic showed that these tests do not measure the ability of lower grade children, since a great many children were unable to work correctly even one of the examples given. A test that includes problems less difficult than those of this series would be desirable. Tests used must be individual tests rather than group tests ; at least it must be possible to assign individual scores on the basis of the tests given. This is necessary in order that the individual scores of chil- dren of any given age may be taken from the different grades in which these children are tested and thrown into a single distribution on an age basis. For work in country schools there is an added need for individual tests rather than group tests, since groups of children of like age or grade in any given country school are likely to be small. The above statements may be summarized as a set of directions for the guidance of those giving tests which are to be tabulated on an age basis. The concise directions are as follows : 1. Select tests that are identical for all the grades to be tested. 2. Test as many of the grades as possible. 3. Make full age-grade tables of all the children in all the grades. 4. Select tests that measure the ability of all the children. 5. Use individual rather than group tests. Section 2 The second purpose of this study as stated is "to show that this dif- ference is a measure of school efficiency which may be used to meas- ure schools or school systems." In so far as the tests used measure functions affected solely, or even Summary and Conclusions 63 largely, by school training, the difference in performance of children of different ages seems to furnish a measure of school efficiency. In the case of the Trabue Language Scale B the function measured has not been shown to be fundamentally one dependent on school training. In the case of the Courtis Standard Research Tests in Arithmetic Series B it seems that the function measured is to a very large degree at least one dependent on school training ; therefore in this case the difference obtained is one that is chiefly the direct result of the school training received by the children and of elimination, and for that rea- son may be considered a measure of the effectiveness of that training and of elimination. In the case of the Thorndike Silent Reading Scale Alpha 2 the function measured is one which is greatly affected by school training, but which may also be greatly affected by influences outside of the school. Even though the function measured be one which is affected by in- fluences other than school training, it may be argued that the work of the school should so supplement other influences brought to bear upon the children as to secure for them reasonable development of the function considered. If this conception of the work of the school is accepted, the difference between performance of children of differ- ent ages seems a sound measure of the degree to which the school has succeeded in its effort to secure the desired development. In any case in which the difference in performance of children of different ages is considered as measuring some function other than one dependent on school training for its improvement, the difficulty lies in the nature of the test rather than in the fact that the age-differ- ences are used. The same criticism would apply to the same meas- urement if grade standards were used. There are a few advantages that the use of age-differences as a measure of school efficiency seems to have over the use of grade standards. One of these is that the testing may be done at any con- venient time in the school year, with the possible exception of the first three or four weeks of the school term. This is due to the fact that the birthdays of any age-group of children, say the 10-year-olds, are distributed throughout the year in the same way as are the birthdays of any other age-group, say the 13-year-olds. This means that the loss of children from the group because they reach a higher age will be compensated by the accretion of other children from the next lower age-group. Moreover, this loss and accretion continues throughout the school year and for each age-group, so that the difference between 64 Study of Achievement in Country and Town Schools any two age-groups is a constant quantity. During the first few weeks of school there may be a shghtly uneven loss in school ability due to the vacation period, since it has never been shown that the retaining power of children of different ages is the same. After school is once well under way this uneven loss is overcome, and the testing may be done at any convenient time. Another advantage in the use of age-diflferences as a measure of school efficiency lies in the fact that errors such as those caused by having the tests given by the teachers are compensated, since such er- rors are identical for children of all ages. A further advantage in the use of age-differences lies in the fact that the effects of poor grading or great retardation are considered in the measurement of improvement. The necessity of correcting grade results for retardation is avoided, since the score of the retarded child of any given age has entered into the measurement of that age-group. The advantages mentioned above are of particular significance for work in country schools. The difficulties involved in giving tests where the schools are scattered, the grading poor, and the groups of children frequently very small, make it especially desirable to give tests in these schools at the most convenient time of the year and to have the tests given by the teacher. Section 3 The third purpose of this study as stated is "to apply this measure to a system of country schools." This purpose has been accomplished and the results given in the treatment of the respective tests. Section 4 The fourth purpose of this study as stated is "to compare the re- sults in this country school system with the results in certain city school systems." The Madison County 6-month schools have been compared through- out this study with the schools in the same county having a 9-month school term. In addition to this comparison, the results of the Trabue Language Scale B have been compared with results from Louisville, Kentucky ; Paterson, New Jersey ; and St. Paul, Minnesota. As has already been pointed out, this comparison concerns the results of school training and also other influences. The 9-month schools in Madison County made a gain in the ability to complete sentences 53 Summary and Conclusions 65 per cent greater than the gain made over the same three-year period in the 6-month schools. None of the systems studied made a gain so great as that of the Madison County 9-month schools, and all of them except St. Paul made gains greater than did the Madison County 6-month schools. St. Paul made practically the same gain as did these schools. If the comparison is made on the basis of the final ability attained by the children (medians for 13-year-olds), the Madison County 6- month schools are poorer than any of the others studied. Louisville 13-year-old children possess 50 per cent greater ability to complete sentences than do those in the smaller schools of Madison County. The children of the same age in the 9-month schools possess 25 per cent greater ability than do the children of the 6-month schools. The 10-year-old children in Louisville possess greater ability to complete sentences than do the 13-year-old children in the 6-month Madison County schools, and so do the 12-year-old children in the 9-month schools, the 11-year-olds in Paterson and the 10-year-olds in St. Paul. Whichever basis of comparison is used, the Madison County 6- month schools are at the bottom. If the age achievement is used as the basis of comparison, the Madison County 9-month schools are only kept from the bottom by the presence of the 6-month schools among the systems compared. In comparing the work in arithmetic it must be remembered that the results are in terms of examples worked correctly in a given length of time, and that it cannot be assumed that it is twice as difficult to add 8 examples as it is to add 4 in the same time. Bearing in mind this caution, it seems, on the basis of the results obtained, that while the pupil in the Madison County 6-month schools is increasing his ability to add to such an extent that he can add one more example in the time allowed, the pupil in the Madison County 9-month schools is increasing his ability to add by 1.6 examples, the pupil in Louisiana by 2.2, the one in Arkansas City by 2.7, the one in Salina by 3.0, the one in Louisville by 3.4, and the one in Hibbing by 5.7 examples. In subtraction the situation is much the same. While the pupil in the Madison County 6-month schools is improving his ability to sub- tract by 1 example, the one in the 9-month schools of the same county is improving his ability by 3.1, the one in Salina by 3.2, the one in Louisiana by 3.3, the one in Arkansas City by 4.2, the one in Louis- ville by 4.8, and the one in Hibbing by 5.8 examples. 66 Study of Achievement in Country and Town Schools While, the pupil in the 6-month schools of Madison County is im- proving his ability to multiply to such an extent that he can multiply one more example in the time allowed, the pupil in Louisiana improves his ability so that he can multiply 5.8 more examples in the time al- lowed, the pupil in the Madison County 9-month schools improves by 6.2 examples, the one in Louisville by 7.7, the one in Salina by 7.8, the one in Arkansas City by 8.8, and the one in Hibbing by 12.5 ex- amples. In division the situation is even worse. While an improvement of one example is being made by the pupil in the Madison County 6- month schools, there is an improvement of 6.1 by the pupil in the Louisiana schools, of 6.8 in the Madison County 9-month schools, of 9.1 in Arkansas City, of 13.4 in Salina, of 16.1 in Louisville, and of 23.4 in Hibbing. If the comparison be put on the basis of achievement of 13-year-old children, the situation in the Madison County 6-month schools does not seem to be much better. The median 13-year-old child in these schools can neither add, subtract, nor multiply as well as the median 10-year-old in Hibbing, and he can barely divide as well. The Madi- son County 9-month schools do better on this basis, but the median for the 13-year-old children is below the median for the 11-year-old chil- dren in Hibbing in addition, subtraction, multiplication and division. The comparison of the results of the Thorndike Silent Reading Tests shows conditions which are not quite so disastrous for the Madison County 6-month schools in that the differences are not so great. On the basis of improvement, while the pupil in the Madison County 6-month schools is improving his ability to read by one step on the Thorndike scale, the pupil in Hamilton Township improves 2.1 steps, the one in Louisville 2.4, in the Madison County 9-month schools 2.5, and in Amsterdam Z.7 steps. On the basis of age achievement the median 13-year-old child in the Madison County 6-month schools is poorer than the median 11 -year-old child in Hamilton Township, Louisville, and Amsterdam, and almost as poor as the median 11 -year- old child in the Madison County 9-month schools. The comparison of the Madison County 6-month schools with the other schools tested may be summed up in the statement that the chil- dren in these schools have less ability along every line tested than have the children of the same ages in other schools, and that they are learn- ing more slowly, except that the children in St. Paul are improving as slowly as they do in language. Summary and Conclusions 67 Final Summary The following four statements seem justified concerning the four purposes for which this study was undertaken : First: The difference in performance in school subjects can be ob- tained for children of different ages. Second: This difference is a measure which may be used to meas- ure schools or school systems, and has certain advantages for this pur- pose, especially in rural schools. Third : This measure has been applied to a system of country schools. Fourth : The Madison County 6-month schools compare unfavor- ably with all of the other schools measured. The Madison County 9-month schools compare more favorably. APPENDIX For the convenience of any who may wish to supplement the re- port made in Chapter I of scientific studies on the results of instruc- tion in rural schools, or who may later wish to bring this report up to date, this statement of the educational literature investigated is made. As a first step in searching for such data the following surveys were studied. In each case the tables showing the results were investigated to find what scores might be included from rural schools in the com- parisons made. SURVEYS Akron, Ohio. Alabama (three counties). Alabama.* Alton, 111. Amsterdam, N. Y. Anderson, Ind. Arizona.* Ashland, Ore. Atlanta, Ga. Baltimore, Md. Binghamton, N. Y. Blaine, Wash. Bloommgton, Ind. Boise, Idaho. Boston, Mass. Bridgeport, Conn. Buffalo, N. Y. Brookline, Mass. Butte, Mont. Chicago, 111. (Educational Commission). Cincinnati, Ohio. Cleveland, Ohio. Cleveland, Ohio.f Colorado. Cold Springs, N. Y. (Haldane School). Colorado (rural schools). Columbia, S. C. Connecticut (Educational Commission). Connecticut (counties). Dansville, N. Y. (High School). Dayton, Ohio. Delaware.J Delaware (School Buildings). Denver, Col. Detroit, Mich. (Recreational). Elyria, Ohio.* Evansville, Ind. (Vocational). Framingham, Mass. Gary, Ind.* Gary, Ind. J Georgia (Counties). Grafton, W. Va. Grand Junction, Col. Grand Rapids, Mich. Great Neck, L. I. Greene County, Ind. Greenwich, Conn. Hammond, Ind. (Industrial). Harrisburg, Pa. Herkimer, N. Y. Huron County. Illinois (State). Indiana (Vocational). Janesville, Wis. Jefferson County, Ind. (Vocational). Kansas (high schools). *United States Bureau of Education. tRussell Sage Foundation. JGeneral Education Board. 68 Appendix 69 Lane County, Ore. Los Angeles, Cal. Leavenworth, Kan. Louisville, Ky. Maricopa County, Ga. Maryland (State). J Memphis, Tenn.* Minneapolis, Minn. (Vocational). Missouri (Saline County). Montclair, N. J. Nassau County, N. Y. Newburgh, N. Y. New Orleans, La. (Vocational). Newton, Mass. New York City. North Dakota.* Oakland, Cal. Ogden, Utah. Ohio. Oklahoma. Oklahoma (county). Oswego County, N. Y. Paducah, Ky. Paterson, N. J. Port Townsend, Wash. Portland, Ore. Reading, Pa. Rochester, Minn. Rockford, 111. St. Louis, Mo. St. Paul, Minn. Salt Lake City, Utah. San Antonio, Texas. San Francisco, Cal. San Mateo, Cal. Saskatchewan, Canada. Solvay, N. Y. South Bend, Ind. South Dakota.* Stamford, Conn. Syracuse, N. Y. Travis County, Texas. Utica, N. Y. Van Wert, Ohio. Vermont.f Virginia (Educational Commission). Washington.* Waterbury, Conn. Westchester, N. Y. Wilmington, Del.* Windsor County, Vt. Wisconsin (State). Winston-Salem, N. C. Wyoming.* The next step in the search for data bearing on the objective results of instruction in rural schools was a study of A Selected Bibliography of Certain Phases of Educational Measurements, prepared by Edna Bryner and published in the Seventeenth Year Book of the National Society for the Study of Education, 1918. The titles listed were exainined, and whenever there seemed any possibility that the article might contain any data concerning country schools the article was stud- ied. One bulletin by E. J. Ashbaugh, entitled The Arithmetical Skill of Iowa School Children, University of Iowa Extension Bulletin, No. 24, November, 1916, was not found. In all, twenty-eight of the ref- erences were examined, and of these five were found to contain data. As a final step in the search for material bearing on the comparison of country and city schools by the use of objective standards, a study was made of the monthly lists of current educational publications pre- *United States Bureau of Education. fRussell Sage Foundation. JGeneral Education Board. 70 Study of Achievement in Country and Town Schools pared by the United States Bureau of Education, beginning with the list for June, 1917, and extending through the list for October, 1920. In this study every title and subtitle was considered, and in case there seemed a possibility that objective data might be found, the reference was investigated. In this study only two articles which seemed to bear in any way on this topic were not found. These refer- ences are: (1) Johnson, W. E., "Reading, Writing, Arithmetic and Spelling in City and Town Schools of South Dakota in 1917-1918," Bulletin of the Northern Normal and Industrial School at Aberdeen, S. D., Vol. XII, No. 2 (October, 1918) ; and (2) Heckert, J. W., "The Cleveland Survey Tests in Arithmetic in the Miami Valley," Elementary School Journal, XVIII : 447-457. ^^:iip:iiiii ipr >|g|| ■. L'-iOi'K-lfi i't"jlkv :.'!'Xii'' 'i| ' i^^'O^^^^