id sid tid token lemma pos crl-15563 1 1 oconnor.p65 oconnor.p65 PROPN crl-15563 1 2 528 528 PROPN crl-15563 1 3 college college PROPN crl-15563 1 4 & & CCONJ crl-15563 1 5 research research PROPN crl-15563 1 6 libraries library NOUN crl-15563 1 7 november november PROPN crl-15563 1 8 2002 2002 NUM crl-15563 1 9 528 528 NUM crl-15563 1 10 applying apply VERB crl-15563 1 11 systems system NOUN crl-15563 1 12 design design NOUN crl-15563 1 13 and and CCONJ crl-15563 1 14 item item NOUN crl-15563 1 15 response response NOUN crl-15563 1 16 theory theory NOUN crl-15563 1 17 to to ADP crl-15563 1 18 the the DET crl-15563 1 19 problem problem NOUN crl-15563 1 20 of of ADP crl-15563 1 21 measuring measure VERB crl-15563 1 22 information information NOUN crl-15563 1 23 literacy literacy NOUN crl-15563 1 24 skills skill VERB crl-15563 1 25 lisa lisa PROPN crl-15563 1 26 g. g. PROPN crl-15563 1 27 o’connor o’connor PROPN crl-15563 1 28 , , PUNCT crl-15563 1 29 carolyn carolyn PROPN crl-15563 1 30 j. j. PROPN crl-15563 1 31 radcliff radcliff PROPN crl-15563 1 32 , , PUNCT crl-15563 1 33 and and CCONJ crl-15563 1 34 julie julie PROPN crl-15563 1 35 a. a. PROPN crl-15563 1 36 gedeon gedeon PROPN crl-15563 1 37 lisa lisa PROPN crl-15563 1 38 g. g. PROPN crl-15563 1 39 o’connor o’connor PROPN crl-15563 1 40 is be AUX crl-15563 1 41 instructional instructional ADJ crl-15563 1 42 services service NOUN crl-15563 1 43 coordinator coordinator NOUN crl-15563 1 44 at at ADP crl-15563 1 45 kent kent PROPN crl-15563 1 46 state state PROPN crl-15563 1 47 university university PROPN crl-15563 1 48 ; ; PUNCT crl-15563 1 49 e e X crl-15563 1 50 - - NOUN crl-15563 1 51 mail mail NOUN crl-15563 1 52 : : PUNCT crl-15563 1 53 loconnor@lms.kent.edu loconnor@lms.kent.edu PROPN crl-15563 1 54 . . PUNCT crl-15563 2 1 carolyn carolyn PROPN crl-15563 2 2 j. j. PROPN crl-15563 2 3 radcliff radcliff PROPN crl-15563 2 4 is be AUX crl-15563 2 5 head head NOUN crl-15563 2 6 of of ADP crl-15563 2 7 reference reference NOUN crl-15563 2 8 services service NOUN crl-15563 2 9 at at ADP crl-15563 2 10 kent kent PROPN crl-15563 2 11 state state PROPN crl-15563 2 12 university university PROPN crl-15563 2 13 ; ; PUNCT crl-15563 2 14 email email NOUN crl-15563 2 15 : : PUNCT crl-15563 2 16 radcliff@kent.edu radcliff@kent.edu PROPN crl-15563 2 17 . . PUNCT crl-15563 3 1 julie julie PROPN crl-15563 3 2 a. a. PROPN crl-15563 3 3 gedeon gedeon PROPN crl-15563 3 4 is be AUX crl-15563 3 5 manager manager NOUN crl-15563 3 6 of of ADP crl-15563 3 7 academic academic ADJ crl-15563 3 8 technology technology NOUN crl-15563 3 9 services service NOUN crl-15563 3 10 evaluation evaluation NOUN crl-15563 3 11 at at ADP crl-15563 3 12 kent kent PROPN crl-15563 3 13 state state PROPN crl-15563 3 14 university university PROPN crl-15563 3 15 ; ; PUNCT crl-15563 3 16 e e X crl-15563 3 17 - - NOUN crl-15563 3 18 mail mail NOUN crl-15563 3 19 : : PUNCT crl-15563 3 20 jgedeon@kent.edu jgedeon@kent.edu PROPN crl-15563 3 21 . . PUNCT crl-15563 4 1 this this DET crl-15563 4 2 article article NOUN crl-15563 4 3 reports report VERB crl-15563 4 4 on on ADP crl-15563 4 5 a a DET crl-15563 4 6 project project NOUN crl-15563 4 7 to to PART crl-15563 4 8 develop develop VERB crl-15563 4 9 an an DET crl-15563 4 10 instrument instrument NOUN crl-15563 4 11 for for ADP crl-15563 4 12 programmatic programmatic ADJ crl-15563 4 13 - - PUNCT crl-15563 4 14 level level NOUN crl-15563 4 15 assessment assessment NOUN crl-15563 4 16 of of ADP crl-15563 4 17 information information NOUN crl-15563 4 18 literacy literacy NOUN crl-15563 4 19 skills skill NOUN crl-15563 4 20 that that PRON crl-15563 4 21 is be AUX crl-15563 4 22 valid valid ADJ crl-15563 4 23 — — PUNCT crl-15563 4 24 and and CCONJ crl-15563 4 25 thus thus ADV crl-15563 4 26 credible credible ADJ crl-15563 4 27 — — PUNCT crl-15563 4 28 to to ADP crl-15563 4 29 university university NOUN crl-15563 4 30 administrators administrator NOUN crl-15563 4 31 and and CCONJ crl-15563 4 32 other other ADJ crl-15563 4 33 academic academic ADJ crl-15563 4 34 personnel personnel NOUN crl-15563 4 35 . . PUNCT crl-15563 5 1 using use VERB crl-15563 5 2 a a DET crl-15563 5 3 systems system NOUN crl-15563 5 4 approach approach NOUN crl-15563 5 5 for for ADP crl-15563 5 6 test test NOUN crl-15563 5 7 development development NOUN crl-15563 5 8 and and CCONJ crl-15563 5 9 an an DET crl-15563 5 10 item item NOUN crl-15563 5 11 response response NOUN crl-15563 5 12 theory theory NOUN crl-15563 5 13 for for ADP crl-15563 5 14 data datum NOUN crl-15563 5 15 analysis analysis NOUN crl-15563 5 16 , , PUNCT crl-15563 5 17 researchers researcher NOUN crl-15563 5 18 have have AUX crl-15563 5 19 undertaken undertake VERB crl-15563 5 20 a a DET crl-15563 5 21 rigorous rigorous ADJ crl-15563 5 22 and and CCONJ crl-15563 5 23 replicable replicable ADJ crl-15563 5 24 process process NOUN crl-15563 5 25 . . PUNCT crl-15563 6 1 once once ADV crl-15563 6 2 validated validate VERB crl-15563 6 3 , , PUNCT crl-15563 6 4 this this DET crl-15563 6 5 instrument instrument NOUN crl-15563 6 6 will will AUX crl-15563 6 7 be be AUX crl-15563 6 8 administered administer VERB crl-15563 6 9 to to ADP crl-15563 6 10 students student NOUN crl-15563 6 11 to to PART crl-15563 6 12 assess assess VERB crl-15563 6 13 entry entry NOUN crl-15563 6 14 skills skill NOUN crl-15563 6 15 upon upon SCONJ crl-15563 6 16 admission admission NOUN crl-15563 6 17 to to ADP crl-15563 6 18 the the DET crl-15563 6 19 university university NOUN crl-15563 6 20 and and CCONJ crl-15563 6 21 longitudinally longitudinally ADV crl-15563 6 22 to to PART crl-15563 6 23 ascertain ascertain VERB crl-15563 6 24 whether whether SCONJ crl-15563 6 25 there there PRON crl-15563 6 26 is be VERB crl-15563 6 27 significant significant ADJ crl-15563 6 28 change change NOUN crl-15563 6 29 in in ADP crl-15563 6 30 skill skill NOUN crl-15563 6 31 levels level NOUN crl-15563 6 32 from from ADP crl-15563 6 33 admission admission NOUN crl-15563 6 34 to to ADP crl-15563 6 35 graduation graduation NOUN crl-15563 6 36 . . PUNCT crl-15563 7 1 biblical biblical ADJ crl-15563 7 2 parable parable ADJ crl-15563 7 3 on on ADP crl-15563 7 4 the the DET crl-15563 7 5 virtue virtue NOUN crl-15563 7 6 of of ADP crl-15563 7 7 tenacity tenacity NOUN crl-15563 7 8 tells tell NOUN crl-15563 7 9 of of ADP crl-15563 7 10 a a DET crl-15563 7 11 widow widow NOUN crl-15563 7 12 who who PRON crl-15563 7 13 repeatedly repeatedly ADV crl-15563 7 14 beseeches beseech VERB crl-15563 7 15 a a DET crl-15563 7 16 judge judge NOUN crl-15563 7 17 to to PART crl-15563 7 18 grant grant VERB crl-15563 7 19 her her PRON crl-15563 7 20 request request NOUN crl-15563 7 21 . . PUNCT crl-15563 8 1 finally finally ADV crl-15563 8 2 , , PUNCT crl-15563 8 3 the the DET crl-15563 8 4 judge judge NOUN crl-15563 8 5 , , PUNCT crl-15563 8 6 although although SCONJ crl-15563 8 7 not not PART crl-15563 8 8 sympathetic sympathetic ADJ crl-15563 8 9 to to ADP crl-15563 8 10 her her PRON crl-15563 8 11 cause cause NOUN crl-15563 8 12 , , PUNCT crl-15563 8 13 grants grant VERB crl-15563 8 14 her her PRON crl-15563 8 15 request request NOUN crl-15563 8 16 lest lest SCONJ crl-15563 8 17 she she PRON crl-15563 8 18 eventually eventually ADV crl-15563 8 19 exhaust exhaust VERB crl-15563 9 1 [ [ X crl-15563 9 2 him he PRON crl-15563 9 3 ] ] PUNCT crl-15563 9 4 with with ADP crl-15563 9 5 her her PRON crl-15563 9 6 coming come VERB crl-15563 9 7 . . PUNCT crl-15563 10 1 in in ADP crl-15563 10 2 the the DET crl-15563 10 3 golden golden ADJ crl-15563 10 4 age age NOUN crl-15563 10 5 of of ADP crl-15563 10 6 higher high ADJ crl-15563 10 7 education education NOUN crl-15563 10 8 , , PUNCT crl-15563 10 9 when when SCONJ crl-15563 10 10 expansion expansion NOUN crl-15563 10 11 was be AUX crl-15563 10 12 rapid rapid ADJ crl-15563 10 13 and and CCONJ crl-15563 10 14 funding fund VERB crl-15563 10 15 abundant abundant ADJ crl-15563 10 16 , , PUNCT crl-15563 10 17 the the DET crl-15563 10 18 widow widow NOUN crl-15563 10 19 ’s ’s NOUN crl-15563 10 20 technique technique NOUN crl-15563 10 21 may may AUX crl-15563 10 22 have have AUX crl-15563 10 23 been be AUX crl-15563 10 24 effective effective ADJ crl-15563 10 25 . . PUNCT crl-15563 11 1 in in ADP crl-15563 11 2 the the DET crl-15563 11 3 current current ADJ crl-15563 11 4 era era NOUN crl-15563 11 5 of of ADP crl-15563 11 6 finite finite ADJ crl-15563 11 7 resources resource NOUN crl-15563 11 8 and and CCONJ crl-15563 11 9 increased increase VERB crl-15563 11 10 fiscal fiscal ADJ crl-15563 11 11 accountability accountability NOUN crl-15563 11 12 , , PUNCT crl-15563 11 13 however however ADV crl-15563 11 14 , , PUNCT crl-15563 11 15 when when SCONJ crl-15563 11 16 libraries library NOUN crl-15563 11 17 plead plead VERB crl-15563 11 18 their their PRON crl-15563 11 19 cases case NOUN crl-15563 11 20 for for SCONJ crl-15563 11 21 resources resource NOUN crl-15563 11 22 to to PART crl-15563 11 23 support support VERB crl-15563 11 24 their their PRON crl-15563 11 25 information information NOUN crl-15563 11 26 literacy literacy NOUN crl-15563 11 27 programs program NOUN crl-15563 11 28 , , PUNCT crl-15563 11 29 persistence persistence NOUN crl-15563 11 30 alone alone ADV crl-15563 11 31 does do AUX crl-15563 11 32 not not PART crl-15563 11 33 suffice suffice VERB crl-15563 11 34 . . PUNCT crl-15563 12 1 purpose purpose NOUN crl-15563 12 2 are be AUX crl-15563 12 3 libraries library NOUN crl-15563 12 4 able able ADJ crl-15563 12 5 to to PART crl-15563 12 6 provide provide VERB crl-15563 12 7 evidence evidence NOUN crl-15563 12 8 that that SCONJ crl-15563 12 9 information information NOUN crl-15563 12 10 literacy literacy NOUN crl-15563 12 11 skills skill NOUN crl-15563 12 12 affect affect VERB crl-15563 12 13 student student NOUN crl-15563 12 14 learning learning NOUN crl-15563 12 15 and and CCONJ crl-15563 12 16 success success NOUN crl-15563 12 17 ? ? PUNCT crl-15563 13 1 a a DET crl-15563 13 2 thorough thorough ADJ crl-15563 13 3 search search NOUN crl-15563 13 4 of of ADP crl-15563 13 5 the the DET crl-15563 13 6 library library NOUN crl-15563 13 7 literature literature NOUN crl-15563 13 8 reveals reveal VERB crl-15563 13 9 that that SCONJ crl-15563 13 10 our our PRON crl-15563 13 11 profession profession NOUN crl-15563 13 12 is be AUX crl-15563 13 13 not not PART crl-15563 13 14 yet yet ADV crl-15563 13 15 in in ADP crl-15563 13 16 a a DET crl-15563 13 17 position position NOUN crl-15563 13 18 to to PART crl-15563 13 19 agree agree VERB crl-15563 13 20 on on ADP crl-15563 13 21 the the DET crl-15563 13 22 best good ADJ crl-15563 13 23 method method NOUN crl-15563 13 24 for for ADP crl-15563 13 25 assessing assess VERB crl-15563 13 26 those those DET crl-15563 13 27 skills skill NOUN crl-15563 13 28 , , PUNCT crl-15563 13 29 let let VERB crl-15563 13 30 alone alone ADV crl-15563 13 31 assert assert VERB crl-15563 13 32 that that SCONJ crl-15563 13 33 they they PRON crl-15563 13 34 make make VERB crl-15563 13 35 a a DET crl-15563 13 36 difference difference NOUN crl-15563 13 37 . . PUNCT crl-15563 14 1 the the DET crl-15563 14 2 purpose purpose NOUN crl-15563 14 3 of of ADP crl-15563 14 4 the the DET crl-15563 14 5 project project NOUN crl-15563 14 6 for for ADP crl-15563 14 7 the the DET crl-15563 14 8 standardized standardized ADJ crl-15563 14 9 assessment assessment NOUN crl-15563 14 10 of of ADP crl-15563 14 11 information information NOUN crl-15563 14 12 literacy literacy NOUN crl-15563 14 13 skills skill NOUN crl-15563 14 14 ( ( PUNCT crl-15563 14 15 sails sail NOUN crl-15563 14 16 ) ) PUNCT crl-15563 14 17 is be AUX crl-15563 14 18 to to PART crl-15563 14 19 develop develop VERB crl-15563 14 20 an an DET crl-15563 14 21 instrument instrument NOUN crl-15563 14 22 for for ADP crl-15563 14 23 programmatic programmatic ADJ crl-15563 14 24 - - PUNCT crl-15563 14 25 level level NOUN crl-15563 14 26 assessment assessment NOUN crl-15563 14 27 of of ADP crl-15563 14 28 information information NOUN crl-15563 14 29 literacy literacy NOUN crl-15563 14 30 skills skill NOUN crl-15563 14 31 that that PRON crl-15563 14 32 is be AUX crl-15563 14 33 valid valid ADJ crl-15563 14 34 — — PUNCT crl-15563 14 35 and and CCONJ crl-15563 14 36 thus thus ADV crl-15563 14 37 credible credible ADJ crl-15563 14 38 — — PUNCT crl-15563 14 39 to to ADP crl-15563 14 40 university university NOUN crl-15563 14 41 administrators administrator NOUN crl-15563 14 42 and and CCONJ crl-15563 14 43 other other ADJ crl-15563 14 44 academic academic ADJ crl-15563 14 45 personnel personnel NOUN crl-15563 14 46 . . PUNCT crl-15563 15 1 once once ADV crl-15563 15 2 validated validate VERB crl-15563 15 3 , , PUNCT crl-15563 15 4 this this DET crl-15563 15 5 instrument instrument NOUN crl-15563 15 6 will will AUX crl-15563 15 7 be be AUX crl-15563 15 8 administered administer VERB crl-15563 15 9 to to ADP crl-15563 15 10 students student NOUN crl-15563 15 11 to to PART crl-15563 15 12 assess assess VERB crl-15563 15 13 entry entry NOUN crl-15563 15 14 skills skill NOUN crl-15563 15 15 upon upon SCONJ crl-15563 15 16 admission admission NOUN crl-15563 15 17 to to ADP crl-15563 15 18 the the DET crl-15563 15 19 university university NOUN crl-15563 15 20 and and CCONJ crl-15563 15 21 longitudinally longitudinally ADV crl-15563 15 22 to to PART crl-15563 15 23 ascertain ascertain VERB crl-15563 15 24 whether whether SCONJ crl-15563 15 25 there there PRON crl-15563 15 26 is be VERB crl-15563 15 27 significant significant ADJ crl-15563 15 28 change change NOUN crl-15563 15 29 in in ADP crl-15563 15 30 skill skill NOUN crl-15563 15 31 levels level NOUN crl-15563 15 32 from from ADP crl-15563 15 33 admission admission NOUN crl-15563 15 34 to to ADP crl-15563 15 35 graduation graduation NOUN crl-15563 15 36 . . PUNCT crl-15563 16 1 after after SCONJ crl-15563 16 2 information information NOUN crl-15563 16 3 literacy literacy NOUN crl-15563 16 4 skills skill NOUN crl-15563 16 5 have have AUX crl-15563 16 6 been be AUX crl-15563 16 7 measured measure VERB crl-15563 16 8 and and CCONJ crl-15563 16 9 any any DET crl-15563 16 10 applying apply VERB crl-15563 16 11 systems system NOUN crl-15563 16 12 design design NOUN crl-15563 16 13 and and CCONJ crl-15563 16 14 item item NOUN crl-15563 16 15 response response NOUN crl-15563 16 16 theory theory NOUN crl-15563 16 17 529 529 NUM crl-15563 16 18 changes change NOUN crl-15563 16 19 in in ADP crl-15563 16 20 skill skill NOUN crl-15563 16 21 levels level NOUN crl-15563 16 22 over over ADP crl-15563 16 23 time time NOUN crl-15563 16 24 identified identify VERB crl-15563 16 25 , , PUNCT crl-15563 16 26 whether whether SCONJ crl-15563 16 27 those those DET crl-15563 16 28 skills skill NOUN crl-15563 16 29 have have AUX crl-15563 16 30 any any DET crl-15563 16 31 relationship relationship NOUN crl-15563 16 32 to to ADP crl-15563 16 33 students student NOUN crl-15563 16 34 ’ ’ PART crl-15563 16 35 academic academic ADJ crl-15563 16 36 success success NOUN crl-15563 16 37 and and CCONJ crl-15563 16 38 retention retention NOUN crl-15563 16 39 must must AUX crl-15563 16 40 be be AUX crl-15563 16 41 determined determine VERB crl-15563 16 42 . . PUNCT crl-15563 17 1 the the DET crl-15563 17 2 authors author NOUN crl-15563 17 3 of of ADP crl-15563 17 4 this this DET crl-15563 17 5 study study NOUN crl-15563 17 6 were be AUX crl-15563 17 7 inspired inspire VERB crl-15563 17 8 by by ADP crl-15563 17 9 the the DET crl-15563 17 10 wisconsin wisconsin PROPN crl-15563 17 11 ohio ohio PROPN crl-15563 17 12 reference reference PROPN crl-15563 17 13 evaluation evaluation NOUN crl-15563 17 14 project project NOUN crl-15563 17 15 ( ( PUNCT crl-15563 17 16 worep worep PROPN crl-15563 17 17 ) ) PUNCT crl-15563 17 18 , , PUNCT crl-15563 17 19 a a DET crl-15563 17 20 tool tool NOUN crl-15563 17 21 for for ADP crl-15563 17 22 evaluating evaluate VERB crl-15563 17 23 reference reference NOUN crl-15563 17 24 services service NOUN crl-15563 17 25 . . PUNCT crl-15563 18 1 the the DET crl-15563 18 2 attributes attribute NOUN crl-15563 18 3 of of ADP crl-15563 18 4 worep worep PROPN crl-15563 18 5 that that PRON crl-15563 18 6 were be AUX crl-15563 18 7 appealing appeal VERB crl-15563 18 8 were be AUX crl-15563 18 9 that that SCONJ crl-15563 18 10 it it PRON crl-15563 18 11 is be AUX crl-15563 18 12 standardized standardize VERB crl-15563 18 13 , , PUNCT crl-15563 18 14 contains contain VERB crl-15563 18 15 items item NOUN crl-15563 18 16 not not PART crl-15563 18 17 specific specific ADJ crl-15563 18 18 to to ADP crl-15563 18 19 a a DET crl-15563 18 20 particular particular ADJ crl-15563 18 21 institution institution NOUN crl-15563 18 22 or or CCONJ crl-15563 18 23 library library NOUN crl-15563 18 24 , , PUNCT crl-15563 18 25 is be AUX crl-15563 18 26 easily easily ADV crl-15563 18 27 administered administer VERB crl-15563 18 28 , , PUNCT crl-15563 18 29 has have AUX crl-15563 18 30 been be AUX crl-15563 18 31 proven prove VERB crl-15563 18 32 valid valid ADJ crl-15563 18 33 and and CCONJ crl-15563 18 34 reliable reliable ADJ crl-15563 18 35 , , PUNCT crl-15563 18 36 assesses assess VERB crl-15563 18 37 at at ADP crl-15563 18 38 an an DET crl-15563 18 39 institutional institutional ADJ crl-15563 18 40 level level NOUN crl-15563 18 41 , , PUNCT crl-15563 18 42 and and CCONJ crl-15563 18 43 provides provide VERB crl-15563 18 44 for for ADP crl-15563 18 45 both both CCONJ crl-15563 18 46 external external ADJ crl-15563 18 47 and and CCONJ crl-15563 18 48 internal internal ADJ crl-15563 18 49 benchmarking benchmarking NOUN crl-15563 18 50 . . PUNCT crl-15563 19 1 these these DET crl-15563 19 2 laudable laudable ADJ crl-15563 19 3 characteristics characteristic NOUN crl-15563 19 4 are be AUX crl-15563 19 5 ones one NOUN crl-15563 19 6 the the DET crl-15563 19 7 authors author NOUN crl-15563 19 8 sought seek VERB crl-15563 19 9 to to PART crl-15563 19 10 emulate emulate VERB crl-15563 19 11 as as SCONJ crl-15563 19 12 they they PRON crl-15563 19 13 worked work VERB crl-15563 19 14 toward toward ADP crl-15563 19 15 creating create VERB crl-15563 19 16 an an DET crl-15563 19 17 instrument instrument NOUN crl-15563 19 18 for for ADP crl-15563 19 19 measuring measure VERB crl-15563 19 20 information information NOUN crl-15563 19 21 literacy literacy NOUN crl-15563 19 22 skills skill NOUN crl-15563 19 23 . . PUNCT crl-15563 20 1 literature literature NOUN crl-15563 20 2 review review VERB crl-15563 20 3 the the DET crl-15563 20 4 library library NOUN crl-15563 20 5 literature literature NOUN crl-15563 20 6 on on ADP crl-15563 20 7 assessment assessment NOUN crl-15563 20 8 practice practice NOUN crl-15563 20 9 for for ADP crl-15563 20 10 the the DET crl-15563 20 11 past past ADJ crl-15563 20 12 twenty twenty NUM crl-15563 20 13 years year NOUN crl-15563 20 14 demonstrates demonstrate VERB crl-15563 20 15 little little ADJ crl-15563 20 16 experience experience NOUN crl-15563 20 17 in in ADP crl-15563 20 18 formalized formalize VERB crl-15563 20 19 evaluation evaluation NOUN crl-15563 20 20 in in ADP crl-15563 20 21 general general ADJ crl-15563 20 22 and and CCONJ crl-15563 20 23 does do AUX crl-15563 20 24 not not PART crl-15563 20 25 contain contain VERB crl-15563 20 26 or or CCONJ crl-15563 20 27 make make VERB crl-15563 20 28 reference reference NOUN crl-15563 20 29 to to ADP crl-15563 20 30 an an DET crl-15563 20 31 instrument instrument NOUN crl-15563 20 32 that that PRON crl-15563 20 33 is be AUX crl-15563 20 34 suitable suitable ADJ crl-15563 20 35 for for ADP crl-15563 20 36 standardized standardized ADJ crl-15563 20 37 , , PUNCT crl-15563 20 38 longitudinal longitudinal ADJ crl-15563 20 39 , , PUNCT crl-15563 20 40 and and CCONJ crl-15563 20 41 crossinstitutionally crossinstitutionally ADV crl-15563 20 42 administered administer VERB crl-15563 20 43 assessment assessment NOUN crl-15563 20 44 . . PUNCT crl-15563 21 1 “ " PUNCT crl-15563 21 2 surveys survey NOUN crl-15563 21 3 published publish VERB crl-15563 21 4 since since SCONJ crl-15563 21 5 1980 1980 NUM crl-15563 21 6 reflect reflect VERB crl-15563 21 7 an an DET crl-15563 21 8 increase increase NOUN crl-15563 21 9 in in ADP crl-15563 21 10 the the DET crl-15563 21 11 number number NOUN crl-15563 21 12 of of ADP crl-15563 21 13 institutions institution NOUN crl-15563 21 14 implementing implement VERB crl-15563 21 15 evaluation evaluation NOUN crl-15563 21 16 as as ADP crl-15563 21 17 part part NOUN crl-15563 21 18 of of ADP crl-15563 21 19 their their PRON crl-15563 21 20 bi bi PROPN crl-15563 21 21 programs program NOUN crl-15563 21 22 . . PUNCT crl-15563 22 1 however however ADV crl-15563 22 2 , , PUNCT crl-15563 22 3 formal formal ADJ crl-15563 22 4 evaluative evaluative ADJ crl-15563 22 5 methodologies methodology NOUN crl-15563 22 6 are be AUX crl-15563 22 7 still still ADV crl-15563 22 8 not not PART crl-15563 22 9 being be AUX crl-15563 22 10 applied apply VERB crl-15563 22 11 to to ADP crl-15563 22 12 any any DET crl-15563 22 13 significant significant ADJ crl-15563 22 14 degree degree NOUN crl-15563 22 15 . . PUNCT crl-15563 22 16 ”1 ”1 SPACE crl-15563 23 1 according accord VERB crl-15563 23 2 to to ADP crl-15563 23 3 teresa teresa PROPN crl-15563 23 4 b. b. PROPN crl-15563 23 5 mensching mensching PROPN crl-15563 23 6 ’s ’s PART crl-15563 23 7 1987 1987 NUM crl-15563 23 8 survey survey NOUN crl-15563 23 9 of of ADP crl-15563 23 10 loex loex NOUN crl-15563 23 11 - - PUNCT crl-15563 23 12 participating participate VERB crl-15563 23 13 libraries library NOUN crl-15563 23 14 , , PUNCT crl-15563 23 15 only only ADV crl-15563 23 16 23 23 NUM crl-15563 23 17 percent percent NOUN crl-15563 23 18 of of ADP crl-15563 23 19 respondents respondent NOUN crl-15563 23 20 who who PRON crl-15563 23 21 evaluated evaluate VERB crl-15563 23 22 bi bi PROPN crl-15563 23 23 were be AUX crl-15563 23 24 using use VERB crl-15563 23 25 an an DET crl-15563 23 26 assessment assessment NOUN crl-15563 23 27 mechanism.2 mechanism.2 NOUN crl-15563 23 28 as as SCONJ crl-15563 23 29 jill jill PROPN crl-15563 23 30 coupe coupe NOUN crl-15563 23 31 summed sum VERB crl-15563 23 32 up up ADP crl-15563 23 33 , , PUNCT crl-15563 23 34 “ " PUNCT crl-15563 23 35 perhaps perhaps ADV crl-15563 23 36 one one NUM crl-15563 23 37 reason reason NOUN crl-15563 23 38 that that PRON crl-15563 23 39 librarians librarian NOUN crl-15563 23 40 have have AUX crl-15563 23 41 neglected neglect VERB crl-15563 23 42 the the DET crl-15563 23 43 measurement measurement NOUN crl-15563 23 44 of of ADP crl-15563 23 45 basic basic ADJ crl-15563 23 46 library library NOUN crl-15563 23 47 skills skill NOUN crl-15563 23 48 is be AUX crl-15563 23 49 the the DET crl-15563 23 50 lack lack NOUN crl-15563 23 51 of of ADP crl-15563 23 52 an an DET crl-15563 23 53 adequate adequate ADJ crl-15563 23 54 survey survey NOUN crl-15563 23 55 instrument instrument NOUN crl-15563 23 56 . . PUNCT crl-15563 23 57 ”3 ”3 SPACE crl-15563 24 1 another another DET crl-15563 24 2 characteristic characteristic NOUN crl-15563 24 3 of of ADP crl-15563 24 4 current current ADJ crl-15563 24 5 assessment assessment NOUN crl-15563 24 6 programs program NOUN crl-15563 24 7 is be AUX crl-15563 24 8 that that SCONJ crl-15563 24 9 they they PRON crl-15563 24 10 emphasize emphasize VERB crl-15563 24 11 measuring measure VERB crl-15563 24 12 the the DET crl-15563 24 13 efficacy efficacy NOUN crl-15563 24 14 of of ADP crl-15563 24 15 individual individual ADJ crl-15563 24 16 components component NOUN crl-15563 24 17 of of ADP crl-15563 24 18 instruction instruction NOUN crl-15563 24 19 in in ADP crl-15563 24 20 order order NOUN crl-15563 24 21 to to PART crl-15563 24 22 plan plan VERB crl-15563 24 23 for for ADP crl-15563 24 24 improvement improvement NOUN crl-15563 24 25 , , PUNCT crl-15563 24 26 rather rather ADV crl-15563 24 27 than than ADP crl-15563 24 28 assessing assess VERB crl-15563 24 29 whether whether SCONJ crl-15563 24 30 library library NOUN crl-15563 24 31 instruction instruction NOUN crl-15563 24 32 forwards forward VERB crl-15563 24 33 the the DET crl-15563 24 34 instructional instructional ADJ crl-15563 24 35 goals goal NOUN crl-15563 24 36 of of ADP crl-15563 24 37 the the DET crl-15563 24 38 institution institution NOUN crl-15563 24 39 . . PUNCT crl-15563 25 1 thus thus ADV crl-15563 25 2 , , PUNCT crl-15563 25 3 instruments instrument NOUN crl-15563 25 4 are be AUX crl-15563 25 5 developed develop VERB crl-15563 25 6 quickly quickly ADV crl-15563 25 7 and and CCONJ crl-15563 25 8 the the DET crl-15563 25 9 gathered gather VERB crl-15563 25 10 data data NOUN crl-15563 25 11 , , PUNCT crl-15563 25 12 not not PART crl-15563 25 13 the the DET crl-15563 25 14 development development NOUN crl-15563 25 15 process process NOUN crl-15563 25 16 , , PUNCT crl-15563 25 17 are be AUX crl-15563 25 18 the the DET crl-15563 25 19 main main ADJ crl-15563 25 20 focus focus NOUN crl-15563 25 21 of of ADP crl-15563 25 22 the the DET crl-15563 25 23 research research NOUN crl-15563 25 24 reports report NOUN crl-15563 25 25 . . PUNCT crl-15563 26 1 according accord VERB crl-15563 26 2 to to ADP crl-15563 26 3 bonnie bonnie PROPN crl-15563 26 4 g. g. PROPN crl-15563 26 5 lindauer lindauer PROPN crl-15563 26 6 , , PUNCT crl-15563 26 7 “ " PUNCT crl-15563 26 8 almost almost ADV crl-15563 26 9 none none NOUN crl-15563 26 10 of of ADP crl-15563 26 11 these these DET crl-15563 26 12 publications publication NOUN crl-15563 26 13 provide provide VERB crl-15563 26 14 measures measure NOUN crl-15563 26 15 or or CCONJ crl-15563 26 16 methods method NOUN crl-15563 26 17 for for ADP crl-15563 26 18 assessing assess VERB crl-15563 26 19 the the DET crl-15563 26 20 impact impact NOUN crl-15563 26 21 of of ADP crl-15563 26 22 academic academic ADJ crl-15563 26 23 libraries library NOUN crl-15563 26 24 on on ADP crl-15563 26 25 campuswide campuswide NOUN crl-15563 26 26 educational educational ADJ crl-15563 26 27 outcomes outcome NOUN crl-15563 26 28 . . PUNCT crl-15563 27 1 overwhelmingly overwhelmingly ADV crl-15563 27 2 , , PUNCT crl-15563 27 3 the the DET crl-15563 27 4 literature literature NOUN crl-15563 27 5 is be AUX crl-15563 27 6 internally internally ADV crl-15563 27 7 focused focus VERB crl-15563 27 8 , , PUNCT crl-15563 27 9 looking look VERB crl-15563 27 10 at at ADP crl-15563 27 11 the the DET crl-15563 27 12 academic academic ADJ crl-15563 27 13 library library NOUN crl-15563 27 14 as as ADP crl-15563 27 15 an an DET crl-15563 27 16 overall overall ADJ crl-15563 27 17 organization organization NOUN crl-15563 27 18 or or CCONJ crl-15563 27 19 at at ADP crl-15563 27 20 one one NUM crl-15563 27 21 or or CCONJ crl-15563 27 22 more more ADJ crl-15563 27 23 of of ADP crl-15563 27 24 its its PRON crl-15563 27 25 components component NOUN crl-15563 27 26 or or CCONJ crl-15563 27 27 services service NOUN crl-15563 27 28 . . PUNCT crl-15563 27 29 ”4 ”4 SPACE crl-15563 28 1 lois lois PROPN crl-15563 28 2 m. m. PROPN crl-15563 28 3 pausch pausch PROPN crl-15563 28 4 and and CCONJ crl-15563 28 5 mary mary PROPN crl-15563 28 6 pagliero pagliero PROPN crl-15563 28 7 popp popp PROPN crl-15563 28 8 agree agree VERB crl-15563 28 9 : : PUNCT crl-15563 28 10 “ " PUNCT crl-15563 28 11 review review NOUN crl-15563 28 12 of of ADP crl-15563 28 13 the the DET crl-15563 28 14 recent recent ADJ crl-15563 28 15 literature literature NOUN crl-15563 28 16 on on ADP crl-15563 28 17 assessment assessment NOUN crl-15563 28 18 of of ADP crl-15563 28 19 library library NOUN crl-15563 28 20 instruction instruction NOUN crl-15563 28 21 reveals reveal VERB crl-15563 28 22 few few ADJ crl-15563 28 23 changes change NOUN crl-15563 28 24 in in ADP crl-15563 28 25 the the DET crl-15563 28 26 formal formal ADJ crl-15563 28 27 evaluation evaluation NOUN crl-15563 28 28 methodologies methodology NOUN crl-15563 28 29 employed employ VERB crl-15563 28 30 by by ADP crl-15563 28 31 librarians librarian NOUN crl-15563 28 32 . . PUNCT crl-15563 29 1 in in ADP crl-15563 29 2 fact fact NOUN crl-15563 29 3 , , PUNCT crl-15563 29 4 evaluation evaluation NOUN crl-15563 29 5 of of ADP crl-15563 29 6 any any DET crl-15563 29 7 kind kind NOUN crl-15563 29 8 is be AUX crl-15563 29 9 more more ADV crl-15563 29 10 likely likely ADJ crl-15563 29 11 to to PART crl-15563 29 12 be be AUX crl-15563 29 13 informal informal ADJ crl-15563 29 14 in in ADP crl-15563 29 15 nature nature NOUN crl-15563 29 16 , , PUNCT crl-15563 29 17 as as SCONJ crl-15563 29 18 is be AUX crl-15563 29 19 noted note VERB crl-15563 29 20 … … PUNCT crl-15563 29 21 . . PUNCT crl-15563 30 1 where where SCONJ crl-15563 30 2 formal formal ADJ crl-15563 30 3 evaluation evaluation NOUN crl-15563 30 4 is be AUX crl-15563 30 5 being be AUX crl-15563 30 6 carried carry VERB crl-15563 30 7 out out ADP crl-15563 30 8 , , PUNCT crl-15563 30 9 little little ADJ crl-15563 30 10 full full ADJ crl-15563 30 11 program program NOUN crl-15563 30 12 assessment assessment NOUN crl-15563 30 13 is be AUX crl-15563 30 14 being be AUX crl-15563 30 15 done do VERB crl-15563 30 16 . . PUNCT crl-15563 30 17 ”5 ”5 SPACE crl-15563 31 1 the the DET crl-15563 31 2 authors author NOUN crl-15563 31 3 of of ADP crl-15563 31 4 this this DET crl-15563 31 5 article article NOUN crl-15563 31 6 believe believe VERB crl-15563 31 7 that that SCONJ crl-15563 31 8 in in ADP crl-15563 31 9 order order NOUN crl-15563 31 10 to to PART crl-15563 31 11 measure measure VERB crl-15563 31 12 information information NOUN crl-15563 31 13 literacy literacy NOUN crl-15563 31 14 as as ADP crl-15563 31 15 a a DET crl-15563 31 16 campuswide campuswide NOUN crl-15563 31 17 learning learning NOUN crl-15563 31 18 outcome outcome NOUN crl-15563 31 19 , , PUNCT crl-15563 31 20 a a DET crl-15563 31 21 more more ADV crl-15563 31 22 rigorous rigorous ADJ crl-15563 31 23 process process NOUN crl-15563 31 24 must must AUX crl-15563 31 25 be be AUX crl-15563 31 26 demonstrated demonstrate VERB crl-15563 31 27 than than SCONJ crl-15563 31 28 currently currently ADV crl-15563 31 29 exists exist VERB crl-15563 31 30 . . PUNCT crl-15563 32 1 having having AUX crl-15563 32 2 failed fail VERB crl-15563 32 3 to to PART crl-15563 32 4 locate locate VERB crl-15563 32 5 an an DET crl-15563 32 6 instrument instrument NOUN crl-15563 32 7 that that PRON crl-15563 32 8 could could AUX crl-15563 32 9 be be AUX crl-15563 32 10 used use VERB crl-15563 32 11 to to PART crl-15563 32 12 assess assess VERB crl-15563 32 13 the the DET crl-15563 32 14 information information NOUN crl-15563 32 15 literacy literacy NOUN crl-15563 32 16 skills skill NOUN crl-15563 32 17 of of ADP crl-15563 32 18 students student NOUN crl-15563 32 19 longitudinally longitudinally ADV crl-15563 32 20 and and CCONJ crl-15563 32 21 across across ADP crl-15563 32 22 institutions institution NOUN crl-15563 32 23 , , PUNCT crl-15563 32 24 literature literature NOUN crl-15563 32 25 review review NOUN crl-15563 32 26 was be AUX crl-15563 32 27 performed perform VERB crl-15563 32 28 for for ADP crl-15563 32 29 articles article NOUN crl-15563 32 30 on on ADP crl-15563 32 31 the the DET crl-15563 32 32 process process NOUN crl-15563 32 33 of of ADP crl-15563 32 34 developing develop VERB crl-15563 32 35 an an DET crl-15563 32 36 instrument instrument NOUN crl-15563 32 37 to to PART crl-15563 32 38 measure measure VERB crl-15563 32 39 this this DET crl-15563 32 40 construct construct NOUN crl-15563 32 41 . . PUNCT crl-15563 33 1 what what PRON crl-15563 33 2 follows follow VERB crl-15563 33 3 is be AUX crl-15563 33 4 a a DET crl-15563 33 5 summary summary NOUN crl-15563 33 6 of of ADP crl-15563 33 7 the the DET crl-15563 33 8 most most ADV crl-15563 33 9 significant significant ADJ crl-15563 33 10 models model NOUN crl-15563 33 11 . . PUNCT crl-15563 34 1 for for ADP crl-15563 34 2 a a DET crl-15563 34 3 more more ADV crl-15563 34 4 thorough thorough ADJ crl-15563 34 5 literature literature NOUN crl-15563 34 6 review review NOUN crl-15563 34 7 , , PUNCT crl-15563 34 8 refer refer VERB crl-15563 34 9 to to ADP crl-15563 34 10 the the DET crl-15563 34 11 authors author NOUN crl-15563 34 12 ’ ’ PART crl-15563 34 13 paper paper NOUN crl-15563 34 14 on on ADP crl-15563 34 15 the the DET crl-15563 34 16 initial initial ADJ crl-15563 34 17 phase phase NOUN crl-15563 34 18 of of ADP crl-15563 34 19 this this DET crl-15563 34 20 project.6 project.6 NOUN crl-15563 34 21 eight eight NUM crl-15563 34 22 articles article NOUN crl-15563 34 23 reported report VERB crl-15563 34 24 creating create VERB crl-15563 34 25 a a DET crl-15563 34 26 “ " PUNCT crl-15563 34 27 paper paper NOUN crl-15563 34 28 - - PUNCT crl-15563 34 29 and and CCONJ crl-15563 34 30 - - PUNCT crl-15563 34 31 pencil pencil NOUN crl-15563 34 32 ” " PUNCT crl-15563 34 33 test test NOUN crl-15563 34 34 to to PART crl-15563 34 35 assess assess VERB crl-15563 34 36 information information NOUN crl-15563 34 37 literacy literacy NOUN crl-15563 34 38 skills.7 skills.7 NOUN crl-15563 34 39 with with ADP crl-15563 34 40 the the DET crl-15563 34 41 exception exception NOUN crl-15563 34 42 of of ADP crl-15563 34 43 lilith lilith PROPN crl-15563 34 44 r. r. PROPN crl-15563 34 45 kunkel kunkel PROPN crl-15563 34 46 , , PUNCT crl-15563 34 47 susan susan PROPN crl-15563 34 48 m. m. PROPN crl-15563 34 49 weaver weaver PROPN crl-15563 34 50 , , PUNCT crl-15563 34 51 and and CCONJ crl-15563 34 52 kim kim PROPN crl-15563 34 53 n. n. PROPN crl-15563 34 54 cook cook PROPN crl-15563 34 55 , , PUNCT crl-15563 34 56 studies study NOUN crl-15563 34 57 included include VERB crl-15563 34 58 all all PRON crl-15563 34 59 or or CCONJ crl-15563 34 60 parts part NOUN crl-15563 34 61 of of ADP crl-15563 34 62 their their PRON crl-15563 34 63 instruments instrument NOUN crl-15563 34 64 . . PUNCT crl-15563 35 1 all all DET crl-15563 35 2 the the DET crl-15563 35 3 tests test NOUN crl-15563 35 4 included include VERB crl-15563 35 5 questions question NOUN crl-15563 35 6 on on ADP crl-15563 35 7 basic basic ADJ crl-15563 35 8 library library NOUN crl-15563 35 9 skills skill NOUN crl-15563 35 10 , , PUNCT crl-15563 35 11 such such ADJ crl-15563 35 12 as as ADP crl-15563 35 13 opac opac ADJ crl-15563 35 14 usage usage NOUN crl-15563 35 15 , , PUNCT crl-15563 35 16 call call NOUN crl-15563 35 17 number number NOUN crl-15563 35 18 comprehension comprehension NOUN crl-15563 35 19 , , PUNCT crl-15563 35 20 basic basic ADJ crl-15563 35 21 search search NOUN crl-15563 35 22 construction construction NOUN crl-15563 35 23 , , PUNCT crl-15563 35 24 boolean boolean ADJ crl-15563 35 25 operators operator NOUN crl-15563 35 26 , , PUNCT crl-15563 35 27 citation citation NOUN crl-15563 35 28 interpretation interpretation NOUN crl-15563 35 29 , , PUNCT crl-15563 35 30 and and CCONJ crl-15563 35 31 locations location NOUN crl-15563 35 32 of of ADP crl-15563 35 33 various various ADJ crl-15563 35 34 services service NOUN crl-15563 35 35 or or CCONJ crl-15563 35 36 resources resource NOUN crl-15563 35 37 within within ADP crl-15563 35 38 the the DET crl-15563 35 39 the the DET crl-15563 35 40 authors author NOUN crl-15563 35 41 of of ADP crl-15563 35 42 this this DET crl-15563 35 43 article article NOUN crl-15563 35 44 believe believe VERB crl-15563 35 45 that that SCONJ crl-15563 35 46 in in ADP crl-15563 35 47 order order NOUN crl-15563 35 48 to to PART crl-15563 35 49 measure measure VERB crl-15563 35 50 information information NOUN crl-15563 35 51 literacy literacy NOUN crl-15563 35 52 as as ADP crl-15563 35 53 a a DET crl-15563 35 54 campuswide campuswide NOUN crl-15563 35 55 learning learning NOUN crl-15563 35 56 outcome outcome NOUN crl-15563 35 57 , , PUNCT crl-15563 35 58 a a DET crl-15563 35 59 more more ADV crl-15563 35 60 rigorous rigorous ADJ crl-15563 35 61 process process NOUN crl-15563 35 62 must must AUX crl-15563 35 63 be be AUX crl-15563 35 64 demonstrated demonstrate VERB crl-15563 35 65 than than SCONJ crl-15563 35 66 currently currently ADV crl-15563 35 67 exists exist VERB crl-15563 35 68 . . PUNCT crl-15563 36 1 530 530 NUM crl-15563 36 2 college college PROPN crl-15563 36 3 & & CCONJ crl-15563 36 4 research research PROPN crl-15563 36 5 libraries library NOUN crl-15563 36 6 november november PROPN crl-15563 36 7 2002 2002 NUM crl-15563 36 8 libraries library NOUN crl-15563 36 9 . . PUNCT crl-15563 37 1 most most ADJ crl-15563 37 2 also also ADV crl-15563 37 3 included include VERB crl-15563 37 4 items item NOUN crl-15563 37 5 to to PART crl-15563 37 6 assess assess VERB crl-15563 37 7 library library NOUN crl-15563 37 8 - - PUNCT crl-15563 37 9 related relate VERB crl-15563 37 10 attitudes attitude NOUN crl-15563 37 11 and and CCONJ crl-15563 37 12 behaviors behavior NOUN crl-15563 37 13 , , PUNCT crl-15563 37 14 to to PART crl-15563 37 15 allow allow VERB crl-15563 37 16 for for ADP crl-15563 37 17 student student NOUN crl-15563 37 18 self self NOUN crl-15563 37 19 - - PUNCT crl-15563 37 20 assessment assessment NOUN crl-15563 37 21 of of ADP crl-15563 37 22 skills skill NOUN crl-15563 37 23 , , PUNCT crl-15563 37 24 and and CCONJ crl-15563 37 25 to to PART crl-15563 37 26 gather gather VERB crl-15563 37 27 basic basic ADJ crl-15563 37 28 demographic demographic ADJ crl-15563 37 29 information information NOUN crl-15563 37 30 . . PUNCT crl-15563 38 1 instruments instrument NOUN crl-15563 38 2 contained contain VERB crl-15563 38 3 between between ADP crl-15563 38 4 nine nine NUM crl-15563 38 5 and and CCONJ crl-15563 38 6 twenty twenty NUM crl-15563 38 7 - - PUNCT crl-15563 38 8 eight eight NUM crl-15563 38 9 items item NOUN crl-15563 38 10 and and CCONJ crl-15563 38 11 were be AUX crl-15563 38 12 administered administer VERB crl-15563 38 13 to to ADP crl-15563 38 14 as as ADV crl-15563 38 15 few few ADJ crl-15563 38 16 as as ADP crl-15563 38 17 111 111 NUM crl-15563 38 18 students student NOUN crl-15563 38 19 and and CCONJ crl-15563 38 20 as as ADV crl-15563 38 21 many many ADJ crl-15563 38 22 as as ADP crl-15563 38 23 1,702 1,702 NUM crl-15563 38 24 , , PUNCT crl-15563 38 25 with with ADP crl-15563 38 26 most most ADJ crl-15563 38 27 studies study NOUN crl-15563 38 28 including include VERB crl-15563 38 29 between between ADP crl-15563 38 30 200 200 NUM crl-15563 38 31 and and CCONJ crl-15563 38 32 400 400 NUM crl-15563 38 33 students student NOUN crl-15563 38 34 . . PUNCT crl-15563 39 1 five five NUM crl-15563 39 2 of of ADP crl-15563 39 3 the the DET crl-15563 39 4 studies study NOUN crl-15563 39 5 used use VERB crl-15563 39 6 preand preand NOUN crl-15563 39 7 posttesting posttesting NOUN crl-15563 39 8 ; ; PUNCT crl-15563 39 9 three three NUM crl-15563 39 10 of of ADP crl-15563 39 11 the the DET crl-15563 39 12 preand preand NOUN crl-15563 39 13 posttests posttest NOUN crl-15563 39 14 were be AUX crl-15563 39 15 identical identical ADJ crl-15563 39 16 instruments instrument NOUN crl-15563 39 17 . . PUNCT crl-15563 40 1 all all PRON crl-15563 40 2 of of ADP crl-15563 40 3 the the DET crl-15563 40 4 instruments instrument NOUN crl-15563 40 5 contained contain VERB crl-15563 40 6 questions question NOUN crl-15563 40 7 specific specific ADJ crl-15563 40 8 to to ADP crl-15563 40 9 the the DET crl-15563 40 10 researchers researcher NOUN crl-15563 40 11 ’ ’ PART crl-15563 40 12 libraries library NOUN crl-15563 40 13 , , PUNCT crl-15563 40 14 and and CCONJ crl-15563 40 15 three three NUM crl-15563 40 16 of of ADP crl-15563 40 17 them they PRON crl-15563 40 18 were be AUX crl-15563 40 19 subject subject ADJ crl-15563 40 20 specific specific ADJ crl-15563 40 21 . . PUNCT crl-15563 41 1 most most ADJ crl-15563 41 2 of of ADP crl-15563 41 3 the the DET crl-15563 41 4 instruments instrument NOUN crl-15563 41 5 were be AUX crl-15563 41 6 administered administer VERB crl-15563 41 7 within within ADP crl-15563 41 8 two two NUM crl-15563 41 9 to to PART crl-15563 41 10 four four NUM crl-15563 41 11 weeks week NOUN crl-15563 41 12 of of ADP crl-15563 41 13 instruction instruction NOUN crl-15563 41 14 , , PUNCT crl-15563 41 15 with with ADP crl-15563 41 16 the the DET crl-15563 41 17 exception exception NOUN crl-15563 41 18 of of ADP crl-15563 41 19 a a DET crl-15563 41 20 follow follow VERB crl-15563 41 21 - - PUNCT crl-15563 41 22 up up ADP crl-15563 41 23 study study NOUN crl-15563 41 24 by by ADP crl-15563 41 25 thomas thomas PROPN crl-15563 41 26 k. k. PROPN crl-15563 41 27 fry fry PROPN crl-15563 41 28 and and CCONJ crl-15563 41 29 joan joan PROPN crl-15563 41 30 kaplowitz.8 kaplowitz.8 PROPN crl-15563 41 31 the the DET crl-15563 41 32 most most ADV crl-15563 41 33 common common ADJ crl-15563 41 34 formal formal ADJ crl-15563 41 35 data datum NOUN crl-15563 41 36 analysis analysis NOUN crl-15563 41 37 employed employ VERB crl-15563 41 38 in in ADP crl-15563 41 39 these these DET crl-15563 41 40 studies study NOUN crl-15563 41 41 was be AUX crl-15563 41 42 classical classical ADJ crl-15563 41 43 test test NOUN crl-15563 41 44 theory theory NOUN crl-15563 41 45 ( ( PUNCT crl-15563 41 46 ctt ctt ADV crl-15563 41 47 ) ) PUNCT crl-15563 41 48 . . PUNCT crl-15563 42 1 ctt ctt PROPN crl-15563 42 2 is be AUX crl-15563 42 3 a a DET crl-15563 42 4 measurement measurement NOUN crl-15563 42 5 model model NOUN crl-15563 42 6 based base VERB crl-15563 42 7 on on ADP crl-15563 42 8 information information NOUN crl-15563 42 9 provided provide VERB crl-15563 42 10 at at ADP crl-15563 42 11 the the DET crl-15563 42 12 test test NOUN crl-15563 42 13 score score NOUN crl-15563 42 14 level level NOUN crl-15563 42 15 , , PUNCT crl-15563 42 16 which which PRON crl-15563 42 17 assumes assume VERB crl-15563 42 18 that that SCONJ crl-15563 42 19 a a DET crl-15563 42 20 determination determination NOUN crl-15563 42 21 about about ADP crl-15563 42 22 examinees examinee NOUN crl-15563 42 23 may may AUX crl-15563 42 24 be be AUX crl-15563 42 25 made make VERB crl-15563 42 26 based base VERB crl-15563 42 27 on on ADP crl-15563 42 28 total total ADJ crl-15563 42 29 test test NOUN crl-15563 42 30 score score NOUN crl-15563 42 31 . . PUNCT crl-15563 43 1 it it PRON crl-15563 43 2 is be AUX crl-15563 43 3 appropriately appropriately ADV crl-15563 43 4 used use VERB crl-15563 43 5 with with ADP crl-15563 43 6 fixedlength fixedlength NOUN crl-15563 43 7 tests test NOUN crl-15563 43 8 with with ADP crl-15563 43 9 the the DET crl-15563 43 10 same same ADJ crl-15563 43 11 set set NOUN crl-15563 43 12 of of ADP crl-15563 43 13 items item NOUN crl-15563 43 14 administered administer VERB crl-15563 43 15 to to ADP crl-15563 43 16 all all DET crl-15563 43 17 respondents respondent NOUN crl-15563 43 18 . . PUNCT crl-15563 44 1 ctt ctt PROPN crl-15563 44 2 is be AUX crl-15563 44 3 best well ADV crl-15563 44 4 suited suited ADJ crl-15563 44 5 for for ADP crl-15563 44 6 traditional traditional ADJ crl-15563 44 7 testing testing NOUN crl-15563 44 8 situations situation NOUN crl-15563 44 9 in in ADP crl-15563 44 10 which which PRON crl-15563 44 11 all all DET crl-15563 44 12 members member NOUN crl-15563 44 13 of of ADP crl-15563 44 14 the the DET crl-15563 44 15 target target NOUN crl-15563 44 16 population population NOUN crl-15563 44 17 are be AUX crl-15563 44 18 administered administer VERB crl-15563 44 19 the the DET crl-15563 44 20 same same ADJ crl-15563 44 21 or or CCONJ crl-15563 44 22 parallel parallel ADJ crl-15563 44 23 sets set NOUN crl-15563 44 24 of of ADP crl-15563 44 25 test test NOUN crl-15563 44 26 items item NOUN crl-15563 44 27 ( ( PUNCT crl-15563 44 28 e.g. e.g. ADV crl-15563 44 29 , , PUNCT crl-15563 44 30 classroom classroom NOUN crl-15563 44 31 testing testing NOUN crl-15563 44 32 ) ) PUNCT crl-15563 44 33 . . PUNCT crl-15563 45 1 this this DET crl-15563 45 2 model model NOUN crl-15563 45 3 is be AUX crl-15563 45 4 acceptable acceptable ADJ crl-15563 45 5 if if SCONJ crl-15563 45 6 the the DET crl-15563 45 7 test test NOUN crl-15563 45 8 takers taker NOUN crl-15563 45 9 are be AUX crl-15563 45 10 homogeneous homogeneous ADJ crl-15563 45 11 on on ADP crl-15563 45 12 the the DET crl-15563 45 13 trait trait NOUN crl-15563 45 14 being be AUX crl-15563 45 15 measured measure VERB crl-15563 45 16 . . PUNCT crl-15563 46 1 three three NUM crl-15563 46 2 of of ADP crl-15563 46 3 these these DET crl-15563 46 4 studies study NOUN crl-15563 46 5 were be AUX crl-15563 46 6 of of ADP crl-15563 46 7 particular particular ADJ crl-15563 46 8 interest interest NOUN crl-15563 46 9 to to ADP crl-15563 46 10 this this DET crl-15563 46 11 project project NOUN crl-15563 46 12 . . PUNCT crl-15563 47 1 the the DET crl-15563 47 2 first first ADJ crl-15563 47 3 of of ADP crl-15563 47 4 these these DET crl-15563 47 5 tests test NOUN crl-15563 47 6 was be AUX crl-15563 47 7 virginia virginia PROPN crl-15563 47 8 tiefel tiefel PROPN crl-15563 47 9 ’s ’s PROPN crl-15563 47 10 report report NOUN crl-15563 47 11 describing describe VERB crl-15563 47 12 a a DET crl-15563 47 13 1986 1986 NUM crl-15563 47 14 project project NOUN crl-15563 47 15 at at ADP crl-15563 47 16 ohio ohio PROPN crl-15563 47 17 state state PROPN crl-15563 47 18 university university PROPN crl-15563 47 19 . . PUNCT crl-15563 48 1 the the DET crl-15563 48 2 purpose purpose NOUN crl-15563 48 3 of of ADP crl-15563 48 4 this this DET crl-15563 48 5 project project NOUN crl-15563 48 6 was be AUX crl-15563 48 7 to to PART crl-15563 48 8 develop develop VERB crl-15563 48 9 an an DET crl-15563 48 10 instrument instrument NOUN crl-15563 48 11 that that PRON crl-15563 48 12 could could AUX crl-15563 48 13 be be AUX crl-15563 48 14 used use VERB crl-15563 48 15 to to PART crl-15563 48 16 measure measure VERB crl-15563 48 17 the the DET crl-15563 48 18 effectiveness effectiveness NOUN crl-15563 48 19 of of ADP crl-15563 48 20 library library NOUN crl-15563 48 21 instruction instruction NOUN crl-15563 48 22 . . PUNCT crl-15563 49 1 the the DET crl-15563 49 2 resulting result VERB crl-15563 49 3 test test NOUN crl-15563 49 4 was be AUX crl-15563 49 5 administered administer VERB crl-15563 49 6 to to ADP crl-15563 49 7 1,702 1,702 NUM crl-15563 49 8 students student NOUN crl-15563 49 9 two two NUM crl-15563 49 10 weeks week NOUN crl-15563 49 11 after after SCONJ crl-15563 49 12 they they PRON crl-15563 49 13 received receive VERB crl-15563 49 14 instruction instruction NOUN crl-15563 49 15 . . PUNCT crl-15563 50 1 item item NOUN crl-15563 50 2 - - PUNCT crl-15563 50 3 by by ADP crl-15563 50 4 - - PUNCT crl-15563 50 5 item item NOUN crl-15563 50 6 analysis analysis NOUN crl-15563 50 7 for for ADP crl-15563 50 8 validity validity NOUN crl-15563 50 9 occurred occur VERB crl-15563 50 10 only only ADV crl-15563 50 11 after after SCONJ crl-15563 50 12 large large ADJ crl-15563 50 13 - - PUNCT crl-15563 50 14 scale scale NOUN crl-15563 50 15 testing testing NOUN crl-15563 50 16 had have AUX crl-15563 50 17 revealed reveal VERB crl-15563 50 18 significant significant ADJ crl-15563 50 19 weaknesses weakness NOUN crl-15563 50 20 in in ADP crl-15563 50 21 the the DET crl-15563 50 22 instrument instrument NOUN crl-15563 50 23 . . PUNCT crl-15563 51 1 tiefel tiefel PROPN crl-15563 51 2 asserted assert VERB crl-15563 51 3 that that SCONJ crl-15563 51 4 , , PUNCT crl-15563 51 5 despite despite SCONJ crl-15563 51 6 its its PRON crl-15563 51 7 flaws flaw NOUN crl-15563 51 8 , , PUNCT crl-15563 51 9 the the DET crl-15563 51 10 results result NOUN crl-15563 51 11 of of ADP crl-15563 51 12 her her PRON crl-15563 51 13 study study NOUN crl-15563 51 14 suggested suggest VERB crl-15563 51 15 that that SCONJ crl-15563 51 16 “ " PUNCT crl-15563 51 17 ohio ohio PROPN crl-15563 51 18 state state PROPN crl-15563 51 19 ’s ’s PART crl-15563 51 20 library library NOUN crl-15563 51 21 instruction instruction NOUN crl-15563 51 22 program program NOUN crl-15563 51 23 has have AUX crl-15563 51 24 brought bring VERB crl-15563 51 25 about about ADP crl-15563 51 26 a a DET crl-15563 51 27 statistically statistically ADV crl-15563 51 28 significant significant ADJ crl-15563 51 29 improvement improvement NOUN crl-15563 51 30 in in ADP crl-15563 51 31 students student NOUN crl-15563 51 32 ’ ’ PART crl-15563 51 33 knowledge knowledge NOUN crl-15563 51 34 about about ADP crl-15563 51 35 the the DET crl-15563 51 36 library library NOUN crl-15563 51 37 , , PUNCT crl-15563 51 38 their their PRON crl-15563 51 39 ability ability NOUN crl-15563 51 40 to to PART crl-15563 51 41 use use VERB crl-15563 51 42 libraries library NOUN crl-15563 51 43 , , PUNCT crl-15563 51 44 and and CCONJ crl-15563 51 45 their their PRON crl-15563 51 46 attitudes attitude NOUN crl-15563 51 47 toward toward ADP crl-15563 51 48 libraries library NOUN crl-15563 51 49 and and CCONJ crl-15563 51 50 librarians librarian NOUN crl-15563 51 51 . . PUNCT crl-15563 51 52 ”9 ”9 SPACE crl-15563 52 1 no no DET crl-15563 52 2 follow follow VERB crl-15563 52 3 - - PUNCT crl-15563 52 4 up up ADP crl-15563 52 5 assessment assessment NOUN crl-15563 52 6 was be AUX crl-15563 52 7 reported report VERB crl-15563 52 8 . . PUNCT crl-15563 53 1 nancy nancy PROPN crl-15563 53 2 wootton wootton PROPN crl-15563 53 3 colborn colborn PROPN crl-15563 53 4 and and CCONJ crl-15563 53 5 roseanne roseanne PROPN crl-15563 53 6 m. m. PROPN crl-15563 53 7 cordell cordell PROPN crl-15563 53 8 developed develop VERB crl-15563 53 9 an an DET crl-15563 53 10 instrument instrument NOUN crl-15563 53 11 to to PART crl-15563 53 12 measure measure VERB crl-15563 53 13 knowledge knowledge NOUN crl-15563 53 14 in in ADP crl-15563 53 15 five five NUM crl-15563 53 16 fundamental fundamental ADJ crl-15563 53 17 areas area NOUN crl-15563 53 18 . . PUNCT crl-15563 54 1 their their PRON crl-15563 54 2 test test NOUN crl-15563 54 3 was be AUX crl-15563 54 4 administered administer VERB crl-15563 54 5 prior prior ADV crl-15563 54 6 to to ADP crl-15563 54 7 and and CCONJ crl-15563 54 8 after after ADP crl-15563 54 9 library library NOUN crl-15563 54 10 instruction instruction NOUN crl-15563 54 11 . . PUNCT crl-15563 55 1 of of ADP crl-15563 55 2 all all DET crl-15563 55 3 the the DET crl-15563 55 4 studies study NOUN crl-15563 55 5 examined examine VERB crl-15563 55 6 , , PUNCT crl-15563 55 7 this this DET crl-15563 55 8 one one NOUN crl-15563 55 9 detailed detail VERB crl-15563 55 10 the the DET crl-15563 55 11 most most ADV crl-15563 55 12 rigorous rigorous ADJ crl-15563 55 13 development development NOUN crl-15563 55 14 process process NOUN crl-15563 55 15 , , PUNCT crl-15563 55 16 in in ADP crl-15563 55 17 which which PRON crl-15563 55 18 the the DET crl-15563 55 19 authors author NOUN crl-15563 55 20 used use VERB crl-15563 55 21 both both CCONJ crl-15563 55 22 a a DET crl-15563 55 23 difficulty difficulty NOUN crl-15563 55 24 and and CCONJ crl-15563 55 25 a a DET crl-15563 55 26 discrimination discrimination NOUN crl-15563 55 27 index index NOUN crl-15563 55 28 to to PART crl-15563 55 29 examine examine VERB crl-15563 55 30 all all DET crl-15563 55 31 items item NOUN crl-15563 55 32 and and CCONJ crl-15563 55 33 revised revise VERB crl-15563 55 34 their their PRON crl-15563 55 35 instrument instrument NOUN crl-15563 55 36 accordingly accordingly ADV crl-15563 55 37 . . PUNCT crl-15563 56 1 data datum NOUN crl-15563 56 2 from from ADP crl-15563 56 3 129 129 NUM crl-15563 56 4 students student NOUN crl-15563 56 5 showed show VERB crl-15563 56 6 no no DET crl-15563 56 7 significant significant ADJ crl-15563 56 8 difference difference NOUN crl-15563 56 9 between between ADP crl-15563 56 10 preand preand VERB crl-15563 56 11 posttest postt ADJ crl-15563 56 12 results result NOUN crl-15563 56 13 . . PUNCT crl-15563 57 1 no no DET crl-15563 57 2 explanations explanation NOUN crl-15563 57 3 were be AUX crl-15563 57 4 given give VERB crl-15563 57 5 for for ADP crl-15563 57 6 the the DET crl-15563 57 7 disappointing disappointing ADJ crl-15563 57 8 results result NOUN crl-15563 57 9 . . PUNCT crl-15563 58 1 the the DET crl-15563 58 2 authors author NOUN crl-15563 58 3 asserted assert VERB crl-15563 58 4 that that SCONJ crl-15563 58 5 the the DET crl-15563 58 6 test test NOUN crl-15563 58 7 itself itself PRON crl-15563 58 8 was be AUX crl-15563 58 9 not not PART crl-15563 58 10 the the DET crl-15563 58 11 weak weak ADJ crl-15563 58 12 link link NOUN crl-15563 58 13 ; ; PUNCT crl-15563 58 14 however however ADV crl-15563 58 15 , , PUNCT crl-15563 58 16 inadequate inadequate ADJ crl-15563 58 17 data datum NOUN crl-15563 58 18 were be AUX crl-15563 58 19 collected collect VERB crl-15563 58 20 to to PART crl-15563 58 21 rule rule VERB crl-15563 58 22 that that PRON crl-15563 58 23 out out ADP crl-15563 58 24 . . PUNCT crl-15563 59 1 their their PRON crl-15563 59 2 experience experience NOUN crl-15563 59 3 shows show VERB crl-15563 59 4 how how SCONJ crl-15563 59 5 difficult difficult ADJ crl-15563 59 6 and and CCONJ crl-15563 59 7 unpredictable unpredictable ADJ crl-15563 59 8 the the DET crl-15563 59 9 test test NOUN crl-15563 59 10 development development NOUN crl-15563 59 11 process process NOUN crl-15563 59 12 can can AUX crl-15563 59 13 be be AUX crl-15563 59 14 . . PUNCT crl-15563 60 1 larry larry PROPN crl-15563 60 2 hardesty hardesty PROPN crl-15563 60 3 , , PUNCT crl-15563 60 4 nicholas nicholas PROPN crl-15563 60 5 p. p. PROPN crl-15563 60 6 lovrich lovrich PROPN crl-15563 60 7 jr jr PROPN crl-15563 60 8 . . PROPN crl-15563 60 9 , , PUNCT crl-15563 60 10 and and CCONJ crl-15563 60 11 james james PROPN crl-15563 60 12 mannon mannon PROPN crl-15563 60 13 reported report VERB crl-15563 60 14 on on ADP crl-15563 60 15 the the DET crl-15563 60 16 development development NOUN crl-15563 60 17 of of ADP crl-15563 60 18 an an DET crl-15563 60 19 instrument instrument NOUN crl-15563 60 20 containing contain VERB crl-15563 60 21 twenty twenty NUM crl-15563 60 22 - - PUNCT crl-15563 60 23 six six NUM crl-15563 60 24 items item NOUN crl-15563 60 25 to to PART crl-15563 60 26 test test VERB crl-15563 60 27 library library NOUN crl-15563 60 28 use use NOUN crl-15563 60 29 skills skill NOUN crl-15563 60 30 and and CCONJ crl-15563 60 31 ten ten NUM crl-15563 60 32 attitudinal attitudinal ADJ crl-15563 60 33 items item NOUN crl-15563 60 34 . . PUNCT crl-15563 61 1 the the DET crl-15563 61 2 instrument instrument NOUN crl-15563 61 3 was be AUX crl-15563 61 4 administered administer VERB crl-15563 61 5 to to ADP crl-15563 61 6 162 162 NUM crl-15563 61 7 freshmen freshman NOUN crl-15563 61 8 prior prior ADV crl-15563 61 9 to to ADP crl-15563 61 10 instruction instruction NOUN crl-15563 61 11 and and CCONJ crl-15563 61 12 to to ADP crl-15563 61 13 the the DET crl-15563 61 14 same same ADJ crl-15563 61 15 group group NOUN crl-15563 61 16 eight eight NUM crl-15563 61 17 weeks week NOUN crl-15563 61 18 after after ADP crl-15563 61 19 instruction instruction NOUN crl-15563 61 20 . . PUNCT crl-15563 62 1 skill skill NOUN crl-15563 62 2 items item NOUN crl-15563 62 3 were be AUX crl-15563 62 4 considered consider VERB crl-15563 62 5 reliable reliable ADJ crl-15563 62 6 if if SCONJ crl-15563 62 7 more more ADJ crl-15563 62 8 than than ADP crl-15563 62 9 50 50 NUM crl-15563 62 10 percent percent NOUN crl-15563 62 11 and and CCONJ crl-15563 62 12 less less ADJ crl-15563 62 13 than than ADP crl-15563 62 14 90 90 NUM crl-15563 62 15 percent percent NOUN crl-15563 62 16 of of ADP crl-15563 62 17 respondents respondent NOUN crl-15563 62 18 answered answer VERB crl-15563 62 19 items item NOUN crl-15563 62 20 correctly correctly ADV crl-15563 62 21 . . PUNCT crl-15563 63 1 results result NOUN crl-15563 63 2 indicated indicate VERB crl-15563 63 3 a a DET crl-15563 63 4 35 35 NUM crl-15563 63 5 percent percent NOUN crl-15563 63 6 increase increase NOUN crl-15563 63 7 in in ADP crl-15563 63 8 correct correct ADJ crl-15563 63 9 responses response NOUN crl-15563 63 10 from from ADP crl-15563 63 11 the the DET crl-15563 63 12 first first ADJ crl-15563 63 13 to to ADP crl-15563 63 14 the the DET crl-15563 63 15 second second ADJ crl-15563 63 16 administration administration NOUN crl-15563 63 17 . . PUNCT crl-15563 64 1 researchers researcher NOUN crl-15563 64 2 used use VERB crl-15563 64 3 a a DET crl-15563 64 4 control control NOUN crl-15563 64 5 group group NOUN crl-15563 64 6 in in ADP crl-15563 64 7 the the DET crl-15563 64 8 testing testing NOUN crl-15563 64 9 phase phase NOUN crl-15563 64 10 to to PART crl-15563 64 11 ensure ensure VERB crl-15563 64 12 the the DET crl-15563 64 13 legitimacy legitimacy NOUN crl-15563 64 14 of of ADP crl-15563 64 15 any any DET crl-15563 64 16 significant significant ADJ crl-15563 64 17 differences difference NOUN crl-15563 64 18 discovered discover VERB crl-15563 64 19 in in ADP crl-15563 64 20 their their PRON crl-15563 64 21 study study NOUN crl-15563 64 22 . . PUNCT crl-15563 65 1 this this DET crl-15563 65 2 research research NOUN crl-15563 65 3 project project NOUN crl-15563 65 4 , , PUNCT crl-15563 65 5 which which PRON crl-15563 65 6 was be AUX crl-15563 65 7 later later ADV crl-15563 65 8 replicated replicate VERB crl-15563 65 9 by by ADP crl-15563 65 10 the the DET crl-15563 65 11 same same ADJ crl-15563 65 12 authors author NOUN crl-15563 65 13 , , PUNCT crl-15563 65 14 achieved achieve VERB crl-15563 65 15 its its PRON crl-15563 65 16 stated stated ADJ crl-15563 65 17 purpose purpose NOUN crl-15563 65 18 of of ADP crl-15563 65 19 providing provide VERB crl-15563 65 20 “ " PUNCT crl-15563 65 21 a a DET crl-15563 65 22 model model NOUN crl-15563 65 23 of of ADP crl-15563 65 24 evaluation evaluation NOUN crl-15563 65 25 and and CCONJ crl-15563 65 26 its its PRON crl-15563 65 27 application application NOUN crl-15563 65 28 , , PUNCT crl-15563 65 29 which which PRON crl-15563 65 30 may may AUX crl-15563 65 31 be be AUX crl-15563 65 32 of of ADP crl-15563 65 33 use use NOUN crl-15563 65 34 to to ADP crl-15563 65 35 others other NOUN crl-15563 65 36 interested interested ADJ crl-15563 65 37 in in ADP crl-15563 65 38 systematic systematic ADJ crl-15563 65 39 assessment assessment NOUN crl-15563 65 40 of of ADP crl-15563 65 41 instructional instructional ADJ crl-15563 65 42 programs program NOUN crl-15563 65 43 . . PUNCT crl-15563 66 1 ”10 ”10 PUNCT crl-15563 66 2 the the DET crl-15563 66 3 body body NOUN crl-15563 66 4 of of ADP crl-15563 66 5 literature literature NOUN crl-15563 66 6 on on ADP crl-15563 66 7 library library NOUN crl-15563 66 8 instruction instruction NOUN crl-15563 66 9 assessment assessment NOUN crl-15563 66 10 reveals reveal VERB crl-15563 66 11 weaknesses weakness NOUN crl-15563 66 12 that that SCONJ crl-15563 66 13 the the DET crl-15563 66 14 authors author NOUN crl-15563 66 15 of of ADP crl-15563 66 16 this this DET crl-15563 66 17 article article NOUN crl-15563 66 18 were be AUX crl-15563 66 19 determined determined ADJ crl-15563 66 20 to to PART crl-15563 66 21 avoid avoid VERB crl-15563 66 22 . . PUNCT crl-15563 67 1 it it PRON crl-15563 67 2 also also ADV crl-15563 67 3 affirmed affirm VERB crl-15563 67 4 the the DET crl-15563 67 5 importance importance NOUN crl-15563 67 6 of of ADP crl-15563 67 7 many many ADJ crl-15563 67 8 of of ADP crl-15563 67 9 their their PRON crl-15563 67 10 original original ADJ crl-15563 67 11 project project NOUN crl-15563 67 12 goals goal NOUN crl-15563 67 13 . . PUNCT crl-15563 68 1 for for ADP crl-15563 68 2 exapplying exapplye VERB crl-15563 68 3 systems system NOUN crl-15563 68 4 design design NOUN crl-15563 68 5 and and CCONJ crl-15563 68 6 item item NOUN crl-15563 68 7 response response NOUN crl-15563 68 8 theory theory NOUN crl-15563 68 9 531 531 NUM crl-15563 68 10 ample ample ADJ crl-15563 68 11 , , PUNCT crl-15563 68 12 it it PRON crl-15563 68 13 was be AUX crl-15563 68 14 clear clear ADJ crl-15563 68 15 that that SCONJ crl-15563 68 16 the the DET crl-15563 68 17 very very ADV crl-15563 68 18 narrow narrow ADJ crl-15563 68 19 skill skill NOUN crl-15563 68 20 sets set NOUN crl-15563 68 21 tested test VERB crl-15563 68 22 by by ADP crl-15563 68 23 most most ADJ crl-15563 68 24 of of ADP crl-15563 68 25 the the DET crl-15563 68 26 instruments instrument NOUN crl-15563 68 27 did do AUX crl-15563 68 28 not not PART crl-15563 68 29 measure measure VERB crl-15563 68 30 the the DET crl-15563 68 31 full full ADJ crl-15563 68 32 range range NOUN crl-15563 68 33 of of ADP crl-15563 68 34 the the DET crl-15563 68 35 information information NOUN crl-15563 68 36 literacy literacy NOUN crl-15563 68 37 trait trait NOUN crl-15563 68 38 . . PUNCT crl-15563 69 1 also also ADV crl-15563 69 2 , , PUNCT crl-15563 69 3 a a DET crl-15563 69 4 thorough thorough ADJ crl-15563 69 5 trial trial NOUN crl-15563 69 6 process process NOUN crl-15563 69 7 with with ADP crl-15563 69 8 small small ADJ crl-15563 69 9 , , PUNCT crl-15563 69 10 easily easily ADV crl-15563 69 11 assembled assemble VERB crl-15563 69 12 groups group NOUN crl-15563 69 13 will will AUX crl-15563 69 14 identify identify VERB crl-15563 69 15 problem problem NOUN crl-15563 69 16 items item NOUN crl-15563 69 17 prior prior ADV crl-15563 69 18 to to ADP crl-15563 69 19 large large ADJ crl-15563 69 20 group group NOUN crl-15563 69 21 trials trial NOUN crl-15563 69 22 , , PUNCT crl-15563 69 23 saving save VERB crl-15563 69 24 time time NOUN crl-15563 69 25 and and CCONJ crl-15563 69 26 effort effort NOUN crl-15563 69 27 . . PUNCT crl-15563 70 1 instrument instrument NOUN crl-15563 70 2 development development NOUN crl-15563 70 3 should should AUX crl-15563 70 4 be be AUX crl-15563 70 5 undertaken undertake VERB crl-15563 70 6 with with ADP crl-15563 70 7 thorough thorough ADJ crl-15563 70 8 consideration consideration NOUN crl-15563 70 9 for for ADP crl-15563 70 10 how how SCONJ crl-15563 70 11 assessment assessment NOUN crl-15563 70 12 will will AUX crl-15563 70 13 ultimately ultimately ADV crl-15563 70 14 be be AUX crl-15563 70 15 administered administer VERB crl-15563 70 16 . . PUNCT crl-15563 71 1 because because SCONJ crl-15563 71 2 the the DET crl-15563 71 3 aim aim NOUN crl-15563 71 4 of of ADP crl-15563 71 5 this this DET crl-15563 71 6 project project NOUN crl-15563 71 7 was be AUX crl-15563 71 8 to to PART crl-15563 71 9 conduct conduct VERB crl-15563 71 10 programmaticlevel programmaticlevel NOUN crl-15563 71 11 assessment assessment NOUN crl-15563 71 12 , , PUNCT crl-15563 71 13 participant participant ADJ crl-15563 71 14 samples sample NOUN crl-15563 71 15 had have VERB crl-15563 71 16 to to PART crl-15563 71 17 be be AUX crl-15563 71 18 large large ADJ crl-15563 71 19 enough enough ADV crl-15563 71 20 to to PART crl-15563 71 21 enable enable VERB crl-15563 71 22 results result NOUN crl-15563 71 23 to to PART crl-15563 71 24 be be AUX crl-15563 71 25 generalized generalize VERB crl-15563 71 26 to to ADP crl-15563 71 27 the the DET crl-15563 71 28 institutional institutional ADJ crl-15563 71 29 population population NOUN crl-15563 71 30 ; ; PUNCT crl-15563 71 31 therefore therefore ADV crl-15563 71 32 , , PUNCT crl-15563 71 33 the the DET crl-15563 71 34 instrument instrument NOUN crl-15563 71 35 had have VERB crl-15563 71 36 to to PART crl-15563 71 37 be be AUX crl-15563 71 38 easily easily ADV crl-15563 71 39 administered administer VERB crl-15563 71 40 and and CCONJ crl-15563 71 41 scored score VERB crl-15563 71 42 . . PUNCT crl-15563 72 1 although although SCONJ crl-15563 72 2 this this DET crl-15563 72 3 requirement requirement NOUN crl-15563 72 4 indicates indicate VERB crl-15563 72 5 assessment assessment NOUN crl-15563 72 6 that that PRON crl-15563 72 7 is be AUX crl-15563 72 8 not not PART crl-15563 72 9 authentic authentic ADJ crl-15563 72 10 ( ( PUNCT crl-15563 72 11 that that ADV crl-15563 72 12 is is ADV crl-15563 72 13 , , PUNCT crl-15563 72 14 assessment assessment NOUN crl-15563 72 15 requiring require VERB crl-15563 72 16 learners learner NOUN crl-15563 72 17 to to PART crl-15563 72 18 actually actually ADV crl-15563 72 19 perform perform VERB crl-15563 72 20 tasks task NOUN crl-15563 72 21 associated associate VERB crl-15563 72 22 with with ADP crl-15563 72 23 learning learn VERB crl-15563 72 24 outcomes outcome NOUN crl-15563 72 25 ) ) PUNCT crl-15563 72 26 , , PUNCT crl-15563 72 27 it it PRON crl-15563 72 28 is be AUX crl-15563 72 29 nonetheless nonetheless ADV crl-15563 72 30 vital vital ADJ crl-15563 72 31 to to ADP crl-15563 72 32 the the DET crl-15563 72 33 project project NOUN crl-15563 72 34 ’s ’s PART crl-15563 72 35 long long ADJ crl-15563 72 36 - - PUNCT crl-15563 72 37 term term NOUN crl-15563 72 38 goals goal NOUN crl-15563 72 39 . . PUNCT crl-15563 73 1 in in ADP crl-15563 73 2 addition addition NOUN crl-15563 73 3 , , PUNCT crl-15563 73 4 assessing assess VERB crl-15563 73 5 long long ADJ crl-15563 73 6 - - PUNCT crl-15563 73 7 term term NOUN crl-15563 73 8 skill skill NOUN crl-15563 73 9 acquisition acquisition NOUN crl-15563 73 10 is be AUX crl-15563 73 11 ultimately ultimately ADV crl-15563 73 12 more more ADV crl-15563 73 13 valuable valuable ADJ crl-15563 73 14 than than ADP crl-15563 73 15 measuring measure VERB crl-15563 73 16 short short ADJ crl-15563 73 17 - - PUNCT crl-15563 73 18 term term NOUN crl-15563 73 19 gains gain NOUN crl-15563 73 20 ; ; PUNCT crl-15563 73 21 thus thus ADV crl-15563 73 22 , , PUNCT crl-15563 73 23 longitudinal longitudinal ADJ crl-15563 73 24 testing testing NOUN crl-15563 73 25 is be AUX crl-15563 73 26 imperative imperative ADJ crl-15563 73 27 . . PUNCT crl-15563 74 1 if if SCONJ crl-15563 74 2 identical identical ADJ crl-15563 74 3 preand preand NOUN crl-15563 74 4 posttests posttest NOUN crl-15563 74 5 are be AUX crl-15563 74 6 used use VERB crl-15563 74 7 , , PUNCT crl-15563 74 8 the the DET crl-15563 74 9 effect effect NOUN crl-15563 74 10 the the DET crl-15563 74 11 test test NOUN crl-15563 74 12 - - PUNCT crl-15563 74 13 taking take VERB crl-15563 74 14 experience experience NOUN crl-15563 74 15 has have VERB crl-15563 74 16 on on ADP crl-15563 74 17 results result NOUN crl-15563 74 18 must must AUX crl-15563 74 19 be be AUX crl-15563 74 20 evaluated evaluate VERB crl-15563 74 21 . . PUNCT crl-15563 75 1 the the DET crl-15563 75 2 implication implication NOUN crl-15563 75 3 for for ADP crl-15563 75 4 the the DET crl-15563 75 5 authors author NOUN crl-15563 75 6 ’ ’ PART crl-15563 75 7 project project NOUN crl-15563 75 8 was be AUX crl-15563 75 9 that that SCONJ crl-15563 75 10 a a DET crl-15563 75 11 large large ADJ crl-15563 75 12 test test NOUN crl-15563 75 13 bank bank NOUN crl-15563 75 14 should should AUX crl-15563 75 15 be be AUX crl-15563 75 16 available available ADJ crl-15563 75 17 so so SCONJ crl-15563 75 18 that that SCONJ crl-15563 75 19 different different ADJ crl-15563 75 20 items item NOUN crl-15563 75 21 testing test VERB crl-15563 75 22 the the DET crl-15563 75 23 same same ADJ crl-15563 75 24 outcomes outcome NOUN crl-15563 75 25 can can AUX crl-15563 75 26 be be AUX crl-15563 75 27 generated generate VERB crl-15563 75 28 randomly randomly ADV crl-15563 75 29 to to PART crl-15563 75 30 accommodate accommodate VERB crl-15563 75 31 repeated repeat VERB crl-15563 75 32 testing testing NOUN crl-15563 75 33 on on ADP crl-15563 75 34 the the DET crl-15563 75 35 same same ADJ crl-15563 75 36 samples sample NOUN crl-15563 75 37 without without ADP crl-15563 75 38 test test NOUN crl-15563 75 39 experience experience NOUN crl-15563 75 40 effects effect NOUN crl-15563 75 41 . . PUNCT crl-15563 76 1 because because SCONJ crl-15563 76 2 measuring measure VERB crl-15563 76 3 information information NOUN crl-15563 76 4 literacy literacy NOUN crl-15563 76 5 alone alone ADV crl-15563 76 6 does do AUX crl-15563 76 7 not not PART crl-15563 76 8 address address VERB crl-15563 76 9 its its PRON crl-15563 76 10 relevance relevance NOUN crl-15563 76 11 to to ADP crl-15563 76 12 the the DET crl-15563 76 13 university university NOUN crl-15563 76 14 ’s ’s NUM crl-15563 76 15 mission mission NOUN crl-15563 76 16 , , PUNCT crl-15563 76 17 data datum NOUN crl-15563 76 18 must must AUX crl-15563 76 19 be be AUX crl-15563 76 20 gathered gather VERB crl-15563 76 21 and and CCONJ crl-15563 76 22 analyzed analyze VERB crl-15563 76 23 in in ADP crl-15563 76 24 such such DET crl-15563 76 25 a a DET crl-15563 76 26 way way NOUN crl-15563 76 27 as as SCONJ crl-15563 76 28 to to PART crl-15563 76 29 assess assess VERB crl-15563 76 30 the the DET crl-15563 76 31 effect effect NOUN crl-15563 76 32 of of ADP crl-15563 76 33 information information NOUN crl-15563 76 34 literacy literacy NOUN crl-15563 76 35 on on ADP crl-15563 76 36 student student NOUN crl-15563 76 37 success success NOUN crl-15563 76 38 and and CCONJ crl-15563 76 39 retention retention NOUN crl-15563 76 40 . . PUNCT crl-15563 77 1 finally finally ADV crl-15563 77 2 , , PUNCT crl-15563 77 3 the the DET crl-15563 77 4 process process NOUN crl-15563 77 5 of of ADP crl-15563 77 6 instrument instrument NOUN crl-15563 77 7 development development NOUN crl-15563 77 8 and and CCONJ crl-15563 77 9 testing testing NOUN crl-15563 77 10 should should AUX crl-15563 77 11 be be AUX crl-15563 77 12 reported report VERB crl-15563 77 13 at at ADP crl-15563 77 14 the the DET crl-15563 77 15 level level NOUN crl-15563 77 16 of of ADP crl-15563 77 17 detail detail NOUN crl-15563 77 18 needed need VERB crl-15563 77 19 to to PART crl-15563 77 20 replicate replicate VERB crl-15563 77 21 the the DET crl-15563 77 22 study study NOUN crl-15563 77 23 . . PUNCT crl-15563 78 1 the the DET crl-15563 78 2 rigor rigor NOUN crl-15563 78 3 should should AUX crl-15563 78 4 be be AUX crl-15563 78 5 evident evident ADJ crl-15563 78 6 to to ADP crl-15563 78 7 anyone anyone PRON crl-15563 78 8 who who PRON crl-15563 78 9 questions question VERB crl-15563 78 10 its its PRON crl-15563 78 11 validity validity NOUN crl-15563 78 12 . . PUNCT crl-15563 79 1 as as SCONJ crl-15563 79 2 ralph ralph PROPN crl-15563 79 3 catts catts PROPN crl-15563 79 4 wrote write VERB crl-15563 79 5 , , PUNCT crl-15563 79 6 “ " PUNCT crl-15563 79 7 for for ADP crl-15563 79 8 assessment assessment NOUN crl-15563 79 9 of of ADP crl-15563 79 10 information information NOUN crl-15563 79 11 literacy literacy NOUN crl-15563 79 12 to to PART crl-15563 79 13 be be AUX crl-15563 79 14 accepted accept VERB crl-15563 79 15 , , PUNCT crl-15563 79 16 all all DET crl-15563 79 17 stakeholders stakeholder NOUN crl-15563 79 18 must must AUX crl-15563 79 19 have have VERB crl-15563 79 20 confidence confidence NOUN crl-15563 79 21 in in ADP crl-15563 79 22 the the DET crl-15563 79 23 reliability reliability NOUN crl-15563 79 24 of of ADP crl-15563 79 25 the the DET crl-15563 79 26 assessments assessment NOUN crl-15563 79 27 . . PUNCT crl-15563 80 1 this this PRON crl-15563 80 2 means mean VERB crl-15563 80 3 that that SCONJ crl-15563 80 4 assessment assessment NOUN crl-15563 80 5 must must AUX crl-15563 80 6 be be AUX crl-15563 80 7 internally internally ADV crl-15563 80 8 consistent consistent ADJ crl-15563 80 9 , , PUNCT crl-15563 80 10 and and CCONJ crl-15563 80 11 reproducible reproducible ADJ crl-15563 80 12 . . PUNCT crl-15563 80 13 ”11 ”11 PROPN crl-15563 80 14 methodology methodology PROPN crl-15563 80 15 the the DET crl-15563 80 16 developmental developmental ADJ crl-15563 80 17 phase phase NOUN crl-15563 80 18 of of ADP crl-15563 80 19 this this DET crl-15563 80 20 project project NOUN crl-15563 80 21 was be AUX crl-15563 80 22 based base VERB crl-15563 80 23 on on ADP crl-15563 80 24 a a DET crl-15563 80 25 systems system NOUN crl-15563 80 26 model model NOUN crl-15563 80 27 popularized popularize VERB crl-15563 80 28 by by ADP crl-15563 80 29 walter walter PROPN crl-15563 80 30 dick dick PROPN crl-15563 80 31 and and CCONJ crl-15563 80 32 lou lou PROPN crl-15563 80 33 carey.12 carey.12 PROPN crl-15563 80 34 this this DET crl-15563 80 35 model model NOUN crl-15563 80 36 theorizes theorize VERB crl-15563 80 37 that that SCONJ crl-15563 80 38 instruction instruction NOUN crl-15563 80 39 is be AUX crl-15563 80 40 a a DET crl-15563 80 41 systematic systematic ADJ crl-15563 80 42 process process NOUN crl-15563 80 43 in in ADP crl-15563 80 44 which which PRON crl-15563 80 45 every every DET crl-15563 80 46 component component NOUN crl-15563 80 47 , , PUNCT crl-15563 80 48 including include VERB crl-15563 80 49 assessment assessment NOUN crl-15563 80 50 , , PUNCT crl-15563 80 51 is be AUX crl-15563 80 52 crucial crucial ADJ crl-15563 80 53 for for ADP crl-15563 80 54 learning learn VERB crl-15563 80 55 to to PART crl-15563 80 56 occur occur VERB crl-15563 80 57 . . PUNCT crl-15563 81 1 it it PRON crl-15563 81 2 asserts assert VERB crl-15563 81 3 that that SCONJ crl-15563 81 4 legitimate legitimate ADJ crl-15563 81 5 assessment assessment NOUN crl-15563 81 6 is be AUX crl-15563 81 7 inexorably inexorably ADV crl-15563 81 8 linked link VERB crl-15563 81 9 to to ADP crl-15563 81 10 instructional instructional ADJ crl-15563 81 11 goals goal NOUN crl-15563 81 12 and and CCONJ crl-15563 81 13 performance performance NOUN crl-15563 81 14 outcomes outcome NOUN crl-15563 81 15 . . PUNCT crl-15563 82 1 the the DET crl-15563 82 2 systems system NOUN crl-15563 82 3 process process NOUN crl-15563 82 4 is be AUX crl-15563 82 5 thorough thorough ADJ crl-15563 82 6 and and CCONJ crl-15563 82 7 time time NOUN crl-15563 82 8 - - PUNCT crl-15563 82 9 consuming consume VERB crl-15563 82 10 , , PUNCT crl-15563 82 11 so so CCONJ crl-15563 82 12 it it PRON crl-15563 82 13 is be AUX crl-15563 82 14 best well ADV crl-15563 82 15 suited suited ADJ crl-15563 82 16 to to ADP crl-15563 82 17 programs program NOUN crl-15563 82 18 of of ADP crl-15563 82 19 instruction instruction NOUN crl-15563 82 20 rather rather ADV crl-15563 82 21 than than ADP crl-15563 82 22 to to ADP crl-15563 82 23 individual individual ADJ crl-15563 82 24 instructional instructional ADJ crl-15563 82 25 sessions session NOUN crl-15563 82 26 . . PUNCT crl-15563 83 1 there there PRON crl-15563 83 2 are be VERB crl-15563 83 3 five five NUM crl-15563 83 4 phases phase NOUN crl-15563 83 5 of of ADP crl-15563 83 6 systematic systematic ADJ crl-15563 83 7 instructional instructional ADJ crl-15563 83 8 design design NOUN crl-15563 83 9 that that PRON crl-15563 83 10 lead lead VERB crl-15563 83 11 to to ADP crl-15563 83 12 effective effective ADJ crl-15563 83 13 instruction instruction NOUN crl-15563 83 14 and and CCONJ crl-15563 83 15 assessment assessment NOUN crl-15563 83 16 . . PUNCT crl-15563 84 1 the the DET crl-15563 84 2 first first ADJ crl-15563 84 3 phase phase NOUN crl-15563 84 4 is be AUX crl-15563 84 5 to to PART crl-15563 84 6 determine determine VERB crl-15563 84 7 what what PRON crl-15563 84 8 , , PUNCT crl-15563 84 9 specifically specifically ADV crl-15563 84 10 , , PUNCT crl-15563 84 11 the the DET crl-15563 84 12 researcher researcher NOUN crl-15563 84 13 wants want VERB crl-15563 84 14 learners learner NOUN crl-15563 84 15 to to PART crl-15563 84 16 be be AUX crl-15563 84 17 able able ADJ crl-15563 84 18 to to PART crl-15563 84 19 do do VERB crl-15563 84 20 as as ADP crl-15563 84 21 the the DET crl-15563 84 22 result result NOUN crl-15563 84 23 of of ADP crl-15563 84 24 instruction instruction NOUN crl-15563 84 25 . . PUNCT crl-15563 85 1 the the DET crl-15563 85 2 second second ADJ crl-15563 85 3 phase phase NOUN crl-15563 85 4 is be AUX crl-15563 85 5 to to PART crl-15563 85 6 analyze analyze VERB crl-15563 85 7 the the DET crl-15563 85 8 instructional instructional ADJ crl-15563 85 9 goal goal NOUN crl-15563 85 10 , , PUNCT crl-15563 85 11 which which PRON crl-15563 85 12 means mean VERB crl-15563 85 13 describing describe VERB crl-15563 85 14 precisely precisely ADV crl-15563 85 15 the the DET crl-15563 85 16 behaviors behavior NOUN crl-15563 85 17 that that SCONJ crl-15563 85 18 learners learner NOUN crl-15563 85 19 will will AUX crl-15563 85 20 engage engage VERB crl-15563 85 21 in in ADP crl-15563 85 22 when when SCONJ crl-15563 85 23 they they PRON crl-15563 85 24 have have AUX crl-15563 85 25 achieved achieve VERB crl-15563 85 26 that that DET crl-15563 85 27 goal goal NOUN crl-15563 85 28 . . PUNCT crl-15563 86 1 fortunately fortunately ADV crl-15563 86 2 , , PUNCT crl-15563 86 3 when when SCONJ crl-15563 86 4 the the DET crl-15563 86 5 authors author NOUN crl-15563 86 6 first first ADV crl-15563 86 7 began begin VERB crl-15563 86 8 analyzing analyze VERB crl-15563 86 9 information information NOUN crl-15563 86 10 literacy literacy NOUN crl-15563 86 11 in in ADP crl-15563 86 12 1998 1998 NUM crl-15563 86 13 , , PUNCT crl-15563 86 14 the the DET crl-15563 86 15 first first ADJ crl-15563 86 16 two two NUM crl-15563 86 17 of of ADP crl-15563 86 18 these these DET crl-15563 86 19 phases phase NOUN crl-15563 86 20 had have AUX crl-15563 86 21 been be AUX crl-15563 86 22 essentially essentially ADV crl-15563 86 23 accomplished accomplish VERB crl-15563 86 24 with with ADP crl-15563 86 25 publication publication NOUN crl-15563 86 26 of of ADP crl-15563 86 27 the the DET crl-15563 86 28 nine nine NUM crl-15563 86 29 standards standard NOUN crl-15563 86 30 of of ADP crl-15563 86 31 student student NOUN crl-15563 86 32 learning learning NOUN crl-15563 86 33 from from ADP crl-15563 86 34 the the DET crl-15563 86 35 association association NOUN crl-15563 86 36 of of ADP crl-15563 86 37 school school NOUN crl-15563 86 38 librarians.13 librarians.13 NOUN crl-15563 86 39 these these DET crl-15563 86 40 standards standard NOUN crl-15563 86 41 and and CCONJ crl-15563 86 42 their their PRON crl-15563 86 43 corresponding correspond VERB crl-15563 86 44 performance performance NOUN crl-15563 86 45 indicators indicator NOUN crl-15563 86 46 delineated delineate VERB crl-15563 86 47 information information NOUN crl-15563 86 48 literacy literacy NOUN crl-15563 86 49 and and CCONJ crl-15563 86 50 clearly clearly ADV crl-15563 86 51 defined define VERB crl-15563 86 52 its its PRON crl-15563 86 53 goals goal NOUN crl-15563 86 54 . . PUNCT crl-15563 87 1 the the DET crl-15563 87 2 third third ADJ crl-15563 87 3 phase phase NOUN crl-15563 87 4 is be AUX crl-15563 87 5 to to PART crl-15563 87 6 analyze analyze VERB crl-15563 87 7 learners learner NOUN crl-15563 87 8 and and CCONJ crl-15563 87 9 contexts context NOUN crl-15563 87 10 to to PART crl-15563 87 11 gain gain VERB crl-15563 87 12 a a DET crl-15563 87 13 more more ADV crl-15563 87 14 complete complete ADJ crl-15563 87 15 understanding understanding NOUN crl-15563 87 16 of of ADP crl-15563 87 17 the the DET crl-15563 87 18 learning learning NOUN crl-15563 87 19 environment environment NOUN crl-15563 87 20 . . PUNCT crl-15563 88 1 the the DET crl-15563 88 2 authors author NOUN crl-15563 88 3 ’ ’ PART crl-15563 88 4 analysis analysis NOUN crl-15563 88 5 was be AUX crl-15563 88 6 based base VERB crl-15563 88 7 on on ADP crl-15563 88 8 national national ADJ crl-15563 88 9 trends trend NOUN crl-15563 88 10 in in ADP crl-15563 88 11 college college NOUN crl-15563 88 12 student student NOUN crl-15563 88 13 expectations expectation NOUN crl-15563 88 14 and and CCONJ crl-15563 88 15 experiences experience NOUN crl-15563 88 16 , , PUNCT crl-15563 88 17 data datum NOUN crl-15563 88 18 provided provide VERB crl-15563 88 19 by by ADP crl-15563 88 20 kent kent PROPN crl-15563 88 21 state state PROPN crl-15563 88 22 university university PROPN crl-15563 88 23 ’s ’s PART crl-15563 88 24 ( ( PUNCT crl-15563 88 25 ksu ksu PROPN crl-15563 88 26 ) ) PUNCT crl-15563 88 27 office office NOUN crl-15563 88 28 of of ADP crl-15563 88 29 institutional institutional ADJ crl-15563 88 30 research research NOUN crl-15563 88 31 ( ( PUNCT crl-15563 88 32 e.g. e.g. ADV crl-15563 88 33 , , PUNCT crl-15563 88 34 graduation graduation NOUN crl-15563 88 35 rates rate NOUN crl-15563 88 36 , , PUNCT crl-15563 88 37 act act NOUN crl-15563 88 38 scores score NOUN crl-15563 88 39 , , PUNCT crl-15563 88 40 high high ADJ crl-15563 88 41 school school NOUN crl-15563 88 42 grade grade NOUN crl-15563 88 43 point point NOUN crl-15563 88 44 averages average NOUN crl-15563 88 45 , , PUNCT crl-15563 88 46 etc etc X crl-15563 88 47 . . PUNCT crl-15563 88 48 ) ) PUNCT crl-15563 88 49 and and CCONJ crl-15563 88 50 personal personal ADJ crl-15563 88 51 experience experience NOUN crl-15563 88 52 in in ADP crl-15563 88 53 working work VERB crl-15563 88 54 with with ADP crl-15563 88 55 students student NOUN crl-15563 88 56 over over ADP crl-15563 88 57 the the DET crl-15563 88 58 years year NOUN crl-15563 88 59 . . PUNCT crl-15563 89 1 this this DET crl-15563 89 2 phase phase NOUN crl-15563 89 3 is be AUX crl-15563 89 4 an an DET crl-15563 89 5 opportunity opportunity NOUN crl-15563 89 6 to to PART crl-15563 89 7 shift shift VERB crl-15563 89 8 away away ADV crl-15563 89 9 from from ADP crl-15563 89 10 a a DET crl-15563 89 11 narrow narrow ADJ crl-15563 89 12 focus focus NOUN crl-15563 89 13 on on ADP crl-15563 89 14 the the DET crl-15563 89 15 specific specific ADJ crl-15563 89 16 task task NOUN crl-15563 89 17 and and CCONJ crl-15563 89 18 to to PART crl-15563 89 19 think think VERB crl-15563 89 20 more more ADV crl-15563 89 21 broadly broadly ADV crl-15563 89 22 about about ADP crl-15563 89 23 the the DET crl-15563 89 24 population population NOUN crl-15563 89 25 to to PART crl-15563 89 26 be be AUX crl-15563 89 27 studied study VERB crl-15563 89 28 . . PUNCT crl-15563 90 1 after after ADP crl-15563 90 2 analyzing analyze VERB crl-15563 90 3 learners learner NOUN crl-15563 90 4 and and CCONJ crl-15563 90 5 contexts context NOUN crl-15563 90 6 , , PUNCT crl-15563 90 7 the the DET crl-15563 90 8 fourth fourth ADJ crl-15563 90 9 phase phase NOUN crl-15563 90 10 is be AUX crl-15563 90 11 to to PART crl-15563 90 12 write write VERB crl-15563 90 13 performance performance NOUN crl-15563 90 14 objectives objective NOUN crl-15563 90 15 . . PUNCT crl-15563 91 1 these these DET crl-15563 91 2 objectives objective NOUN crl-15563 91 3 are be AUX crl-15563 91 4 specific specific ADJ crl-15563 91 5 statements statement NOUN crl-15563 91 6 that that PRON crl-15563 91 7 identify identify VERB crl-15563 91 8 and and CCONJ crl-15563 91 9 describe describe VERB crl-15563 91 10 skills skill NOUN crl-15563 91 11 to to PART crl-15563 91 12 be be AUX crl-15563 91 13 attained attain VERB crl-15563 91 14 , , PUNCT crl-15563 91 15 conditions condition NOUN crl-15563 91 16 under under ADP crl-15563 91 17 which which PRON crl-15563 91 18 they they PRON crl-15563 91 19 must must AUX crl-15563 91 20 be be AUX crl-15563 91 21 performed perform VERB crl-15563 91 22 , , PUNCT crl-15563 91 23 and and CCONJ crl-15563 91 24 criteria criterion NOUN crl-15563 91 25 for for ADP crl-15563 91 26 successful successful ADJ crl-15563 91 27 performance performance NOUN crl-15563 91 28 . . PUNCT crl-15563 92 1 because because SCONJ crl-15563 92 2 the the DET crl-15563 92 3 objec532 objec532 PROPN crl-15563 92 4 college college PROPN crl-15563 92 5 & & CCONJ crl-15563 92 6 research research PROPN crl-15563 92 7 libraries library NOUN crl-15563 92 8 november november PROPN crl-15563 92 9 2002 2002 NUM crl-15563 92 10 tives tive NOUN crl-15563 92 11 must must AUX crl-15563 92 12 be be AUX crl-15563 92 13 written write VERB crl-15563 92 14 for for ADP crl-15563 92 15 every every DET crl-15563 92 16 skill skill NOUN crl-15563 92 17 and and CCONJ crl-15563 92 18 subskill subskill NOUN crl-15563 92 19 required require VERB crl-15563 92 20 to to PART crl-15563 92 21 meet meet VERB crl-15563 92 22 the the DET crl-15563 92 23 overall overall ADJ crl-15563 92 24 instructional instructional ADJ crl-15563 92 25 goal goal NOUN crl-15563 92 26 , , PUNCT crl-15563 92 27 this this DET crl-15563 92 28 phase phase NOUN crl-15563 92 29 can can AUX crl-15563 92 30 be be AUX crl-15563 92 31 both both CCONJ crl-15563 92 32 tedious tedious ADJ crl-15563 92 33 and and CCONJ crl-15563 92 34 time time NOUN crl-15563 92 35 - - PUNCT crl-15563 92 36 consuming consume VERB crl-15563 92 37 . . PUNCT crl-15563 93 1 in in ADP crl-15563 93 2 fact fact NOUN crl-15563 93 3 , , PUNCT crl-15563 93 4 it it PRON crl-15563 93 5 took take VERB crl-15563 93 6 a a DET crl-15563 93 7 ksu ksu PROPN crl-15563 93 8 team team NOUN crl-15563 93 9 of of ADP crl-15563 93 10 four four NUM crl-15563 93 11 instructional instructional ADJ crl-15563 93 12 services service NOUN crl-15563 93 13 librarians librarian VERB crl-15563 93 14 several several ADJ crl-15563 93 15 months month NOUN crl-15563 93 16 of of ADP crl-15563 93 17 concentrated concentrated ADJ crl-15563 93 18 work work NOUN crl-15563 93 19 to to PART crl-15563 93 20 complete complete VERB crl-15563 93 21 this this DET crl-15563 93 22 phase phase NOUN crl-15563 93 23 . . PUNCT crl-15563 94 1 for for ADP crl-15563 94 2 these these DET crl-15563 94 3 reasons reason NOUN crl-15563 94 4 , , PUNCT crl-15563 94 5 this this PRON crl-15563 94 6 is be AUX crl-15563 94 7 the the DET crl-15563 94 8 phase phase NOUN crl-15563 94 9 researchers researcher NOUN crl-15563 94 10 may may AUX crl-15563 94 11 be be AUX crl-15563 94 12 most most ADV crl-15563 94 13 likely likely ADJ crl-15563 94 14 to to PART crl-15563 94 15 skip skip VERB crl-15563 94 16 or or CCONJ crl-15563 94 17 rush rush VERB crl-15563 94 18 through through ADV crl-15563 94 19 . . PUNCT crl-15563 95 1 if if SCONJ crl-15563 95 2 this this DET crl-15563 95 3 phase phase NOUN crl-15563 95 4 is be AUX crl-15563 95 5 done do VERB crl-15563 95 6 well well ADV crl-15563 95 7 , , PUNCT crl-15563 95 8 the the DET crl-15563 95 9 next next ADJ crl-15563 95 10 phase phase NOUN crl-15563 95 11 can can AUX crl-15563 95 12 be be AUX crl-15563 95 13 accomplished accomplish VERB crl-15563 95 14 more more ADV crl-15563 95 15 efficiently efficiently ADV crl-15563 95 16 and and CCONJ crl-15563 95 17 effectively effectively ADV crl-15563 95 18 . . PUNCT crl-15563 96 1 although although SCONJ crl-15563 96 2 the the DET crl-15563 96 3 writing writing NOUN crl-15563 96 4 of of ADP crl-15563 96 5 objectives objective NOUN crl-15563 96 6 was be AUX crl-15563 96 7 completed complete VERB crl-15563 96 8 in in ADP crl-15563 96 9 1999 1999 NUM crl-15563 96 10 by by ADP crl-15563 96 11 ksu ksu PROPN crl-15563 96 12 ’s ’s PROPN crl-15563 96 13 instructional instructional ADJ crl-15563 96 14 services service NOUN crl-15563 96 15 team team NOUN crl-15563 96 16 , , PUNCT crl-15563 96 17 the the DET crl-15563 96 18 objectives objective NOUN crl-15563 96 19 have have AUX crl-15563 96 20 since since SCONJ crl-15563 96 21 been be AUX crl-15563 96 22 replaced replace VERB crl-15563 96 23 with with ADP crl-15563 96 24 the the DET crl-15563 96 25 model model NOUN crl-15563 96 26 learning learn VERB crl-15563 96 27 outcomes outcome NOUN crl-15563 96 28 written write VERB crl-15563 96 29 and and CCONJ crl-15563 96 30 adopted adopt VERB crl-15563 96 31 by by ADP crl-15563 96 32 acrl acrl ADJ crl-15563 96 33 in in ADP crl-15563 96 34 order order NOUN crl-15563 96 35 to to PART crl-15563 96 36 achieve achieve VERB crl-15563 96 37 consistency consistency NOUN crl-15563 96 38 with with ADP crl-15563 96 39 other other ADJ crl-15563 96 40 institutions institution NOUN crl-15563 96 41 around around ADP crl-15563 96 42 the the DET crl-15563 96 43 country country NOUN crl-15563 96 44 . . PUNCT crl-15563 97 1 only only ADV crl-15563 97 2 after after ADP crl-15563 97 3 following follow VERB crl-15563 97 4 the the DET crl-15563 97 5 first first ADJ crl-15563 97 6 four four NUM crl-15563 97 7 steps step NOUN crl-15563 97 8 carefully carefully ADV crl-15563 97 9 were be AUX crl-15563 97 10 the the DET crl-15563 97 11 authors author NOUN crl-15563 97 12 prepared prepare VERB crl-15563 97 13 to to PART crl-15563 97 14 begin begin VERB crl-15563 97 15 instrument instrument NOUN crl-15563 97 16 development development NOUN crl-15563 97 17 . . PUNCT crl-15563 98 1 in in ADP crl-15563 98 2 this this DET crl-15563 98 3 phase phase NOUN crl-15563 98 4 , , PUNCT crl-15563 98 5 items item NOUN crl-15563 98 6 flow flow VERB crl-15563 98 7 naturally naturally ADV crl-15563 98 8 , , PUNCT crl-15563 98 9 although although SCONJ crl-15563 98 10 not not PART crl-15563 98 11 easily easily ADV crl-15563 98 12 , , PUNCT crl-15563 98 13 from from ADP crl-15563 98 14 objectives objective NOUN crl-15563 98 15 . . PUNCT crl-15563 99 1 writing write VERB crl-15563 99 2 items item NOUN crl-15563 99 3 is be AUX crl-15563 99 4 only only ADV crl-15563 99 5 a a DET crl-15563 99 6 question question NOUN crl-15563 99 7 of of ADP crl-15563 99 8 determining determine VERB crl-15563 99 9 how how SCONJ crl-15563 99 10 the the DET crl-15563 99 11 learner learner NOUN crl-15563 99 12 ’s ’s PART crl-15563 99 13 ability ability NOUN crl-15563 99 14 to to PART crl-15563 99 15 perform perform VERB crl-15563 99 16 in in ADP crl-15563 99 17 the the DET crl-15563 99 18 manner manner NOUN crl-15563 99 19 already already ADV crl-15563 99 20 described describe VERB crl-15563 99 21 can can AUX crl-15563 99 22 be be AUX crl-15563 99 23 measured measure VERB crl-15563 99 24 . . PUNCT crl-15563 100 1 figure figure VERB crl-15563 100 2 1 1 NUM crl-15563 100 3 shows show VERB crl-15563 100 4 an an DET crl-15563 100 5 item item NOUN crl-15563 100 6 that that PRON crl-15563 100 7 was be AUX crl-15563 100 8 developed develop VERB crl-15563 100 9 based base VERB crl-15563 100 10 on on ADP crl-15563 100 11 the the DET crl-15563 100 12 original original ADJ crl-15563 100 13 instructional instructional ADJ crl-15563 100 14 goal goal NOUN crl-15563 100 15 and and CCONJ crl-15563 100 16 learning learning NOUN crl-15563 100 17 outcome outcome NOUN crl-15563 100 18 . . PUNCT crl-15563 101 1 it it PRON crl-15563 101 2 is be AUX crl-15563 101 3 important important ADJ crl-15563 101 4 to to PART crl-15563 101 5 note note VERB crl-15563 101 6 that that SCONJ crl-15563 101 7 this this PRON crl-15563 101 8 is be AUX crl-15563 101 9 not not PART crl-15563 101 10 the the DET crl-15563 101 11 only only ADJ crl-15563 101 12 item item NOUN crl-15563 101 13 developed develop VERB crl-15563 101 14 for for ADP crl-15563 101 15 that that DET crl-15563 101 16 performance performance NOUN crl-15563 101 17 indicator indicator NOUN crl-15563 101 18 or or CCONJ crl-15563 101 19 even even ADV crl-15563 101 20 for for ADP crl-15563 101 21 the the DET crl-15563 101 22 specific specific ADJ crl-15563 101 23 outcome outcome NOUN crl-15563 101 24 . . PUNCT crl-15563 102 1 when when SCONJ crl-15563 102 2 items item NOUN crl-15563 102 3 have have AUX crl-15563 102 4 been be AUX crl-15563 102 5 developed develop VERB crl-15563 102 6 , , PUNCT crl-15563 102 7 several several ADJ crl-15563 102 8 iterations iteration NOUN crl-15563 102 9 of of ADP crl-15563 102 10 evaluation evaluation NOUN crl-15563 102 11 are be AUX crl-15563 102 12 necessary necessary ADJ crl-15563 102 13 to to PART crl-15563 102 14 ensure ensure VERB crl-15563 102 15 that that SCONJ crl-15563 102 16 the the DET crl-15563 102 17 items item NOUN crl-15563 102 18 function function VERB crl-15563 102 19 as as SCONJ crl-15563 102 20 they they PRON crl-15563 102 21 were be AUX crl-15563 102 22 designed design VERB crl-15563 102 23 to to PART crl-15563 102 24 function function VERB crl-15563 102 25 . . PUNCT crl-15563 103 1 items item NOUN crl-15563 103 2 are be AUX crl-15563 103 3 put put VERB crl-15563 103 4 to to ADP crl-15563 103 5 the the DET crl-15563 103 6 test test NOUN crl-15563 103 7 in in ADP crl-15563 103 8 a a DET crl-15563 103 9 series series NOUN crl-15563 103 10 of of ADP crl-15563 103 11 three three NUM crl-15563 103 12 trial trial NOUN crl-15563 103 13 phases phase NOUN crl-15563 103 14 . . PUNCT crl-15563 104 1 in in ADP crl-15563 104 2 the the DET crl-15563 104 3 first first ADJ crl-15563 104 4 trial trial NOUN crl-15563 104 5 phase phase NOUN crl-15563 104 6 , , PUNCT crl-15563 104 7 the the DET crl-15563 104 8 items item NOUN crl-15563 104 9 are be AUX crl-15563 104 10 tested test VERB crl-15563 104 11 in in ADP crl-15563 104 12 one one NUM crl-15563 104 13 - - PUNCT crl-15563 104 14 on on ADP crl-15563 104 15 - - PUNCT crl-15563 104 16 one one NUM crl-15563 104 17 trials trial NOUN crl-15563 104 18 . . PUNCT crl-15563 105 1 the the DET crl-15563 105 2 purpose purpose NOUN crl-15563 105 3 of of ADP crl-15563 105 4 this this DET crl-15563 105 5 phase phase NOUN crl-15563 105 6 is be AUX crl-15563 105 7 to to PART crl-15563 105 8 identify identify VERB crl-15563 105 9 and and CCONJ crl-15563 105 10 remove remove VERB crl-15563 105 11 the the DET crl-15563 105 12 most most ADV crl-15563 105 13 obvious obvious ADJ crl-15563 105 14 errors error NOUN crl-15563 105 15 and and CCONJ crl-15563 105 16 is be AUX crl-15563 105 17 accomplished accomplish VERB crl-15563 105 18 through through ADP crl-15563 105 19 direct direct ADJ crl-15563 105 20 interaction interaction NOUN crl-15563 105 21 between between ADP crl-15563 105 22 designers designer NOUN crl-15563 105 23 and and CCONJ crl-15563 105 24 individual individual ADJ crl-15563 105 25 learners learner NOUN crl-15563 105 26 . . PUNCT crl-15563 106 1 dick dick PROPN crl-15563 106 2 and and CCONJ crl-15563 106 3 cary cary PROPN crl-15563 106 4 recommended recommend VERB crl-15563 106 5 three three NUM crl-15563 106 6 or or CCONJ crl-15563 106 7 more more ADJ crl-15563 106 8 learners learner NOUN crl-15563 106 9 drawn draw VERB crl-15563 106 10 from from ADP crl-15563 106 11 the the DET crl-15563 106 12 target target NOUN crl-15563 106 13 population population NOUN crl-15563 106 14 . . PUNCT crl-15563 107 1 this this DET crl-15563 107 2 study study NOUN crl-15563 107 3 used use VERB crl-15563 107 4 six six NUM crl-15563 107 5 learners learner NOUN crl-15563 107 6 . . PUNCT crl-15563 108 1 in in ADP crl-15563 108 2 this this DET crl-15563 108 3 phase phase NOUN crl-15563 108 4 , , PUNCT crl-15563 108 5 learners learner NOUN crl-15563 108 6 engage engage VERB crl-15563 108 7 in in ADP crl-15563 108 8 in in ADP crl-15563 108 9 - - PUNCT crl-15563 108 10 depth depth NOUN crl-15563 108 11 communication communication NOUN crl-15563 108 12 and and CCONJ crl-15563 108 13 analysis analysis NOUN crl-15563 108 14 with with ADP crl-15563 108 15 designers designer NOUN crl-15563 108 16 as as SCONJ crl-15563 108 17 they they PRON crl-15563 108 18 complete complete VERB crl-15563 108 19 the the DET crl-15563 108 20 items item NOUN crl-15563 108 21 . . PUNCT crl-15563 109 1 researchers researcher NOUN crl-15563 109 2 try try VERB crl-15563 109 3 to to PART crl-15563 109 4 determine determine VERB crl-15563 109 5 , , PUNCT crl-15563 109 6 among among ADP crl-15563 109 7 other other ADJ crl-15563 109 8 things thing NOUN crl-15563 109 9 , , PUNCT crl-15563 109 10 what what PRON crl-15563 109 11 is be AUX crl-15563 109 12 clear clear ADJ crl-15563 109 13 , , PUNCT crl-15563 109 14 what what PRON crl-15563 109 15 is be AUX crl-15563 109 16 unclear unclear ADJ crl-15563 109 17 , , PUNCT crl-15563 109 18 how how SCONJ crl-15563 109 19 learners learner NOUN crl-15563 109 20 interpret interpret VERB crl-15563 109 21 questions question NOUN crl-15563 109 22 , , PUNCT crl-15563 109 23 and and CCONJ crl-15563 109 24 why why SCONJ crl-15563 109 25 learners learner NOUN crl-15563 109 26 select select VERB crl-15563 109 27 specific specific ADJ crl-15563 109 28 responses response NOUN crl-15563 109 29 . . PUNCT crl-15563 110 1 items item NOUN crl-15563 110 2 are be AUX crl-15563 110 3 revised revise VERB crl-15563 110 4 on on ADP crl-15563 110 5 the the DET crl-15563 110 6 basis basis NOUN crl-15563 110 7 of of ADP crl-15563 110 8 data datum NOUN crl-15563 110 9 gathered gather VERB crl-15563 110 10 from from ADP crl-15563 110 11 this this DET crl-15563 110 12 phase phase NOUN crl-15563 110 13 . . PUNCT crl-15563 111 1 in in ADP crl-15563 111 2 the the DET crl-15563 111 3 next next ADJ crl-15563 111 4 phase phase NOUN crl-15563 111 5 , , PUNCT crl-15563 111 6 items item NOUN crl-15563 111 7 are be AUX crl-15563 111 8 tested test VERB crl-15563 111 9 in in ADP crl-15563 111 10 small small ADJ crl-15563 111 11 group group NOUN crl-15563 111 12 trials trial NOUN crl-15563 111 13 . . PUNCT crl-15563 112 1 these these DET crl-15563 112 2 trials trial NOUN crl-15563 112 3 are be AUX crl-15563 112 4 an an DET crl-15563 112 5 extension extension NOUN crl-15563 112 6 of of ADP crl-15563 112 7 one one NUM crl-15563 112 8 - - PUNCT crl-15563 112 9 on on ADP crl-15563 112 10 - - PUNCT crl-15563 112 11 one one NUM crl-15563 112 12 trials trial NOUN crl-15563 112 13 and and CCONJ crl-15563 112 14 provide provide VERB crl-15563 112 15 opportunities opportunity NOUN crl-15563 112 16 for for ADP crl-15563 112 17 further further ADJ crl-15563 112 18 revision revision NOUN crl-15563 112 19 . . PUNCT crl-15563 113 1 in in ADP crl-15563 113 2 this this DET crl-15563 113 3 figure figure NOUN crl-15563 113 4 1 1 NUM crl-15563 113 5 example example NOUN crl-15563 113 6 of of ADP crl-15563 113 7 item item NOUN crl-15563 113 8 development development PROPN crl-15563 113 9 acrl acrl ADJ crl-15563 113 10 standard standard ADJ crl-15563 113 11 two two NUM crl-15563 113 12 : : PUNCT crl-15563 113 13 the the DET crl-15563 113 14 information information NOUN crl-15563 113 15 - - PUNCT crl-15563 113 16 literate literate NOUN crl-15563 113 17 student student NOUN crl-15563 113 18 accesses access VERB crl-15563 113 19 needed need VERB crl-15563 113 20 information information NOUN crl-15563 113 21 effectively effectively ADV crl-15563 113 22 and and CCONJ crl-15563 113 23 efficiently efficiently ADV crl-15563 113 24 . . PUNCT crl-15563 114 1 performance performance NOUN crl-15563 114 2 indicator indicator NOUN crl-15563 114 3 1 1 NUM crl-15563 114 4 : : PUNCT crl-15563 114 5 the the DET crl-15563 114 6 information information NOUN crl-15563 114 7 - - PUNCT crl-15563 114 8 literate literate NOUN crl-15563 114 9 student student NOUN crl-15563 114 10 selects select VERB crl-15563 114 11 the the DET crl-15563 114 12 most most ADV crl-15563 114 13 appropriate appropriate ADJ crl-15563 114 14 investigative investigative ADJ crl-15563 114 15 methods method NOUN crl-15563 114 16 or or CCONJ crl-15563 114 17 information information NOUN crl-15563 114 18 retrieval retrieval NOUN crl-15563 114 19 systems system NOUN crl-15563 114 20 for for ADP crl-15563 114 21 accessing access VERB crl-15563 114 22 the the DET crl-15563 114 23 needed need VERB crl-15563 114 24 information information NOUN crl-15563 114 25 . . PUNCT crl-15563 115 1 outcome outcome NOUN crl-15563 115 2 : : PUNCT crl-15563 115 3 selects select VERB crl-15563 115 4 appropriate appropriate ADJ crl-15563 115 5 tools tool NOUN crl-15563 115 6 ( ( PUNCT crl-15563 115 7 e.g. e.g. ADV crl-15563 115 8 , , PUNCT crl-15563 115 9 indexes index NOUN crl-15563 115 10 , , PUNCT crl-15563 115 11 online online ADJ crl-15563 115 12 databases database NOUN crl-15563 115 13 ) ) PUNCT crl-15563 115 14 for for ADP crl-15563 115 15 research research NOUN crl-15563 115 16 on on ADP crl-15563 115 17 a a DET crl-15563 115 18 particular particular ADJ crl-15563 115 19 topic topic NOUN crl-15563 115 20 item item NOUN crl-15563 115 21 : : PUNCT crl-15563 115 22 if if SCONJ crl-15563 115 23 you you PRON crl-15563 115 24 are be AUX crl-15563 115 25 required require VERB crl-15563 115 26 to to PART crl-15563 115 27 write write VERB crl-15563 115 28 a a DET crl-15563 115 29 paper paper NOUN crl-15563 115 30 on on ADP crl-15563 115 31 teenage teenage ADJ crl-15563 115 32 pregnancy pregnancy NOUN crl-15563 115 33 , , PUNCT crl-15563 115 34 which which PRON crl-15563 115 35 of of ADP crl-15563 115 36 the the DET crl-15563 115 37 following follow VERB crl-15563 115 38 types type NOUN crl-15563 115 39 of of ADP crl-15563 115 40 databases database NOUN crl-15563 115 41 might might AUX crl-15563 115 42 have have VERB crl-15563 115 43 articles article NOUN crl-15563 115 44 on on ADP crl-15563 115 45 this this DET crl-15563 115 46 topic topic NOUN crl-15563 115 47 ? ? PUNCT crl-15563 116 1 q q NOUN crl-15563 116 2 architecture architecture NOUN crl-15563 116 3 database database NOUN crl-15563 116 4 q q NOUN crl-15563 116 5 education education NOUN crl-15563 116 6 database database NOUN crl-15563 116 7 q q X crl-15563 116 8 health health NOUN crl-15563 116 9 database database NOUN crl-15563 116 10 q q X crl-15563 116 11 mathematics mathematic NOUN crl-15563 116 12 database database NOUN crl-15563 116 13 q q X crl-15563 116 14 physics physics NOUN crl-15563 116 15 database database NOUN crl-15563 116 16 q q X crl-15563 116 17 psychology psychology NOUN crl-15563 116 18 database database NOUN crl-15563 116 19 applying apply VERB crl-15563 116 20 systems system NOUN crl-15563 116 21 design design NOUN crl-15563 116 22 and and CCONJ crl-15563 116 23 item item NOUN crl-15563 116 24 response response NOUN crl-15563 116 25 theory theory NOUN crl-15563 116 26 533 533 NUM crl-15563 116 27 figure figure NOUN crl-15563 116 28 2 2 NUM crl-15563 116 29 example example NOUN crl-15563 116 30 of of ADP crl-15563 116 31 content content NOUN crl-15563 116 32 changes change NOUN crl-15563 116 33 resulting result VERB crl-15563 116 34 from from ADP crl-15563 116 35 trial trial NOUN crl-15563 116 36 process process NOUN crl-15563 116 37 ( ( PUNCT crl-15563 116 38 changes change NOUN crl-15563 116 39 indicated indicate VERB crl-15563 116 40 by by ADP crl-15563 116 41 highlighted highlighted ADJ crl-15563 116 42 text text NOUN crl-15563 116 43 ) ) PUNCT crl-15563 116 44 original original ADJ crl-15563 116 45 version version NOUN crl-15563 116 46 each each PRON crl-15563 116 47 of of ADP crl-15563 116 48 the the DET crl-15563 116 49 following follow VERB crl-15563 116 50 statements statement NOUN crl-15563 116 51 is be AUX crl-15563 116 52 true true ADJ crl-15563 116 53 about about ADP crl-15563 116 54 the the DET crl-15563 116 55 library library NOUN crl-15563 116 56 or or CCONJ crl-15563 116 57 the the DET crl-15563 116 58 world world NOUN crl-15563 116 59 wide wide ADJ crl-15563 116 60 web web NOUN crl-15563 116 61 . . PUNCT crl-15563 117 1 identify identify VERB crl-15563 117 2 which which DET crl-15563 117 3 statements statement NOUN crl-15563 117 4 describe describe VERB crl-15563 117 5 the the DET crl-15563 117 6 library library NOUN crl-15563 117 7 or or CCONJ crl-15563 117 8 the the DET crl-15563 117 9 web web NOUN crl-15563 117 10 . . PUNCT crl-15563 118 1 use use VERB crl-15563 118 2 w w ADP crl-15563 118 3 if if SCONJ crl-15563 118 4 the the DET crl-15563 118 5 statement statement NOUN crl-15563 118 6 is be AUX crl-15563 118 7 true true ADJ crl-15563 118 8 about about ADP crl-15563 118 9 the the DET crl-15563 118 10 web web NOUN crl-15563 118 11 . . PUNCT crl-15563 119 1 use use VERB crl-15563 119 2 l l NOUN crl-15563 119 3 if if SCONJ crl-15563 119 4 the the DET crl-15563 119 5 statement statement NOUN crl-15563 119 6 is be AUX crl-15563 119 7 true true ADJ crl-15563 119 8 about about ADP crl-15563 119 9 the the DET crl-15563 119 10 library library NOUN crl-15563 119 11 . . PUNCT crl-15563 120 1 use use VERB crl-15563 120 2 b b NOUN crl-15563 120 3 if if SCONJ crl-15563 120 4 the the DET crl-15563 120 5 statement statement NOUN crl-15563 120 6 is be AUX crl-15563 120 7 true true ADJ crl-15563 120 8 about about ADP crl-15563 120 9 both both DET crl-15563 120 10 the the DET crl-15563 120 11 library library NOUN crl-15563 120 12 and and CCONJ crl-15563 120 13 the the DET crl-15563 120 14 web web NOUN crl-15563 120 15 . . PUNCT crl-15563 121 1 _ _ PUNCT crl-15563 121 2 _ _ PUNCT crl-15563 121 3 _ _ PUNCT crl-15563 121 4 _ _ PUNCT crl-15563 121 5 has have VERB crl-15563 121 6 information information NOUN crl-15563 121 7 that that PRON crl-15563 121 8 has have AUX crl-15563 121 9 been be AUX crl-15563 121 10 through through ADP crl-15563 121 11 traditional traditional ADJ crl-15563 121 12 publishing publishing NOUN crl-15563 121 13 process process NOUN crl-15563 121 14 _ _ PUNCT crl-15563 121 15 _ _ PUNCT crl-15563 121 16 _ _ PUNCT crl-15563 121 17 _ _ PUNCT crl-15563 121 18 has have VERB crl-15563 121 19 information information NOUN crl-15563 121 20 that that PRON crl-15563 121 21 is be AUX crl-15563 121 22 sold sell VERB crl-15563 121 23 by by ADP crl-15563 121 24 publishers publisher NOUN crl-15563 121 25 _ _ PUNCT crl-15563 121 26 _ _ PUNCT crl-15563 121 27 _ _ PUNCT crl-15563 121 28 _ _ PUNCT crl-15563 121 29 has have VERB crl-15563 121 30 a a DET crl-15563 121 31 classification classification NOUN crl-15563 121 32 system system NOUN crl-15563 121 33 _ _ PUNCT crl-15563 121 34 _ _ PUNCT crl-15563 121 35 _ _ PUNCT crl-15563 121 36 _ _ PUNCT crl-15563 121 37 has have VERB crl-15563 121 38 information information NOUN crl-15563 121 39 provided provide VERB crl-15563 121 40 by by ADP crl-15563 121 41 organizations organization NOUN crl-15563 121 42 , , PUNCT crl-15563 121 43 individuals individual NOUN crl-15563 121 44 , , PUNCT crl-15563 121 45 companies company NOUN crl-15563 121 46 , , PUNCT crl-15563 121 47 and and CCONJ crl-15563 121 48 governments government NOUN crl-15563 121 49 _ _ PUNCT crl-15563 121 50 _ _ PUNCT crl-15563 121 51 _ _ PUNCT crl-15563 121 52 _ _ PUNCT crl-15563 121 53 is be AUX crl-15563 121 54 available available ADJ crl-15563 121 55 24 24 NUM crl-15563 121 56 hours hour NOUN crl-15563 121 57 a a DET crl-15563 121 58 day day NOUN crl-15563 121 59 revision revision NOUN crl-15563 121 60 1 1 NUM crl-15563 121 61 ( ( PUNCT crl-15563 121 62 after after ADP crl-15563 121 63 one one NUM crl-15563 121 64 - - PUNCT crl-15563 121 65 on on ADP crl-15563 121 66 - - PUNCT crl-15563 121 67 one one NUM crl-15563 121 68 trials trial NOUN crl-15563 121 69 ) ) PUNCT crl-15563 121 70 academic academic ADJ crl-15563 121 71 libraries library NOUN crl-15563 121 72 are be AUX crl-15563 121 73 generally generally ADV crl-15563 121 74 thought think VERB crl-15563 121 75 of of ADP crl-15563 121 76 as as ADP crl-15563 121 77 collections collection NOUN crl-15563 121 78 of of ADP crl-15563 121 79 materials material NOUN crl-15563 121 80 in in ADP crl-15563 121 81 print print NOUN crl-15563 121 82 and and CCONJ crl-15563 121 83 electronic electronic ADJ crl-15563 121 84 formats format NOUN crl-15563 121 85 . . PUNCT crl-15563 122 1 some some PRON crl-15563 122 2 of of ADP crl-15563 122 3 these these DET crl-15563 122 4 materials material NOUN crl-15563 122 5 are be AUX crl-15563 122 6 made make VERB crl-15563 122 7 available available ADJ crl-15563 122 8 to to ADP crl-15563 122 9 users user NOUN crl-15563 122 10 through through ADP crl-15563 122 11 the the DET crl-15563 122 12 web web NOUN crl-15563 122 13 but but CCONJ crl-15563 122 14 are be AUX crl-15563 122 15 not not PART crl-15563 122 16 included include VERB crl-15563 122 17 in in ADP crl-15563 122 18 what what PRON crl-15563 122 19 we we PRON crl-15563 122 20 traditionally traditionally ADV crl-15563 122 21 think think VERB crl-15563 122 22 of of ADP crl-15563 122 23 as as ADP crl-15563 122 24 the the DET crl-15563 122 25 web web NOUN crl-15563 122 26 . . PUNCT crl-15563 123 1 the the DET crl-15563 123 2 world world NOUN crl-15563 123 3 wide wide ADJ crl-15563 123 4 web web NOUN crl-15563 123 5 is be AUX crl-15563 123 6 a a DET crl-15563 123 7 means means NOUN crl-15563 123 8 of of ADP crl-15563 123 9 communication communication NOUN crl-15563 123 10 . . PUNCT crl-15563 124 1 computers computer NOUN crl-15563 124 2 all all ADV crl-15563 124 3 over over ADP crl-15563 124 4 the the DET crl-15563 124 5 world world NOUN crl-15563 124 6 network network NOUN crl-15563 124 7 with with ADP crl-15563 124 8 one one NUM crl-15563 124 9 another another DET crl-15563 124 10 by by ADP crl-15563 124 11 using use VERB crl-15563 124 12 a a DET crl-15563 124 13 common common ADJ crl-15563 124 14 language language NOUN crl-15563 124 15 . . PUNCT crl-15563 125 1 which which PRON crl-15563 125 2 of of ADP crl-15563 125 3 the the DET crl-15563 125 4 following follow VERB crl-15563 125 5 statements statement NOUN crl-15563 125 6 are be AUX crl-15563 125 7 generally generally ADV crl-15563 125 8 true true ADJ crl-15563 125 9 about about ADP crl-15563 125 10 academic academic ADJ crl-15563 125 11 libraries library NOUN crl-15563 125 12 and/or and/or CCONJ crl-15563 125 13 the the DET crl-15563 125 14 web web NOUN crl-15563 125 15 ? ? PUNCT crl-15563 126 1 put put VERB crl-15563 126 2 a a DET crl-15563 126 3 w w NOUN crl-15563 126 4 if if SCONJ crl-15563 126 5 the the DET crl-15563 126 6 statement statement NOUN crl-15563 126 7 is be AUX crl-15563 126 8 true true ADJ crl-15563 126 9 about about ADP crl-15563 126 10 the the DET crl-15563 126 11 web web NOUN crl-15563 126 12 . . PUNCT crl-15563 127 1 put put VERB crl-15563 127 2 an an DET crl-15563 127 3 l l NOUN crl-15563 127 4 if if SCONJ crl-15563 127 5 the the DET crl-15563 127 6 statement statement NOUN crl-15563 127 7 is be AUX crl-15563 127 8 true true ADJ crl-15563 127 9 about about ADP crl-15563 127 10 the the DET crl-15563 127 11 library library NOUN crl-15563 127 12 . . PUNCT crl-15563 128 1 put put VERB crl-15563 128 2 a a DET crl-15563 128 3 b b NOUN crl-15563 128 4 if if SCONJ crl-15563 128 5 the the DET crl-15563 128 6 statement statement NOUN crl-15563 128 7 is be AUX crl-15563 128 8 true true ADJ crl-15563 128 9 about about ADP crl-15563 128 10 both both DET crl-15563 128 11 the the DET crl-15563 128 12 library library NOUN crl-15563 128 13 and and CCONJ crl-15563 128 14 the the DET crl-15563 128 15 web web NOUN crl-15563 128 16 . . PUNCT crl-15563 129 1 _ _ PUNCT crl-15563 129 2 _ _ PUNCT crl-15563 129 3 _ _ PUNCT crl-15563 129 4 _ _ PUNCT crl-15563 129 5 all all PRON crl-15563 129 6 its its PRON crl-15563 129 7 resources resource NOUN crl-15563 129 8 are be AUX crl-15563 129 9 free free ADJ crl-15563 129 10 and and CCONJ crl-15563 129 11 accessible accessible ADJ crl-15563 129 12 to to ADP crl-15563 129 13 students student NOUN crl-15563 129 14 . . PUNCT crl-15563 130 1 _ _ PUNCT crl-15563 130 2 _ _ PUNCT crl-15563 130 3 _ _ PUNCT crl-15563 130 4 _ _ PUNCT crl-15563 130 5 anyone anyone PRON crl-15563 130 6 can can AUX crl-15563 130 7 add add VERB crl-15563 130 8 information information NOUN crl-15563 130 9 to to ADP crl-15563 130 10 it it PRON crl-15563 130 11 . . PUNCT crl-15563 131 1 _ _ PUNCT crl-15563 131 2 _ _ PUNCT crl-15563 131 3 _ _ PUNCT crl-15563 131 4 _ _ PUNCT crl-15563 131 5 has have VERB crl-15563 131 6 material material NOUN crl-15563 131 7 aimed aim VERB crl-15563 131 8 at at ADP crl-15563 131 9 all all DET crl-15563 131 10 audiences audience NOUN crl-15563 131 11 , , PUNCT crl-15563 131 12 including include VERB crl-15563 131 13 consumers consumer NOUN crl-15563 131 14 , , PUNCT crl-15563 131 15 scholars scholar NOUN crl-15563 131 16 , , PUNCT crl-15563 131 17 students student NOUN crl-15563 131 18 , , PUNCT crl-15563 131 19 hobbyists hobbyist NOUN crl-15563 131 20 , , PUNCT crl-15563 131 21 businesses business NOUN crl-15563 131 22 . . PUNCT crl-15563 132 1 _ _ PUNCT crl-15563 132 2 _ _ PUNCT crl-15563 132 3 _ _ PUNCT crl-15563 132 4 _ _ PUNCT crl-15563 132 5 has have VERB crl-15563 132 6 materials material NOUN crl-15563 132 7 that that PRON crl-15563 132 8 have have AUX crl-15563 132 9 been be AUX crl-15563 132 10 purchased purchase VERB crl-15563 132 11 on on ADP crl-15563 132 12 behalf behalf NOUN crl-15563 132 13 of of ADP crl-15563 132 14 students student NOUN crl-15563 132 15 . . PUNCT crl-15563 133 1 _ _ PUNCT crl-15563 133 2 _ _ PUNCT crl-15563 133 3 _ _ PUNCT crl-15563 133 4 _ _ PUNCT crl-15563 133 5 information information NOUN crl-15563 133 6 must must AUX crl-15563 133 7 be be AUX crl-15563 133 8 deemed deem VERB crl-15563 133 9 authoritative authoritative ADJ crl-15563 133 10 to to PART crl-15563 133 11 be be AUX crl-15563 133 12 included include VERB crl-15563 133 13 . . PUNCT crl-15563 134 1 _ _ PUNCT crl-15563 134 2 _ _ PUNCT crl-15563 134 3 _ _ PUNCT crl-15563 134 4 _ _ PUNCT crl-15563 134 5 is be AUX crl-15563 134 6 organized organize VERB crl-15563 134 7 systematically systematically ADV crl-15563 134 8 with with ADP crl-15563 134 9 a a DET crl-15563 134 10 classification classification NOUN crl-15563 134 11 scheme scheme NOUN crl-15563 134 12 . . PUNCT crl-15563 135 1 _ _ PUNCT crl-15563 135 2 _ _ PUNCT crl-15563 135 3 _ _ PUNCT crl-15563 135 4 _ _ PUNCT crl-15563 135 5 offers offer VERB crl-15563 135 6 online online ADJ crl-15563 135 7 option option NOUN crl-15563 135 8 to to PART crl-15563 135 9 ask ask VERB crl-15563 135 10 questions question NOUN crl-15563 135 11 . . PUNCT crl-15563 136 1 project project NOUN crl-15563 136 2 , , PUNCT crl-15563 136 3 items item NOUN crl-15563 136 4 were be AUX crl-15563 136 5 administered administer VERB crl-15563 136 6 to to ADP crl-15563 136 7 a a DET crl-15563 136 8 class class NOUN crl-15563 136 9 of of ADP crl-15563 136 10 twenty twenty NUM crl-15563 136 11 students student NOUN crl-15563 136 12 in in ADP crl-15563 136 13 a a DET crl-15563 136 14 manner manner NOUN crl-15563 136 15 that that PRON crl-15563 136 16 approximated approximate VERB crl-15563 136 17 a a DET crl-15563 136 18 normal normal ADJ crl-15563 136 19 test test NOUN crl-15563 136 20 - - PUNCT crl-15563 136 21 taking take VERB crl-15563 136 22 situation situation NOUN crl-15563 136 23 , , PUNCT crl-15563 136 24 except except SCONJ crl-15563 136 25 that that SCONJ crl-15563 136 26 learners learner NOUN crl-15563 136 27 were be AUX crl-15563 136 28 asked ask VERB crl-15563 136 29 to to PART crl-15563 136 30 make make VERB crl-15563 136 31 notes note NOUN crl-15563 136 32 of of ADP crl-15563 136 33 questions question NOUN crl-15563 136 34 , , PUNCT crl-15563 136 35 problems problem NOUN crl-15563 136 36 , , PUNCT crl-15563 136 37 and and CCONJ crl-15563 136 38 thoughts thought NOUN crl-15563 136 39 about about ADP crl-15563 136 40 items item NOUN crl-15563 136 41 . . PUNCT crl-15563 137 1 when when SCONJ crl-15563 137 2 all all DET crl-15563 137 3 the the DET crl-15563 137 4 instruments instrument NOUN crl-15563 137 5 were be AUX crl-15563 137 6 completed complete VERB crl-15563 137 7 and and CCONJ crl-15563 137 8 returned return VERB crl-15563 137 9 , , PUNCT crl-15563 137 10 the the DET crl-15563 137 11 authors author NOUN crl-15563 137 12 engaged engage VERB crl-15563 137 13 in in ADP crl-15563 137 14 a a DET crl-15563 137 15 dialog dialog NOUN crl-15563 137 16 with with ADP crl-15563 137 17 students student NOUN crl-15563 137 18 . . PUNCT crl-15563 138 1 students student NOUN crl-15563 138 2 ’ ’ PART crl-15563 138 3 interpretations interpretation NOUN crl-15563 138 4 of of ADP crl-15563 138 5 questions question NOUN crl-15563 138 6 and and CCONJ crl-15563 138 7 their their PRON crl-15563 138 8 answers answer NOUN crl-15563 138 9 enabled enable VERB crl-15563 138 10 the the DET crl-15563 138 11 authors author NOUN crl-15563 138 12 to to PART crl-15563 138 13 make make VERB crl-15563 138 14 substantial substantial ADJ crl-15563 138 15 improvements improvement NOUN crl-15563 138 16 to to ADP crl-15563 138 17 the the DET crl-15563 138 18 instrument instrument NOUN crl-15563 138 19 . . PUNCT crl-15563 139 1 finally finally ADV crl-15563 139 2 , , PUNCT crl-15563 139 3 the the DET crl-15563 139 4 items item NOUN crl-15563 139 5 were be AUX crl-15563 139 6 tested test VERB crl-15563 139 7 in in ADP crl-15563 139 8 field field NOUN crl-15563 139 9 trials trial NOUN crl-15563 139 10 . . PUNCT crl-15563 140 1 field field NOUN crl-15563 140 2 trials trial NOUN crl-15563 140 3 most most ADV crl-15563 140 4 closely closely ADV crl-15563 140 5 emulate emulate VERB crl-15563 140 6 the the DET crl-15563 140 7 intended intended ADJ crl-15563 140 8 context context NOUN crl-15563 140 9 for for ADP crl-15563 140 10 instrument instrument PROPN crl-15563 140 11 administration administration NOUN crl-15563 140 12 . . PUNCT crl-15563 141 1 designers designer NOUN crl-15563 141 2 become become VERB crl-15563 141 3 observers observer NOUN crl-15563 141 4 only only ADV crl-15563 141 5 and and CCONJ crl-15563 141 6 do do AUX crl-15563 141 7 not not PART crl-15563 141 8 interact interact VERB crl-15563 141 9 with with ADP crl-15563 141 10 learners learner NOUN crl-15563 141 11 . . PUNCT crl-15563 142 1 feedback feedback NOUN crl-15563 142 2 for for ADP crl-15563 142 3 revision revision NOUN crl-15563 142 4 is be AUX crl-15563 142 5 taken take VERB crl-15563 142 6 exclusively exclusively ADV crl-15563 142 7 from from ADP crl-15563 142 8 the the DET crl-15563 142 9 data datum NOUN crl-15563 142 10 gathered gather VERB crl-15563 142 11 . . PUNCT crl-15563 143 1 in in ADP crl-15563 143 2 the the DET crl-15563 143 3 authors author NOUN crl-15563 143 4 ’ ’ PART crl-15563 143 5 spring spring NOUN crl-15563 143 6 2001 2001 NUM crl-15563 143 7 study study NOUN crl-15563 143 8 , , PUNCT crl-15563 143 9 the the DET crl-15563 143 10 instrument instrument NOUN crl-15563 143 11 was be AUX crl-15563 143 12 administered administer VERB crl-15563 143 13 to to ADP crl-15563 143 14 554 554 NUM crl-15563 143 15 students student NOUN crl-15563 143 16 in in ADP crl-15563 143 17 this this DET crl-15563 143 18 phase phase NOUN crl-15563 143 19 of of ADP crl-15563 143 20 the the DET crl-15563 143 21 project project NOUN crl-15563 143 22 . . PUNCT crl-15563 144 1 figure figure NOUN crl-15563 144 2 2 2 NUM crl-15563 144 3 provides provide VERB crl-15563 144 4 an an DET crl-15563 144 5 example example NOUN crl-15563 144 6 of of ADP crl-15563 144 7 how how SCONJ crl-15563 144 8 one one NUM crl-15563 144 9 item item NOUN crl-15563 144 10 changed change VERB crl-15563 144 11 throughout throughout ADP crl-15563 144 12 the the DET crl-15563 144 13 process process NOUN crl-15563 144 14 . . PUNCT crl-15563 145 1 534 534 NUM crl-15563 145 2 college college PROPN crl-15563 145 3 & & CCONJ crl-15563 145 4 research research PROPN crl-15563 145 5 libraries library NOUN crl-15563 145 6 november november PROPN crl-15563 145 7 2002 2002 NUM crl-15563 145 8 figure figure NOUN crl-15563 145 9 2 2 NUM crl-15563 145 10 ( ( PUNCT crl-15563 145 11 continued continue VERB crl-15563 145 12 ) ) PUNCT crl-15563 145 13 example example NOUN crl-15563 145 14 of of ADP crl-15563 145 15 content content NOUN crl-15563 145 16 changes change NOUN crl-15563 145 17 resulting result VERB crl-15563 145 18 from from ADP crl-15563 145 19 trial trial NOUN crl-15563 145 20 process process NOUN crl-15563 145 21 ( ( PUNCT crl-15563 145 22 changes change NOUN crl-15563 145 23 indicated indicate VERB crl-15563 145 24 by by ADP crl-15563 145 25 highlighted highlighted ADJ crl-15563 145 26 text text NOUN crl-15563 145 27 ) ) PUNCT crl-15563 145 28 revision revision NOUN crl-15563 145 29 2 2 NUM crl-15563 145 30 ( ( PUNCT crl-15563 145 31 after after ADP crl-15563 145 32 small small ADJ crl-15563 145 33 group group NOUN crl-15563 145 34 trials trial NOUN crl-15563 145 35 ) ) PUNCT crl-15563 145 36 academic academic ADJ crl-15563 145 37 libraries library NOUN crl-15563 145 38 are be AUX crl-15563 145 39 generally generally ADV crl-15563 145 40 thought think VERB crl-15563 145 41 of of ADP crl-15563 145 42 as as ADP crl-15563 145 43 collections collection NOUN crl-15563 145 44 of of ADP crl-15563 145 45 materials material NOUN crl-15563 145 46 in in ADP crl-15563 145 47 print print NOUN crl-15563 145 48 and and CCONJ crl-15563 145 49 electronic electronic ADJ crl-15563 145 50 formats format NOUN crl-15563 145 51 . . PUNCT crl-15563 146 1 some some PRON crl-15563 146 2 of of ADP crl-15563 146 3 these these DET crl-15563 146 4 materials material NOUN crl-15563 146 5 are be AUX crl-15563 146 6 made make VERB crl-15563 146 7 available available ADJ crl-15563 146 8 to to ADP crl-15563 146 9 users user NOUN crl-15563 146 10 through through ADP crl-15563 146 11 the the DET crl-15563 146 12 web web NOUN crl-15563 146 13 but but CCONJ crl-15563 146 14 are be AUX crl-15563 146 15 not not PART crl-15563 146 16 included include VERB crl-15563 146 17 in in ADP crl-15563 146 18 what what PRON crl-15563 146 19 we we PRON crl-15563 146 20 traditionally traditionally ADV crl-15563 146 21 think think VERB crl-15563 146 22 of of ADP crl-15563 146 23 as as ADP crl-15563 146 24 the the DET crl-15563 146 25 web web NOUN crl-15563 146 26 . . PUNCT crl-15563 147 1 the the DET crl-15563 147 2 world world NOUN crl-15563 147 3 wide wide ADJ crl-15563 147 4 web web NOUN crl-15563 147 5 is be AUX crl-15563 147 6 a a DET crl-15563 147 7 means means NOUN crl-15563 147 8 of of ADP crl-15563 147 9 communication communication NOUN crl-15563 147 10 . . PUNCT crl-15563 148 1 computers computer NOUN crl-15563 148 2 all all ADV crl-15563 148 3 over over ADP crl-15563 148 4 the the DET crl-15563 148 5 world world NOUN crl-15563 148 6 network network NOUN crl-15563 148 7 with with ADP crl-15563 148 8 one one NUM crl-15563 148 9 another another DET crl-15563 148 10 by by ADP crl-15563 148 11 using use VERB crl-15563 148 12 a a DET crl-15563 148 13 common common ADJ crl-15563 148 14 language language NOUN crl-15563 148 15 . . PUNCT crl-15563 149 1 which which PRON crl-15563 149 2 of of ADP crl-15563 149 3 the the DET crl-15563 149 4 following follow VERB crl-15563 149 5 statements statement NOUN crl-15563 149 6 are be AUX crl-15563 149 7 generally generally ADV crl-15563 149 8 true true ADJ crl-15563 149 9 about about ADP crl-15563 149 10 academic academic ADJ crl-15563 149 11 libraries library NOUN crl-15563 149 12 and/or and/or CCONJ crl-15563 149 13 the the DET crl-15563 149 14 web web NOUN crl-15563 149 15 ? ? PUNCT crl-15563 150 1 put put VERB crl-15563 150 2 a a DET crl-15563 150 3 w w NOUN crl-15563 150 4 if if SCONJ crl-15563 150 5 the the DET crl-15563 150 6 statement statement NOUN crl-15563 150 7 is be AUX crl-15563 150 8 true true ADJ crl-15563 150 9 about about ADP crl-15563 150 10 the the DET crl-15563 150 11 web web NOUN crl-15563 150 12 . . PUNCT crl-15563 151 1 put put VERB crl-15563 151 2 an an DET crl-15563 151 3 l l NOUN crl-15563 151 4 if if SCONJ crl-15563 151 5 the the DET crl-15563 151 6 statement statement NOUN crl-15563 151 7 is be AUX crl-15563 151 8 true true ADJ crl-15563 151 9 about about ADP crl-15563 151 10 the the DET crl-15563 151 11 academic academic ADJ crl-15563 151 12 library library NOUN crl-15563 151 13 . . PUNCT crl-15563 152 1 put put VERB crl-15563 152 2 a a DET crl-15563 152 3 b b NOUN crl-15563 152 4 if if SCONJ crl-15563 152 5 the the DET crl-15563 152 6 statement statement NOUN crl-15563 152 7 is be AUX crl-15563 152 8 true true ADJ crl-15563 152 9 about about ADP crl-15563 152 10 both both DET crl-15563 152 11 the the DET crl-15563 152 12 academic academic ADJ crl-15563 152 13 library library NOUN crl-15563 152 14 and and CCONJ crl-15563 152 15 the the DET crl-15563 152 16 web web NOUN crl-15563 152 17 . . PUNCT crl-15563 153 1 _ _ PUNCT crl-15563 153 2 _ _ PUNCT crl-15563 153 3 _ _ PUNCT crl-15563 153 4 _ _ PUNCT crl-15563 154 1 all all DET crl-15563 154 2 its its PRON crl-15563 154 3 resources resource NOUN crl-15563 154 4 are be AUX crl-15563 154 5 free free ADJ crl-15563 154 6 and and CCONJ crl-15563 154 7 accessible accessible ADJ crl-15563 154 8 to to ADP crl-15563 154 9 students student NOUN crl-15563 154 10 . . PUNCT crl-15563 155 1 _ _ PUNCT crl-15563 155 2 _ _ PUNCT crl-15563 155 3 _ _ PUNCT crl-15563 156 1 _ _ PUNCT crl-15563 157 1 anyone anyone PRON crl-15563 157 2 can can AUX crl-15563 157 3 add add VERB crl-15563 157 4 information information NOUN crl-15563 157 5 to to ADP crl-15563 157 6 it it PRON crl-15563 157 7 . . PUNCT crl-15563 158 1 _ _ PUNCT crl-15563 158 2 _ _ PUNCT crl-15563 158 3 _ _ PUNCT crl-15563 158 4 _ _ PUNCT crl-15563 158 5 has have VERB crl-15563 158 6 material material NOUN crl-15563 158 7 aimed aim VERB crl-15563 158 8 at at ADP crl-15563 158 9 all all DET crl-15563 158 10 audiences audience NOUN crl-15563 158 11 , , PUNCT crl-15563 158 12 including include VERB crl-15563 158 13 shoppers shopper NOUN crl-15563 158 14 , , PUNCT crl-15563 158 15 support support NOUN crl-15563 158 16 groups group NOUN crl-15563 158 17 , , PUNCT crl-15563 158 18 scholars scholar NOUN crl-15563 158 19 , , PUNCT crl-15563 158 20 students student NOUN crl-15563 158 21 , , PUNCT crl-15563 158 22 hobbyists hobbyist NOUN crl-15563 158 23 , , PUNCT crl-15563 158 24 businesses business NOUN crl-15563 158 25 . . PUNCT crl-15563 159 1 _ _ PUNCT crl-15563 159 2 _ _ PUNCT crl-15563 159 3 _ _ PUNCT crl-15563 159 4 _ _ PUNCT crl-15563 159 5 has have VERB crl-15563 159 6 materials material NOUN crl-15563 159 7 that that PRON crl-15563 159 8 have have AUX crl-15563 159 9 been be AUX crl-15563 159 10 purchased purchase VERB crl-15563 159 11 on on ADP crl-15563 159 12 behalf behalf NOUN crl-15563 159 13 of of ADP crl-15563 159 14 students student NOUN crl-15563 159 15 . . PUNCT crl-15563 160 1 _ _ PUNCT crl-15563 160 2 _ _ PUNCT crl-15563 160 3 _ _ PUNCT crl-15563 161 1 _ _ PUNCT crl-15563 161 2 information information NOUN crl-15563 161 3 must must AUX crl-15563 161 4 have have AUX crl-15563 161 5 been be AUX crl-15563 161 6 deemed deem VERB crl-15563 161 7 authoritative authoritative ADJ crl-15563 161 8 to to PART crl-15563 161 9 be be AUX crl-15563 161 10 included include VERB crl-15563 161 11 . . PUNCT crl-15563 162 1 _ _ PUNCT crl-15563 162 2 _ _ PUNCT crl-15563 162 3 _ _ PUNCT crl-15563 162 4 _ _ PUNCT crl-15563 162 5 is be AUX crl-15563 162 6 organized organize VERB crl-15563 162 7 systematically systematically ADV crl-15563 162 8 with with ADP crl-15563 162 9 a a DET crl-15563 162 10 classification classification NOUN crl-15563 162 11 scheme scheme NOUN crl-15563 162 12 . . PUNCT crl-15563 163 1 _ _ PUNCT crl-15563 163 2 _ _ PUNCT crl-15563 163 3 _ _ PUNCT crl-15563 163 4 _ _ PUNCT crl-15563 163 5 offers offer VERB crl-15563 163 6 online online ADJ crl-15563 163 7 option option NOUN crl-15563 163 8 to to PART crl-15563 163 9 ask ask VERB crl-15563 163 10 questions question NOUN crl-15563 163 11 . . PUNCT crl-15563 164 1 revision revision NOUN crl-15563 164 2 3 3 NUM crl-15563 164 3 ( ( PUNCT crl-15563 164 4 after after ADP crl-15563 164 5 field field NOUN crl-15563 164 6 trials trial NOUN crl-15563 164 7 ) ) PUNCT crl-15563 164 8 academic academic ADJ crl-15563 164 9 libraries library NOUN crl-15563 164 10 are be AUX crl-15563 164 11 generally generally ADV crl-15563 164 12 thought think VERB crl-15563 164 13 of of ADP crl-15563 164 14 as as ADP crl-15563 164 15 collections collection NOUN crl-15563 164 16 of of ADP crl-15563 164 17 materials material NOUN crl-15563 164 18 in in ADP crl-15563 164 19 print print NOUN crl-15563 164 20 and and CCONJ crl-15563 164 21 electronic electronic ADJ crl-15563 164 22 formats format NOUN crl-15563 164 23 . . PUNCT crl-15563 165 1 some some PRON crl-15563 165 2 of of ADP crl-15563 165 3 these these DET crl-15563 165 4 materials material NOUN crl-15563 165 5 are be AUX crl-15563 165 6 made make VERB crl-15563 165 7 available available ADJ crl-15563 165 8 to to ADP crl-15563 165 9 users user NOUN crl-15563 165 10 through through ADP crl-15563 165 11 the the DET crl-15563 165 12 web web NOUN crl-15563 165 13 but but CCONJ crl-15563 165 14 are be AUX crl-15563 165 15 not not PART crl-15563 165 16 included include VERB crl-15563 165 17 in in ADP crl-15563 165 18 what what PRON crl-15563 165 19 we we PRON crl-15563 165 20 traditionally traditionally ADV crl-15563 165 21 think think VERB crl-15563 165 22 of of ADP crl-15563 165 23 as as ADP crl-15563 165 24 the the DET crl-15563 165 25 web web NOUN crl-15563 165 26 . . PUNCT crl-15563 166 1 the the DET crl-15563 166 2 world world NOUN crl-15563 166 3 wide wide ADJ crl-15563 166 4 web web NOUN crl-15563 166 5 is be AUX crl-15563 166 6 a a DET crl-15563 166 7 means means NOUN crl-15563 166 8 of of ADP crl-15563 166 9 communication communication NOUN crl-15563 166 10 . . PUNCT crl-15563 167 1 computers computer NOUN crl-15563 167 2 all all ADV crl-15563 167 3 over over ADP crl-15563 167 4 the the DET crl-15563 167 5 world world NOUN crl-15563 167 6 network network NOUN crl-15563 167 7 with with ADP crl-15563 167 8 one one NUM crl-15563 167 9 another another DET crl-15563 167 10 by by ADP crl-15563 167 11 using use VERB crl-15563 167 12 a a DET crl-15563 167 13 common common ADJ crl-15563 167 14 language language NOUN crl-15563 167 15 . . PUNCT crl-15563 168 1 which which PRON crl-15563 168 2 of of ADP crl-15563 168 3 the the DET crl-15563 168 4 following follow VERB crl-15563 168 5 statements statement NOUN crl-15563 168 6 are be AUX crl-15563 168 7 generally generally ADV crl-15563 168 8 true true ADJ crl-15563 168 9 about about ADP crl-15563 168 10 academic academic ADJ crl-15563 168 11 libraries library NOUN crl-15563 168 12 and/or and/or CCONJ crl-15563 168 13 the the DET crl-15563 168 14 web web NOUN crl-15563 168 15 ? ? PUNCT crl-15563 169 1 put put VERB crl-15563 169 2 a a DET crl-15563 169 3 w w NOUN crl-15563 169 4 if if SCONJ crl-15563 169 5 the the DET crl-15563 169 6 statement statement NOUN crl-15563 169 7 is be AUX crl-15563 169 8 true true ADJ crl-15563 169 9 about about ADP crl-15563 169 10 the the DET crl-15563 169 11 web web NOUN crl-15563 169 12 . . PUNCT crl-15563 170 1 put put VERB crl-15563 170 2 an an DET crl-15563 170 3 l l NOUN crl-15563 170 4 if if SCONJ crl-15563 170 5 the the DET crl-15563 170 6 statement statement NOUN crl-15563 170 7 is be AUX crl-15563 170 8 true true ADJ crl-15563 170 9 about about ADP crl-15563 170 10 the the DET crl-15563 170 11 academic academic ADJ crl-15563 170 12 library library NOUN crl-15563 170 13 . . PUNCT crl-15563 171 1 put put VERB crl-15563 171 2 a a DET crl-15563 171 3 b b NOUN crl-15563 171 4 if if SCONJ crl-15563 171 5 the the DET crl-15563 171 6 statement statement NOUN crl-15563 171 7 is be AUX crl-15563 171 8 true true ADJ crl-15563 171 9 about about ADP crl-15563 171 10 both both DET crl-15563 171 11 the the DET crl-15563 171 12 academic academic ADJ crl-15563 171 13 library library NOUN crl-15563 171 14 and and CCONJ crl-15563 171 15 the the DET crl-15563 171 16 web web NOUN crl-15563 171 17 . . PUNCT crl-15563 172 1 put put VERB crl-15563 172 2 a a DET crl-15563 172 3 n n NOUN crl-15563 172 4 if if SCONJ crl-15563 172 5 the the DET crl-15563 172 6 statement statement NOUN crl-15563 172 7 is be AUX crl-15563 172 8 not not PART crl-15563 172 9 true true ADJ crl-15563 172 10 about about ADP crl-15563 172 11 either either CCONJ crl-15563 172 12 the the DET crl-15563 172 13 academic academic ADJ crl-15563 172 14 library library NOUN crl-15563 172 15 or or CCONJ crl-15563 172 16 the the DET crl-15563 172 17 web web NOUN crl-15563 172 18 . . PUNCT crl-15563 173 1 _ _ PUNCT crl-15563 173 2 _ _ PUNCT crl-15563 173 3 _ _ PUNCT crl-15563 173 4 _ _ PUNCT crl-15563 174 1 all all DET crl-15563 174 2 its its PRON crl-15563 174 3 resources resource NOUN crl-15563 174 4 are be AUX crl-15563 174 5 free free ADJ crl-15563 174 6 and and CCONJ crl-15563 174 7 accessible accessible ADJ crl-15563 174 8 to to ADP crl-15563 174 9 students student NOUN crl-15563 174 10 . . PUNCT crl-15563 175 1 _ _ PUNCT crl-15563 175 2 _ _ PUNCT crl-15563 175 3 _ _ PUNCT crl-15563 176 1 _ _ PUNCT crl-15563 177 1 anyone anyone PRON crl-15563 177 2 can can AUX crl-15563 177 3 add add VERB crl-15563 177 4 information information NOUN crl-15563 177 5 to to ADP crl-15563 177 6 it it PRON crl-15563 177 7 . . PUNCT crl-15563 178 1 _ _ PUNCT crl-15563 178 2 _ _ PUNCT crl-15563 178 3 _ _ PUNCT crl-15563 178 4 _ _ PUNCT crl-15563 178 5 targets target VERB crl-15563 178 6 all all DET crl-15563 178 7 audiences audience NOUN crl-15563 178 8 , , PUNCT crl-15563 178 9 including include VERB crl-15563 178 10 shoppers shopper NOUN crl-15563 178 11 , , PUNCT crl-15563 178 12 support support NOUN crl-15563 178 13 groups group NOUN crl-15563 178 14 , , PUNCT crl-15563 178 15 scholars scholar NOUN crl-15563 178 16 , , PUNCT crl-15563 178 17 students student NOUN crl-15563 178 18 , , PUNCT crl-15563 178 19 hobbyists hobbyist NOUN crl-15563 178 20 , , PUNCT crl-15563 178 21 businesses business NOUN crl-15563 178 22 . . PUNCT crl-15563 179 1 _ _ PUNCT crl-15563 179 2 _ _ PUNCT crl-15563 179 3 _ _ PUNCT crl-15563 179 4 _ _ PUNCT crl-15563 179 5 has have VERB crl-15563 179 6 materials material NOUN crl-15563 179 7 that that PRON crl-15563 179 8 have have AUX crl-15563 179 9 been be AUX crl-15563 179 10 purchased purchase VERB crl-15563 179 11 on on ADP crl-15563 179 12 behalf behalf NOUN crl-15563 179 13 of of ADP crl-15563 179 14 students student NOUN crl-15563 179 15 . . PUNCT crl-15563 180 1 _ _ PUNCT crl-15563 180 2 _ _ PUNCT crl-15563 180 3 _ _ PUNCT crl-15563 181 1 _ _ PUNCT crl-15563 181 2 information information NOUN crl-15563 181 3 must must AUX crl-15563 181 4 have have AUX crl-15563 181 5 been be AUX crl-15563 181 6 deemed deem VERB crl-15563 181 7 authoritative authoritative ADJ crl-15563 181 8 to to PART crl-15563 181 9 be be AUX crl-15563 181 10 included include VERB crl-15563 181 11 . . PUNCT crl-15563 182 1 _ _ PUNCT crl-15563 182 2 _ _ PUNCT crl-15563 182 3 _ _ PUNCT crl-15563 182 4 _ _ PUNCT crl-15563 182 5 is be AUX crl-15563 182 6 organized organize VERB crl-15563 182 7 systematically systematically ADV crl-15563 182 8 with with ADP crl-15563 182 9 a a DET crl-15563 182 10 classification classification NOUN crl-15563 182 11 scheme scheme NOUN crl-15563 182 12 . . PUNCT crl-15563 183 1 _ _ PUNCT crl-15563 183 2 _ _ PUNCT crl-15563 183 3 _ _ PUNCT crl-15563 183 4 _ _ PUNCT crl-15563 183 5 offers offer VERB crl-15563 183 6 online online ADJ crl-15563 183 7 option option NOUN crl-15563 183 8 to to PART crl-15563 183 9 ask ask VERB crl-15563 183 10 questions question NOUN crl-15563 183 11 . . PUNCT crl-15563 184 1 applying apply VERB crl-15563 184 2 systems system NOUN crl-15563 184 3 design design NOUN crl-15563 184 4 and and CCONJ crl-15563 184 5 item item NOUN crl-15563 184 6 response response NOUN crl-15563 184 7 theory theory NOUN crl-15563 184 8 535 535 NUM crl-15563 184 9 a a DET crl-15563 184 10 systems system NOUN crl-15563 184 11 approach approach NOUN crl-15563 184 12 has have AUX crl-15563 184 13 worked work VERB crl-15563 184 14 especially especially ADV crl-15563 184 15 well well ADV crl-15563 184 16 for for ADP crl-15563 184 17 this this DET crl-15563 184 18 project project NOUN crl-15563 184 19 because because SCONJ crl-15563 184 20 it it PRON crl-15563 184 21 is be AUX crl-15563 184 22 an an DET crl-15563 184 23 integrative integrative ADJ crl-15563 184 24 and and CCONJ crl-15563 184 25 reiterative reiterative ADJ crl-15563 184 26 process process NOUN crl-15563 184 27 . . PUNCT crl-15563 185 1 when when SCONJ crl-15563 185 2 items item NOUN crl-15563 185 3 are be AUX crl-15563 185 4 developed develop VERB crl-15563 185 5 to to PART crl-15563 185 6 measure measure VERB crl-15563 185 7 specific specific ADJ crl-15563 185 8 behaviors behavior NOUN crl-15563 185 9 , , PUNCT crl-15563 185 10 they they PRON crl-15563 185 11 are be AUX crl-15563 185 12 easier easy ADJ crl-15563 185 13 to to PART crl-15563 185 14 write write VERB crl-15563 185 15 and and CCONJ crl-15563 185 16 more more ADV crl-15563 185 17 authentic authentic ADJ crl-15563 185 18 . . PUNCT crl-15563 186 1 because because SCONJ crl-15563 186 2 the the DET crl-15563 186 3 work work NOUN crl-15563 186 4 is be AUX crl-15563 186 5 based base VERB crl-15563 186 6 on on ADP crl-15563 186 7 thoroughly thoroughly ADV crl-15563 186 8 analyzed analyze VERB crl-15563 186 9 goals goal NOUN crl-15563 186 10 and and CCONJ crl-15563 186 11 objectives objective NOUN crl-15563 186 12 , , PUNCT crl-15563 186 13 the the DET crl-15563 186 14 process process NOUN crl-15563 186 15 is be AUX crl-15563 186 16 empirical empirical ADJ crl-15563 186 17 and and CCONJ crl-15563 186 18 easily easily ADV crl-15563 186 19 replicable replicable ADJ crl-15563 186 20 . . PUNCT crl-15563 187 1 designers designer NOUN crl-15563 187 2 who who PRON crl-15563 187 3 follow follow VERB crl-15563 187 4 the the DET crl-15563 187 5 same same ADJ crl-15563 187 6 procedures procedure NOUN crl-15563 187 7 would would AUX crl-15563 187 8 theoretically theoretically ADV crl-15563 187 9 produce produce VERB crl-15563 187 10 a a DET crl-15563 187 11 similar similar ADJ crl-15563 187 12 instrument instrument NOUN crl-15563 187 13 . . PUNCT crl-15563 188 1 the the DET crl-15563 188 2 systematic systematic ADJ crl-15563 188 3 process process NOUN crl-15563 188 4 also also ADV crl-15563 188 5 facilitates facilitate VERB crl-15563 188 6 a a DET crl-15563 188 7 high high ADJ crl-15563 188 8 degree degree NOUN crl-15563 188 9 of of ADP crl-15563 188 10 collaboration collaboration NOUN crl-15563 188 11 between between ADP crl-15563 188 12 content content NOUN crl-15563 188 13 and and CCONJ crl-15563 188 14 measurement measurement NOUN crl-15563 188 15 experts expert NOUN crl-15563 188 16 . . PUNCT crl-15563 189 1 because because SCONJ crl-15563 189 2 the the DET crl-15563 189 3 systematic systematic ADJ crl-15563 189 4 approach approach NOUN crl-15563 189 5 was be AUX crl-15563 189 6 created create VERB crl-15563 189 7 particularly particularly ADV crl-15563 189 8 for for ADP crl-15563 189 9 programmaticlevel programmaticlevel NOUN crl-15563 189 10 instructional instructional ADJ crl-15563 189 11 design design NOUN crl-15563 189 12 , , PUNCT crl-15563 189 13 it it PRON crl-15563 189 14 also also ADV crl-15563 189 15 works work VERB crl-15563 189 16 particularly particularly ADV crl-15563 189 17 well well ADV crl-15563 189 18 for for ADP crl-15563 189 19 programmatic programmatic ADJ crl-15563 189 20 - - PUNCT crl-15563 189 21 level level NOUN crl-15563 189 22 assessment assessment NOUN crl-15563 189 23 . . PUNCT crl-15563 190 1 participants participant NOUN crl-15563 190 2 in in ADP crl-15563 190 3 the the DET crl-15563 190 4 field field NOUN crl-15563 190 5 trials trial NOUN crl-15563 190 6 participants participant NOUN crl-15563 190 7 in in ADP crl-15563 190 8 this this DET crl-15563 190 9 phase phase NOUN crl-15563 190 10 of of ADP crl-15563 190 11 the the DET crl-15563 190 12 project project NOUN crl-15563 190 13 were be AUX crl-15563 190 14 undergraduates undergraduate NOUN crl-15563 190 15 enrolled enrol VERB crl-15563 190 16 during during ADP crl-15563 190 17 the the DET crl-15563 190 18 spring spring NOUN crl-15563 190 19 semester semester NOUN crl-15563 190 20 2001 2001 NUM crl-15563 190 21 at at ADP crl-15563 190 22 ksu ksu PROPN crl-15563 190 23 . . PROPN crl-15563 191 1 data data PROPN crl-15563 191 2 were be AUX crl-15563 191 3 collected collect VERB crl-15563 191 4 from from ADP crl-15563 191 5 freshmen freshmen ADJ crl-15563 191 6 orientation orientation NOUN crl-15563 191 7 , , PUNCT crl-15563 191 8 nursing nursing NOUN crl-15563 191 9 , , PUNCT crl-15563 191 10 and and CCONJ crl-15563 191 11 journalism journalism NOUN crl-15563 191 12 and and CCONJ crl-15563 191 13 mass mass NOUN crl-15563 191 14 communications communication NOUN crl-15563 191 15 classes class NOUN crl-15563 191 16 . . PUNCT crl-15563 192 1 the the DET crl-15563 192 2 classes class NOUN crl-15563 192 3 were be AUX crl-15563 192 4 selected select VERB crl-15563 192 5 based base VERB crl-15563 192 6 on on ADP crl-15563 192 7 several several ADJ crl-15563 192 8 factors factor NOUN crl-15563 192 9 , , PUNCT crl-15563 192 10 including include VERB crl-15563 192 11 number number NOUN crl-15563 192 12 of of ADP crl-15563 192 13 students student NOUN crl-15563 192 14 enrolled enrol VERB crl-15563 192 15 and and CCONJ crl-15563 192 16 faculty faculty NOUN crl-15563 192 17 willingness willingness NOUN crl-15563 192 18 to to PART crl-15563 192 19 allow allow VERB crl-15563 192 20 class class NOUN crl-15563 192 21 time time NOUN crl-15563 192 22 for for ADP crl-15563 192 23 participation participation NOUN crl-15563 192 24 . . PUNCT crl-15563 193 1 respondents respondent NOUN crl-15563 193 2 ranged range VERB crl-15563 193 3 from from ADP crl-15563 193 4 freshmen freshman NOUN crl-15563 193 5 to to ADP crl-15563 193 6 seniors senior NOUN crl-15563 193 7 . . PUNCT crl-15563 194 1 participants participant NOUN crl-15563 194 2 were be AUX crl-15563 194 3 given give VERB crl-15563 194 4 a a DET crl-15563 194 5 consent consent NOUN crl-15563 194 6 letter letter NOUN crl-15563 194 7 detailing detail VERB crl-15563 194 8 the the DET crl-15563 194 9 purpose purpose NOUN crl-15563 194 10 of of ADP crl-15563 194 11 the the DET crl-15563 194 12 study study NOUN crl-15563 194 13 , , PUNCT crl-15563 194 14 which which PRON crl-15563 194 15 they they PRON crl-15563 194 16 were be AUX crl-15563 194 17 required require VERB crl-15563 194 18 to to PART crl-15563 194 19 sign sign VERB crl-15563 194 20 before before ADV crl-15563 194 21 participating participate VERB crl-15563 194 22 . . PUNCT crl-15563 195 1 rather rather ADV crl-15563 195 2 than than ADP crl-15563 195 3 self self NOUN crl-15563 195 4 - - PUNCT crl-15563 195 5 reporting report VERB crl-15563 195 6 demographic demographic ADJ crl-15563 195 7 and and CCONJ crl-15563 195 8 academic academic ADJ crl-15563 195 9 data datum NOUN crl-15563 195 10 such such ADJ crl-15563 195 11 as as ADP crl-15563 195 12 grade grade NOUN crl-15563 195 13 point point NOUN crl-15563 195 14 average average PROPN crl-15563 195 15 ( ( PUNCT crl-15563 195 16 gpa gpa PROPN crl-15563 195 17 ) ) PUNCT crl-15563 195 18 , , PUNCT crl-15563 195 19 major major ADJ crl-15563 195 20 , , PUNCT crl-15563 195 21 and and CCONJ crl-15563 195 22 class class NOUN crl-15563 195 23 , , PUNCT crl-15563 195 24 the the DET crl-15563 195 25 students student NOUN crl-15563 195 26 were be AUX crl-15563 195 27 asked ask VERB crl-15563 195 28 to to PART crl-15563 195 29 provide provide VERB crl-15563 195 30 their their PRON crl-15563 195 31 student student NOUN crl-15563 195 32 i i NOUN crl-15563 195 33 d d ADJ crl-15563 195 34 numbers number NOUN crl-15563 195 35 so so SCONJ crl-15563 195 36 that that SCONJ crl-15563 195 37 more more ADV crl-15563 195 38 accurate accurate ADJ crl-15563 195 39 information information NOUN crl-15563 195 40 could could AUX crl-15563 195 41 be be AUX crl-15563 195 42 gathered gather VERB crl-15563 195 43 . . PUNCT crl-15563 196 1 the the DET crl-15563 196 2 authors author NOUN crl-15563 196 3 remained remain VERB crl-15563 196 4 in in ADP crl-15563 196 5 the the DET crl-15563 196 6 room room NOUN crl-15563 196 7 while while SCONJ crl-15563 196 8 the the DET crl-15563 196 9 students student NOUN crl-15563 196 10 completed complete VERB crl-15563 196 11 the the DET crl-15563 196 12 instrument instrument NOUN crl-15563 196 13 and and CCONJ crl-15563 196 14 collected collect VERB crl-15563 196 15 them they PRON crl-15563 196 16 immediately immediately ADV crl-15563 196 17 thereafter thereafter ADV crl-15563 196 18 . . PUNCT crl-15563 197 1 of of ADP crl-15563 197 2 the the DET crl-15563 197 3 554 554 NUM crl-15563 197 4 instruments instrument NOUN crl-15563 197 5 administered administer VERB crl-15563 197 6 , , PUNCT crl-15563 197 7 537 537 NUM crl-15563 197 8 were be AUX crl-15563 197 9 completed complete VERB crl-15563 197 10 . . PUNCT crl-15563 198 1 these these PRON crl-15563 198 2 were be AUX crl-15563 198 3 used use VERB crl-15563 198 4 for for ADP crl-15563 198 5 the the DET crl-15563 198 6 item item NOUN crl-15563 198 7 analysis analysis NOUN crl-15563 198 8 described describe VERB crl-15563 198 9 below below ADV crl-15563 198 10 . . PUNCT crl-15563 199 1 three three NUM crl-15563 199 2 hundred hundred NUM crl-15563 199 3 and and CCONJ crl-15563 199 4 ninety ninety NUM crl-15563 199 5 - - PUNCT crl-15563 199 6 eight eight NUM crl-15563 199 7 students student NOUN crl-15563 199 8 provided provide VERB crl-15563 199 9 valid valid ADJ crl-15563 199 10 i i NOUN crl-15563 199 11 d d PROPN crl-15563 199 12 numbers number NOUN crl-15563 199 13 , , PUNCT crl-15563 199 14 which which PRON crl-15563 199 15 were be AUX crl-15563 199 16 used use VERB crl-15563 199 17 to to PART crl-15563 199 18 obtain obtain VERB crl-15563 199 19 demographic demographic ADJ crl-15563 199 20 and and CCONJ crl-15563 199 21 academic academic ADJ crl-15563 199 22 data datum NOUN crl-15563 199 23 . . PUNCT crl-15563 200 1 measurement measurement NOUN crl-15563 200 2 model model NOUN crl-15563 200 3 the the DET crl-15563 200 4 authors author NOUN crl-15563 200 5 opted opt VERB crl-15563 200 6 to to PART crl-15563 200 7 use use VERB crl-15563 200 8 item item NOUN crl-15563 200 9 response response NOUN crl-15563 200 10 theory theory NOUN crl-15563 200 11 ( ( PUNCT crl-15563 200 12 irt irt ADV crl-15563 200 13 ) ) PUNCT crl-15563 200 14 as as ADP crl-15563 200 15 the the DET crl-15563 200 16 measurement measurement NOUN crl-15563 200 17 model model NOUN crl-15563 200 18 for for ADP crl-15563 200 19 this this DET crl-15563 200 20 project project NOUN crl-15563 200 21 . . PUNCT crl-15563 201 1 irt irt ADV crl-15563 201 2 , , PUNCT crl-15563 201 3 also also ADV crl-15563 201 4 known know VERB crl-15563 201 5 as as ADP crl-15563 201 6 latent latent ADJ crl-15563 201 7 trait trait NOUN crl-15563 201 8 theory theory NOUN crl-15563 201 9 , , PUNCT crl-15563 201 10 focuses focus VERB crl-15563 201 11 on on ADP crl-15563 201 12 latent latent ADJ crl-15563 201 13 , , PUNCT crl-15563 201 14 unobservable unobservable ADJ crl-15563 201 15 traits trait NOUN crl-15563 201 16 such such ADJ crl-15563 201 17 as as ADP crl-15563 201 18 knowledge knowledge NOUN crl-15563 201 19 or or CCONJ crl-15563 201 20 ability ability NOUN crl-15563 201 21 level level NOUN crl-15563 201 22 . . PUNCT crl-15563 202 1 in in ADP crl-15563 202 2 this this DET crl-15563 202 3 project project NOUN crl-15563 202 4 , , PUNCT crl-15563 202 5 the the DET crl-15563 202 6 latent latent ADJ crl-15563 202 7 trait trait NOUN crl-15563 202 8 is be AUX crl-15563 202 9 information information NOUN crl-15563 202 10 literacy literacy NOUN crl-15563 202 11 ability ability NOUN crl-15563 202 12 . . PUNCT crl-15563 203 1 to to PART crl-15563 203 2 measure measure VERB crl-15563 203 3 this this DET crl-15563 203 4 ability ability NOUN crl-15563 203 5 , , PUNCT crl-15563 203 6 the the DET crl-15563 203 7 authors author NOUN crl-15563 203 8 devised devise VERB crl-15563 203 9 a a DET crl-15563 203 10 set set NOUN crl-15563 203 11 of of ADP crl-15563 203 12 questions question NOUN crl-15563 203 13 of of ADP crl-15563 203 14 varying vary VERB crl-15563 203 15 difficulty difficulty NOUN crl-15563 203 16 levels level NOUN crl-15563 203 17 . . PUNCT crl-15563 204 1 difficulty difficulty NOUN crl-15563 204 2 level level NOUN crl-15563 204 3 of of ADP crl-15563 204 4 the the DET crl-15563 204 5 questions question NOUN crl-15563 204 6 was be AUX crl-15563 204 7 verified verify VERB crl-15563 204 8 by by ADP crl-15563 204 9 presenting present VERB crl-15563 204 10 the the DET crl-15563 204 11 items item NOUN crl-15563 204 12 to to PART crl-15563 204 13 content content VERB crl-15563 204 14 experts expert NOUN crl-15563 204 15 ( ( PUNCT crl-15563 204 16 experienced experienced ADJ crl-15563 204 17 reference reference NOUN crl-15563 204 18 and and CCONJ crl-15563 204 19 instruction instruction NOUN crl-15563 204 20 librarians librarian NOUN crl-15563 204 21 ) ) PUNCT crl-15563 204 22 and and CCONJ crl-15563 204 23 having have VERB crl-15563 204 24 them they PRON crl-15563 204 25 rate rate VERB crl-15563 204 26 each each DET crl-15563 204 27 item item NOUN crl-15563 204 28 as as ADP crl-15563 204 29 easy easy ADJ crl-15563 204 30 , , PUNCT crl-15563 204 31 medium medium ADJ crl-15563 204 32 , , PUNCT crl-15563 204 33 or or CCONJ crl-15563 204 34 difficult difficult ADJ crl-15563 204 35 . . PUNCT crl-15563 205 1 this this DET crl-15563 205 2 approach approach NOUN crl-15563 205 3 gives give VERB crl-15563 205 4 the the DET crl-15563 205 5 ability ability NOUN crl-15563 205 6 to to PART crl-15563 205 7 differentiate differentiate VERB crl-15563 205 8 between between ADP crl-15563 205 9 people people NOUN crl-15563 205 10 who who PRON crl-15563 205 11 get get VERB crl-15563 205 12 easy easy ADJ crl-15563 205 13 items item NOUN crl-15563 205 14 correct correct ADJ crl-15563 205 15 and and CCONJ crl-15563 205 16 those those PRON crl-15563 205 17 who who PRON crl-15563 205 18 also also ADV crl-15563 205 19 get get VERB crl-15563 205 20 difficult difficult ADJ crl-15563 205 21 items item NOUN crl-15563 205 22 correct correct ADJ crl-15563 205 23 . . PUNCT crl-15563 206 1 the the DET crl-15563 206 2 analysis analysis NOUN crl-15563 206 3 of of ADP crl-15563 206 4 responses response NOUN crl-15563 206 5 is be AUX crl-15563 206 6 based base VERB crl-15563 206 7 on on ADP crl-15563 206 8 a a DET crl-15563 206 9 mathematical mathematical ADJ crl-15563 206 10 model model NOUN crl-15563 206 11 of of ADP crl-15563 206 12 the the DET crl-15563 206 13 probability probability NOUN crl-15563 206 14 of of ADP crl-15563 206 15 how how SCONJ crl-15563 206 16 people people NOUN crl-15563 206 17 at at ADP crl-15563 206 18 different different ADJ crl-15563 206 19 ability ability NOUN crl-15563 206 20 levels level NOUN crl-15563 206 21 respond respond VERB crl-15563 206 22 to to ADP crl-15563 206 23 an an DET crl-15563 206 24 item item NOUN crl-15563 206 25 . . PUNCT crl-15563 207 1 plotting plot VERB crl-15563 207 2 the the DET crl-15563 207 3 probability probability NOUN crl-15563 207 4 of of ADP crl-15563 207 5 a a DET crl-15563 207 6 correct correct ADJ crl-15563 207 7 response response NOUN crl-15563 207 8 against against ADP crl-15563 207 9 a a DET crl-15563 207 10 continuum continuum NOUN crl-15563 207 11 of of ADP crl-15563 207 12 ability ability NOUN crl-15563 207 13 levels level NOUN crl-15563 207 14 results result VERB crl-15563 207 15 in in ADP crl-15563 207 16 the the DET crl-15563 207 17 item item NOUN crl-15563 207 18 characteristic characteristic ADJ crl-15563 207 19 curve curve NOUN crl-15563 207 20 ( ( PUNCT crl-15563 207 21 icc icc NOUN crl-15563 207 22 ) ) PUNCT crl-15563 207 23 , , PUNCT crl-15563 207 24 a a DET crl-15563 207 25 key key ADJ crl-15563 207 26 construct construct NOUN crl-15563 207 27 of of ADP crl-15563 207 28 irt irt NOUN crl-15563 207 29 . . PUNCT crl-15563 208 1 each each DET crl-15563 208 2 item item NOUN crl-15563 208 3 will will AUX crl-15563 208 4 have have VERB crl-15563 208 5 its its PRON crl-15563 208 6 own own ADJ crl-15563 208 7 icc icc NOUN crl-15563 208 8 . . PUNCT crl-15563 209 1 figure figure VERB crl-15563 209 2 3 3 NUM crl-15563 209 3 shows show VERB crl-15563 209 4 an an DET crl-15563 209 5 example example NOUN crl-15563 209 6 of of ADP crl-15563 209 7 two two NUM crl-15563 209 8 iccs icc NOUN crl-15563 209 9 representing represent VERB crl-15563 209 10 two two NUM crl-15563 209 11 items item NOUN crl-15563 209 12 of of ADP crl-15563 209 13 varying vary VERB crl-15563 209 14 difficulty difficulty NOUN crl-15563 209 15 level level NOUN crl-15563 209 16 with with ADP crl-15563 209 17 probability probability NOUN crl-15563 209 18 on on ADP crl-15563 209 19 the the DET crl-15563 209 20 vertical vertical ADJ crl-15563 209 21 axis axis NOUN crl-15563 209 22 and and CCONJ crl-15563 209 23 theta theta NOUN crl-15563 209 24 ( ( PUNCT crl-15563 209 25 ability ability NOUN crl-15563 209 26 ) ) PUNCT crl-15563 209 27 on on ADP crl-15563 209 28 the the DET crl-15563 209 29 horizontal horizontal ADJ crl-15563 209 30 axis axis NOUN crl-15563 209 31 . . PUNCT crl-15563 210 1 the the DET crl-15563 210 2 curve curve NOUN crl-15563 210 3 on on ADP crl-15563 210 4 the the DET crl-15563 210 5 left left NOUN crl-15563 210 6 represents represent VERB crl-15563 210 7 an an DET crl-15563 210 8 easier easy ADJ crl-15563 210 9 item item NOUN crl-15563 210 10 because because SCONJ crl-15563 210 11 it it PRON crl-15563 210 12 appears appear VERB crl-15563 210 13 at at ADP crl-15563 210 14 the the DET crl-15563 210 15 lower low ADJ crl-15563 210 16 end end NOUN crl-15563 210 17 of of ADP crl-15563 210 18 the the DET crl-15563 210 19 ability ability NOUN crl-15563 210 20 continuum continuum NOUN crl-15563 210 21 . . PUNCT crl-15563 211 1 moving move VERB crl-15563 211 2 higher higher ADV crl-15563 211 3 on on ADP crl-15563 211 4 this this DET crl-15563 211 5 continuum continuum NOUN crl-15563 211 6 , , PUNCT crl-15563 211 7 respondents respondent NOUN crl-15563 211 8 with with ADP crl-15563 211 9 higher high ADJ crl-15563 211 10 levels level NOUN crl-15563 211 11 of of ADP crl-15563 211 12 ability ability NOUN crl-15563 211 13 have have VERB crl-15563 211 14 a a DET crl-15563 211 15 higher high ADJ crl-15563 211 16 probability probability NOUN crl-15563 211 17 of of ADP crl-15563 211 18 responding respond VERB crl-15563 211 19 correctly correctly ADV crl-15563 211 20 to to ADP crl-15563 211 21 this this DET crl-15563 211 22 item item NOUN crl-15563 211 23 . . PUNCT crl-15563 212 1 for for ADP crl-15563 212 2 the the DET crl-15563 212 3 more more ADV crl-15563 212 4 difficult difficult ADJ crl-15563 212 5 item item NOUN crl-15563 212 6 , , PUNCT crl-15563 212 7 the the DET crl-15563 212 8 one one NOUN crl-15563 212 9 on on ADP crl-15563 212 10 the the DET crl-15563 212 11 right right ADJ crl-15563 212 12 , , PUNCT crl-15563 212 13 lower low ADJ crl-15563 212 14 - - PUNCT crl-15563 212 15 ability ability NOUN crl-15563 212 16 respondents respondent NOUN crl-15563 212 17 have have VERB crl-15563 212 18 a a DET crl-15563 212 19 lower low ADJ crl-15563 212 20 probability probability NOUN crl-15563 212 21 of of ADP crl-15563 212 22 responding respond VERB crl-15563 212 23 correctly correctly ADV crl-15563 212 24 than than SCONJ crl-15563 212 25 do do VERB crl-15563 212 26 higher high ADJ crl-15563 212 27 - - PUNCT crl-15563 212 28 ability ability NOUN crl-15563 212 29 respondents respondent NOUN crl-15563 212 30 . . PUNCT crl-15563 213 1 there there PRON crl-15563 213 2 are be VERB crl-15563 213 3 different different ADJ crl-15563 213 4 models model NOUN crl-15563 213 5 of of ADP crl-15563 213 6 item item NOUN crl-15563 213 7 response response NOUN crl-15563 213 8 theory theory NOUN crl-15563 213 9 , , PUNCT crl-15563 213 10 based base VERB crl-15563 213 11 on on ADP crl-15563 213 12 the the DET crl-15563 213 13 number number NOUN crl-15563 213 14 of of ADP crl-15563 213 15 parameters parameter NOUN crl-15563 213 16 to to PART crl-15563 213 17 be be AUX crl-15563 213 18 estimated estimate VERB crl-15563 213 19 for for ADP crl-15563 213 20 the the DET crl-15563 213 21 items item NOUN crl-15563 213 22 . . PUNCT crl-15563 214 1 the the DET crl-15563 214 2 authors author NOUN crl-15563 214 3 used use VERB crl-15563 214 4 a a DET crl-15563 214 5 one one NUM crl-15563 214 6 - - PUNCT crl-15563 214 7 parameter parameter NOUN crl-15563 214 8 model model NOUN crl-15563 214 9 , , PUNCT crl-15563 214 10 the the DET crl-15563 214 11 rasch rasch NOUN crl-15563 214 12 rating rating NOUN crl-15563 214 13 scale scale NOUN crl-15563 214 14 . . PUNCT crl-15563 215 1 in in ADP crl-15563 215 2 this this DET crl-15563 215 3 one one NUM crl-15563 215 4 - - PUNCT crl-15563 215 5 paramthe paramthe NOUN crl-15563 215 6 authors author NOUN crl-15563 215 7 examined examine VERB crl-15563 215 8 results result NOUN crl-15563 215 9 to to PART crl-15563 215 10 determine determine VERB crl-15563 215 11 whether whether SCONJ crl-15563 215 12 the the DET crl-15563 215 13 latent latent ADJ crl-15563 215 14 trait trait NOUN crl-15563 215 15 of of ADP crl-15563 215 16 information information NOUN crl-15563 215 17 literacy literacy NOUN crl-15563 215 18 could could AUX crl-15563 215 19 be be AUX crl-15563 215 20 measured measure VERB crl-15563 215 21 adequately adequately ADV crl-15563 215 22 based base VERB crl-15563 215 23 on on ADP crl-15563 215 24 six six NUM crl-15563 215 25 criteria criterion NOUN crl-15563 215 26 outlined outline VERB crl-15563 215 27 by by ADP crl-15563 215 28 benjamin benjamin PROPN crl-15563 215 29 d. d. PROPN crl-15563 215 30 wright wright PROPN crl-15563 215 31 and and CCONJ crl-15563 215 32 mark mark PROPN crl-15563 215 33 h. h. PROPN crl-15563 215 34 stone.14 stone.14 PROPN crl-15563 215 35 536 536 NUM crl-15563 215 36 college college PROPN crl-15563 215 37 & & CCONJ crl-15563 215 38 research research PROPN crl-15563 215 39 libraries library NOUN crl-15563 215 40 november november PROPN crl-15563 215 41 2002 2002 NUM crl-15563 215 42 eter eter NOUN crl-15563 215 43 model model NOUN crl-15563 215 44 , , PUNCT crl-15563 215 45 the the DET crl-15563 215 46 item item NOUN crl-15563 215 47 characteristic characteristic ADJ crl-15563 215 48 curves curve NOUN crl-15563 215 49 for for ADP crl-15563 215 50 all all DET crl-15563 215 51 items item NOUN crl-15563 215 52 on on ADP crl-15563 215 53 the the DET crl-15563 215 54 instrument instrument NOUN crl-15563 215 55 vary vary VERB crl-15563 215 56 only only ADV crl-15563 215 57 in in ADP crl-15563 215 58 their their PRON crl-15563 215 59 location location NOUN crl-15563 215 60 along along ADP crl-15563 215 61 the the DET crl-15563 215 62 ability ability NOUN crl-15563 215 63 continuum continuum NOUN crl-15563 215 64 . . PUNCT crl-15563 216 1 the the DET crl-15563 216 2 rasch rasch PROPN crl-15563 216 3 model model NOUN crl-15563 216 4 is be AUX crl-15563 216 5 represented represent VERB crl-15563 216 6 by by ADP crl-15563 216 7 p p PROPN crl-15563 216 8 ni ni PROPN crl-15563 216 9 ( ( PUNCT crl-15563 216 10 x x SYM crl-15563 216 11 = = X crl-15563 216 12 1 1 NUM crl-15563 216 13 ) ) PUNCT crl-15563 216 14 = = NOUN crl-15563 217 1 f f PROPN crl-15563 217 2 ( ( PUNCT crl-15563 217 3 b b PROPN crl-15563 217 4 n n PROPN crl-15563 217 5 d d PROPN crl-15563 217 6 i i PROPN crl-15563 217 7 ) ) PUNCT crl-15563 217 8 , , PUNCT crl-15563 217 9 which which PRON crl-15563 217 10 means mean VERB crl-15563 217 11 that that SCONJ crl-15563 217 12 the the DET crl-15563 217 13 probability probability NOUN crl-15563 217 14 of of ADP crl-15563 217 15 person person NOUN crl-15563 217 16 n n ADV crl-15563 217 17 responding respond VERB crl-15563 217 18 correctly correctly ADV crl-15563 217 19 to to AUX crl-15563 217 20 item item VERB crl-15563 217 21 i i PRON crl-15563 217 22 is be AUX crl-15563 217 23 a a DET crl-15563 217 24 function function NOUN crl-15563 217 25 of of ADP crl-15563 217 26 the the DET crl-15563 217 27 difference difference NOUN crl-15563 217 28 between between ADP crl-15563 217 29 his his PRON crl-15563 217 30 or or CCONJ crl-15563 217 31 her her PRON crl-15563 217 32 ability ability NOUN crl-15563 217 33 ( ( PUNCT crl-15563 217 34 b b NOUN crl-15563 217 35 n n X crl-15563 217 36 ) ) PUNCT crl-15563 217 37 and and CCONJ crl-15563 217 38 the the DET crl-15563 217 39 item item NOUN crl-15563 217 40 ’s ’s PART crl-15563 217 41 difficulty difficulty NOUN crl-15563 217 42 ( ( PUNCT crl-15563 217 43 d d PROPN crl-15563 217 44 i i PROPN crl-15563 217 45 ) ) PUNCT crl-15563 218 1 ( ( PUNCT crl-15563 218 2 x x PUNCT crl-15563 218 3 is be AUX crl-15563 218 4 any any DET crl-15563 218 5 given give VERB crl-15563 218 6 score score NOUN crl-15563 218 7 and and CCONJ crl-15563 218 8 1 1 NUM crl-15563 218 9 is be AUX crl-15563 218 10 a a DET crl-15563 218 11 correct correct ADJ crl-15563 218 12 response response NOUN crl-15563 218 13 ) ) PUNCT crl-15563 218 14 . . PUNCT crl-15563 219 1 the the DET crl-15563 219 2 rasch rasch PROPN crl-15563 219 3 model model NOUN crl-15563 219 4 uses use VERB crl-15563 219 5 a a DET crl-15563 219 6 logistic logistic ADJ crl-15563 219 7 function function NOUN crl-15563 219 8 to to PART crl-15563 219 9 describe describe VERB crl-15563 219 10 the the DET crl-15563 219 11 interaction interaction NOUN crl-15563 219 12 between between ADP crl-15563 219 13 items item NOUN crl-15563 219 14 and and CCONJ crl-15563 219 15 persons person NOUN crl-15563 219 16 . . PUNCT crl-15563 220 1 a a DET crl-15563 220 2 logit logit NOUN crl-15563 220 3 is be AUX crl-15563 220 4 the the DET crl-15563 220 5 natural natural ADJ crl-15563 220 6 logarithm logarithm NOUN crl-15563 220 7 of of ADP crl-15563 220 8 the the DET crl-15563 220 9 odds odd NOUN crl-15563 220 10 of of ADP crl-15563 220 11 an an DET crl-15563 220 12 event event NOUN crl-15563 220 13 ’s ’s PART crl-15563 220 14 occurring occur VERB crl-15563 220 15 . . PUNCT crl-15563 221 1 the the DET crl-15563 221 2 logit logit ADJ crl-15563 221 3 transformation transformation NOUN crl-15563 221 4 linearizes linearize VERB crl-15563 221 5 the the DET crl-15563 221 6 inherent inherent ADJ crl-15563 221 7 nonlinear nonlinear ADJ crl-15563 221 8 relationship relationship NOUN crl-15563 221 9 between between ADP crl-15563 221 10 the the DET crl-15563 221 11 items item NOUN crl-15563 221 12 and and CCONJ crl-15563 221 13 the the DET crl-15563 221 14 persons person NOUN crl-15563 221 15 . . PUNCT crl-15563 222 1 the the DET crl-15563 222 2 distribution distribution NOUN crl-15563 222 3 of of ADP crl-15563 222 4 logits logit NOUN crl-15563 222 5 is be AUX crl-15563 222 6 symmetric symmetric ADJ crl-15563 222 7 around around ADP crl-15563 222 8 the the DET crl-15563 222 9 midpoint midpoint ADJ crl-15563 222 10 probability probability NOUN crl-15563 222 11 of of ADP crl-15563 222 12 0.5 0.5 NUM crl-15563 222 13 ( ( PUNCT crl-15563 222 14 logit logit ADV crl-15563 222 15 = = PROPN crl-15563 222 16 0 0 NUM crl-15563 222 17 ) ) PUNCT crl-15563 222 18 and and CCONJ crl-15563 222 19 ranges range VERB crl-15563 222 20 from from ADP crl-15563 222 21 negative negative ADJ crl-15563 222 22 infinity infinity NOUN crl-15563 222 23 to to ADP crl-15563 222 24 positive positive ADJ crl-15563 222 25 infinity infinity NOUN crl-15563 222 26 . . PUNCT crl-15563 223 1 in in ADP crl-15563 223 2 the the DET crl-15563 223 3 rasch rasch PROPN crl-15563 223 4 model model NOUN crl-15563 223 5 , , PUNCT crl-15563 223 6 the the DET crl-15563 223 7 items item NOUN crl-15563 223 8 and and CCONJ crl-15563 223 9 the the DET crl-15563 223 10 respondents respondent NOUN crl-15563 223 11 are be AUX crl-15563 223 12 calibrated calibrate VERB crl-15563 223 13 along along ADP crl-15563 223 14 the the DET crl-15563 223 15 same same ADJ crl-15563 223 16 continuum continuum NOUN crl-15563 223 17 . . PUNCT crl-15563 224 1 items item NOUN crl-15563 224 2 that that PRON crl-15563 224 3 are be AUX crl-15563 224 4 more more ADV crl-15563 224 5 difficult difficult ADJ crl-15563 224 6 to to PART crl-15563 224 7 answer answer VERB crl-15563 224 8 are be AUX crl-15563 224 9 calibrated calibrate VERB crl-15563 224 10 toward toward ADP crl-15563 224 11 the the DET crl-15563 224 12 high high ADJ crl-15563 224 13 end end NOUN crl-15563 224 14 of of ADP crl-15563 224 15 the the DET crl-15563 224 16 continuum continuum NOUN crl-15563 224 17 , , PUNCT crl-15563 224 18 and and CCONJ crl-15563 224 19 items item NOUN crl-15563 224 20 that that PRON crl-15563 224 21 are be AUX crl-15563 224 22 easier easy ADJ crl-15563 224 23 to to PART crl-15563 224 24 answer answer VERB crl-15563 224 25 appear appear VERB crl-15563 224 26 at at ADP crl-15563 224 27 the the DET crl-15563 224 28 low low ADJ crl-15563 224 29 end end NOUN crl-15563 224 30 . . PUNCT crl-15563 225 1 respondents respondent NOUN crl-15563 225 2 are be AUX crl-15563 225 3 placed place VERB crl-15563 225 4 along along ADP crl-15563 225 5 the the DET crl-15563 225 6 same same ADJ crl-15563 225 7 continuum continuum NOUN crl-15563 225 8 in in ADP crl-15563 225 9 a a DET crl-15563 225 10 similar similar ADJ crl-15563 225 11 manner manner NOUN crl-15563 225 12 — — PUNCT crl-15563 225 13 those those PRON crl-15563 225 14 who who PRON crl-15563 225 15 are be AUX crl-15563 225 16 able able ADJ crl-15563 225 17 to to PART crl-15563 225 18 respond respond VERB crl-15563 225 19 correctly correctly ADV crl-15563 225 20 to to ADP crl-15563 225 21 more more ADJ crl-15563 225 22 items item NOUN crl-15563 225 23 are be AUX crl-15563 225 24 placed place VERB crl-15563 225 25 at at ADP crl-15563 225 26 the the DET crl-15563 225 27 higher high ADJ crl-15563 225 28 end end NOUN crl-15563 225 29 of of ADP crl-15563 225 30 the the DET crl-15563 225 31 continuum continuum PROPN crl-15563 225 32 , , PUNCT crl-15563 225 33 and and CCONJ crl-15563 225 34 those those PRON crl-15563 225 35 who who PRON crl-15563 225 36 have have VERB crl-15563 225 37 less less ADJ crl-15563 225 38 success success NOUN crl-15563 225 39 responding respond VERB crl-15563 225 40 appear appear VERB crl-15563 225 41 at at ADP crl-15563 225 42 the the DET crl-15563 225 43 low low ADJ crl-15563 225 44 end end NOUN crl-15563 225 45 . . PUNCT crl-15563 226 1 the the DET crl-15563 226 2 use use NOUN crl-15563 226 3 of of ADP crl-15563 226 4 item item NOUN crl-15563 226 5 response response NOUN crl-15563 226 6 theory theory NOUN crl-15563 226 7 , , PUNCT crl-15563 226 8 and and CCONJ crl-15563 226 9 specifically specifically ADV crl-15563 226 10 the the DET crl-15563 226 11 rasch rasch PROPN crl-15563 226 12 model model NOUN crl-15563 226 13 , , PUNCT crl-15563 226 14 guides guide VERB crl-15563 226 15 the the DET crl-15563 226 16 data datum NOUN crl-15563 226 17 analysis analysis NOUN crl-15563 226 18 . . PUNCT crl-15563 227 1 the the DET crl-15563 227 2 following follow VERB crl-15563 227 3 section section NOUN crl-15563 227 4 discusses discuss VERB crl-15563 227 5 what what PRON crl-15563 227 6 the the DET crl-15563 227 7 data datum NOUN crl-15563 227 8 say say VERB crl-15563 227 9 about about ADP crl-15563 227 10 the the DET crl-15563 227 11 items item NOUN crl-15563 227 12 developed develop VERB crl-15563 227 13 and and CCONJ crl-15563 227 14 whether whether SCONJ crl-15563 227 15 they they PRON crl-15563 227 16 accurately accurately ADV crl-15563 227 17 measure measure VERB crl-15563 227 18 the the DET crl-15563 227 19 information information NOUN crl-15563 227 20 literacy literacy NOUN crl-15563 227 21 trait trait NOUN crl-15563 227 22 . . PUNCT crl-15563 228 1 data datum NOUN crl-15563 228 2 analysis analysis NOUN crl-15563 228 3 data datum NOUN crl-15563 228 4 from from ADP crl-15563 228 5 the the DET crl-15563 228 6 field field NOUN crl-15563 228 7 trials trial NOUN crl-15563 228 8 described describe VERB crl-15563 228 9 earlier early ADV crl-15563 228 10 were be AUX crl-15563 228 11 analyzed analyze VERB crl-15563 228 12 using use VERB crl-15563 228 13 winsteps winstep NOUN crl-15563 228 14 , , PUNCT crl-15563 228 15 a a DET crl-15563 228 16 rasch rasch NOUN crl-15563 228 17 modeling modeling NOUN crl-15563 228 18 program program NOUN crl-15563 228 19 created create VERB crl-15563 228 20 by by ADP crl-15563 228 21 researchers researcher NOUN crl-15563 228 22 at at ADP crl-15563 228 23 the the DET crl-15563 228 24 mesa mesa PROPN crl-15563 228 25 institute institute PROPN crl-15563 228 26 at at ADP crl-15563 228 27 the the DET crl-15563 228 28 university university PROPN crl-15563 228 29 of of ADP crl-15563 228 30 chicago chicago PROPN crl-15563 228 31 . . PUNCT crl-15563 229 1 the the DET crl-15563 229 2 authors author NOUN crl-15563 229 3 examined examine VERB crl-15563 229 4 results result NOUN crl-15563 229 5 to to PART crl-15563 229 6 determine determine VERB crl-15563 229 7 whether whether SCONJ crl-15563 229 8 the the DET crl-15563 229 9 latent latent ADJ crl-15563 229 10 trait trait NOUN crl-15563 229 11 of of ADP crl-15563 229 12 information information NOUN crl-15563 229 13 literacy literacy NOUN crl-15563 229 14 could could AUX crl-15563 229 15 be be AUX crl-15563 229 16 measured measure VERB crl-15563 229 17 adequately adequately ADV crl-15563 229 18 based base VERB crl-15563 229 19 on on ADP crl-15563 229 20 six six NUM crl-15563 229 21 criteria criterion NOUN crl-15563 229 22 outlined outline VERB crl-15563 229 23 by by ADP crl-15563 229 24 benjamin benjamin PROPN crl-15563 229 25 d. d. PROPN crl-15563 229 26 wright wright PROPN crl-15563 229 27 and and CCONJ crl-15563 229 28 mark mark PROPN crl-15563 229 29 h. h. PROPN crl-15563 229 30 stone.14 stone.14 PROPN crl-15563 230 1 1 1 NUM crl-15563 230 2 . . PUNCT crl-15563 230 3 is be AUX crl-15563 230 4 a a DET crl-15563 230 5 discernible discernible ADJ crl-15563 230 6 line line NOUN crl-15563 230 7 of of ADP crl-15563 230 8 increasing increase VERB crl-15563 230 9 intensity intensity NOUN crl-15563 230 10 defined define VERB crl-15563 230 11 by by ADP crl-15563 230 12 the the DET crl-15563 230 13 data datum NOUN crl-15563 230 14 ? ? PUNCT crl-15563 231 1 the the DET crl-15563 231 2 project project NOUN crl-15563 231 3 authors author NOUN crl-15563 231 4 addressed address VERB crl-15563 231 5 this this DET crl-15563 231 6 question question NOUN crl-15563 231 7 by by ADP crl-15563 231 8 looking look VERB crl-15563 231 9 at at ADP crl-15563 231 10 the the DET crl-15563 231 11 extent extent NOUN crl-15563 231 12 to to PART crl-15563 231 13 which which PRON crl-15563 231 14 item item NOUN crl-15563 231 15 calibrations calibration NOUN crl-15563 231 16 were be AUX crl-15563 231 17 spread spread VERB crl-15563 231 18 out out ADP crl-15563 231 19 to to PART crl-15563 231 20 define define VERB crl-15563 231 21 distinct distinct ADJ crl-15563 231 22 levels level NOUN crl-15563 231 23 of of ADP crl-15563 231 24 information information NOUN crl-15563 231 25 literacy literacy NOUN crl-15563 231 26 skill skill NOUN crl-15563 231 27 . . PUNCT crl-15563 232 1 one one NUM crl-15563 232 2 criterion criterion NOUN crl-15563 232 3 was be AUX crl-15563 232 4 that that DET crl-15563 232 5 separation separation NOUN crl-15563 232 6 of of ADP crl-15563 232 7 item item NOUN crl-15563 232 8 difficulties difficulty NOUN crl-15563 232 9 should should AUX crl-15563 232 10 be be AUX crl-15563 232 11 between between ADP crl-15563 232 12 -3 -3 PUNCT crl-15563 232 13 and and CCONJ crl-15563 232 14 +3 +3 PROPN crl-15563 232 15 on on ADP crl-15563 232 16 the the DET crl-15563 232 17 logit logit ADJ crl-15563 232 18 scale scale NOUN crl-15563 232 19 to to PART crl-15563 232 20 be be AUX crl-15563 232 21 adequate adequate ADJ crl-15563 232 22 . . PUNCT crl-15563 233 1 in in ADP crl-15563 233 2 addition addition NOUN crl-15563 233 3 , , PUNCT crl-15563 233 4 the the DET crl-15563 233 5 itemperson itemperson NOUN crl-15563 233 6 map map NOUN crl-15563 233 7 , , PUNCT crl-15563 233 8 plotting plot VERB crl-15563 233 9 person person NOUN crl-15563 233 10 ability ability NOUN crl-15563 233 11 against against ADP crl-15563 233 12 item item NOUN crl-15563 233 13 difficulty difficulty NOUN crl-15563 233 14 , , PUNCT crl-15563 233 15 should should AUX crl-15563 233 16 show show VERB crl-15563 233 17 the the DET crl-15563 233 18 figure figure NOUN crl-15563 233 19 3 3 NUM crl-15563 233 20 item item NOUN crl-15563 233 21 characteristic characteristic ADJ crl-15563 233 22 curves curve NOUN crl-15563 233 23 applying apply VERB crl-15563 233 24 systems system NOUN crl-15563 233 25 design design NOUN crl-15563 233 26 and and CCONJ crl-15563 233 27 item item NOUN crl-15563 233 28 response response NOUN crl-15563 233 29 theory theory NOUN crl-15563 233 30 537 537 NUM crl-15563 233 31 figure figure NOUN crl-15563 233 32 4 4 NUM crl-15563 233 33 map map NOUN crl-15563 233 34 of of ADP crl-15563 233 35 persons person NOUN crl-15563 233 36 and and CCONJ crl-15563 233 37 items item NOUN crl-15563 233 38 items item NOUN crl-15563 233 39 spread spread VERB crl-15563 233 40 equally equally ADV crl-15563 233 41 among among ADP crl-15563 233 42 the the DET crl-15563 233 43 respondents respondent NOUN crl-15563 233 44 . . PUNCT crl-15563 234 1 figure figure VERB crl-15563 234 2 4 4 NUM crl-15563 234 3 , , PUNCT crl-15563 234 4 which which PRON crl-15563 234 5 is be AUX crl-15563 234 6 the the DET crl-15563 234 7 map map NOUN crl-15563 234 8 of of ADP crl-15563 234 9 persons person NOUN crl-15563 234 10 and and CCONJ crl-15563 234 11 items item NOUN crl-15563 234 12 created create VERB crl-15563 234 13 by by ADP crl-15563 234 14 the the DET crl-15563 234 15 winsteps winstep NOUN crl-15563 234 16 program program NOUN crl-15563 234 17 , , PUNCT crl-15563 234 18 shows show VERB crl-15563 234 19 the the DET crl-15563 234 20 latent latent ADJ crl-15563 234 21 trait trait NOUN crl-15563 234 22 of of ADP crl-15563 234 23 information information NOUN crl-15563 234 24 literacy literacy NOUN crl-15563 234 25 depicted depict VERB crl-15563 234 26 by by ADP crl-15563 234 27 the the DET crl-15563 234 28 vertical vertical ADJ crl-15563 234 29 line line NOUN crl-15563 234 30 . . PUNCT crl-15563 235 1 the the DET crl-15563 235 2 distribution distribution NOUN crl-15563 235 3 of of ADP crl-15563 235 4 persons person NOUN crl-15563 235 5 is be AUX crl-15563 235 6 on on ADP crl-15563 235 7 the the DET crl-15563 235 8 left left NOUN crl-15563 235 9 of of ADP crl-15563 235 10 the the DET crl-15563 235 11 line line NOUN crl-15563 235 12 , , PUNCT crl-15563 235 13 and and CCONJ crl-15563 235 14 the the DET crl-15563 235 15 distribution distribution NOUN crl-15563 235 16 of of ADP crl-15563 235 17 items item NOUN crl-15563 235 18 is be AUX crl-15563 235 19 on on ADP crl-15563 235 20 the the DET crl-15563 235 21 right right NOUN crl-15563 235 22 . . PUNCT crl-15563 236 1 better well ADJ crl-15563 236 2 - - PUNCT crl-15563 236 3 able able ADJ crl-15563 236 4 persons person NOUN crl-15563 236 5 and and CCONJ crl-15563 236 6 more more ADV crl-15563 236 7 - - PUNCT crl-15563 236 8 difficult difficult ADJ crl-15563 236 9 items item NOUN crl-15563 236 10 appear appear VERB crl-15563 236 11 toward toward ADP crl-15563 236 12 the the DET crl-15563 236 13 top top NOUN crl-15563 236 14 of of ADP crl-15563 236 15 the the DET crl-15563 236 16 map map NOUN crl-15563 236 17 . . PUNCT crl-15563 237 1 persons person NOUN crl-15563 237 2 and and CCONJ crl-15563 237 3 items item NOUN crl-15563 237 4 are be AUX crl-15563 237 5 scaled scale VERB crl-15563 237 6 in in ADP crl-15563 237 7 logits logit NOUN crl-15563 237 8 , , PUNCT crl-15563 237 9 with with ADP crl-15563 237 10 a a DET crl-15563 237 11 mean mean NOUN crl-15563 237 12 of of ADP crl-15563 237 13 0 0 NUM crl-15563 237 14 and and CCONJ crl-15563 237 15 a a DET crl-15563 237 16 standard standard ADJ crl-15563 237 17 deviation deviation NOUN crl-15563 237 18 of of ADP crl-15563 237 19 1 1 NUM crl-15563 237 20 . . PROPN crl-15563 237 21 examination examination NOUN crl-15563 237 22 of of ADP crl-15563 237 23 the the DET crl-15563 237 24 map map NOUN crl-15563 237 25 shows show VERB crl-15563 237 26 item item NOUN crl-15563 237 27 calibrations calibration NOUN crl-15563 237 28 evenly evenly ADV crl-15563 237 29 spread spread VERB crl-15563 237 30 along along ADP crl-15563 237 31 the the DET crl-15563 237 32 latent latent NOUN crl-15563 237 33 trait trait NOUN crl-15563 237 34 , , PUNCT crl-15563 237 35 ranging range VERB crl-15563 237 36 from from ADP crl-15563 237 37 -3.29 -3.29 PROPN crl-15563 237 38 to to ADP crl-15563 237 39 +2.86 +2.86 ADJ crl-15563 237 40 . . PUNCT crl-15563 238 1 although although SCONJ crl-15563 238 2 there there PRON crl-15563 238 3 are be VERB crl-15563 238 4 some some DET crl-15563 238 5 small small ADJ crl-15563 238 6 gaps gap NOUN crl-15563 238 7 , , PUNCT crl-15563 238 8 for for ADP crl-15563 238 9 the the DET crl-15563 238 10 most most ADJ crl-15563 238 11 part part NOUN crl-15563 238 12 , , PUNCT crl-15563 238 13 items item NOUN crl-15563 238 14 cover cover VERB crl-15563 238 15 the the DET crl-15563 238 16 range range NOUN crl-15563 238 17 of of ADP crl-15563 238 18 difficulty difficulty NOUN crl-15563 238 19 levels level NOUN crl-15563 238 20 . . PUNCT crl-15563 239 1 the the DET crl-15563 239 2 distribution distribution NOUN crl-15563 239 3 of of ADP crl-15563 239 4 persons person NOUN crl-15563 239 5 along along ADP crl-15563 239 6 the the DET crl-15563 239 7 variable variable NOUN crl-15563 239 8 is be AUX crl-15563 239 9 approximately approximately ADV crl-15563 239 10 normal normal ADJ crl-15563 239 11 , , PUNCT crl-15563 239 12 and and CCONJ crl-15563 239 13 persons person NOUN crl-15563 239 14 and and CCONJ crl-15563 239 15 items item NOUN crl-15563 239 16 are be AUX crl-15563 239 17 targeted target VERB crl-15563 239 18 , , PUNCT crl-15563 239 19 that that ADV crl-15563 239 20 is be AUX crl-15563 239 21 , , PUNCT crl-15563 239 22 lined line VERB crl-15563 239 23 up up ADP crl-15563 239 24 with with ADP crl-15563 239 25 each each DET crl-15563 239 26 other other ADJ crl-15563 239 27 along along ADP crl-15563 239 28 the the DET crl-15563 239 29 variable variable NOUN crl-15563 239 30 . . PUNCT crl-15563 240 1 moreover moreover ADV crl-15563 240 2 , , PUNCT crl-15563 240 3 the the DET crl-15563 240 4 persons person NOUN crl-15563 240 5 are be AUX crl-15563 240 6 bounded bound VERB crl-15563 240 7 by by ADP crl-15563 240 8 the the DET crl-15563 240 9 items item NOUN crl-15563 240 10 , , PUNCT crl-15563 240 11 meaning mean VERB crl-15563 240 12 that that SCONJ crl-15563 240 13 some some DET crl-15563 240 14 items item NOUN crl-15563 240 15 are be AUX crl-15563 240 16 more more ADV crl-15563 240 17 difficult difficult ADJ crl-15563 240 18 than than ADP crl-15563 240 19 the the DET crl-15563 240 20 highest high ADJ crl-15563 240 21 - - PUNCT crl-15563 240 22 ability ability NOUN crl-15563 240 23 level level NOUN crl-15563 240 24 and and CCONJ crl-15563 240 25 some some PRON crl-15563 240 26 are be AUX crl-15563 240 27 easier easy ADJ crl-15563 240 28 than than ADP crl-15563 240 29 the the DET crl-15563 240 30 lowest low ADJ crl-15563 240 31 - - PUNCT crl-15563 240 32 ability ability NOUN crl-15563 240 33 level level NOUN crl-15563 240 34 . . PUNCT crl-15563 241 1 538 538 NUM crl-15563 241 2 college college PROPN crl-15563 241 3 & & CCONJ crl-15563 241 4 research research PROPN crl-15563 241 5 libraries library NOUN crl-15563 241 6 november november PROPN crl-15563 241 7 2002 2002 NUM crl-15563 241 8 2 2 NUM crl-15563 241 9 . . X crl-15563 241 10 is be AUX crl-15563 241 11 item item NOUN crl-15563 241 12 placement placement NOUN crl-15563 241 13 along along ADP crl-15563 241 14 this this DET crl-15563 241 15 line line NOUN crl-15563 241 16 reasonable reasonable ADJ crl-15563 241 17 ? ? PUNCT crl-15563 242 1 a a DET crl-15563 242 2 satisfactory satisfactory ADJ crl-15563 242 3 response response NOUN crl-15563 242 4 to to ADP crl-15563 242 5 this this DET crl-15563 242 6 question question NOUN crl-15563 242 7 calls call VERB crl-15563 242 8 for for SCONJ crl-15563 242 9 items item NOUN crl-15563 242 10 to to PART crl-15563 242 11 be be AUX crl-15563 242 12 ordered order VERB crl-15563 242 13 in in ADP crl-15563 242 14 a a DET crl-15563 242 15 way way NOUN crl-15563 242 16 that that PRON crl-15563 242 17 follows follow VERB crl-15563 242 18 expectations expectation NOUN crl-15563 242 19 . . PUNCT crl-15563 243 1 those those DET crl-15563 243 2 items item NOUN crl-15563 243 3 measuring measure VERB crl-15563 243 4 higher high ADJ crl-15563 243 5 - - PUNCT crl-15563 243 6 level level NOUN crl-15563 243 7 information information NOUN crl-15563 243 8 literacy literacy NOUN crl-15563 243 9 skills skill NOUN crl-15563 243 10 must must AUX crl-15563 243 11 group group VERB crl-15563 243 12 together together ADV crl-15563 243 13 at at ADP crl-15563 243 14 the the DET crl-15563 243 15 high high ADJ crl-15563 243 16 end end NOUN crl-15563 243 17 of of ADP crl-15563 243 18 the the DET crl-15563 243 19 continuum continuum NOUN crl-15563 243 20 , , PUNCT crl-15563 243 21 and and CCONJ crl-15563 243 22 those those PRON crl-15563 243 23 measuring measure VERB crl-15563 243 24 lower low ADJ crl-15563 243 25 - - PUNCT crl-15563 243 26 level level NOUN crl-15563 243 27 skills skill NOUN crl-15563 243 28 should should AUX crl-15563 243 29 group group VERB crl-15563 243 30 together together ADV crl-15563 243 31 at at ADP crl-15563 243 32 the the DET crl-15563 243 33 low low ADJ crl-15563 243 34 end end NOUN crl-15563 243 35 of of ADP crl-15563 243 36 the the DET crl-15563 243 37 continuum continuum PROPN crl-15563 243 38 . . PUNCT crl-15563 244 1 upon upon SCONJ crl-15563 244 2 examination examination NOUN crl-15563 244 3 of of ADP crl-15563 244 4 the the DET crl-15563 244 5 individual individual ADJ crl-15563 244 6 items item NOUN crl-15563 244 7 and and CCONJ crl-15563 244 8 comparison comparison NOUN crl-15563 244 9 of of ADP crl-15563 244 10 their their PRON crl-15563 244 11 placement placement NOUN crl-15563 244 12 along along ADP crl-15563 244 13 the the DET crl-15563 244 14 variable variable NOUN crl-15563 244 15 with with ADP crl-15563 244 16 their their PRON crl-15563 244 17 own own ADJ crl-15563 244 18 intent intent NOUN crl-15563 244 19 , , PUNCT crl-15563 244 20 the the DET crl-15563 244 21 content content NOUN crl-15563 244 22 experts expert NOUN crl-15563 244 23 ’ ’ PART crl-15563 244 24 input input NOUN crl-15563 244 25 , , PUNCT crl-15563 244 26 and and CCONJ crl-15563 244 27 the the DET crl-15563 244 28 previous previous ADJ crl-15563 244 29 phases phase NOUN crl-15563 244 30 of of ADP crl-15563 244 31 data data NOUN crl-15563 244 32 collection collection NOUN crl-15563 244 33 , , PUNCT crl-15563 244 34 the the DET crl-15563 244 35 authors author NOUN crl-15563 244 36 found find VERB crl-15563 244 37 that that SCONJ crl-15563 244 38 , , PUNCT crl-15563 244 39 for for ADP crl-15563 244 40 the the DET crl-15563 244 41 most most ADJ crl-15563 244 42 part part NOUN crl-15563 244 43 , , PUNCT crl-15563 244 44 the the DET crl-15563 244 45 ordering ordering NOUN crl-15563 244 46 from from ADP crl-15563 244 47 easy easy ADJ crl-15563 244 48 to to AUX crl-15563 244 49 difficult difficult ADJ crl-15563 244 50 makes make VERB crl-15563 244 51 sense sense NOUN crl-15563 244 52 based base VERB crl-15563 244 53 on on ADP crl-15563 244 54 content content NOUN crl-15563 244 55 area area NOUN crl-15563 244 56 and and CCONJ crl-15563 244 57 knowledge knowledge NOUN crl-15563 244 58 level level NOUN crl-15563 244 59 needed need VERB crl-15563 244 60 to to PART crl-15563 244 61 respond respond VERB crl-15563 244 62 correctly correctly ADV crl-15563 244 63 . . PUNCT crl-15563 245 1 for for ADP crl-15563 245 2 the the DET crl-15563 245 3 few few ADJ crl-15563 245 4 items item NOUN crl-15563 245 5 that that PRON crl-15563 245 6 seemed seem VERB crl-15563 245 7 incorrectly incorrectly ADV crl-15563 245 8 scaled scale VERB crl-15563 245 9 , , PUNCT crl-15563 245 10 the the DET crl-15563 245 11 authors author NOUN crl-15563 245 12 looked look VERB crl-15563 245 13 at at ADP crl-15563 245 14 the the DET crl-15563 245 15 questions question NOUN crl-15563 245 16 themselves themselves PRON crl-15563 245 17 : : PUNCT crl-15563 245 18 the the DET crl-15563 245 19 wording wording NOUN crl-15563 245 20 , , PUNCT crl-15563 245 21 the the DET crl-15563 245 22 response response NOUN crl-15563 245 23 options option NOUN crl-15563 245 24 , , PUNCT crl-15563 245 25 and and CCONJ crl-15563 245 26 even even ADV crl-15563 245 27 the the DET crl-15563 245 28 items item NOUN crl-15563 245 29 ’ ' PUNCT crl-15563 245 30 placement placement NOUN crl-15563 245 31 within within ADP crl-15563 245 32 the the DET crl-15563 245 33 instrument instrument NOUN crl-15563 245 34 . . PUNCT crl-15563 246 1 for for ADP crl-15563 246 2 example example NOUN crl-15563 246 3 , , PUNCT crl-15563 246 4 the the DET crl-15563 246 5 item item NOUN crl-15563 246 6 calibrated calibrate VERB crl-15563 246 7 as as ADP crl-15563 246 8 the the DET crl-15563 246 9 easiest easy ADJ crl-15563 246 10 on on ADP crl-15563 246 11 the the DET crl-15563 246 12 item item NOUN crl-15563 246 13 - - PUNCT crl-15563 246 14 person person NOUN crl-15563 246 15 map map NOUN crl-15563 246 16 was be AUX crl-15563 246 17 item item NOUN crl-15563 246 18 7 7 NUM crl-15563 246 19 , , PUNCT crl-15563 246 20 which which PRON crl-15563 246 21 asked ask VERB crl-15563 246 22 students student NOUN crl-15563 246 23 how how SCONJ crl-15563 246 24 to to PART crl-15563 246 25 search search VERB crl-15563 246 26 for for ADP crl-15563 246 27 items item NOUN crl-15563 246 28 written write VERB crl-15563 246 29 by by ADP crl-15563 246 30 charlotte charlotte PROPN crl-15563 246 31 brontë brontë PROPN crl-15563 246 32 . . PUNCT crl-15563 247 1 this this DET crl-15563 247 2 item item NOUN crl-15563 247 3 proved prove VERB crl-15563 247 4 easy easy ADJ crl-15563 247 5 in in ADP crl-15563 247 6 the the DET crl-15563 247 7 earlier early ADJ crl-15563 247 8 phases phase NOUN crl-15563 247 9 of of ADP crl-15563 247 10 instrument instrument NOUN crl-15563 247 11 development development NOUN crl-15563 247 12 , , PUNCT crl-15563 247 13 and and CCONJ crl-15563 247 14 most most ADJ crl-15563 247 15 people people NOUN crl-15563 247 16 would would AUX crl-15563 247 17 agree agree VERB crl-15563 247 18 that that SCONJ crl-15563 247 19 this this PRON crl-15563 247 20 is be AUX crl-15563 247 21 a a DET crl-15563 247 22 fairly fairly ADV crl-15563 247 23 easy easy ADJ crl-15563 247 24 concept concept NOUN crl-15563 247 25 for for SCONJ crl-15563 247 26 students student NOUN crl-15563 247 27 to to PART crl-15563 247 28 understand understand VERB crl-15563 247 29 . . PUNCT crl-15563 248 1 therefore therefore ADV crl-15563 248 2 , , PUNCT crl-15563 248 3 the the DET crl-15563 248 4 authors author NOUN crl-15563 248 5 were be AUX crl-15563 248 6 quite quite ADV crl-15563 248 7 confident confident ADJ crl-15563 248 8 that that SCONJ crl-15563 248 9 this this DET crl-15563 248 10 item item NOUN crl-15563 248 11 was be AUX crl-15563 248 12 calibrated calibrate VERB crl-15563 248 13 correctly correctly ADV crl-15563 248 14 . . PUNCT crl-15563 249 1 the the DET crl-15563 249 2 next next ADJ crl-15563 249 3 easiest easy ADJ crl-15563 249 4 item item NOUN crl-15563 249 5 was be AUX crl-15563 249 6 item item NOUN crl-15563 249 7 13 13 NUM crl-15563 249 8 , , PUNCT crl-15563 249 9 which which PRON crl-15563 249 10 was be AUX crl-15563 249 11 one one NUM crl-15563 249 12 of of ADP crl-15563 249 13 a a DET crl-15563 249 14 series series NOUN crl-15563 249 15 of of ADP crl-15563 249 16 items item NOUN crl-15563 249 17 on on ADP crl-15563 249 18 the the DET crl-15563 249 19 theme theme NOUN crl-15563 249 20 of of ADP crl-15563 249 21 how how SCONJ crl-15563 249 22 a a DET crl-15563 249 23 student student NOUN crl-15563 249 24 starts start VERB crl-15563 249 25 on on ADP crl-15563 249 26 a a DET crl-15563 249 27 class class NOUN crl-15563 249 28 assignment assignment NOUN crl-15563 249 29 requiring require VERB crl-15563 249 30 library library NOUN crl-15563 249 31 research research NOUN crl-15563 249 32 . . PUNCT crl-15563 250 1 when when SCONJ crl-15563 250 2 this this DET crl-15563 250 3 item item NOUN crl-15563 250 4 was be AUX crl-15563 250 5 reexamined reexamine VERB crl-15563 250 6 after after ADP crl-15563 250 7 an an DET crl-15563 250 8 analysis analysis NOUN crl-15563 250 9 of of ADP crl-15563 250 10 the the DET crl-15563 250 11 data datum NOUN crl-15563 250 12 , , PUNCT crl-15563 250 13 the the DET crl-15563 250 14 authors author NOUN crl-15563 250 15 realized realize VERB crl-15563 250 16 it it PRON crl-15563 250 17 was be AUX crl-15563 250 18 really really ADV crl-15563 250 19 an an DET crl-15563 250 20 opinion opinion NOUN crl-15563 250 21 - - PUNCT crl-15563 250 22 type type NOUN crl-15563 250 23 item item NOUN crl-15563 250 24 allowing allow VERB crl-15563 250 25 three three NUM crl-15563 250 26 correct correct ADJ crl-15563 250 27 options option NOUN crl-15563 250 28 ( ( PUNCT crl-15563 250 29 which which PRON crl-15563 250 30 may may AUX crl-15563 250 31 explain explain VERB crl-15563 250 32 why why SCONJ crl-15563 250 33 it it PRON crl-15563 250 34 was be AUX crl-15563 250 35 calibrated calibrate VERB crl-15563 250 36 as as ADP crl-15563 250 37 easy easy ADJ crl-15563 250 38 ): ): PUNCT crl-15563 250 39 the the DET crl-15563 250 40 item item NOUN crl-15563 250 41 itself itself PRON crl-15563 250 42 and and CCONJ crl-15563 250 43 the the DET crl-15563 250 44 way way NOUN crl-15563 250 45 it it PRON crl-15563 250 46 was be AUX crl-15563 250 47 written write VERB crl-15563 250 48 and and CCONJ crl-15563 250 49 scored score VERB crl-15563 250 50 may may AUX crl-15563 250 51 not not PART crl-15563 250 52 be be AUX crl-15563 250 53 adequate adequate ADJ crl-15563 250 54 to to PART crl-15563 250 55 test test VERB crl-15563 250 56 the the DET crl-15563 250 57 skill skill NOUN crl-15563 250 58 . . PUNCT crl-15563 251 1 at at ADP crl-15563 251 2 the the DET crl-15563 251 3 other other ADJ crl-15563 251 4 extreme extreme NOUN crl-15563 251 5 , , PUNCT crl-15563 251 6 looking look VERB crl-15563 251 7 at at ADP crl-15563 251 8 the the DET crl-15563 251 9 most most ADV crl-15563 251 10 difficult difficult ADJ crl-15563 251 11 items item NOUN crl-15563 251 12 , , PUNCT crl-15563 251 13 it it PRON crl-15563 251 14 was be AUX crl-15563 251 15 found find VERB crl-15563 251 16 that that SCONJ crl-15563 251 17 item item NOUN crl-15563 251 18 18 18 NUM crl-15563 251 19 calibrated calibrate VERB crl-15563 251 20 as as ADP crl-15563 251 21 the the DET crl-15563 251 22 most most ADV crl-15563 251 23 difficult difficult ADJ crl-15563 251 24 . . PUNCT crl-15563 252 1 this this DET crl-15563 252 2 item item NOUN crl-15563 252 3 asked ask VERB crl-15563 252 4 students student NOUN crl-15563 252 5 to to PART crl-15563 252 6 select select VERB crl-15563 252 7 which which DET crl-15563 252 8 databases database VERB crl-15563 252 9 they they PRON crl-15563 252 10 would would AUX crl-15563 252 11 search search VERB crl-15563 252 12 to to PART crl-15563 252 13 find find VERB crl-15563 252 14 information information NOUN crl-15563 252 15 on on ADP crl-15563 252 16 teenage teenage ADJ crl-15563 252 17 pregnancy pregnancy NOUN crl-15563 252 18 . . PUNCT crl-15563 253 1 it it PRON crl-15563 253 2 was be AUX crl-15563 253 3 scored score VERB crl-15563 253 4 such such ADJ crl-15563 253 5 that that SCONJ crl-15563 253 6 respondents respondent NOUN crl-15563 253 7 had have VERB crl-15563 253 8 to to PART crl-15563 253 9 mark mark VERB crl-15563 253 10 all all DET crl-15563 253 11 three three NUM crl-15563 253 12 options option NOUN crl-15563 253 13 to to PART crl-15563 253 14 get get VERB crl-15563 253 15 credit credit NOUN crl-15563 253 16 for for ADP crl-15563 253 17 responding respond VERB crl-15563 253 18 correctly correctly ADV crl-15563 253 19 . . PUNCT crl-15563 254 1 again again ADV crl-15563 254 2 , , PUNCT crl-15563 254 3 upon upon SCONJ crl-15563 254 4 careful careful ADJ crl-15563 254 5 examination examination NOUN crl-15563 254 6 , , PUNCT crl-15563 254 7 it it PRON crl-15563 254 8 was be AUX crl-15563 254 9 noticed notice VERB crl-15563 254 10 that that SCONJ crl-15563 254 11 the the DET crl-15563 254 12 item item NOUN crl-15563 254 13 itself itself PRON crl-15563 254 14 was be AUX crl-15563 254 15 not not PART crl-15563 254 16 extremely extremely ADV crl-15563 254 17 difficult difficult ADJ crl-15563 254 18 to to ADP crl-15563 254 19 the the DET crl-15563 254 20 content content NOUN crl-15563 254 21 experts expert NOUN crl-15563 254 22 or or CCONJ crl-15563 254 23 the the DET crl-15563 254 24 respondents respondent NOUN crl-15563 254 25 in in ADP crl-15563 254 26 the the DET crl-15563 254 27 earlier early ADJ crl-15563 254 28 phases phase NOUN crl-15563 254 29 of of ADP crl-15563 254 30 data data NOUN crl-15563 254 31 collection collection NOUN crl-15563 254 32 , , PUNCT crl-15563 254 33 so so SCONJ crl-15563 254 34 perhaps perhaps ADV crl-15563 254 35 the the DET crl-15563 254 36 way way NOUN crl-15563 254 37 it it PRON crl-15563 254 38 was be AUX crl-15563 254 39 scored score VERB crl-15563 254 40 made make VERB crl-15563 254 41 it it PRON crl-15563 254 42 more more ADV crl-15563 254 43 difficult difficult ADJ crl-15563 254 44 . . PUNCT crl-15563 255 1 it it PRON crl-15563 255 2 might might AUX crl-15563 255 3 be be AUX crl-15563 255 4 better well ADJ crl-15563 255 5 , , PUNCT crl-15563 255 6 and and CCONJ crl-15563 255 7 more more ADV crl-15563 255 8 accurate accurate ADJ crl-15563 255 9 , , PUNCT crl-15563 255 10 to to PART crl-15563 255 11 award award VERB crl-15563 255 12 partial partial ADJ crl-15563 255 13 credit credit NOUN crl-15563 255 14 for for ADP crl-15563 255 15 each each DET crl-15563 255 16 correct correct ADJ crl-15563 255 17 option option NOUN crl-15563 255 18 selected select VERB crl-15563 255 19 . . PUNCT crl-15563 256 1 the the DET crl-15563 256 2 next next ADJ crl-15563 256 3 most most ADV crl-15563 256 4 - - PUNCT crl-15563 256 5 difficult difficult ADJ crl-15563 256 6 item item NOUN crl-15563 256 7 was be AUX crl-15563 256 8 item item NOUN crl-15563 256 9 24 24 NUM crl-15563 256 10 , , PUNCT crl-15563 256 11 which which PRON crl-15563 256 12 asked ask VERB crl-15563 256 13 students student NOUN crl-15563 256 14 to to PART crl-15563 256 15 select select VERB crl-15563 256 16 the the DET crl-15563 256 17 optimum optimum ADJ crl-15563 256 18 search search NOUN crl-15563 256 19 strategy strategy NOUN crl-15563 256 20 to to PART crl-15563 256 21 locate locate VERB crl-15563 256 22 information information NOUN crl-15563 256 23 on on ADP crl-15563 256 24 the the DET crl-15563 256 25 use use NOUN crl-15563 256 26 of of ADP crl-15563 256 27 color color NOUN crl-15563 256 28 in in ADP crl-15563 256 29 the the DET crl-15563 256 30 famous famous ADJ crl-15563 256 31 painting painting NOUN crl-15563 256 32 the the DET crl-15563 256 33 madonna madonna NOUN crl-15563 256 34 . . PUNCT crl-15563 257 1 all all DET crl-15563 257 2 the the DET crl-15563 257 3 content content NOUN crl-15563 257 4 experts expert NOUN crl-15563 257 5 and and CCONJ crl-15563 257 6 previous previous ADJ crl-15563 257 7 phases phase NOUN crl-15563 257 8 of of ADP crl-15563 257 9 data data NOUN crl-15563 257 10 collection collection NOUN crl-15563 257 11 provided provide VERB crl-15563 257 12 evidence evidence NOUN crl-15563 257 13 that that SCONJ crl-15563 257 14 this this DET crl-15563 257 15 item item NOUN crl-15563 257 16 was be AUX crl-15563 257 17 quite quite ADV crl-15563 257 18 difficult difficult ADJ crl-15563 257 19 for for ADP crl-15563 257 20 the the DET crl-15563 257 21 respondent respondent ADJ crl-15563 257 22 population population NOUN crl-15563 257 23 , , PUNCT crl-15563 257 24 so so SCONJ crl-15563 257 25 the the DET crl-15563 257 26 authors author NOUN crl-15563 257 27 were be AUX crl-15563 257 28 confident confident ADJ crl-15563 257 29 that that SCONJ crl-15563 257 30 this this DET crl-15563 257 31 item item NOUN crl-15563 257 32 was be AUX crl-15563 257 33 calibrated calibrate VERB crl-15563 257 34 correctly correctly ADV crl-15563 257 35 . . PUNCT crl-15563 258 1 this this PRON crl-15563 258 2 is be AUX crl-15563 258 3 the the DET crl-15563 258 4 process process NOUN crl-15563 258 5 the the DET crl-15563 258 6 authors author NOUN crl-15563 258 7 followed follow VERB crl-15563 258 8 when when SCONJ crl-15563 258 9 examining examine VERB crl-15563 258 10 each each PRON crl-15563 258 11 of of ADP crl-15563 258 12 the the DET crl-15563 258 13 items item NOUN crl-15563 258 14 and and CCONJ crl-15563 258 15 their their PRON crl-15563 258 16 placement placement NOUN crl-15563 258 17 along along ADP crl-15563 258 18 the the DET crl-15563 258 19 continuum continuum PROPN crl-15563 258 20 , , PUNCT crl-15563 258 21 and and CCONJ crl-15563 258 22 some some DET crl-15563 258 23 decisions decision NOUN crl-15563 258 24 were be AUX crl-15563 258 25 made make VERB crl-15563 258 26 for for ADP crl-15563 258 27 revisions revision NOUN crl-15563 258 28 based base VERB crl-15563 258 29 on on ADP crl-15563 258 30 these these DET crl-15563 258 31 deliberations deliberation NOUN crl-15563 258 32 . . PUNCT crl-15563 259 1 3 3 X crl-15563 259 2 . . X crl-15563 259 3 do do AUX crl-15563 259 4 the the DET crl-15563 259 5 items item NOUN crl-15563 259 6 work work VERB crl-15563 259 7 together together ADV crl-15563 259 8 to to PART crl-15563 259 9 define define VERB crl-15563 259 10 a a DET crl-15563 259 11 single single ADJ crl-15563 259 12 variable variable NOUN crl-15563 259 13 ? ? PUNCT crl-15563 260 1 the the DET crl-15563 260 2 responses response NOUN crl-15563 260 3 to to ADP crl-15563 260 4 the the DET crl-15563 260 5 items item NOUN crl-15563 260 6 should should AUX crl-15563 260 7 be be AUX crl-15563 260 8 in in ADP crl-15563 260 9 general general ADJ crl-15563 260 10 agreement agreement NOUN crl-15563 260 11 with with ADP crl-15563 260 12 the the DET crl-15563 260 13 ordering ordering NOUN crl-15563 260 14 of of ADP crl-15563 260 15 persons person NOUN crl-15563 260 16 implied imply VERB crl-15563 260 17 by by ADP crl-15563 260 18 the the DET crl-15563 260 19 majority majority NOUN crl-15563 260 20 of of ADP crl-15563 260 21 items item NOUN crl-15563 260 22 . . PUNCT crl-15563 261 1 in in ADP crl-15563 261 2 other other ADJ crl-15563 261 3 words word NOUN crl-15563 261 4 , , PUNCT crl-15563 261 5 people people NOUN crl-15563 261 6 with with ADP crl-15563 261 7 higher high ADJ crl-15563 261 8 - - PUNCT crl-15563 261 9 ability ability NOUN crl-15563 261 10 level level NOUN crl-15563 261 11 should should AUX crl-15563 261 12 have have AUX crl-15563 261 13 answered answer VERB crl-15563 261 14 most most ADJ crl-15563 261 15 items item NOUN crl-15563 261 16 correctly correctly ADV crl-15563 261 17 , , PUNCT crl-15563 261 18 particularly particularly ADV crl-15563 261 19 the the DET crl-15563 261 20 easier easy ADJ crl-15563 261 21 items item NOUN crl-15563 261 22 ; ; PUNCT crl-15563 261 23 and and CCONJ crl-15563 261 24 people people NOUN crl-15563 261 25 with with ADP crl-15563 261 26 less less ADJ crl-15563 261 27 ability ability NOUN crl-15563 261 28 should should AUX crl-15563 261 29 have have AUX crl-15563 261 30 answered answer VERB crl-15563 261 31 most most ADV crl-15563 261 32 easy easy ADJ crl-15563 261 33 items item NOUN crl-15563 261 34 correctly correctly ADV crl-15563 261 35 but but CCONJ crl-15563 261 36 missed miss VERB crl-15563 261 37 more more ADJ crl-15563 261 38 of of ADP crl-15563 261 39 the the DET crl-15563 261 40 difficult difficult ADJ crl-15563 261 41 items item NOUN crl-15563 261 42 . . PUNCT crl-15563 262 1 this this PRON crl-15563 262 2 can can AUX crl-15563 262 3 be be AUX crl-15563 262 4 analyzed analyze VERB crl-15563 262 5 by by ADP crl-15563 262 6 examining examine VERB crl-15563 262 7 “ " PUNCT crl-15563 262 8 item item NOUN crl-15563 262 9 fit fit NOUN crl-15563 262 10 , , PUNCT crl-15563 262 11 ” " PUNCT crl-15563 262 12 in in ADP crl-15563 262 13 particular particular ADJ crl-15563 262 14 , , PUNCT crl-15563 262 15 the the DET crl-15563 262 16 number number NOUN crl-15563 262 17 of of ADP crl-15563 262 18 item item NOUN crl-15563 262 19 misfits misfit NOUN crl-15563 262 20 . . PUNCT crl-15563 263 1 a a DET crl-15563 263 2 lack lack NOUN crl-15563 263 3 of of ADP crl-15563 263 4 ( ( PUNCT crl-15563 263 5 or or CCONJ crl-15563 263 6 few few ADJ crl-15563 263 7 ) ) PUNCT crl-15563 263 8 item item NOUN crl-15563 263 9 misfits misfit NOUN crl-15563 263 10 indicates indicate VERB crl-15563 263 11 that that SCONJ crl-15563 263 12 the the DET crl-15563 263 13 variable variable NOUN crl-15563 263 14 can can AUX crl-15563 263 15 be be AUX crl-15563 263 16 reasonably reasonably ADV crl-15563 263 17 ordered order VERB crl-15563 263 18 from from ADP crl-15563 263 19 easy easy ADJ crl-15563 263 20 to to PART crl-15563 263 21 difficult difficult ADJ crl-15563 263 22 without without ADP crl-15563 263 23 too too ADV crl-15563 263 24 many many ADJ crl-15563 263 25 persons person NOUN crl-15563 263 26 violating violate VERB crl-15563 263 27 this this DET crl-15563 263 28 pattern pattern NOUN crl-15563 263 29 . . PUNCT crl-15563 264 1 item item PROPN crl-15563 264 2 fit fit PROPN crl-15563 264 3 is be AUX crl-15563 264 4 measured measure VERB crl-15563 264 5 in in ADP crl-15563 264 6 two two NUM crl-15563 264 7 ways way NOUN crl-15563 264 8 in in ADP crl-15563 264 9 the the DET crl-15563 264 10 rasch rasch PROPN crl-15563 264 11 model model NOUN crl-15563 264 12 . . PUNCT crl-15563 265 1 the the DET crl-15563 265 2 first first ADJ crl-15563 265 3 is be AUX crl-15563 265 4 referred refer VERB crl-15563 265 5 to to ADP crl-15563 265 6 as as ADP crl-15563 265 7 infit infit ADJ crl-15563 265 8 , , PUNCT crl-15563 265 9 which which PRON crl-15563 265 10 indicates indicate VERB crl-15563 265 11 how how SCONJ crl-15563 265 12 well well ADV crl-15563 265 13 an an DET crl-15563 265 14 item item NOUN crl-15563 265 15 works work VERB crl-15563 265 16 for for ADP crl-15563 265 17 persons person NOUN crl-15563 265 18 close close ADJ crl-15563 265 19 to to ADP crl-15563 265 20 it it PRON crl-15563 265 21 in in ADP crl-15563 265 22 ability ability NOUN crl-15563 265 23 level level NOUN crl-15563 265 24 . . PUNCT crl-15563 266 1 the the DET crl-15563 266 2 second second ADJ crl-15563 266 3 way way NOUN crl-15563 266 4 to to PART crl-15563 266 5 look look VERB crl-15563 266 6 at at ADP crl-15563 266 7 item item NOUN crl-15563 266 8 fit fit PROPN crl-15563 266 9 is be AUX crl-15563 266 10 outfit outfit ADJ crl-15563 266 11 , , PUNCT crl-15563 266 12 which which PRON crl-15563 266 13 indicates indicate VERB crl-15563 266 14 how how SCONJ crl-15563 266 15 well well ADV crl-15563 266 16 an an DET crl-15563 266 17 item item NOUN crl-15563 266 18 works work VERB crl-15563 266 19 for for ADP crl-15563 266 20 persons person NOUN crl-15563 266 21 far far ADV crl-15563 266 22 from from ADP crl-15563 266 23 it it PRON crl-15563 266 24 in in ADP crl-15563 266 25 ability ability NOUN crl-15563 266 26 level level NOUN crl-15563 266 27 . . PUNCT crl-15563 267 1 figure figure NOUN crl-15563 267 2 5 5 NUM crl-15563 267 3 illustrates illustrate VERB crl-15563 267 4 the the DET crl-15563 267 5 concepts concept NOUN crl-15563 267 6 of of ADP crl-15563 267 7 infit infit NOUN crl-15563 267 8 and and CCONJ crl-15563 267 9 outfit outfit NOUN crl-15563 267 10 . . PUNCT crl-15563 268 1 looking look VERB crl-15563 268 2 at at ADP crl-15563 268 3 item item NOUN crl-15563 268 4 3 3 NUM crl-15563 268 5 on on ADP crl-15563 268 6 the the DET crl-15563 268 7 map map NOUN crl-15563 268 8 , , PUNCT crl-15563 268 9 one one PRON crl-15563 268 10 would would AUX crl-15563 268 11 expect expect VERB crl-15563 268 12 that that SCONJ crl-15563 268 13 the the DET crl-15563 268 14 people people NOUN crl-15563 268 15 near near ADP crl-15563 268 16 that that DET crl-15563 268 17 item item NOUN crl-15563 268 18 would would AUX crl-15563 268 19 have have VERB crl-15563 268 20 a a DET crl-15563 268 21 50 50 NUM crl-15563 268 22 percent percent NOUN crl-15563 268 23 applying apply VERB crl-15563 268 24 systems system NOUN crl-15563 268 25 design design NOUN crl-15563 268 26 and and CCONJ crl-15563 268 27 item item NOUN crl-15563 268 28 response response NOUN crl-15563 268 29 theory theory NOUN crl-15563 268 30 539 539 NUM crl-15563 268 31 figure figure NOUN crl-15563 268 32 5 5 NUM crl-15563 268 33 map map NOUN crl-15563 268 34 of of ADP crl-15563 268 35 persons person NOUN crl-15563 268 36 and and CCONJ crl-15563 268 37 items item NOUN crl-15563 268 38 with with ADP crl-15563 268 39 item item NOUN crl-15563 268 40 names name NOUN crl-15563 268 41 probability probability NOUN crl-15563 268 42 of of ADP crl-15563 268 43 responding respond VERB crl-15563 268 44 correctly correctly ADV crl-15563 268 45 to to ADP crl-15563 268 46 it it PRON crl-15563 268 47 ( ( PUNCT crl-15563 268 48 infit infit VERB crl-15563 268 49 ) ) PUNCT crl-15563 268 50 . . PUNCT crl-15563 269 1 if if SCONJ crl-15563 269 2 , , PUNCT crl-15563 269 3 in in ADP crl-15563 269 4 fact fact NOUN crl-15563 269 5 , , PUNCT crl-15563 269 6 everyone everyone PRON crl-15563 269 7 responds respond VERB crl-15563 269 8 correctly correctly ADV crl-15563 269 9 or or CCONJ crl-15563 269 10 everyone everyone PRON crl-15563 269 11 misses miss VERB crl-15563 269 12 this this DET crl-15563 269 13 item item NOUN crl-15563 269 14 , , PUNCT crl-15563 269 15 the the DET crl-15563 269 16 item item NOUN crl-15563 269 17 is be AUX crl-15563 269 18 not not PART crl-15563 269 19 working work VERB crl-15563 269 20 as as SCONJ crl-15563 269 21 expected expect VERB crl-15563 269 22 . . PUNCT crl-15563 270 1 when when SCONJ crl-15563 270 2 considering consider VERB crl-15563 270 3 the the DET crl-15563 270 4 people people NOUN crl-15563 270 5 at at ADP crl-15563 270 6 the the DET crl-15563 270 7 top top NOUN crl-15563 270 8 of of ADP crl-15563 270 9 the the DET crl-15563 270 10 ability ability NOUN crl-15563 270 11 scale scale NOUN crl-15563 270 12 in in ADP crl-15563 270 13 relation relation NOUN crl-15563 270 14 to to PART crl-15563 270 15 item item NOUN crl-15563 270 16 3 3 NUM crl-15563 270 17 , , PUNCT crl-15563 270 18 one one PRON crl-15563 270 19 would would AUX crl-15563 270 20 expect expect VERB crl-15563 270 21 them they PRON crl-15563 270 22 to to PART crl-15563 270 23 answer answer VERB crl-15563 270 24 correctly correctly ADV crl-15563 270 25 ( ( PUNCT crl-15563 270 26 outfit outfit NOUN crl-15563 270 27 ) ) PUNCT crl-15563 270 28 . . PUNCT crl-15563 271 1 if if SCONJ crl-15563 271 2 they they PRON crl-15563 271 3 all all PRON crl-15563 271 4 miss miss VERB crl-15563 271 5 this this DET crl-15563 271 6 item item NOUN crl-15563 271 7 , , PUNCT crl-15563 271 8 it it PRON crl-15563 271 9 provides provide VERB crl-15563 271 10 information information NOUN crl-15563 271 11 that that SCONJ crl-15563 271 12 the the DET crl-15563 271 13 item item NOUN crl-15563 271 14 does do AUX crl-15563 271 15 not not PART crl-15563 271 16 work work VERB crl-15563 271 17 for for ADP crl-15563 271 18 higher high ADJ crl-15563 271 19 - - PUNCT crl-15563 271 20 ability ability NOUN crl-15563 271 21 people people NOUN crl-15563 271 22 . . PUNCT crl-15563 272 1 the the DET crl-15563 272 2 pilot pilot NOUN crl-15563 272 3 instrument instrument NOUN crl-15563 272 4 had have VERB crl-15563 272 5 four four NUM crl-15563 272 6 misfitting misfitting NOUN crl-15563 272 7 items item NOUN crl-15563 272 8 ( ( PUNCT crl-15563 272 9 9 9 NUM crl-15563 272 10 % % NOUN crl-15563 272 11 misfits misfit NOUN crl-15563 272 12 ) ) PUNCT crl-15563 272 13 out out ADP crl-15563 272 14 of of ADP crl-15563 272 15 the the DET crl-15563 272 16 forty forty NUM crl-15563 272 17 - - PUNCT crl-15563 272 18 six six NUM crl-15563 272 19 included include VERB crl-15563 272 20 . . PUNCT crl-15563 273 1 it it PRON crl-15563 273 2 is be AUX crl-15563 273 3 important important ADJ crl-15563 273 4 to to PART crl-15563 273 5 examine examine VERB crl-15563 273 6 the the DET crl-15563 273 7 misfits misfit NOUN crl-15563 273 8 individually individually ADV crl-15563 273 9 to to PART crl-15563 273 10 determine determine VERB crl-15563 273 11 why why SCONJ crl-15563 273 12 they they PRON crl-15563 273 13 are be AUX crl-15563 273 14 occurring occur VERB crl-15563 273 15 . . PUNCT crl-15563 274 1 the the DET crl-15563 274 2 authors author NOUN crl-15563 274 3 considered consider VERB crl-15563 274 4 the the DET crl-15563 274 5 wording wording NOUN crl-15563 274 6 of of ADP crl-15563 274 7 the the DET crl-15563 274 8 items item NOUN crl-15563 274 9 and and CCONJ crl-15563 274 10 the the DET crl-15563 274 11 response response NOUN crl-15563 274 12 options option NOUN crl-15563 274 13 to to PART crl-15563 274 14 determine determine VERB crl-15563 274 15 whether whether SCONJ crl-15563 274 16 there there PRON crl-15563 274 17 was be VERB crl-15563 274 18 anything anything PRON crl-15563 274 19 tricky tricky ADJ crl-15563 274 20 or or CCONJ crl-15563 274 21 misleading misleading ADJ crl-15563 274 22 . . PUNCT crl-15563 275 1 the the DET crl-15563 275 2 frequencies frequency NOUN crl-15563 275 3 of of ADP crl-15563 275 4 responses response NOUN crl-15563 275 5 across across ADP crl-15563 275 6 options option NOUN crl-15563 275 7 also also ADV crl-15563 275 8 were be AUX crl-15563 275 9 examined examine VERB crl-15563 275 10 to to PART crl-15563 275 11 determine determine VERB crl-15563 275 12 whether whether SCONJ crl-15563 275 13 540 540 NUM crl-15563 275 14 college college NOUN crl-15563 275 15 & & CCONJ crl-15563 275 16 research research PROPN crl-15563 275 17 libraries library NOUN crl-15563 275 18 november november PROPN crl-15563 275 19 2002 2002 NUM crl-15563 275 20 some some PRON crl-15563 275 21 of of ADP crl-15563 275 22 the the DET crl-15563 275 23 incorrect incorrect ADJ crl-15563 275 24 options option NOUN crl-15563 275 25 were be AUX crl-15563 275 26 too too ADV crl-15563 275 27 attractive attractive ADJ crl-15563 275 28 to to ADP crl-15563 275 29 respondents respondent NOUN crl-15563 275 30 . . PUNCT crl-15563 276 1 an an DET crl-15563 276 2 example example NOUN crl-15563 276 3 of of ADP crl-15563 276 4 this this PRON crl-15563 276 5 was be AUX crl-15563 276 6 item item NOUN crl-15563 276 7 16 16 NUM crl-15563 276 8 , , PUNCT crl-15563 276 9 which which PRON crl-15563 276 10 asked ask VERB crl-15563 276 11 respondents respondent NOUN crl-15563 276 12 why why SCONJ crl-15563 276 13 searching search VERB crl-15563 276 14 a a DET crl-15563 276 15 database database NOUN crl-15563 276 16 using use VERB crl-15563 276 17 the the DET crl-15563 276 18 term term NOUN crl-15563 276 19 “ " PUNCT crl-15563 276 20 skin skin NOUN crl-15563 276 21 cancer cancer NOUN crl-15563 276 22 ” " PUNCT crl-15563 276 23 would would AUX crl-15563 276 24 retrieve retrieve VERB crl-15563 276 25 an an DET crl-15563 276 26 article article NOUN crl-15563 276 27 with with ADP crl-15563 276 28 the the DET crl-15563 276 29 word word NOUN crl-15563 276 30 “ " PUNCT crl-15563 276 31 melanoma melanoma PROPN crl-15563 276 32 ” " PUNCT crl-15563 276 33 in in ADP crl-15563 276 34 the the DET crl-15563 276 35 title title NOUN crl-15563 276 36 . . PUNCT crl-15563 277 1 one one NUM crl-15563 277 2 of of ADP crl-15563 277 3 the the DET crl-15563 277 4 incorrect incorrect ADJ crl-15563 277 5 response response NOUN crl-15563 277 6 options option NOUN crl-15563 277 7 was be AUX crl-15563 277 8 “ " PUNCT crl-15563 277 9 relevancy relevancy NOUN crl-15563 277 10 ranking ranking NOUN crl-15563 277 11 , , PUNCT crl-15563 277 12 ” " PUNCT crl-15563 277 13 which which PRON crl-15563 277 14 proved prove VERB crl-15563 277 15 to to PART crl-15563 277 16 be be AUX crl-15563 277 17 very very ADV crl-15563 277 18 attractive attractive ADJ crl-15563 277 19 , , PUNCT crl-15563 277 20 even even ADV crl-15563 277 21 to to ADP crl-15563 277 22 higher high ADJ crl-15563 277 23 - - PUNCT crl-15563 277 24 ability ability NOUN crl-15563 277 25 subjects subject NOUN crl-15563 277 26 , , PUNCT crl-15563 277 27 throughout throughout ADP crl-15563 277 28 each each DET crl-15563 277 29 phase phase NOUN crl-15563 277 30 of of ADP crl-15563 277 31 instrument instrument NOUN crl-15563 277 32 development development NOUN crl-15563 277 33 . . PUNCT crl-15563 278 1 the the DET crl-15563 278 2 next next ADJ crl-15563 278 3 three three NUM crl-15563 278 4 criteria criterion NOUN crl-15563 278 5 dealt deal VERB crl-15563 278 6 more more ADV crl-15563 278 7 closely closely ADV crl-15563 278 8 with with ADP crl-15563 278 9 the the DET crl-15563 278 10 adequate adequate ADJ crl-15563 278 11 measurement measurement NOUN crl-15563 278 12 of of ADP crl-15563 278 13 persons person NOUN crl-15563 278 14 using use VERB crl-15563 278 15 the the DET crl-15563 278 16 information information NOUN crl-15563 278 17 literacy literacy NOUN crl-15563 278 18 pilot pilot NOUN crl-15563 278 19 instrument instrument NOUN crl-15563 278 20 . . PUNCT crl-15563 279 1 the the DET crl-15563 279 2 authors author NOUN crl-15563 279 3 are be AUX crl-15563 279 4 doing do VERB crl-15563 279 5 additional additional ADJ crl-15563 279 6 work work NOUN crl-15563 279 7 to to PART crl-15563 279 8 analyze analyze VERB crl-15563 279 9 the the DET crl-15563 279 10 results result NOUN crl-15563 279 11 in in ADP crl-15563 279 12 relation relation NOUN crl-15563 279 13 to to ADP crl-15563 279 14 the the DET crl-15563 279 15 person person NOUN crl-15563 279 16 measures measure NOUN crl-15563 279 17 ; ; PUNCT crl-15563 279 18 this this DET crl-15563 279 19 effort effort NOUN crl-15563 279 20 will will AUX crl-15563 279 21 guide guide VERB crl-15563 279 22 further further ADJ crl-15563 279 23 refinement refinement NOUN crl-15563 279 24 of of ADP crl-15563 279 25 the the DET crl-15563 279 26 instrument instrument NOUN crl-15563 279 27 . . PUNCT crl-15563 280 1 4 4 X crl-15563 280 2 . . X crl-15563 280 3 are be AUX crl-15563 280 4 persons person NOUN crl-15563 280 5 adequately adequately ADV crl-15563 280 6 separated separate VERB crl-15563 280 7 along along ADP crl-15563 280 8 the the DET crl-15563 280 9 line line NOUN crl-15563 280 10 defined define VERB crl-15563 280 11 by by ADP crl-15563 280 12 the the DET crl-15563 280 13 items item NOUN crl-15563 280 14 ? ? PUNCT crl-15563 281 1 it it PRON crl-15563 281 2 should should AUX crl-15563 281 3 be be AUX crl-15563 281 4 possible possible ADJ crl-15563 281 5 to to PART crl-15563 281 6 separate separate ADJ crl-15563 281 7 persons person NOUN crl-15563 281 8 measured measure VERB crl-15563 281 9 into into ADP crl-15563 281 10 distinct distinct ADJ crl-15563 281 11 levels level NOUN crl-15563 281 12 of of ADP crl-15563 281 13 ability ability NOUN crl-15563 281 14 in in ADP crl-15563 281 15 information information NOUN crl-15563 281 16 literacy literacy NOUN crl-15563 281 17 . . PUNCT crl-15563 282 1 the the DET crl-15563 282 2 measure measure NOUN crl-15563 282 3 of of ADP crl-15563 282 4 person person NOUN crl-15563 282 5 separation separation NOUN crl-15563 282 6 reliability reliability NOUN crl-15563 282 7 will will AUX crl-15563 282 8 provide provide VERB crl-15563 282 9 an an DET crl-15563 282 10 indication indication NOUN crl-15563 282 11 of of ADP crl-15563 282 12 whether whether SCONJ crl-15563 282 13 this this PRON crl-15563 282 14 has have AUX crl-15563 282 15 been be AUX crl-15563 282 16 achieved achieve VERB crl-15563 282 17 . . PUNCT crl-15563 283 1 person person NOUN crl-15563 283 2 separation separation NOUN crl-15563 283 3 reliability reliability NOUN crl-15563 283 4 is be AUX crl-15563 283 5 an an DET crl-15563 283 6 estimate estimate NOUN crl-15563 283 7 of of ADP crl-15563 283 8 how how SCONJ crl-15563 283 9 well well ADJ crl-15563 283 10 persons person NOUN crl-15563 283 11 can can AUX crl-15563 283 12 be be AUX crl-15563 283 13 differentiated differentiate VERB crl-15563 283 14 on on ADP crl-15563 283 15 information information NOUN crl-15563 283 16 literacy literacy NOUN crl-15563 283 17 . . PUNCT crl-15563 284 1 its its PRON crl-15563 284 2 values value NOUN crl-15563 284 3 are be AUX crl-15563 284 4 analogous analogous ADJ crl-15563 284 5 to to PART crl-15563 284 6 cronbach cronbach VERB crl-15563 284 7 ’s ’s DET crl-15563 284 8 alpha alpha NOUN crl-15563 284 9 , , PUNCT crl-15563 284 10 with with ADP crl-15563 284 11 values value NOUN crl-15563 284 12 ranging range VERB crl-15563 284 13 from from ADP crl-15563 284 14 0 0 NUM crl-15563 284 15 to to ADP crl-15563 284 16 1 1 NUM crl-15563 284 17 . . PUNCT crl-15563 285 1 the the DET crl-15563 285 2 person person NOUN crl-15563 285 3 separation separation NOUN crl-15563 285 4 reliability reliability NOUN crl-15563 285 5 for for ADP crl-15563 285 6 this this DET crl-15563 285 7 pilot pilot NOUN crl-15563 285 8 data data NOUN crl-15563 285 9 collection collection NOUN crl-15563 285 10 was be AUX crl-15563 285 11 .64 .64 NUM crl-15563 285 12 , , PUNCT crl-15563 285 13 indicating indicate VERB crl-15563 285 14 a a DET crl-15563 285 15 moderate moderate ADJ crl-15563 285 16 level level NOUN crl-15563 285 17 of of ADP crl-15563 285 18 confidence confidence NOUN crl-15563 285 19 in in ADP crl-15563 285 20 the the DET crl-15563 285 21 ability ability NOUN crl-15563 285 22 to to PART crl-15563 285 23 separate separate VERB crl-15563 285 24 students student NOUN crl-15563 285 25 into into ADP crl-15563 285 26 levels level NOUN crl-15563 285 27 of of ADP crl-15563 285 28 information information NOUN crl-15563 285 29 literacy literacy NOUN crl-15563 285 30 . . PUNCT crl-15563 286 1 5 5 X crl-15563 286 2 . . X crl-15563 286 3 do do AUX crl-15563 286 4 individual individual ADJ crl-15563 286 5 placements placement NOUN crl-15563 286 6 along along ADP crl-15563 286 7 the the DET crl-15563 286 8 variable variable ADJ crl-15563 286 9 make make VERB crl-15563 286 10 sense sense NOUN crl-15563 286 11 ? ? PUNCT crl-15563 287 1 this this PRON crl-15563 287 2 can can AUX crl-15563 287 3 be be AUX crl-15563 287 4 judged judge VERB crl-15563 287 5 based base VERB crl-15563 287 6 on on ADP crl-15563 287 7 other other ADJ crl-15563 287 8 information information NOUN crl-15563 287 9 available available ADJ crl-15563 287 10 about about ADP crl-15563 287 11 the the DET crl-15563 287 12 persons person NOUN crl-15563 287 13 being be AUX crl-15563 287 14 tested test VERB crl-15563 287 15 . . PUNCT crl-15563 288 1 a a DET crl-15563 288 2 comparison comparison NOUN crl-15563 288 3 of of ADP crl-15563 288 4 the the DET crl-15563 288 5 position position NOUN crl-15563 288 6 of of ADP crl-15563 288 7 subjects subject NOUN crl-15563 288 8 with with ADP crl-15563 288 9 higher high ADJ crl-15563 288 10 act act NOUN crl-15563 288 11 scores score NOUN crl-15563 288 12 or or CCONJ crl-15563 288 13 higher high ADJ crl-15563 288 14 ksu ksu PROPN crl-15563 288 15 cumulative cumulative ADJ crl-15563 288 16 gpas gpas PROPN crl-15563 288 17 against against ADP crl-15563 288 18 those those PRON crl-15563 288 19 with with ADP crl-15563 288 20 lower low ADJ crl-15563 288 21 act act NOUN crl-15563 288 22 scores score NOUN crl-15563 288 23 or or CCONJ crl-15563 288 24 gpas gpa NOUN crl-15563 288 25 would would AUX crl-15563 288 26 give give VERB crl-15563 288 27 an an DET crl-15563 288 28 indication indication NOUN crl-15563 288 29 of of ADP crl-15563 288 30 the the DET crl-15563 288 31 reasonableness reasonableness NOUN crl-15563 288 32 of of ADP crl-15563 288 33 the the DET crl-15563 288 34 placements placement NOUN crl-15563 288 35 along along ADP crl-15563 288 36 this this DET crl-15563 288 37 line line NOUN crl-15563 288 38 . . PUNCT crl-15563 289 1 act act PROPN crl-15563 289 2 scores score NOUN crl-15563 289 3 generally generally ADV crl-15563 289 4 are be AUX crl-15563 289 5 more more ADV crl-15563 289 6 attractive attractive ADJ crl-15563 289 7 for for ADP crl-15563 289 8 this this DET crl-15563 289 9 purpose purpose NOUN crl-15563 289 10 because because SCONJ crl-15563 289 11 of of ADP crl-15563 289 12 the the DET crl-15563 289 13 standardized standardized ADJ crl-15563 289 14 nature nature NOUN crl-15563 289 15 of of ADP crl-15563 289 16 the the DET crl-15563 289 17 scores score NOUN crl-15563 289 18 . . PUNCT crl-15563 290 1 gpas gpa NOUN crl-15563 290 2 are be AUX crl-15563 290 3 more more ADV crl-15563 290 4 variable variable ADJ crl-15563 290 5 depending depend VERB crl-15563 290 6 on on ADP crl-15563 290 7 the the DET crl-15563 290 8 level level NOUN crl-15563 290 9 of of ADP crl-15563 290 10 courses course NOUN crl-15563 290 11 and and CCONJ crl-15563 290 12 subject subject NOUN crl-15563 290 13 matter matter NOUN crl-15563 290 14 . . PUNCT crl-15563 291 1 this this DET crl-15563 291 2 question question NOUN crl-15563 291 3 was be AUX crl-15563 291 4 addressed address VERB crl-15563 291 5 by by ADP crl-15563 291 6 looking look VERB crl-15563 291 7 at at ADP crl-15563 291 8 the the DET crl-15563 291 9 398 398 NUM crl-15563 291 10 respondents respondent NOUN crl-15563 291 11 who who PRON crl-15563 291 12 provided provide VERB crl-15563 291 13 valid valid ADJ crl-15563 291 14 student student NOUN crl-15563 291 15 i i NOUN crl-15563 291 16 d d PROPN crl-15563 291 17 numbers number NOUN crl-15563 291 18 , , PUNCT crl-15563 291 19 allowing allow VERB crl-15563 291 20 the the DET crl-15563 291 21 authors author NOUN crl-15563 291 22 to to PART crl-15563 291 23 obtain obtain VERB crl-15563 291 24 additional additional ADJ crl-15563 291 25 data datum NOUN crl-15563 291 26 from from ADP crl-15563 291 27 the the DET crl-15563 291 28 university university NOUN crl-15563 291 29 ’s ’s PART crl-15563 291 30 student student NOUN crl-15563 291 31 information information NOUN crl-15563 291 32 system system NOUN crl-15563 291 33 . . PUNCT crl-15563 292 1 correlations correlation NOUN crl-15563 292 2 were be AUX crl-15563 292 3 computed compute VERB crl-15563 292 4 between between ADP crl-15563 292 5 the the DET crl-15563 292 6 rasch rasch NOUN crl-15563 292 7 person person NOUN crl-15563 292 8 measures measure NOUN crl-15563 292 9 and and CCONJ crl-15563 292 10 act act VERB crl-15563 292 11 scores score NOUN crl-15563 292 12 and and CCONJ crl-15563 292 13 the the DET crl-15563 292 14 rasch rasch NOUN crl-15563 292 15 person person NOUN crl-15563 292 16 measures measure NOUN crl-15563 292 17 and and CCONJ crl-15563 292 18 ksu ksu PROPN crl-15563 292 19 cumulative cumulative ADJ crl-15563 292 20 gpas gpas PROPN crl-15563 292 21 . . PUNCT crl-15563 293 1 a a DET crl-15563 293 2 small small ADJ crl-15563 293 3 correlation correlation NOUN crl-15563 293 4 ( ( PUNCT crl-15563 293 5 .263 .263 NUM crl-15563 293 6 ) ) PUNCT crl-15563 293 7 was be AUX crl-15563 293 8 found find VERB crl-15563 293 9 between between ADP crl-15563 293 10 the the DET crl-15563 293 11 rasch rasch NOUN crl-15563 293 12 measures measure NOUN crl-15563 293 13 and and CCONJ crl-15563 293 14 the the DET crl-15563 293 15 ksu ksu PROPN crl-15563 293 16 gpas gpas PROPN crl-15563 293 17 . . PUNCT crl-15563 294 1 a a DET crl-15563 294 2 moderate moderate ADJ crl-15563 294 3 correlation correlation NOUN crl-15563 294 4 ( ( PUNCT crl-15563 294 5 .482 .482 NUM crl-15563 294 6 ) ) PUNCT crl-15563 294 7 was be AUX crl-15563 294 8 found find VERB crl-15563 294 9 between between ADP crl-15563 294 10 the the DET crl-15563 294 11 rasch rasch NOUN crl-15563 294 12 measures measure NOUN crl-15563 294 13 and and CCONJ crl-15563 294 14 the the DET crl-15563 294 15 act act NOUN crl-15563 294 16 scores score VERB crl-15563 294 17 . . PUNCT crl-15563 295 1 this this DET crl-15563 295 2 moderate moderate ADJ crl-15563 295 3 correlation correlation NOUN crl-15563 295 4 provides provide VERB crl-15563 295 5 some some DET crl-15563 295 6 indication indication NOUN crl-15563 295 7 that that SCONJ crl-15563 295 8 the the DET crl-15563 295 9 information information NOUN crl-15563 295 10 literacy literacy NOUN crl-15563 295 11 instrument instrument NOUN crl-15563 295 12 is be AUX crl-15563 295 13 adequately adequately ADV crl-15563 295 14 measuring measure VERB crl-15563 295 15 students student NOUN crl-15563 295 16 with with ADP crl-15563 295 17 different different ADJ crl-15563 295 18 ability ability NOUN crl-15563 295 19 levels level NOUN crl-15563 295 20 . . PUNCT crl-15563 296 1 6 6 X crl-15563 296 2 . . X crl-15563 296 3 how how SCONJ crl-15563 296 4 valid valid ADJ crl-15563 296 5 is be AUX crl-15563 296 6 each each DET crl-15563 296 7 person person NOUN crl-15563 296 8 ’s ’s PART crl-15563 296 9 measure measure NOUN crl-15563 296 10 ? ? PUNCT crl-15563 297 1 each each DET crl-15563 297 2 person person NOUN crl-15563 297 3 ’s ’s PART crl-15563 297 4 responses response NOUN crl-15563 297 5 can can AUX crl-15563 297 6 be be AUX crl-15563 297 7 examined examine VERB crl-15563 297 8 for for ADP crl-15563 297 9 consistency consistency NOUN crl-15563 297 10 . . PUNCT crl-15563 298 1 the the DET crl-15563 298 2 order order NOUN crl-15563 298 3 of of ADP crl-15563 298 4 the the DET crl-15563 298 5 item item NOUN crl-15563 298 6 difficulties difficulty NOUN crl-15563 298 7 should should AUX crl-15563 298 8 be be AUX crl-15563 298 9 similar similar ADJ crl-15563 298 10 for for ADP crl-15563 298 11 everyone everyone PRON crl-15563 298 12 . . PUNCT crl-15563 299 1 if if SCONJ crl-15563 299 2 there there PRON crl-15563 299 3 are be VERB crl-15563 299 4 wide wide ADJ crl-15563 299 5 discrepancies discrepancy NOUN crl-15563 299 6 , , PUNCT crl-15563 299 7 the the DET crl-15563 299 8 validity validity NOUN crl-15563 299 9 of of ADP crl-15563 299 10 that that DET crl-15563 299 11 person person NOUN crl-15563 299 12 ’s ’s PART crl-15563 299 13 measure measure NOUN crl-15563 299 14 is be AUX crl-15563 299 15 suspect suspect ADJ crl-15563 299 16 . . PUNCT crl-15563 300 1 the the DET crl-15563 300 2 measure measure NOUN crl-15563 300 3 used use VERB crl-15563 300 4 to to PART crl-15563 300 5 determine determine VERB crl-15563 300 6 this this PRON crl-15563 300 7 is be AUX crl-15563 300 8 person person NOUN crl-15563 300 9 fit fit ADJ crl-15563 300 10 . . PUNCT crl-15563 301 1 person person NOUN crl-15563 301 2 misfit misfit PROPN crl-15563 301 3 is be AUX crl-15563 301 4 determined determine VERB crl-15563 301 5 by by ADP crl-15563 301 6 infit infit NOUN crl-15563 301 7 and and CCONJ crl-15563 301 8 outfit outfit NOUN crl-15563 301 9 , , PUNCT crl-15563 301 10 similarly similarly ADV crl-15563 301 11 to to PART crl-15563 301 12 item item VERB crl-15563 301 13 misfit misfit NOUN crl-15563 301 14 . . PUNCT crl-15563 302 1 there there PRON crl-15563 302 2 were be VERB crl-15563 302 3 44 44 NUM crl-15563 302 4 misfitting misfitting NOUN crl-15563 302 5 persons person NOUN crl-15563 302 6 out out ADP crl-15563 302 7 of of ADP crl-15563 302 8 537 537 NUM crl-15563 302 9 ( ( PUNCT crl-15563 302 10 8.2 8.2 NUM crl-15563 302 11 % % NOUN crl-15563 302 12 ) ) PUNCT crl-15563 302 13 . . PUNCT crl-15563 303 1 misfitting misfit VERB crl-15563 303 2 persons person NOUN crl-15563 303 3 ’ ' PUNCT crl-15563 303 4 responses response NOUN crl-15563 303 5 were be AUX crl-15563 303 6 examined examine VERB crl-15563 303 7 individually individually ADV crl-15563 303 8 to to PART crl-15563 303 9 determine determine VERB crl-15563 303 10 why why SCONJ crl-15563 303 11 the the DET crl-15563 303 12 instrument instrument NOUN crl-15563 303 13 was be AUX crl-15563 303 14 not not PART crl-15563 303 15 working work VERB crl-15563 303 16 for for ADP crl-15563 303 17 them they PRON crl-15563 303 18 . . PUNCT crl-15563 304 1 several several ADJ crl-15563 304 2 aspects aspect NOUN crl-15563 304 3 of of ADP crl-15563 304 4 their their PRON crl-15563 304 5 responses response NOUN crl-15563 304 6 were be AUX crl-15563 304 7 considered consider VERB crl-15563 304 8 , , PUNCT crl-15563 304 9 including include VERB crl-15563 304 10 any any DET crl-15563 304 11 patterns pattern NOUN crl-15563 304 12 ( ( PUNCT crl-15563 304 13 selecting select VERB crl-15563 304 14 the the DET crl-15563 304 15 first first ADJ crl-15563 304 16 option option NOUN crl-15563 304 17 on on ADP crl-15563 304 18 the the DET crl-15563 304 19 first first ADJ crl-15563 304 20 page page NOUN crl-15563 304 21 , , PUNCT crl-15563 304 22 the the DET crl-15563 304 23 second second ADJ crl-15563 304 24 option option NOUN crl-15563 304 25 on on ADP crl-15563 304 26 the the DET crl-15563 304 27 second second ADJ crl-15563 304 28 page page NOUN crl-15563 304 29 , , PUNCT crl-15563 304 30 etc etc X crl-15563 304 31 . . X crl-15563 304 32 ) ) PUNCT crl-15563 304 33 , , PUNCT crl-15563 304 34 use use NOUN crl-15563 304 35 of of ADP crl-15563 304 36 extreme extreme ADJ crl-15563 304 37 categories category NOUN crl-15563 304 38 ( ( PUNCT crl-15563 304 39 marking mark VERB crl-15563 304 40 all all DET crl-15563 304 41 ones one NOUN crl-15563 304 42 or or CCONJ crl-15563 304 43 sixes six NOUN crl-15563 304 44 ) ) PUNCT crl-15563 304 45 , , PUNCT crl-15563 304 46 the the DET crl-15563 304 47 number number NOUN crl-15563 304 48 of of ADP crl-15563 304 49 items item NOUN crl-15563 304 50 to to PART crl-15563 304 51 which which PRON crl-15563 304 52 the the DET crl-15563 304 53 individual individual NOUN crl-15563 304 54 responded respond VERB crl-15563 304 55 ( ( PUNCT crl-15563 304 56 if if SCONJ crl-15563 304 57 less less ADJ crl-15563 304 58 than than ADP crl-15563 304 59 half half NOUN crl-15563 304 60 were be AUX crl-15563 304 61 answered answer VERB crl-15563 304 62 , , PUNCT crl-15563 304 63 there there PRON crl-15563 304 64 may may AUX crl-15563 304 65 not not PART crl-15563 304 66 be be AUX crl-15563 304 67 enough enough ADJ crl-15563 304 68 information information NOUN crl-15563 304 69 to to PART crl-15563 304 70 accurately accurately ADV crl-15563 304 71 measure measure VERB crl-15563 304 72 the the DET crl-15563 304 73 person person NOUN crl-15563 304 74 ) ) PUNCT crl-15563 304 75 , , PUNCT crl-15563 304 76 and and CCONJ crl-15563 304 77 specific specific ADJ crl-15563 304 78 items item NOUN crl-15563 304 79 causing cause VERB crl-15563 304 80 problems problem NOUN crl-15563 304 81 for for ADP crl-15563 304 82 many many ADJ crl-15563 304 83 of of ADP crl-15563 304 84 the the DET crl-15563 304 85 misfitting misfitting NOUN crl-15563 304 86 persons person NOUN crl-15563 304 87 . . PUNCT crl-15563 305 1 there there PRON crl-15563 305 2 were be VERB crl-15563 305 3 no no DET crl-15563 305 4 apparent apparent ADJ crl-15563 305 5 patterns pattern NOUN crl-15563 305 6 to to ADP crl-15563 305 7 the the DET crl-15563 305 8 responses response NOUN crl-15563 305 9 of of ADP crl-15563 305 10 misfitting misfit VERB crl-15563 305 11 persons person NOUN crl-15563 305 12 . . PUNCT crl-15563 306 1 the the DET crl-15563 306 2 data datum NOUN crl-15563 306 3 analysis analysis NOUN crl-15563 306 4 centered center VERB crl-15563 306 5 on on ADP crl-15563 306 6 addressing address VERB crl-15563 306 7 the the DET crl-15563 306 8 six six NUM crl-15563 306 9 accepted accept VERB crl-15563 306 10 criteria criterion NOUN crl-15563 306 11 for for ADP crl-15563 306 12 adequate adequate ADJ crl-15563 306 13 measurement measurement NOUN crl-15563 306 14 of of ADP crl-15563 306 15 information information NOUN crl-15563 306 16 literacy literacy NOUN crl-15563 306 17 using use VERB crl-15563 306 18 the the DET crl-15563 306 19 rasch rasch PROPN crl-15563 306 20 model model NOUN crl-15563 306 21 of of ADP crl-15563 306 22 item item NOUN crl-15563 306 23 response response NOUN crl-15563 306 24 theory theory NOUN crl-15563 306 25 . . PUNCT crl-15563 307 1 the the DET crl-15563 307 2 analysis analysis NOUN crl-15563 307 3 showed show VERB crl-15563 307 4 that that SCONJ crl-15563 307 5 most most ADJ crl-15563 307 6 items item NOUN crl-15563 307 7 developed develop VERB crl-15563 307 8 to to ADP crl-15563 307 9 date date NOUN crl-15563 307 10 were be AUX crl-15563 307 11 reliable reliable ADJ crl-15563 307 12 and and CCONJ crl-15563 307 13 valid valid ADJ crl-15563 307 14 and and CCONJ crl-15563 307 15 that that SCONJ crl-15563 307 16 the the DET crl-15563 307 17 items item NOUN crl-15563 307 18 worked work VERB crl-15563 307 19 together together ADV crl-15563 307 20 to to PART crl-15563 307 21 measure measure VERB crl-15563 307 22 at at ADP crl-15563 307 23 least least ADJ crl-15563 307 24 some some DET crl-15563 307 25 portion portion NOUN crl-15563 307 26 of of ADP crl-15563 307 27 the the DET crl-15563 307 28 trait trait NOUN crl-15563 307 29 of of ADP crl-15563 307 30 information information NOUN crl-15563 307 31 literacy literacy NOUN crl-15563 307 32 . . PUNCT crl-15563 308 1 after after SCONJ crl-15563 308 2 items item NOUN crl-15563 308 3 have have AUX crl-15563 308 4 been be AUX crl-15563 308 5 developed develop VERB crl-15563 308 6 and and CCONJ crl-15563 308 7 validated validate VERB crl-15563 308 8 for for ADP crl-15563 308 9 all all DET crl-15563 308 10 learning learn VERB crl-15563 308 11 outcomes outcome NOUN crl-15563 308 12 , , PUNCT crl-15563 308 13 the the DET crl-15563 308 14 authors author NOUN crl-15563 308 15 will will AUX crl-15563 308 16 be be AUX crl-15563 308 17 able able ADJ crl-15563 308 18 to to PART crl-15563 308 19 assert assert VERB crl-15563 308 20 that that SCONJ crl-15563 308 21 they they PRON crl-15563 308 22 can can AUX crl-15563 308 23 measure measure VERB crl-15563 308 24 the the DET crl-15563 308 25 applying apply VERB crl-15563 308 26 systems system NOUN crl-15563 308 27 design design NOUN crl-15563 308 28 and and CCONJ crl-15563 308 29 item item NOUN crl-15563 308 30 response response NOUN crl-15563 308 31 theory theory NOUN crl-15563 308 32 541 541 NUM crl-15563 308 33 trait trait NOUN crl-15563 308 34 to to ADP crl-15563 308 35 the the DET crl-15563 308 36 extent extent NOUN crl-15563 308 37 that that SCONJ crl-15563 308 38 it it PRON crl-15563 308 39 can can AUX crl-15563 308 40 be be AUX crl-15563 308 41 measured measure VERB crl-15563 308 42 by by ADP crl-15563 308 43 a a DET crl-15563 308 44 standardized standardized ADJ crl-15563 308 45 multiple multiple ADJ crl-15563 308 46 - - PUNCT crl-15563 308 47 choice choice NOUN crl-15563 308 48 test test NOUN crl-15563 308 49 format format NOUN crl-15563 308 50 . . PUNCT crl-15563 309 1 similar similar ADJ crl-15563 309 2 analyses analysis NOUN crl-15563 309 3 will will AUX crl-15563 309 4 be be AUX crl-15563 309 5 conducted conduct VERB crl-15563 309 6 as as SCONJ crl-15563 309 7 new new ADJ crl-15563 309 8 items item NOUN crl-15563 309 9 are be AUX crl-15563 309 10 developed develop VERB crl-15563 309 11 and and CCONJ crl-15563 309 12 during during ADP crl-15563 309 13 new new ADJ crl-15563 309 14 rounds round NOUN crl-15563 309 15 of of ADP crl-15563 309 16 data data NOUN crl-15563 309 17 collection collection NOUN crl-15563 309 18 through through ADP crl-15563 309 19 field field NOUN crl-15563 309 20 trials trial NOUN crl-15563 309 21 . . PUNCT crl-15563 310 1 current current ADJ crl-15563 310 2 phase phase NOUN crl-15563 310 3 of of ADP crl-15563 310 4 project project NOUN crl-15563 310 5 as as ADP crl-15563 310 6 of of ADP crl-15563 310 7 the the DET crl-15563 310 8 time time NOUN crl-15563 310 9 of of ADP crl-15563 310 10 this this DET crl-15563 310 11 writing writing NOUN crl-15563 310 12 ( ( PUNCT crl-15563 310 13 march march PROPN crl-15563 310 14 2002 2002 NUM crl-15563 310 15 ) ) PUNCT crl-15563 310 16 and and CCONJ crl-15563 310 17 since since SCONJ crl-15563 310 18 the the DET crl-15563 310 19 last last ADJ crl-15563 310 20 round round NOUN crl-15563 310 21 of of ADP crl-15563 310 22 trials trial NOUN crl-15563 310 23 , , PUNCT crl-15563 310 24 the the DET crl-15563 310 25 authors author NOUN crl-15563 310 26 have have AUX crl-15563 310 27 revised revise VERB crl-15563 310 28 the the DET crl-15563 310 29 problem problem NOUN crl-15563 310 30 items item NOUN crl-15563 310 31 . . PUNCT crl-15563 311 1 they they PRON crl-15563 311 2 also also ADV crl-15563 311 3 have have AUX crl-15563 311 4 created create VERB crl-15563 311 5 forty forty NUM crl-15563 311 6 - - PUNCT crl-15563 311 7 six six NUM crl-15563 311 8 additional additional ADJ crl-15563 311 9 items item NOUN crl-15563 311 10 , , PUNCT crl-15563 311 11 covering cover VERB crl-15563 311 12 approximately approximately ADV crl-15563 311 13 70 70 NUM crl-15563 311 14 percent percent NOUN crl-15563 311 15 of of ADP crl-15563 311 16 the the DET crl-15563 311 17 unique unique ADJ crl-15563 311 18 learning learning NOUN crl-15563 311 19 outcomes outcome NOUN crl-15563 311 20 deemed deem VERB crl-15563 311 21 testable testable ADJ crl-15563 311 22 . . PUNCT crl-15563 312 1 both both CCONJ crl-15563 312 2 the the DET crl-15563 312 3 revised revised ADJ crl-15563 312 4 and and CCONJ crl-15563 312 5 the the DET crl-15563 312 6 newly newly ADV crl-15563 312 7 created create VERB crl-15563 312 8 items item NOUN crl-15563 312 9 have have AUX crl-15563 312 10 been be AUX crl-15563 312 11 tested test VERB crl-15563 312 12 in in ADP crl-15563 312 13 one one NUM crl-15563 312 14 - - PUNCT crl-15563 312 15 onone onone NOUN crl-15563 312 16 and and CCONJ crl-15563 312 17 small small ADJ crl-15563 312 18 group group NOUN crl-15563 312 19 trials trial NOUN crl-15563 312 20 . . PUNCT crl-15563 313 1 the the DET crl-15563 313 2 instrument instrument NOUN crl-15563 313 3 has have AUX crl-15563 313 4 been be AUX crl-15563 313 5 converted convert VERB crl-15563 313 6 from from ADP crl-15563 313 7 a a DET crl-15563 313 8 paper paper NOUN crl-15563 313 9 - - PUNCT crl-15563 313 10 and and CCONJ crl-15563 313 11 - - PUNCT crl-15563 313 12 pencil pencil NOUN crl-15563 313 13 format format NOUN crl-15563 313 14 to to ADP crl-15563 313 15 a a DET crl-15563 313 16 web web NOUN crl-15563 313 17 - - PUNCT crl-15563 313 18 based base VERB crl-15563 313 19 format format NOUN crl-15563 313 20 . . PUNCT crl-15563 314 1 the the DET crl-15563 314 2 web web NOUN crl-15563 314 3 format format NOUN crl-15563 314 4 offers offer VERB crl-15563 314 5 advantages advantage NOUN crl-15563 314 6 over over ADP crl-15563 314 7 paper paper NOUN crl-15563 314 8 , , PUNCT crl-15563 314 9 primarily primarily ADV crl-15563 314 10 in in ADP crl-15563 314 11 terms term NOUN crl-15563 314 12 of of ADP crl-15563 314 13 data data NOUN crl-15563 314 14 collection collection NOUN crl-15563 314 15 . . PUNCT crl-15563 315 1 web web NOUN crl-15563 315 2 responses response NOUN crl-15563 315 3 going go VERB crl-15563 315 4 directly directly ADV crl-15563 315 5 into into ADP crl-15563 315 6 a a DET crl-15563 315 7 database database NOUN crl-15563 315 8 cut cut VERB crl-15563 315 9 out out ADP crl-15563 315 10 the the DET crl-15563 315 11 tedious tedious ADJ crl-15563 315 12 and and CCONJ crl-15563 315 13 expensive expensive ADJ crl-15563 315 14 step step NOUN crl-15563 315 15 of of ADP crl-15563 315 16 data data NOUN crl-15563 315 17 entry entry NOUN crl-15563 315 18 and and CCONJ crl-15563 315 19 substantially substantially ADV crl-15563 315 20 reduce reduce VERB crl-15563 315 21 the the DET crl-15563 315 22 potential potential NOUN crl-15563 315 23 for for ADP crl-15563 315 24 errors error NOUN crl-15563 315 25 . . PUNCT crl-15563 316 1 it it PRON crl-15563 316 2 also also ADV crl-15563 316 3 is be AUX crl-15563 316 4 possible possible ADJ crl-15563 316 5 to to PART crl-15563 316 6 work work VERB crl-15563 316 7 with with ADP crl-15563 316 8 instructors instructor NOUN crl-15563 316 9 to to PART crl-15563 316 10 have have VERB crl-15563 316 11 students student NOUN crl-15563 316 12 complete complete VERB crl-15563 316 13 the the DET crl-15563 316 14 questionnaire questionnaire NOUN crl-15563 316 15 outside outside ADP crl-15563 316 16 class class NOUN crl-15563 316 17 time time NOUN crl-15563 316 18 without without ADP crl-15563 316 19 the the DET crl-15563 316 20 additional additional ADJ crl-15563 316 21 time time NOUN crl-15563 316 22 and and CCONJ crl-15563 316 23 staffing staff VERB crl-15563 316 24 demands demand NOUN crl-15563 316 25 of of ADP crl-15563 316 26 getting get VERB crl-15563 316 27 the the DET crl-15563 316 28 proper proper ADJ crl-15563 316 29 forms form NOUN crl-15563 316 30 to to ADP crl-15563 316 31 the the DET crl-15563 316 32 students student NOUN crl-15563 316 33 , , PUNCT crl-15563 316 34 collecting collect VERB crl-15563 316 35 the the DET crl-15563 316 36 completed complete VERB crl-15563 316 37 responses response NOUN crl-15563 316 38 , , PUNCT crl-15563 316 39 and and CCONJ crl-15563 316 40 meeting meet VERB crl-15563 316 41 other other ADJ crl-15563 316 42 administrative administrative ADJ crl-15563 316 43 challenges challenge NOUN crl-15563 316 44 . . PUNCT crl-15563 317 1 one one NUM crl-15563 317 2 significant significant ADJ crl-15563 317 3 disadvantage disadvantage NOUN crl-15563 317 4 , , PUNCT crl-15563 317 5 however however ADV crl-15563 317 6 , , PUNCT crl-15563 317 7 is be AUX crl-15563 317 8 that that SCONJ crl-15563 317 9 networked network VERB crl-15563 317 10 computer computer NOUN crl-15563 317 11 workstations workstation NOUN crl-15563 317 12 must must AUX crl-15563 317 13 be be AUX crl-15563 317 14 available available ADJ crl-15563 317 15 to to ADP crl-15563 317 16 students student NOUN crl-15563 317 17 completing complete VERB crl-15563 317 18 the the DET crl-15563 317 19 instrument instrument NOUN crl-15563 317 20 , , PUNCT crl-15563 317 21 a a DET crl-15563 317 22 requirement requirement NOUN crl-15563 317 23 not not PART crl-15563 317 24 met meet VERB crl-15563 317 25 by by ADP crl-15563 317 26 all all DET crl-15563 317 27 venues venue NOUN crl-15563 317 28 . . PUNCT crl-15563 318 1 the the DET crl-15563 318 2 authors author NOUN crl-15563 318 3 ’ ’ PART crl-15563 318 4 previous previous ADJ crl-15563 318 5 work work NOUN crl-15563 318 6 has have AUX crl-15563 318 7 entailed entail VERB crl-15563 318 8 going go VERB crl-15563 318 9 into into ADP crl-15563 318 10 classrooms classroom NOUN crl-15563 318 11 that that PRON crl-15563 318 12 do do AUX crl-15563 318 13 not not PART crl-15563 318 14 have have VERB crl-15563 318 15 computers computer NOUN crl-15563 318 16 . . PUNCT crl-15563 319 1 on on ADP crl-15563 319 2 balance balance NOUN crl-15563 319 3 , , PUNCT crl-15563 319 4 however however ADV crl-15563 319 5 , , PUNCT crl-15563 319 6 the the DET crl-15563 319 7 web web NOUN crl-15563 319 8 - - PUNCT crl-15563 319 9 based base VERB crl-15563 319 10 format format NOUN crl-15563 319 11 has have AUX crl-15563 319 12 proved prove VERB crl-15563 319 13 preferable preferable ADJ crl-15563 319 14 to to ADP crl-15563 319 15 the the DET crl-15563 319 16 paper paper NOUN crl-15563 319 17 format format NOUN crl-15563 319 18 for for ADP crl-15563 319 19 the the DET crl-15563 319 20 purposes purpose NOUN crl-15563 319 21 of of ADP crl-15563 319 22 this this DET crl-15563 319 23 study study NOUN crl-15563 319 24 . . PUNCT crl-15563 320 1 both both CCONJ crl-15563 320 2 old old ADJ crl-15563 320 3 and and CCONJ crl-15563 320 4 new new ADJ crl-15563 320 5 items item NOUN crl-15563 320 6 are be AUX crl-15563 320 7 now now ADV crl-15563 320 8 being be AUX crl-15563 320 9 retested reteste VERB crl-15563 320 10 in in ADP crl-15563 320 11 new new ADJ crl-15563 320 12 iterations iteration NOUN crl-15563 320 13 of of ADP crl-15563 320 14 the the DET crl-15563 320 15 instrument instrument NOUN crl-15563 320 16 to to PART crl-15563 320 17 ensure ensure VERB crl-15563 320 18 that that SCONJ crl-15563 320 19 the the DET crl-15563 320 20 new new ADJ crl-15563 320 21 versions version NOUN crl-15563 320 22 are be AUX crl-15563 320 23 in in ADP crl-15563 320 24 fact fact NOUN crl-15563 320 25 measuring measure VERB crl-15563 320 26 accurately accurately ADV crl-15563 320 27 the the DET crl-15563 320 28 skills skill NOUN crl-15563 320 29 they they PRON crl-15563 320 30 are be AUX crl-15563 320 31 attempting attempt VERB crl-15563 320 32 to to PART crl-15563 320 33 measure measure VERB crl-15563 320 34 . . PUNCT crl-15563 321 1 there there PRON crl-15563 321 2 are be VERB crl-15563 321 3 multiple multiple ADJ crl-15563 321 4 versions version NOUN crl-15563 321 5 of of ADP crl-15563 321 6 the the DET crl-15563 321 7 instrument instrument NOUN crl-15563 321 8 in in ADP crl-15563 321 9 which which PRON crl-15563 321 10 item item NOUN crl-15563 321 11 order order NOUN crl-15563 321 12 varies vary VERB crl-15563 321 13 so so SCONJ crl-15563 321 14 that that SCONJ crl-15563 321 15 any any DET crl-15563 321 16 uneven uneven ADJ crl-15563 321 17 effects effect NOUN crl-15563 321 18 of of ADP crl-15563 321 19 test test NOUN crl-15563 321 20 fatigue fatigue NOUN crl-15563 321 21 or or CCONJ crl-15563 321 22 distraction distraction NOUN crl-15563 321 23 will will AUX crl-15563 321 24 be be AUX crl-15563 321 25 reduced reduce VERB crl-15563 321 26 or or CCONJ crl-15563 321 27 eliminated eliminate VERB crl-15563 321 28 . . PUNCT crl-15563 322 1 the the DET crl-15563 322 2 authors author NOUN crl-15563 322 3 have have AUX crl-15563 322 4 administered administer VERB crl-15563 322 5 the the DET crl-15563 322 6 instrument instrument NOUN crl-15563 322 7 to to ADP crl-15563 322 8 a a DET crl-15563 322 9 group group NOUN crl-15563 322 10 of of ADP crl-15563 322 11 freshmen freshman NOUN crl-15563 322 12 from from ADP crl-15563 322 13 university university NOUN crl-15563 322 14 orientation orientation NOUN crl-15563 322 15 at at ADP crl-15563 322 16 ksu ksu PROPN crl-15563 322 17 and and CCONJ crl-15563 322 18 are be AUX crl-15563 322 19 beginning begin VERB crl-15563 322 20 to to PART crl-15563 322 21 analyze analyze VERB crl-15563 322 22 the the DET crl-15563 322 23 results result NOUN crl-15563 322 24 . . PUNCT crl-15563 323 1 in in ADP crl-15563 323 2 addition addition NOUN crl-15563 323 3 , , PUNCT crl-15563 323 4 they they PRON crl-15563 323 5 have have AUX crl-15563 323 6 identified identify VERB crl-15563 323 7 other other ADJ crl-15563 323 8 institutions institution NOUN crl-15563 323 9 that that PRON crl-15563 323 10 are be AUX crl-15563 323 11 willing willing ADJ crl-15563 323 12 to to PART crl-15563 323 13 participate participate VERB crl-15563 323 14 in in ADP crl-15563 323 15 the the DET crl-15563 323 16 next next ADJ crl-15563 323 17 phases phase NOUN crl-15563 323 18 of of ADP crl-15563 323 19 the the DET crl-15563 323 20 study study NOUN crl-15563 323 21 . . PUNCT crl-15563 324 1 items item NOUN crl-15563 324 2 were be AUX crl-15563 324 3 written write VERB crl-15563 324 4 to to PART crl-15563 324 5 be be AUX crl-15563 324 6 institution institution NOUN crl-15563 324 7 neutral neutral ADJ crl-15563 324 8 by by ADP crl-15563 324 9 avoiding avoid VERB crl-15563 324 10 reference reference NOUN crl-15563 324 11 to to ADP crl-15563 324 12 the the DET crl-15563 324 13 name name NOUN crl-15563 324 14 of of ADP crl-15563 324 15 the the DET crl-15563 324 16 library library NOUN crl-15563 324 17 catalog catalog NOUN crl-15563 324 18 or or CCONJ crl-15563 324 19 locations location NOUN crl-15563 324 20 specific specific ADJ crl-15563 324 21 to to ADP crl-15563 324 22 the the DET crl-15563 324 23 ksu ksu PROPN crl-15563 324 24 libraries library NOUN crl-15563 324 25 . . PUNCT crl-15563 325 1 however however ADV crl-15563 325 2 , , PUNCT crl-15563 325 3 the the DET crl-15563 325 4 best good ADJ crl-15563 325 5 test test NOUN crl-15563 325 6 of of ADP crl-15563 325 7 whether whether SCONJ crl-15563 325 8 the the DET crl-15563 325 9 project project NOUN crl-15563 325 10 has have AUX crl-15563 325 11 been be AUX crl-15563 325 12 successful successful ADJ crl-15563 325 13 is be AUX crl-15563 325 14 to to PART crl-15563 325 15 have have VERB crl-15563 325 16 students student NOUN crl-15563 325 17 at at ADP crl-15563 325 18 other other ADJ crl-15563 325 19 institutions institution NOUN crl-15563 325 20 complete complete VERB crl-15563 325 21 the the DET crl-15563 325 22 instrument instrument NOUN crl-15563 325 23 and and CCONJ crl-15563 325 24 then then ADV crl-15563 325 25 to to PART crl-15563 325 26 compare compare VERB crl-15563 325 27 their their PRON crl-15563 325 28 results result NOUN crl-15563 325 29 with with ADP crl-15563 325 30 those those PRON crl-15563 325 31 of of ADP crl-15563 325 32 ksu ksu ADJ crl-15563 325 33 students student NOUN crl-15563 325 34 with with ADP crl-15563 325 35 appropriate appropriate ADJ crl-15563 325 36 controls control NOUN crl-15563 325 37 . . PUNCT crl-15563 326 1 pilot pilot NOUN crl-15563 326 2 testing testing NOUN crl-15563 326 3 with with ADP crl-15563 326 4 other other ADJ crl-15563 326 5 colleges college NOUN crl-15563 326 6 and and CCONJ crl-15563 326 7 universities university NOUN crl-15563 326 8 has have AUX crl-15563 326 9 begun begin VERB crl-15563 326 10 and and CCONJ crl-15563 326 11 will will AUX crl-15563 326 12 run run VERB crl-15563 326 13 through through ADP crl-15563 326 14 the the DET crl-15563 326 15 fall fall NOUN crl-15563 326 16 of of ADP crl-15563 326 17 2002 2002 NUM crl-15563 326 18 . . PUNCT crl-15563 327 1 the the DET crl-15563 327 2 authors author NOUN crl-15563 327 3 have have AUX crl-15563 327 4 selected select VERB crl-15563 327 5 a a DET crl-15563 327 6 variety variety NOUN crl-15563 327 7 of of ADP crl-15563 327 8 institution institution NOUN crl-15563 327 9 types type NOUN crl-15563 327 10 , , PUNCT crl-15563 327 11 including include VERB crl-15563 327 12 small small ADJ crl-15563 327 13 private private ADJ crl-15563 327 14 colleges college NOUN crl-15563 327 15 , , PUNCT crl-15563 327 16 community community NOUN crl-15563 327 17 colleges college NOUN crl-15563 327 18 , , PUNCT crl-15563 327 19 other other ADJ crl-15563 327 20 universities university NOUN crl-15563 327 21 , , PUNCT crl-15563 327 22 and and CCONJ crl-15563 327 23 institutions institution NOUN crl-15563 327 24 with with ADP crl-15563 327 25 more more ADV crl-15563 327 26 heterogeneous heterogeneous ADJ crl-15563 327 27 populations population NOUN crl-15563 327 28 . . PUNCT crl-15563 328 1 future future ADJ crl-15563 328 2 phases phase NOUN crl-15563 328 3 the the DET crl-15563 328 4 next next ADJ crl-15563 328 5 step step NOUN crl-15563 328 6 is be AUX crl-15563 328 7 to to PART crl-15563 328 8 develop develop VERB crl-15563 328 9 and and CCONJ crl-15563 328 10 test test VERB crl-15563 328 11 items item NOUN crl-15563 328 12 that that PRON crl-15563 328 13 correspond correspond VERB crl-15563 328 14 to to ADP crl-15563 328 15 the the DET crl-15563 328 16 acrl acrl ADJ crl-15563 328 17 behavioral behavioral ADJ crl-15563 328 18 objectives objective NOUN crl-15563 328 19 that that PRON crl-15563 328 20 have have AUX crl-15563 328 21 not not PART crl-15563 328 22 yet yet ADV crl-15563 328 23 been be AUX crl-15563 328 24 addressed address VERB crl-15563 328 25 and and CCONJ crl-15563 328 26 are be AUX crl-15563 328 27 appropriate appropriate ADJ crl-15563 328 28 for for ADP crl-15563 328 29 an an DET crl-15563 328 30 undergraduate undergraduate ADJ crl-15563 328 31 learner learner NOUN crl-15563 328 32 . . PUNCT crl-15563 329 1 ultimately ultimately ADV crl-15563 329 2 , , PUNCT crl-15563 329 3 before before ADP crl-15563 329 4 administering administer VERB crl-15563 329 5 the the DET crl-15563 329 6 test test NOUN crl-15563 329 7 longitudinally longitudinally ADV crl-15563 329 8 , , PUNCT crl-15563 329 9 the the DET crl-15563 329 10 authors author NOUN crl-15563 329 11 will will AUX crl-15563 329 12 develop develop VERB crl-15563 329 13 a a DET crl-15563 329 14 test test NOUN crl-15563 329 15 bank bank NOUN crl-15563 329 16 of of ADP crl-15563 329 17 items item NOUN crl-15563 329 18 that that PRON crl-15563 329 19 permits permit VERB crl-15563 329 20 repeat repeat NOUN crl-15563 329 21 testing testing NOUN crl-15563 329 22 of of ADP crl-15563 329 23 students student NOUN crl-15563 329 24 while while SCONJ crl-15563 329 25 avoiding avoid VERB crl-15563 329 26 the the DET crl-15563 329 27 problem problem NOUN crl-15563 329 28 of of ADP crl-15563 329 29 test test NOUN crl-15563 329 30 - - PUNCT crl-15563 329 31 taker taker NOUN crl-15563 329 32 familiarity familiarity NOUN crl-15563 329 33 with with ADP crl-15563 329 34 the the DET crl-15563 329 35 test test NOUN crl-15563 329 36 items item NOUN crl-15563 329 37 . . PUNCT crl-15563 330 1 criticism criticism NOUN crl-15563 330 2 of of ADP crl-15563 330 3 preand preand NOUN crl-15563 330 4 posttesting posttesting NOUN crl-15563 330 5 is be AUX crl-15563 330 6 often often ADV crl-15563 330 7 prompted prompt VERB crl-15563 330 8 ( ( PUNCT crl-15563 330 9 justifiably justifiably ADV crl-15563 330 10 ) ) PUNCT crl-15563 330 11 when when SCONJ crl-15563 330 12 the the DET crl-15563 330 13 pretest pret ADJ crl-15563 330 14 items item NOUN crl-15563 330 15 are be AUX crl-15563 330 16 the the DET crl-15563 330 17 same same ADJ crl-15563 330 18 as as ADP crl-15563 330 19 the the DET crl-15563 330 20 posttest postt ADJ crl-15563 330 21 items item NOUN crl-15563 330 22 . . PUNCT crl-15563 331 1 developing develop VERB crl-15563 331 2 several several ADJ crl-15563 331 3 items item NOUN crl-15563 331 4 that that PRON crl-15563 331 5 measure measure VERB crl-15563 331 6 the the DET crl-15563 331 7 same same ADJ crl-15563 331 8 construct construct NOUN crl-15563 331 9 allows allow VERB crl-15563 331 10 for for ADP crl-15563 331 11 acceptable acceptable ADJ crl-15563 331 12 substitution substitution NOUN crl-15563 331 13 of of ADP crl-15563 331 14 one one NUM crl-15563 331 15 of of ADP crl-15563 331 16 those those DET crl-15563 331 17 items item NOUN crl-15563 331 18 for for ADP crl-15563 331 19 another another PRON crl-15563 331 20 . . PUNCT crl-15563 332 1 the the DET crl-15563 332 2 authors author NOUN crl-15563 332 3 will will AUX crl-15563 332 4 further far ADV crl-15563 332 5 investigate investigate VERB crl-15563 332 6 the the DET crl-15563 332 7 validity validity NOUN crl-15563 332 8 of of ADP crl-15563 332 9 the the DET crl-15563 332 10 instrument instrument NOUN crl-15563 332 11 by by ADP crl-15563 332 12 interviewing interview VERB crl-15563 332 13 and and CCONJ crl-15563 332 14 administering administer VERB crl-15563 332 15 performance performance NOUN crl-15563 332 16 tests test NOUN crl-15563 332 17 to to ADP crl-15563 332 18 both both DET crl-15563 332 19 highand highand NOUN crl-15563 332 20 low low ADJ crl-15563 332 21 - - PUNCT crl-15563 332 22 scoring score VERB crl-15563 332 23 students student NOUN crl-15563 332 24 from from ADP crl-15563 332 25 the the DET crl-15563 332 26 field field NOUN crl-15563 332 27 trial trial NOUN crl-15563 332 28 phase phase NOUN crl-15563 332 29 . . PUNCT crl-15563 333 1 that that PRON crl-15563 333 2 is be AUX crl-15563 333 3 , , PUNCT crl-15563 333 4 students student NOUN crl-15563 333 5 will will AUX crl-15563 333 6 be be AUX crl-15563 333 7 asked ask VERB crl-15563 333 8 to to PART crl-15563 333 9 perform perform VERB crl-15563 333 10 a a DET crl-15563 333 11 task task NOUN crl-15563 333 12 deemed deem VERB crl-15563 333 13 to to PART crl-15563 333 14 be be AUX crl-15563 333 15 based base VERB crl-15563 333 16 on on ADP crl-15563 333 17 knowledge knowledge NOUN crl-15563 333 18 represented represent VERB crl-15563 333 19 by by ADP crl-15563 333 20 an an DET crl-15563 333 21 item item NOUN crl-15563 333 22 . . PUNCT crl-15563 334 1 for for ADP crl-15563 334 2 example example NOUN crl-15563 334 3 , , PUNCT crl-15563 334 4 one one NUM crl-15563 334 5 item item NOUN crl-15563 334 6 asks ask VERB crl-15563 334 7 , , PUNCT crl-15563 334 8 “ " PUNCT crl-15563 334 9 to to PART crl-15563 334 10 find find VERB crl-15563 334 11 material material NOUN crl-15563 334 12 about about ADP crl-15563 334 13 the the DET crl-15563 334 14 poet poet NOUN crl-15563 334 15 maya maya PROPN crl-15563 334 16 angelou angelou PROPN crl-15563 334 17 , , PUNCT crl-15563 334 18 which which DET crl-15563 334 19 type type NOUN crl-15563 334 20 of of ADP crl-15563 334 21 search search NOUN crl-15563 334 22 is be AUX crl-15563 334 23 most most ADV crl-15563 334 24 effective effective ADJ crl-15563 334 25 ? ? PUNCT crl-15563 334 26 ” " PUNCT crl-15563 335 1 the the DET crl-15563 335 2 possible possible ADJ crl-15563 335 3 answers answer NOUN crl-15563 335 4 are be AUX crl-15563 335 5 author author NOUN crl-15563 335 6 , , PUNCT crl-15563 335 7 subject subject NOUN crl-15563 335 8 , , PUNCT crl-15563 335 9 and and CCONJ crl-15563 335 10 title title NOUN crl-15563 335 11 ; ; PUNCT crl-15563 335 12 the the DET crl-15563 335 13 correct correct ADJ crl-15563 335 14 answer answer NOUN crl-15563 335 15 is be AUX crl-15563 335 16 subject subject ADJ crl-15563 335 17 . . PUNCT crl-15563 336 1 during during ADP crl-15563 336 2 the the DET crl-15563 336 3 performance performance NOUN crl-15563 336 4 interviews interview NOUN crl-15563 336 5 , , PUNCT crl-15563 336 6 students student NOUN crl-15563 336 7 will will AUX crl-15563 336 8 be be AUX crl-15563 336 9 asked ask VERB crl-15563 336 10 to to PART crl-15563 336 11 use use VERB crl-15563 336 12 the the DET crl-15563 336 13 library library NOUN crl-15563 336 14 catalog catalog NOUN crl-15563 336 15 to to PART crl-15563 336 16 find find VERB crl-15563 336 17 materials material NOUN crl-15563 336 18 about about ADP crl-15563 336 19 a a DET crl-15563 336 20 person person NOUN crl-15563 336 21 . . PUNCT crl-15563 337 1 their their PRON crl-15563 337 2 542 542 NUM crl-15563 337 3 college college PROPN crl-15563 337 4 & & CCONJ crl-15563 337 5 research research PROPN crl-15563 337 6 libraries library NOUN crl-15563 337 7 november november PROPN crl-15563 337 8 2002 2002 NUM crl-15563 337 9 actions action NOUN crl-15563 337 10 will will AUX crl-15563 337 11 be be AUX crl-15563 337 12 observed observe VERB crl-15563 337 13 , , PUNCT crl-15563 337 14 anticipating anticipate VERB crl-15563 337 15 that that SCONJ crl-15563 337 16 students student NOUN crl-15563 337 17 who who PRON crl-15563 337 18 scored score VERB crl-15563 337 19 high high ADV crl-15563 337 20 on on ADP crl-15563 337 21 the the DET crl-15563 337 22 instrument instrument NOUN crl-15563 337 23 will will AUX crl-15563 337 24 use use VERB crl-15563 337 25 the the DET crl-15563 337 26 “ " PUNCT crl-15563 337 27 subject subject ADJ crl-15563 337 28 ” " PUNCT crl-15563 337 29 option option NOUN crl-15563 337 30 more more ADV crl-15563 337 31 often often ADV crl-15563 337 32 than than ADP crl-15563 337 33 those those PRON crl-15563 337 34 who who PRON crl-15563 337 35 scored score VERB crl-15563 337 36 low low ADV crl-15563 337 37 on on ADP crl-15563 337 38 the the DET crl-15563 337 39 instrument instrument NOUN crl-15563 337 40 . . PUNCT crl-15563 338 1 this this DET crl-15563 338 2 phase phase NOUN crl-15563 338 3 of of ADP crl-15563 338 4 the the DET crl-15563 338 5 project project NOUN crl-15563 338 6 has have AUX crl-15563 338 7 been be AUX crl-15563 338 8 funded fund VERB crl-15563 338 9 by by ADP crl-15563 338 10 a a DET crl-15563 338 11 research research NOUN crl-15563 338 12 grant grant NOUN crl-15563 338 13 from from ADP crl-15563 338 14 the the DET crl-15563 338 15 academic academic ADJ crl-15563 338 16 library library PROPN crl-15563 338 17 association association PROPN crl-15563 338 18 of of ADP crl-15563 338 19 ohio ohio PROPN crl-15563 338 20 . . PUNCT crl-15563 339 1 the the DET crl-15563 339 2 web web NOUN crl-15563 339 3 - - PUNCT crl-15563 339 4 based base VERB crl-15563 339 5 format format NOUN crl-15563 339 6 will will AUX crl-15563 339 7 be be AUX crl-15563 339 8 expanded expand VERB crl-15563 339 9 in in ADP crl-15563 339 10 the the DET crl-15563 339 11 future future NOUN crl-15563 339 12 to to PART crl-15563 339 13 allow allow VERB crl-15563 339 14 for for ADP crl-15563 339 15 actual actual ADJ crl-15563 339 16 performance performance NOUN crl-15563 339 17 of of ADP crl-15563 339 18 activities activity NOUN crl-15563 339 19 demonstrating demonstrate VERB crl-15563 339 20 information information NOUN crl-15563 339 21 literacy literacy NOUN crl-15563 339 22 skills skill NOUN crl-15563 339 23 . . PUNCT crl-15563 340 1 an an DET crl-15563 340 2 interactive interactive ADJ crl-15563 340 3 module module NOUN crl-15563 340 4 with with ADP crl-15563 340 5 a a DET crl-15563 340 6 simulated simulated ADJ crl-15563 340 7 database database NOUN crl-15563 340 8 will will AUX crl-15563 340 9 present present VERB crl-15563 340 10 a a DET crl-15563 340 11 test test NOUN crl-15563 340 12 of of ADP crl-15563 340 13 students student NOUN crl-15563 340 14 ’ ’ PART crl-15563 340 15 skill skill NOUN crl-15563 340 16 and and CCONJ crl-15563 340 17 knowledge knowledge NOUN crl-15563 340 18 that that PRON crl-15563 340 19 is be AUX crl-15563 340 20 more more ADV crl-15563 340 21 realistic realistic ADJ crl-15563 340 22 than than ADP crl-15563 340 23 the the DET crl-15563 340 24 multiple multiple ADJ crl-15563 340 25 - - PUNCT crl-15563 340 26 choice choice NOUN crl-15563 340 27 questions question NOUN crl-15563 340 28 currently currently ADV crl-15563 340 29 being be AUX crl-15563 340 30 used use VERB crl-15563 340 31 . . PUNCT crl-15563 341 1 for for ADP crl-15563 341 2 example example NOUN crl-15563 341 3 , , PUNCT crl-15563 341 4 students student NOUN crl-15563 341 5 will will AUX crl-15563 341 6 have have VERB crl-15563 341 7 the the DET crl-15563 341 8 opportunity opportunity NOUN crl-15563 341 9 to to PART crl-15563 341 10 demonstrate demonstrate VERB crl-15563 341 11 the the DET crl-15563 341 12 correct correct ADJ crl-15563 341 13 use use NOUN crl-15563 341 14 of of ADP crl-15563 341 15 boolean boolean ADJ crl-15563 341 16 operators operator NOUN crl-15563 341 17 by by ADP crl-15563 341 18 searching search VERB crl-15563 341 19 a a DET crl-15563 341 20 limited limited ADJ crl-15563 341 21 database database NOUN crl-15563 341 22 . . PUNCT crl-15563 342 1 performance performance NOUN crl-15563 342 2 will will AUX crl-15563 342 3 replace replace VERB crl-15563 342 4 the the DET crl-15563 342 5 terminology terminology NOUN crl-15563 342 6 recognition recognition NOUN crl-15563 342 7 that that PRON crl-15563 342 8 limits limit VERB crl-15563 342 9 the the DET crl-15563 342 10 present present ADJ crl-15563 342 11 items item NOUN crl-15563 342 12 . . PUNCT crl-15563 343 1 information information NOUN crl-15563 343 2 literacy literacy NOUN crl-15563 343 3 competencies competency NOUN crl-15563 343 4 are be AUX crl-15563 343 5 both both PRON crl-15563 343 6 broad broad ADJ crl-15563 343 7 in in ADP crl-15563 343 8 scope scope NOUN crl-15563 343 9 and and CCONJ crl-15563 343 10 thorough thorough ADJ crl-15563 343 11 in in ADP crl-15563 343 12 depth depth NOUN crl-15563 343 13 . . PUNCT crl-15563 344 1 currently currently ADV crl-15563 344 2 , , PUNCT crl-15563 344 3 it it PRON crl-15563 344 4 is be AUX crl-15563 344 5 nearly nearly ADV crl-15563 344 6 impossible impossible ADJ crl-15563 344 7 to to PART crl-15563 344 8 measure measure VERB crl-15563 344 9 the the DET crl-15563 344 10 entire entire ADJ crl-15563 344 11 trait trait NOUN crl-15563 344 12 of of ADP crl-15563 344 13 information information NOUN crl-15563 344 14 literacy literacy NOUN crl-15563 344 15 without without ADP crl-15563 344 16 subjecting subject VERB crl-15563 344 17 respondents respondent NOUN crl-15563 344 18 to to ADP crl-15563 344 19 an an DET crl-15563 344 20 extremely extremely ADV crl-15563 344 21 long long ADJ crl-15563 344 22 test test NOUN crl-15563 344 23 . . PUNCT crl-15563 345 1 a a DET crl-15563 345 2 working work VERB crl-15563 345 3 group group NOUN crl-15563 345 4 of of ADP crl-15563 345 5 librarians librarian NOUN crl-15563 345 6 from from ADP crl-15563 345 7 arl arl PROPN crl-15563 345 8 universities university NOUN crl-15563 345 9 and and CCONJ crl-15563 345 10 ohio ohio PROPN crl-15563 345 11 institutions institution NOUN crl-15563 345 12 will will AUX crl-15563 345 13 convene convene VERB crl-15563 345 14 in in ADP crl-15563 345 15 april april PROPN crl-15563 345 16 2002 2002 NUM crl-15563 345 17 to to PART crl-15563 345 18 cluster cluster VERB crl-15563 345 19 outcomes outcome NOUN crl-15563 345 20 into into ADP crl-15563 345 21 skill skill NOUN crl-15563 345 22 sets set NOUN crl-15563 345 23 and and CCONJ crl-15563 345 24 difficulty difficulty NOUN crl-15563 345 25 levels level NOUN crl-15563 345 26 . . PUNCT crl-15563 346 1 this this DET crl-15563 346 2 activity activity NOUN crl-15563 346 3 will will AUX crl-15563 346 4 not not PART crl-15563 346 5 only only ADV crl-15563 346 6 allow allow VERB crl-15563 346 7 the the DET crl-15563 346 8 authors author NOUN crl-15563 346 9 to to PART crl-15563 346 10 report report VERB crl-15563 346 11 test test NOUN crl-15563 346 12 results result NOUN crl-15563 346 13 in in ADP crl-15563 346 14 a a DET crl-15563 346 15 way way NOUN crl-15563 346 16 that that PRON crl-15563 346 17 is be AUX crl-15563 346 18 most most ADV crl-15563 346 19 useful useful ADJ crl-15563 346 20 for for SCONJ crl-15563 346 21 librarians librarian NOUN crl-15563 346 22 to to PART crl-15563 346 23 identify identify VERB crl-15563 346 24 problem problem NOUN crl-15563 346 25 areas area NOUN crl-15563 346 26 , , PUNCT crl-15563 346 27 but but CCONJ crl-15563 346 28 it it PRON crl-15563 346 29 also also ADV crl-15563 346 30 will will AUX crl-15563 346 31 prepare prepare VERB crl-15563 346 32 the the DET crl-15563 346 33 authors author NOUN crl-15563 346 34 for for ADP crl-15563 346 35 the the DET crl-15563 346 36 final final ADJ crl-15563 346 37 phase phase NOUN crl-15563 346 38 of of ADP crl-15563 346 39 the the DET crl-15563 346 40 initial initial ADJ crl-15563 346 41 development development NOUN crl-15563 346 42 process process NOUN crl-15563 346 43 in in ADP crl-15563 346 44 which which PRON crl-15563 346 45 the the DET crl-15563 346 46 web web NOUN crl-15563 346 47 - - PUNCT crl-15563 346 48 based base VERB crl-15563 346 49 test test NOUN crl-15563 346 50 will will AUX crl-15563 346 51 be be AUX crl-15563 346 52 converted convert VERB crl-15563 346 53 to to ADP crl-15563 346 54 a a DET crl-15563 346 55 computer computer NOUN crl-15563 346 56 adaptive adaptive ADJ crl-15563 346 57 format format NOUN crl-15563 346 58 . . PUNCT crl-15563 347 1 this this DET crl-15563 347 2 format format NOUN crl-15563 347 3 will will AUX crl-15563 347 4 permit permit VERB crl-15563 347 5 testing testing NOUN crl-15563 347 6 of of ADP crl-15563 347 7 the the DET crl-15563 347 8 information information NOUN crl-15563 347 9 literacy literacy NOUN crl-15563 347 10 trait trait NOUN crl-15563 347 11 in in ADP crl-15563 347 12 an an DET crl-15563 347 13 efficient efficient ADJ crl-15563 347 14 manner manner NOUN crl-15563 347 15 . . PUNCT crl-15563 348 1 the the DET crl-15563 348 2 authors author NOUN crl-15563 348 3 are be AUX crl-15563 348 4 currently currently ADV crl-15563 348 5 seeking seek VERB crl-15563 348 6 funding funding NOUN crl-15563 348 7 for for ADP crl-15563 348 8 this this DET crl-15563 348 9 activity activity NOUN crl-15563 348 10 . . PUNCT crl-15563 349 1 conclusion conclusion NOUN crl-15563 349 2 project project NOUN crl-15563 349 3 sails sail NOUN crl-15563 349 4 has have AUX crl-15563 349 5 revealed reveal VERB crl-15563 349 6 many many ADJ crl-15563 349 7 things thing NOUN crl-15563 349 8 about about ADP crl-15563 349 9 assessment assessment NOUN crl-15563 349 10 . . PUNCT crl-15563 350 1 first first ADV crl-15563 350 2 , , PUNCT crl-15563 350 3 very very ADV crl-15563 350 4 early early ADV crl-15563 350 5 on on ADV crl-15563 350 6 , , PUNCT crl-15563 350 7 the the DET crl-15563 350 8 authors author NOUN crl-15563 350 9 realized realize VERB crl-15563 350 10 the the DET crl-15563 350 11 need need NOUN crl-15563 350 12 to to PART crl-15563 350 13 involve involve VERB crl-15563 350 14 an an DET crl-15563 350 15 expert expert NOUN crl-15563 350 16 in in ADP crl-15563 350 17 measurement measurement NOUN crl-15563 350 18 and and CCONJ crl-15563 350 19 evaluation evaluation NOUN crl-15563 350 20 . . PUNCT crl-15563 351 1 they they PRON crl-15563 351 2 identified identify VERB crl-15563 351 3 a a DET crl-15563 351 4 local local ADJ crl-15563 351 5 expert expert NOUN crl-15563 351 6 who who PRON crl-15563 351 7 also also ADV crl-15563 351 8 happened happen VERB crl-15563 351 9 to to PART crl-15563 351 10 have have VERB crl-15563 351 11 a a DET crl-15563 351 12 solid solid ADJ crl-15563 351 13 background background NOUN crl-15563 351 14 in in ADP crl-15563 351 15 library library NOUN crl-15563 351 16 science science NOUN crl-15563 351 17 and and CCONJ crl-15563 351 18 brought bring VERB crl-15563 351 19 that that DET crl-15563 351 20 person person NOUN crl-15563 351 21 onto onto ADP crl-15563 351 22 the the DET crl-15563 351 23 team team NOUN crl-15563 351 24 . . PUNCT crl-15563 352 1 this this DET crl-15563 352 2 partnering partnering NOUN crl-15563 352 3 was be AUX crl-15563 352 4 essential essential ADJ crl-15563 352 5 to to ADP crl-15563 352 6 the the DET crl-15563 352 7 success success NOUN crl-15563 352 8 of of ADP crl-15563 352 9 the the DET crl-15563 352 10 project project NOUN crl-15563 352 11 . . PUNCT crl-15563 353 1 the the DET crl-15563 353 2 authors author NOUN crl-15563 353 3 also also ADV crl-15563 353 4 learned learn VERB crl-15563 353 5 that that SCONJ crl-15563 353 6 relying rely VERB crl-15563 353 7 on on ADP crl-15563 353 8 an an DET crl-15563 353 9 established establish VERB crl-15563 353 10 method method NOUN crl-15563 353 11 of of ADP crl-15563 353 12 development development NOUN crl-15563 353 13 , , PUNCT crl-15563 353 14 the the DET crl-15563 353 15 systematic systematic ADJ crl-15563 353 16 instructional instructional ADJ crl-15563 353 17 design design NOUN crl-15563 353 18 , , PUNCT crl-15563 353 19 was be AUX crl-15563 353 20 very very ADV crl-15563 353 21 beneficial beneficial ADJ crl-15563 353 22 because because SCONJ crl-15563 353 23 items item NOUN crl-15563 353 24 could could AUX crl-15563 353 25 be be AUX crl-15563 353 26 developed develop VERB crl-15563 353 27 that that PRON crl-15563 353 28 performed perform VERB crl-15563 353 29 well well ADV crl-15563 353 30 in in ADP crl-15563 353 31 the the DET crl-15563 353 32 data datum NOUN crl-15563 353 33 analysis analysis NOUN crl-15563 353 34 phase phase NOUN crl-15563 353 35 . . PUNCT crl-15563 354 1 without without ADP crl-15563 354 2 that that DET crl-15563 354 3 process process NOUN crl-15563 354 4 , , PUNCT crl-15563 354 5 much much ADJ crl-15563 354 6 effort effort NOUN crl-15563 354 7 could could AUX crl-15563 354 8 have have AUX crl-15563 354 9 easily easily ADV crl-15563 354 10 been be AUX crl-15563 354 11 spent spend VERB crl-15563 354 12 on on ADP crl-15563 354 13 large large ADJ crl-15563 354 14 - - PUNCT crl-15563 354 15 scale scale NOUN crl-15563 354 16 testing testing NOUN crl-15563 354 17 only only ADV crl-15563 354 18 to to PART crl-15563 354 19 find find VERB crl-15563 354 20 that that SCONJ crl-15563 354 21 the the DET crl-15563 354 22 students student NOUN crl-15563 354 23 taking take VERB crl-15563 354 24 the the DET crl-15563 354 25 test test NOUN crl-15563 354 26 did do AUX crl-15563 354 27 not not PART crl-15563 354 28 fully fully ADV crl-15563 354 29 understand understand VERB crl-15563 354 30 the the DET crl-15563 354 31 items item NOUN crl-15563 354 32 . . PUNCT crl-15563 355 1 the the DET crl-15563 355 2 one one NUM crl-15563 355 3 - - PUNCT crl-15563 355 4 on on ADP crl-15563 355 5 - - PUNCT crl-15563 355 6 one one NUM crl-15563 355 7 and and CCONJ crl-15563 355 8 small small ADJ crl-15563 355 9 group group NOUN crl-15563 355 10 testing testing NOUN crl-15563 355 11 helped help VERB crl-15563 355 12 avoid avoid VERB crl-15563 355 13 that that DET crl-15563 355 14 problem problem NOUN crl-15563 355 15 . . PUNCT crl-15563 356 1 one one NUM crl-15563 356 2 painful painful ADJ crl-15563 356 3 lesson lesson NOUN crl-15563 356 4 has have AUX crl-15563 356 5 been be AUX crl-15563 356 6 the the DET crl-15563 356 7 need need NOUN crl-15563 356 8 to to PART crl-15563 356 9 carefully carefully ADV crl-15563 356 10 document document VERB crl-15563 356 11 all all DET crl-15563 356 12 steps step NOUN crl-15563 356 13 — — PUNCT crl-15563 356 14 the the DET crl-15563 356 15 authors author NOUN crl-15563 356 16 were be AUX crl-15563 356 17 occasionally occasionally ADV crl-15563 356 18 forced force VERB crl-15563 356 19 to to PART crl-15563 356 20 reconstruct reconstruct VERB crl-15563 356 21 actions action NOUN crl-15563 356 22 taken take VERB crl-15563 356 23 or or CCONJ crl-15563 356 24 decisions decision NOUN crl-15563 356 25 made make VERB crl-15563 356 26 , , PUNCT crl-15563 356 27 a a DET crl-15563 356 28 time time NOUN crl-15563 356 29 - - PUNCT crl-15563 356 30 consuming consume VERB crl-15563 356 31 and and CCONJ crl-15563 356 32 frustrating frustrating ADJ crl-15563 356 33 process process NOUN crl-15563 356 34 . . PUNCT crl-15563 357 1 finally finally ADV crl-15563 357 2 , , PUNCT crl-15563 357 3 the the DET crl-15563 357 4 authors author NOUN crl-15563 357 5 realize realize VERB crl-15563 357 6 that that SCONJ crl-15563 357 7 the the DET crl-15563 357 8 tremendous tremendous ADJ crl-15563 357 9 effort effort NOUN crl-15563 357 10 needed need VERB crl-15563 357 11 to to PART crl-15563 357 12 create create VERB crl-15563 357 13 a a DET crl-15563 357 14 meticulously meticulously ADV crl-15563 357 15 tested test VERB crl-15563 357 16 standardized standardized ADJ crl-15563 357 17 tool tool NOUN crl-15563 357 18 is be AUX crl-15563 357 19 well well ADV crl-15563 357 20 worth worth ADJ crl-15563 357 21 it it PRON crl-15563 357 22 . . PUNCT crl-15563 358 1 thus thus ADV crl-15563 358 2 far far ADV crl-15563 358 3 , , PUNCT crl-15563 358 4 responses response NOUN crl-15563 358 5 to to ADP crl-15563 358 6 the the DET crl-15563 358 7 work work NOUN crl-15563 358 8 have have AUX crl-15563 358 9 been be AUX crl-15563 358 10 overwhelmingly overwhelmingly ADV crl-15563 358 11 positive positive ADJ crl-15563 358 12 and and CCONJ crl-15563 358 13 encouraging encouraging ADJ crl-15563 358 14 . . PUNCT crl-15563 359 1 if if SCONJ crl-15563 359 2 project project NOUN crl-15563 359 3 sails sail NOUN crl-15563 359 4 continues continue VERB crl-15563 359 5 to to PART crl-15563 359 6 be be AUX crl-15563 359 7 successful successful ADJ crl-15563 359 8 in in ADP crl-15563 359 9 its its PRON crl-15563 359 10 development development NOUN crl-15563 359 11 and and CCONJ crl-15563 359 12 implementation implementation NOUN crl-15563 359 13 , , PUNCT crl-15563 359 14 perhaps perhaps ADV crl-15563 359 15 it it PRON crl-15563 359 16 can can AUX crl-15563 359 17 offer offer VERB crl-15563 359 18 a a DET crl-15563 359 19 viable viable ADJ crl-15563 359 20 solution solution NOUN crl-15563 359 21 for for ADP crl-15563 359 22 a a DET crl-15563 359 23 number number NOUN crl-15563 359 24 of of ADP crl-15563 359 25 libraries library NOUN crl-15563 359 26 without without ADP crl-15563 359 27 the the DET crl-15563 359 28 resources resource NOUN crl-15563 359 29 to to PART crl-15563 359 30 engage engage VERB crl-15563 359 31 in in ADP crl-15563 359 32 this this DET crl-15563 359 33 level level NOUN crl-15563 359 34 of of ADP crl-15563 359 35 instrument instrument NOUN crl-15563 359 36 development development NOUN crl-15563 359 37 . . PUNCT crl-15563 360 1 for for ADP crl-15563 360 2 further further ADJ crl-15563 360 3 information information NOUN crl-15563 360 4 on on ADP crl-15563 360 5 project project NOUN crl-15563 360 6 sails sail NOUN crl-15563 360 7 and and CCONJ crl-15563 360 8 an an DET crl-15563 360 9 update update NOUN crl-15563 360 10 on on ADP crl-15563 360 11 its its PRON crl-15563 360 12 progress progress NOUN crl-15563 360 13 , , PUNCT crl-15563 360 14 visit visit VERB crl-15563 360 15 the the DET crl-15563 360 16 authors author NOUN crl-15563 360 17 ’ ’ PART crl-15563 360 18 web web NOUN crl-15563 360 19 site site NOUN crl-15563 360 20 at at ADP crl-15563 360 21 www.library.kent.edu/sails www.library.kent.edu/sail NOUN crl-15563 360 22 . . PUNCT crl-15563 361 1 notes note NOUN crl-15563 361 2 1 1 NUM crl-15563 361 3 . . PROPN crl-15563 361 4 christopher christopher PROPN crl-15563 361 5 bober bober PROPN crl-15563 361 6 , , PUNCT crl-15563 361 7 sonia sonia PROPN crl-15563 361 8 poulin poulin PROPN crl-15563 361 9 , , PUNCT crl-15563 361 10 and and CCONJ crl-15563 361 11 luigina luigina PROPN crl-15563 361 12 vileno vileno PROPN crl-15563 361 13 , , PUNCT crl-15563 361 14 “ " PUNCT crl-15563 361 15 evaluating evaluate VERB crl-15563 361 16 library library NOUN crl-15563 361 17 instruction instruction NOUN crl-15563 361 18 in in ADP crl-15563 361 19 academic academic ADJ crl-15563 361 20 libraries library NOUN crl-15563 361 21 : : PUNCT crl-15563 361 22 a a DET crl-15563 361 23 critical critical ADJ crl-15563 361 24 review review NOUN crl-15563 361 25 of of ADP crl-15563 361 26 the the DET crl-15563 361 27 literature literature NOUN crl-15563 361 28 , , PUNCT crl-15563 361 29 1980–1993 1980–1993 NUM crl-15563 361 30 , , PUNCT crl-15563 361 31 ” " PUNCT crl-15563 361 32 reference reference NOUN crl-15563 361 33 librarian librarian PROPN crl-15563 361 34 51/52 51/52 PROPN crl-15563 361 35 ( ( PUNCT crl-15563 361 36 1995 1995 NUM crl-15563 361 37 ): ): PUNCT crl-15563 361 38 53–71 53–71 NUM crl-15563 361 39 . . PUNCT crl-15563 362 1 2 2 X crl-15563 362 2 . . X crl-15563 362 3 teresa teresa PROPN crl-15563 362 4 b. b. PROPN crl-15563 362 5 mensching mensching PROPN crl-15563 362 6 , , PUNCT crl-15563 362 7 “ " PUNCT crl-15563 362 8 trends trend NOUN crl-15563 362 9 in in ADP crl-15563 362 10 bibliographic bibliographic ADJ crl-15563 362 11 instruction instruction NOUN crl-15563 362 12 in in ADP crl-15563 362 13 the the DET crl-15563 362 14 1980s 1980s NUM crl-15563 362 15 : : PUNCT crl-15563 362 16 a a DET crl-15563 362 17 comparison comparison NOUN crl-15563 362 18 of of ADP crl-15563 362 19 data datum NOUN crl-15563 362 20 from from ADP crl-15563 362 21 two two NUM crl-15563 362 22 surveys survey NOUN crl-15563 362 23 , , PUNCT crl-15563 362 24 ” " PUNCT crl-15563 362 25 research research NOUN crl-15563 362 26 strategies strategy NOUN crl-15563 362 27 7 7 NUM crl-15563 362 28 ( ( PUNCT crl-15563 362 29 winter winter NOUN crl-15563 362 30 1989 1989 NUM crl-15563 362 31 ): ): PUNCT crl-15563 362 32 4–13 4–13 PROPN crl-15563 362 33 . . PROPN crl-15563 362 34 3 3 X crl-15563 362 35 . . X crl-15563 362 36 jill jill PROPN crl-15563 362 37 coupe coupe PROPN crl-15563 362 38 , , PUNCT crl-15563 362 39 “ " PUNCT crl-15563 362 40 undergraduate undergraduate ADJ crl-15563 362 41 library library NOUN crl-15563 362 42 skills skill NOUN crl-15563 362 43 : : PUNCT crl-15563 362 44 two two NUM crl-15563 362 45 surveys survey NOUN crl-15563 362 46 at at ADP crl-15563 362 47 johns johns PROPN crl-15563 362 48 hopkins hopkins PROPN crl-15563 362 49 university university PROPN crl-15563 362 50 , , PUNCT crl-15563 362 51 ” " PUNCT crl-15563 362 52 research research NOUN crl-15563 362 53 strategies strategy NOUN crl-15563 362 54 11 11 NUM crl-15563 362 55 ( ( PUNCT crl-15563 362 56 fall fall NOUN crl-15563 362 57 1993 1993 NUM crl-15563 362 58 ): ): PUNCT crl-15563 362 59 188–201 188–201 NUM crl-15563 362 60 . . NUM crl-15563 363 1 4 4 X crl-15563 363 2 . . PROPN crl-15563 363 3 bonnie bonnie PROPN crl-15563 363 4 g g PROPN crl-15563 363 5 lindauer lindauer PROPN crl-15563 363 6 , , PUNCT crl-15563 363 7 “ " PUNCT crl-15563 363 8 defining define VERB crl-15563 363 9 and and CCONJ crl-15563 363 10 measuring measure VERB crl-15563 363 11 the the DET crl-15563 363 12 library library NOUN crl-15563 363 13 ’s ’s PART crl-15563 363 14 impact impact NOUN crl-15563 363 15 on on ADP crl-15563 363 16 campuswide campuswide NOUN crl-15563 363 17 outcomes outcome NOUN crl-15563 363 18 , , PUNCT crl-15563 363 19 ” " PUNCT crl-15563 363 20 college college NOUN crl-15563 363 21 and and CCONJ crl-15563 363 22 research research NOUN crl-15563 363 23 libraries library NOUN crl-15563 363 24 6 6 NUM crl-15563 363 25 ( ( PUNCT crl-15563 363 26 nov nov PROPN crl-15563 363 27 . . PROPN crl-15563 363 28 1998 1998 NUM crl-15563 363 29 ): ): PUNCT crl-15563 363 30 546–70 546–70 NUM crl-15563 363 31 . . PUNCT crl-15563 364 1 applying apply VERB crl-15563 364 2 systems system NOUN crl-15563 364 3 design design NOUN crl-15563 364 4 and and CCONJ crl-15563 364 5 item item NOUN crl-15563 364 6 response response NOUN crl-15563 364 7 theory theory NOUN crl-15563 364 8 543 543 NUM crl-15563 364 9 5 5 NUM crl-15563 364 10 . . PUNCT crl-15563 364 11 lois lois PROPN crl-15563 364 12 m m PROPN crl-15563 364 13 pausch pausch PROPN crl-15563 364 14 and and CCONJ crl-15563 364 15 mary mary PROPN crl-15563 364 16 pagliero pagliero PROPN crl-15563 364 17 popp popp PROPN crl-15563 364 18 , , PUNCT crl-15563 364 19 “ " PUNCT crl-15563 364 20 assessment assessment NOUN crl-15563 364 21 of of ADP crl-15563 364 22 information information NOUN crl-15563 364 23 literacy literacy NOUN crl-15563 364 24 : : PUNCT crl-15563 364 25 lessons lesson NOUN crl-15563 364 26 from from ADP crl-15563 364 27 the the DET crl-15563 364 28 higher high ADJ crl-15563 364 29 education education NOUN crl-15563 364 30 assessment assessment NOUN crl-15563 364 31 movement movement NOUN crl-15563 364 32 , , PUNCT crl-15563 364 33 ” " PUNCT crl-15563 364 34 association association NOUN crl-15563 364 35 of of ADP crl-15563 364 36 college college PROPN crl-15563 364 37 and and CCONJ crl-15563 364 38 research research NOUN crl-15563 364 39 libraries library NOUN crl-15563 364 40 [ [ X crl-15563 364 41 cited cite VERB crl-15563 364 42 14 14 NUM crl-15563 364 43 march march NOUN crl-15563 364 44 2002 2002 NUM crl-15563 364 45 ] ] PUNCT crl-15563 364 46 . . PUNCT crl-15563 365 1 available available ADJ crl-15563 365 2 online online ADV crl-15563 365 3 from from ADP crl-15563 365 4 http://www.ala.org/acrl/paperhtm/ http://www.ala.org/acrl/paperhtm/ PROPN crl-15563 365 5 d30.html d30.html PROPN crl-15563 365 6 . . PUNCT crl-15563 366 1 6 6 X crl-15563 366 2 . . PROPN crl-15563 366 3 lisa lisa PROPN crl-15563 366 4 g. g. PROPN crl-15563 366 5 o’connor o’connor PROPN crl-15563 366 6 , , PUNCT crl-15563 366 7 carolyn carolyn PROPN crl-15563 366 8 j. j. PROPN crl-15563 366 9 radcliff radcliff PROPN crl-15563 366 10 , , PUNCT crl-15563 366 11 and and CCONJ crl-15563 366 12 julie julie PROPN crl-15563 366 13 a. a. PROPN crl-15563 366 14 gedeon gedeon PROPN crl-15563 366 15 , , PUNCT crl-15563 366 16 “ " PUNCT crl-15563 366 17 assessing assess VERB crl-15563 366 18 information information NOUN crl-15563 366 19 literacy literacy NOUN crl-15563 366 20 skills skill NOUN crl-15563 366 21 : : PUNCT crl-15563 366 22 developing develop VERB crl-15563 366 23 a a DET crl-15563 366 24 standardized standardized ADJ crl-15563 366 25 instrument instrument NOUN crl-15563 366 26 for for ADP crl-15563 366 27 institutional institutional ADJ crl-15563 366 28 and and CCONJ crl-15563 366 29 longitudinal longitudinal ADJ crl-15563 366 30 measurement measurement NOUN crl-15563 366 31 , , PUNCT crl-15563 366 32 ” " PUNCT crl-15563 366 33 in in ADP crl-15563 366 34 crossing cross VERB crl-15563 366 35 the the DET crl-15563 366 36 divide divide NOUN crl-15563 366 37 : : PUNCT crl-15563 366 38 proceedings proceeding NOUN crl-15563 366 39 of of ADP crl-15563 366 40 the the DET crl-15563 366 41 tenth tenth ADJ crl-15563 366 42 national national ADJ crl-15563 366 43 conference conference NOUN crl-15563 366 44 of of ADP crl-15563 366 45 the the DET crl-15563 366 46 association association NOUN crl-15563 366 47 of of ADP crl-15563 366 48 college college NOUN crl-15563 366 49 and and CCONJ crl-15563 366 50 research research NOUN crl-15563 366 51 libraries library NOUN crl-15563 366 52 ( ( PUNCT crl-15563 366 53 chicago chicago PROPN crl-15563 366 54 : : PUNCT crl-15563 366 55 acrl acrl ADJ crl-15563 366 56 2001 2001 NUM crl-15563 366 57 ) ) PUNCT crl-15563 366 58 . . PUNCT crl-15563 367 1 7 7 X crl-15563 367 2 . . X crl-15563 367 3 larry larry PROPN crl-15563 367 4 hardesty hardesty PROPN crl-15563 367 5 , , PUNCT crl-15563 367 6 nicholas nicholas PROPN crl-15563 367 7 p. p. PROPN crl-15563 367 8 lovrich lovrich PROPN crl-15563 367 9 jr jr PROPN crl-15563 367 10 . . PROPN crl-15563 367 11 , , PUNCT crl-15563 367 12 and and CCONJ crl-15563 367 13 james james PROPN crl-15563 367 14 mannon mannon PROPN crl-15563 367 15 , , PUNCT crl-15563 367 16 “ " PUNCT crl-15563 367 17 evaluating evaluate VERB crl-15563 367 18 library library NOUN crl-15563 367 19 - - PUNCT crl-15563 367 20 use use NOUN crl-15563 367 21 instruction instruction NOUN crl-15563 367 22 , , PUNCT crl-15563 367 23 ” " PUNCT crl-15563 367 24 college college NOUN crl-15563 367 25 and and CCONJ crl-15563 367 26 research research NOUN crl-15563 367 27 libraries library NOUN crl-15563 367 28 40 40 NUM crl-15563 367 29 ( ( PUNCT crl-15563 367 30 1979 1979 NUM crl-15563 367 31 ): ): PUNCT crl-15563 367 32 309–17 309–17 NUM crl-15563 367 33 ; ; PUNCT crl-15563 367 34 joan joan PROPN crl-15563 367 35 kaplowitz kaplowitz PROPN crl-15563 367 36 , , PUNCT crl-15563 367 37 “ " PUNCT crl-15563 367 38 a a DET crl-15563 367 39 preand preand NOUN crl-15563 367 40 post post ADJ crl-15563 367 41 - - ADJ crl-15563 367 42 test test ADJ crl-15563 367 43 evaluation evaluation NOUN crl-15563 367 44 of of ADP crl-15563 367 45 the the DET crl-15563 367 46 english english PROPN crl-15563 367 47 3 3 NUM crl-15563 367 48 - - PUNCT crl-15563 367 49 library library NOUN crl-15563 367 50 instruction instruction NOUN crl-15563 367 51 program program NOUN crl-15563 367 52 at at ADP crl-15563 367 53 ucla ucla NOUN crl-15563 367 54 , , PUNCT crl-15563 367 55 ” " PUNCT crl-15563 367 56 research research NOUN crl-15563 367 57 strategies strategy NOUN crl-15563 367 58 4 4 NUM crl-15563 367 59 ( ( PUNCT crl-15563 367 60 winter winter NOUN crl-15563 367 61 1986 1986 NUM crl-15563 367 62 ): ): PUNCT crl-15563 367 63 11–17 11–17 NUM crl-15563 367 64 ; ; PUNCT crl-15563 367 65 virginia virginia PROPN crl-15563 367 66 tiefel tiefel PROPN crl-15563 367 67 , , PUNCT crl-15563 367 68 “ " PUNCT crl-15563 367 69 evaluating evaluate VERB crl-15563 367 70 a a DET crl-15563 367 71 library library NOUN crl-15563 367 72 user user NOUN crl-15563 367 73 education education NOUN crl-15563 367 74 program program NOUN crl-15563 367 75 : : PUNCT crl-15563 367 76 a a DET crl-15563 367 77 decade decade NOUN crl-15563 367 78 of of ADP crl-15563 367 79 experience experience NOUN crl-15563 367 80 , , PUNCT crl-15563 367 81 ” " PUNCT crl-15563 367 82 college college NOUN crl-15563 367 83 and and CCONJ crl-15563 367 84 research research NOUN crl-15563 367 85 libraries library NOUN crl-15563 367 86 50 50 NUM crl-15563 367 87 ( ( PUNCT crl-15563 367 88 mar mar PROPN crl-15563 367 89 . . PROPN crl-15563 367 90 1989 1989 NUM crl-15563 367 91 ): ): PUNCT crl-15563 367 92 249–59 249–59 NUM crl-15563 367 93 ; ; PUNCT crl-15563 367 94 jill jill PROPN crl-15563 367 95 coupe coupe PROPN crl-15563 367 96 , , PUNCT crl-15563 367 97 “ " PUNCT crl-15563 367 98 undergraduate undergraduate ADJ crl-15563 367 99 library library NOUN crl-15563 367 100 skills skill NOUN crl-15563 367 101 : : PUNCT crl-15563 367 102 two two NUM crl-15563 367 103 surveys survey NOUN crl-15563 367 104 at at ADP crl-15563 367 105 johns johns PROPN crl-15563 367 106 hopkins hopkins PROPN crl-15563 367 107 university university PROPN crl-15563 367 108 , , PUNCT crl-15563 367 109 ” " PUNCT crl-15563 367 110 research research NOUN crl-15563 367 111 strategies strategy NOUN crl-15563 367 112 11 11 NUM crl-15563 367 113 ( ( PUNCT crl-15563 367 114 fall fall NOUN crl-15563 367 115 1993 1993 NUM crl-15563 367 116 ): ): PUNCT crl-15563 367 117 188–201 188–201 NUM crl-15563 367 118 ; ; PUNCT crl-15563 367 119 godfrey godfrey VERB crl-15563 367 120 franklin franklin PROPN crl-15563 367 121 and and CCONJ crl-15563 367 122 ronald ronald PROPN crl-15563 367 123 c. c. PROPN crl-15563 367 124 toifel toifel PROPN crl-15563 367 125 , , PUNCT crl-15563 367 126 “ " PUNCT crl-15563 367 127 the the DET crl-15563 367 128 effects effect NOUN crl-15563 367 129 of of ADP crl-15563 367 130 bi bi PROPN crl-15563 367 131 on on ADP crl-15563 367 132 library library NOUN crl-15563 367 133 knowledge knowledge NOUN crl-15563 367 134 and and CCONJ crl-15563 367 135 skills skill NOUN crl-15563 367 136 among among ADP crl-15563 367 137 education education NOUN crl-15563 367 138 students student NOUN crl-15563 367 139 , , PUNCT crl-15563 367 140 ” " PUNCT crl-15563 367 141 research research NOUN crl-15563 367 142 strategies strategy NOUN crl-15563 367 143 12 12 NUM crl-15563 367 144 ( ( PUNCT crl-15563 367 145 fall fall NOUN crl-15563 367 146 1994 1994 NUM crl-15563 367 147 ): ): PUNCT crl-15563 367 148 224–37 224–37 NUM crl-15563 367 149 ; ; PUNCT crl-15563 367 150 lilith lilith PROPN crl-15563 367 151 r. r. PROPN crl-15563 367 152 kunkel kunkel PROPN crl-15563 367 153 , , PUNCT crl-15563 367 154 susan susan PROPN crl-15563 367 155 m. m. PROPN crl-15563 367 156 weaver weaver PROPN crl-15563 367 157 , , PUNCT crl-15563 367 158 and and CCONJ crl-15563 367 159 kim kim PROPN crl-15563 367 160 n. n. PROPN crl-15563 367 161 cook cook PROPN crl-15563 367 162 , , PUNCT crl-15563 367 163 “ " PUNCT crl-15563 367 164 what what PRON crl-15563 367 165 do do AUX crl-15563 367 166 they they PRON crl-15563 367 167 know know VERB crl-15563 367 168 ? ? PUNCT crl-15563 367 169 : : PUNCT crl-15563 367 170 an an DET crl-15563 367 171 assessment assessment NOUN crl-15563 367 172 of of ADP crl-15563 367 173 undergraduate undergraduate ADJ crl-15563 367 174 library library NOUN crl-15563 367 175 skills skill NOUN crl-15563 367 176 , , PUNCT crl-15563 367 177 ” " PUNCT crl-15563 367 178 journal journal NOUN crl-15563 367 179 of of ADP crl-15563 367 180 academic academic ADJ crl-15563 367 181 librarianship librarianship NOUN crl-15563 367 182 22 22 NUM crl-15563 367 183 ( ( PUNCT crl-15563 367 184 nov nov PROPN crl-15563 367 185 . . PROPN crl-15563 367 186 1996 1996 NUM crl-15563 367 187 ): ): PUNCT crl-15563 367 188 430–34 430–34 NOUN crl-15563 367 189 ; ; PUNCT crl-15563 367 190 nancy nancy PROPN crl-15563 367 191 wootton wootton PROPN crl-15563 367 192 colborn colborn PROPN crl-15563 367 193 and and CCONJ crl-15563 367 194 roseanne roseanne PROPN crl-15563 367 195 m. m. PROPN crl-15563 367 196 cordell cordell PROPN crl-15563 367 197 , , PUNCT crl-15563 367 198 “ " PUNCT crl-15563 367 199 moving move VERB crl-15563 367 200 from from ADP crl-15563 367 201 subjective subjective ADJ crl-15563 367 202 to to ADP crl-15563 367 203 objective objective ADJ crl-15563 367 204 assessments assessment NOUN crl-15563 367 205 of of ADP crl-15563 367 206 your your PRON crl-15563 367 207 instruction instruction NOUN crl-15563 367 208 program program NOUN crl-15563 367 209 , , PUNCT crl-15563 367 210 ” " PUNCT crl-15563 367 211 reference reference NOUN crl-15563 367 212 services service NOUN crl-15563 367 213 review review VERB crl-15563 367 214 26 26 NUM crl-15563 367 215 ( ( PUNCT crl-15563 367 216 fall fall NOUN crl-15563 367 217 / / SYM crl-15563 367 218 winter winter NOUN crl-15563 367 219 1998 1998 NUM crl-15563 367 220 ): ): PUNCT crl-15563 367 221 125–37 125–37 NUM crl-15563 367 222 ; ; PUNCT crl-15563 367 223 mollie mollie PROPN crl-15563 367 224 d. d. PROPN crl-15563 367 225 lawson lawson PROPN crl-15563 367 226 , , PUNCT crl-15563 367 227 “ " PUNCT crl-15563 367 228 assessment assessment NOUN crl-15563 367 229 of of ADP crl-15563 367 230 a a DET crl-15563 367 231 college college NOUN crl-15563 367 232 freshman freshman NOUN crl-15563 367 233 course course NOUN crl-15563 367 234 in in ADP crl-15563 367 235 information information NOUN crl-15563 367 236 resources resource NOUN crl-15563 367 237 , , PUNCT crl-15563 367 238 ” " PUNCT crl-15563 367 239 library library NOUN crl-15563 367 240 review review NOUN crl-15563 367 241 48 48 NUM crl-15563 367 242 ( ( PUNCT crl-15563 367 243 1999 1999 NUM crl-15563 367 244 ): ): PUNCT crl-15563 367 245 73–78 73–78 NUM crl-15563 367 246 ; ; PUNCT crl-15563 367 247 julie julie PROPN crl-15563 367 248 rabine rabine PROPN crl-15563 367 249 and and CCONJ crl-15563 367 250 catherine catherine PROPN crl-15563 367 251 cardwell cardwell PROPN crl-15563 367 252 , , PUNCT crl-15563 367 253 “ " PUNCT crl-15563 367 254 start start VERB crl-15563 367 255 making make VERB crl-15563 367 256 sense sense NOUN crl-15563 367 257 : : PUNCT crl-15563 367 258 practical practical ADJ crl-15563 367 259 approaches approach NOUN crl-15563 367 260 to to ADP crl-15563 367 261 outcomes outcome NOUN crl-15563 367 262 assessment assessment NOUN crl-15563 367 263 for for ADP crl-15563 367 264 libraries library NOUN crl-15563 367 265 , , PUNCT crl-15563 367 266 ” " PUNCT crl-15563 367 267 research research NOUN crl-15563 367 268 strategies strategy NOUN crl-15563 367 269 17 17 NUM crl-15563 367 270 ( ( PUNCT crl-15563 367 271 fall fall NOUN crl-15563 367 272 2000 2000 NUM crl-15563 367 273 ): ): PUNCT crl-15563 367 274 319–35 319–35 NUM crl-15563 367 275 . . PUNCT crl-15563 368 1 8 8 X crl-15563 368 2 . . X crl-15563 368 3 thomas thomas PROPN crl-15563 368 4 k. k. PROPN crl-15563 368 5 fry fry PROPN crl-15563 368 6 and and CCONJ crl-15563 368 7 joan joan PROPN crl-15563 368 8 kaplowitz kaplowitz PROPN crl-15563 368 9 , , PUNCT crl-15563 368 10 “ " PUNCT crl-15563 368 11 the the DET crl-15563 368 12 english english PROPN crl-15563 368 13 3 3 NUM crl-15563 368 14 library library NOUN crl-15563 368 15 instruction instruction NOUN crl-15563 368 16 program program NOUN crl-15563 368 17 at at ADP crl-15563 368 18 ucla ucla NOUN crl-15563 368 19 : : PUNCT crl-15563 368 20 a a DET crl-15563 368 21 follow follow VERB crl-15563 368 22 - - PUNCT crl-15563 368 23 up up ADP crl-15563 368 24 study study NOUN crl-15563 368 25 , , PUNCT crl-15563 368 26 ” " PUNCT crl-15563 368 27 research research NOUN crl-15563 368 28 strategies strategy NOUN crl-15563 368 29 6 6 NUM crl-15563 368 30 ( ( PUNCT crl-15563 368 31 summer summer NOUN crl-15563 368 32 1988 1988 NUM crl-15563 368 33 ): ): PUNCT crl-15563 368 34 100–108 100–108 NUM crl-15563 368 35 9 9 NUM crl-15563 368 36 . . NUM crl-15563 368 37 tiefel tiefel NOUN crl-15563 368 38 , , PUNCT crl-15563 368 39 “ " PUNCT crl-15563 368 40 evaluating evaluate VERB crl-15563 368 41 a a DET crl-15563 368 42 library library NOUN crl-15563 368 43 user user NOUN crl-15563 368 44 education education NOUN crl-15563 368 45 program program NOUN crl-15563 368 46 . . PUNCT crl-15563 368 47 ” " PUNCT crl-15563 369 1 10 10 NUM crl-15563 369 2 . . PUNCT crl-15563 369 3 hardesty hardesty PROPN crl-15563 369 4 , , PUNCT crl-15563 369 5 lovrich lovrich NOUN crl-15563 369 6 , , PUNCT crl-15563 369 7 and and CCONJ crl-15563 369 8 mannon mannon PROPN crl-15563 369 9 , , PUNCT crl-15563 369 10 “ " PUNCT crl-15563 369 11 evaluating evaluate VERB crl-15563 369 12 library library NOUN crl-15563 369 13 - - PUNCT crl-15563 369 14 use use NOUN crl-15563 369 15 instruction instruction NOUN crl-15563 369 16 . . PUNCT crl-15563 369 17 ” " PUNCT crl-15563 370 1 11 11 NUM crl-15563 370 2 . . PUNCT crl-15563 370 3 ralph ralph PROPN crl-15563 370 4 catts catts PROPN crl-15563 370 5 , , PUNCT crl-15563 370 6 “ " PUNCT crl-15563 370 7 some some DET crl-15563 370 8 issues issue NOUN crl-15563 370 9 in in ADP crl-15563 370 10 assessing assess VERB crl-15563 370 11 information information NOUN crl-15563 370 12 literacy literacy NOUN crl-15563 370 13 , , PUNCT crl-15563 370 14 ” " PUNCT crl-15563 370 15 information information NOUN crl-15563 370 16 literacy literacy NOUN crl-15563 370 17 around around ADP crl-15563 370 18 the the DET crl-15563 370 19 world world NOUN crl-15563 370 20 : : PUNCT crl-15563 370 21 advances advance NOUN crl-15563 370 22 in in ADP crl-15563 370 23 programs program NOUN crl-15563 370 24 and and CCONJ crl-15563 370 25 research research NOUN crl-15563 370 26 , , PUNCT crl-15563 370 27 ed ed NOUN crl-15563 370 28 . . PROPN crl-15563 370 29 christine christine PROPN crl-15563 370 30 bruce bruce PROPN crl-15563 370 31 and and CCONJ crl-15563 370 32 philip philip PROPN crl-15563 370 33 candy candy PROPN crl-15563 370 34 ( ( PUNCT crl-15563 370 35 wagga wagga PROPN crl-15563 370 36 wagga wagga PROPN crl-15563 370 37 , , PUNCT crl-15563 370 38 new new ADJ crl-15563 370 39 south south ADJ crl-15563 370 40 wales wale NOUN crl-15563 370 41 : : PUNCT crl-15563 370 42 centre centre NOUN crl-15563 370 43 for for ADP crl-15563 370 44 information information NOUN crl-15563 370 45 studies study NOUN crl-15563 370 46 , , PUNCT crl-15563 370 47 2000 2000 NUM crl-15563 370 48 ) ) PUNCT crl-15563 370 49 . . PUNCT crl-15563 371 1 12 12 NUM crl-15563 371 2 . . PUNCT crl-15563 372 1 walter walter PROPN crl-15563 372 2 dick dick PROPN crl-15563 372 3 and and CCONJ crl-15563 372 4 lou lou PROPN crl-15563 372 5 carey carey PROPN crl-15563 372 6 , , PUNCT crl-15563 372 7 the the DET crl-15563 372 8 systematic systematic ADJ crl-15563 372 9 design design NOUN crl-15563 372 10 of of ADP crl-15563 372 11 instruction instruction NOUN crl-15563 372 12 , , PUNCT crl-15563 372 13 4th 4th ADJ crl-15563 372 14 ed ed NOUN crl-15563 372 15 . . PUNCT crl-15563 373 1 ( ( PUNCT crl-15563 373 2 new new PROPN crl-15563 373 3 york york PROPN crl-15563 373 4 city city PROPN crl-15563 373 5 : : PUNCT crl-15563 373 6 harpercollins harpercollin NOUN crl-15563 373 7 , , PUNCT crl-15563 373 8 1996 1996 NUM crl-15563 373 9 ) ) PUNCT crl-15563 373 10 . . PUNCT crl-15563 374 1 13 13 NUM crl-15563 374 2 . . PUNCT crl-15563 375 1 american american PROPN crl-15563 375 2 association association PROPN crl-15563 375 3 of of ADP crl-15563 375 4 school school NOUN crl-15563 375 5 librarians librarian NOUN crl-15563 375 6 and and CCONJ crl-15563 375 7 association association NOUN crl-15563 375 8 for for ADP crl-15563 375 9 educational educational ADJ crl-15563 375 10 communications communication NOUN crl-15563 375 11 and and CCONJ crl-15563 375 12 technology technology NOUN crl-15563 375 13 , , PUNCT crl-15563 375 14 information information NOUN crl-15563 375 15 power power NOUN crl-15563 375 16 : : PUNCT crl-15563 375 17 building build VERB crl-15563 375 18 partnerships partnership NOUN crl-15563 375 19 for for ADP crl-15563 375 20 learning learn VERB crl-15563 375 21 ( ( PUNCT crl-15563 375 22 chicago chicago PROPN crl-15563 375 23 : : PUNCT crl-15563 375 24 ala ala PROPN crl-15563 375 25 , , PUNCT crl-15563 375 26 1998 1998 NUM crl-15563 375 27 ) ) PUNCT crl-15563 375 28 . . PUNCT crl-15563 376 1 14 14 NUM crl-15563 376 2 . . PUNCT crl-15563 377 1 benjamin benjamin PROPN crl-15563 377 2 d. d. PROPN crl-15563 377 3 wright wright PROPN crl-15563 377 4 and and CCONJ crl-15563 377 5 mark mark PROPN crl-15563 377 6 h. h. PROPN crl-15563 377 7 stone stone PROPN crl-15563 377 8 , , PUNCT crl-15563 377 9 best good ADJ crl-15563 377 10 test test NOUN crl-15563 377 11 design design NOUN crl-15563 377 12 ( ( PUNCT crl-15563 377 13 chicago chicago PROPN crl-15563 377 14 : : PUNCT crl-15563 377 15 mesa mesa PROPN crl-15563 377 16 press press PROPN crl-15563 377 17 , , PUNCT crl-15563 377 18 1979 1979 NUM crl-15563 377 19 ) ) PUNCT crl-15563 377 20 . . PUNCT crl-15563 378 1 statement statement NOUN crl-15563 378 2 of of ADP crl-15563 378 3 ownership ownership NOUN crl-15563 378 4 , , PUNCT crl-15563 378 5 management management NOUN crl-15563 378 6 , , PUNCT crl-15563 378 7 and and CCONJ crl-15563 378 8 circulation circulation NOUN crl-15563 378 9 college college PROPN crl-15563 378 10 & & CCONJ crl-15563 378 11 research research PROPN crl-15563 378 12 libraries library NOUN crl-15563 378 13 , , PUNCT crl-15563 378 14 issn issn PROPN crl-15563 378 15 0010 0010 NUM crl-15563 378 16 - - PUNCT crl-15563 378 17 0870 0870 NUM crl-15563 378 18 , , PUNCT crl-15563 378 19 is be AUX crl-15563 378 20 published publish VERB crl-15563 378 21 bimonthly bimonthly ADV crl-15563 378 22 by by ADP crl-15563 378 23 the the DET crl-15563 378 24 association association NOUN crl-15563 378 25 of of ADP crl-15563 378 26 college college NOUN crl-15563 378 27 and and CCONJ crl-15563 378 28 research research NOUN crl-15563 378 29 libraries library NOUN crl-15563 378 30 , , PUNCT crl-15563 378 31 american american PROPN crl-15563 378 32 library library PROPN crl-15563 378 33 association association PROPN crl-15563 378 34 , , PUNCT crl-15563 378 35 50 50 NUM crl-15563 378 36 e. e. PROPN crl-15563 378 37 huron huron PROPN crl-15563 378 38 st st PROPN crl-15563 378 39 . . PROPN crl-15563 378 40 , , PUNCT crl-15563 378 41 chicago chicago PROPN crl-15563 378 42 , , PUNCT crl-15563 378 43 il il PROPN crl-15563 378 44 60611 60611 NUM crl-15563 378 45 - - SYM crl-15563 378 46 2795 2795 NUM crl-15563 378 47 . . PUNCT crl-15563 379 1 the the DET crl-15563 379 2 editor editor NOUN crl-15563 379 3 is be AUX crl-15563 379 4 willliam willliam PROPN crl-15563 379 5 gray gray ADJ crl-15563 379 6 potter potter NOUN crl-15563 379 7 , , PUNCT crl-15563 379 8 university university PROPN crl-15563 379 9 of of ADP crl-15563 379 10 georgia georgia PROPN crl-15563 379 11 libraries libraries PROPN crl-15563 379 12 , , PUNCT crl-15563 379 13 athens athens PROPN crl-15563 379 14 , , PUNCT crl-15563 379 15 ga ga PROPN crl-15563 379 16 30602 30602 NUM crl-15563 379 17 - - SYM crl-15563 379 18 1641 1641 NUM crl-15563 379 19 . . PUNCT crl-15563 380 1 annual annual ADJ crl-15563 380 2 subscription subscription NOUN crl-15563 380 3 price price NOUN crl-15563 380 4 , , PUNCT crl-15563 380 5 $ $ SYM crl-15563 380 6 60.00 60.00 NUM crl-15563 380 7 . . PUNCT crl-15563 380 8 printed print VERB crl-15563 380 9 in in ADP crl-15563 380 10 u.s.a u.s.a NOUN crl-15563 380 11 . . PUNCT crl-15563 381 1 with with ADP crl-15563 381 2 second second ADJ crl-15563 381 3 - - PUNCT crl-15563 381 4 class class NOUN crl-15563 381 5 postage postage NOUN crl-15563 381 6 paid pay VERB crl-15563 381 7 at at ADP crl-15563 381 8 chicago chicago PROPN crl-15563 381 9 , , PUNCT crl-15563 381 10 illinois illinois PROPN crl-15563 381 11 . . PUNCT crl-15563 382 1 as as SCONJ crl-15563 382 2 a a DET crl-15563 382 3 nonprofit nonprofit ADJ crl-15563 382 4 organization organization NOUN crl-15563 382 5 authorized authorize VERB crl-15563 382 6 to to PART crl-15563 382 7 mail mail VERB crl-15563 382 8 at at ADP crl-15563 382 9 special special ADJ crl-15563 382 10 rates rate NOUN crl-15563 382 11 ( ( PUNCT crl-15563 382 12 dmm dmm NOUN crl-15563 382 13 section section NOUN crl-15563 382 14 424.12 424.12 NUM crl-15563 382 15 only only ADV crl-15563 382 16 ) ) PUNCT crl-15563 382 17 , , PUNCT crl-15563 382 18 the the DET crl-15563 382 19 purpose purpose NOUN crl-15563 382 20 , , PUNCT crl-15563 382 21 function function NOUN crl-15563 382 22 , , PUNCT crl-15563 382 23 and and CCONJ crl-15563 382 24 nonprofit nonprofit ADJ crl-15563 382 25 status status NOUN crl-15563 382 26 of of ADP crl-15563 382 27 this this DET crl-15563 382 28 organization organization NOUN crl-15563 382 29 and and CCONJ crl-15563 382 30 the the DET crl-15563 382 31 exempt exempt ADJ crl-15563 382 32 status status NOUN crl-15563 382 33 for for ADP crl-15563 382 34 federal federal ADJ crl-15563 382 35 income income NOUN crl-15563 382 36 tax tax NOUN crl-15563 382 37 purposes purpose NOUN crl-15563 382 38 have have AUX crl-15563 382 39 not not PART crl-15563 382 40 changed change VERB crl-15563 382 41 during during ADP crl-15563 382 42 the the DET crl-15563 382 43 preceding precede VERB crl-15563 382 44 twelve twelve NUM crl-15563 382 45 months month NOUN crl-15563 382 46 . . PUNCT crl-15563 383 1 extent extent NOUN crl-15563 383 2 and and CCONJ crl-15563 383 3 nature nature NOUN crl-15563 383 4 of of ADP crl-15563 383 5 circulation circulation NOUN crl-15563 383 6 ( ( PUNCT crl-15563 383 7 average average ADJ crl-15563 383 8 figures figure NOUN crl-15563 383 9 denote denote VERB crl-15563 383 10 the the DET crl-15563 383 11 average average ADJ crl-15563 383 12 number number NOUN crl-15563 383 13 of of ADP crl-15563 383 14 copies copy NOUN crl-15563 383 15 printed print VERB crl-15563 383 16 each each DET crl-15563 383 17 issue issue NOUN crl-15563 383 18 during during ADP crl-15563 383 19 the the DET crl-15563 383 20 preceding precede VERB crl-15563 383 21 twelve twelve NUM crl-15563 383 22 months month NOUN crl-15563 383 23 ; ; PUNCT crl-15563 383 24 actual actual ADJ crl-15563 383 25 figures figure NOUN crl-15563 383 26 denote denote VERB crl-15563 383 27 actual actual ADJ crl-15563 383 28 number number NOUN crl-15563 383 29 of of ADP crl-15563 383 30 copies copy NOUN crl-15563 383 31 of of ADP crl-15563 383 32 single single ADJ crl-15563 383 33 issue issue NOUN crl-15563 383 34 published publish VERB crl-15563 383 35 nearest near ADJ crl-15563 383 36 filing filing NOUN crl-15563 383 37 date date NOUN crl-15563 383 38 : : PUNCT crl-15563 383 39 november november PROPN crl-15563 383 40 2002 2002 NUM crl-15563 383 41 issue issue NOUN crl-15563 383 42 . . PUNCT crl-15563 383 43 ) ) PUNCT crl-15563 383 44 15a 15a NOUN crl-15563 383 45 . . PUNCT crl-15563 384 1 total total ADJ crl-15563 384 2 number number NOUN crl-15563 384 3 of of ADP crl-15563 384 4 copies copy NOUN crl-15563 384 5 ( ( PUNCT crl-15563 384 6 net net ADJ crl-15563 384 7 press press NOUN crl-15563 384 8 run run NOUN crl-15563 384 9 ): ): PUNCT crl-15563 384 10 average average ADJ crl-15563 384 11 13,448 13,448 NUM crl-15563 384 12 ; ; PUNCT crl-15563 384 13 actual actual ADJ crl-15563 384 14 13,495 13,495 NUM crl-15563 384 15 . . PROPN crl-15563 384 16 15b(1 15b(1 NUM crl-15563 384 17 ) ) PUNCT crl-15563 384 18 paid pay VERB crl-15563 384 19 / / SYM crl-15563 384 20 requested request VERB crl-15563 384 21 outside outside ADP crl-15563 384 22 county county NOUN crl-15563 384 23 : : PUNCT crl-15563 384 24 average average ADJ crl-15563 384 25 11,953 11,953 NUM crl-15563 384 26 ; ; PUNCT crl-15563 384 27 actual actual ADJ crl-15563 384 28 12,017 12,017 NUM crl-15563 384 29 . . PUNCT crl-15563 385 1 15c 15c NOUN crl-15563 385 2 . . PUNCT crl-15563 386 1 total total ADJ crl-15563 386 2 paid pay VERB crl-15563 386 3 and/or and/or CCONJ crl-15563 386 4 requested request VERB crl-15563 386 5 circulation circulation NOUN crl-15563 386 6 : : PUNCT crl-15563 386 7 average average ADJ crl-15563 386 8 11,953 11,953 NUM crl-15563 386 9 ; ; PUNCT crl-15563 386 10 actual actual ADJ crl-15563 386 11 12,017 12,017 NUM crl-15563 386 12 . . PUNCT crl-15563 386 13 15d(1 15d(1 NUM crl-15563 386 14 ) ) PUNCT crl-15563 386 15 . . PUNCT crl-15563 387 1 free free ADJ crl-15563 387 2 distribution distribution NOUN crl-15563 387 3 by by ADP crl-15563 387 4 mail mail NOUN crl-15563 387 5 outside outside NOUN crl-15563 387 6 - - PUNCT crl-15563 387 7 county county NOUN crl-15563 387 8 : : PUNCT crl-15563 387 9 average average ADJ crl-15563 387 10 24 24 NUM crl-15563 387 11 ; ; PUNCT crl-15563 387 12 actual actual ADJ crl-15563 387 13 20 20 NUM crl-15563 387 14 . . NUM crl-15563 387 15 15f 15f NOUN crl-15563 387 16 . . PUNCT crl-15563 388 1 total total ADJ crl-15563 388 2 free free ADJ crl-15563 388 3 distribution distribution NOUN crl-15563 388 4 : : PUNCT crl-15563 388 5 average average ADJ crl-15563 388 6 24 24 NUM crl-15563 388 7 ; ; PUNCT crl-15563 388 8 actual actual ADJ crl-15563 388 9 20 20 NUM crl-15563 388 10 . . NUM crl-15563 388 11 15 15 NUM crl-15563 388 12 g. g. ADJ crl-15563 388 13 total total ADJ crl-15563 388 14 distribution distribution NOUN crl-15563 388 15 : : PUNCT crl-15563 388 16 average average ADJ crl-15563 388 17 11,977 11,977 NUM crl-15563 388 18 ; ; PUNCT crl-15563 388 19 actual actual ADJ crl-15563 388 20 12,057 12,057 NUM crl-15563 388 21 . . PUNCT crl-15563 389 1 15h 15h NOUN crl-15563 389 2 . . PUNCT crl-15563 390 1 copies copy NOUN crl-15563 390 2 not not PART crl-15563 390 3 distributed distribute VERB crl-15563 390 4 : : PUNCT crl-15563 390 5 average average VERB crl-15563 390 6 1,471 1,471 NUM crl-15563 390 7 ; ; PUNCT crl-15563 390 8 actual actual ADJ crl-15563 390 9 1,438 1,438 NUM crl-15563 390 10 . . PUNCT crl-15563 391 1 15i 15i PROPN crl-15563 391 2 . . PUNCT crl-15563 392 1 total total PROPN crl-15563 392 2 : : PUNCT crl-15563 392 3 average average ADJ crl-15563 392 4 13,448 13,448 NUM crl-15563 392 5 ; ; PUNCT crl-15563 392 6 actual actual ADJ crl-15563 392 7 13,495 13,495 NUM crl-15563 392 8 . . NUM crl-15563 392 9 15j 15j NOUN crl-15563 392 10 . . PUNCT crl-15563 393 1 percent percent NOUN crl-15563 393 2 paid pay VERB crl-15563 393 3 and/or and/or CCONJ crl-15563 393 4 requested request VERB crl-15563 393 5 circulation circulation NOUN crl-15563 393 6 : : PUNCT crl-15563 393 7 average average ADJ crl-15563 393 8 99 99 NUM crl-15563 393 9 % % NOUN crl-15563 393 10 ; ; PUNCT crl-15563 393 11 actual actual ADJ crl-15563 393 12 99 99 NUM crl-15563 393 13 % % NOUN crl-15563 393 14 . . PUNCT crl-15563 394 1 statement statement NOUN crl-15563 394 2 of of ADP crl-15563 394 3 ownership ownership NOUN crl-15563 394 4 , , PUNCT crl-15563 394 5 management management NOUN crl-15563 394 6 , , PUNCT crl-15563 394 7 and and CCONJ crl-15563 394 8 circulation circulation NOUN crl-15563 394 9 ( ( PUNCT crl-15563 394 10 ps ps PROPN crl-15563 394 11 form form NOUN crl-15563 394 12 3526 3526 NUM crl-15563 394 13 , , PUNCT crl-15563 394 14 oct oct PROPN crl-15563 394 15 . . PROPN crl-15563 394 16 1999 1999 NUM crl-15563 394 17 ) ) PUNCT crl-15563 394 18 for for ADP crl-15563 394 19 2002 2002 NUM crl-15563 394 20 filed file VERB crl-15563 394 21 with with ADP crl-15563 394 22 the the DET crl-15563 394 23 united united PROPN crl-15563 394 24 states states PROPN crl-15563 394 25 post post PROPN crl-15563 394 26 office office NOUN crl-15563 394 27 postmaster postmaster NOUN crl-15563 394 28 in in ADP crl-15563 394 29 chicago chicago PROPN crl-15563 394 30 , , PUNCT crl-15563 394 31 october october PROPN crl-15563 394 32 1 1 NUM crl-15563 394 33 , , PUNCT crl-15563 394 34 2002 2002 NUM crl-15563 394 35 . . PUNCT