id sid tid token lemma pos crl-14698 1 1 college college NOUN crl-14698 1 2 and and CCONJ crl-14698 1 3 research research NOUN crl-14698 1 4 libraries librarie VERB crl-14698 1 5 letters letter NOUN crl-14698 1 6 to to ADP crl-14698 1 7 the the DET crl-14698 1 8 editor editor NOUN crl-14698 1 9 : : PUNCT crl-14698 1 10 we we PRON crl-14698 1 11 have have VERB crl-14698 1 12 some some DET crl-14698 1 13 additional additional ADJ crl-14698 1 14 information information NOUN crl-14698 1 15 on on ADP crl-14698 1 16 a a DET crl-14698 1 17 trend trend NOUN crl-14698 1 18 reported report VERB crl-14698 1 19 in in ADP crl-14698 1 20 our our PRON crl-14698 1 21 article article NOUN crl-14698 1 22 , , PUNCT crl-14698 1 23 " " PUNCT crl-14698 1 24 arl arl NOUN crl-14698 1 25 directors director NOUN crl-14698 1 26 : : PUNCT crl-14698 1 27 two two NUM crl-14698 1 28 decades decade NOUN crl-14698 1 29 of of ADP crl-14698 1 30 changes change NOUN crl-14698 1 31 , , PUNCT crl-14698 1 32 " " PUNCT crl-14698 1 33 college college NOUN crl-14698 1 34 & & CCONJ crl-14698 1 35 research research PROPN crl-14698 1 36 libraries librarie VERB crl-14698 1 37 52:241 52:241 NUM crl-14698 1 38 - - SYM crl-14698 1 39 54 54 NUM crl-14698 1 40 ( ( PUNCT crl-14698 1 41 may may AUX crl-14698 1 42 1991 1991 NUM crl-14698 1 43 ) ) PUNCT crl-14698 1 44 . . PUNCT crl-14698 2 1 in in ADP crl-14698 2 2 the the DET crl-14698 2 3 period period NOUN crl-14698 2 4 1985 1985 NUM crl-14698 2 5 - - SYM crl-14698 2 6 1989 1989 NUM crl-14698 2 7 , , PUNCT crl-14698 2 8 there there PRON crl-14698 2 9 was be VERB crl-14698 2 10 an an DET crl-14698 2 11 unusual unusual ADJ crl-14698 2 12 pattern pattern NOUN crl-14698 2 13 of of ADP crl-14698 2 14 gender gender NOUN crl-14698 2 15 changes change NOUN crl-14698 2 16 , , PUNCT crl-14698 2 17 with with ADP crl-14698 2 18 54 54 NUM crl-14698 2 19 percent percent NOUN crl-14698 2 20 of of ADP crl-14698 2 21 the the DET crl-14698 2 22 new new ADJ crl-14698 2 23 hires hire NOUN crl-14698 2 24 replacing replace VERB crl-14698 2 25 a a DET crl-14698 2 26 director director NOUN crl-14698 2 27 of of ADP crl-14698 2 28 the the DET crl-14698 2 29 opposite opposite ADJ crl-14698 2 30 gender gender NOUN crl-14698 2 31 . . PUNCT crl-14698 3 1 it it PRON crl-14698 3 2 appeared appear VERB crl-14698 3 3 that that SCONJ crl-14698 3 4 male male ADJ crl-14698 3 5 directors director NOUN crl-14698 3 6 were be AUX crl-14698 3 7 being be AUX crl-14698 3 8 replaced replace VERB crl-14698 3 9 by by ADP crl-14698 3 10 females female NOUN crl-14698 3 11 , , PUNCT crl-14698 3 12 and and CCONJ crl-14698 3 13 female female ADJ crl-14698 3 14 directors director NOUN crl-14698 3 15 were be AUX crl-14698 3 16 being be AUX crl-14698 3 17 replaced replace VERB crl-14698 3 18 by by ADP crl-14698 3 19 males male NOUN crl-14698 3 20 . . PUNCT crl-14698 4 1 to to PART crl-14698 4 2 ascertain ascertain VERB crl-14698 4 3 if if SCONJ crl-14698 4 4 this this DET crl-14698 4 5 pattern pattern NOUN crl-14698 4 6 is be AUX crl-14698 4 7 continuing continue VERB crl-14698 4 8 , , PUNCT crl-14698 4 9 we we PRON crl-14698 4 10 analyzed analyze VERB crl-14698 4 11 the the DET crl-14698 4 12 comparable comparable ADJ crl-14698 4 13 data datum NOUN crl-14698 4 14 for for ADP crl-14698 4 15 the the DET crl-14698 4 16 period period NOUN crl-14698 4 17 july july PROPN crl-14698 4 18 1 1 NUM crl-14698 4 19 , , PUNCT crl-14698 4 20 1990 1990 NUM crl-14698 4 21 through through ADP crl-14698 4 22 june june PROPN crl-14698 4 23 30 30 NUM crl-14698 4 24 , , PUNCT crl-14698 4 25 1991 1991 NUM crl-14698 4 26 . . PUNCT crl-14698 5 1 during during ADP crl-14698 5 2 that that DET crl-14698 5 3 period period NOUN crl-14698 5 4 , , PUNCT crl-14698 5 5 ten ten NUM crl-14698 5 6 directorships directorship NOUN crl-14698 5 7 were be AUX crl-14698 5 8 filled fill VERB crl-14698 5 9 with with ADP crl-14698 5 10 permanent permanent ADJ crl-14698 5 11 appointees appointee NOUN crl-14698 5 12 . . PUNCT crl-14698 6 1 of of ADP crl-14698 6 2 the the DET crl-14698 6 3 ten ten NUM crl-14698 6 4 , , PUNCT crl-14698 6 5 seven seven NUM crl-14698 6 6 or or CCONJ crl-14698 6 7 70 70 NUM crl-14698 6 8 percent percent NOUN crl-14698 6 9 were be AUX crl-14698 6 10 gender gender NOUN crl-14698 6 11 switches switch NOUN crl-14698 6 12 : : PUNCT crl-14698 6 13 one one NUM crl-14698 6 14 was be AUX crl-14698 6 15 a a DET crl-14698 6 16 male male NOUN crl-14698 6 17 replacing replace VERB crl-14698 6 18 a a DET crl-14698 6 19 female female ADJ crl-14698 6 20 director director NOUN crl-14698 6 21 and and CCONJ crl-14698 6 22 six six NUM crl-14698 6 23 were be AUX crl-14698 6 24 females female NOUN crl-14698 6 25 replacing replace VERB crl-14698 6 26 male male ADJ crl-14698 6 27 directors director NOUN crl-14698 6 28 . . PUNCT crl-14698 7 1 the the DET crl-14698 7 2 data datum NOUN crl-14698 7 3 indicate indicate VERB crl-14698 7 4 that that SCONJ crl-14698 7 5 the the DET crl-14698 7 6 pattern pattern NOUN crl-14698 7 7 of of ADP crl-14698 7 8 replacement replacement NOUN crl-14698 7 9 by by ADP crl-14698 7 10 opposite opposite ADJ crl-14698 7 11 gender gender NOUN crl-14698 7 12 is be AUX crl-14698 7 13 continuing continue VERB crl-14698 7 14 , , PUNCT crl-14698 7 15 as as SCONJ crl-14698 7 16 is be AUX crl-14698 7 17 the the DET crl-14698 7 18 trend trend NOUN crl-14698 7 19 of of ADP crl-14698 7 20 an an DET crl-14698 7 21 increase increase NOUN crl-14698 7 22 in in ADP crl-14698 7 23 the the DET crl-14698 7 24 percentage percentage NOUN crl-14698 7 25 of of ADP crl-14698 7 26 arl arl NOUN crl-14698 7 27 directors director NOUN crl-14698 7 28 who who PRON crl-14698 7 29 are be AUX crl-14698 7 30 female female ADJ crl-14698 7 31 . . PUNCT crl-14698 8 1 female female ADJ crl-14698 8 2 applicants applicant NOUN crl-14698 8 3 still still ADV crl-14698 8 4 have have VERB crl-14698 8 5 a a DET crl-14698 8 6 better well ADJ crl-14698 8 7 chance chance NOUN crl-14698 8 8 of of ADP crl-14698 8 9 being be AUX crl-14698 8 10 offered offer VERB crl-14698 8 11 a a DET crl-14698 8 12 position position NOUN crl-14698 8 13 in in ADP crl-14698 8 14 an an DET crl-14698 8 15 institution institution NOUN crl-14698 8 16 that that PRON crl-14698 8 17 had have AUX crl-14698 8 18 previously previously ADV crl-14698 8 19 been be AUX crl-14698 8 20 directed direct VERB crl-14698 8 21 by by ADP crl-14698 8 22 a a DET crl-14698 8 23 male male NOUN crl-14698 8 24 than than ADP crl-14698 8 25 one one NUM crl-14698 8 26 that that PRON crl-14698 8 27 had have VERB crl-14698 8 28 a a DET crl-14698 8 29 female female ADJ crl-14698 8 30 director director NOUN crl-14698 8 31 . . PUNCT crl-14698 9 1 male male ADJ crl-14698 9 2 applicants applicant NOUN crl-14698 9 3 continue continue VERB crl-14698 9 4 to to PART crl-14698 9 5 have have VERB crl-14698 9 6 an an DET crl-14698 9 7 equal equal ADJ crl-14698 9 8 chance chance NOUN crl-14698 9 9 of of ADP crl-14698 9 10 replacing replace VERB crl-14698 9 11 a a DET crl-14698 9 12 male male NOUN crl-14698 9 13 or or CCONJ crl-14698 9 14 a a DET crl-14698 9 15 female female ADJ crl-14698 9 16 director director NOUN crl-14698 9 17 . . PUNCT crl-14698 10 1 to to ADP crl-14698 10 2 the the DET crl-14698 10 3 editor editor NOUN crl-14698 10 4 : : PUNCT crl-14698 10 5 marcia marcia PROPN crl-14698 10 6 j. j. PROPN crl-14698 10 7 myers myers PROPN crl-14698 10 8 associate associate PROPN crl-14698 10 9 dean dean PROPN crl-14698 10 10 of of ADP crl-14698 10 11 libraries library NOUN crl-14698 10 12 for for ADP crl-14698 10 13 administrative administrative ADJ crl-14698 10 14 services service NOUN crl-14698 10 15 university university PROPN crl-14698 10 16 of of ADP crl-14698 10 17 tennessee tennessee PROPN crl-14698 10 18 , , PUNCT crl-14698 10 19 knoxville knoxville PROPN crl-14698 10 20 paula paula PROPN crl-14698 10 21 t. t. PROPN crl-14698 10 22 kaufman kaufman PROPN crl-14698 10 23 dean dean PROPN crl-14698 10 24 of of ADP crl-14698 10 25 libraries library NOUN crl-14698 10 26 while while SCONJ crl-14698 10 27 any any DET crl-14698 10 28 librarian librarian NOUN crl-14698 10 29 concerned concern VERB crl-14698 10 30 with with ADP crl-14698 10 31 public public ADJ crl-14698 10 32 services service NOUN crl-14698 10 33 must must AUX crl-14698 10 34 be be AUX crl-14698 10 35 disturbed disturb VERB crl-14698 10 36 by by ADP crl-14698 10 37 the the DET crl-14698 10 38 results result NOUN crl-14698 10 39 of of ADP crl-14698 10 40 the the DET crl-14698 10 41 elzy elzy NOUN crl-14698 10 42 , , PUNCT crl-14698 10 43 nourie nourie PROPN crl-14698 10 44 , , PUNCT crl-14698 10 45 lancaster lancaster NOUN crl-14698 10 46 , , PUNCT crl-14698 10 47 and and CCONJ crl-14698 10 48 joseph joseph PROPN crl-14698 10 49 study study PROPN crl-14698 10 50 ( ( PUNCT crl-14698 10 51 " " PUNCT crl-14698 10 52 evaluating evaluate VERB crl-14698 10 53 reference reference NOUN crl-14698 10 54 service service NOUN crl-14698 10 55 in in ADP crl-14698 10 56 a a DET crl-14698 10 57 large large ADJ crl-14698 10 58 academic academic ADJ crl-14698 10 59 library library NOUN crl-14698 10 60 , , PUNCT crl-14698 10 61 " " PUNCT crl-14698 10 62 [ [ X crl-14698 10 63 c&rl c&rl PROPN crl-14698 10 64 52:454 52:454 NUM crl-14698 10 65 - - SYM crl-14698 10 66 65 65 NUM crl-14698 10 67 ( ( PUNCT crl-14698 10 68 september september PROPN crl-14698 10 69 1991 1991 NUM crl-14698 10 70 ) ) PUNCT crl-14698 10 71 ] ] PUNCT crl-14698 10 72 ) ) PUNCT crl-14698 10 73 , , PUNCT crl-14698 10 74 i i PRON crl-14698 10 75 am be AUX crl-14698 10 76 even even ADV crl-14698 10 77 more more ADV crl-14698 10 78 troubled troubled ADJ crl-14698 10 79 by by ADP crl-14698 10 80 what what PRON crl-14698 10 81 the the DET crl-14698 10 82 article article NOUN crl-14698 10 83 left leave VERB crl-14698 10 84 out out ADP crl-14698 10 85 . . PUNCT crl-14698 11 1 what what PRON crl-14698 11 2 was be AUX crl-14698 11 3 presented present VERB crl-14698 11 4 as as ADP crl-14698 11 5 a a DET crl-14698 11 6 dispassionate dispassionate ADJ crl-14698 11 7 academic academic ADJ crl-14698 11 8 analysis analysis NOUN crl-14698 11 9 of of ADP crl-14698 11 10 performance performance NOUN crl-14698 11 11 levels level NOUN crl-14698 11 12 might might AUX crl-14698 11 13 equally equally ADV crl-14698 11 14 be be AUX crl-14698 11 15 characterized characterize VERB crl-14698 11 16 as as ADP crl-14698 11 17 a a DET crl-14698 11 18 violation violation NOUN crl-14698 11 19 of of ADP crl-14698 11 20 the the DET crl-14698 11 21 professional professional ADJ crl-14698 11 22 relationship relationship NOUN crl-14698 11 23 between between ADP crl-14698 11 24 department department NOUN crl-14698 11 25 head head NOUN crl-14698 11 26 and and CCONJ crl-14698 11 27 reference reference NOUN crl-14698 11 28 librarian librarian NOUN crl-14698 11 29 . . PUNCT crl-14698 12 1 the the DET crl-14698 12 2 authors author NOUN crl-14698 12 3 seem seem VERB crl-14698 12 4 oblivious oblivious ADJ crl-14698 12 5 to to ADP crl-14698 12 6 the the DET crl-14698 12 7 ethical ethical ADJ crl-14698 12 8 questions question NOUN crl-14698 12 9 raised raise VERB crl-14698 12 10 by by ADP crl-14698 12 11 using use VERB crl-14698 12 12 student student NOUN crl-14698 12 13 patrons patron NOUN crl-14698 12 14 as as ADP crl-14698 12 15 anonymous anonymous ADJ crl-14698 12 16 performance performance NOUN crl-14698 12 17 evaluators evaluator NOUN crl-14698 12 18 , , PUNCT crl-14698 12 19 and and CCONJ crl-14698 12 20 the the DET crl-14698 12 21 suggestion suggestion NOUN crl-14698 12 22 that that SCONJ crl-14698 12 23 the the DET crl-14698 12 24 results result NOUN crl-14698 12 25 of of ADP crl-14698 12 26 such such DET crl-14698 12 27 a a DET crl-14698 12 28 study study NOUN crl-14698 12 29 might might AUX crl-14698 12 30 be be AUX crl-14698 12 31 used use VERB crl-14698 12 32 to to PART crl-14698 12 33 make make VERB crl-14698 12 34 salary salary NOUN crl-14698 12 35 and and CCONJ crl-14698 12 36 tenure tenure NOUN crl-14698 12 37 decisions decision NOUN crl-14698 12 38 would would AUX crl-14698 12 39 be be AUX crl-14698 12 40 ludicrous ludicrous ADJ crl-14698 12 41 were be AUX crl-14698 12 42 it it PRON crl-14698 12 43 not not PART crl-14698 12 44 so so ADV crl-14698 12 45 appalling appalling ADJ crl-14698 12 46 . . PUNCT crl-14698 13 1 can can AUX crl-14698 13 2 ten ten NUM crl-14698 13 3 transactions transaction NOUN crl-14698 13 4 at at ADP crl-14698 13 5 a a DET crl-14698 13 6 busy busy ADJ crl-14698 13 7 reference reference NOUN crl-14698 13 8 desk desk NOUN crl-14698 13 9 possibly possibly ADV crl-14698 13 10 be be AUX crl-14698 13 11 a a DET crl-14698 13 12 statistically statistically ADV crl-14698 13 13 significant significant ADJ crl-14698 13 14 sample sample NOUN crl-14698 13 15 ? ? PUNCT crl-14698 14 1 the the DET crl-14698 14 2 authors author NOUN crl-14698 14 3 do do AUX crl-14698 14 4 not not PART crl-14698 14 5 present present VERB crl-14698 14 6 us we PRON crl-14698 14 7 with with ADP crl-14698 14 8 sufficient sufficient ADJ crl-14698 14 9 data datum NOUN crl-14698 14 10 to to PART crl-14698 14 11 judge judge VERB crl-14698 14 12 , , PUNCT crl-14698 14 13 but but CCONJ crl-14698 14 14 i i PRON crl-14698 14 15 very very ADV crl-14698 14 16 much much ADV crl-14698 14 17 doubt doubt NOUN crl-14698 14 18 that that SCONJ crl-14698 14 19 that that PRON crl-14698 14 20 is be AUX crl-14698 14 21 the the DET crl-14698 14 22 case case NOUN crl-14698 14 23 . . PUNCT crl-14698 15 1 i i PRON crl-14698 15 2 for for ADP crl-14698 15 3 one one NUM crl-14698 15 4 would would AUX crl-14698 15 5 be be AUX crl-14698 15 6 very very ADV crl-14698 15 7 interested interested ADJ crl-14698 15 8 in in ADP crl-14698 15 9 hearing hear VERB crl-14698 15 10 from from ADP crl-14698 15 11 the the DET crl-14698 15 12 reference reference NOUN crl-14698 15 13 librarians librarian NOUN crl-14698 15 14 at at ADP crl-14698 15 15 illinois illinois PROPN crl-14698 15 16 state state PROPN crl-14698 15 17 university university PROPN crl-14698 15 18 's 's PART crl-14698 15 19 milner milner NOUN crl-14698 15 20 library library NOUN crl-14698 15 21 . . PUNCT crl-14698 16 1 i i PRON crl-14698 16 2 am be AUX crl-14698 16 3 sure sure ADJ crl-14698 16 4 that that SCONJ crl-14698 16 5 they they PRON crl-14698 16 6 would would AUX crl-14698 16 7 be be AUX crl-14698 16 8 able able ADJ crl-14698 16 9 to to PART crl-14698 16 10 offer offer VERB crl-14698 16 11 your your PRON crl-14698 16 12 readers reader NOUN crl-14698 16 13 a a DET crl-14698 16 14 trenchant trenchant ADJ crl-14698 16 15 commentary commentary NOUN crl-14698 16 16 on on ADP crl-14698 16 17 the the DET crl-14698 16 18 merits merit NOUN crl-14698 16 19 and and CCONJ crl-14698 16 20 methodology methodology NOUN crl-14698 16 21 of of ADP crl-14698 16 22 this this DET crl-14698 16 23 study study NOUN crl-14698 16 24 . . PUNCT crl-14698 17 1 to to ADP crl-14698 17 2 the the DET crl-14698 17 3 editor editor NOUN crl-14698 17 4 : : PUNCT crl-14698 17 5 charles charles PROPN crl-14698 17 6 j. j. PROPN crl-14698 17 7 ten ten PROPN crl-14698 17 8 brink brink PROPN crl-14698 17 9 head head NOUN crl-14698 17 10 of of ADP crl-14698 17 11 public public ADJ crl-14698 17 12 services service NOUN crl-14698 17 13 university university PROPN crl-14698 17 14 of of ADP crl-14698 17 15 chicago chicago PROPN crl-14698 17 16 mr mr PROPN crl-14698 17 17 . . PROPN crl-14698 17 18 ten ten PROPN crl-14698 17 19 brink brink PROPN crl-14698 17 20 raises raise VERB crl-14698 17 21 no no DET crl-14698 17 22 issue issue NOUN crl-14698 17 23 that that SCONJ crl-14698 17 24 we we PRON crl-14698 17 25 have have AUX crl-14698 17 26 not not PART crl-14698 17 27 discussed discuss VERB crl-14698 17 28 again again ADV crl-14698 17 29 and and CCONJ crl-14698 17 30 again again ADV crl-14698 17 31 ourselves ourselves PRON crl-14698 17 32 . . PUNCT crl-14698 18 1 an an DET crl-14698 18 2 in in ADP crl-14698 18 3 - - PUNCT crl-14698 18 4 depth depth NOUN crl-14698 18 5 response response NOUN crl-14698 18 6 to to ADP crl-14698 18 7 his his PRON crl-14698 18 8 letter letter NOUN crl-14698 18 9 could could AUX crl-14698 18 10 easily easily ADV crl-14698 18 11 fill fill VERB crl-14698 18 12 yet yet ADV crl-14698 18 13 another another DET crl-14698 18 14 article article NOUN crl-14698 18 15 for for ADP crl-14698 18 16 your your PRON crl-14698 18 17 journal journal NOUN crl-14698 18 18 . . PUNCT crl-14698 19 1 our our PRON crl-14698 19 2 article article NOUN crl-14698 19 3 was be AUX crl-14698 19 4 written write VERB crl-14698 19 5 to to PART crl-14698 19 6 report report VERB crl-14698 19 7 the the DET crl-14698 19 8 methodology methodology NOUN crl-14698 19 9 and and CCONJ crl-14698 19 10 results result NOUN crl-14698 19 11 of of ADP crl-14698 19 12 what what PRON crl-14698 19 13 started start VERB crl-14698 19 14 out out ADP crl-14698 19 15 to to PART crl-14698 19 16 be be AUX crl-14698 19 17 82 82 NUM crl-14698 19 18 college college PROPN crl-14698 19 19 & & CCONJ crl-14698 19 20 research research PROPN crl-14698 19 21 libraries librarie VERB crl-14698 19 22 january january PROPN crl-14698 19 23 1992 1992 NUM crl-14698 19 24 an an DET crl-14698 19 25 in in ADP crl-14698 19 26 - - PUNCT crl-14698 19 27 house house NOUN crl-14698 19 28 research research NOUN crl-14698 19 29 project project NOUN crl-14698 19 30 with with ADP crl-14698 19 31 some some DET crl-14698 19 32 practical practical ADJ crl-14698 19 33 value value NOUN crl-14698 19 34 . . PUNCT crl-14698 20 1 most most ADJ crl-14698 20 2 research research NOUN crl-14698 20 3 reports report NOUN crl-14698 20 4 are be AUX crl-14698 20 5 indeed indeed ADV crl-14698 20 6 dispassionate dispassionate ADJ crl-14698 20 7 and and CCONJ crl-14698 20 8 academic academic ADJ crl-14698 20 9 . . PUNCT crl-14698 21 1 discussing discuss VERB crl-14698 21 2 the the DET crl-14698 21 3 concerns concern NOUN crl-14698 21 4 raised raise VERB crl-14698 21 5 in in ADP crl-14698 21 6 ten ten NUM crl-14698 21 7 brink brink NOUN crl-14698 21 8 's 's PART crl-14698 21 9 letter letter NOUN crl-14698 21 10 would would AUX crl-14698 21 11 necessarily necessarily ADV crl-14698 21 12 take take VERB crl-14698 21 13 the the DET crl-14698 21 14 form form NOUN crl-14698 21 15 of of ADP crl-14698 21 16 an an DET crl-14698 21 17 opinion opinion NOUN crl-14698 21 18 article article NOUN crl-14698 21 19 or or CCONJ crl-14698 21 20 a a DET crl-14698 21 21 personal personal ADJ crl-14698 21 22 account account NOUN crl-14698 21 23 . . PUNCT crl-14698 22 1 public public ADJ crl-14698 22 2 university university PROPN crl-14698 22 3 administrators administrator NOUN crl-14698 22 4 across across ADP crl-14698 22 5 the the DET crl-14698 22 6 state state NOUN crl-14698 22 7 of of ADP crl-14698 22 8 illinois illinois PROPN crl-14698 22 9 are be AUX crl-14698 22 10 requiring require VERB crl-14698 22 11 increased increase VERB crl-14698 22 12 accountability accountability NOUN crl-14698 22 13 among among ADP crl-14698 22 14 their their PRON crl-14698 22 15 faculty faculty NOUN crl-14698 22 16 for for ADP crl-14698 22 17 teaching teaching NOUN crl-14698 22 18 effectiveness effectiveness NOUN crl-14698 22 19 . . PUNCT crl-14698 23 1 on on ADP crl-14698 23 2 our our PRON crl-14698 23 3 campus campus NOUN crl-14698 23 4 every every DET crl-14698 23 5 faculty faculty NOUN crl-14698 23 6 member member NOUN crl-14698 23 7 except except SCONJ crl-14698 23 8 the the DET crl-14698 23 9 library library NOUN crl-14698 23 10 faculty faculty NOUN crl-14698 23 11 must must AUX crl-14698 23 12 undergo undergo VERB crl-14698 23 13 anonymous anonymous ADJ crl-14698 23 14 performance performance NOUN crl-14698 23 15 evaluations evaluation NOUN crl-14698 23 16 filled fill VERB crl-14698 23 17 out out ADP crl-14698 23 18 by by ADP crl-14698 23 19 students student NOUN crl-14698 23 20 near near ADP crl-14698 23 21 the the DET crl-14698 23 22 end end NOUN crl-14698 23 23 of of ADP crl-14698 23 24 each each DET crl-14698 23 25 term term NOUN crl-14698 23 26 . . PUNCT crl-14698 24 1 these these DET crl-14698 24 2 evaluations evaluation NOUN crl-14698 24 3 are be AUX crl-14698 24 4 used use VERB crl-14698 24 5 as as ADP crl-14698 24 6 an an DET crl-14698 24 7 important important ADJ crl-14698 24 8 part part NOUN crl-14698 24 9 of of ADP crl-14698 24 10 the the DET crl-14698 24 11 process process NOUN crl-14698 24 12 to to PART crl-14698 24 13 distribute distribute VERB crl-14698 24 14 merit merit NOUN crl-14698 24 15 pay pay NOUN crl-14698 24 16 , , PUNCT crl-14698 24 17 as as ADV crl-14698 24 18 well well ADV crl-14698 24 19 as as ADP crl-14698 24 20 in in ADP crl-14698 24 21 tenure tenure NOUN crl-14698 24 22 recommendations recommendation NOUN crl-14698 24 23 . . PUNCT crl-14698 25 1 evaluation evaluation NOUN crl-14698 25 2 of of ADP crl-14698 25 3 reference reference NOUN crl-14698 25 4 effectiveness effectiveness NOUN crl-14698 25 5 is be AUX crl-14698 25 6 a a DET crl-14698 25 7 logical logical ADJ crl-14698 25 8 parallel parallel NOUN crl-14698 25 9 to to ADP crl-14698 25 10 the the DET crl-14698 25 11 anonymous anonymous ADJ crl-14698 25 12 performance performance NOUN crl-14698 25 13 evaluations evaluation NOUN crl-14698 25 14 which which PRON crl-14698 25 15 scrutinize scrutinize VERB crl-14698 25 16 teaching teaching NOUN crl-14698 25 17 effectiveness effectiveness NOUN crl-14698 25 18 . . PUNCT crl-14698 26 1 ten ten NUM crl-14698 26 2 brink brink NOUN crl-14698 26 3 may may AUX crl-14698 26 4 not not PART crl-14698 26 5 be be AUX crl-14698 26 6 aware aware ADJ crl-14698 26 7 that that SCONJ crl-14698 26 8 the the DET crl-14698 26 9 tenure tenure NOUN crl-14698 26 10 process process NOUN crl-14698 26 11 generally generally ADV crl-14698 26 12 involves involve VERB crl-14698 26 13 from from ADP crl-14698 26 14 three three NUM crl-14698 26 15 to to PART crl-14698 26 16 seven seven NUM crl-14698 26 17 years year NOUN crl-14698 26 18 . . PUNCT crl-14698 27 1 should should AUX crl-14698 27 2 the the DET crl-14698 27 3 library library NOUN crl-14698 27 4 faculty faculty NOUN crl-14698 27 5 decide decide VERB crl-14698 27 6 to to PART crl-14698 27 7 incorporate incorporate VERB crl-14698 27 8 some some DET crl-14698 27 9 form form NOUN crl-14698 27 10 of of ADP crl-14698 27 11 reference reference NOUN crl-14698 27 12 evaluation evaluation NOUN crl-14698 27 13 in in ADP crl-14698 27 14 the the DET crl-14698 27 15 tenure tenure NOUN crl-14698 27 16 recommendation recommendation NOUN crl-14698 27 17 , , PUNCT crl-14698 27 18 documentation documentation NOUN crl-14698 27 19 of of ADP crl-14698 27 20 performance performance NOUN crl-14698 27 21 using use VERB crl-14698 27 22 a a DET crl-14698 27 23 manageable manageable ADJ crl-14698 27 24 number number NOUN crl-14698 27 25 of of ADP crl-14698 27 26 questions question NOUN crl-14698 27 27 spanning span VERB crl-14698 27 28 three three NUM crl-14698 27 29 to to PART crl-14698 27 30 seven seven NUM crl-14698 27 31 years year NOUN crl-14698 27 32 may may AUX crl-14698 27 33 indeed indeed ADV crl-14698 27 34 be be AUX crl-14698 27 35 valuable valuable ADJ crl-14698 27 36 as as ADP crl-14698 27 37 one one NUM crl-14698 27 38 component component NOUN crl-14698 27 39 in in ADP crl-14698 27 40 determining determine VERB crl-14698 27 41 a a DET crl-14698 27 42 tenure tenure NOUN crl-14698 27 43 recommendation recommendation NOUN crl-14698 27 44 - - PUNCT crl-14698 27 45 particularly particularly ADV crl-14698 27 46 in in ADP crl-14698 27 47 the the DET crl-14698 27 48 case case NOUN crl-14698 27 49 of of ADP crl-14698 27 50 consistently consistently ADV crl-14698 27 51 poor poor ADJ crl-14698 27 52 performance performance NOUN crl-14698 27 53 . . PUNCT crl-14698 28 1 the the DET crl-14698 28 2 question question NOUN crl-14698 28 3 of of ADP crl-14698 28 4 the the DET crl-14698 28 5 ethics ethic NOUN crl-14698 28 6 of of ADP crl-14698 28 7 unobtrusive unobtrusive ADJ crl-14698 28 8 evaluation evaluation NOUN crl-14698 28 9 has have AUX crl-14698 28 10 been be AUX crl-14698 28 11 debated debate VERB crl-14698 28 12 since since SCONJ crl-14698 28 13 the the DET crl-14698 28 14 method method NOUN crl-14698 28 15 was be AUX crl-14698 28 16 first first ADV crl-14698 28 17 developed develop VERB crl-14698 28 18 over over ADP crl-14698 28 19 twenty twenty NUM crl-14698 28 20 years year NOUN crl-14698 28 21 ago ago ADV crl-14698 28 22 and and CCONJ crl-14698 28 23 was be AUX crl-14698 28 24 debated debate VERB crl-14698 28 25 before before ADV crl-14698 28 26 and and CCONJ crl-14698 28 27 after after ADP crl-14698 28 28 this this DET crl-14698 28 29 project project NOUN crl-14698 28 30 by by ADP crl-14698 28 31 milner milner NOUN crl-14698 28 32 faculty faculty NOUN crl-14698 28 33 . . PUNCT crl-14698 29 1 ethical ethical ADJ crl-14698 29 2 questions question NOUN crl-14698 29 3 were be AUX crl-14698 29 4 discussed discuss VERB crl-14698 29 5 at at ADP crl-14698 29 6 some some DET crl-14698 29 7 length length NOUN crl-14698 29 8 both both CCONJ crl-14698 29 9 among among ADP crl-14698 29 10 the the DET crl-14698 29 11 researchers researcher NOUN crl-14698 29 12 , , PUNCT crl-14698 29 13 in in ADP crl-14698 29 14 general general ADJ crl-14698 29 15 public public ADJ crl-14698 29 16 service service NOUN crl-14698 29 17 faculty faculty NOUN crl-14698 29 18 meetings meeting NOUN crl-14698 29 19 , , PUNCT crl-14698 29 20 and and CCONJ crl-14698 29 21 in in ADP crl-14698 29 22 a a DET crl-14698 29 23 two two NUM crl-14698 29 24 - - PUNCT crl-14698 29 25 day day NOUN crl-14698 29 26 workshop workshop NOUN crl-14698 29 27 on on ADP crl-14698 29 28 reference reference NOUN crl-14698 29 29 effectiveness effectiveness NOUN crl-14698 29 30 conducted conduct VERB crl-14698 29 31 by by ADP crl-14698 29 32 dr dr PROPN crl-14698 29 33 . . PROPN crl-14698 29 34 thomas thomas PROPN crl-14698 29 35 childers childer NOUN crl-14698 29 36 for for ADP crl-14698 29 37 our our PRON crl-14698 29 38 reference reference NOUN crl-14698 29 39 librarians librarian NOUN crl-14698 29 40 in in ADP crl-14698 29 41 october october PROPN crl-14698 29 42 of of ADP crl-14698 29 43 last last ADJ crl-14698 29 44 year year NOUN crl-14698 29 45 . . PUNCT crl-14698 30 1 there there PRON crl-14698 30 2 was be VERB crl-14698 30 3 , , PUNCT crl-14698 30 4 of of ADP crl-14698 30 5 course course NOUN crl-14698 30 6 , , PUNCT crl-14698 30 7 no no DET crl-14698 30 8 resolution resolution NOUN crl-14698 30 9 to to ADP crl-14698 30 10 the the DET crl-14698 30 11 discussion discussion NOUN crl-14698 30 12 - - PUNCT crl-14698 30 13 but but CCONJ crl-14698 30 14 all all PRON crl-14698 30 15 were be AUX crl-14698 30 16 given give VERB crl-14698 30 17 the the DET crl-14698 30 18 chance chance NOUN crl-14698 30 19 to to PART crl-14698 30 20 voice voice VERB crl-14698 30 21 concerns concern NOUN crl-14698 30 22 . . PUNCT crl-14698 31 1 while while SCONJ crl-14698 31 2 no no DET crl-14698 31 3 one one NOUN crl-14698 31 4 really really ADV crl-14698 31 5 enjoys enjoy VERB crl-14698 31 6 evaluation evaluation NOUN crl-14698 31 7 from from ADP crl-14698 31 8 either either DET crl-14698 31 9 end end NOUN crl-14698 31 10 of of ADP crl-14698 31 11 the the DET crl-14698 31 12 process process NOUN crl-14698 31 13 , , PUNCT crl-14698 31 14 it it PRON crl-14698 31 15 is be AUX crl-14698 31 16 a a DET crl-14698 31 17 necessary necessary ADJ crl-14698 31 18 activity activity NOUN crl-14698 31 19 - - PUNCT crl-14698 31 20 and and CCONJ crl-14698 31 21 one one NUM crl-14698 31 22 which which PRON crl-14698 31 23 we we PRON crl-14698 31 24 feel feel VERB crl-14698 31 25 is be AUX crl-14698 31 26 far far ADV crl-14698 31 27 better well ADV crl-14698 31 28 accomplished accomplish VERB crl-14698 31 29 from from ADP crl-14698 31 30 within within ADP crl-14698 31 31 the the DET crl-14698 31 32 profession profession NOUN crl-14698 31 33 and and CCONJ crl-14698 31 34 within within ADP crl-14698 31 35 the the DET crl-14698 31 36 institution institution NOUN crl-14698 31 37 than than ADP crl-14698 31 38 by by ADP crl-14698 31 39 consultants consultant NOUN crl-14698 31 40 from from ADP crl-14698 31 41 outside outside ADV crl-14698 31 42 . . PUNCT crl-14698 32 1 milner milner PROPN crl-14698 32 2 library library PROPN crl-14698 32 3 has have AUX crl-14698 32 4 formed form VERB crl-14698 32 5 a a DET crl-14698 32 6 committee committee NOUN crl-14698 32 7 which which PRON crl-14698 32 8 will will AUX crl-14698 32 9 have have VERB crl-14698 32 10 as as ADP crl-14698 32 11 one one NUM crl-14698 32 12 of of ADP crl-14698 32 13 its its PRON crl-14698 32 14 charges charge NOUN crl-14698 32 15 finding find VERB crl-14698 32 16 an an DET crl-14698 32 17 effective effective ADJ crl-14698 32 18 and and CCONJ crl-14698 32 19 acceptable acceptable ADJ crl-14698 32 20 method method NOUN crl-14698 32 21 of of ADP crl-14698 32 22 evaluating evaluate VERB crl-14698 32 23 reference reference NOUN crl-14698 32 24 service service NOUN crl-14698 32 25 . . PUNCT crl-14698 33 1 this this DET crl-14698 33 2 committee committee NOUN crl-14698 33 3 was be AUX crl-14698 33 4 formed form VERB crl-14698 33 5 as as ADP crl-14698 33 6 a a DET crl-14698 33 7 direct direct ADJ crl-14698 33 8 result result NOUN crl-14698 33 9 of of ADP crl-14698 33 10 the the DET crl-14698 33 11 evaluation evaluation NOUN crl-14698 33 12 project project NOUN crl-14698 33 13 . . PUNCT crl-14698 34 1 while while SCONJ crl-14698 34 2 unobtrusive unobtrusive ADJ crl-14698 34 3 study study NOUN crl-14698 34 4 may may AUX crl-14698 34 5 not not PART crl-14698 34 6 be be AUX crl-14698 34 7 the the DET crl-14698 34 8 preferred preferred ADJ crl-14698 34 9 or or CCONJ crl-14698 34 10 popular popular ADJ crl-14698 34 11 method method NOUN crl-14698 34 12 of of ADP crl-14698 34 13 evaluation evaluation NOUN crl-14698 34 14 , , PUNCT crl-14698 34 15 it it PRON crl-14698 34 16 is be AUX crl-14698 34 17 an an DET crl-14698 34 18 effective effective ADJ crl-14698 34 19 catalyst catalyst NOUN crl-14698 34 20 for for ADP crl-14698 34 21 change change NOUN crl-14698 34 22 . . PUNCT crl-14698 35 1 cheryl cheryl PROPN crl-14698 35 2 elzv elzv PROPN crl-14698 35 3 and and CCONJ crl-14698 35 4 alan alan PROPN crl-14698 35 5 nourie nourie PROPN crl-14698 35 6 illinois illinois PROPN crl-14698 35 7 state state PROPN crl-14698 35 8 university university PROPN crl-14698 35 9 milner milner PROPN crl-14698 35 10 library library PROPN