id sid tid token lemma pos work_rujstqwje5gkdm2bqer4drugey 1 1 The the DT work_rujstqwje5gkdm2bqer4drugey 1 2 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 1 3 Demographics Demographics NNPS work_rujstqwje5gkdm2bqer4drugey 1 4 of of IN work_rujstqwje5gkdm2bqer4drugey 1 5 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 1 6 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 1 7 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 1 8 The the DT work_rujstqwje5gkdm2bqer4drugey 1 9 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 1 10 Demographics Demographics NNPS work_rujstqwje5gkdm2bqer4drugey 1 11 of of IN work_rujstqwje5gkdm2bqer4drugey 1 12 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 1 13 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 1 14 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 1 15 Ellie Ellie NNP work_rujstqwje5gkdm2bqer4drugey 1 16 Pavlick1 Pavlick1 NNP work_rujstqwje5gkdm2bqer4drugey 1 17 Matt Matt NNP work_rujstqwje5gkdm2bqer4drugey 1 18 Post2 Post2 VBD work_rujstqwje5gkdm2bqer4drugey 1 19 Ann Ann NNP work_rujstqwje5gkdm2bqer4drugey 1 20 Irvine2 Irvine2 NNP work_rujstqwje5gkdm2bqer4drugey 1 21 Dmitry Dmitry NNP work_rujstqwje5gkdm2bqer4drugey 1 22 Kachaev2 Kachaev2 NNP work_rujstqwje5gkdm2bqer4drugey 1 23 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 1 24 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 1 25 - - HYPH work_rujstqwje5gkdm2bqer4drugey 1 26 Burch1,2 Burch1,2 NNP work_rujstqwje5gkdm2bqer4drugey 1 27 1Computer 1Computer NNP work_rujstqwje5gkdm2bqer4drugey 1 28 and and CC work_rujstqwje5gkdm2bqer4drugey 1 29 Information Information NNP work_rujstqwje5gkdm2bqer4drugey 1 30 Science Science NNP work_rujstqwje5gkdm2bqer4drugey 1 31 Department Department NNP work_rujstqwje5gkdm2bqer4drugey 1 32 , , , work_rujstqwje5gkdm2bqer4drugey 1 33 University University NNP work_rujstqwje5gkdm2bqer4drugey 1 34 of of IN work_rujstqwje5gkdm2bqer4drugey 1 35 Pennsylvania Pennsylvania NNP work_rujstqwje5gkdm2bqer4drugey 1 36 2Human 2Human NNP work_rujstqwje5gkdm2bqer4drugey 1 37 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 1 38 Technology Technology NNP work_rujstqwje5gkdm2bqer4drugey 1 39 Center Center NNP work_rujstqwje5gkdm2bqer4drugey 1 40 of of IN work_rujstqwje5gkdm2bqer4drugey 1 41 Excellence Excellence NNP work_rujstqwje5gkdm2bqer4drugey 1 42 , , , work_rujstqwje5gkdm2bqer4drugey 1 43 Johns Johns NNP work_rujstqwje5gkdm2bqer4drugey 1 44 Hopkins Hopkins NNP work_rujstqwje5gkdm2bqer4drugey 1 45 University University NNP work_rujstqwje5gkdm2bqer4drugey 1 46 Abstract Abstract NNP work_rujstqwje5gkdm2bqer4drugey 1 47 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 1 48 present present VBP work_rujstqwje5gkdm2bqer4drugey 1 49 a a DT work_rujstqwje5gkdm2bqer4drugey 1 50 large large JJ work_rujstqwje5gkdm2bqer4drugey 1 51 scale scale NN work_rujstqwje5gkdm2bqer4drugey 1 52 study study NN work_rujstqwje5gkdm2bqer4drugey 1 53 of of IN work_rujstqwje5gkdm2bqer4drugey 1 54 the the DT work_rujstqwje5gkdm2bqer4drugey 1 55 languages language NNS work_rujstqwje5gkdm2bqer4drugey 1 56 spoken speak VBN work_rujstqwje5gkdm2bqer4drugey 1 57 by by IN work_rujstqwje5gkdm2bqer4drugey 1 58 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 1 59 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 1 60 on on IN work_rujstqwje5gkdm2bqer4drugey 1 61 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 1 62 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 1 63 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 1 64 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 1 65 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 1 66 . . . work_rujstqwje5gkdm2bqer4drugey 2 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 2 2 establish establish VBP work_rujstqwje5gkdm2bqer4drugey 2 3 a a DT work_rujstqwje5gkdm2bqer4drugey 2 4 methodology methodology NN work_rujstqwje5gkdm2bqer4drugey 2 5 for for IN work_rujstqwje5gkdm2bqer4drugey 2 6 determining determine VBG work_rujstqwje5gkdm2bqer4drugey 2 7 the the DT work_rujstqwje5gkdm2bqer4drugey 2 8 language language NN work_rujstqwje5gkdm2bqer4drugey 2 9 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 2 10 of of IN work_rujstqwje5gkdm2bqer4drugey 2 11 anony- anony- NN work_rujstqwje5gkdm2bqer4drugey 2 12 mous mous JJ work_rujstqwje5gkdm2bqer4drugey 2 13 crowd crowd NN work_rujstqwje5gkdm2bqer4drugey 2 14 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 2 15 that that WDT work_rujstqwje5gkdm2bqer4drugey 2 16 is be VBZ work_rujstqwje5gkdm2bqer4drugey 2 17 more more RBR work_rujstqwje5gkdm2bqer4drugey 2 18 robust robust JJ work_rujstqwje5gkdm2bqer4drugey 2 19 than than IN work_rujstqwje5gkdm2bqer4drugey 2 20 simple simple JJ work_rujstqwje5gkdm2bqer4drugey 2 21 surveying surveying NN work_rujstqwje5gkdm2bqer4drugey 2 22 . . . work_rujstqwje5gkdm2bqer4drugey 3 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 3 2 validate validate VBP work_rujstqwje5gkdm2bqer4drugey 3 3 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 3 4 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 3 5 self- self- NNS work_rujstqwje5gkdm2bqer4drugey 3 6 reported report VBD work_rujstqwje5gkdm2bqer4drugey 3 7 language language NN work_rujstqwje5gkdm2bqer4drugey 3 8 skill skill NN work_rujstqwje5gkdm2bqer4drugey 3 9 claims claim NNS work_rujstqwje5gkdm2bqer4drugey 3 10 by by IN work_rujstqwje5gkdm2bqer4drugey 3 11 measuring measure VBG work_rujstqwje5gkdm2bqer4drugey 3 12 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 3 13 ability ability NN work_rujstqwje5gkdm2bqer4drugey 3 14 to to TO work_rujstqwje5gkdm2bqer4drugey 3 15 correctly correctly RB work_rujstqwje5gkdm2bqer4drugey 3 16 translate translate VB work_rujstqwje5gkdm2bqer4drugey 3 17 words word NNS work_rujstqwje5gkdm2bqer4drugey 3 18 , , , work_rujstqwje5gkdm2bqer4drugey 3 19 and and CC work_rujstqwje5gkdm2bqer4drugey 3 20 by by IN work_rujstqwje5gkdm2bqer4drugey 3 21 geolocating geolocate VBG work_rujstqwje5gkdm2bqer4drugey 3 22 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 3 23 to to TO work_rujstqwje5gkdm2bqer4drugey 3 24 see see VB work_rujstqwje5gkdm2bqer4drugey 3 25 if if IN work_rujstqwje5gkdm2bqer4drugey 3 26 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 3 27 reside reside VBP work_rujstqwje5gkdm2bqer4drugey 3 28 in in IN work_rujstqwje5gkdm2bqer4drugey 3 29 countries country NNS work_rujstqwje5gkdm2bqer4drugey 3 30 where where WRB work_rujstqwje5gkdm2bqer4drugey 3 31 the the DT work_rujstqwje5gkdm2bqer4drugey 3 32 languages language NNS work_rujstqwje5gkdm2bqer4drugey 3 33 are be VBP work_rujstqwje5gkdm2bqer4drugey 3 34 likely likely JJ work_rujstqwje5gkdm2bqer4drugey 3 35 to to TO work_rujstqwje5gkdm2bqer4drugey 3 36 be be VB work_rujstqwje5gkdm2bqer4drugey 3 37 spoken speak VBN work_rujstqwje5gkdm2bqer4drugey 3 38 . . . work_rujstqwje5gkdm2bqer4drugey 4 1 Rather rather RB work_rujstqwje5gkdm2bqer4drugey 4 2 than than IN work_rujstqwje5gkdm2bqer4drugey 4 3 posting post VBG work_rujstqwje5gkdm2bqer4drugey 4 4 a a DT work_rujstqwje5gkdm2bqer4drugey 4 5 one one CD work_rujstqwje5gkdm2bqer4drugey 4 6 - - HYPH work_rujstqwje5gkdm2bqer4drugey 4 7 off off NN work_rujstqwje5gkdm2bqer4drugey 4 8 survey survey NN work_rujstqwje5gkdm2bqer4drugey 4 9 , , , work_rujstqwje5gkdm2bqer4drugey 4 10 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 4 11 posted post VBD work_rujstqwje5gkdm2bqer4drugey 4 12 paid pay VBN work_rujstqwje5gkdm2bqer4drugey 4 13 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 4 14 consisting consist VBG work_rujstqwje5gkdm2bqer4drugey 4 15 of of IN work_rujstqwje5gkdm2bqer4drugey 4 16 1,000 1,000 CD work_rujstqwje5gkdm2bqer4drugey 4 17 as- as- NN work_rujstqwje5gkdm2bqer4drugey 4 18 signments signment NNS work_rujstqwje5gkdm2bqer4drugey 4 19 to to TO work_rujstqwje5gkdm2bqer4drugey 4 20 translate translate VB work_rujstqwje5gkdm2bqer4drugey 4 21 a a DT work_rujstqwje5gkdm2bqer4drugey 4 22 total total NN work_rujstqwje5gkdm2bqer4drugey 4 23 of of IN work_rujstqwje5gkdm2bqer4drugey 4 24 10,000 10,000 CD work_rujstqwje5gkdm2bqer4drugey 4 25 words word NNS work_rujstqwje5gkdm2bqer4drugey 4 26 in in IN work_rujstqwje5gkdm2bqer4drugey 4 27 each each DT work_rujstqwje5gkdm2bqer4drugey 4 28 of of IN work_rujstqwje5gkdm2bqer4drugey 4 29 100 100 CD work_rujstqwje5gkdm2bqer4drugey 4 30 languages language NNS work_rujstqwje5gkdm2bqer4drugey 4 31 . . . work_rujstqwje5gkdm2bqer4drugey 5 1 Our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 5 2 study study NN work_rujstqwje5gkdm2bqer4drugey 5 3 ran run VBD work_rujstqwje5gkdm2bqer4drugey 5 4 for for IN work_rujstqwje5gkdm2bqer4drugey 5 5 several several JJ work_rujstqwje5gkdm2bqer4drugey 5 6 months month NNS work_rujstqwje5gkdm2bqer4drugey 5 7 , , , work_rujstqwje5gkdm2bqer4drugey 5 8 and and CC work_rujstqwje5gkdm2bqer4drugey 5 9 was be VBD work_rujstqwje5gkdm2bqer4drugey 5 10 highly highly RB work_rujstqwje5gkdm2bqer4drugey 5 11 visible visible JJ work_rujstqwje5gkdm2bqer4drugey 5 12 on on IN work_rujstqwje5gkdm2bqer4drugey 5 13 the the DT work_rujstqwje5gkdm2bqer4drugey 5 14 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 5 15 crowdsourcing crowdsourcing NN work_rujstqwje5gkdm2bqer4drugey 5 16 platform platform NN work_rujstqwje5gkdm2bqer4drugey 5 17 , , , work_rujstqwje5gkdm2bqer4drugey 5 18 increas- increas- NNP work_rujstqwje5gkdm2bqer4drugey 5 19 ing ing NNP work_rujstqwje5gkdm2bqer4drugey 5 20 the the DT work_rujstqwje5gkdm2bqer4drugey 5 21 chances chance NNS work_rujstqwje5gkdm2bqer4drugey 5 22 that that IN work_rujstqwje5gkdm2bqer4drugey 5 23 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 5 24 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 5 25 would would MD work_rujstqwje5gkdm2bqer4drugey 5 26 complete complete VB work_rujstqwje5gkdm2bqer4drugey 5 27 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 5 28 . . . work_rujstqwje5gkdm2bqer4drugey 6 1 Our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 6 2 study study NN work_rujstqwje5gkdm2bqer4drugey 6 3 was be VBD work_rujstqwje5gkdm2bqer4drugey 6 4 useful useful JJ work_rujstqwje5gkdm2bqer4drugey 6 5 both both DT work_rujstqwje5gkdm2bqer4drugey 6 6 to to TO work_rujstqwje5gkdm2bqer4drugey 6 7 cre- cre- VB work_rujstqwje5gkdm2bqer4drugey 6 8 ate eat VBD work_rujstqwje5gkdm2bqer4drugey 6 9 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 6 10 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 6 11 and and CC work_rujstqwje5gkdm2bqer4drugey 6 12 to to TO work_rujstqwje5gkdm2bqer4drugey 6 13 act act VB work_rujstqwje5gkdm2bqer4drugey 6 14 as as IN work_rujstqwje5gkdm2bqer4drugey 6 15 cen- cen- NN work_rujstqwje5gkdm2bqer4drugey 6 16 sus sus NN work_rujstqwje5gkdm2bqer4drugey 6 17 of of IN work_rujstqwje5gkdm2bqer4drugey 6 18 the the DT work_rujstqwje5gkdm2bqer4drugey 6 19 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 6 20 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 6 21 on on IN work_rujstqwje5gkdm2bqer4drugey 6 22 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 6 23 . . . work_rujstqwje5gkdm2bqer4drugey 7 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 7 2 use use VBP work_rujstqwje5gkdm2bqer4drugey 7 3 this this DT work_rujstqwje5gkdm2bqer4drugey 7 4 data datum NNS work_rujstqwje5gkdm2bqer4drugey 7 5 to to TO work_rujstqwje5gkdm2bqer4drugey 7 6 recommend recommend VB work_rujstqwje5gkdm2bqer4drugey 7 7 languages language NNS work_rujstqwje5gkdm2bqer4drugey 7 8 with with IN work_rujstqwje5gkdm2bqer4drugey 7 9 the the DT work_rujstqwje5gkdm2bqer4drugey 7 10 largest large JJS work_rujstqwje5gkdm2bqer4drugey 7 11 speaker speaker NN work_rujstqwje5gkdm2bqer4drugey 7 12 populations population NNS work_rujstqwje5gkdm2bqer4drugey 7 13 as as IN work_rujstqwje5gkdm2bqer4drugey 7 14 good good JJ work_rujstqwje5gkdm2bqer4drugey 7 15 candidates candidate NNS work_rujstqwje5gkdm2bqer4drugey 7 16 for for IN work_rujstqwje5gkdm2bqer4drugey 7 17 other other JJ work_rujstqwje5gkdm2bqer4drugey 7 18 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 7 19 who who WP work_rujstqwje5gkdm2bqer4drugey 7 20 want want VBP work_rujstqwje5gkdm2bqer4drugey 7 21 to to TO work_rujstqwje5gkdm2bqer4drugey 7 22 develop develop VB work_rujstqwje5gkdm2bqer4drugey 7 23 crowdsourced crowdsource VBN work_rujstqwje5gkdm2bqer4drugey 7 24 , , , work_rujstqwje5gkdm2bqer4drugey 7 25 multilingual multilingual JJ work_rujstqwje5gkdm2bqer4drugey 7 26 technologies technology NNS work_rujstqwje5gkdm2bqer4drugey 7 27 . . . work_rujstqwje5gkdm2bqer4drugey 8 1 To to TO work_rujstqwje5gkdm2bqer4drugey 8 2 further further RB work_rujstqwje5gkdm2bqer4drugey 8 3 demonstrate demonstrate VB work_rujstqwje5gkdm2bqer4drugey 8 4 the the DT work_rujstqwje5gkdm2bqer4drugey 8 5 value value NN work_rujstqwje5gkdm2bqer4drugey 8 6 of of IN work_rujstqwje5gkdm2bqer4drugey 8 7 creating create VBG work_rujstqwje5gkdm2bqer4drugey 8 8 data datum NNS work_rujstqwje5gkdm2bqer4drugey 8 9 via via IN work_rujstqwje5gkdm2bqer4drugey 8 10 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 8 11 , , , work_rujstqwje5gkdm2bqer4drugey 8 12 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 8 13 hire hire VBP work_rujstqwje5gkdm2bqer4drugey 8 14 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 8 15 to to TO work_rujstqwje5gkdm2bqer4drugey 8 16 create create VB work_rujstqwje5gkdm2bqer4drugey 8 17 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 8 18 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 8 19 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 8 20 in in IN work_rujstqwje5gkdm2bqer4drugey 8 21 six six CD work_rujstqwje5gkdm2bqer4drugey 8 22 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 8 23 lan- lan- NN work_rujstqwje5gkdm2bqer4drugey 8 24 guages guage NNS work_rujstqwje5gkdm2bqer4drugey 8 25 , , , work_rujstqwje5gkdm2bqer4drugey 8 26 and and CC work_rujstqwje5gkdm2bqer4drugey 8 27 use use VB work_rujstqwje5gkdm2bqer4drugey 8 28 them -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 8 29 to to TO work_rujstqwje5gkdm2bqer4drugey 8 30 train train VB work_rujstqwje5gkdm2bqer4drugey 8 31 statistical statistical JJ work_rujstqwje5gkdm2bqer4drugey 8 32 ma- ma- JJ work_rujstqwje5gkdm2bqer4drugey 8 33 chine chine JJ work_rujstqwje5gkdm2bqer4drugey 8 34 translation translation NN work_rujstqwje5gkdm2bqer4drugey 8 35 systems system NNS work_rujstqwje5gkdm2bqer4drugey 8 36 . . . work_rujstqwje5gkdm2bqer4drugey 9 1 1 1 CD work_rujstqwje5gkdm2bqer4drugey 9 2 Overview overview NN work_rujstqwje5gkdm2bqer4drugey 9 3 Crowdsourcing Crowdsourcing NNP work_rujstqwje5gkdm2bqer4drugey 9 4 is be VBZ work_rujstqwje5gkdm2bqer4drugey 9 5 a a DT work_rujstqwje5gkdm2bqer4drugey 9 6 promising promising JJ work_rujstqwje5gkdm2bqer4drugey 9 7 new new JJ work_rujstqwje5gkdm2bqer4drugey 9 8 mechanism mechanism NN work_rujstqwje5gkdm2bqer4drugey 9 9 for for IN work_rujstqwje5gkdm2bqer4drugey 9 10 collecting collect VBG work_rujstqwje5gkdm2bqer4drugey 9 11 data datum NNS work_rujstqwje5gkdm2bqer4drugey 9 12 for for IN work_rujstqwje5gkdm2bqer4drugey 9 13 natural natural JJ work_rujstqwje5gkdm2bqer4drugey 9 14 language language NN work_rujstqwje5gkdm2bqer4drugey 9 15 processing processing NN work_rujstqwje5gkdm2bqer4drugey 9 16 re- re- XX work_rujstqwje5gkdm2bqer4drugey 9 17 search search NN work_rujstqwje5gkdm2bqer4drugey 9 18 . . . work_rujstqwje5gkdm2bqer4drugey 10 1 Access access NN work_rujstqwje5gkdm2bqer4drugey 10 2 to to IN work_rujstqwje5gkdm2bqer4drugey 10 3 a a DT work_rujstqwje5gkdm2bqer4drugey 10 4 fast fast JJ work_rujstqwje5gkdm2bqer4drugey 10 5 , , , work_rujstqwje5gkdm2bqer4drugey 10 6 cheap cheap JJ work_rujstqwje5gkdm2bqer4drugey 10 7 , , , work_rujstqwje5gkdm2bqer4drugey 10 8 and and CC work_rujstqwje5gkdm2bqer4drugey 10 9 flexible flexible JJ work_rujstqwje5gkdm2bqer4drugey 10 10 work- work- NN work_rujstqwje5gkdm2bqer4drugey 10 11 force force NN work_rujstqwje5gkdm2bqer4drugey 10 12 allows allow VBZ work_rujstqwje5gkdm2bqer4drugey 10 13 us -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 10 14 to to TO work_rujstqwje5gkdm2bqer4drugey 10 15 collect collect VB work_rujstqwje5gkdm2bqer4drugey 10 16 new new JJ work_rujstqwje5gkdm2bqer4drugey 10 17 types type NNS work_rujstqwje5gkdm2bqer4drugey 10 18 of of IN work_rujstqwje5gkdm2bqer4drugey 10 19 data datum NNS work_rujstqwje5gkdm2bqer4drugey 10 20 , , , work_rujstqwje5gkdm2bqer4drugey 10 21 poten- poten- NN work_rujstqwje5gkdm2bqer4drugey 10 22 tially tially RB work_rujstqwje5gkdm2bqer4drugey 10 23 enabling enable VBG work_rujstqwje5gkdm2bqer4drugey 10 24 new new JJ work_rujstqwje5gkdm2bqer4drugey 10 25 language language NN work_rujstqwje5gkdm2bqer4drugey 10 26 technologies technology NNS work_rujstqwje5gkdm2bqer4drugey 10 27 . . . work_rujstqwje5gkdm2bqer4drugey 11 1 Because because IN work_rujstqwje5gkdm2bqer4drugey 11 2 crowdsourcing crowdsourcing JJ work_rujstqwje5gkdm2bqer4drugey 11 3 platforms platform NNS work_rujstqwje5gkdm2bqer4drugey 11 4 like like IN work_rujstqwje5gkdm2bqer4drugey 11 5 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 11 6 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 11 7 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 11 8 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 11 9 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 11 10 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 11 11 give give VBP work_rujstqwje5gkdm2bqer4drugey 11 12 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 11 13 access access NN work_rujstqwje5gkdm2bqer4drugey 11 14 to to IN work_rujstqwje5gkdm2bqer4drugey 11 15 a a DT work_rujstqwje5gkdm2bqer4drugey 11 16 world- world- NN work_rujstqwje5gkdm2bqer4drugey 11 17 wide wide JJ work_rujstqwje5gkdm2bqer4drugey 11 18 workforce workforce NN work_rujstqwje5gkdm2bqer4drugey 11 19 , , , work_rujstqwje5gkdm2bqer4drugey 11 20 one one CD work_rujstqwje5gkdm2bqer4drugey 11 21 obvious obvious JJ work_rujstqwje5gkdm2bqer4drugey 11 22 application application NN work_rujstqwje5gkdm2bqer4drugey 11 23 of of IN work_rujstqwje5gkdm2bqer4drugey 11 24 crowd- crowd- NN work_rujstqwje5gkdm2bqer4drugey 11 25 sourcing sourcing NN work_rujstqwje5gkdm2bqer4drugey 11 26 is be VBZ work_rujstqwje5gkdm2bqer4drugey 11 27 the the DT work_rujstqwje5gkdm2bqer4drugey 11 28 creation creation NN work_rujstqwje5gkdm2bqer4drugey 11 29 of of IN work_rujstqwje5gkdm2bqer4drugey 11 30 multilingual multilingual JJ work_rujstqwje5gkdm2bqer4drugey 11 31 technologies technology NNS work_rujstqwje5gkdm2bqer4drugey 11 32 . . . work_rujstqwje5gkdm2bqer4drugey 12 1 With with IN work_rujstqwje5gkdm2bqer4drugey 12 2 an an DT work_rujstqwje5gkdm2bqer4drugey 12 3 increasing increase VBG work_rujstqwje5gkdm2bqer4drugey 12 4 number number NN work_rujstqwje5gkdm2bqer4drugey 12 5 of of IN work_rujstqwje5gkdm2bqer4drugey 12 6 active active JJ work_rujstqwje5gkdm2bqer4drugey 12 7 crowd crowd NN work_rujstqwje5gkdm2bqer4drugey 12 8 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 12 9 located locate VBN work_rujstqwje5gkdm2bqer4drugey 12 10 outside outside RB work_rujstqwje5gkdm2bqer4drugey 12 11 of of IN work_rujstqwje5gkdm2bqer4drugey 12 12 the the DT work_rujstqwje5gkdm2bqer4drugey 12 13 United United NNP work_rujstqwje5gkdm2bqer4drugey 12 14 States States NNP work_rujstqwje5gkdm2bqer4drugey 12 15 , , , work_rujstqwje5gkdm2bqer4drugey 12 16 there there EX work_rujstqwje5gkdm2bqer4drugey 12 17 is be VBZ work_rujstqwje5gkdm2bqer4drugey 12 18 even even RB work_rujstqwje5gkdm2bqer4drugey 12 19 the the DT work_rujstqwje5gkdm2bqer4drugey 12 20 potential potential NN work_rujstqwje5gkdm2bqer4drugey 12 21 to to TO work_rujstqwje5gkdm2bqer4drugey 12 22 reach reach VB work_rujstqwje5gkdm2bqer4drugey 12 23 fluent fluent JJ work_rujstqwje5gkdm2bqer4drugey 12 24 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 12 25 of of IN work_rujstqwje5gkdm2bqer4drugey 12 26 lower low JJR work_rujstqwje5gkdm2bqer4drugey 12 27 resource resource NN work_rujstqwje5gkdm2bqer4drugey 12 28 languages language NNS work_rujstqwje5gkdm2bqer4drugey 12 29 . . . work_rujstqwje5gkdm2bqer4drugey 13 1 In in IN work_rujstqwje5gkdm2bqer4drugey 13 2 this this DT work_rujstqwje5gkdm2bqer4drugey 13 3 paper paper NN work_rujstqwje5gkdm2bqer4drugey 13 4 , , , work_rujstqwje5gkdm2bqer4drugey 13 5 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 13 6 investigate investigate VBP work_rujstqwje5gkdm2bqer4drugey 13 7 the the DT work_rujstqwje5gkdm2bqer4drugey 13 8 feasi- feasi- JJ work_rujstqwje5gkdm2bqer4drugey 13 9 bility bility NN work_rujstqwje5gkdm2bqer4drugey 13 10 of of IN work_rujstqwje5gkdm2bqer4drugey 13 11 hiring hire VBG work_rujstqwje5gkdm2bqer4drugey 13 12 language language NN work_rujstqwje5gkdm2bqer4drugey 13 13 informants informant NNS work_rujstqwje5gkdm2bqer4drugey 13 14 on on IN work_rujstqwje5gkdm2bqer4drugey 13 15 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 13 16 by by IN work_rujstqwje5gkdm2bqer4drugey 13 17 conducting conduct VBG work_rujstqwje5gkdm2bqer4drugey 13 18 the the DT work_rujstqwje5gkdm2bqer4drugey 13 19 first first JJ work_rujstqwje5gkdm2bqer4drugey 13 20 large large JJ work_rujstqwje5gkdm2bqer4drugey 13 21 - - HYPH work_rujstqwje5gkdm2bqer4drugey 13 22 scale scale NN work_rujstqwje5gkdm2bqer4drugey 13 23 demographic demographic JJ work_rujstqwje5gkdm2bqer4drugey 13 24 study study NN work_rujstqwje5gkdm2bqer4drugey 13 25 of of IN work_rujstqwje5gkdm2bqer4drugey 13 26 the the DT work_rujstqwje5gkdm2bqer4drugey 13 27 languages language NNS work_rujstqwje5gkdm2bqer4drugey 13 28 spoken speak VBN work_rujstqwje5gkdm2bqer4drugey 13 29 by by IN work_rujstqwje5gkdm2bqer4drugey 13 30 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 13 31 on on IN work_rujstqwje5gkdm2bqer4drugey 13 32 the the DT work_rujstqwje5gkdm2bqer4drugey 13 33 platform platform NN work_rujstqwje5gkdm2bqer4drugey 13 34 . . . work_rujstqwje5gkdm2bqer4drugey 14 1 There there EX work_rujstqwje5gkdm2bqer4drugey 14 2 are be VBP work_rujstqwje5gkdm2bqer4drugey 14 3 several several JJ work_rujstqwje5gkdm2bqer4drugey 14 4 complicating complicate VBG work_rujstqwje5gkdm2bqer4drugey 14 5 factors factor NNS work_rujstqwje5gkdm2bqer4drugey 14 6 when when WRB work_rujstqwje5gkdm2bqer4drugey 14 7 try- try- NNS work_rujstqwje5gkdm2bqer4drugey 14 8 ing ing NNP work_rujstqwje5gkdm2bqer4drugey 14 9 to to TO work_rujstqwje5gkdm2bqer4drugey 14 10 take take VB work_rujstqwje5gkdm2bqer4drugey 14 11 a a DT work_rujstqwje5gkdm2bqer4drugey 14 12 census census NN work_rujstqwje5gkdm2bqer4drugey 14 13 of of IN work_rujstqwje5gkdm2bqer4drugey 14 14 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 14 15 on on IN work_rujstqwje5gkdm2bqer4drugey 14 16 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 14 17 . . . work_rujstqwje5gkdm2bqer4drugey 15 1 The the DT work_rujstqwje5gkdm2bqer4drugey 15 2 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 15 3 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 15 4 identities identity NNS work_rujstqwje5gkdm2bqer4drugey 15 5 are be VBP work_rujstqwje5gkdm2bqer4drugey 15 6 anonymized anonymize VBN work_rujstqwje5gkdm2bqer4drugey 15 7 , , , work_rujstqwje5gkdm2bqer4drugey 15 8 and and CC work_rujstqwje5gkdm2bqer4drugey 15 9 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 15 10 provides provide VBZ work_rujstqwje5gkdm2bqer4drugey 15 11 no no DT work_rujstqwje5gkdm2bqer4drugey 15 12 information information NN work_rujstqwje5gkdm2bqer4drugey 15 13 about about IN work_rujstqwje5gkdm2bqer4drugey 15 14 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 15 15 countries country NNS work_rujstqwje5gkdm2bqer4drugey 15 16 of of IN work_rujstqwje5gkdm2bqer4drugey 15 17 ori- ori- DT work_rujstqwje5gkdm2bqer4drugey 15 18 gin gin NN work_rujstqwje5gkdm2bqer4drugey 15 19 or or CC work_rujstqwje5gkdm2bqer4drugey 15 20 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 15 21 language language NN work_rujstqwje5gkdm2bqer4drugey 15 22 abilities ability NNS work_rujstqwje5gkdm2bqer4drugey 15 23 . . . work_rujstqwje5gkdm2bqer4drugey 16 1 Posting post VBG work_rujstqwje5gkdm2bqer4drugey 16 2 a a DT work_rujstqwje5gkdm2bqer4drugey 16 3 simple simple JJ work_rujstqwje5gkdm2bqer4drugey 16 4 sur- sur- NN work_rujstqwje5gkdm2bqer4drugey 16 5 vey vey NN work_rujstqwje5gkdm2bqer4drugey 16 6 to to TO work_rujstqwje5gkdm2bqer4drugey 16 7 have have VB work_rujstqwje5gkdm2bqer4drugey 16 8 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 16 9 report report VB work_rujstqwje5gkdm2bqer4drugey 16 10 this this DT work_rujstqwje5gkdm2bqer4drugey 16 11 information information NN work_rujstqwje5gkdm2bqer4drugey 16 12 may may MD work_rujstqwje5gkdm2bqer4drugey 16 13 be be VB work_rujstqwje5gkdm2bqer4drugey 16 14 inadequate inadequate JJ work_rujstqwje5gkdm2bqer4drugey 16 15 , , , work_rujstqwje5gkdm2bqer4drugey 16 16 since since IN work_rujstqwje5gkdm2bqer4drugey 16 17 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 16 18 a a LS work_rujstqwje5gkdm2bqer4drugey 16 19 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 16 20 many many JJ work_rujstqwje5gkdm2bqer4drugey 16 21 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 16 22 may may MD work_rujstqwje5gkdm2bqer4drugey 16 23 never never RB work_rujstqwje5gkdm2bqer4drugey 16 24 see see VB work_rujstqwje5gkdm2bqer4drugey 16 25 the the DT work_rujstqwje5gkdm2bqer4drugey 16 26 survey survey NN work_rujstqwje5gkdm2bqer4drugey 16 27 , , , work_rujstqwje5gkdm2bqer4drugey 16 28 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 16 29 b b LS work_rujstqwje5gkdm2bqer4drugey 16 30 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 16 31 many many JJ work_rujstqwje5gkdm2bqer4drugey 16 32 opt opt VBP work_rujstqwje5gkdm2bqer4drugey 16 33 not not RB work_rujstqwje5gkdm2bqer4drugey 16 34 to to TO work_rujstqwje5gkdm2bqer4drugey 16 35 do do VB work_rujstqwje5gkdm2bqer4drugey 16 36 one one CD work_rujstqwje5gkdm2bqer4drugey 16 37 - - HYPH work_rujstqwje5gkdm2bqer4drugey 16 38 off off RP work_rujstqwje5gkdm2bqer4drugey 16 39 surveys survey NNS work_rujstqwje5gkdm2bqer4drugey 16 40 since since IN work_rujstqwje5gkdm2bqer4drugey 16 41 potential potential JJ work_rujstqwje5gkdm2bqer4drugey 16 42 payment payment NN work_rujstqwje5gkdm2bqer4drugey 16 43 is be VBZ work_rujstqwje5gkdm2bqer4drugey 16 44 low low JJ work_rujstqwje5gkdm2bqer4drugey 16 45 , , , work_rujstqwje5gkdm2bqer4drugey 16 46 and and CC work_rujstqwje5gkdm2bqer4drugey 16 47 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 16 48 c c NN work_rujstqwje5gkdm2bqer4drugey 16 49 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 16 50 validating validate VBG work_rujstqwje5gkdm2bqer4drugey 16 51 the the DT work_rujstqwje5gkdm2bqer4drugey 16 52 answers answer NNS work_rujstqwje5gkdm2bqer4drugey 16 53 of of IN work_rujstqwje5gkdm2bqer4drugey 16 54 respondents respondent NNS work_rujstqwje5gkdm2bqer4drugey 16 55 is be VBZ work_rujstqwje5gkdm2bqer4drugey 16 56 not not RB work_rujstqwje5gkdm2bqer4drugey 16 57 straightforward straightforward JJ work_rujstqwje5gkdm2bqer4drugey 16 58 . . . work_rujstqwje5gkdm2bqer4drugey 17 1 Our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 17 2 study study NN work_rujstqwje5gkdm2bqer4drugey 17 3 establishes establish VBZ work_rujstqwje5gkdm2bqer4drugey 17 4 a a DT work_rujstqwje5gkdm2bqer4drugey 17 5 methodology methodology NN work_rujstqwje5gkdm2bqer4drugey 17 6 for for IN work_rujstqwje5gkdm2bqer4drugey 17 7 deter- deter- NN work_rujstqwje5gkdm2bqer4drugey 17 8 mining mine VBG work_rujstqwje5gkdm2bqer4drugey 17 9 the the DT work_rujstqwje5gkdm2bqer4drugey 17 10 language language NN work_rujstqwje5gkdm2bqer4drugey 17 11 demographics demographic NNS work_rujstqwje5gkdm2bqer4drugey 17 12 of of IN work_rujstqwje5gkdm2bqer4drugey 17 13 anonymous anonymous JJ work_rujstqwje5gkdm2bqer4drugey 17 14 crowd crowd NN work_rujstqwje5gkdm2bqer4drugey 17 15 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 17 16 that that WDT work_rujstqwje5gkdm2bqer4drugey 17 17 is be VBZ work_rujstqwje5gkdm2bqer4drugey 17 18 more more RBR work_rujstqwje5gkdm2bqer4drugey 17 19 robust robust JJ work_rujstqwje5gkdm2bqer4drugey 17 20 than than IN work_rujstqwje5gkdm2bqer4drugey 17 21 simple simple JJ work_rujstqwje5gkdm2bqer4drugey 17 22 sur- sur- NN work_rujstqwje5gkdm2bqer4drugey 17 23 veying veying NN work_rujstqwje5gkdm2bqer4drugey 17 24 . . . work_rujstqwje5gkdm2bqer4drugey 18 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 18 2 ask ask VBP work_rujstqwje5gkdm2bqer4drugey 18 3 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 18 4 what what WDT work_rujstqwje5gkdm2bqer4drugey 18 5 languages language VBZ work_rujstqwje5gkdm2bqer4drugey 18 6 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 18 7 speak speak VBP work_rujstqwje5gkdm2bqer4drugey 18 8 and and CC work_rujstqwje5gkdm2bqer4drugey 18 9 what what WP work_rujstqwje5gkdm2bqer4drugey 18 10 country country NN work_rujstqwje5gkdm2bqer4drugey 18 11 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 18 12 live live VBP work_rujstqwje5gkdm2bqer4drugey 18 13 in in IN work_rujstqwje5gkdm2bqer4drugey 18 14 , , , work_rujstqwje5gkdm2bqer4drugey 18 15 and and CC work_rujstqwje5gkdm2bqer4drugey 18 16 validate validate VB work_rujstqwje5gkdm2bqer4drugey 18 17 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 18 18 claims claim NNS work_rujstqwje5gkdm2bqer4drugey 18 19 by by IN work_rujstqwje5gkdm2bqer4drugey 18 20 measuring measure VBG work_rujstqwje5gkdm2bqer4drugey 18 21 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 18 22 ability ability NN work_rujstqwje5gkdm2bqer4drugey 18 23 to to TO work_rujstqwje5gkdm2bqer4drugey 18 24 correctly correctly RB work_rujstqwje5gkdm2bqer4drugey 18 25 trans- trans- VB work_rujstqwje5gkdm2bqer4drugey 18 26 late late JJ work_rujstqwje5gkdm2bqer4drugey 18 27 words word NNS work_rujstqwje5gkdm2bqer4drugey 18 28 and and CC work_rujstqwje5gkdm2bqer4drugey 18 29 by by IN work_rujstqwje5gkdm2bqer4drugey 18 30 recording record VBG work_rujstqwje5gkdm2bqer4drugey 18 31 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 18 32 geolocation geolocation NN work_rujstqwje5gkdm2bqer4drugey 18 33 . . . work_rujstqwje5gkdm2bqer4drugey 19 1 To to TO work_rujstqwje5gkdm2bqer4drugey 19 2 increase increase VB work_rujstqwje5gkdm2bqer4drugey 19 3 the the DT work_rujstqwje5gkdm2bqer4drugey 19 4 visibility visibility NN work_rujstqwje5gkdm2bqer4drugey 19 5 and and CC work_rujstqwje5gkdm2bqer4drugey 19 6 the the DT work_rujstqwje5gkdm2bqer4drugey 19 7 desirability desirability NN work_rujstqwje5gkdm2bqer4drugey 19 8 of of IN work_rujstqwje5gkdm2bqer4drugey 19 9 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 19 10 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 19 11 , , , work_rujstqwje5gkdm2bqer4drugey 19 12 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 19 13 post post VBP work_rujstqwje5gkdm2bqer4drugey 19 14 1,000 1,000 CD work_rujstqwje5gkdm2bqer4drugey 19 15 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 19 16 in in IN work_rujstqwje5gkdm2bqer4drugey 19 17 each each DT work_rujstqwje5gkdm2bqer4drugey 19 18 of of IN work_rujstqwje5gkdm2bqer4drugey 19 19 100 100 CD work_rujstqwje5gkdm2bqer4drugey 19 20 lan- lan- NN work_rujstqwje5gkdm2bqer4drugey 19 21 guages guage NNS work_rujstqwje5gkdm2bqer4drugey 19 22 . . . work_rujstqwje5gkdm2bqer4drugey 20 1 These these DT work_rujstqwje5gkdm2bqer4drugey 20 2 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 20 3 each each DT work_rujstqwje5gkdm2bqer4drugey 20 4 consist consist VBP work_rujstqwje5gkdm2bqer4drugey 20 5 of of IN work_rujstqwje5gkdm2bqer4drugey 20 6 translating translate VBG work_rujstqwje5gkdm2bqer4drugey 20 7 10 10 CD work_rujstqwje5gkdm2bqer4drugey 20 8 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 20 9 words word NNS work_rujstqwje5gkdm2bqer4drugey 20 10 into into IN work_rujstqwje5gkdm2bqer4drugey 20 11 English English NNP work_rujstqwje5gkdm2bqer4drugey 20 12 . . . work_rujstqwje5gkdm2bqer4drugey 21 1 Two two CD work_rujstqwje5gkdm2bqer4drugey 21 2 of of IN work_rujstqwje5gkdm2bqer4drugey 21 3 the the DT work_rujstqwje5gkdm2bqer4drugey 21 4 10 10 CD work_rujstqwje5gkdm2bqer4drugey 21 5 words word NNS work_rujstqwje5gkdm2bqer4drugey 21 6 have have VBP work_rujstqwje5gkdm2bqer4drugey 21 7 known know VBN work_rujstqwje5gkdm2bqer4drugey 21 8 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 21 9 , , , work_rujstqwje5gkdm2bqer4drugey 21 10 allowing allow VBG work_rujstqwje5gkdm2bqer4drugey 21 11 us -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 21 12 to to TO work_rujstqwje5gkdm2bqer4drugey 21 13 validate validate VB work_rujstqwje5gkdm2bqer4drugey 21 14 that that IN work_rujstqwje5gkdm2bqer4drugey 21 15 the the DT work_rujstqwje5gkdm2bqer4drugey 21 16 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 21 17 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 21 18 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 21 19 are be VBP work_rujstqwje5gkdm2bqer4drugey 21 20 accurate accurate JJ work_rujstqwje5gkdm2bqer4drugey 21 21 . . . work_rujstqwje5gkdm2bqer4drugey 22 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 22 2 construct construct VBP work_rujstqwje5gkdm2bqer4drugey 22 3 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 22 4 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 22 5 with with IN work_rujstqwje5gkdm2bqer4drugey 22 6 up up IN work_rujstqwje5gkdm2bqer4drugey 22 7 to to TO work_rujstqwje5gkdm2bqer4drugey 22 8 10,000 10,000 CD work_rujstqwje5gkdm2bqer4drugey 22 9 entries entry NNS work_rujstqwje5gkdm2bqer4drugey 22 10 , , , work_rujstqwje5gkdm2bqer4drugey 22 11 with with IN work_rujstqwje5gkdm2bqer4drugey 22 12 the the DT work_rujstqwje5gkdm2bqer4drugey 22 13 majority majority NN work_rujstqwje5gkdm2bqer4drugey 22 14 of of IN work_rujstqwje5gkdm2bqer4drugey 22 15 entries entry NNS work_rujstqwje5gkdm2bqer4drugey 22 16 being be VBG work_rujstqwje5gkdm2bqer4drugey 22 17 new new JJ work_rujstqwje5gkdm2bqer4drugey 22 18 . . . work_rujstqwje5gkdm2bqer4drugey 23 1 Surveying survey VBG work_rujstqwje5gkdm2bqer4drugey 23 2 thousands thousand NNS work_rujstqwje5gkdm2bqer4drugey 23 3 of of IN work_rujstqwje5gkdm2bqer4drugey 23 4 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 23 5 allows allow VBZ work_rujstqwje5gkdm2bqer4drugey 23 6 us -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 23 7 to to TO work_rujstqwje5gkdm2bqer4drugey 23 8 ana- ana- RB work_rujstqwje5gkdm2bqer4drugey 23 9 lyze lyze VB work_rujstqwje5gkdm2bqer4drugey 23 10 current current JJ work_rujstqwje5gkdm2bqer4drugey 23 11 speaker speaker NN work_rujstqwje5gkdm2bqer4drugey 23 12 populations population NNS work_rujstqwje5gkdm2bqer4drugey 23 13 for for IN work_rujstqwje5gkdm2bqer4drugey 23 14 100 100 CD work_rujstqwje5gkdm2bqer4drugey 23 15 languages language NNS work_rujstqwje5gkdm2bqer4drugey 23 16 . . . work_rujstqwje5gkdm2bqer4drugey 24 1 79 79 CD work_rujstqwje5gkdm2bqer4drugey 24 2 Transactions transaction NNS work_rujstqwje5gkdm2bqer4drugey 24 3 of of IN work_rujstqwje5gkdm2bqer4drugey 24 4 the the DT work_rujstqwje5gkdm2bqer4drugey 24 5 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 24 6 for for IN work_rujstqwje5gkdm2bqer4drugey 24 7 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 24 8 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 24 9 , , , work_rujstqwje5gkdm2bqer4drugey 24 10 2 2 CD work_rujstqwje5gkdm2bqer4drugey 24 11 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 24 12 2014 2014 CD work_rujstqwje5gkdm2bqer4drugey 24 13 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 24 14 79–92 79–92 CD work_rujstqwje5gkdm2bqer4drugey 24 15 . . . work_rujstqwje5gkdm2bqer4drugey 25 1 Action Action NNP work_rujstqwje5gkdm2bqer4drugey 25 2 Editor Editor NNP work_rujstqwje5gkdm2bqer4drugey 25 3 : : : work_rujstqwje5gkdm2bqer4drugey 25 4 Mirella Mirella NNP work_rujstqwje5gkdm2bqer4drugey 25 5 Lapata Lapata NNP work_rujstqwje5gkdm2bqer4drugey 25 6 . . . work_rujstqwje5gkdm2bqer4drugey 26 1 Submitted submit VBN work_rujstqwje5gkdm2bqer4drugey 26 2 12/2013 12/2013 CD work_rujstqwje5gkdm2bqer4drugey 26 3 ; ; : work_rujstqwje5gkdm2bqer4drugey 26 4 Published publish VBN work_rujstqwje5gkdm2bqer4drugey 26 5 2/2014 2/2014 CD work_rujstqwje5gkdm2bqer4drugey 26 6 . . . work_rujstqwje5gkdm2bqer4drugey 27 1 c c NNP work_rujstqwje5gkdm2bqer4drugey 27 2 © © NNP work_rujstqwje5gkdm2bqer4drugey 27 3 2014 2014 CD work_rujstqwje5gkdm2bqer4drugey 27 4 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 27 5 for for IN work_rujstqwje5gkdm2bqer4drugey 27 6 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 27 7 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 27 8 . . . work_rujstqwje5gkdm2bqer4drugey 28 1 11/26/13 11/26/13 CD work_rujstqwje5gkdm2bqer4drugey 28 2 turkermap.html turkermap.html NNP work_rujstqwje5gkdm2bqer4drugey 28 3 file:///Users file:///Users NNPS work_rujstqwje5gkdm2bqer4drugey 28 4 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 5 ellie ellie NNS work_rujstqwje5gkdm2bqer4drugey 28 6 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 7 Documents Documents NNP work_rujstqwje5gkdm2bqer4drugey 28 8 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 9 Research Research NNP work_rujstqwje5gkdm2bqer4drugey 28 10 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 11 turker turker NN work_rujstqwje5gkdm2bqer4drugey 28 12 - - HYPH work_rujstqwje5gkdm2bqer4drugey 28 13 demographics demographic NNS work_rujstqwje5gkdm2bqer4drugey 28 14 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 15 code code NN work_rujstqwje5gkdm2bqer4drugey 28 16 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 17 src/20130905 src/20130905 NNP work_rujstqwje5gkdm2bqer4drugey 28 18 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 19 paper paper NN work_rujstqwje5gkdm2bqer4drugey 28 20 - - HYPH work_rujstqwje5gkdm2bqer4drugey 28 21 rewrite rewrite NN work_rujstqwje5gkdm2bqer4drugey 28 22 / / SYM work_rujstqwje5gkdm2bqer4drugey 28 23 turkermap.html turkermap.html NNS work_rujstqwje5gkdm2bqer4drugey 28 24 1/1 1/1 CD work_rujstqwje5gkdm2bqer4drugey 28 25 111 111 CD work_rujstqwje5gkdm2bqer4drugey 28 26 1,9981,9981,998 1,9981,9981,998 CD work_rujstqwje5gkdm2bqer4drugey 28 27 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 28 28 1 1 CD work_rujstqwje5gkdm2bqer4drugey 28 29 : : : work_rujstqwje5gkdm2bqer4drugey 28 30 The the DT work_rujstqwje5gkdm2bqer4drugey 28 31 number number NN work_rujstqwje5gkdm2bqer4drugey 28 32 of of IN work_rujstqwje5gkdm2bqer4drugey 28 33 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 28 34 per per IN work_rujstqwje5gkdm2bqer4drugey 28 35 country country NN work_rujstqwje5gkdm2bqer4drugey 28 36 . . . work_rujstqwje5gkdm2bqer4drugey 29 1 This this DT work_rujstqwje5gkdm2bqer4drugey 29 2 map map NN work_rujstqwje5gkdm2bqer4drugey 29 3 was be VBD work_rujstqwje5gkdm2bqer4drugey 29 4 generated generate VBN work_rujstqwje5gkdm2bqer4drugey 29 5 based base VBN work_rujstqwje5gkdm2bqer4drugey 29 6 on on IN work_rujstqwje5gkdm2bqer4drugey 29 7 geolocating geolocate VBG work_rujstqwje5gkdm2bqer4drugey 29 8 the the DT work_rujstqwje5gkdm2bqer4drugey 29 9 IP IP NNP work_rujstqwje5gkdm2bqer4drugey 29 10 address address NN work_rujstqwje5gkdm2bqer4drugey 29 11 of of IN work_rujstqwje5gkdm2bqer4drugey 29 12 4,983 4,983 CD work_rujstqwje5gkdm2bqer4drugey 29 13 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 29 14 in in IN work_rujstqwje5gkdm2bqer4drugey 29 15 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 29 16 study study NN work_rujstqwje5gkdm2bqer4drugey 29 17 . . . work_rujstqwje5gkdm2bqer4drugey 30 1 Omitted omit VBN work_rujstqwje5gkdm2bqer4drugey 30 2 are be VBP work_rujstqwje5gkdm2bqer4drugey 30 3 60 60 CD work_rujstqwje5gkdm2bqer4drugey 30 4 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 30 5 who who WP work_rujstqwje5gkdm2bqer4drugey 30 6 were be VBD work_rujstqwje5gkdm2bqer4drugey 30 7 located locate VBN work_rujstqwje5gkdm2bqer4drugey 30 8 in in IN work_rujstqwje5gkdm2bqer4drugey 30 9 more more JJR work_rujstqwje5gkdm2bqer4drugey 30 10 than than IN work_rujstqwje5gkdm2bqer4drugey 30 11 one one CD work_rujstqwje5gkdm2bqer4drugey 30 12 country country NN work_rujstqwje5gkdm2bqer4drugey 30 13 during during IN work_rujstqwje5gkdm2bqer4drugey 30 14 the the DT work_rujstqwje5gkdm2bqer4drugey 30 15 study study NN work_rujstqwje5gkdm2bqer4drugey 30 16 , , , work_rujstqwje5gkdm2bqer4drugey 30 17 and and CC work_rujstqwje5gkdm2bqer4drugey 30 18 238 238 CD work_rujstqwje5gkdm2bqer4drugey 30 19 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 30 20 who who WP work_rujstqwje5gkdm2bqer4drugey 30 21 could could MD work_rujstqwje5gkdm2bqer4drugey 30 22 not not RB work_rujstqwje5gkdm2bqer4drugey 30 23 be be VB work_rujstqwje5gkdm2bqer4drugey 30 24 geolocated geolocate VBN work_rujstqwje5gkdm2bqer4drugey 30 25 . . . work_rujstqwje5gkdm2bqer4drugey 31 1 The the DT work_rujstqwje5gkdm2bqer4drugey 31 2 size size NN work_rujstqwje5gkdm2bqer4drugey 31 3 of of IN work_rujstqwje5gkdm2bqer4drugey 31 4 the the DT work_rujstqwje5gkdm2bqer4drugey 31 5 circles circle NNS work_rujstqwje5gkdm2bqer4drugey 31 6 represents represent VBZ work_rujstqwje5gkdm2bqer4drugey 31 7 the the DT work_rujstqwje5gkdm2bqer4drugey 31 8 number number NN work_rujstqwje5gkdm2bqer4drugey 31 9 of of IN work_rujstqwje5gkdm2bqer4drugey 31 10 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 31 11 from from IN work_rujstqwje5gkdm2bqer4drugey 31 12 each each DT work_rujstqwje5gkdm2bqer4drugey 31 13 country country NN work_rujstqwje5gkdm2bqer4drugey 31 14 . . . work_rujstqwje5gkdm2bqer4drugey 32 1 The the DT work_rujstqwje5gkdm2bqer4drugey 32 2 two two CD work_rujstqwje5gkdm2bqer4drugey 32 3 largest large JJS work_rujstqwje5gkdm2bqer4drugey 32 4 are be VBP work_rujstqwje5gkdm2bqer4drugey 32 5 India India NNP work_rujstqwje5gkdm2bqer4drugey 32 6 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 32 7 1,998 1,998 CD work_rujstqwje5gkdm2bqer4drugey 32 8 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 32 9 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 32 10 and and CC work_rujstqwje5gkdm2bqer4drugey 32 11 the the DT work_rujstqwje5gkdm2bqer4drugey 32 12 United United NNP work_rujstqwje5gkdm2bqer4drugey 32 13 States States NNP work_rujstqwje5gkdm2bqer4drugey 32 14 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 32 15 866 866 CD work_rujstqwje5gkdm2bqer4drugey 32 16 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 32 17 . . . work_rujstqwje5gkdm2bqer4drugey 33 1 To to TO work_rujstqwje5gkdm2bqer4drugey 33 2 calibrate calibrate VB work_rujstqwje5gkdm2bqer4drugey 33 3 the the DT work_rujstqwje5gkdm2bqer4drugey 33 4 sizes size NNS work_rujstqwje5gkdm2bqer4drugey 33 5 : : : work_rujstqwje5gkdm2bqer4drugey 33 6 the the DT work_rujstqwje5gkdm2bqer4drugey 33 7 Philippines Philippines NNP work_rujstqwje5gkdm2bqer4drugey 33 8 has have VBZ work_rujstqwje5gkdm2bqer4drugey 33 9 142 142 CD work_rujstqwje5gkdm2bqer4drugey 33 10 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 33 11 , , , work_rujstqwje5gkdm2bqer4drugey 33 12 Egypt Egypt NNP work_rujstqwje5gkdm2bqer4drugey 33 13 has have VBZ work_rujstqwje5gkdm2bqer4drugey 33 14 25 25 CD work_rujstqwje5gkdm2bqer4drugey 33 15 , , , work_rujstqwje5gkdm2bqer4drugey 33 16 Russia Russia NNP work_rujstqwje5gkdm2bqer4drugey 33 17 has have VBZ work_rujstqwje5gkdm2bqer4drugey 33 18 10 10 CD work_rujstqwje5gkdm2bqer4drugey 33 19 , , , work_rujstqwje5gkdm2bqer4drugey 33 20 and and CC work_rujstqwje5gkdm2bqer4drugey 33 21 Sri Sri NNP work_rujstqwje5gkdm2bqer4drugey 33 22 Lanka Lanka NNP work_rujstqwje5gkdm2bqer4drugey 33 23 has have VBZ work_rujstqwje5gkdm2bqer4drugey 33 24 4 4 CD work_rujstqwje5gkdm2bqer4drugey 33 25 . . . work_rujstqwje5gkdm2bqer4drugey 34 1 The the DT work_rujstqwje5gkdm2bqer4drugey 34 2 data datum NNS work_rujstqwje5gkdm2bqer4drugey 34 3 also also RB work_rujstqwje5gkdm2bqer4drugey 34 4 allows allow VBZ work_rujstqwje5gkdm2bqer4drugey 34 5 us -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 34 6 to to TO work_rujstqwje5gkdm2bqer4drugey 34 7 answer answer VB work_rujstqwje5gkdm2bqer4drugey 34 8 questions question NNS work_rujstqwje5gkdm2bqer4drugey 34 9 like like IN work_rujstqwje5gkdm2bqer4drugey 34 10 : : : work_rujstqwje5gkdm2bqer4drugey 34 11 How how WRB work_rujstqwje5gkdm2bqer4drugey 34 12 quickly quickly RB work_rujstqwje5gkdm2bqer4drugey 34 13 is be VBZ work_rujstqwje5gkdm2bqer4drugey 34 14 work work NN work_rujstqwje5gkdm2bqer4drugey 34 15 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 34 16 in in IN work_rujstqwje5gkdm2bqer4drugey 34 17 a a DT work_rujstqwje5gkdm2bqer4drugey 34 18 given give VBN work_rujstqwje5gkdm2bqer4drugey 34 19 language language NN work_rujstqwje5gkdm2bqer4drugey 34 20 ? ? . work_rujstqwje5gkdm2bqer4drugey 35 1 Are be VBP work_rujstqwje5gkdm2bqer4drugey 35 2 crowdsourced crowdsourced JJ work_rujstqwje5gkdm2bqer4drugey 35 3 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 35 4 reliably reliably RB work_rujstqwje5gkdm2bqer4drugey 35 5 good good JJ work_rujstqwje5gkdm2bqer4drugey 35 6 ? ? . work_rujstqwje5gkdm2bqer4drugey 36 1 How how WRB work_rujstqwje5gkdm2bqer4drugey 36 2 often often RB work_rujstqwje5gkdm2bqer4drugey 36 3 do do VBP work_rujstqwje5gkdm2bqer4drugey 36 4 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 36 5 misrepresent misrepresent VB work_rujstqwje5gkdm2bqer4drugey 36 6 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 36 7 language language NN work_rujstqwje5gkdm2bqer4drugey 36 8 abili- abili- NN work_rujstqwje5gkdm2bqer4drugey 36 9 ties tie NNS work_rujstqwje5gkdm2bqer4drugey 36 10 to to TO work_rujstqwje5gkdm2bqer4drugey 36 11 obtain obtain VB work_rujstqwje5gkdm2bqer4drugey 36 12 financial financial JJ work_rujstqwje5gkdm2bqer4drugey 36 13 rewards reward NNS work_rujstqwje5gkdm2bqer4drugey 36 14 ? ? . work_rujstqwje5gkdm2bqer4drugey 37 1 2 2 CD work_rujstqwje5gkdm2bqer4drugey 37 2 Background Background NNP work_rujstqwje5gkdm2bqer4drugey 37 3 and and CC work_rujstqwje5gkdm2bqer4drugey 37 4 Related Related NNP work_rujstqwje5gkdm2bqer4drugey 37 5 Work Work NNP work_rujstqwje5gkdm2bqer4drugey 37 6 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 37 7 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 37 8 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 37 9 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 37 10 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 37 11 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 37 12 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 37 13 is be VBZ work_rujstqwje5gkdm2bqer4drugey 37 14 an an DT work_rujstqwje5gkdm2bqer4drugey 37 15 on- on- NNP work_rujstqwje5gkdm2bqer4drugey 37 16 line line NN work_rujstqwje5gkdm2bqer4drugey 37 17 marketplace marketplace NN work_rujstqwje5gkdm2bqer4drugey 37 18 for for IN work_rujstqwje5gkdm2bqer4drugey 37 19 work work NN work_rujstqwje5gkdm2bqer4drugey 37 20 that that WDT work_rujstqwje5gkdm2bqer4drugey 37 21 gives give VBZ work_rujstqwje5gkdm2bqer4drugey 37 22 employers employer NNS work_rujstqwje5gkdm2bqer4drugey 37 23 and and CC work_rujstqwje5gkdm2bqer4drugey 37 24 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 37 25 access access VBP work_rujstqwje5gkdm2bqer4drugey 37 26 to to IN work_rujstqwje5gkdm2bqer4drugey 37 27 a a DT work_rujstqwje5gkdm2bqer4drugey 37 28 large large JJ work_rujstqwje5gkdm2bqer4drugey 37 29 , , , work_rujstqwje5gkdm2bqer4drugey 37 30 low low JJ work_rujstqwje5gkdm2bqer4drugey 37 31 - - HYPH work_rujstqwje5gkdm2bqer4drugey 37 32 cost cost NN work_rujstqwje5gkdm2bqer4drugey 37 33 work- work- NN work_rujstqwje5gkdm2bqer4drugey 37 34 force force NN work_rujstqwje5gkdm2bqer4drugey 37 35 . . . work_rujstqwje5gkdm2bqer4drugey 38 1 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 38 2 allows allow VBZ work_rujstqwje5gkdm2bqer4drugey 38 3 employers employer NNS work_rujstqwje5gkdm2bqer4drugey 38 4 to to TO work_rujstqwje5gkdm2bqer4drugey 38 5 provide provide VB work_rujstqwje5gkdm2bqer4drugey 38 6 micro- micro- NN work_rujstqwje5gkdm2bqer4drugey 38 7 payments payment NNS work_rujstqwje5gkdm2bqer4drugey 38 8 in in IN work_rujstqwje5gkdm2bqer4drugey 38 9 return return NN work_rujstqwje5gkdm2bqer4drugey 38 10 for for IN work_rujstqwje5gkdm2bqer4drugey 38 11 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 38 12 completing complete VBG work_rujstqwje5gkdm2bqer4drugey 38 13 micro- micro- NN work_rujstqwje5gkdm2bqer4drugey 38 14 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 38 15 . . . work_rujstqwje5gkdm2bqer4drugey 39 1 The the DT work_rujstqwje5gkdm2bqer4drugey 39 2 basic basic JJ work_rujstqwje5gkdm2bqer4drugey 39 3 units unit NNS work_rujstqwje5gkdm2bqer4drugey 39 4 of of IN work_rujstqwje5gkdm2bqer4drugey 39 5 work work NN work_rujstqwje5gkdm2bqer4drugey 39 6 on on IN work_rujstqwje5gkdm2bqer4drugey 39 7 MTurk MTurk NNS work_rujstqwje5gkdm2bqer4drugey 39 8 are be VBP work_rujstqwje5gkdm2bqer4drugey 39 9 called call VBN work_rujstqwje5gkdm2bqer4drugey 39 10 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 39 11 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 39 12 Intelligence Intelligence NNP work_rujstqwje5gkdm2bqer4drugey 39 13 Tasks Tasks NNPS work_rujstqwje5gkdm2bqer4drugey 39 14 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 39 15 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 39 16 HITs HITs NNP work_rujstqwje5gkdm2bqer4drugey 39 17 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 39 18 . . . work_rujstqwje5gkdm2bqer4drugey 40 1 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 40 2 was be VBD work_rujstqwje5gkdm2bqer4drugey 40 3 de- de- RB work_rujstqwje5gkdm2bqer4drugey 40 4 signed sign VBN work_rujstqwje5gkdm2bqer4drugey 40 5 to to TO work_rujstqwje5gkdm2bqer4drugey 40 6 accommodate accommodate VB work_rujstqwje5gkdm2bqer4drugey 40 7 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 40 8 that that WDT work_rujstqwje5gkdm2bqer4drugey 40 9 are be VBP work_rujstqwje5gkdm2bqer4drugey 40 10 difficult difficult JJ work_rujstqwje5gkdm2bqer4drugey 40 11 for for IN work_rujstqwje5gkdm2bqer4drugey 40 12 computers computer NNS work_rujstqwje5gkdm2bqer4drugey 40 13 , , , work_rujstqwje5gkdm2bqer4drugey 40 14 but but CC work_rujstqwje5gkdm2bqer4drugey 40 15 simple simple JJ work_rujstqwje5gkdm2bqer4drugey 40 16 for for IN work_rujstqwje5gkdm2bqer4drugey 40 17 people people NNS work_rujstqwje5gkdm2bqer4drugey 40 18 . . . work_rujstqwje5gkdm2bqer4drugey 41 1 This this DT work_rujstqwje5gkdm2bqer4drugey 41 2 facilitates facilitate VBZ work_rujstqwje5gkdm2bqer4drugey 41 3 research research NN work_rujstqwje5gkdm2bqer4drugey 41 4 into into IN work_rujstqwje5gkdm2bqer4drugey 41 5 human human JJ work_rujstqwje5gkdm2bqer4drugey 41 6 computation computation NN work_rujstqwje5gkdm2bqer4drugey 41 7 , , , work_rujstqwje5gkdm2bqer4drugey 41 8 where where WRB work_rujstqwje5gkdm2bqer4drugey 41 9 people people NNS work_rujstqwje5gkdm2bqer4drugey 41 10 can can MD work_rujstqwje5gkdm2bqer4drugey 41 11 be be VB work_rujstqwje5gkdm2bqer4drugey 41 12 treated treat VBN work_rujstqwje5gkdm2bqer4drugey 41 13 as as IN work_rujstqwje5gkdm2bqer4drugey 41 14 a a DT work_rujstqwje5gkdm2bqer4drugey 41 15 function function NN work_rujstqwje5gkdm2bqer4drugey 41 16 call call NN work_rujstqwje5gkdm2bqer4drugey 41 17 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 41 18 von von NNP work_rujstqwje5gkdm2bqer4drugey 41 19 Ahn Ahn NNP work_rujstqwje5gkdm2bqer4drugey 41 20 , , , work_rujstqwje5gkdm2bqer4drugey 41 21 2005 2005 CD work_rujstqwje5gkdm2bqer4drugey 41 22 ; ; : work_rujstqwje5gkdm2bqer4drugey 41 23 Little Little NNP work_rujstqwje5gkdm2bqer4drugey 41 24 et et FW work_rujstqwje5gkdm2bqer4drugey 41 25 al al NNP work_rujstqwje5gkdm2bqer4drugey 41 26 . . NNP work_rujstqwje5gkdm2bqer4drugey 41 27 , , , work_rujstqwje5gkdm2bqer4drugey 41 28 2009 2009 CD work_rujstqwje5gkdm2bqer4drugey 41 29 ; ; : work_rujstqwje5gkdm2bqer4drugey 41 30 Quinn Quinn NNP work_rujstqwje5gkdm2bqer4drugey 41 31 and and CC work_rujstqwje5gkdm2bqer4drugey 41 32 Bederson Bederson NNP work_rujstqwje5gkdm2bqer4drugey 41 33 , , , work_rujstqwje5gkdm2bqer4drugey 41 34 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 41 35 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 41 36 . . . work_rujstqwje5gkdm2bqer4drugey 42 1 It -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 42 2 has have VBZ work_rujstqwje5gkdm2bqer4drugey 42 3 appli- appli- NNP work_rujstqwje5gkdm2bqer4drugey 42 4 cation cation NN work_rujstqwje5gkdm2bqer4drugey 42 5 to to IN work_rujstqwje5gkdm2bqer4drugey 42 6 research research NN work_rujstqwje5gkdm2bqer4drugey 42 7 areas area NNS work_rujstqwje5gkdm2bqer4drugey 42 8 like like IN work_rujstqwje5gkdm2bqer4drugey 42 9 human human JJ work_rujstqwje5gkdm2bqer4drugey 42 10 - - HYPH work_rujstqwje5gkdm2bqer4drugey 42 11 computer computer NN work_rujstqwje5gkdm2bqer4drugey 42 12 inter- inter- NN work_rujstqwje5gkdm2bqer4drugey 42 13 action action NN work_rujstqwje5gkdm2bqer4drugey 42 14 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 42 15 Bigham Bigham NNP work_rujstqwje5gkdm2bqer4drugey 42 16 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 17 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 18 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 19 , , , work_rujstqwje5gkdm2bqer4drugey 42 20 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 21 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 22 Bernstein Bernstein NNP work_rujstqwje5gkdm2bqer4drugey 42 23 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 24 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 25 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 26 , , , work_rujstqwje5gkdm2bqer4drugey 42 27 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 28 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 42 29 , , , work_rujstqwje5gkdm2bqer4drugey 42 30 computer computer NN work_rujstqwje5gkdm2bqer4drugey 42 31 vision vision NN work_rujstqwje5gkdm2bqer4drugey 42 32 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 42 33 Sorokin Sorokin NNP work_rujstqwje5gkdm2bqer4drugey 42 34 and and CC work_rujstqwje5gkdm2bqer4drugey 42 35 Forsyth Forsyth NNP work_rujstqwje5gkdm2bqer4drugey 42 36 , , , work_rujstqwje5gkdm2bqer4drugey 42 37 2008 2008 CD work_rujstqwje5gkdm2bqer4drugey 42 38 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 39 Deng Deng NNP work_rujstqwje5gkdm2bqer4drugey 42 40 et et FW work_rujstqwje5gkdm2bqer4drugey 42 41 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 42 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 43 , , , work_rujstqwje5gkdm2bqer4drugey 42 44 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 45 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 46 Rashtchian Rashtchian NNP work_rujstqwje5gkdm2bqer4drugey 42 47 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 48 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 49 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 50 , , , work_rujstqwje5gkdm2bqer4drugey 42 51 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 52 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 42 53 , , , work_rujstqwje5gkdm2bqer4drugey 42 54 speech speech NN work_rujstqwje5gkdm2bqer4drugey 42 55 pro- pro- NN work_rujstqwje5gkdm2bqer4drugey 42 56 cessing cessing NN work_rujstqwje5gkdm2bqer4drugey 42 57 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 42 58 Marge Marge NNP work_rujstqwje5gkdm2bqer4drugey 42 59 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 60 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 61 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 62 , , , work_rujstqwje5gkdm2bqer4drugey 42 63 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 64 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 65 Lane Lane NNP work_rujstqwje5gkdm2bqer4drugey 42 66 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 67 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 68 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 69 , , , work_rujstqwje5gkdm2bqer4drugey 42 70 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 71 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 72 Parent Parent NNP work_rujstqwje5gkdm2bqer4drugey 42 73 and and CC work_rujstqwje5gkdm2bqer4drugey 42 74 Eskenazi Eskenazi NNP work_rujstqwje5gkdm2bqer4drugey 42 75 , , , work_rujstqwje5gkdm2bqer4drugey 42 76 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 42 77 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 78 Eskenazi Eskenazi NNP work_rujstqwje5gkdm2bqer4drugey 42 79 et et FW work_rujstqwje5gkdm2bqer4drugey 42 80 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 81 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 82 , , , work_rujstqwje5gkdm2bqer4drugey 42 83 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 42 84 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 42 85 , , , work_rujstqwje5gkdm2bqer4drugey 42 86 and and CC work_rujstqwje5gkdm2bqer4drugey 42 87 natu- natu- JJ work_rujstqwje5gkdm2bqer4drugey 42 88 ral ral JJ work_rujstqwje5gkdm2bqer4drugey 42 89 language language NN work_rujstqwje5gkdm2bqer4drugey 42 90 processing processing NN work_rujstqwje5gkdm2bqer4drugey 42 91 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 42 92 Snow Snow NNP work_rujstqwje5gkdm2bqer4drugey 42 93 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 94 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 95 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 96 , , , work_rujstqwje5gkdm2bqer4drugey 42 97 2008 2008 CD work_rujstqwje5gkdm2bqer4drugey 42 98 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 99 Callison- Callison- NNP work_rujstqwje5gkdm2bqer4drugey 42 100 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 42 101 and and CC work_rujstqwje5gkdm2bqer4drugey 42 102 Dredze Dredze NNP work_rujstqwje5gkdm2bqer4drugey 42 103 , , , work_rujstqwje5gkdm2bqer4drugey 42 104 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 42 105 ; ; : work_rujstqwje5gkdm2bqer4drugey 42 106 Laws Laws NNP work_rujstqwje5gkdm2bqer4drugey 42 107 et et NNP work_rujstqwje5gkdm2bqer4drugey 42 108 al al NNP work_rujstqwje5gkdm2bqer4drugey 42 109 . . NNP work_rujstqwje5gkdm2bqer4drugey 42 110 , , , work_rujstqwje5gkdm2bqer4drugey 42 111 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 42 112 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 42 113 . . . work_rujstqwje5gkdm2bqer4drugey 43 1 On on IN work_rujstqwje5gkdm2bqer4drugey 43 2 MTurk mturk CD work_rujstqwje5gkdm2bqer4drugey 43 3 , , , work_rujstqwje5gkdm2bqer4drugey 43 4 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 43 5 who who WP work_rujstqwje5gkdm2bqer4drugey 43 6 need need VBP work_rujstqwje5gkdm2bqer4drugey 43 7 work work NN work_rujstqwje5gkdm2bqer4drugey 43 8 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 43 9 are be VBP work_rujstqwje5gkdm2bqer4drugey 43 10 called call VBN work_rujstqwje5gkdm2bqer4drugey 43 11 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 43 12 Requesters Requesters NNPS work_rujstqwje5gkdm2bqer4drugey 43 13 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 43 14 , , , work_rujstqwje5gkdm2bqer4drugey 43 15 and and CC work_rujstqwje5gkdm2bqer4drugey 43 16 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 43 17 are be VBP work_rujstqwje5gkdm2bqer4drugey 43 18 often often RB work_rujstqwje5gkdm2bqer4drugey 43 19 re- re- RB work_rujstqwje5gkdm2bqer4drugey 43 20 ferred ferre VBN work_rujstqwje5gkdm2bqer4drugey 43 21 to to IN work_rujstqwje5gkdm2bqer4drugey 43 22 as as IN work_rujstqwje5gkdm2bqer4drugey 43 23 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 43 24 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 43 25 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 43 26 . . . work_rujstqwje5gkdm2bqer4drugey 44 1 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 44 2 is be VBZ work_rujstqwje5gkdm2bqer4drugey 44 3 a a DT work_rujstqwje5gkdm2bqer4drugey 44 4 true true JJ work_rujstqwje5gkdm2bqer4drugey 44 5 market market NN work_rujstqwje5gkdm2bqer4drugey 44 6 , , , work_rujstqwje5gkdm2bqer4drugey 44 7 mean- mean- NN work_rujstqwje5gkdm2bqer4drugey 44 8 ing ing NNP work_rujstqwje5gkdm2bqer4drugey 44 9 that that IN work_rujstqwje5gkdm2bqer4drugey 44 10 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 44 11 are be VBP work_rujstqwje5gkdm2bqer4drugey 44 12 free free JJ work_rujstqwje5gkdm2bqer4drugey 44 13 to to TO work_rujstqwje5gkdm2bqer4drugey 44 14 choose choose VB work_rujstqwje5gkdm2bqer4drugey 44 15 to to TO work_rujstqwje5gkdm2bqer4drugey 44 16 complete complete VB work_rujstqwje5gkdm2bqer4drugey 44 17 the the DT work_rujstqwje5gkdm2bqer4drugey 44 18 HITs hit NNS work_rujstqwje5gkdm2bqer4drugey 44 19 which which WDT work_rujstqwje5gkdm2bqer4drugey 44 20 interest interest VBP work_rujstqwje5gkdm2bqer4drugey 44 21 them -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 44 22 , , , work_rujstqwje5gkdm2bqer4drugey 44 23 and and CC work_rujstqwje5gkdm2bqer4drugey 44 24 Requesters requester NNS work_rujstqwje5gkdm2bqer4drugey 44 25 can can MD work_rujstqwje5gkdm2bqer4drugey 44 26 price price VB work_rujstqwje5gkdm2bqer4drugey 44 27 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 44 28 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 44 29 competitively competitively RB work_rujstqwje5gkdm2bqer4drugey 44 30 to to TO work_rujstqwje5gkdm2bqer4drugey 44 31 try try VB work_rujstqwje5gkdm2bqer4drugey 44 32 to to TO work_rujstqwje5gkdm2bqer4drugey 44 33 attract attract VB work_rujstqwje5gkdm2bqer4drugey 44 34 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 44 35 and and CC work_rujstqwje5gkdm2bqer4drugey 44 36 have have VBP work_rujstqwje5gkdm2bqer4drugey 44 37 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 44 38 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 44 39 done do VBN work_rujstqwje5gkdm2bqer4drugey 44 40 quickly quickly RB work_rujstqwje5gkdm2bqer4drugey 44 41 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 44 42 Faridani Faridani NNP work_rujstqwje5gkdm2bqer4drugey 44 43 et et FW work_rujstqwje5gkdm2bqer4drugey 44 44 al al NNP work_rujstqwje5gkdm2bqer4drugey 44 45 . . NNP work_rujstqwje5gkdm2bqer4drugey 44 46 , , , work_rujstqwje5gkdm2bqer4drugey 44 47 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 44 48 ; ; : work_rujstqwje5gkdm2bqer4drugey 44 49 Singer Singer NNP work_rujstqwje5gkdm2bqer4drugey 44 50 and and CC work_rujstqwje5gkdm2bqer4drugey 44 51 Mittal Mittal NNP work_rujstqwje5gkdm2bqer4drugey 44 52 , , , work_rujstqwje5gkdm2bqer4drugey 44 53 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 44 54 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 44 55 . . . work_rujstqwje5gkdm2bqer4drugey 45 1 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 45 2 remain remain VBP work_rujstqwje5gkdm2bqer4drugey 45 3 anony- anony- NN work_rujstqwje5gkdm2bqer4drugey 45 4 mous mous JJ work_rujstqwje5gkdm2bqer4drugey 45 5 to to IN work_rujstqwje5gkdm2bqer4drugey 45 6 Requesters Requesters NNPS work_rujstqwje5gkdm2bqer4drugey 45 7 , , , work_rujstqwje5gkdm2bqer4drugey 45 8 and and CC work_rujstqwje5gkdm2bqer4drugey 45 9 all all DT work_rujstqwje5gkdm2bqer4drugey 45 10 payment payment NN work_rujstqwje5gkdm2bqer4drugey 45 11 occurs occur VBZ work_rujstqwje5gkdm2bqer4drugey 45 12 through through IN work_rujstqwje5gkdm2bqer4drugey 45 13 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 45 14 . . . work_rujstqwje5gkdm2bqer4drugey 46 1 Requesters requester NNS work_rujstqwje5gkdm2bqer4drugey 46 2 are be VBP work_rujstqwje5gkdm2bqer4drugey 46 3 able able JJ work_rujstqwje5gkdm2bqer4drugey 46 4 to to TO work_rujstqwje5gkdm2bqer4drugey 46 5 accept accept VB work_rujstqwje5gkdm2bqer4drugey 46 6 submitted submitted JJ work_rujstqwje5gkdm2bqer4drugey 46 7 work work NN work_rujstqwje5gkdm2bqer4drugey 46 8 or or CC work_rujstqwje5gkdm2bqer4drugey 46 9 reject reject VB work_rujstqwje5gkdm2bqer4drugey 46 10 work work NN work_rujstqwje5gkdm2bqer4drugey 46 11 that that WDT work_rujstqwje5gkdm2bqer4drugey 46 12 does do VBZ work_rujstqwje5gkdm2bqer4drugey 46 13 not not RB work_rujstqwje5gkdm2bqer4drugey 46 14 meet meet VB work_rujstqwje5gkdm2bqer4drugey 46 15 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 46 16 stan- stan- JJ work_rujstqwje5gkdm2bqer4drugey 46 17 dards dard NNS work_rujstqwje5gkdm2bqer4drugey 46 18 . . . work_rujstqwje5gkdm2bqer4drugey 47 1 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 47 2 are be VBP work_rujstqwje5gkdm2bqer4drugey 47 3 only only RB work_rujstqwje5gkdm2bqer4drugey 47 4 paid pay VBN work_rujstqwje5gkdm2bqer4drugey 47 5 if if IN work_rujstqwje5gkdm2bqer4drugey 47 6 a a DT work_rujstqwje5gkdm2bqer4drugey 47 7 Requester Requester NNP work_rujstqwje5gkdm2bqer4drugey 47 8 accepts accept VBZ work_rujstqwje5gkdm2bqer4drugey 47 9 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 47 10 work work NN work_rujstqwje5gkdm2bqer4drugey 47 11 . . . work_rujstqwje5gkdm2bqer4drugey 48 1 Several several JJ work_rujstqwje5gkdm2bqer4drugey 48 2 reports report NNS work_rujstqwje5gkdm2bqer4drugey 48 3 examine examine VBP work_rujstqwje5gkdm2bqer4drugey 48 4 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 48 5 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 48 6 as as IN work_rujstqwje5gkdm2bqer4drugey 48 7 an an DT work_rujstqwje5gkdm2bqer4drugey 48 8 economic economic JJ work_rujstqwje5gkdm2bqer4drugey 48 9 market market NN work_rujstqwje5gkdm2bqer4drugey 48 10 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 48 11 Ipeirotis ipeirotis VB work_rujstqwje5gkdm2bqer4drugey 48 12 , , , work_rujstqwje5gkdm2bqer4drugey 48 13 2010a 2010a NNS work_rujstqwje5gkdm2bqer4drugey 48 14 ; ; : work_rujstqwje5gkdm2bqer4drugey 48 15 Lehdonvirta Lehdonvirta NNP work_rujstqwje5gkdm2bqer4drugey 48 16 and and CC work_rujstqwje5gkdm2bqer4drugey 48 17 Ernkvist Ernkvist NNP work_rujstqwje5gkdm2bqer4drugey 48 18 , , , work_rujstqwje5gkdm2bqer4drugey 48 19 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 48 20 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 48 21 . . . work_rujstqwje5gkdm2bqer4drugey 49 1 When when WRB work_rujstqwje5gkdm2bqer4drugey 49 2 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 49 3 introduced introduce VBD work_rujstqwje5gkdm2bqer4drugey 49 4 MTurk mturk CD work_rujstqwje5gkdm2bqer4drugey 49 5 , , , work_rujstqwje5gkdm2bqer4drugey 49 6 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 49 7 first first RB work_rujstqwje5gkdm2bqer4drugey 49 8 offered offer VBD work_rujstqwje5gkdm2bqer4drugey 49 9 payment payment NN work_rujstqwje5gkdm2bqer4drugey 49 10 only only RB work_rujstqwje5gkdm2bqer4drugey 49 11 in in IN work_rujstqwje5gkdm2bqer4drugey 49 12 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 49 13 credits credit NNS work_rujstqwje5gkdm2bqer4drugey 49 14 , , , work_rujstqwje5gkdm2bqer4drugey 49 15 and and CC work_rujstqwje5gkdm2bqer4drugey 49 16 later later RB work_rujstqwje5gkdm2bqer4drugey 49 17 offered offer VBD work_rujstqwje5gkdm2bqer4drugey 49 18 direct direct JJ work_rujstqwje5gkdm2bqer4drugey 49 19 payment payment NN work_rujstqwje5gkdm2bqer4drugey 49 20 in in IN work_rujstqwje5gkdm2bqer4drugey 49 21 US US NNP work_rujstqwje5gkdm2bqer4drugey 49 22 dollars dollar NNS work_rujstqwje5gkdm2bqer4drugey 49 23 . . . work_rujstqwje5gkdm2bqer4drugey 50 1 More more RBR work_rujstqwje5gkdm2bqer4drugey 50 2 re- re- RB work_rujstqwje5gkdm2bqer4drugey 50 3 cently cently RB work_rujstqwje5gkdm2bqer4drugey 50 4 , , , work_rujstqwje5gkdm2bqer4drugey 50 5 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 50 6 has have VBZ work_rujstqwje5gkdm2bqer4drugey 50 7 expanded expand VBN work_rujstqwje5gkdm2bqer4drugey 50 8 to to TO work_rujstqwje5gkdm2bqer4drugey 50 9 include include VB work_rujstqwje5gkdm2bqer4drugey 50 10 one one CD work_rujstqwje5gkdm2bqer4drugey 50 11 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 50 12 cur- cur- NN work_rujstqwje5gkdm2bqer4drugey 50 13 rency rency NN work_rujstqwje5gkdm2bqer4drugey 50 14 , , , work_rujstqwje5gkdm2bqer4drugey 50 15 the the DT work_rujstqwje5gkdm2bqer4drugey 50 16 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 50 17 rupee rupee NN work_rujstqwje5gkdm2bqer4drugey 50 18 . . . work_rujstqwje5gkdm2bqer4drugey 51 1 Despite despite IN work_rujstqwje5gkdm2bqer4drugey 51 2 its -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 51 3 payments payment NNS work_rujstqwje5gkdm2bqer4drugey 51 4 be- be- JJ work_rujstqwje5gkdm2bqer4drugey 51 5 ing ing NN work_rujstqwje5gkdm2bqer4drugey 51 6 limited limit VBN work_rujstqwje5gkdm2bqer4drugey 51 7 to to IN work_rujstqwje5gkdm2bqer4drugey 51 8 two two CD work_rujstqwje5gkdm2bqer4drugey 51 9 currencies currency NNS work_rujstqwje5gkdm2bqer4drugey 51 10 or or CC work_rujstqwje5gkdm2bqer4drugey 51 11 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 51 12 credits credit VBZ work_rujstqwje5gkdm2bqer4drugey 51 13 , , , work_rujstqwje5gkdm2bqer4drugey 51 14 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 51 15 claims claim NNS work_rujstqwje5gkdm2bqer4drugey 51 16 over over IN work_rujstqwje5gkdm2bqer4drugey 51 17 half half PDT work_rujstqwje5gkdm2bqer4drugey 51 18 a a DT work_rujstqwje5gkdm2bqer4drugey 51 19 million million CD work_rujstqwje5gkdm2bqer4drugey 51 20 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 51 21 from from IN work_rujstqwje5gkdm2bqer4drugey 51 22 190 190 CD work_rujstqwje5gkdm2bqer4drugey 51 23 countries country NNS work_rujstqwje5gkdm2bqer4drugey 51 24 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 51 25 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 51 26 , , , work_rujstqwje5gkdm2bqer4drugey 51 27 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 51 28 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 51 29 . . . work_rujstqwje5gkdm2bqer4drugey 52 1 This this DT work_rujstqwje5gkdm2bqer4drugey 52 2 suggests suggest VBZ work_rujstqwje5gkdm2bqer4drugey 52 3 that that IN work_rujstqwje5gkdm2bqer4drugey 52 4 its -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 52 5 worker worker NN work_rujstqwje5gkdm2bqer4drugey 52 6 population population NN work_rujstqwje5gkdm2bqer4drugey 52 7 should should MD work_rujstqwje5gkdm2bqer4drugey 52 8 represent represent VB work_rujstqwje5gkdm2bqer4drugey 52 9 a a DT work_rujstqwje5gkdm2bqer4drugey 52 10 diverse diverse JJ work_rujstqwje5gkdm2bqer4drugey 52 11 set set NN work_rujstqwje5gkdm2bqer4drugey 52 12 of of IN work_rujstqwje5gkdm2bqer4drugey 52 13 languages language NNS work_rujstqwje5gkdm2bqer4drugey 52 14 . . . work_rujstqwje5gkdm2bqer4drugey 53 1 80 80 CD work_rujstqwje5gkdm2bqer4drugey 53 2 A a DT work_rujstqwje5gkdm2bqer4drugey 53 3 demographic demographic JJ work_rujstqwje5gkdm2bqer4drugey 53 4 study study NN work_rujstqwje5gkdm2bqer4drugey 53 5 by by IN work_rujstqwje5gkdm2bqer4drugey 53 6 Ipeirotis Ipeirotis NNP work_rujstqwje5gkdm2bqer4drugey 53 7 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 53 8 2010b 2010b CD work_rujstqwje5gkdm2bqer4drugey 53 9 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 53 10 fo- fo- NNP work_rujstqwje5gkdm2bqer4drugey 53 11 cused cuse VBD work_rujstqwje5gkdm2bqer4drugey 53 12 on on IN work_rujstqwje5gkdm2bqer4drugey 53 13 age age NN work_rujstqwje5gkdm2bqer4drugey 53 14 , , , work_rujstqwje5gkdm2bqer4drugey 53 15 gender gender NN work_rujstqwje5gkdm2bqer4drugey 53 16 , , , work_rujstqwje5gkdm2bqer4drugey 53 17 martial martial JJ work_rujstqwje5gkdm2bqer4drugey 53 18 status status NN work_rujstqwje5gkdm2bqer4drugey 53 19 , , , work_rujstqwje5gkdm2bqer4drugey 53 20 income income NN work_rujstqwje5gkdm2bqer4drugey 53 21 lev- lev- NN work_rujstqwje5gkdm2bqer4drugey 53 22 els els IN work_rujstqwje5gkdm2bqer4drugey 53 23 , , , work_rujstqwje5gkdm2bqer4drugey 53 24 motivation motivation NN work_rujstqwje5gkdm2bqer4drugey 53 25 for for IN work_rujstqwje5gkdm2bqer4drugey 53 26 working work VBG work_rujstqwje5gkdm2bqer4drugey 53 27 on on IN work_rujstqwje5gkdm2bqer4drugey 53 28 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 53 29 , , , work_rujstqwje5gkdm2bqer4drugey 53 30 and and CC work_rujstqwje5gkdm2bqer4drugey 53 31 whether whether IN work_rujstqwje5gkdm2bqer4drugey 53 32 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 53 33 used use VBD work_rujstqwje5gkdm2bqer4drugey 53 34 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 53 35 as as IN work_rujstqwje5gkdm2bqer4drugey 53 36 a a DT work_rujstqwje5gkdm2bqer4drugey 53 37 primary primary JJ work_rujstqwje5gkdm2bqer4drugey 53 38 or or CC work_rujstqwje5gkdm2bqer4drugey 53 39 supplemental supplemental JJ work_rujstqwje5gkdm2bqer4drugey 53 40 form form NN work_rujstqwje5gkdm2bqer4drugey 53 41 of of IN work_rujstqwje5gkdm2bqer4drugey 53 42 income income NN work_rujstqwje5gkdm2bqer4drugey 53 43 . . . work_rujstqwje5gkdm2bqer4drugey 54 1 The the DT work_rujstqwje5gkdm2bqer4drugey 54 2 study study NN work_rujstqwje5gkdm2bqer4drugey 54 3 contrasted contrast VBD work_rujstqwje5gkdm2bqer4drugey 54 4 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 54 5 and and CC work_rujstqwje5gkdm2bqer4drugey 54 6 US US NNP work_rujstqwje5gkdm2bqer4drugey 54 7 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 54 8 . . . work_rujstqwje5gkdm2bqer4drugey 55 1 Ross Ross NNP work_rujstqwje5gkdm2bqer4drugey 55 2 et et FW work_rujstqwje5gkdm2bqer4drugey 55 3 al al NNP work_rujstqwje5gkdm2bqer4drugey 55 4 . . . work_rujstqwje5gkdm2bqer4drugey 56 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 56 2 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 56 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 56 4 completed complete VBD work_rujstqwje5gkdm2bqer4drugey 56 5 a a DT work_rujstqwje5gkdm2bqer4drugey 56 6 longitudi- longitudi- NN work_rujstqwje5gkdm2bqer4drugey 56 7 nal nal NNP work_rujstqwje5gkdm2bqer4drugey 56 8 follow follow VB work_rujstqwje5gkdm2bqer4drugey 56 9 - - HYPH work_rujstqwje5gkdm2bqer4drugey 56 10 on on RP work_rujstqwje5gkdm2bqer4drugey 56 11 study study NN work_rujstqwje5gkdm2bqer4drugey 56 12 . . . work_rujstqwje5gkdm2bqer4drugey 57 1 A a DT work_rujstqwje5gkdm2bqer4drugey 57 2 number number NN work_rujstqwje5gkdm2bqer4drugey 57 3 of of IN work_rujstqwje5gkdm2bqer4drugey 57 4 other other JJ work_rujstqwje5gkdm2bqer4drugey 57 5 studies study NNS work_rujstqwje5gkdm2bqer4drugey 57 6 have have VBP work_rujstqwje5gkdm2bqer4drugey 57 7 informally informally RB work_rujstqwje5gkdm2bqer4drugey 57 8 investigated investigate VBN work_rujstqwje5gkdm2bqer4drugey 57 9 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 57 10 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 57 11 language language NN work_rujstqwje5gkdm2bqer4drugey 57 12 abilities ability NNS work_rujstqwje5gkdm2bqer4drugey 57 13 . . . work_rujstqwje5gkdm2bqer4drugey 58 1 Munro Munro NNP work_rujstqwje5gkdm2bqer4drugey 58 2 and and CC work_rujstqwje5gkdm2bqer4drugey 58 3 Tily Tily NNP work_rujstqwje5gkdm2bqer4drugey 58 4 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 58 5 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 58 6 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 58 7 compiled compile VBN work_rujstqwje5gkdm2bqer4drugey 58 8 survey survey NN work_rujstqwje5gkdm2bqer4drugey 58 9 responses response NNS work_rujstqwje5gkdm2bqer4drugey 58 10 of of IN work_rujstqwje5gkdm2bqer4drugey 58 11 2,000 2,000 CD work_rujstqwje5gkdm2bqer4drugey 58 12 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 58 13 , , , work_rujstqwje5gkdm2bqer4drugey 58 14 revealing reveal VBG work_rujstqwje5gkdm2bqer4drugey 58 15 that that IN work_rujstqwje5gkdm2bqer4drugey 58 16 four four CD work_rujstqwje5gkdm2bqer4drugey 58 17 of of IN work_rujstqwje5gkdm2bqer4drugey 58 18 the the DT work_rujstqwje5gkdm2bqer4drugey 58 19 six six CD work_rujstqwje5gkdm2bqer4drugey 58 20 most most RBS work_rujstqwje5gkdm2bqer4drugey 58 21 represented represented JJ work_rujstqwje5gkdm2bqer4drugey 58 22 languages language NNS work_rujstqwje5gkdm2bqer4drugey 58 23 come come VBP work_rujstqwje5gkdm2bqer4drugey 58 24 from from IN work_rujstqwje5gkdm2bqer4drugey 58 25 India India NNP work_rujstqwje5gkdm2bqer4drugey 58 26 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 58 27 the the DT work_rujstqwje5gkdm2bqer4drugey 58 28 top top JJ work_rujstqwje5gkdm2bqer4drugey 58 29 six six CD work_rujstqwje5gkdm2bqer4drugey 58 30 being be VBG work_rujstqwje5gkdm2bqer4drugey 58 31 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 58 32 , , , work_rujstqwje5gkdm2bqer4drugey 58 33 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 58 34 , , , work_rujstqwje5gkdm2bqer4drugey 58 35 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 58 36 , , , work_rujstqwje5gkdm2bqer4drugey 58 37 Spanish Spanish NNP work_rujstqwje5gkdm2bqer4drugey 58 38 , , , work_rujstqwje5gkdm2bqer4drugey 58 39 French French NNP work_rujstqwje5gkdm2bqer4drugey 58 40 , , , work_rujstqwje5gkdm2bqer4drugey 58 41 and and CC work_rujstqwje5gkdm2bqer4drugey 58 42 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 58 43 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 58 44 . . . work_rujstqwje5gkdm2bqer4drugey 59 1 Irvine Irvine NNP work_rujstqwje5gkdm2bqer4drugey 59 2 and and CC work_rujstqwje5gkdm2bqer4drugey 59 3 Klementiev Klementiev NNP work_rujstqwje5gkdm2bqer4drugey 59 4 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 59 5 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 59 6 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 59 7 had have VBD work_rujstqwje5gkdm2bqer4drugey 59 8 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 59 9 evaluate evaluate VB work_rujstqwje5gkdm2bqer4drugey 59 10 the the DT work_rujstqwje5gkdm2bqer4drugey 59 11 accuracy accuracy NN work_rujstqwje5gkdm2bqer4drugey 59 12 of of IN work_rujstqwje5gkdm2bqer4drugey 59 13 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 59 14 that that WDT work_rujstqwje5gkdm2bqer4drugey 59 15 had have VBD work_rujstqwje5gkdm2bqer4drugey 59 16 been be VBN work_rujstqwje5gkdm2bqer4drugey 59 17 automatically automatically RB work_rujstqwje5gkdm2bqer4drugey 59 18 inducted induct VBN work_rujstqwje5gkdm2bqer4drugey 59 19 from from IN work_rujstqwje5gkdm2bqer4drugey 59 20 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 59 21 texts text NNS work_rujstqwje5gkdm2bqer4drugey 59 22 . . . work_rujstqwje5gkdm2bqer4drugey 60 1 They -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 60 2 examined examine VBD work_rujstqwje5gkdm2bqer4drugey 60 3 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 60 4 of of IN work_rujstqwje5gkdm2bqer4drugey 60 5 100 100 CD work_rujstqwje5gkdm2bqer4drugey 60 6 words word NNS work_rujstqwje5gkdm2bqer4drugey 60 7 in in IN work_rujstqwje5gkdm2bqer4drugey 60 8 42 42 CD work_rujstqwje5gkdm2bqer4drugey 60 9 low low JJ work_rujstqwje5gkdm2bqer4drugey 60 10 - - HYPH work_rujstqwje5gkdm2bqer4drugey 60 11 resource resource NN work_rujstqwje5gkdm2bqer4drugey 60 12 languages language NNS work_rujstqwje5gkdm2bqer4drugey 60 13 , , , work_rujstqwje5gkdm2bqer4drugey 60 14 and and CC work_rujstqwje5gkdm2bqer4drugey 60 15 reported report VBD work_rujstqwje5gkdm2bqer4drugey 60 16 geolocated geolocated JJ work_rujstqwje5gkdm2bqer4drugey 60 17 countries country NNS work_rujstqwje5gkdm2bqer4drugey 60 18 for for IN work_rujstqwje5gkdm2bqer4drugey 60 19 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 60 20 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 60 21 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 60 22 India India NNP work_rujstqwje5gkdm2bqer4drugey 60 23 , , , work_rujstqwje5gkdm2bqer4drugey 60 24 the the DT work_rujstqwje5gkdm2bqer4drugey 60 25 US US NNP work_rujstqwje5gkdm2bqer4drugey 60 26 , , , work_rujstqwje5gkdm2bqer4drugey 60 27 Romania Romania NNP work_rujstqwje5gkdm2bqer4drugey 60 28 , , , work_rujstqwje5gkdm2bqer4drugey 60 29 Pakistan Pakistan NNP work_rujstqwje5gkdm2bqer4drugey 60 30 , , , work_rujstqwje5gkdm2bqer4drugey 60 31 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 60 32 , , , work_rujstqwje5gkdm2bqer4drugey 60 33 Latvia Latvia NNP work_rujstqwje5gkdm2bqer4drugey 60 34 , , , work_rujstqwje5gkdm2bqer4drugey 60 35 Bangladesh Bangladesh NNP work_rujstqwje5gkdm2bqer4drugey 60 36 and and CC work_rujstqwje5gkdm2bqer4drugey 60 37 the the DT work_rujstqwje5gkdm2bqer4drugey 60 38 Philippines Philippines NNP work_rujstqwje5gkdm2bqer4drugey 60 39 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 60 40 . . . work_rujstqwje5gkdm2bqer4drugey 61 1 Irvine Irvine NNP work_rujstqwje5gkdm2bqer4drugey 61 2 and and CC work_rujstqwje5gkdm2bqer4drugey 61 3 Klementiev Klementiev NNP work_rujstqwje5gkdm2bqer4drugey 61 4 discussed discuss VBD work_rujstqwje5gkdm2bqer4drugey 61 5 the the DT work_rujstqwje5gkdm2bqer4drugey 61 6 difficulty difficulty NN work_rujstqwje5gkdm2bqer4drugey 61 7 of of IN work_rujstqwje5gkdm2bqer4drugey 61 8 quality quality NN work_rujstqwje5gkdm2bqer4drugey 61 9 control control NN work_rujstqwje5gkdm2bqer4drugey 61 10 and and CC work_rujstqwje5gkdm2bqer4drugey 61 11 assessing assess VBG work_rujstqwje5gkdm2bqer4drugey 61 12 the the DT work_rujstqwje5gkdm2bqer4drugey 61 13 plausi- plausi- NN work_rujstqwje5gkdm2bqer4drugey 61 14 bility bility NN work_rujstqwje5gkdm2bqer4drugey 61 15 of of IN work_rujstqwje5gkdm2bqer4drugey 61 16 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 61 17 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 61 18 language language NN work_rujstqwje5gkdm2bqer4drugey 61 19 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 61 20 for for IN work_rujstqwje5gkdm2bqer4drugey 61 21 rare rare JJ work_rujstqwje5gkdm2bqer4drugey 61 22 languages language NNS work_rujstqwje5gkdm2bqer4drugey 61 23 , , , work_rujstqwje5gkdm2bqer4drugey 61 24 which which WDT work_rujstqwje5gkdm2bqer4drugey 61 25 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 61 26 address address VBP work_rujstqwje5gkdm2bqer4drugey 61 27 in in IN work_rujstqwje5gkdm2bqer4drugey 61 28 this this DT work_rujstqwje5gkdm2bqer4drugey 61 29 paper paper NN work_rujstqwje5gkdm2bqer4drugey 61 30 . . . work_rujstqwje5gkdm2bqer4drugey 62 1 Several several JJ work_rujstqwje5gkdm2bqer4drugey 62 2 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 62 3 have have VBP work_rujstqwje5gkdm2bqer4drugey 62 4 investigated investigate VBN work_rujstqwje5gkdm2bqer4drugey 62 5 using use VBG work_rujstqwje5gkdm2bqer4drugey 62 6 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 62 7 to to TO work_rujstqwje5gkdm2bqer4drugey 62 8 build build VB work_rujstqwje5gkdm2bqer4drugey 62 9 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 62 10 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 62 11 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 62 12 for for IN work_rujstqwje5gkdm2bqer4drugey 62 13 ma- ma- JJ work_rujstqwje5gkdm2bqer4drugey 62 14 chine chine JJ work_rujstqwje5gkdm2bqer4drugey 62 15 translation translation NN work_rujstqwje5gkdm2bqer4drugey 62 16 , , , work_rujstqwje5gkdm2bqer4drugey 62 17 a a DT work_rujstqwje5gkdm2bqer4drugey 62 18 task task NN work_rujstqwje5gkdm2bqer4drugey 62 19 which which WDT work_rujstqwje5gkdm2bqer4drugey 62 20 stands stand VBZ work_rujstqwje5gkdm2bqer4drugey 62 21 to to TO work_rujstqwje5gkdm2bqer4drugey 62 22 benefit benefit VB work_rujstqwje5gkdm2bqer4drugey 62 23 low low JJ work_rujstqwje5gkdm2bqer4drugey 62 24 cost cost NN work_rujstqwje5gkdm2bqer4drugey 62 25 , , , work_rujstqwje5gkdm2bqer4drugey 62 26 high high JJ work_rujstqwje5gkdm2bqer4drugey 62 27 volume volume NN work_rujstqwje5gkdm2bqer4drugey 62 28 translation translation NN work_rujstqwje5gkdm2bqer4drugey 62 29 on on IN work_rujstqwje5gkdm2bqer4drugey 62 30 demand demand NN work_rujstqwje5gkdm2bqer4drugey 62 31 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 62 32 Ger- Ger- NNP work_rujstqwje5gkdm2bqer4drugey 62 33 mann mann NNP work_rujstqwje5gkdm2bqer4drugey 62 34 , , , work_rujstqwje5gkdm2bqer4drugey 62 35 2001 2001 CD work_rujstqwje5gkdm2bqer4drugey 62 36 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 62 37 . . . work_rujstqwje5gkdm2bqer4drugey 63 1 Ambati Ambati NNP work_rujstqwje5gkdm2bqer4drugey 63 2 et et NNP work_rujstqwje5gkdm2bqer4drugey 63 3 al al NNP work_rujstqwje5gkdm2bqer4drugey 63 4 . . . work_rujstqwje5gkdm2bqer4drugey 64 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 64 2 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 64 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 64 4 conducted conduct VBD work_rujstqwje5gkdm2bqer4drugey 64 5 a a DT work_rujstqwje5gkdm2bqer4drugey 64 6 pilot pilot NN work_rujstqwje5gkdm2bqer4drugey 64 7 study study NN work_rujstqwje5gkdm2bqer4drugey 64 8 by by IN work_rujstqwje5gkdm2bqer4drugey 64 9 posting post VBG work_rujstqwje5gkdm2bqer4drugey 64 10 25 25 CD work_rujstqwje5gkdm2bqer4drugey 64 11 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 64 12 to to IN work_rujstqwje5gkdm2bqer4drugey 64 13 MTurk mturk VB work_rujstqwje5gkdm2bqer4drugey 64 14 for for IN work_rujstqwje5gkdm2bqer4drugey 64 15 Span- Span- NNP work_rujstqwje5gkdm2bqer4drugey 64 16 ish ish NNP work_rujstqwje5gkdm2bqer4drugey 64 17 , , , work_rujstqwje5gkdm2bqer4drugey 64 18 Chinese Chinese NNPS work_rujstqwje5gkdm2bqer4drugey 64 19 , , , work_rujstqwje5gkdm2bqer4drugey 64 20 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 64 21 , , , work_rujstqwje5gkdm2bqer4drugey 64 22 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 64 23 , , , work_rujstqwje5gkdm2bqer4drugey 64 24 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 64 25 , , , work_rujstqwje5gkdm2bqer4drugey 64 26 and and CC work_rujstqwje5gkdm2bqer4drugey 64 27 Haitian Haitian NNP work_rujstqwje5gkdm2bqer4drugey 64 28 Cre- Cre- NNP work_rujstqwje5gkdm2bqer4drugey 64 29 ole ole NN work_rujstqwje5gkdm2bqer4drugey 64 30 . . . work_rujstqwje5gkdm2bqer4drugey 65 1 In in IN work_rujstqwje5gkdm2bqer4drugey 65 2 a a DT work_rujstqwje5gkdm2bqer4drugey 65 3 study study NN work_rujstqwje5gkdm2bqer4drugey 65 4 of of IN work_rujstqwje5gkdm2bqer4drugey 65 5 2000 2000 CD work_rujstqwje5gkdm2bqer4drugey 65 6 Urdu urdu JJ work_rujstqwje5gkdm2bqer4drugey 65 7 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 65 8 , , , work_rujstqwje5gkdm2bqer4drugey 65 9 Zaidan Zaidan NNP work_rujstqwje5gkdm2bqer4drugey 65 10 and and CC work_rujstqwje5gkdm2bqer4drugey 65 11 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 65 12 - - HYPH work_rujstqwje5gkdm2bqer4drugey 65 13 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 65 14 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 65 15 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 65 16 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 65 17 presented present VBN work_rujstqwje5gkdm2bqer4drugey 65 18 methods method NNS work_rujstqwje5gkdm2bqer4drugey 65 19 for for IN work_rujstqwje5gkdm2bqer4drugey 65 20 achieving achieve VBG work_rujstqwje5gkdm2bqer4drugey 65 21 professional professional JJ work_rujstqwje5gkdm2bqer4drugey 65 22 - - HYPH work_rujstqwje5gkdm2bqer4drugey 65 23 level level NN work_rujstqwje5gkdm2bqer4drugey 65 24 translation translation NN work_rujstqwje5gkdm2bqer4drugey 65 25 quality quality NN work_rujstqwje5gkdm2bqer4drugey 65 26 from from IN work_rujstqwje5gkdm2bqer4drugey 65 27 Turkers Turkers NNP work_rujstqwje5gkdm2bqer4drugey 65 28 by by IN work_rujstqwje5gkdm2bqer4drugey 65 29 soliciting solicit VBG work_rujstqwje5gkdm2bqer4drugey 65 30 multiple multiple JJ work_rujstqwje5gkdm2bqer4drugey 65 31 English english JJ work_rujstqwje5gkdm2bqer4drugey 65 32 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 65 33 of of IN work_rujstqwje5gkdm2bqer4drugey 65 34 each each DT work_rujstqwje5gkdm2bqer4drugey 65 35 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 65 36 sentence sentence NN work_rujstqwje5gkdm2bqer4drugey 65 37 . . . work_rujstqwje5gkdm2bqer4drugey 66 1 Zbib Zbib NNP work_rujstqwje5gkdm2bqer4drugey 66 2 et et FW work_rujstqwje5gkdm2bqer4drugey 66 3 al al NNP work_rujstqwje5gkdm2bqer4drugey 66 4 . . . work_rujstqwje5gkdm2bqer4drugey 67 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 67 2 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 67 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 67 4 used use VBD work_rujstqwje5gkdm2bqer4drugey 67 5 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 67 6 to to TO work_rujstqwje5gkdm2bqer4drugey 67 7 construct construct VB work_rujstqwje5gkdm2bqer4drugey 67 8 a a DT work_rujstqwje5gkdm2bqer4drugey 67 9 1.5 1.5 CD work_rujstqwje5gkdm2bqer4drugey 67 10 million million CD work_rujstqwje5gkdm2bqer4drugey 67 11 word word NN work_rujstqwje5gkdm2bqer4drugey 67 12 par- par- NN work_rujstqwje5gkdm2bqer4drugey 67 13 allel allel NNP work_rujstqwje5gkdm2bqer4drugey 67 14 corpus corpus NN work_rujstqwje5gkdm2bqer4drugey 67 15 of of IN work_rujstqwje5gkdm2bqer4drugey 67 16 dialect dialect VB work_rujstqwje5gkdm2bqer4drugey 67 17 Arabic Arabic NNP work_rujstqwje5gkdm2bqer4drugey 67 18 and and CC work_rujstqwje5gkdm2bqer4drugey 67 19 English English NNP work_rujstqwje5gkdm2bqer4drugey 67 20 , , , work_rujstqwje5gkdm2bqer4drugey 67 21 train- train- NN work_rujstqwje5gkdm2bqer4drugey 67 22 ing e VBG work_rujstqwje5gkdm2bqer4drugey 67 23 a a DT work_rujstqwje5gkdm2bqer4drugey 67 24 statistical statistical JJ work_rujstqwje5gkdm2bqer4drugey 67 25 machine machine NN work_rujstqwje5gkdm2bqer4drugey 67 26 translation translation NN work_rujstqwje5gkdm2bqer4drugey 67 27 system system NN work_rujstqwje5gkdm2bqer4drugey 67 28 that that WDT work_rujstqwje5gkdm2bqer4drugey 67 29 pro- pro- NN work_rujstqwje5gkdm2bqer4drugey 67 30 duced duce VBD work_rujstqwje5gkdm2bqer4drugey 67 31 higher high JJR work_rujstqwje5gkdm2bqer4drugey 67 32 quality quality NN work_rujstqwje5gkdm2bqer4drugey 67 33 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 67 34 of of IN work_rujstqwje5gkdm2bqer4drugey 67 35 dialect dialect VB work_rujstqwje5gkdm2bqer4drugey 67 36 Arabic Arabic NNP work_rujstqwje5gkdm2bqer4drugey 67 37 than than IN work_rujstqwje5gkdm2bqer4drugey 67 38 a a DT work_rujstqwje5gkdm2bqer4drugey 67 39 system system NN work_rujstqwje5gkdm2bqer4drugey 67 40 a a DT work_rujstqwje5gkdm2bqer4drugey 67 41 trained train VBN work_rujstqwje5gkdm2bqer4drugey 67 42 on on IN work_rujstqwje5gkdm2bqer4drugey 67 43 100 100 CD work_rujstqwje5gkdm2bqer4drugey 67 44 times time NNS work_rujstqwje5gkdm2bqer4drugey 67 45 more more JJR work_rujstqwje5gkdm2bqer4drugey 67 46 Mod- Mod- NNP work_rujstqwje5gkdm2bqer4drugey 67 47 ern ern NN work_rujstqwje5gkdm2bqer4drugey 67 48 Standard Standard NNP work_rujstqwje5gkdm2bqer4drugey 67 49 Arabic arabic JJ work_rujstqwje5gkdm2bqer4drugey 67 50 - - HYPH work_rujstqwje5gkdm2bqer4drugey 67 51 English English NNP work_rujstqwje5gkdm2bqer4drugey 67 52 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 67 53 data datum NNS work_rujstqwje5gkdm2bqer4drugey 67 54 . . . work_rujstqwje5gkdm2bqer4drugey 68 1 Zbib Zbib NNP work_rujstqwje5gkdm2bqer4drugey 68 2 et et FW work_rujstqwje5gkdm2bqer4drugey 68 3 al al NNP work_rujstqwje5gkdm2bqer4drugey 68 4 . . . work_rujstqwje5gkdm2bqer4drugey 69 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 69 2 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 69 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 69 4 conducted conduct VBD work_rujstqwje5gkdm2bqer4drugey 69 5 a a DT work_rujstqwje5gkdm2bqer4drugey 69 6 systematic systematic JJ work_rujstqwje5gkdm2bqer4drugey 69 7 study study NN work_rujstqwje5gkdm2bqer4drugey 69 8 that that WDT work_rujstqwje5gkdm2bqer4drugey 69 9 showed show VBD work_rujstqwje5gkdm2bqer4drugey 69 10 that that IN work_rujstqwje5gkdm2bqer4drugey 69 11 training train VBG work_rujstqwje5gkdm2bqer4drugey 69 12 an an DT work_rujstqwje5gkdm2bqer4drugey 69 13 MT MT NNP work_rujstqwje5gkdm2bqer4drugey 69 14 system system NN work_rujstqwje5gkdm2bqer4drugey 69 15 on on IN work_rujstqwje5gkdm2bqer4drugey 69 16 crowdsourced crowdsourced JJ work_rujstqwje5gkdm2bqer4drugey 69 17 trans- trans- JJ work_rujstqwje5gkdm2bqer4drugey 69 18 lations lation NNS work_rujstqwje5gkdm2bqer4drugey 69 19 resulted result VBD work_rujstqwje5gkdm2bqer4drugey 69 20 in in IN work_rujstqwje5gkdm2bqer4drugey 69 21 the the DT work_rujstqwje5gkdm2bqer4drugey 69 22 same same JJ work_rujstqwje5gkdm2bqer4drugey 69 23 performance performance NN work_rujstqwje5gkdm2bqer4drugey 69 24 as as IN work_rujstqwje5gkdm2bqer4drugey 69 25 training training NN work_rujstqwje5gkdm2bqer4drugey 69 26 on on IN work_rujstqwje5gkdm2bqer4drugey 69 27 professional professional JJ work_rujstqwje5gkdm2bqer4drugey 69 28 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 69 29 , , , work_rujstqwje5gkdm2bqer4drugey 69 30 at at IN work_rujstqwje5gkdm2bqer4drugey 69 31 1 1 CD work_rujstqwje5gkdm2bqer4drugey 69 32 5 5 CD work_rujstqwje5gkdm2bqer4drugey 69 33 the the DT work_rujstqwje5gkdm2bqer4drugey 69 34 cost cost NN work_rujstqwje5gkdm2bqer4drugey 69 35 . . . work_rujstqwje5gkdm2bqer4drugey 70 1 Hu Hu NNP work_rujstqwje5gkdm2bqer4drugey 70 2 et et FW work_rujstqwje5gkdm2bqer4drugey 70 3 al al NNP work_rujstqwje5gkdm2bqer4drugey 70 4 . . . work_rujstqwje5gkdm2bqer4drugey 71 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 71 2 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 71 3 ; ; : work_rujstqwje5gkdm2bqer4drugey 71 4 Hu Hu NNP work_rujstqwje5gkdm2bqer4drugey 71 5 et et FW work_rujstqwje5gkdm2bqer4drugey 71 6 al al NNP work_rujstqwje5gkdm2bqer4drugey 71 7 . . . work_rujstqwje5gkdm2bqer4drugey 72 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 72 2 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 72 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 72 4 performed perform VBD work_rujstqwje5gkdm2bqer4drugey 72 5 crowdsourced crowdsource VBN work_rujstqwje5gkdm2bqer4drugey 72 6 translation translation NN work_rujstqwje5gkdm2bqer4drugey 72 7 by by IN work_rujstqwje5gkdm2bqer4drugey 72 8 having have VBG work_rujstqwje5gkdm2bqer4drugey 72 9 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 72 10 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 72 11 collab- collab- NNP work_rujstqwje5gkdm2bqer4drugey 72 12 orate orate NNP work_rujstqwje5gkdm2bqer4drugey 72 13 and and CC work_rujstqwje5gkdm2bqer4drugey 72 14 iteratively iteratively RB work_rujstqwje5gkdm2bqer4drugey 72 15 improve improve VB work_rujstqwje5gkdm2bqer4drugey 72 16 MT MT NNP work_rujstqwje5gkdm2bqer4drugey 72 17 output output NN work_rujstqwje5gkdm2bqer4drugey 72 18 . . . work_rujstqwje5gkdm2bqer4drugey 73 1 English English NNP work_rujstqwje5gkdm2bqer4drugey 73 2 689 689 CD work_rujstqwje5gkdm2bqer4drugey 73 3 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 73 4 253 253 CD work_rujstqwje5gkdm2bqer4drugey 73 5 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 73 6 219 219 CD work_rujstqwje5gkdm2bqer4drugey 73 7 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 73 8 149 149 CD work_rujstqwje5gkdm2bqer4drugey 73 9 Spanish Spanish NNP work_rujstqwje5gkdm2bqer4drugey 73 10 131 131 CD work_rujstqwje5gkdm2bqer4drugey 73 11 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 73 12 87 87 CD work_rujstqwje5gkdm2bqer4drugey 73 13 Chinese Chinese NNP work_rujstqwje5gkdm2bqer4drugey 73 14 86 86 CD work_rujstqwje5gkdm2bqer4drugey 73 15 Romanian romanian JJ work_rujstqwje5gkdm2bqer4drugey 73 16 85 85 CD work_rujstqwje5gkdm2bqer4drugey 73 17 Portuguese portuguese JJ work_rujstqwje5gkdm2bqer4drugey 73 18 82 82 CD work_rujstqwje5gkdm2bqer4drugey 73 19 Arabic Arabic NNP work_rujstqwje5gkdm2bqer4drugey 73 20 74 74 CD work_rujstqwje5gkdm2bqer4drugey 73 21 Kannada Kannada NNP work_rujstqwje5gkdm2bqer4drugey 73 22 72 72 CD work_rujstqwje5gkdm2bqer4drugey 73 23 German German NNP work_rujstqwje5gkdm2bqer4drugey 73 24 66 66 CD work_rujstqwje5gkdm2bqer4drugey 73 25 French french JJ work_rujstqwje5gkdm2bqer4drugey 73 26 63 63 CD work_rujstqwje5gkdm2bqer4drugey 73 27 Polish Polish NNP work_rujstqwje5gkdm2bqer4drugey 73 28 61 61 CD work_rujstqwje5gkdm2bqer4drugey 73 29 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 73 30 56 56 CD work_rujstqwje5gkdm2bqer4drugey 73 31 Tagalog Tagalog NNP work_rujstqwje5gkdm2bqer4drugey 73 32 54 54 CD work_rujstqwje5gkdm2bqer4drugey 73 33 Marathi Marathi NNP work_rujstqwje5gkdm2bqer4drugey 73 34 48 48 CD work_rujstqwje5gkdm2bqer4drugey 73 35 Russian russian JJ work_rujstqwje5gkdm2bqer4drugey 73 36 44 44 CD work_rujstqwje5gkdm2bqer4drugey 73 37 Italian italian JJ work_rujstqwje5gkdm2bqer4drugey 73 38 43 43 CD work_rujstqwje5gkdm2bqer4drugey 73 39 Bengali Bengali NNP work_rujstqwje5gkdm2bqer4drugey 73 40 41 41 CD work_rujstqwje5gkdm2bqer4drugey 73 41 Gujarati Gujarati NNP work_rujstqwje5gkdm2bqer4drugey 73 42 39 39 CD work_rujstqwje5gkdm2bqer4drugey 73 43 Hebrew Hebrew VBD work_rujstqwje5gkdm2bqer4drugey 73 44 38 38 CD work_rujstqwje5gkdm2bqer4drugey 73 45 Dutch dutch JJ work_rujstqwje5gkdm2bqer4drugey 73 46 37 37 CD work_rujstqwje5gkdm2bqer4drugey 73 47 Turkish turkish JJ work_rujstqwje5gkdm2bqer4drugey 73 48 35 35 CD work_rujstqwje5gkdm2bqer4drugey 73 49 Vietnamese vietnamese JJ work_rujstqwje5gkdm2bqer4drugey 73 50 34 34 CD work_rujstqwje5gkdm2bqer4drugey 73 51 Macedonian Macedonian NNP work_rujstqwje5gkdm2bqer4drugey 73 52 31 31 CD work_rujstqwje5gkdm2bqer4drugey 73 53 Cebuano Cebuano NNP work_rujstqwje5gkdm2bqer4drugey 73 54 29 29 CD work_rujstqwje5gkdm2bqer4drugey 73 55 Swedish swedish JJ work_rujstqwje5gkdm2bqer4drugey 73 56 26 26 CD work_rujstqwje5gkdm2bqer4drugey 73 57 Bulgarian bulgarian JJ work_rujstqwje5gkdm2bqer4drugey 73 58 25 25 CD work_rujstqwje5gkdm2bqer4drugey 73 59 Swahili Swahili NNP work_rujstqwje5gkdm2bqer4drugey 73 60 23 23 CD work_rujstqwje5gkdm2bqer4drugey 73 61 Hungarian Hungarian NNP work_rujstqwje5gkdm2bqer4drugey 73 62 23 23 CD work_rujstqwje5gkdm2bqer4drugey 73 63 Catalan Catalan NNP work_rujstqwje5gkdm2bqer4drugey 73 64 22 22 CD work_rujstqwje5gkdm2bqer4drugey 73 65 Thai Thai NNP work_rujstqwje5gkdm2bqer4drugey 73 66 22 22 CD work_rujstqwje5gkdm2bqer4drugey 73 67 Lithuanian Lithuanian NNP work_rujstqwje5gkdm2bqer4drugey 73 68 21 21 CD work_rujstqwje5gkdm2bqer4drugey 73 69 Punjabi Punjabi NNP work_rujstqwje5gkdm2bqer4drugey 73 70 21 21 CD work_rujstqwje5gkdm2bqer4drugey 73 71 Others Others NNPS work_rujstqwje5gkdm2bqer4drugey 73 72 ≤ ≤ VBP work_rujstqwje5gkdm2bqer4drugey 73 73 20 20 CD work_rujstqwje5gkdm2bqer4drugey 73 74 Table table NN work_rujstqwje5gkdm2bqer4drugey 73 75 1 1 CD work_rujstqwje5gkdm2bqer4drugey 73 76 : : : work_rujstqwje5gkdm2bqer4drugey 73 77 Self self NN work_rujstqwje5gkdm2bqer4drugey 73 78 - - HYPH work_rujstqwje5gkdm2bqer4drugey 73 79 reported report VBN work_rujstqwje5gkdm2bqer4drugey 73 80 native native JJ work_rujstqwje5gkdm2bqer4drugey 73 81 language language NN work_rujstqwje5gkdm2bqer4drugey 73 82 of of IN work_rujstqwje5gkdm2bqer4drugey 73 83 3,216 3,216 CD work_rujstqwje5gkdm2bqer4drugey 73 84 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 73 85 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 73 86 . . . work_rujstqwje5gkdm2bqer4drugey 74 1 Not not RB work_rujstqwje5gkdm2bqer4drugey 74 2 shown show VBN work_rujstqwje5gkdm2bqer4drugey 74 3 are be VBP work_rujstqwje5gkdm2bqer4drugey 74 4 49 49 CD work_rujstqwje5gkdm2bqer4drugey 74 5 languages language NNS work_rujstqwje5gkdm2bqer4drugey 74 6 with with IN work_rujstqwje5gkdm2bqer4drugey 74 7 ≤20 ≤20 NN work_rujstqwje5gkdm2bqer4drugey 74 8 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 74 9 . . . work_rujstqwje5gkdm2bqer4drugey 75 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 75 2 omit omit VBP work_rujstqwje5gkdm2bqer4drugey 75 3 1,801 1,801 CD work_rujstqwje5gkdm2bqer4drugey 75 4 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 75 5 who who WP work_rujstqwje5gkdm2bqer4drugey 75 6 did do VBD work_rujstqwje5gkdm2bqer4drugey 75 7 not not RB work_rujstqwje5gkdm2bqer4drugey 75 8 report report VB work_rujstqwje5gkdm2bqer4drugey 75 9 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 75 10 native native JJ work_rujstqwje5gkdm2bqer4drugey 75 11 language language NN work_rujstqwje5gkdm2bqer4drugey 75 12 , , , work_rujstqwje5gkdm2bqer4drugey 75 13 243 243 CD work_rujstqwje5gkdm2bqer4drugey 75 14 who who WP work_rujstqwje5gkdm2bqer4drugey 75 15 reported report VBD work_rujstqwje5gkdm2bqer4drugey 75 16 2 2 CD work_rujstqwje5gkdm2bqer4drugey 75 17 na- na- NN work_rujstqwje5gkdm2bqer4drugey 75 18 tive tive JJ work_rujstqwje5gkdm2bqer4drugey 75 19 languages language NNS work_rujstqwje5gkdm2bqer4drugey 75 20 , , , work_rujstqwje5gkdm2bqer4drugey 75 21 and and CC work_rujstqwje5gkdm2bqer4drugey 75 22 83 83 CD work_rujstqwje5gkdm2bqer4drugey 75 23 with with IN work_rujstqwje5gkdm2bqer4drugey 75 24 ≥3 ≥3 NNP work_rujstqwje5gkdm2bqer4drugey 75 25 native native JJ work_rujstqwje5gkdm2bqer4drugey 75 26 languages language NNS work_rujstqwje5gkdm2bqer4drugey 75 27 . . . work_rujstqwje5gkdm2bqer4drugey 76 1 Several several JJ work_rujstqwje5gkdm2bqer4drugey 76 2 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 76 3 have have VBP work_rujstqwje5gkdm2bqer4drugey 76 4 examined examine VBN work_rujstqwje5gkdm2bqer4drugey 76 5 cost cost NN work_rujstqwje5gkdm2bqer4drugey 76 6 optimiza- optimiza- JJ work_rujstqwje5gkdm2bqer4drugey 76 7 tion tion NN work_rujstqwje5gkdm2bqer4drugey 76 8 using use VBG work_rujstqwje5gkdm2bqer4drugey 76 9 active active JJ work_rujstqwje5gkdm2bqer4drugey 76 10 learning learning NN work_rujstqwje5gkdm2bqer4drugey 76 11 techniques technique NNS work_rujstqwje5gkdm2bqer4drugey 76 12 to to TO work_rujstqwje5gkdm2bqer4drugey 76 13 select select VB work_rujstqwje5gkdm2bqer4drugey 76 14 the the DT work_rujstqwje5gkdm2bqer4drugey 76 15 most most RBS work_rujstqwje5gkdm2bqer4drugey 76 16 useful useful JJ work_rujstqwje5gkdm2bqer4drugey 76 17 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 76 18 or or CC work_rujstqwje5gkdm2bqer4drugey 76 19 fragments fragment NNS work_rujstqwje5gkdm2bqer4drugey 76 20 to to TO work_rujstqwje5gkdm2bqer4drugey 76 21 translate translate VB work_rujstqwje5gkdm2bqer4drugey 76 22 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 76 23 Am- Am- NNP work_rujstqwje5gkdm2bqer4drugey 76 24 bati bati NNS work_rujstqwje5gkdm2bqer4drugey 76 25 and and CC work_rujstqwje5gkdm2bqer4drugey 76 26 Vogel Vogel NNP work_rujstqwje5gkdm2bqer4drugey 76 27 , , , work_rujstqwje5gkdm2bqer4drugey 76 28 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 76 29 ; ; : work_rujstqwje5gkdm2bqer4drugey 76 30 Bloodgood Bloodgood NNP work_rujstqwje5gkdm2bqer4drugey 76 31 and and CC work_rujstqwje5gkdm2bqer4drugey 76 32 Callison- Callison- NNP work_rujstqwje5gkdm2bqer4drugey 76 33 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 76 34 , , , work_rujstqwje5gkdm2bqer4drugey 76 35 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 76 36 ; ; : work_rujstqwje5gkdm2bqer4drugey 76 37 Ambati ambati RB work_rujstqwje5gkdm2bqer4drugey 76 38 , , , work_rujstqwje5gkdm2bqer4drugey 76 39 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 76 40 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 76 41 . . . work_rujstqwje5gkdm2bqer4drugey 77 1 To to TO work_rujstqwje5gkdm2bqer4drugey 77 2 contrast contrast VB work_rujstqwje5gkdm2bqer4drugey 77 3 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 77 4 research research NN work_rujstqwje5gkdm2bqer4drugey 77 5 with with IN work_rujstqwje5gkdm2bqer4drugey 77 6 previous previous JJ work_rujstqwje5gkdm2bqer4drugey 77 7 work work NN work_rujstqwje5gkdm2bqer4drugey 77 8 , , , work_rujstqwje5gkdm2bqer4drugey 77 9 the the DT work_rujstqwje5gkdm2bqer4drugey 77 10 main main JJ work_rujstqwje5gkdm2bqer4drugey 77 11 contributions contribution NNS work_rujstqwje5gkdm2bqer4drugey 77 12 of of IN work_rujstqwje5gkdm2bqer4drugey 77 13 this this DT work_rujstqwje5gkdm2bqer4drugey 77 14 paper paper NN work_rujstqwje5gkdm2bqer4drugey 77 15 are be VBP work_rujstqwje5gkdm2bqer4drugey 77 16 : : : work_rujstqwje5gkdm2bqer4drugey 77 17 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 77 18 1 1 LS work_rujstqwje5gkdm2bqer4drugey 77 19 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 77 20 a a DT work_rujstqwje5gkdm2bqer4drugey 77 21 robust robust JJ work_rujstqwje5gkdm2bqer4drugey 77 22 methodology methodology NN work_rujstqwje5gkdm2bqer4drugey 77 23 for for IN work_rujstqwje5gkdm2bqer4drugey 77 24 assessing assess VBG work_rujstqwje5gkdm2bqer4drugey 77 25 the the DT work_rujstqwje5gkdm2bqer4drugey 77 26 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 77 27 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 77 28 of of IN work_rujstqwje5gkdm2bqer4drugey 77 29 anonymous anonymous JJ work_rujstqwje5gkdm2bqer4drugey 77 30 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 77 31 , , , work_rujstqwje5gkdm2bqer4drugey 77 32 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 77 33 2 2 LS work_rujstqwje5gkdm2bqer4drugey 77 34 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 77 35 the the DT work_rujstqwje5gkdm2bqer4drugey 77 36 largest large JJS work_rujstqwje5gkdm2bqer4drugey 77 37 - - HYPH work_rujstqwje5gkdm2bqer4drugey 77 38 scale scale NN work_rujstqwje5gkdm2bqer4drugey 77 39 census census NN work_rujstqwje5gkdm2bqer4drugey 77 40 to to IN work_rujstqwje5gkdm2bqer4drugey 77 41 date date NN work_rujstqwje5gkdm2bqer4drugey 77 42 of of IN work_rujstqwje5gkdm2bqer4drugey 77 43 language language NN work_rujstqwje5gkdm2bqer4drugey 77 44 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 77 45 of of IN work_rujstqwje5gkdm2bqer4drugey 77 46 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 77 47 on on IN work_rujstqwje5gkdm2bqer4drugey 77 48 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 77 49 , , , work_rujstqwje5gkdm2bqer4drugey 77 50 and and CC work_rujstqwje5gkdm2bqer4drugey 77 51 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 77 52 3 3 LS work_rujstqwje5gkdm2bqer4drugey 77 53 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 77 54 a a DT work_rujstqwje5gkdm2bqer4drugey 77 55 detailed detailed JJ work_rujstqwje5gkdm2bqer4drugey 77 56 analysis analysis NN work_rujstqwje5gkdm2bqer4drugey 77 57 of of IN work_rujstqwje5gkdm2bqer4drugey 77 58 the the DT work_rujstqwje5gkdm2bqer4drugey 77 59 data datum NNS work_rujstqwje5gkdm2bqer4drugey 77 60 gathered gather VBN work_rujstqwje5gkdm2bqer4drugey 77 61 in in IN work_rujstqwje5gkdm2bqer4drugey 77 62 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 77 63 study study NN work_rujstqwje5gkdm2bqer4drugey 77 64 . . . work_rujstqwje5gkdm2bqer4drugey 78 1 3 3 CD work_rujstqwje5gkdm2bqer4drugey 78 2 Experimental Experimental NNP work_rujstqwje5gkdm2bqer4drugey 78 3 Design Design NNP work_rujstqwje5gkdm2bqer4drugey 78 4 The the DT work_rujstqwje5gkdm2bqer4drugey 78 5 central central JJ work_rujstqwje5gkdm2bqer4drugey 78 6 task task NN work_rujstqwje5gkdm2bqer4drugey 78 7 in in IN work_rujstqwje5gkdm2bqer4drugey 78 8 this this DT work_rujstqwje5gkdm2bqer4drugey 78 9 study study NN work_rujstqwje5gkdm2bqer4drugey 78 10 was be VBD work_rujstqwje5gkdm2bqer4drugey 78 11 to to TO work_rujstqwje5gkdm2bqer4drugey 78 12 investigate investigate VB work_rujstqwje5gkdm2bqer4drugey 78 13 Me- Me- NNP work_rujstqwje5gkdm2bqer4drugey 78 14 chanical chanical JJ work_rujstqwje5gkdm2bqer4drugey 78 15 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 78 16 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 78 17 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 78 18 population population NN work_rujstqwje5gkdm2bqer4drugey 78 19 . . . work_rujstqwje5gkdm2bqer4drugey 79 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 79 2 accom- accom- RB work_rujstqwje5gkdm2bqer4drugey 79 3 plished plishe VBD work_rujstqwje5gkdm2bqer4drugey 79 4 this this DT work_rujstqwje5gkdm2bqer4drugey 79 5 through through IN work_rujstqwje5gkdm2bqer4drugey 79 6 self self NN work_rujstqwje5gkdm2bqer4drugey 79 7 - - HYPH work_rujstqwje5gkdm2bqer4drugey 79 8 reported report VBN work_rujstqwje5gkdm2bqer4drugey 79 9 surveys survey NNS work_rujstqwje5gkdm2bqer4drugey 79 10 combined combine VBN work_rujstqwje5gkdm2bqer4drugey 79 11 with with IN work_rujstqwje5gkdm2bqer4drugey 79 12 a a DT work_rujstqwje5gkdm2bqer4drugey 79 13 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 79 14 to to TO work_rujstqwje5gkdm2bqer4drugey 79 15 translate translate VB work_rujstqwje5gkdm2bqer4drugey 79 16 individual individual JJ work_rujstqwje5gkdm2bqer4drugey 79 17 words word NNS work_rujstqwje5gkdm2bqer4drugey 79 18 for for IN work_rujstqwje5gkdm2bqer4drugey 79 19 100 100 CD work_rujstqwje5gkdm2bqer4drugey 79 20 languages language NNS work_rujstqwje5gkdm2bqer4drugey 79 21 . . . work_rujstqwje5gkdm2bqer4drugey 80 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 80 2 evaluate evaluate VBP work_rujstqwje5gkdm2bqer4drugey 80 3 the the DT work_rujstqwje5gkdm2bqer4drugey 80 4 accuracy accuracy NN work_rujstqwje5gkdm2bqer4drugey 80 5 of of IN work_rujstqwje5gkdm2bqer4drugey 80 6 the the DT work_rujstqwje5gkdm2bqer4drugey 80 7 work- work- NN work_rujstqwje5gkdm2bqer4drugey 80 8 ers ers NNP work_rujstqwje5gkdm2bqer4drugey 80 9 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 80 10 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 80 11 against against IN work_rujstqwje5gkdm2bqer4drugey 80 12 known know VBN work_rujstqwje5gkdm2bqer4drugey 80 13 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 80 14 . . . work_rujstqwje5gkdm2bqer4drugey 81 1 In in IN work_rujstqwje5gkdm2bqer4drugey 81 2 cases case NNS work_rujstqwje5gkdm2bqer4drugey 81 3 where where WRB work_rujstqwje5gkdm2bqer4drugey 81 4 these these DT work_rujstqwje5gkdm2bqer4drugey 81 5 were be VBD work_rujstqwje5gkdm2bqer4drugey 81 6 not not RB work_rujstqwje5gkdm2bqer4drugey 81 7 exact exact JJ work_rujstqwje5gkdm2bqer4drugey 81 8 matches match NNS work_rujstqwje5gkdm2bqer4drugey 81 9 , , , work_rujstqwje5gkdm2bqer4drugey 81 10 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 81 11 used use VBD work_rujstqwje5gkdm2bqer4drugey 81 12 a a DT work_rujstqwje5gkdm2bqer4drugey 81 13 sec- sec- JJ work_rujstqwje5gkdm2bqer4drugey 81 14 ond ond NN work_rujstqwje5gkdm2bqer4drugey 81 15 pass pass NN work_rujstqwje5gkdm2bqer4drugey 81 16 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 81 17 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 81 18 , , , work_rujstqwje5gkdm2bqer4drugey 81 19 which which WDT work_rujstqwje5gkdm2bqer4drugey 81 20 asked ask VBD work_rujstqwje5gkdm2bqer4drugey 81 21 English English NNP work_rujstqwje5gkdm2bqer4drugey 81 22 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 81 23 to to TO work_rujstqwje5gkdm2bqer4drugey 81 24 evaluate evaluate VB work_rujstqwje5gkdm2bqer4drugey 81 25 if if IN work_rujstqwje5gkdm2bqer4drugey 81 26 a a DT work_rujstqwje5gkdm2bqer4drugey 81 27 worker worker NN work_rujstqwje5gkdm2bqer4drugey 81 28 - - HYPH work_rujstqwje5gkdm2bqer4drugey 81 29 provided provide VBN work_rujstqwje5gkdm2bqer4drugey 81 30 translation translation NN work_rujstqwje5gkdm2bqer4drugey 81 31 was be VBD work_rujstqwje5gkdm2bqer4drugey 81 32 a a DT work_rujstqwje5gkdm2bqer4drugey 81 33 synonym synonym NN work_rujstqwje5gkdm2bqer4drugey 81 34 of of IN work_rujstqwje5gkdm2bqer4drugey 81 35 the the DT work_rujstqwje5gkdm2bqer4drugey 81 36 known know VBN work_rujstqwje5gkdm2bqer4drugey 81 37 translation translation NN work_rujstqwje5gkdm2bqer4drugey 81 38 . . . work_rujstqwje5gkdm2bqer4drugey 82 1 Demographic demographic JJ work_rujstqwje5gkdm2bqer4drugey 82 2 questionnaire questionnaire NN work_rujstqwje5gkdm2bqer4drugey 82 3 At at IN work_rujstqwje5gkdm2bqer4drugey 82 4 the the DT work_rujstqwje5gkdm2bqer4drugey 82 5 start start NN work_rujstqwje5gkdm2bqer4drugey 82 6 of of IN work_rujstqwje5gkdm2bqer4drugey 82 7 each each DT work_rujstqwje5gkdm2bqer4drugey 82 8 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 82 9 , , , work_rujstqwje5gkdm2bqer4drugey 82 10 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 82 11 were be VBD work_rujstqwje5gkdm2bqer4drugey 82 12 asked ask VBN work_rujstqwje5gkdm2bqer4drugey 82 13 to to TO work_rujstqwje5gkdm2bqer4drugey 82 14 complete complete VB work_rujstqwje5gkdm2bqer4drugey 82 15 a a DT work_rujstqwje5gkdm2bqer4drugey 82 16 brief brief JJ work_rujstqwje5gkdm2bqer4drugey 82 17 survey survey NN work_rujstqwje5gkdm2bqer4drugey 82 18 about about IN work_rujstqwje5gkdm2bqer4drugey 82 19 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 82 20 language language NN work_rujstqwje5gkdm2bqer4drugey 82 21 abilities ability NNS work_rujstqwje5gkdm2bqer4drugey 82 22 . . . work_rujstqwje5gkdm2bqer4drugey 83 1 The the DT work_rujstqwje5gkdm2bqer4drugey 83 2 survey survey NN work_rujstqwje5gkdm2bqer4drugey 83 3 asked ask VBD work_rujstqwje5gkdm2bqer4drugey 83 4 the the DT work_rujstqwje5gkdm2bqer4drugey 83 5 following follow VBG work_rujstqwje5gkdm2bqer4drugey 83 6 questions question NNS work_rujstqwje5gkdm2bqer4drugey 83 7 : : : work_rujstqwje5gkdm2bqer4drugey 83 8 • • NNP work_rujstqwje5gkdm2bqer4drugey 83 9 Is be VBZ work_rujstqwje5gkdm2bqer4drugey 83 10 [ [ -LRB- work_rujstqwje5gkdm2bqer4drugey 83 11 language language NN work_rujstqwje5gkdm2bqer4drugey 83 12 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 83 13 your -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 83 14 native native JJ work_rujstqwje5gkdm2bqer4drugey 83 15 language language NN work_rujstqwje5gkdm2bqer4drugey 83 16 ? ? . work_rujstqwje5gkdm2bqer4drugey 84 1 • • VB work_rujstqwje5gkdm2bqer4drugey 84 2 How how WRB work_rujstqwje5gkdm2bqer4drugey 84 3 many many JJ work_rujstqwje5gkdm2bqer4drugey 84 4 years year NNS work_rujstqwje5gkdm2bqer4drugey 84 5 have have VBP work_rujstqwje5gkdm2bqer4drugey 84 6 you -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 84 7 spoken speak VBN work_rujstqwje5gkdm2bqer4drugey 84 8 [ [ -LRB- work_rujstqwje5gkdm2bqer4drugey 84 9 language language NN work_rujstqwje5gkdm2bqer4drugey 84 10 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 84 11 ? ? . work_rujstqwje5gkdm2bqer4drugey 85 1 81 81 CD work_rujstqwje5gkdm2bqer4drugey 85 2 • • NN work_rujstqwje5gkdm2bqer4drugey 85 3 Is be VBZ work_rujstqwje5gkdm2bqer4drugey 85 4 English English NNP work_rujstqwje5gkdm2bqer4drugey 85 5 your -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 85 6 native native JJ work_rujstqwje5gkdm2bqer4drugey 85 7 language language NN work_rujstqwje5gkdm2bqer4drugey 85 8 ? ? . work_rujstqwje5gkdm2bqer4drugey 86 1 • • VB work_rujstqwje5gkdm2bqer4drugey 86 2 How how WRB work_rujstqwje5gkdm2bqer4drugey 86 3 many many JJ work_rujstqwje5gkdm2bqer4drugey 86 4 years year NNS work_rujstqwje5gkdm2bqer4drugey 86 5 have have VBP work_rujstqwje5gkdm2bqer4drugey 86 6 you -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 86 7 spoken speak VBN work_rujstqwje5gkdm2bqer4drugey 86 8 English English NNP work_rujstqwje5gkdm2bqer4drugey 86 9 ? ? . work_rujstqwje5gkdm2bqer4drugey 87 1 • • VB work_rujstqwje5gkdm2bqer4drugey 87 2 What what WDT work_rujstqwje5gkdm2bqer4drugey 87 3 country country NN work_rujstqwje5gkdm2bqer4drugey 87 4 do do VBP work_rujstqwje5gkdm2bqer4drugey 87 5 you -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 87 6 live live VB work_rujstqwje5gkdm2bqer4drugey 87 7 in in IN work_rujstqwje5gkdm2bqer4drugey 87 8 ? ? . work_rujstqwje5gkdm2bqer4drugey 88 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 88 2 automatically automatically RB work_rujstqwje5gkdm2bqer4drugey 88 3 collected collect VBD work_rujstqwje5gkdm2bqer4drugey 88 4 each each DT work_rujstqwje5gkdm2bqer4drugey 88 5 worker worker NN work_rujstqwje5gkdm2bqer4drugey 88 6 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 88 7 current current JJ work_rujstqwje5gkdm2bqer4drugey 88 8 lo- lo- NNP work_rujstqwje5gkdm2bqer4drugey 88 9 cation cation NN work_rujstqwje5gkdm2bqer4drugey 88 10 by by IN work_rujstqwje5gkdm2bqer4drugey 88 11 geolocating geolocate VBG work_rujstqwje5gkdm2bqer4drugey 88 12 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 88 13 IP IP NNP work_rujstqwje5gkdm2bqer4drugey 88 14 address address NN work_rujstqwje5gkdm2bqer4drugey 88 15 . . . work_rujstqwje5gkdm2bqer4drugey 89 1 A a DT work_rujstqwje5gkdm2bqer4drugey 89 2 total total NN work_rujstqwje5gkdm2bqer4drugey 89 3 of of IN work_rujstqwje5gkdm2bqer4drugey 89 4 5,281 5,281 CD work_rujstqwje5gkdm2bqer4drugey 89 5 unique unique JJ work_rujstqwje5gkdm2bqer4drugey 89 6 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 89 7 completed complete VBD work_rujstqwje5gkdm2bqer4drugey 89 8 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 89 9 HITs hit NNS work_rujstqwje5gkdm2bqer4drugey 89 10 . . . work_rujstqwje5gkdm2bqer4drugey 90 1 Of of IN work_rujstqwje5gkdm2bqer4drugey 90 2 these these DT work_rujstqwje5gkdm2bqer4drugey 90 3 , , , work_rujstqwje5gkdm2bqer4drugey 90 4 3,625 3,625 CD work_rujstqwje5gkdm2bqer4drugey 90 5 provided provide VBD work_rujstqwje5gkdm2bqer4drugey 90 6 answers answer NNS work_rujstqwje5gkdm2bqer4drugey 90 7 to to IN work_rujstqwje5gkdm2bqer4drugey 90 8 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 90 9 survey survey NN work_rujstqwje5gkdm2bqer4drugey 90 10 questions question NNS work_rujstqwje5gkdm2bqer4drugey 90 11 , , , work_rujstqwje5gkdm2bqer4drugey 90 12 and and CC work_rujstqwje5gkdm2bqer4drugey 90 13 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 90 14 were be VBD work_rujstqwje5gkdm2bqer4drugey 90 15 able able JJ work_rujstqwje5gkdm2bqer4drugey 90 16 to to TO work_rujstqwje5gkdm2bqer4drugey 90 17 geolocate geolocate VB work_rujstqwje5gkdm2bqer4drugey 90 18 5,043 5,043 CD work_rujstqwje5gkdm2bqer4drugey 90 19 . . . work_rujstqwje5gkdm2bqer4drugey 91 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 91 2 1 1 CD work_rujstqwje5gkdm2bqer4drugey 91 3 plots plot VBZ work_rujstqwje5gkdm2bqer4drugey 91 4 the the DT work_rujstqwje5gkdm2bqer4drugey 91 5 location location NN work_rujstqwje5gkdm2bqer4drugey 91 6 of of IN work_rujstqwje5gkdm2bqer4drugey 91 7 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 91 8 across across IN work_rujstqwje5gkdm2bqer4drugey 91 9 106 106 CD work_rujstqwje5gkdm2bqer4drugey 91 10 countries country NNS work_rujstqwje5gkdm2bqer4drugey 91 11 . . . work_rujstqwje5gkdm2bqer4drugey 92 1 Table table NN work_rujstqwje5gkdm2bqer4drugey 92 2 1 1 CD work_rujstqwje5gkdm2bqer4drugey 92 3 gives give VBZ work_rujstqwje5gkdm2bqer4drugey 92 4 the the DT work_rujstqwje5gkdm2bqer4drugey 92 5 most most RBS work_rujstqwje5gkdm2bqer4drugey 92 6 common common JJ work_rujstqwje5gkdm2bqer4drugey 92 7 self self NN work_rujstqwje5gkdm2bqer4drugey 92 8 - - HYPH work_rujstqwje5gkdm2bqer4drugey 92 9 reported report VBN work_rujstqwje5gkdm2bqer4drugey 92 10 native native JJ work_rujstqwje5gkdm2bqer4drugey 92 11 lan- lan- NN work_rujstqwje5gkdm2bqer4drugey 92 12 guages guage NNS work_rujstqwje5gkdm2bqer4drugey 92 13 . . . work_rujstqwje5gkdm2bqer4drugey 93 1 Selection selection NN work_rujstqwje5gkdm2bqer4drugey 93 2 of of IN work_rujstqwje5gkdm2bqer4drugey 93 3 languages language NNS work_rujstqwje5gkdm2bqer4drugey 93 4 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 93 5 drew draw VBD work_rujstqwje5gkdm2bqer4drugey 93 6 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 93 7 data datum NNS work_rujstqwje5gkdm2bqer4drugey 93 8 from from IN work_rujstqwje5gkdm2bqer4drugey 93 9 the the DT work_rujstqwje5gkdm2bqer4drugey 93 10 different different JJ work_rujstqwje5gkdm2bqer4drugey 93 11 language language NN work_rujstqwje5gkdm2bqer4drugey 93 12 versions version NNS work_rujstqwje5gkdm2bqer4drugey 93 13 of of IN work_rujstqwje5gkdm2bqer4drugey 93 14 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 93 15 . . . work_rujstqwje5gkdm2bqer4drugey 94 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 94 2 se- se- VBP work_rujstqwje5gkdm2bqer4drugey 94 3 lected lecte VBD work_rujstqwje5gkdm2bqer4drugey 94 4 the the DT work_rujstqwje5gkdm2bqer4drugey 94 5 100 100 CD work_rujstqwje5gkdm2bqer4drugey 94 6 languages language NNS work_rujstqwje5gkdm2bqer4drugey 94 7 with with IN work_rujstqwje5gkdm2bqer4drugey 94 8 the the DT work_rujstqwje5gkdm2bqer4drugey 94 9 largest large JJS work_rujstqwje5gkdm2bqer4drugey 94 10 number number NN work_rujstqwje5gkdm2bqer4drugey 94 11 of of IN work_rujstqwje5gkdm2bqer4drugey 94 12 articles article NNS work_rujstqwje5gkdm2bqer4drugey 94 13 1 1 CD work_rujstqwje5gkdm2bqer4drugey 94 14 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 94 15 Table table NN work_rujstqwje5gkdm2bqer4drugey 94 16 2 2 CD work_rujstqwje5gkdm2bqer4drugey 94 17 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 94 18 . . . work_rujstqwje5gkdm2bqer4drugey 95 1 For for IN work_rujstqwje5gkdm2bqer4drugey 95 2 each each DT work_rujstqwje5gkdm2bqer4drugey 95 3 language language NN work_rujstqwje5gkdm2bqer4drugey 95 4 , , , work_rujstqwje5gkdm2bqer4drugey 95 5 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 95 6 chose choose VBD work_rujstqwje5gkdm2bqer4drugey 95 7 the the DT work_rujstqwje5gkdm2bqer4drugey 95 8 1,000 1,000 CD work_rujstqwje5gkdm2bqer4drugey 95 9 most most RBS work_rujstqwje5gkdm2bqer4drugey 95 10 viewed view VBN work_rujstqwje5gkdm2bqer4drugey 95 11 articles article NNS work_rujstqwje5gkdm2bqer4drugey 95 12 over over IN work_rujstqwje5gkdm2bqer4drugey 95 13 a a DT work_rujstqwje5gkdm2bqer4drugey 95 14 1 1 CD work_rujstqwje5gkdm2bqer4drugey 95 15 year year NN work_rujstqwje5gkdm2bqer4drugey 95 16 period,2 period,2 NNP work_rujstqwje5gkdm2bqer4drugey 95 17 and and CC work_rujstqwje5gkdm2bqer4drugey 95 18 extracted extract VBD work_rujstqwje5gkdm2bqer4drugey 95 19 the the DT work_rujstqwje5gkdm2bqer4drugey 95 20 10,000 10,000 CD work_rujstqwje5gkdm2bqer4drugey 95 21 most most RBS work_rujstqwje5gkdm2bqer4drugey 95 22 frequent frequent JJ work_rujstqwje5gkdm2bqer4drugey 95 23 words word NNS work_rujstqwje5gkdm2bqer4drugey 95 24 from from IN work_rujstqwje5gkdm2bqer4drugey 95 25 them -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 95 26 . . . work_rujstqwje5gkdm2bqer4drugey 96 1 The the DT work_rujstqwje5gkdm2bqer4drugey 96 2 resulting result VBG work_rujstqwje5gkdm2bqer4drugey 96 3 vocabularies vocabulary NNS work_rujstqwje5gkdm2bqer4drugey 96 4 served serve VBD work_rujstqwje5gkdm2bqer4drugey 96 5 as as IN work_rujstqwje5gkdm2bqer4drugey 96 6 the the DT work_rujstqwje5gkdm2bqer4drugey 96 7 input input NN work_rujstqwje5gkdm2bqer4drugey 96 8 to to IN work_rujstqwje5gkdm2bqer4drugey 96 9 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 96 10 translation translation NN work_rujstqwje5gkdm2bqer4drugey 96 11 HIT HIT NNP work_rujstqwje5gkdm2bqer4drugey 96 12 . . . work_rujstqwje5gkdm2bqer4drugey 97 1 Translation translation NN work_rujstqwje5gkdm2bqer4drugey 97 2 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 97 3 For for IN work_rujstqwje5gkdm2bqer4drugey 97 4 the the DT work_rujstqwje5gkdm2bqer4drugey 97 5 translation translation NN work_rujstqwje5gkdm2bqer4drugey 97 6 task task NN work_rujstqwje5gkdm2bqer4drugey 97 7 , , , work_rujstqwje5gkdm2bqer4drugey 97 8 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 97 9 asked ask VBD work_rujstqwje5gkdm2bqer4drugey 97 10 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 97 11 to to TO work_rujstqwje5gkdm2bqer4drugey 97 12 translate translate VB work_rujstqwje5gkdm2bqer4drugey 97 13 individual individual JJ work_rujstqwje5gkdm2bqer4drugey 97 14 words word NNS work_rujstqwje5gkdm2bqer4drugey 97 15 . . . work_rujstqwje5gkdm2bqer4drugey 98 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 98 2 showed show VBD work_rujstqwje5gkdm2bqer4drugey 98 3 each each DT work_rujstqwje5gkdm2bqer4drugey 98 4 word word NN work_rujstqwje5gkdm2bqer4drugey 98 5 in in IN work_rujstqwje5gkdm2bqer4drugey 98 6 the the DT work_rujstqwje5gkdm2bqer4drugey 98 7 context context NN work_rujstqwje5gkdm2bqer4drugey 98 8 of of IN work_rujstqwje5gkdm2bqer4drugey 98 9 three three CD work_rujstqwje5gkdm2bqer4drugey 98 10 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 98 11 that that WDT work_rujstqwje5gkdm2bqer4drugey 98 12 were be VBD work_rujstqwje5gkdm2bqer4drugey 98 13 drawn draw VBN work_rujstqwje5gkdm2bqer4drugey 98 14 from from IN work_rujstqwje5gkdm2bqer4drugey 98 15 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 98 16 . . . work_rujstqwje5gkdm2bqer4drugey 99 1 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 99 2 were be VBD work_rujstqwje5gkdm2bqer4drugey 99 3 al- al- RB work_rujstqwje5gkdm2bqer4drugey 99 4 lowed low VBN work_rujstqwje5gkdm2bqer4drugey 99 5 to to TO work_rujstqwje5gkdm2bqer4drugey 99 6 mark mark VB work_rujstqwje5gkdm2bqer4drugey 99 7 that that IN work_rujstqwje5gkdm2bqer4drugey 99 8 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 99 9 were be VBD work_rujstqwje5gkdm2bqer4drugey 99 10 unable unable JJ work_rujstqwje5gkdm2bqer4drugey 99 11 to to TO work_rujstqwje5gkdm2bqer4drugey 99 12 translate translate VB work_rujstqwje5gkdm2bqer4drugey 99 13 a a DT work_rujstqwje5gkdm2bqer4drugey 99 14 word word NN work_rujstqwje5gkdm2bqer4drugey 99 15 . . . work_rujstqwje5gkdm2bqer4drugey 100 1 Each each DT work_rujstqwje5gkdm2bqer4drugey 100 2 task task NN work_rujstqwje5gkdm2bqer4drugey 100 3 contained contain VBD work_rujstqwje5gkdm2bqer4drugey 100 4 10 10 CD work_rujstqwje5gkdm2bqer4drugey 100 5 words word NNS work_rujstqwje5gkdm2bqer4drugey 100 6 , , , work_rujstqwje5gkdm2bqer4drugey 100 7 8 8 CD work_rujstqwje5gkdm2bqer4drugey 100 8 of of IN work_rujstqwje5gkdm2bqer4drugey 100 9 which which WDT work_rujstqwje5gkdm2bqer4drugey 100 10 were be VBD work_rujstqwje5gkdm2bqer4drugey 100 11 words word NNS work_rujstqwje5gkdm2bqer4drugey 100 12 with with IN work_rujstqwje5gkdm2bqer4drugey 100 13 unknown unknown JJ work_rujstqwje5gkdm2bqer4drugey 100 14 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 100 15 , , , work_rujstqwje5gkdm2bqer4drugey 100 16 and and CC work_rujstqwje5gkdm2bqer4drugey 100 17 2 2 CD work_rujstqwje5gkdm2bqer4drugey 100 18 of of IN work_rujstqwje5gkdm2bqer4drugey 100 19 which which WDT work_rujstqwje5gkdm2bqer4drugey 100 20 were be VBD work_rujstqwje5gkdm2bqer4drugey 100 21 quality quality NN work_rujstqwje5gkdm2bqer4drugey 100 22 control control NN work_rujstqwje5gkdm2bqer4drugey 100 23 words word NNS work_rujstqwje5gkdm2bqer4drugey 100 24 with with IN work_rujstqwje5gkdm2bqer4drugey 100 25 known known JJ work_rujstqwje5gkdm2bqer4drugey 100 26 trans- trans- JJ work_rujstqwje5gkdm2bqer4drugey 100 27 lations lation NNS work_rujstqwje5gkdm2bqer4drugey 100 28 . . . work_rujstqwje5gkdm2bqer4drugey 101 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 101 2 gave give VBD work_rujstqwje5gkdm2bqer4drugey 101 3 special special JJ work_rujstqwje5gkdm2bqer4drugey 101 4 instruction instruction NN work_rujstqwje5gkdm2bqer4drugey 101 5 for for IN work_rujstqwje5gkdm2bqer4drugey 101 6 translat- translat- NN work_rujstqwje5gkdm2bqer4drugey 101 7 ing e VBG work_rujstqwje5gkdm2bqer4drugey 101 8 names name NNS work_rujstqwje5gkdm2bqer4drugey 101 9 of of IN work_rujstqwje5gkdm2bqer4drugey 101 10 people people NNS work_rujstqwje5gkdm2bqer4drugey 101 11 and and CC work_rujstqwje5gkdm2bqer4drugey 101 12 places place NNS work_rujstqwje5gkdm2bqer4drugey 101 13 , , , work_rujstqwje5gkdm2bqer4drugey 101 14 giving give VBG work_rujstqwje5gkdm2bqer4drugey 101 15 examples example NNS work_rujstqwje5gkdm2bqer4drugey 101 16 of of IN work_rujstqwje5gkdm2bqer4drugey 101 17 how how WRB work_rujstqwje5gkdm2bqer4drugey 101 18 to to TO work_rujstqwje5gkdm2bqer4drugey 101 19 handle handle VB work_rujstqwje5gkdm2bqer4drugey 101 20 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 101 21 Barack Barack NNP work_rujstqwje5gkdm2bqer4drugey 101 22 Obama Obama NNP work_rujstqwje5gkdm2bqer4drugey 101 23 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 101 24 and and CC work_rujstqwje5gkdm2bqer4drugey 101 25 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 101 26 Australia Australia NNP work_rujstqwje5gkdm2bqer4drugey 101 27 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 101 28 using use VBG work_rujstqwje5gkdm2bqer4drugey 101 29 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 101 30 interlanguage interlanguage NN work_rujstqwje5gkdm2bqer4drugey 101 31 links link NNS work_rujstqwje5gkdm2bqer4drugey 101 32 . . . work_rujstqwje5gkdm2bqer4drugey 102 1 For for IN work_rujstqwje5gkdm2bqer4drugey 102 2 languages language NNS work_rujstqwje5gkdm2bqer4drugey 102 3 with with IN work_rujstqwje5gkdm2bqer4drugey 102 4 non non JJ work_rujstqwje5gkdm2bqer4drugey 102 5 - - JJ work_rujstqwje5gkdm2bqer4drugey 102 6 Latin latin JJ work_rujstqwje5gkdm2bqer4drugey 102 7 alphabets alphabet NNS work_rujstqwje5gkdm2bqer4drugey 102 8 , , , work_rujstqwje5gkdm2bqer4drugey 102 9 names name NNS work_rujstqwje5gkdm2bqer4drugey 102 10 were be VBD work_rujstqwje5gkdm2bqer4drugey 102 11 transliterated transliterate VBN work_rujstqwje5gkdm2bqer4drugey 102 12 . . . work_rujstqwje5gkdm2bqer4drugey 103 1 The the DT work_rujstqwje5gkdm2bqer4drugey 103 2 task task NN work_rujstqwje5gkdm2bqer4drugey 103 3 paid pay VBD work_rujstqwje5gkdm2bqer4drugey 103 4 $ $ $ work_rujstqwje5gkdm2bqer4drugey 103 5 0.15 0.15 CD work_rujstqwje5gkdm2bqer4drugey 103 6 for for IN work_rujstqwje5gkdm2bqer4drugey 103 7 the the DT work_rujstqwje5gkdm2bqer4drugey 103 8 translation translation NN work_rujstqwje5gkdm2bqer4drugey 103 9 of of IN work_rujstqwje5gkdm2bqer4drugey 103 10 10 10 CD work_rujstqwje5gkdm2bqer4drugey 103 11 words word NNS work_rujstqwje5gkdm2bqer4drugey 103 12 . . . work_rujstqwje5gkdm2bqer4drugey 104 1 Each each DT work_rujstqwje5gkdm2bqer4drugey 104 2 set set NN work_rujstqwje5gkdm2bqer4drugey 104 3 of of IN work_rujstqwje5gkdm2bqer4drugey 104 4 10 10 CD work_rujstqwje5gkdm2bqer4drugey 104 5 words word NNS work_rujstqwje5gkdm2bqer4drugey 104 6 was be VBD work_rujstqwje5gkdm2bqer4drugey 104 7 independently independently RB work_rujstqwje5gkdm2bqer4drugey 104 8 translated translate VBN work_rujstqwje5gkdm2bqer4drugey 104 9 by by IN work_rujstqwje5gkdm2bqer4drugey 104 10 three three CD work_rujstqwje5gkdm2bqer4drugey 104 11 separate separate JJ work_rujstqwje5gkdm2bqer4drugey 104 12 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 104 13 . . . work_rujstqwje5gkdm2bqer4drugey 105 1 5,281 5,281 CD work_rujstqwje5gkdm2bqer4drugey 105 2 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 105 3 completed complete VBD work_rujstqwje5gkdm2bqer4drugey 105 4 256,604 256,604 CD work_rujstqwje5gkdm2bqer4drugey 105 5 translation translation NN work_rujstqwje5gkdm2bqer4drugey 105 6 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 105 7 , , , work_rujstqwje5gkdm2bqer4drugey 105 8 totaling total VBG work_rujstqwje5gkdm2bqer4drugey 105 9 more more JJR work_rujstqwje5gkdm2bqer4drugey 105 10 than than IN work_rujstqwje5gkdm2bqer4drugey 105 11 3 3 CD work_rujstqwje5gkdm2bqer4drugey 105 12 million million CD work_rujstqwje5gkdm2bqer4drugey 105 13 words word NNS work_rujstqwje5gkdm2bqer4drugey 105 14 , , , work_rujstqwje5gkdm2bqer4drugey 105 15 over over IN work_rujstqwje5gkdm2bqer4drugey 105 16 a a DT work_rujstqwje5gkdm2bqer4drugey 105 17 period period NN work_rujstqwje5gkdm2bqer4drugey 105 18 of of IN work_rujstqwje5gkdm2bqer4drugey 105 19 three three CD work_rujstqwje5gkdm2bqer4drugey 105 20 and and CC work_rujstqwje5gkdm2bqer4drugey 105 21 a a DT work_rujstqwje5gkdm2bqer4drugey 105 22 half half NN work_rujstqwje5gkdm2bqer4drugey 105 23 months month NNS work_rujstqwje5gkdm2bqer4drugey 105 24 . . . work_rujstqwje5gkdm2bqer4drugey 106 1 Gold gold JJ work_rujstqwje5gkdm2bqer4drugey 106 2 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 106 3 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 106 4 A a DT work_rujstqwje5gkdm2bqer4drugey 106 5 set set NN work_rujstqwje5gkdm2bqer4drugey 106 6 of of IN work_rujstqwje5gkdm2bqer4drugey 106 7 gold gold NN work_rujstqwje5gkdm2bqer4drugey 106 8 stan- stan- NN work_rujstqwje5gkdm2bqer4drugey 106 9 dard dard NN work_rujstqwje5gkdm2bqer4drugey 106 10 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 106 11 were be VBD work_rujstqwje5gkdm2bqer4drugey 106 12 automatically automatically RB work_rujstqwje5gkdm2bqer4drugey 106 13 harvested harvest VBN work_rujstqwje5gkdm2bqer4drugey 106 14 from from IN work_rujstqwje5gkdm2bqer4drugey 106 15 1http://meta.wikimedia.org/wiki/List_of 1http://meta.wikimedia.org/wiki/List_of NNP work_rujstqwje5gkdm2bqer4drugey 106 16 _ _ NNP work_rujstqwje5gkdm2bqer4drugey 106 17 Wikipedias Wikipedias NNP work_rujstqwje5gkdm2bqer4drugey 106 18 2http://dumps.wikimedia.org/other/ 2http://dumps.wikimedia.org/other/ CD work_rujstqwje5gkdm2bqer4drugey 106 19 pagecounts pagecount NNS work_rujstqwje5gkdm2bqer4drugey 106 20 - - : work_rujstqwje5gkdm2bqer4drugey 106 21 raw/ raw/ NNP work_rujstqwje5gkdm2bqer4drugey 106 22 500K+ 500k+ CD work_rujstqwje5gkdm2bqer4drugey 106 23 ARTICLES articles NN work_rujstqwje5gkdm2bqer4drugey 106 24 : : : work_rujstqwje5gkdm2bqer4drugey 106 25 German German NNP work_rujstqwje5gkdm2bqer4drugey 106 26 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 27 de de NNP work_rujstqwje5gkdm2bqer4drugey 106 28 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 29 , , , work_rujstqwje5gkdm2bqer4drugey 106 30 English English NNP work_rujstqwje5gkdm2bqer4drugey 106 31 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 32 en en NNP work_rujstqwje5gkdm2bqer4drugey 106 33 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 34 , , , work_rujstqwje5gkdm2bqer4drugey 106 35 Spanish Spanish NNP work_rujstqwje5gkdm2bqer4drugey 106 36 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 37 es es NN work_rujstqwje5gkdm2bqer4drugey 106 38 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 39 , , , work_rujstqwje5gkdm2bqer4drugey 106 40 French French NNP work_rujstqwje5gkdm2bqer4drugey 106 41 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 42 fr fr NN work_rujstqwje5gkdm2bqer4drugey 106 43 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 44 , , , work_rujstqwje5gkdm2bqer4drugey 106 45 Italian Italian NNP work_rujstqwje5gkdm2bqer4drugey 106 46 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 47 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 106 48 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 49 , , , work_rujstqwje5gkdm2bqer4drugey 106 50 Japanese Japanese NNP work_rujstqwje5gkdm2bqer4drugey 106 51 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 52 ja ja NNP work_rujstqwje5gkdm2bqer4drugey 106 53 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 54 , , , work_rujstqwje5gkdm2bqer4drugey 106 55 Dutch Dutch NNP work_rujstqwje5gkdm2bqer4drugey 106 56 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 57 nl nl UH work_rujstqwje5gkdm2bqer4drugey 106 58 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 59 , , , work_rujstqwje5gkdm2bqer4drugey 106 60 Polish Polish NNP work_rujstqwje5gkdm2bqer4drugey 106 61 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 62 pl pl NNP work_rujstqwje5gkdm2bqer4drugey 106 63 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 64 , , , work_rujstqwje5gkdm2bqer4drugey 106 65 Portuguese Portuguese NNP work_rujstqwje5gkdm2bqer4drugey 106 66 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 67 pt pt UH work_rujstqwje5gkdm2bqer4drugey 106 68 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 69 , , , work_rujstqwje5gkdm2bqer4drugey 106 70 Russian Russian NNP work_rujstqwje5gkdm2bqer4drugey 106 71 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 72 ru ru NNP work_rujstqwje5gkdm2bqer4drugey 106 73 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 74 100K-500 100k-500 CD work_rujstqwje5gkdm2bqer4drugey 106 75 K k NN work_rujstqwje5gkdm2bqer4drugey 106 76 ARTICLES articles NN work_rujstqwje5gkdm2bqer4drugey 106 77 : : : work_rujstqwje5gkdm2bqer4drugey 106 78 Arabic Arabic NNP work_rujstqwje5gkdm2bqer4drugey 106 79 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 80 ar ar NNP work_rujstqwje5gkdm2bqer4drugey 106 81 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 82 , , , work_rujstqwje5gkdm2bqer4drugey 106 83 Bulgarian Bulgarian NNP work_rujstqwje5gkdm2bqer4drugey 106 84 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 85 bg bg NNP work_rujstqwje5gkdm2bqer4drugey 106 86 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 87 , , , work_rujstqwje5gkdm2bqer4drugey 106 88 Catalan Catalan NNP work_rujstqwje5gkdm2bqer4drugey 106 89 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 90 ca ca NNP work_rujstqwje5gkdm2bqer4drugey 106 91 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 92 , , , work_rujstqwje5gkdm2bqer4drugey 106 93 Czech Czech NNP work_rujstqwje5gkdm2bqer4drugey 106 94 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 95 cs cs NNP work_rujstqwje5gkdm2bqer4drugey 106 96 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 97 , , , work_rujstqwje5gkdm2bqer4drugey 106 98 Danish Danish NNP work_rujstqwje5gkdm2bqer4drugey 106 99 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 100 da da NNP work_rujstqwje5gkdm2bqer4drugey 106 101 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 102 , , , work_rujstqwje5gkdm2bqer4drugey 106 103 Esperanto Esperanto NNP work_rujstqwje5gkdm2bqer4drugey 106 104 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 105 eo eo NNP work_rujstqwje5gkdm2bqer4drugey 106 106 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 107 , , , work_rujstqwje5gkdm2bqer4drugey 106 108 Basque Basque NNP work_rujstqwje5gkdm2bqer4drugey 106 109 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 110 eu eu NNP work_rujstqwje5gkdm2bqer4drugey 106 111 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 112 , , , work_rujstqwje5gkdm2bqer4drugey 106 113 Persian Persian NNP work_rujstqwje5gkdm2bqer4drugey 106 114 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 115 fa fa FW work_rujstqwje5gkdm2bqer4drugey 106 116 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 117 , , , work_rujstqwje5gkdm2bqer4drugey 106 118 Finnish Finnish NNP work_rujstqwje5gkdm2bqer4drugey 106 119 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 120 fi fi NN work_rujstqwje5gkdm2bqer4drugey 106 121 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 122 , , , work_rujstqwje5gkdm2bqer4drugey 106 123 Hebrew Hebrew NNP work_rujstqwje5gkdm2bqer4drugey 106 124 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 125 he -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 106 126 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 127 , , , work_rujstqwje5gkdm2bqer4drugey 106 128 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 106 129 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 130 hi hi UH work_rujstqwje5gkdm2bqer4drugey 106 131 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 132 , , , work_rujstqwje5gkdm2bqer4drugey 106 133 Croatian Croatian NNP work_rujstqwje5gkdm2bqer4drugey 106 134 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 135 hr hr NNP work_rujstqwje5gkdm2bqer4drugey 106 136 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 137 , , , work_rujstqwje5gkdm2bqer4drugey 106 138 Hungarian Hungarian NNP work_rujstqwje5gkdm2bqer4drugey 106 139 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 140 hu hu NNP work_rujstqwje5gkdm2bqer4drugey 106 141 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 142 , , , work_rujstqwje5gkdm2bqer4drugey 106 143 Indonesian Indonesian NNP work_rujstqwje5gkdm2bqer4drugey 106 144 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 145 i -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 106 146 d d VBN work_rujstqwje5gkdm2bqer4drugey 106 147 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 148 , , , work_rujstqwje5gkdm2bqer4drugey 106 149 Korean Korean NNP work_rujstqwje5gkdm2bqer4drugey 106 150 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 151 ko ko NNP work_rujstqwje5gkdm2bqer4drugey 106 152 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 153 , , , work_rujstqwje5gkdm2bqer4drugey 106 154 Lithuanian Lithuanian NNP work_rujstqwje5gkdm2bqer4drugey 106 155 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 156 lt lt NNP work_rujstqwje5gkdm2bqer4drugey 106 157 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 158 , , , work_rujstqwje5gkdm2bqer4drugey 106 159 Malay Malay NNP work_rujstqwje5gkdm2bqer4drugey 106 160 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 161 ms ms NNP work_rujstqwje5gkdm2bqer4drugey 106 162 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 163 , , , work_rujstqwje5gkdm2bqer4drugey 106 164 Norwe- Norwe- NNP work_rujstqwje5gkdm2bqer4drugey 106 165 gian gian NN work_rujstqwje5gkdm2bqer4drugey 106 166 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 167 Bokmal Bokmal NNP work_rujstqwje5gkdm2bqer4drugey 106 168 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 169 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 170 no no UH work_rujstqwje5gkdm2bqer4drugey 106 171 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 172 , , , work_rujstqwje5gkdm2bqer4drugey 106 173 Romanian Romanian NNP work_rujstqwje5gkdm2bqer4drugey 106 174 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 175 ro ro NNP work_rujstqwje5gkdm2bqer4drugey 106 176 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 177 , , , work_rujstqwje5gkdm2bqer4drugey 106 178 Slovak Slovak NNP work_rujstqwje5gkdm2bqer4drugey 106 179 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 180 sk sk NN work_rujstqwje5gkdm2bqer4drugey 106 181 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 182 , , , work_rujstqwje5gkdm2bqer4drugey 106 183 Slovenian Slovenian NNP work_rujstqwje5gkdm2bqer4drugey 106 184 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 185 sl sl UH work_rujstqwje5gkdm2bqer4drugey 106 186 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 187 , , , work_rujstqwje5gkdm2bqer4drugey 106 188 Ser- Ser- NNP work_rujstqwje5gkdm2bqer4drugey 106 189 bian bian NNP work_rujstqwje5gkdm2bqer4drugey 106 190 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 191 sr sr NNP work_rujstqwje5gkdm2bqer4drugey 106 192 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 193 , , , work_rujstqwje5gkdm2bqer4drugey 106 194 Swedish Swedish NNP work_rujstqwje5gkdm2bqer4drugey 106 195 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 196 sv sv NNP work_rujstqwje5gkdm2bqer4drugey 106 197 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 198 , , , work_rujstqwje5gkdm2bqer4drugey 106 199 Turkish turkish JJ work_rujstqwje5gkdm2bqer4drugey 106 200 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 201 tr tr JJ work_rujstqwje5gkdm2bqer4drugey 106 202 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 203 , , , work_rujstqwje5gkdm2bqer4drugey 106 204 UKrainian UKrainian NNP work_rujstqwje5gkdm2bqer4drugey 106 205 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 206 UK UK NNP work_rujstqwje5gkdm2bqer4drugey 106 207 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 208 , , , work_rujstqwje5gkdm2bqer4drugey 106 209 Vietnamese Vietnamese NNP work_rujstqwje5gkdm2bqer4drugey 106 210 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 211 vi vi NNP work_rujstqwje5gkdm2bqer4drugey 106 212 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 213 , , , work_rujstqwje5gkdm2bqer4drugey 106 214 Waray Waray NNP work_rujstqwje5gkdm2bqer4drugey 106 215 - - HYPH work_rujstqwje5gkdm2bqer4drugey 106 216 Waray Waray NNP work_rujstqwje5gkdm2bqer4drugey 106 217 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 218 war war NN work_rujstqwje5gkdm2bqer4drugey 106 219 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 220 , , , work_rujstqwje5gkdm2bqer4drugey 106 221 Chinese Chinese NNP work_rujstqwje5gkdm2bqer4drugey 106 222 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 223 zh zh NNP work_rujstqwje5gkdm2bqer4drugey 106 224 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 225 10K-100 10k-100 CD work_rujstqwje5gkdm2bqer4drugey 106 226 K k NN work_rujstqwje5gkdm2bqer4drugey 106 227 ARTICLES articles NN work_rujstqwje5gkdm2bqer4drugey 106 228 : : : work_rujstqwje5gkdm2bqer4drugey 106 229 Afrikaans Afrikaans NNPS work_rujstqwje5gkdm2bqer4drugey 106 230 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 231 af af NN work_rujstqwje5gkdm2bqer4drugey 106 232 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 233 Amharic Amharic NNP work_rujstqwje5gkdm2bqer4drugey 106 234 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 235 am be VBP work_rujstqwje5gkdm2bqer4drugey 106 236 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 237 Asturian Asturian NNP work_rujstqwje5gkdm2bqer4drugey 106 238 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 239 ast ast NN work_rujstqwje5gkdm2bqer4drugey 106 240 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 241 Azerbaijani Azerbaijani NNP work_rujstqwje5gkdm2bqer4drugey 106 242 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 243 az az NN work_rujstqwje5gkdm2bqer4drugey 106 244 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 245 Belarusian Belarusian NNP work_rujstqwje5gkdm2bqer4drugey 106 246 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 247 be be VB work_rujstqwje5gkdm2bqer4drugey 106 248 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 249 Bengali Bengali NNP work_rujstqwje5gkdm2bqer4drugey 106 250 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 251 bn bn NNP work_rujstqwje5gkdm2bqer4drugey 106 252 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 253 Bishnupriya Bishnupriya NNP work_rujstqwje5gkdm2bqer4drugey 106 254 Manipuri Manipuri NNP work_rujstqwje5gkdm2bqer4drugey 106 255 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 256 bpy bpy NN work_rujstqwje5gkdm2bqer4drugey 106 257 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 258 Breton Breton NNP work_rujstqwje5gkdm2bqer4drugey 106 259 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 260 br br NN work_rujstqwje5gkdm2bqer4drugey 106 261 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 262 Bosnian Bosnian NNP work_rujstqwje5gkdm2bqer4drugey 106 263 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 264 bs bs NNP work_rujstqwje5gkdm2bqer4drugey 106 265 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 266 Cebuano Cebuano NNP work_rujstqwje5gkdm2bqer4drugey 106 267 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 268 ceb ceb NN work_rujstqwje5gkdm2bqer4drugey 106 269 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 270 Welsh Welsh NNP work_rujstqwje5gkdm2bqer4drugey 106 271 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 272 cy cy NNP work_rujstqwje5gkdm2bqer4drugey 106 273 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 274 Zazaki Zazaki NNP work_rujstqwje5gkdm2bqer4drugey 106 275 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 276 diq diq NNS work_rujstqwje5gkdm2bqer4drugey 106 277 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 278 Greek Greek NNP work_rujstqwje5gkdm2bqer4drugey 106 279 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 280 el el NNP work_rujstqwje5gkdm2bqer4drugey 106 281 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 282 West West NNP work_rujstqwje5gkdm2bqer4drugey 106 283 Frisian Frisian NNP work_rujstqwje5gkdm2bqer4drugey 106 284 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 285 fy fy NN work_rujstqwje5gkdm2bqer4drugey 106 286 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 287 Irish Irish NNP work_rujstqwje5gkdm2bqer4drugey 106 288 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 289 ga ga NNP work_rujstqwje5gkdm2bqer4drugey 106 290 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 291 Galician Galician NNP work_rujstqwje5gkdm2bqer4drugey 106 292 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 293 gl gl NNP work_rujstqwje5gkdm2bqer4drugey 106 294 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 295 Gujarati Gujarati NNP work_rujstqwje5gkdm2bqer4drugey 106 296 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 297 gu gu NNP work_rujstqwje5gkdm2bqer4drugey 106 298 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 299 Haitian Haitian NNP work_rujstqwje5gkdm2bqer4drugey 106 300 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 301 ht ht NNP work_rujstqwje5gkdm2bqer4drugey 106 302 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 303 Armenian Armenian NNP work_rujstqwje5gkdm2bqer4drugey 106 304 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 305 hy hy NNP work_rujstqwje5gkdm2bqer4drugey 106 306 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 307 Icelandic Icelandic NNP work_rujstqwje5gkdm2bqer4drugey 106 308 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 309 is be VBZ work_rujstqwje5gkdm2bqer4drugey 106 310 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 311 Javanese Javanese NNP work_rujstqwje5gkdm2bqer4drugey 106 312 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 313 jv jv NNP work_rujstqwje5gkdm2bqer4drugey 106 314 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 315 Geor- Geor- NNP work_rujstqwje5gkdm2bqer4drugey 106 316 gian gian NNP work_rujstqwje5gkdm2bqer4drugey 106 317 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 318 ka ka NNP work_rujstqwje5gkdm2bqer4drugey 106 319 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 320 Kannada Kannada NNP work_rujstqwje5gkdm2bqer4drugey 106 321 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 322 kn kn UH work_rujstqwje5gkdm2bqer4drugey 106 323 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 324 Kurdish Kurdish NNP work_rujstqwje5gkdm2bqer4drugey 106 325 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 326 ku ku NNP work_rujstqwje5gkdm2bqer4drugey 106 327 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 328 Luxembourgish Luxembourgish NNP work_rujstqwje5gkdm2bqer4drugey 106 329 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 330 lb lb RB work_rujstqwje5gkdm2bqer4drugey 106 331 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 332 Latvian Latvian NNP work_rujstqwje5gkdm2bqer4drugey 106 333 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 334 lv lv NNP work_rujstqwje5gkdm2bqer4drugey 106 335 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 336 Malagasy Malagasy NNP work_rujstqwje5gkdm2bqer4drugey 106 337 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 338 mg mg NNP work_rujstqwje5gkdm2bqer4drugey 106 339 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 340 Macedonian Macedonian NNP work_rujstqwje5gkdm2bqer4drugey 106 341 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 342 mk mk NNP work_rujstqwje5gkdm2bqer4drugey 106 343 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 344 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 106 345 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 346 ml ml NNP work_rujstqwje5gkdm2bqer4drugey 106 347 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 348 Marathi Marathi NNP work_rujstqwje5gkdm2bqer4drugey 106 349 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 350 mr mr NNP work_rujstqwje5gkdm2bqer4drugey 106 351 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 352 Neapolitan Neapolitan NNP work_rujstqwje5gkdm2bqer4drugey 106 353 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 354 nap nap NN work_rujstqwje5gkdm2bqer4drugey 106 355 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 356 Low Low NNP work_rujstqwje5gkdm2bqer4drugey 106 357 Saxon Saxon NNP work_rujstqwje5gkdm2bqer4drugey 106 358 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 359 nds nds NNP work_rujstqwje5gkdm2bqer4drugey 106 360 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 361 Nepali Nepali NNP work_rujstqwje5gkdm2bqer4drugey 106 362 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 363 ne ne NNP work_rujstqwje5gkdm2bqer4drugey 106 364 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 365 Newar Newar NNP work_rujstqwje5gkdm2bqer4drugey 106 366 / / SYM work_rujstqwje5gkdm2bqer4drugey 106 367 Nepal Nepal NNP work_rujstqwje5gkdm2bqer4drugey 106 368 Bhasa Bhasa NNP work_rujstqwje5gkdm2bqer4drugey 106 369 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 370 new new JJ work_rujstqwje5gkdm2bqer4drugey 106 371 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 372 Norwegian Norwegian NNP work_rujstqwje5gkdm2bqer4drugey 106 373 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 374 Nynorsk Nynorsk NNP work_rujstqwje5gkdm2bqer4drugey 106 375 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 376 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 377 nn nn NNP work_rujstqwje5gkdm2bqer4drugey 106 378 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 379 Piedmontese Piedmontese NNP work_rujstqwje5gkdm2bqer4drugey 106 380 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 381 pms pms NN work_rujstqwje5gkdm2bqer4drugey 106 382 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 383 Sicil- Sicil- NNP work_rujstqwje5gkdm2bqer4drugey 106 384 ian ian NNP work_rujstqwje5gkdm2bqer4drugey 106 385 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 386 scn scn NNP work_rujstqwje5gkdm2bqer4drugey 106 387 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 388 Serbo Serbo NNP work_rujstqwje5gkdm2bqer4drugey 106 389 - - HYPH work_rujstqwje5gkdm2bqer4drugey 106 390 Croatian Croatian NNP work_rujstqwje5gkdm2bqer4drugey 106 391 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 392 sh sh NNP work_rujstqwje5gkdm2bqer4drugey 106 393 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 394 Albanian Albanian NNP work_rujstqwje5gkdm2bqer4drugey 106 395 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 396 sq sq NNP work_rujstqwje5gkdm2bqer4drugey 106 397 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 398 Sundanese Sundanese NNP work_rujstqwje5gkdm2bqer4drugey 106 399 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 400 su su NNP work_rujstqwje5gkdm2bqer4drugey 106 401 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 402 Swahili Swahili NNP work_rujstqwje5gkdm2bqer4drugey 106 403 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 404 sw sw NNP work_rujstqwje5gkdm2bqer4drugey 106 405 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 406 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 106 407 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 408 ta ta NNP work_rujstqwje5gkdm2bqer4drugey 106 409 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 410 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 106 411 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 412 te te NNP work_rujstqwje5gkdm2bqer4drugey 106 413 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 414 Thai Thai NNP work_rujstqwje5gkdm2bqer4drugey 106 415 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 416 th th XX work_rujstqwje5gkdm2bqer4drugey 106 417 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 418 Tagalog Tagalog NNP work_rujstqwje5gkdm2bqer4drugey 106 419 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 420 tl tl NN work_rujstqwje5gkdm2bqer4drugey 106 421 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 422 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 106 423 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 424 ur ur NNP work_rujstqwje5gkdm2bqer4drugey 106 425 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 426 Yoruba Yoruba NNP work_rujstqwje5gkdm2bqer4drugey 106 427 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 428 yo yo NNP work_rujstqwje5gkdm2bqer4drugey 106 429 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 430 < < XX work_rujstqwje5gkdm2bqer4drugey 106 431 10 10 CD work_rujstqwje5gkdm2bqer4drugey 106 432 K k NN work_rujstqwje5gkdm2bqer4drugey 106 433 ARTICLES article NNS work_rujstqwje5gkdm2bqer4drugey 106 434 : : : work_rujstqwje5gkdm2bqer4drugey 106 435 Central Central NNP work_rujstqwje5gkdm2bqer4drugey 106 436 Bicolano Bicolano NNP work_rujstqwje5gkdm2bqer4drugey 106 437 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 438 bcl bcl NN work_rujstqwje5gkdm2bqer4drugey 106 439 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 440 Tibetan Tibetan NNP work_rujstqwje5gkdm2bqer4drugey 106 441 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 442 bo bo NNP work_rujstqwje5gkdm2bqer4drugey 106 443 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 444 Ilokano Ilokano NNP work_rujstqwje5gkdm2bqer4drugey 106 445 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 446 ilo ilo NNP work_rujstqwje5gkdm2bqer4drugey 106 447 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 448 Punjabi Punjabi NNP work_rujstqwje5gkdm2bqer4drugey 106 449 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 450 pa pa NNP work_rujstqwje5gkdm2bqer4drugey 106 451 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 452 Kapampangan Kapampangan NNP work_rujstqwje5gkdm2bqer4drugey 106 453 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 454 pam pam NNP work_rujstqwje5gkdm2bqer4drugey 106 455 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 456 Pashto Pashto NNP work_rujstqwje5gkdm2bqer4drugey 106 457 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 458 ps ps NNP work_rujstqwje5gkdm2bqer4drugey 106 459 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 460 Sindhi Sindhi NNP work_rujstqwje5gkdm2bqer4drugey 106 461 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 462 sd sd NN work_rujstqwje5gkdm2bqer4drugey 106 463 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 464 Somali somali NN work_rujstqwje5gkdm2bqer4drugey 106 465 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 466 so so RB work_rujstqwje5gkdm2bqer4drugey 106 467 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 468 Uzbek Uzbek NNP work_rujstqwje5gkdm2bqer4drugey 106 469 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 470 uz uz NNP work_rujstqwje5gkdm2bqer4drugey 106 471 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 472 Wolof Wolof NNP work_rujstqwje5gkdm2bqer4drugey 106 473 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 106 474 wo wo NN work_rujstqwje5gkdm2bqer4drugey 106 475 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 106 476 Table table NN work_rujstqwje5gkdm2bqer4drugey 106 477 2 2 CD work_rujstqwje5gkdm2bqer4drugey 106 478 : : : work_rujstqwje5gkdm2bqer4drugey 106 479 A a DT work_rujstqwje5gkdm2bqer4drugey 106 480 list list NN work_rujstqwje5gkdm2bqer4drugey 106 481 of of IN work_rujstqwje5gkdm2bqer4drugey 106 482 the the DT work_rujstqwje5gkdm2bqer4drugey 106 483 languages language NNS work_rujstqwje5gkdm2bqer4drugey 106 484 that that WDT work_rujstqwje5gkdm2bqer4drugey 106 485 were be VBD work_rujstqwje5gkdm2bqer4drugey 106 486 used use VBN work_rujstqwje5gkdm2bqer4drugey 106 487 in in IN work_rujstqwje5gkdm2bqer4drugey 106 488 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 106 489 study study NN work_rujstqwje5gkdm2bqer4drugey 106 490 , , , work_rujstqwje5gkdm2bqer4drugey 106 491 grouped group VBN work_rujstqwje5gkdm2bqer4drugey 106 492 by by IN work_rujstqwje5gkdm2bqer4drugey 106 493 the the DT work_rujstqwje5gkdm2bqer4drugey 106 494 number number NN work_rujstqwje5gkdm2bqer4drugey 106 495 of of IN work_rujstqwje5gkdm2bqer4drugey 106 496 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 106 497 articles article NNS work_rujstqwje5gkdm2bqer4drugey 106 498 in in IN work_rujstqwje5gkdm2bqer4drugey 106 499 the the DT work_rujstqwje5gkdm2bqer4drugey 106 500 language language NN work_rujstqwje5gkdm2bqer4drugey 106 501 . . . work_rujstqwje5gkdm2bqer4drugey 107 1 Each each DT work_rujstqwje5gkdm2bqer4drugey 107 2 language language NN work_rujstqwje5gkdm2bqer4drugey 107 3 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 107 4 code code NN work_rujstqwje5gkdm2bqer4drugey 107 5 is be VBZ work_rujstqwje5gkdm2bqer4drugey 107 6 given give VBN work_rujstqwje5gkdm2bqer4drugey 107 7 in in IN work_rujstqwje5gkdm2bqer4drugey 107 8 parentheses parenthesis NNS work_rujstqwje5gkdm2bqer4drugey 107 9 . . . work_rujstqwje5gkdm2bqer4drugey 108 1 These these DT work_rujstqwje5gkdm2bqer4drugey 108 2 language language NN work_rujstqwje5gkdm2bqer4drugey 108 3 codes code NNS work_rujstqwje5gkdm2bqer4drugey 108 4 are be VBP work_rujstqwje5gkdm2bqer4drugey 108 5 used use VBN work_rujstqwje5gkdm2bqer4drugey 108 6 in in IN work_rujstqwje5gkdm2bqer4drugey 108 7 other other JJ work_rujstqwje5gkdm2bqer4drugey 108 8 figures figure NNS work_rujstqwje5gkdm2bqer4drugey 108 9 throughout throughout IN work_rujstqwje5gkdm2bqer4drugey 108 10 this this DT work_rujstqwje5gkdm2bqer4drugey 108 11 paper paper NN work_rujstqwje5gkdm2bqer4drugey 108 12 . . . work_rujstqwje5gkdm2bqer4drugey 109 1 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 109 2 for for IN work_rujstqwje5gkdm2bqer4drugey 109 3 every every DT work_rujstqwje5gkdm2bqer4drugey 109 4 language language NN work_rujstqwje5gkdm2bqer4drugey 109 5 to to TO work_rujstqwje5gkdm2bqer4drugey 109 6 use use VB work_rujstqwje5gkdm2bqer4drugey 109 7 as as IN work_rujstqwje5gkdm2bqer4drugey 109 8 embedded embed VBN work_rujstqwje5gkdm2bqer4drugey 109 9 controls control NNS work_rujstqwje5gkdm2bqer4drugey 109 10 . . . work_rujstqwje5gkdm2bqer4drugey 110 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 110 2 used use VBD work_rujstqwje5gkdm2bqer4drugey 110 3 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 110 4 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 110 5 inter inter JJ work_rujstqwje5gkdm2bqer4drugey 110 6 - - JJ work_rujstqwje5gkdm2bqer4drugey 110 7 language language JJ work_rujstqwje5gkdm2bqer4drugey 110 8 links link NNS work_rujstqwje5gkdm2bqer4drugey 110 9 to to TO work_rujstqwje5gkdm2bqer4drugey 110 10 pair pair VB work_rujstqwje5gkdm2bqer4drugey 110 11 titles title NNS work_rujstqwje5gkdm2bqer4drugey 110 12 of of IN work_rujstqwje5gkdm2bqer4drugey 110 13 English english JJ work_rujstqwje5gkdm2bqer4drugey 110 14 articles article NNS work_rujstqwje5gkdm2bqer4drugey 110 15 with with IN work_rujstqwje5gkdm2bqer4drugey 110 16 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 110 17 corre- corre- NN work_rujstqwje5gkdm2bqer4drugey 110 18 sponding sponde VBG work_rujstqwje5gkdm2bqer4drugey 110 19 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 110 20 article article NN work_rujstqwje5gkdm2bqer4drugey 110 21 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 110 22 title title NN work_rujstqwje5gkdm2bqer4drugey 110 23 . . . work_rujstqwje5gkdm2bqer4drugey 111 1 To to TO work_rujstqwje5gkdm2bqer4drugey 111 2 get get VB work_rujstqwje5gkdm2bqer4drugey 111 3 a a DT work_rujstqwje5gkdm2bqer4drugey 111 4 more more RBR work_rujstqwje5gkdm2bqer4drugey 111 5 trans- trans- JJ work_rujstqwje5gkdm2bqer4drugey 111 6 latable latable JJ work_rujstqwje5gkdm2bqer4drugey 111 7 set set NN work_rujstqwje5gkdm2bqer4drugey 111 8 of of IN work_rujstqwje5gkdm2bqer4drugey 111 9 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 111 10 , , , work_rujstqwje5gkdm2bqer4drugey 111 11 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 111 12 excluded exclude VBD work_rujstqwje5gkdm2bqer4drugey 111 13 any any DT work_rujstqwje5gkdm2bqer4drugey 111 14 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 111 15 where where WRB work_rujstqwje5gkdm2bqer4drugey 111 16 : : : work_rujstqwje5gkdm2bqer4drugey 111 17 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 111 18 1 1 LS work_rujstqwje5gkdm2bqer4drugey 111 19 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 111 20 the the DT work_rujstqwje5gkdm2bqer4drugey 111 21 English english JJ work_rujstqwje5gkdm2bqer4drugey 111 22 word word NN work_rujstqwje5gkdm2bqer4drugey 111 23 was be VBD work_rujstqwje5gkdm2bqer4drugey 111 24 not not RB work_rujstqwje5gkdm2bqer4drugey 111 25 present present JJ work_rujstqwje5gkdm2bqer4drugey 111 26 in in IN work_rujstqwje5gkdm2bqer4drugey 111 27 the the DT work_rujstqwje5gkdm2bqer4drugey 111 28 WordNet WordNet NNP work_rujstqwje5gkdm2bqer4drugey 111 29 ontology ontology NN work_rujstqwje5gkdm2bqer4drugey 111 30 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 111 31 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 111 32 , , , work_rujstqwje5gkdm2bqer4drugey 111 33 1995 1995 CD work_rujstqwje5gkdm2bqer4drugey 111 34 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 111 35 , , , work_rujstqwje5gkdm2bqer4drugey 111 36 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 111 37 2 2 LS work_rujstqwje5gkdm2bqer4drugey 111 38 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 111 39 either either CC work_rujstqwje5gkdm2bqer4drugey 111 40 article article NN work_rujstqwje5gkdm2bqer4drugey 111 41 title title NN work_rujstqwje5gkdm2bqer4drugey 111 42 was be VBD work_rujstqwje5gkdm2bqer4drugey 111 43 longer long JJR work_rujstqwje5gkdm2bqer4drugey 111 44 than than IN work_rujstqwje5gkdm2bqer4drugey 111 45 a a DT work_rujstqwje5gkdm2bqer4drugey 111 46 single single JJ work_rujstqwje5gkdm2bqer4drugey 111 47 word word NN work_rujstqwje5gkdm2bqer4drugey 111 48 , , , work_rujstqwje5gkdm2bqer4drugey 111 49 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 111 50 3 3 LS work_rujstqwje5gkdm2bqer4drugey 111 51 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 111 52 the the DT work_rujstqwje5gkdm2bqer4drugey 111 53 English English NNP work_rujstqwje5gkdm2bqer4drugey 111 54 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 111 55 page page NN work_rujstqwje5gkdm2bqer4drugey 111 56 was be VBD work_rujstqwje5gkdm2bqer4drugey 111 57 a a DT work_rujstqwje5gkdm2bqer4drugey 111 58 subcategory subcategory NN work_rujstqwje5gkdm2bqer4drugey 111 59 of of IN work_rujstqwje5gkdm2bqer4drugey 111 60 person person NN work_rujstqwje5gkdm2bqer4drugey 111 61 or or CC work_rujstqwje5gkdm2bqer4drugey 111 62 place place NN work_rujstqwje5gkdm2bqer4drugey 111 63 , , , work_rujstqwje5gkdm2bqer4drugey 111 64 or or CC work_rujstqwje5gkdm2bqer4drugey 111 65 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 111 66 4 4 LS work_rujstqwje5gkdm2bqer4drugey 111 67 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 111 68 the the DT work_rujstqwje5gkdm2bqer4drugey 111 69 English English NNP work_rujstqwje5gkdm2bqer4drugey 111 70 and and CC work_rujstqwje5gkdm2bqer4drugey 111 71 the the DT work_rujstqwje5gkdm2bqer4drugey 111 72 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 111 73 titles title NNS work_rujstqwje5gkdm2bqer4drugey 111 74 were be VBD work_rujstqwje5gkdm2bqer4drugey 111 75 identical identical JJ work_rujstqwje5gkdm2bqer4drugey 111 76 or or CC work_rujstqwje5gkdm2bqer4drugey 111 77 a a DT work_rujstqwje5gkdm2bqer4drugey 111 78 substring substring NN work_rujstqwje5gkdm2bqer4drugey 111 79 of of IN work_rujstqwje5gkdm2bqer4drugey 111 80 the the DT work_rujstqwje5gkdm2bqer4drugey 111 81 other other JJ work_rujstqwje5gkdm2bqer4drugey 111 82 . . . work_rujstqwje5gkdm2bqer4drugey 112 1 Manual manual JJ work_rujstqwje5gkdm2bqer4drugey 112 2 evaluation evaluation NN work_rujstqwje5gkdm2bqer4drugey 112 3 of of IN work_rujstqwje5gkdm2bqer4drugey 112 4 non non JJ work_rujstqwje5gkdm2bqer4drugey 112 5 - - JJ work_rujstqwje5gkdm2bqer4drugey 112 6 identical identical JJ work_rujstqwje5gkdm2bqer4drugey 112 7 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 112 8 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 112 9 counted count VBD work_rujstqwje5gkdm2bqer4drugey 112 10 all all DT work_rujstqwje5gkdm2bqer4drugey 112 11 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 112 12 that that WDT work_rujstqwje5gkdm2bqer4drugey 112 13 exactly exactly RB work_rujstqwje5gkdm2bqer4drugey 112 14 matched match VBD work_rujstqwje5gkdm2bqer4drugey 112 15 the the DT work_rujstqwje5gkdm2bqer4drugey 112 16 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 112 17 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 112 18 translation translation NN work_rujstqwje5gkdm2bqer4drugey 112 19 as as IN work_rujstqwje5gkdm2bqer4drugey 112 20 correct correct JJ work_rujstqwje5gkdm2bqer4drugey 112 21 . . . work_rujstqwje5gkdm2bqer4drugey 113 1 For for IN work_rujstqwje5gkdm2bqer4drugey 113 2 non- non- NNP work_rujstqwje5gkdm2bqer4drugey 113 3 exact exact JJ work_rujstqwje5gkdm2bqer4drugey 113 4 matches match NNS work_rujstqwje5gkdm2bqer4drugey 113 5 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 113 6 created create VBD work_rujstqwje5gkdm2bqer4drugey 113 7 a a DT work_rujstqwje5gkdm2bqer4drugey 113 8 second second JJ work_rujstqwje5gkdm2bqer4drugey 113 9 - - HYPH work_rujstqwje5gkdm2bqer4drugey 113 10 pass pass NN work_rujstqwje5gkdm2bqer4drugey 113 11 quality quality NN work_rujstqwje5gkdm2bqer4drugey 113 12 as- as- DT work_rujstqwje5gkdm2bqer4drugey 113 13 surance surance NN work_rujstqwje5gkdm2bqer4drugey 113 14 HIT HIT NNP work_rujstqwje5gkdm2bqer4drugey 113 15 . . . work_rujstqwje5gkdm2bqer4drugey 114 1 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 114 2 were be VBD work_rujstqwje5gkdm2bqer4drugey 114 3 shown show VBN work_rujstqwje5gkdm2bqer4drugey 114 4 a a DT work_rujstqwje5gkdm2bqer4drugey 114 5 pair pair NN work_rujstqwje5gkdm2bqer4drugey 114 6 of of IN work_rujstqwje5gkdm2bqer4drugey 114 7 En- en- JJ work_rujstqwje5gkdm2bqer4drugey 114 8 glish glish JJ work_rujstqwje5gkdm2bqer4drugey 114 9 words word NNS work_rujstqwje5gkdm2bqer4drugey 114 10 , , , work_rujstqwje5gkdm2bqer4drugey 114 11 one one CD work_rujstqwje5gkdm2bqer4drugey 114 12 of of IN work_rujstqwje5gkdm2bqer4drugey 114 13 which which WDT work_rujstqwje5gkdm2bqer4drugey 114 14 was be VBD work_rujstqwje5gkdm2bqer4drugey 114 15 a a DT work_rujstqwje5gkdm2bqer4drugey 114 16 Turker Turker NNP work_rujstqwje5gkdm2bqer4drugey 114 17 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 114 18 transla- transla- NN work_rujstqwje5gkdm2bqer4drugey 114 19 tion tion NN work_rujstqwje5gkdm2bqer4drugey 114 20 of of IN work_rujstqwje5gkdm2bqer4drugey 114 21 the the DT work_rujstqwje5gkdm2bqer4drugey 114 22 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 114 23 word word NN work_rujstqwje5gkdm2bqer4drugey 114 24 used use VBN work_rujstqwje5gkdm2bqer4drugey 114 25 for for IN work_rujstqwje5gkdm2bqer4drugey 114 26 quality quality NN work_rujstqwje5gkdm2bqer4drugey 114 27 control control NN work_rujstqwje5gkdm2bqer4drugey 114 28 , , , work_rujstqwje5gkdm2bqer4drugey 114 29 and and CC work_rujstqwje5gkdm2bqer4drugey 114 30 the the DT work_rujstqwje5gkdm2bqer4drugey 114 31 other other JJ work_rujstqwje5gkdm2bqer4drugey 114 32 of of IN work_rujstqwje5gkdm2bqer4drugey 114 33 which which WDT work_rujstqwje5gkdm2bqer4drugey 114 34 was be VBD work_rujstqwje5gkdm2bqer4drugey 114 35 the the DT work_rujstqwje5gkdm2bqer4drugey 114 36 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 114 37 - - HYPH work_rujstqwje5gkdm2bqer4drugey 114 38 standard standard NN work_rujstqwje5gkdm2bqer4drugey 114 39 trans- trans- JJ work_rujstqwje5gkdm2bqer4drugey 114 40 lation lation NN work_rujstqwje5gkdm2bqer4drugey 114 41 of of IN work_rujstqwje5gkdm2bqer4drugey 114 42 the the DT work_rujstqwje5gkdm2bqer4drugey 114 43 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 114 44 word word NN work_rujstqwje5gkdm2bqer4drugey 114 45 . . . work_rujstqwje5gkdm2bqer4drugey 115 1 Evaluators evaluator NNS work_rujstqwje5gkdm2bqer4drugey 115 2 were be VBD work_rujstqwje5gkdm2bqer4drugey 115 3 asked ask VBN work_rujstqwje5gkdm2bqer4drugey 115 4 whether whether IN work_rujstqwje5gkdm2bqer4drugey 115 5 the the DT work_rujstqwje5gkdm2bqer4drugey 115 6 two two CD work_rujstqwje5gkdm2bqer4drugey 115 7 words word NNS work_rujstqwje5gkdm2bqer4drugey 115 8 had have VBD work_rujstqwje5gkdm2bqer4drugey 115 9 the the DT work_rujstqwje5gkdm2bqer4drugey 115 10 same same JJ work_rujstqwje5gkdm2bqer4drugey 115 11 meaning meaning NN work_rujstqwje5gkdm2bqer4drugey 115 12 , , , work_rujstqwje5gkdm2bqer4drugey 115 13 and and CC work_rujstqwje5gkdm2bqer4drugey 115 14 chose choose VBD work_rujstqwje5gkdm2bqer4drugey 115 15 between between IN work_rujstqwje5gkdm2bqer4drugey 115 16 three three CD work_rujstqwje5gkdm2bqer4drugey 115 17 answers answer NNS work_rujstqwje5gkdm2bqer4drugey 115 18 : : : work_rujstqwje5gkdm2bqer4drugey 115 19 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 115 20 Yes yes UH work_rujstqwje5gkdm2bqer4drugey 115 21 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 115 22 , , , work_rujstqwje5gkdm2bqer4drugey 115 23 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 115 24 No no UH work_rujstqwje5gkdm2bqer4drugey 115 25 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 115 26 , , , work_rujstqwje5gkdm2bqer4drugey 115 27 or or CC work_rujstqwje5gkdm2bqer4drugey 115 28 ‘ ' `` work_rujstqwje5gkdm2bqer4drugey 115 29 Re- Re- NNP work_rujstqwje5gkdm2bqer4drugey 115 30 82 82 CD work_rujstqwje5gkdm2bqer4drugey 115 31 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 115 32 2 2 CD work_rujstqwje5gkdm2bqer4drugey 115 33 : : : work_rujstqwje5gkdm2bqer4drugey 115 34 Days day NNS work_rujstqwje5gkdm2bqer4drugey 115 35 to to TO work_rujstqwje5gkdm2bqer4drugey 115 36 complete complete VB work_rujstqwje5gkdm2bqer4drugey 115 37 the the DT work_rujstqwje5gkdm2bqer4drugey 115 38 translation translation NN work_rujstqwje5gkdm2bqer4drugey 115 39 HITs hit NNS work_rujstqwje5gkdm2bqer4drugey 115 40 for for IN work_rujstqwje5gkdm2bqer4drugey 115 41 40 40 CD work_rujstqwje5gkdm2bqer4drugey 115 42 of of IN work_rujstqwje5gkdm2bqer4drugey 115 43 the the DT work_rujstqwje5gkdm2bqer4drugey 115 44 languages language NNS work_rujstqwje5gkdm2bqer4drugey 115 45 . . . work_rujstqwje5gkdm2bqer4drugey 116 1 Tick Tick NNP work_rujstqwje5gkdm2bqer4drugey 116 2 marks mark NNS work_rujstqwje5gkdm2bqer4drugey 116 3 represent represent VBP work_rujstqwje5gkdm2bqer4drugey 116 4 the the DT work_rujstqwje5gkdm2bqer4drugey 116 5 com- com- NN work_rujstqwje5gkdm2bqer4drugey 116 6 pletion pletion NN work_rujstqwje5gkdm2bqer4drugey 116 7 of of IN work_rujstqwje5gkdm2bqer4drugey 116 8 individual individual JJ work_rujstqwje5gkdm2bqer4drugey 116 9 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 116 10 . . . work_rujstqwje5gkdm2bqer4drugey 117 1 lated lated JJ work_rujstqwje5gkdm2bqer4drugey 117 2 but but CC work_rujstqwje5gkdm2bqer4drugey 117 3 not not RB work_rujstqwje5gkdm2bqer4drugey 117 4 synonymous synonymous JJ work_rujstqwje5gkdm2bqer4drugey 117 5 . . . work_rujstqwje5gkdm2bqer4drugey 117 6 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 117 7 Examples example NNS work_rujstqwje5gkdm2bqer4drugey 117 8 of of IN work_rujstqwje5gkdm2bqer4drugey 117 9 mean- mean- JJ work_rujstqwje5gkdm2bqer4drugey 117 10 ing ing NN work_rujstqwje5gkdm2bqer4drugey 117 11 equivalent equivalent JJ work_rujstqwje5gkdm2bqer4drugey 117 12 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 117 13 include include VBP work_rujstqwje5gkdm2bqer4drugey 117 14 : : : work_rujstqwje5gkdm2bqer4drugey 117 15 < < XX work_rujstqwje5gkdm2bqer4drugey 117 16 petroglyphs petroglyphs NNP work_rujstqwje5gkdm2bqer4drugey 117 17 , , , work_rujstqwje5gkdm2bqer4drugey 117 18 rock rock NN work_rujstqwje5gkdm2bqer4drugey 117 19 paintings painting NNS work_rujstqwje5gkdm2bqer4drugey 117 20 > > XX work_rujstqwje5gkdm2bqer4drugey 117 21 , , , work_rujstqwje5gkdm2bqer4drugey 117 22 < < XX work_rujstqwje5gkdm2bqer4drugey 117 23 demo demo NNP work_rujstqwje5gkdm2bqer4drugey 117 24 , , , work_rujstqwje5gkdm2bqer4drugey 117 25 show show VBP work_rujstqwje5gkdm2bqer4drugey 117 26 > > XX work_rujstqwje5gkdm2bqer4drugey 117 27 and and CC work_rujstqwje5gkdm2bqer4drugey 117 28 < < NNP work_rujstqwje5gkdm2bqer4drugey 117 29 loam loam NNP work_rujstqwje5gkdm2bqer4drugey 117 30 , , , work_rujstqwje5gkdm2bqer4drugey 117 31 loam loam NN work_rujstqwje5gkdm2bqer4drugey 117 32 : : : work_rujstqwje5gkdm2bqer4drugey 117 33 soil soil NN work_rujstqwje5gkdm2bqer4drugey 117 34 rich rich JJ work_rujstqwje5gkdm2bqer4drugey 117 35 in in IN work_rujstqwje5gkdm2bqer4drugey 117 36 decaying decay VBG work_rujstqwje5gkdm2bqer4drugey 117 37 matter matter NN work_rujstqwje5gkdm2bqer4drugey 117 38 > > XX work_rujstqwje5gkdm2bqer4drugey 117 39 . . . work_rujstqwje5gkdm2bqer4drugey 118 1 Non non JJ work_rujstqwje5gkdm2bqer4drugey 118 2 - - JJ work_rujstqwje5gkdm2bqer4drugey 118 3 meaning meaning JJ work_rujstqwje5gkdm2bqer4drugey 118 4 equiva- equiva- NN work_rujstqwje5gkdm2bqer4drugey 118 5 lents lent NNS work_rujstqwje5gkdm2bqer4drugey 118 6 included include VBD work_rujstqwje5gkdm2bqer4drugey 118 7 : : : work_rujstqwje5gkdm2bqer4drugey 118 8 < < XX work_rujstqwje5gkdm2bqer4drugey 118 9 assorted assorted JJ work_rujstqwje5gkdm2bqer4drugey 118 10 , , , work_rujstqwje5gkdm2bqer4drugey 118 11 minutes minute NNS work_rujstqwje5gkdm2bqer4drugey 118 12 > > XX work_rujstqwje5gkdm2bqer4drugey 118 13 , , , work_rujstqwje5gkdm2bqer4drugey 118 14 and and CC work_rujstqwje5gkdm2bqer4drugey 118 15 < < XX work_rujstqwje5gkdm2bqer4drugey 118 16 major major JJ work_rujstqwje5gkdm2bqer4drugey 118 17 , , , work_rujstqwje5gkdm2bqer4drugey 118 18 URL url NN work_rujstqwje5gkdm2bqer4drugey 118 19 of of IN work_rujstqwje5gkdm2bqer4drugey 118 20 image image NN work_rujstqwje5gkdm2bqer4drugey 118 21 > > XX work_rujstqwje5gkdm2bqer4drugey 118 22 . . . work_rujstqwje5gkdm2bqer4drugey 119 1 Related related JJ work_rujstqwje5gkdm2bqer4drugey 119 2 items item NNS work_rujstqwje5gkdm2bqer4drugey 119 3 were be VBD work_rujstqwje5gkdm2bqer4drugey 119 4 things thing NNS work_rujstqwje5gkdm2bqer4drugey 119 5 like like IN work_rujstqwje5gkdm2bqer4drugey 119 6 < < XX work_rujstqwje5gkdm2bqer4drugey 119 7 sky sky NN work_rujstqwje5gkdm2bqer4drugey 119 8 , , , work_rujstqwje5gkdm2bqer4drugey 119 9 clouds cloud NNS work_rujstqwje5gkdm2bqer4drugey 119 10 > > XX work_rujstqwje5gkdm2bqer4drugey 119 11 . . . work_rujstqwje5gkdm2bqer4drugey 120 1 Misspellings misspelling NNS work_rujstqwje5gkdm2bqer4drugey 120 2 like like UH work_rujstqwje5gkdm2bqer4drugey 120 3 < < XX work_rujstqwje5gkdm2bqer4drugey 120 4 lactation lactation NN work_rujstqwje5gkdm2bqer4drugey 120 5 , , , work_rujstqwje5gkdm2bqer4drugey 120 6 lac- lac- NN work_rujstqwje5gkdm2bqer4drugey 120 7 tiation tiation NN work_rujstqwje5gkdm2bqer4drugey 120 8 > > XX work_rujstqwje5gkdm2bqer4drugey 120 9 were be VBD work_rujstqwje5gkdm2bqer4drugey 120 10 judged judge VBN work_rujstqwje5gkdm2bqer4drugey 120 11 to to TO work_rujstqwje5gkdm2bqer4drugey 120 12 have have VB work_rujstqwje5gkdm2bqer4drugey 120 13 same same JJ work_rujstqwje5gkdm2bqer4drugey 120 14 meaning meaning NN work_rujstqwje5gkdm2bqer4drugey 120 15 , , , work_rujstqwje5gkdm2bqer4drugey 120 16 and and CC work_rujstqwje5gkdm2bqer4drugey 120 17 were be VBD work_rujstqwje5gkdm2bqer4drugey 120 18 marked mark VBN work_rujstqwje5gkdm2bqer4drugey 120 19 as as IN work_rujstqwje5gkdm2bqer4drugey 120 20 misspelled misspell VBN work_rujstqwje5gkdm2bqer4drugey 120 21 . . . work_rujstqwje5gkdm2bqer4drugey 121 1 Three three CD work_rujstqwje5gkdm2bqer4drugey 121 2 separate separate JJ work_rujstqwje5gkdm2bqer4drugey 121 3 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 121 4 judged judge VBD work_rujstqwje5gkdm2bqer4drugey 121 5 each each DT work_rujstqwje5gkdm2bqer4drugey 121 6 pair pair NN work_rujstqwje5gkdm2bqer4drugey 121 7 , , , work_rujstqwje5gkdm2bqer4drugey 121 8 allowing allow VBG work_rujstqwje5gkdm2bqer4drugey 121 9 majority majority NN work_rujstqwje5gkdm2bqer4drugey 121 10 votes vote NNS work_rujstqwje5gkdm2bqer4drugey 121 11 for for IN work_rujstqwje5gkdm2bqer4drugey 121 12 diffi- diffi- NN work_rujstqwje5gkdm2bqer4drugey 121 13 cult cult NN work_rujstqwje5gkdm2bqer4drugey 121 14 cases case NNS work_rujstqwje5gkdm2bqer4drugey 121 15 . . . work_rujstqwje5gkdm2bqer4drugey 122 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 122 2 checked check VBD work_rujstqwje5gkdm2bqer4drugey 122 3 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 122 4 who who WP work_rujstqwje5gkdm2bqer4drugey 122 5 were be VBD work_rujstqwje5gkdm2bqer4drugey 122 6 working work VBG work_rujstqwje5gkdm2bqer4drugey 122 7 on on IN work_rujstqwje5gkdm2bqer4drugey 122 8 this this DT work_rujstqwje5gkdm2bqer4drugey 122 9 task task NN work_rujstqwje5gkdm2bqer4drugey 122 10 by by IN work_rujstqwje5gkdm2bqer4drugey 122 11 embedding embed VBG work_rujstqwje5gkdm2bqer4drugey 122 12 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 122 13 of of IN work_rujstqwje5gkdm2bqer4drugey 122 14 words word NNS work_rujstqwje5gkdm2bqer4drugey 122 15 which which WDT work_rujstqwje5gkdm2bqer4drugey 122 16 were be VBD work_rujstqwje5gkdm2bqer4drugey 122 17 ei- ei- CD work_rujstqwje5gkdm2bqer4drugey 122 18 पा पा . work_rujstqwje5gkdm2bqer4drugey 122 19 क$ क$ NNP work_rujstqwje5gkdm2bqer4drugey 122 20 % % NN work_rujstqwje5gkdm2bqer4drugey 122 21 तान तान NN work_rujstqwje5gkdm2bqer4drugey 122 22 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 122 23 भी भी NN work_rujstqwje5gkdm2bqer4drugey 122 24 + + SYM work_rujstqwje5gkdm2bqer4drugey 122 25 त$ त$ NNP work_rujstqwje5gkdm2bqer4drugey 122 26 कार कार NNP work_rujstqwje5gkdm2bqer4drugey 122 27 % % NN work_rujstqwje5gkdm2bqer4drugey 122 28 व व NN work_rujstqwje5gkdm2bqer4drugey 122 29 . . . work_rujstqwje5gkdm2bqer4drugey 122 30 प प NNP work_rujstqwje5gkdm2bqer4drugey 122 31 २८ २८ CD work_rujstqwje5gkdm2bqer4drugey 122 32 मई मई NNP work_rujstqwje5gkdm2bqer4drugey 122 33 १९९८ १९९८ CD work_rujstqwje5gkdm2bqer4drugey 122 34 5 5 CD work_rujstqwje5gkdm2bqer4drugey 122 35 छह छह NNP work_rujstqwje5gkdm2bqer4drugey 122 36 परमाण9 परमाण9 NNP work_rujstqwje5gkdm2bqer4drugey 122 37 परी परी XX work_rujstqwje5gkdm2bqer4drugey 122 38 : : : work_rujstqwje5gkdm2bqer4drugey 122 39 ण ण LS work_rujstqwje5gkdm2bqer4drugey 122 40 कर कर IN work_rujstqwje5gkdm2bqer4drugey 122 41 डा डा NNS work_rujstqwje5gkdm2bqer4drugey 122 42 < < XX work_rujstqwje5gkdm2bqer4drugey 122 43 । । NNP work_rujstqwje5gkdm2bqer4drugey 122 44 In in IN work_rujstqwje5gkdm2bqer4drugey 122 45 retribution retribution NN work_rujstqwje5gkdm2bqer4drugey 122 46 pakistan pakistan NNP work_rujstqwje5gkdm2bqer4drugey 122 47 also also RB work_rujstqwje5gkdm2bqer4drugey 122 48 did do VBD work_rujstqwje5gkdm2bqer4drugey 122 49 six six CD work_rujstqwje5gkdm2bqer4drugey 122 50 nuclear nuclear JJ work_rujstqwje5gkdm2bqer4drugey 122 51 tests test NNS work_rujstqwje5gkdm2bqer4drugey 122 52 on on IN work_rujstqwje5gkdm2bqer4drugey 122 53 28 28 CD work_rujstqwje5gkdm2bqer4drugey 122 54 may may MD work_rujstqwje5gkdm2bqer4drugey 122 55 1998 1998 CD work_rujstqwje5gkdm2bqer4drugey 122 56 . . . work_rujstqwje5gkdm2bqer4drugey 123 1 On on IN work_rujstqwje5gkdm2bqer4drugey 123 2 28 28 CD work_rujstqwje5gkdm2bqer4drugey 123 3 May May NNP work_rujstqwje5gkdm2bqer4drugey 123 4 Pakistan Pakistan NNP work_rujstqwje5gkdm2bqer4drugey 123 5 also also RB work_rujstqwje5gkdm2bqer4drugey 123 6 conducted conduct VBD work_rujstqwje5gkdm2bqer4drugey 123 7 six six CD work_rujstqwje5gkdm2bqer4drugey 123 8 nuclear nuclear JJ work_rujstqwje5gkdm2bqer4drugey 123 9 tests test NNS work_rujstqwje5gkdm2bqer4drugey 123 10 as as IN work_rujstqwje5gkdm2bqer4drugey 123 11 an an DT work_rujstqwje5gkdm2bqer4drugey 123 12 act act NN work_rujstqwje5gkdm2bqer4drugey 123 13 of of IN work_rujstqwje5gkdm2bqer4drugey 123 14 redressal redressal NN work_rujstqwje5gkdm2bqer4drugey 123 15 . . . work_rujstqwje5gkdm2bqer4drugey 124 1 Retaliating retaliate VBG work_rujstqwje5gkdm2bqer4drugey 124 2 on on IN work_rujstqwje5gkdm2bqer4drugey 124 3 this this DT work_rujstqwje5gkdm2bqer4drugey 124 4 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 124 5 Pakistan Pakistan NNP work_rujstqwje5gkdm2bqer4drugey 124 6 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 124 7 conducted conduct VBD work_rujstqwje5gkdm2bqer4drugey 124 8 Six(6 Six(6 NNP work_rujstqwje5gkdm2bqer4drugey 124 9 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 124 10 Nuclear Nuclear NNP work_rujstqwje5gkdm2bqer4drugey 124 11 Tests test NNS work_rujstqwje5gkdm2bqer4drugey 124 12 on on IN work_rujstqwje5gkdm2bqer4drugey 124 13 28 28 CD work_rujstqwje5gkdm2bqer4drugey 124 14 May May NNP work_rujstqwje5gkdm2bqer4drugey 124 15 , , , work_rujstqwje5gkdm2bqer4drugey 124 16 1998 1998 CD work_rujstqwje5gkdm2bqer4drugey 124 17 . . . work_rujstqwje5gkdm2bqer4drugey 124 18 pakistan pakistan NNP work_rujstqwje5gkdm2bqer4drugey 124 19 also also RB work_rujstqwje5gkdm2bqer4drugey 124 20 did do VBD work_rujstqwje5gkdm2bqer4drugey 124 21 6 6 CD work_rujstqwje5gkdm2bqer4drugey 124 22 nuclear nuclear JJ work_rujstqwje5gkdm2bqer4drugey 124 23 test test NN work_rujstqwje5gkdm2bqer4drugey 124 24 in in IN work_rujstqwje5gkdm2bqer4drugey 124 25 retribution retribution NN work_rujstqwje5gkdm2bqer4drugey 124 26 on on IN work_rujstqwje5gkdm2bqer4drugey 124 27 28 28 CD work_rujstqwje5gkdm2bqer4drugey 124 28 may may MD work_rujstqwje5gkdm2bqer4drugey 124 29 , , , work_rujstqwje5gkdm2bqer4drugey 124 30 1998 1998 CD work_rujstqwje5gkdm2bqer4drugey 124 31 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 124 32 3 3 CD work_rujstqwje5gkdm2bqer4drugey 124 33 : : : work_rujstqwje5gkdm2bqer4drugey 124 34 An an DT work_rujstqwje5gkdm2bqer4drugey 124 35 example example NN work_rujstqwje5gkdm2bqer4drugey 124 36 of of IN work_rujstqwje5gkdm2bqer4drugey 124 37 the the DT work_rujstqwje5gkdm2bqer4drugey 124 38 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 124 39 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 124 40 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 124 41 of of IN work_rujstqwje5gkdm2bqer4drugey 124 42 a a DT work_rujstqwje5gkdm2bqer4drugey 124 43 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 124 44 sentence sentence NN work_rujstqwje5gkdm2bqer4drugey 124 45 . . . work_rujstqwje5gkdm2bqer4drugey 125 1 The the DT work_rujstqwje5gkdm2bqer4drugey 125 2 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 125 3 are be VBP work_rujstqwje5gkdm2bqer4drugey 125 4 unedited unedited JJ work_rujstqwje5gkdm2bqer4drugey 125 5 and and CC work_rujstqwje5gkdm2bqer4drugey 125 6 contain contain VBP work_rujstqwje5gkdm2bqer4drugey 125 7 fixable fixable JJ work_rujstqwje5gkdm2bqer4drugey 125 8 spelling spelling NN work_rujstqwje5gkdm2bqer4drugey 125 9 , , , work_rujstqwje5gkdm2bqer4drugey 125 10 capitalization capitalization NN work_rujstqwje5gkdm2bqer4drugey 125 11 and and CC work_rujstqwje5gkdm2bqer4drugey 125 12 grammat- grammat- JJ work_rujstqwje5gkdm2bqer4drugey 125 13 ical ical JJ work_rujstqwje5gkdm2bqer4drugey 125 14 errors error NNS work_rujstqwje5gkdm2bqer4drugey 125 15 . . . work_rujstqwje5gkdm2bqer4drugey 126 1 ther ther RB work_rujstqwje5gkdm2bqer4drugey 126 2 known know VBN work_rujstqwje5gkdm2bqer4drugey 126 3 to to TO work_rujstqwje5gkdm2bqer4drugey 126 4 be be VB work_rujstqwje5gkdm2bqer4drugey 126 5 synonyms synonyms JJ work_rujstqwje5gkdm2bqer4drugey 126 6 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 126 7 drawn draw VBN work_rujstqwje5gkdm2bqer4drugey 126 8 from from IN work_rujstqwje5gkdm2bqer4drugey 126 9 Word- Word- NNP work_rujstqwje5gkdm2bqer4drugey 126 10 Net Net NNP work_rujstqwje5gkdm2bqer4drugey 126 11 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 126 12 or or CC work_rujstqwje5gkdm2bqer4drugey 126 13 unrelated unrelated JJ work_rujstqwje5gkdm2bqer4drugey 126 14 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 126 15 randomly randomly RB work_rujstqwje5gkdm2bqer4drugey 126 16 chosen choose VBN work_rujstqwje5gkdm2bqer4drugey 126 17 from from IN work_rujstqwje5gkdm2bqer4drugey 126 18 a a DT work_rujstqwje5gkdm2bqer4drugey 126 19 corpus corpus NN work_rujstqwje5gkdm2bqer4drugey 126 20 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 126 21 . . . work_rujstqwje5gkdm2bqer4drugey 127 1 Automating automate VBG work_rujstqwje5gkdm2bqer4drugey 127 2 approval approval NN work_rujstqwje5gkdm2bqer4drugey 127 3 / / SYM work_rujstqwje5gkdm2bqer4drugey 127 4 rejections rejection NNS work_rujstqwje5gkdm2bqer4drugey 127 5 for for IN work_rujstqwje5gkdm2bqer4drugey 127 6 the the DT work_rujstqwje5gkdm2bqer4drugey 127 7 second second JJ work_rujstqwje5gkdm2bqer4drugey 127 8 - - HYPH work_rujstqwje5gkdm2bqer4drugey 127 9 pass pass NN work_rujstqwje5gkdm2bqer4drugey 127 10 evaluation evaluation NN work_rujstqwje5gkdm2bqer4drugey 127 11 allowed allow VBD work_rujstqwje5gkdm2bqer4drugey 127 12 the the DT work_rujstqwje5gkdm2bqer4drugey 127 13 whole whole JJ work_rujstqwje5gkdm2bqer4drugey 127 14 pipeline pipeline NN work_rujstqwje5gkdm2bqer4drugey 127 15 to to TO work_rujstqwje5gkdm2bqer4drugey 127 16 be be VB work_rujstqwje5gkdm2bqer4drugey 127 17 run run VBN work_rujstqwje5gkdm2bqer4drugey 127 18 au- au- RB work_rujstqwje5gkdm2bqer4drugey 127 19 tomatically tomatically RB work_rujstqwje5gkdm2bqer4drugey 127 20 . . . work_rujstqwje5gkdm2bqer4drugey 128 1 Caching cache VBG work_rujstqwje5gkdm2bqer4drugey 128 2 judgments judgment NNS work_rujstqwje5gkdm2bqer4drugey 128 3 meant mean VBD work_rujstqwje5gkdm2bqer4drugey 128 4 that that IN work_rujstqwje5gkdm2bqer4drugey 128 5 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 128 6 ulti- ulti- VBD work_rujstqwje5gkdm2bqer4drugey 128 7 mately mately RB work_rujstqwje5gkdm2bqer4drugey 128 8 needed need VBN work_rujstqwje5gkdm2bqer4drugey 128 9 only only RB work_rujstqwje5gkdm2bqer4drugey 128 10 20,952 20,952 CD work_rujstqwje5gkdm2bqer4drugey 128 11 synonym synonym NN work_rujstqwje5gkdm2bqer4drugey 128 12 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 128 13 to to TO work_rujstqwje5gkdm2bqer4drugey 128 14 judge judge VB work_rujstqwje5gkdm2bqer4drugey 128 15 all all DT work_rujstqwje5gkdm2bqer4drugey 128 16 of of IN work_rujstqwje5gkdm2bqer4drugey 128 17 the the DT work_rujstqwje5gkdm2bqer4drugey 128 18 submitted submit VBN work_rujstqwje5gkdm2bqer4drugey 128 19 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 128 20 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 128 21 a a DT work_rujstqwje5gkdm2bqer4drugey 128 22 total total NN work_rujstqwje5gkdm2bqer4drugey 128 23 of of IN work_rujstqwje5gkdm2bqer4drugey 128 24 74,572 74,572 CD work_rujstqwje5gkdm2bqer4drugey 128 25 non non JJ work_rujstqwje5gkdm2bqer4drugey 128 26 - - JJ work_rujstqwje5gkdm2bqer4drugey 128 27 matching matching JJ work_rujstqwje5gkdm2bqer4drugey 128 28 word word NN work_rujstqwje5gkdm2bqer4drugey 128 29 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 128 30 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 128 31 . . . work_rujstqwje5gkdm2bqer4drugey 129 1 These these DT work_rujstqwje5gkdm2bqer4drugey 129 2 were be VBD work_rujstqwje5gkdm2bqer4drugey 129 3 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 129 4 by by IN work_rujstqwje5gkdm2bqer4drugey 129 5 an an DT work_rujstqwje5gkdm2bqer4drugey 129 6 additional additional JJ work_rujstqwje5gkdm2bqer4drugey 129 7 1,005 1,005 CD work_rujstqwje5gkdm2bqer4drugey 129 8 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 129 9 . . . work_rujstqwje5gkdm2bqer4drugey 130 1 Each each DT work_rujstqwje5gkdm2bqer4drugey 130 2 of of IN work_rujstqwje5gkdm2bqer4drugey 130 3 these these DT work_rujstqwje5gkdm2bqer4drugey 130 4 as- as- XX work_rujstqwje5gkdm2bqer4drugey 130 5 signments signment NNS work_rujstqwje5gkdm2bqer4drugey 130 6 included include VBD work_rujstqwje5gkdm2bqer4drugey 130 7 10 10 CD work_rujstqwje5gkdm2bqer4drugey 130 8 word word NN work_rujstqwje5gkdm2bqer4drugey 130 9 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 130 10 and and CC work_rujstqwje5gkdm2bqer4drugey 130 11 paid pay VBD work_rujstqwje5gkdm2bqer4drugey 130 12 $ $ $ work_rujstqwje5gkdm2bqer4drugey 130 13 0.10 0.10 CD work_rujstqwje5gkdm2bqer4drugey 130 14 . . . work_rujstqwje5gkdm2bqer4drugey 131 1 Full full JJ work_rujstqwje5gkdm2bqer4drugey 131 2 sentence sentence NN work_rujstqwje5gkdm2bqer4drugey 131 3 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 131 4 To to TO work_rujstqwje5gkdm2bqer4drugey 131 5 demonstrate demonstrate VB work_rujstqwje5gkdm2bqer4drugey 131 6 the the DT work_rujstqwje5gkdm2bqer4drugey 131 7 feasibility feasibility NN work_rujstqwje5gkdm2bqer4drugey 131 8 of of IN work_rujstqwje5gkdm2bqer4drugey 131 9 using use VBG work_rujstqwje5gkdm2bqer4drugey 131 10 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 131 11 to to TO work_rujstqwje5gkdm2bqer4drugey 131 12 create create VB work_rujstqwje5gkdm2bqer4drugey 131 13 multi- multi- NNP work_rujstqwje5gkdm2bqer4drugey 131 14 lingual lingual JJ work_rujstqwje5gkdm2bqer4drugey 131 15 technologies technology NNS work_rujstqwje5gkdm2bqer4drugey 131 16 , , , work_rujstqwje5gkdm2bqer4drugey 131 17 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 131 18 hire hire VBP work_rujstqwje5gkdm2bqer4drugey 131 19 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 131 20 to to TO work_rujstqwje5gkdm2bqer4drugey 131 21 construct construct VB work_rujstqwje5gkdm2bqer4drugey 131 22 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 131 23 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 131 24 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 131 25 from from IN work_rujstqwje5gkdm2bqer4drugey 131 26 scratch scratch NN work_rujstqwje5gkdm2bqer4drugey 131 27 for for IN work_rujstqwje5gkdm2bqer4drugey 131 28 six six CD work_rujstqwje5gkdm2bqer4drugey 131 29 In- In- NNP work_rujstqwje5gkdm2bqer4drugey 131 30 dian dian JJ work_rujstqwje5gkdm2bqer4drugey 131 31 languages language NNS work_rujstqwje5gkdm2bqer4drugey 131 32 . . . work_rujstqwje5gkdm2bqer4drugey 132 1 Germann Germann NNP work_rujstqwje5gkdm2bqer4drugey 132 2 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 132 3 2001 2001 CD work_rujstqwje5gkdm2bqer4drugey 132 4 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 132 5 attempted attempt VBD work_rujstqwje5gkdm2bqer4drugey 132 6 to to TO work_rujstqwje5gkdm2bqer4drugey 132 7 build build VB work_rujstqwje5gkdm2bqer4drugey 132 8 a a DT work_rujstqwje5gkdm2bqer4drugey 132 9 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 132 10 - - HYPH work_rujstqwje5gkdm2bqer4drugey 132 11 English english JJ work_rujstqwje5gkdm2bqer4drugey 132 12 translation translation NN work_rujstqwje5gkdm2bqer4drugey 132 13 system system NN work_rujstqwje5gkdm2bqer4drugey 132 14 from from IN work_rujstqwje5gkdm2bqer4drugey 132 15 scratch scratch NN work_rujstqwje5gkdm2bqer4drugey 132 16 by by IN work_rujstqwje5gkdm2bqer4drugey 132 17 hiring hire VBG work_rujstqwje5gkdm2bqer4drugey 132 18 professional professional JJ work_rujstqwje5gkdm2bqer4drugey 132 19 translators translator NNS work_rujstqwje5gkdm2bqer4drugey 132 20 , , , work_rujstqwje5gkdm2bqer4drugey 132 21 but but CC work_rujstqwje5gkdm2bqer4drugey 132 22 found find VBD work_rujstqwje5gkdm2bqer4drugey 132 23 the the DT work_rujstqwje5gkdm2bqer4drugey 132 24 cost cost NN work_rujstqwje5gkdm2bqer4drugey 132 25 prohibitive prohibitive JJ work_rujstqwje5gkdm2bqer4drugey 132 26 . . . work_rujstqwje5gkdm2bqer4drugey 133 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 133 2 created create VBD work_rujstqwje5gkdm2bqer4drugey 133 3 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 133 4 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 133 5 by by IN work_rujstqwje5gkdm2bqer4drugey 133 6 trans- trans- NNP work_rujstqwje5gkdm2bqer4drugey 133 7 lating lating NNP work_rujstqwje5gkdm2bqer4drugey 133 8 the the DT work_rujstqwje5gkdm2bqer4drugey 133 9 100 100 CD work_rujstqwje5gkdm2bqer4drugey 133 10 most most RBS work_rujstqwje5gkdm2bqer4drugey 133 11 viewed view VBN work_rujstqwje5gkdm2bqer4drugey 133 12 Wikipedia wikipedia JJ work_rujstqwje5gkdm2bqer4drugey 133 13 pages page NNS work_rujstqwje5gkdm2bqer4drugey 133 14 in in IN work_rujstqwje5gkdm2bqer4drugey 133 15 Ben- Ben- NNP work_rujstqwje5gkdm2bqer4drugey 133 16 gali gali NN work_rujstqwje5gkdm2bqer4drugey 133 17 , , , work_rujstqwje5gkdm2bqer4drugey 133 18 Malyalam Malyalam NNP work_rujstqwje5gkdm2bqer4drugey 133 19 , , , work_rujstqwje5gkdm2bqer4drugey 133 20 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 133 21 , , , work_rujstqwje5gkdm2bqer4drugey 133 22 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 133 23 , , , work_rujstqwje5gkdm2bqer4drugey 133 24 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 133 25 , , , work_rujstqwje5gkdm2bqer4drugey 133 26 and and CC work_rujstqwje5gkdm2bqer4drugey 133 27 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 133 28 into into IN work_rujstqwje5gkdm2bqer4drugey 133 29 English English NNP work_rujstqwje5gkdm2bqer4drugey 133 30 . . . work_rujstqwje5gkdm2bqer4drugey 134 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 134 2 collected collect VBD work_rujstqwje5gkdm2bqer4drugey 134 3 four four CD work_rujstqwje5gkdm2bqer4drugey 134 4 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 134 5 from from IN work_rujstqwje5gkdm2bqer4drugey 134 6 differ- differ- JJ work_rujstqwje5gkdm2bqer4drugey 134 7 ent ent NN work_rujstqwje5gkdm2bqer4drugey 134 8 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 134 9 for for IN work_rujstqwje5gkdm2bqer4drugey 134 10 each each DT work_rujstqwje5gkdm2bqer4drugey 134 11 source source NN work_rujstqwje5gkdm2bqer4drugey 134 12 sentence sentence NN work_rujstqwje5gkdm2bqer4drugey 134 13 . . . work_rujstqwje5gkdm2bqer4drugey 135 1 Workers worker NNS work_rujstqwje5gkdm2bqer4drugey 135 2 were be VBD work_rujstqwje5gkdm2bqer4drugey 135 3 paid pay VBN work_rujstqwje5gkdm2bqer4drugey 135 4 $ $ $ work_rujstqwje5gkdm2bqer4drugey 135 5 0.70 0.70 CD work_rujstqwje5gkdm2bqer4drugey 135 6 per per IN work_rujstqwje5gkdm2bqer4drugey 135 7 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 135 8 to to TO work_rujstqwje5gkdm2bqer4drugey 135 9 translate translate VB work_rujstqwje5gkdm2bqer4drugey 135 10 10 10 CD work_rujstqwje5gkdm2bqer4drugey 135 11 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 135 12 . . . work_rujstqwje5gkdm2bqer4drugey 136 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 136 2 accepted accept VBD work_rujstqwje5gkdm2bqer4drugey 136 3 or or CC work_rujstqwje5gkdm2bqer4drugey 136 4 rejected reject VBN work_rujstqwje5gkdm2bqer4drugey 136 5 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 136 6 based base VBN work_rujstqwje5gkdm2bqer4drugey 136 7 on on IN work_rujstqwje5gkdm2bqer4drugey 136 8 a a DT work_rujstqwje5gkdm2bqer4drugey 136 9 manual manual JJ work_rujstqwje5gkdm2bqer4drugey 136 10 review review NN work_rujstqwje5gkdm2bqer4drugey 136 11 of of IN work_rujstqwje5gkdm2bqer4drugey 136 12 each each DT work_rujstqwje5gkdm2bqer4drugey 136 13 worker worker NN work_rujstqwje5gkdm2bqer4drugey 136 14 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 136 15 submis- submis- NN work_rujstqwje5gkdm2bqer4drugey 136 16 sions sion NNS work_rujstqwje5gkdm2bqer4drugey 136 17 , , , work_rujstqwje5gkdm2bqer4drugey 136 18 which which WDT work_rujstqwje5gkdm2bqer4drugey 136 19 included include VBD work_rujstqwje5gkdm2bqer4drugey 136 20 a a DT work_rujstqwje5gkdm2bqer4drugey 136 21 comparison comparison NN work_rujstqwje5gkdm2bqer4drugey 136 22 of of IN work_rujstqwje5gkdm2bqer4drugey 136 23 the the DT work_rujstqwje5gkdm2bqer4drugey 136 24 transla- transla- XX work_rujstqwje5gkdm2bqer4drugey 136 25 tions tion NNS work_rujstqwje5gkdm2bqer4drugey 136 26 to to IN work_rujstqwje5gkdm2bqer4drugey 136 27 a a DT work_rujstqwje5gkdm2bqer4drugey 136 28 monotonic monotonic JJ work_rujstqwje5gkdm2bqer4drugey 136 29 gloss gloss NN work_rujstqwje5gkdm2bqer4drugey 136 30 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 136 31 produced produce VBN work_rujstqwje5gkdm2bqer4drugey 136 32 with with IN work_rujstqwje5gkdm2bqer4drugey 136 33 a a DT work_rujstqwje5gkdm2bqer4drugey 136 34 dic- dic- JJ work_rujstqwje5gkdm2bqer4drugey 136 35 tionary tionary NN work_rujstqwje5gkdm2bqer4drugey 136 36 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 136 37 , , , work_rujstqwje5gkdm2bqer4drugey 136 38 and and CC work_rujstqwje5gkdm2bqer4drugey 136 39 metadata metadata NN work_rujstqwje5gkdm2bqer4drugey 136 40 such such JJ work_rujstqwje5gkdm2bqer4drugey 136 41 as as IN work_rujstqwje5gkdm2bqer4drugey 136 42 the the DT work_rujstqwje5gkdm2bqer4drugey 136 43 amount amount NN work_rujstqwje5gkdm2bqer4drugey 136 44 of of IN work_rujstqwje5gkdm2bqer4drugey 136 45 time time NN work_rujstqwje5gkdm2bqer4drugey 136 46 the the DT work_rujstqwje5gkdm2bqer4drugey 136 47 worker worker NN work_rujstqwje5gkdm2bqer4drugey 136 48 took take VBD work_rujstqwje5gkdm2bqer4drugey 136 49 to to TO work_rujstqwje5gkdm2bqer4drugey 136 50 complete complete VB work_rujstqwje5gkdm2bqer4drugey 136 51 the the DT work_rujstqwje5gkdm2bqer4drugey 136 52 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 136 53 and and CC work_rujstqwje5gkdm2bqer4drugey 136 54 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 136 55 geo- geo- JJ work_rujstqwje5gkdm2bqer4drugey 136 56 graphic graphic JJ work_rujstqwje5gkdm2bqer4drugey 136 57 location location NN work_rujstqwje5gkdm2bqer4drugey 136 58 . . . work_rujstqwje5gkdm2bqer4drugey 137 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 137 2 3 3 CD work_rujstqwje5gkdm2bqer4drugey 137 3 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 137 4 an an DT work_rujstqwje5gkdm2bqer4drugey 137 5 example example NN work_rujstqwje5gkdm2bqer4drugey 137 6 of of IN work_rujstqwje5gkdm2bqer4drugey 137 7 the the DT work_rujstqwje5gkdm2bqer4drugey 137 8 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 137 9 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 137 10 obtained obtain VBD work_rujstqwje5gkdm2bqer4drugey 137 11 . . . work_rujstqwje5gkdm2bqer4drugey 138 1 The the DT work_rujstqwje5gkdm2bqer4drugey 138 2 lack lack NN work_rujstqwje5gkdm2bqer4drugey 138 3 of of IN work_rujstqwje5gkdm2bqer4drugey 138 4 a a DT work_rujstqwje5gkdm2bqer4drugey 138 5 professionally professionally RB work_rujstqwje5gkdm2bqer4drugey 138 6 translated translate VBN work_rujstqwje5gkdm2bqer4drugey 138 7 reference reference NN work_rujstqwje5gkdm2bqer4drugey 138 8 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 138 9 prevented prevent VBD work_rujstqwje5gkdm2bqer4drugey 138 10 us -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 138 11 from from IN work_rujstqwje5gkdm2bqer4drugey 138 12 doing do VBG work_rujstqwje5gkdm2bqer4drugey 138 13 a a DT work_rujstqwje5gkdm2bqer4drugey 138 14 sys- sys- NN work_rujstqwje5gkdm2bqer4drugey 138 15 tematic tematic JJ work_rujstqwje5gkdm2bqer4drugey 138 16 comparison comparison NN work_rujstqwje5gkdm2bqer4drugey 138 17 between between IN work_rujstqwje5gkdm2bqer4drugey 138 18 the the DT work_rujstqwje5gkdm2bqer4drugey 138 19 quality quality NN work_rujstqwje5gkdm2bqer4drugey 138 20 of of IN work_rujstqwje5gkdm2bqer4drugey 138 21 profes- profes- $ work_rujstqwje5gkdm2bqer4drugey 138 22 83 83 CD work_rujstqwje5gkdm2bqer4drugey 138 23 p p NN work_rujstqwje5gkdm2bqer4drugey 138 24 t t NNP work_rujstqwje5gkdm2bqer4drugey 138 25 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 26 s s NNP work_rujstqwje5gkdm2bqer4drugey 138 27 sh sh NNP work_rujstqwje5gkdm2bqer4drugey 138 28 t t NNP work_rujstqwje5gkdm2bqer4drugey 138 29 l l NNP work_rujstqwje5gkdm2bqer4drugey 138 30 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 138 31 sr sr NNP work_rujstqwje5gkdm2bqer4drugey 138 32 ro ro NNP work_rujstqwje5gkdm2bqer4drugey 138 33 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 34 s s NNP work_rujstqwje5gkdm2bqer4drugey 138 35 m m NNP work_rujstqwje5gkdm2bqer4drugey 138 36 s s NNP work_rujstqwje5gkdm2bqer4drugey 138 37 d d NNP work_rujstqwje5gkdm2bqer4drugey 138 38 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 39 a a DT work_rujstqwje5gkdm2bqer4drugey 138 40 f f XX work_rujstqwje5gkdm2bqer4drugey 138 41 te te NNP work_rujstqwje5gkdm2bqer4drugey 138 42 h h NNP work_rujstqwje5gkdm2bqer4drugey 138 43 r r NNP work_rujstqwje5gkdm2bqer4drugey 138 44 i -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 138 45 d d VBN work_rujstqwje5gkdm2bqer4drugey 138 46 d d VBN work_rujstqwje5gkdm2bqer4drugey 138 47 a a NNP work_rujstqwje5gkdm2bqer4drugey 138 48 n n NNP work_rujstqwje5gkdm2bqer4drugey 138 49 l l NN work_rujstqwje5gkdm2bqer4drugey 138 50 tr tr NN work_rujstqwje5gkdm2bqer4drugey 138 51 g g NNP work_rujstqwje5gkdm2bqer4drugey 138 52 u u NNP work_rujstqwje5gkdm2bqer4drugey 138 53 sk sk NNP work_rujstqwje5gkdm2bqer4drugey 138 54 fi fi IN work_rujstqwje5gkdm2bqer4drugey 138 55 h h NNP work_rujstqwje5gkdm2bqer4drugey 138 56 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 57 m m NNP work_rujstqwje5gkdm2bqer4drugey 138 58 l l NNP work_rujstqwje5gkdm2bqer4drugey 138 59 fr fr NNP work_rujstqwje5gkdm2bqer4drugey 138 60 ja ja NNP work_rujstqwje5gkdm2bqer4drugey 138 61 p p NNP work_rujstqwje5gkdm2bqer4drugey 138 62 a a DT work_rujstqwje5gkdm2bqer4drugey 138 63 b b NN work_rujstqwje5gkdm2bqer4drugey 138 64 g g NN work_rujstqwje5gkdm2bqer4drugey 138 65 m m NNP work_rujstqwje5gkdm2bqer4drugey 138 66 k k NNP work_rujstqwje5gkdm2bqer4drugey 138 67 n n NNP work_rujstqwje5gkdm2bqer4drugey 138 68 o o NN work_rujstqwje5gkdm2bqer4drugey 138 69 g g NNP work_rujstqwje5gkdm2bqer4drugey 138 70 l l NN work_rujstqwje5gkdm2bqer4drugey 138 71 h h NN work_rujstqwje5gkdm2bqer4drugey 138 72 t t NNP work_rujstqwje5gkdm2bqer4drugey 138 73 g g NNP work_rujstqwje5gkdm2bqer4drugey 138 74 a a FW work_rujstqwje5gkdm2bqer4drugey 138 75 sv sv NNP work_rujstqwje5gkdm2bqer4drugey 138 76 c c NNP work_rujstqwje5gkdm2bqer4drugey 138 77 y y NNP work_rujstqwje5gkdm2bqer4drugey 138 78 lv lv NNP work_rujstqwje5gkdm2bqer4drugey 138 79 h h NNP work_rujstqwje5gkdm2bqer4drugey 138 80 u u NNP work_rujstqwje5gkdm2bqer4drugey 138 81 k k NNP work_rujstqwje5gkdm2bqer4drugey 138 82 n n CC work_rujstqwje5gkdm2bqer4drugey 138 83 a a NNP work_rujstqwje5gkdm2bqer4drugey 138 84 z z NNP work_rujstqwje5gkdm2bqer4drugey 138 85 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 86 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 87 lt lt NNP work_rujstqwje5gkdm2bqer4drugey 138 88 k k NNP work_rujstqwje5gkdm2bqer4drugey 138 89 o o NNP work_rujstqwje5gkdm2bqer4drugey 138 90 n n NNP work_rujstqwje5gkdm2bqer4drugey 138 91 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 92 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 93 o o NNP work_rujstqwje5gkdm2bqer4drugey 138 94 a a NN work_rujstqwje5gkdm2bqer4drugey 138 95 r r NN work_rujstqwje5gkdm2bqer4drugey 138 96 p p NN work_rujstqwje5gkdm2bqer4drugey 138 97 l l NN work_rujstqwje5gkdm2bqer4drugey 138 98 m m NN work_rujstqwje5gkdm2bqer4drugey 138 99 r r NN work_rujstqwje5gkdm2bqer4drugey 138 100 c c NNP work_rujstqwje5gkdm2bqer4drugey 138 101 a a DT work_rujstqwje5gkdm2bqer4drugey 138 102 c c NNP work_rujstqwje5gkdm2bqer4drugey 138 103 s s NN work_rujstqwje5gkdm2bqer4drugey 138 104 sw sw NNP work_rujstqwje5gkdm2bqer4drugey 138 105 t t NNP work_rujstqwje5gkdm2bqer4drugey 138 106 a a DT work_rujstqwje5gkdm2bqer4drugey 138 107 h h NN work_rujstqwje5gkdm2bqer4drugey 138 108 i i NN work_rujstqwje5gkdm2bqer4drugey 138 109 b b NN work_rujstqwje5gkdm2bqer4drugey 138 110 n n CC work_rujstqwje5gkdm2bqer4drugey 138 111 n n CC work_rujstqwje5gkdm2bqer4drugey 138 112 n n CC work_rujstqwje5gkdm2bqer4drugey 138 113 k k NN work_rujstqwje5gkdm2bqer4drugey 138 114 a a NN work_rujstqwje5gkdm2bqer4drugey 138 115 so so RB work_rujstqwje5gkdm2bqer4drugey 138 116 z z JJ work_rujstqwje5gkdm2bqer4drugey 138 117 h h NN work_rujstqwje5gkdm2bqer4drugey 138 118 jv jv NNP work_rujstqwje5gkdm2bqer4drugey 138 119 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 120 l l NNP work_rujstqwje5gkdm2bqer4drugey 138 121 c c NNP work_rujstqwje5gkdm2bqer4drugey 138 122 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 123 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 124 v v NN work_rujstqwje5gkdm2bqer4drugey 138 125 i i NN work_rujstqwje5gkdm2bqer4drugey 138 126 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 127 c c NNP work_rujstqwje5gkdm2bqer4drugey 138 128 l l NN work_rujstqwje5gkdm2bqer4drugey 138 129 is be VBZ work_rujstqwje5gkdm2bqer4drugey 138 130 su su NNP work_rujstqwje5gkdm2bqer4drugey 138 131 u u NNP work_rujstqwje5gkdm2bqer4drugey 138 132 z z NNP work_rujstqwje5gkdm2bqer4drugey 138 133 lb lb NNP work_rujstqwje5gkdm2bqer4drugey 138 134 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 135 p p NNP work_rujstqwje5gkdm2bqer4drugey 138 136 y y NNP work_rujstqwje5gkdm2bqer4drugey 138 137 sc sc NNP work_rujstqwje5gkdm2bqer4drugey 138 138 n n CC work_rujstqwje5gkdm2bqer4drugey 138 139 n n NNP work_rujstqwje5gkdm2bqer4drugey 138 140 e e NNP work_rujstqwje5gkdm2bqer4drugey 138 141 w w NNP work_rujstqwje5gkdm2bqer4drugey 138 142 u u NNP work_rujstqwje5gkdm2bqer4drugey 138 143 r r NNP work_rujstqwje5gkdm2bqer4drugey 138 144 sd sd NNP work_rujstqwje5gkdm2bqer4drugey 138 145 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 146 r r NNP work_rujstqwje5gkdm2bqer4drugey 138 147 p p NNP work_rujstqwje5gkdm2bqer4drugey 138 148 s s NN work_rujstqwje5gkdm2bqer4drugey 138 149 ru ru NNP work_rujstqwje5gkdm2bqer4drugey 138 150 a a NNP work_rujstqwje5gkdm2bqer4drugey 138 151 m m NNP work_rujstqwje5gkdm2bqer4drugey 138 152 w w NNP work_rujstqwje5gkdm2bqer4drugey 138 153 o o NNP work_rujstqwje5gkdm2bqer4drugey 138 154 b b NNP work_rujstqwje5gkdm2bqer4drugey 138 155 o0.0 o0.0 CD work_rujstqwje5gkdm2bqer4drugey 138 156 0.2 0.2 CD work_rujstqwje5gkdm2bqer4drugey 138 157 0.4 0.4 CD work_rujstqwje5gkdm2bqer4drugey 138 158 0.6 0.6 CD work_rujstqwje5gkdm2bqer4drugey 138 159 0.8 0.8 CD work_rujstqwje5gkdm2bqer4drugey 138 160 1.0 1.0 CD work_rujstqwje5gkdm2bqer4drugey 138 161 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 138 162 4 4 CD work_rujstqwje5gkdm2bqer4drugey 138 163 : : : work_rujstqwje5gkdm2bqer4drugey 138 164 Translation translation NN work_rujstqwje5gkdm2bqer4drugey 138 165 quality quality NN work_rujstqwje5gkdm2bqer4drugey 138 166 for for IN work_rujstqwje5gkdm2bqer4drugey 138 167 languages language NNS work_rujstqwje5gkdm2bqer4drugey 138 168 with with IN work_rujstqwje5gkdm2bqer4drugey 138 169 at at RB work_rujstqwje5gkdm2bqer4drugey 138 170 least least JJS work_rujstqwje5gkdm2bqer4drugey 138 171 50 50 CD work_rujstqwje5gkdm2bqer4drugey 138 172 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 138 173 . . . work_rujstqwje5gkdm2bqer4drugey 139 1 The the DT work_rujstqwje5gkdm2bqer4drugey 139 2 dark dark JJ work_rujstqwje5gkdm2bqer4drugey 139 3 blue blue JJ work_rujstqwje5gkdm2bqer4drugey 139 4 bars bar NNS work_rujstqwje5gkdm2bqer4drugey 139 5 indicate indicate VBP work_rujstqwje5gkdm2bqer4drugey 139 6 the the DT work_rujstqwje5gkdm2bqer4drugey 139 7 pro- pro- NN work_rujstqwje5gkdm2bqer4drugey 139 8 portion portion NN work_rujstqwje5gkdm2bqer4drugey 139 9 of of IN work_rujstqwje5gkdm2bqer4drugey 139 10 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 139 11 which which WDT work_rujstqwje5gkdm2bqer4drugey 139 12 exactly exactly RB work_rujstqwje5gkdm2bqer4drugey 139 13 matched match VBD work_rujstqwje5gkdm2bqer4drugey 139 14 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 139 15 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 139 16 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 139 17 , , , work_rujstqwje5gkdm2bqer4drugey 139 18 and and CC work_rujstqwje5gkdm2bqer4drugey 139 19 light light JJ work_rujstqwje5gkdm2bqer4drugey 139 20 blue blue JJ work_rujstqwje5gkdm2bqer4drugey 139 21 indicate indicate VBP work_rujstqwje5gkdm2bqer4drugey 139 22 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 139 23 which which WDT work_rujstqwje5gkdm2bqer4drugey 139 24 were be VBD work_rujstqwje5gkdm2bqer4drugey 139 25 judged judge VBN work_rujstqwje5gkdm2bqer4drugey 139 26 to to TO work_rujstqwje5gkdm2bqer4drugey 139 27 be be VB work_rujstqwje5gkdm2bqer4drugey 139 28 correct correct JJ work_rujstqwje5gkdm2bqer4drugey 139 29 synonyms synonyms NN work_rujstqwje5gkdm2bqer4drugey 139 30 . . . work_rujstqwje5gkdm2bqer4drugey 140 1 Error error NN work_rujstqwje5gkdm2bqer4drugey 140 2 bars bar NNS work_rujstqwje5gkdm2bqer4drugey 140 3 show show VBP work_rujstqwje5gkdm2bqer4drugey 140 4 the the DT work_rujstqwje5gkdm2bqer4drugey 140 5 95 95 CD work_rujstqwje5gkdm2bqer4drugey 140 6 % % NN work_rujstqwje5gkdm2bqer4drugey 140 7 confidence confidence NN work_rujstqwje5gkdm2bqer4drugey 140 8 intervals interval NNS work_rujstqwje5gkdm2bqer4drugey 140 9 for for IN work_rujstqwje5gkdm2bqer4drugey 140 10 each each DT work_rujstqwje5gkdm2bqer4drugey 140 11 language language NN work_rujstqwje5gkdm2bqer4drugey 140 12 . . . work_rujstqwje5gkdm2bqer4drugey 141 1 sion sion NN work_rujstqwje5gkdm2bqer4drugey 141 2 and and CC work_rujstqwje5gkdm2bqer4drugey 141 3 non non JJ work_rujstqwje5gkdm2bqer4drugey 141 4 - - JJ work_rujstqwje5gkdm2bqer4drugey 141 5 professional professional JJ work_rujstqwje5gkdm2bqer4drugey 141 6 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 141 7 as as IN work_rujstqwje5gkdm2bqer4drugey 141 8 Zaidan Zaidan NNP work_rujstqwje5gkdm2bqer4drugey 141 9 and and CC work_rujstqwje5gkdm2bqer4drugey 141 10 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 141 11 - - HYPH work_rujstqwje5gkdm2bqer4drugey 141 12 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 141 13 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 141 14 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 141 15 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 141 16 did do VBD work_rujstqwje5gkdm2bqer4drugey 141 17 . . . work_rujstqwje5gkdm2bqer4drugey 142 1 Instead instead RB work_rujstqwje5gkdm2bqer4drugey 142 2 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 142 3 evaluate evaluate VBP work_rujstqwje5gkdm2bqer4drugey 142 4 the the DT work_rujstqwje5gkdm2bqer4drugey 142 5 quality quality NN work_rujstqwje5gkdm2bqer4drugey 142 6 of of IN work_rujstqwje5gkdm2bqer4drugey 142 7 the the DT work_rujstqwje5gkdm2bqer4drugey 142 8 data datum NNS work_rujstqwje5gkdm2bqer4drugey 142 9 by by IN work_rujstqwje5gkdm2bqer4drugey 142 10 using use VBG work_rujstqwje5gkdm2bqer4drugey 142 11 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 142 12 to to TO work_rujstqwje5gkdm2bqer4drugey 142 13 train train VB work_rujstqwje5gkdm2bqer4drugey 142 14 SMT SMT NNP work_rujstqwje5gkdm2bqer4drugey 142 15 systems system NNS work_rujstqwje5gkdm2bqer4drugey 142 16 . . . work_rujstqwje5gkdm2bqer4drugey 143 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 143 2 present present VBP work_rujstqwje5gkdm2bqer4drugey 143 3 results result NNS work_rujstqwje5gkdm2bqer4drugey 143 4 in in IN work_rujstqwje5gkdm2bqer4drugey 143 5 section section NN work_rujstqwje5gkdm2bqer4drugey 143 6 5 5 CD work_rujstqwje5gkdm2bqer4drugey 143 7 . . . work_rujstqwje5gkdm2bqer4drugey 144 1 4 4 LS work_rujstqwje5gkdm2bqer4drugey 144 2 Measuring Measuring NNP work_rujstqwje5gkdm2bqer4drugey 144 3 Translation Translation NNP work_rujstqwje5gkdm2bqer4drugey 144 4 Quality Quality NNP work_rujstqwje5gkdm2bqer4drugey 144 5 For for IN work_rujstqwje5gkdm2bqer4drugey 144 6 single single JJ work_rujstqwje5gkdm2bqer4drugey 144 7 word word NN work_rujstqwje5gkdm2bqer4drugey 144 8 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 144 9 , , , work_rujstqwje5gkdm2bqer4drugey 144 10 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 144 11 calculate calculate VBP work_rujstqwje5gkdm2bqer4drugey 144 12 the the DT work_rujstqwje5gkdm2bqer4drugey 144 13 qual- qual- JJ work_rujstqwje5gkdm2bqer4drugey 144 14 ity ity NN work_rujstqwje5gkdm2bqer4drugey 144 15 of of IN work_rujstqwje5gkdm2bqer4drugey 144 16 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 144 17 on on IN work_rujstqwje5gkdm2bqer4drugey 144 18 the the DT work_rujstqwje5gkdm2bqer4drugey 144 19 level level NN work_rujstqwje5gkdm2bqer4drugey 144 20 of of IN work_rujstqwje5gkdm2bqer4drugey 144 21 individual individual JJ work_rujstqwje5gkdm2bqer4drugey 144 22 assign- assign- JJ work_rujstqwje5gkdm2bqer4drugey 144 23 ments ment NNS work_rujstqwje5gkdm2bqer4drugey 144 24 and and CC work_rujstqwje5gkdm2bqer4drugey 144 25 aggregated aggregate VBN work_rujstqwje5gkdm2bqer4drugey 144 26 over over IN work_rujstqwje5gkdm2bqer4drugey 144 27 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 144 28 and and CC work_rujstqwje5gkdm2bqer4drugey 144 29 languages language NNS work_rujstqwje5gkdm2bqer4drugey 144 30 . . . work_rujstqwje5gkdm2bqer4drugey 145 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 145 2 define define VBP work_rujstqwje5gkdm2bqer4drugey 145 3 an an DT work_rujstqwje5gkdm2bqer4drugey 145 4 assignment assignment NN work_rujstqwje5gkdm2bqer4drugey 145 5 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 145 6 quality quality NN work_rujstqwje5gkdm2bqer4drugey 145 7 as as IN work_rujstqwje5gkdm2bqer4drugey 145 8 the the DT work_rujstqwje5gkdm2bqer4drugey 145 9 proportion proportion NN work_rujstqwje5gkdm2bqer4drugey 145 10 of of IN work_rujstqwje5gkdm2bqer4drugey 145 11 controls control NNS work_rujstqwje5gkdm2bqer4drugey 145 12 that that WDT work_rujstqwje5gkdm2bqer4drugey 145 13 are be VBP work_rujstqwje5gkdm2bqer4drugey 145 14 correct correct JJ work_rujstqwje5gkdm2bqer4drugey 145 15 in in IN work_rujstqwje5gkdm2bqer4drugey 145 16 a a DT work_rujstqwje5gkdm2bqer4drugey 145 17 given give VBN work_rujstqwje5gkdm2bqer4drugey 145 18 assignment assignment NN work_rujstqwje5gkdm2bqer4drugey 145 19 , , , work_rujstqwje5gkdm2bqer4drugey 145 20 where where WRB work_rujstqwje5gkdm2bqer4drugey 145 21 correct correct JJ work_rujstqwje5gkdm2bqer4drugey 145 22 means mean VBZ work_rujstqwje5gkdm2bqer4drugey 145 23 exactly exactly RB work_rujstqwje5gkdm2bqer4drugey 145 24 correct correct JJ work_rujstqwje5gkdm2bqer4drugey 145 25 or or CC work_rujstqwje5gkdm2bqer4drugey 145 26 judged judge VBN work_rujstqwje5gkdm2bqer4drugey 145 27 to to TO work_rujstqwje5gkdm2bqer4drugey 145 28 be be VB work_rujstqwje5gkdm2bqer4drugey 145 29 synonymous synonymous JJ work_rujstqwje5gkdm2bqer4drugey 145 30 . . . work_rujstqwje5gkdm2bqer4drugey 146 1 Quality(ai Quality(ai NNP work_rujstqwje5gkdm2bqer4drugey 146 2 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 146 3 = = NFP work_rujstqwje5gkdm2bqer4drugey 146 4 1 1 CD work_rujstqwje5gkdm2bqer4drugey 146 5 ki ki NNP work_rujstqwje5gkdm2bqer4drugey 146 6 ki∑ ki∑ NNP work_rujstqwje5gkdm2bqer4drugey 146 7 j=1 j=1 NNS work_rujstqwje5gkdm2bqer4drugey 146 8 δ(trij δ(trij . work_rujstqwje5gkdm2bqer4drugey 146 9 ∈ ∈ NNP work_rujstqwje5gkdm2bqer4drugey 146 10 syns[gj syns[gj NNP work_rujstqwje5gkdm2bqer4drugey 146 11 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 146 12 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 146 13 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 146 14 1 1 LS work_rujstqwje5gkdm2bqer4drugey 146 15 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 146 16 where where WRB work_rujstqwje5gkdm2bqer4drugey 146 17 ai ai NNP work_rujstqwje5gkdm2bqer4drugey 146 18 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 19 the the DT work_rujstqwje5gkdm2bqer4drugey 146 20 ith ith NNP work_rujstqwje5gkdm2bqer4drugey 146 21 assignment assignment NN work_rujstqwje5gkdm2bqer4drugey 146 22 , , , work_rujstqwje5gkdm2bqer4drugey 146 23 ki ki NNP work_rujstqwje5gkdm2bqer4drugey 146 24 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 25 the the DT work_rujstqwje5gkdm2bqer4drugey 146 26 number number NN work_rujstqwje5gkdm2bqer4drugey 146 27 of of IN work_rujstqwje5gkdm2bqer4drugey 146 28 controls control NNS work_rujstqwje5gkdm2bqer4drugey 146 29 in in IN work_rujstqwje5gkdm2bqer4drugey 146 30 ai ai NNP work_rujstqwje5gkdm2bqer4drugey 146 31 , , , work_rujstqwje5gkdm2bqer4drugey 146 32 trij trij NNP work_rujstqwje5gkdm2bqer4drugey 146 33 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 34 the the DT work_rujstqwje5gkdm2bqer4drugey 146 35 Turker Turker NNP work_rujstqwje5gkdm2bqer4drugey 146 36 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 146 37 provided provide VBN work_rujstqwje5gkdm2bqer4drugey 146 38 transla- transla- NN work_rujstqwje5gkdm2bqer4drugey 146 39 tion tion NN work_rujstqwje5gkdm2bqer4drugey 146 40 of of IN work_rujstqwje5gkdm2bqer4drugey 146 41 control control NN work_rujstqwje5gkdm2bqer4drugey 146 42 word word NN work_rujstqwje5gkdm2bqer4drugey 146 43 j j NNP work_rujstqwje5gkdm2bqer4drugey 146 44 in in IN work_rujstqwje5gkdm2bqer4drugey 146 45 assignment assignment NN work_rujstqwje5gkdm2bqer4drugey 146 46 i i PRP work_rujstqwje5gkdm2bqer4drugey 146 47 , , , work_rujstqwje5gkdm2bqer4drugey 146 48 gj gj NNP work_rujstqwje5gkdm2bqer4drugey 146 49 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 50 the the DT work_rujstqwje5gkdm2bqer4drugey 146 51 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 146 52 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 146 53 translation translation NN work_rujstqwje5gkdm2bqer4drugey 146 54 of of IN work_rujstqwje5gkdm2bqer4drugey 146 55 control control NN work_rujstqwje5gkdm2bqer4drugey 146 56 word word NN work_rujstqwje5gkdm2bqer4drugey 146 57 j j NNP work_rujstqwje5gkdm2bqer4drugey 146 58 , , , work_rujstqwje5gkdm2bqer4drugey 146 59 syns[gj syns[gj NNP work_rujstqwje5gkdm2bqer4drugey 146 60 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 146 61 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 62 the the DT work_rujstqwje5gkdm2bqer4drugey 146 63 set set NN work_rujstqwje5gkdm2bqer4drugey 146 64 of of IN work_rujstqwje5gkdm2bqer4drugey 146 65 words word NNS work_rujstqwje5gkdm2bqer4drugey 146 66 judged judge VBN work_rujstqwje5gkdm2bqer4drugey 146 67 to to TO work_rujstqwje5gkdm2bqer4drugey 146 68 be be VB work_rujstqwje5gkdm2bqer4drugey 146 69 synonymous synonymous JJ work_rujstqwje5gkdm2bqer4drugey 146 70 with with IN work_rujstqwje5gkdm2bqer4drugey 146 71 gj gj NNP work_rujstqwje5gkdm2bqer4drugey 146 72 and and CC work_rujstqwje5gkdm2bqer4drugey 146 73 includes include VBZ work_rujstqwje5gkdm2bqer4drugey 146 74 gj gj NNP work_rujstqwje5gkdm2bqer4drugey 146 75 , , , work_rujstqwje5gkdm2bqer4drugey 146 76 and and CC work_rujstqwje5gkdm2bqer4drugey 146 77 δ(x δ(x NNP work_rujstqwje5gkdm2bqer4drugey 146 78 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 146 79 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 80 Kronecker Kronecker NNP work_rujstqwje5gkdm2bqer4drugey 146 81 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 146 82 delta delta NN work_rujstqwje5gkdm2bqer4drugey 146 83 and and CC work_rujstqwje5gkdm2bqer4drugey 146 84 takes take VBZ work_rujstqwje5gkdm2bqer4drugey 146 85 value value NN work_rujstqwje5gkdm2bqer4drugey 146 86 1 1 CD work_rujstqwje5gkdm2bqer4drugey 146 87 when when WRB work_rujstqwje5gkdm2bqer4drugey 146 88 x x NNP work_rujstqwje5gkdm2bqer4drugey 146 89 is be VBZ work_rujstqwje5gkdm2bqer4drugey 146 90 true true JJ work_rujstqwje5gkdm2bqer4drugey 146 91 . . . work_rujstqwje5gkdm2bqer4drugey 147 1 Most Most JJS work_rujstqwje5gkdm2bqer4drugey 147 2 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 147 3 had have VBD work_rujstqwje5gkdm2bqer4drugey 147 4 two two CD work_rujstqwje5gkdm2bqer4drugey 147 5 known know VBN work_rujstqwje5gkdm2bqer4drugey 147 6 words word NNS work_rujstqwje5gkdm2bqer4drugey 147 7 embedded embed VBN work_rujstqwje5gkdm2bqer4drugey 147 8 , , , work_rujstqwje5gkdm2bqer4drugey 147 9 so so RB work_rujstqwje5gkdm2bqer4drugey 147 10 most most JJS work_rujstqwje5gkdm2bqer4drugey 147 11 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 147 12 had have VBD work_rujstqwje5gkdm2bqer4drugey 147 13 scores score NNS work_rujstqwje5gkdm2bqer4drugey 147 14 of of IN work_rujstqwje5gkdm2bqer4drugey 147 15 either either DT work_rujstqwje5gkdm2bqer4drugey 147 16 0 0 CD work_rujstqwje5gkdm2bqer4drugey 147 17 , , , work_rujstqwje5gkdm2bqer4drugey 147 18 0.5 0.5 CD work_rujstqwje5gkdm2bqer4drugey 147 19 , , , work_rujstqwje5gkdm2bqer4drugey 147 20 or or CC work_rujstqwje5gkdm2bqer4drugey 147 21 1 1 CD work_rujstqwje5gkdm2bqer4drugey 147 22 . . . work_rujstqwje5gkdm2bqer4drugey 148 1 Since since IN work_rujstqwje5gkdm2bqer4drugey 148 2 computing compute VBG work_rujstqwje5gkdm2bqer4drugey 148 3 overall overall JJ work_rujstqwje5gkdm2bqer4drugey 148 4 quality quality NN work_rujstqwje5gkdm2bqer4drugey 148 5 for for IN work_rujstqwje5gkdm2bqer4drugey 148 6 a a DT work_rujstqwje5gkdm2bqer4drugey 148 7 language language NN work_rujstqwje5gkdm2bqer4drugey 148 8 as as IN work_rujstqwje5gkdm2bqer4drugey 148 9 the the DT work_rujstqwje5gkdm2bqer4drugey 148 10 average average JJ work_rujstqwje5gkdm2bqer4drugey 148 11 assignment assignment JJ work_rujstqwje5gkdm2bqer4drugey 148 12 quality quality NN work_rujstqwje5gkdm2bqer4drugey 148 13 score score NN work_rujstqwje5gkdm2bqer4drugey 148 14 is be VBZ work_rujstqwje5gkdm2bqer4drugey 148 15 biased biased JJ work_rujstqwje5gkdm2bqer4drugey 148 16 to- to- NNP work_rujstqwje5gkdm2bqer4drugey 148 17 wards ward NNS work_rujstqwje5gkdm2bqer4drugey 148 18 a a DT work_rujstqwje5gkdm2bqer4drugey 148 19 small small JJ work_rujstqwje5gkdm2bqer4drugey 148 20 number number NN work_rujstqwje5gkdm2bqer4drugey 148 21 of of IN work_rujstqwje5gkdm2bqer4drugey 148 22 highly highly RB work_rujstqwje5gkdm2bqer4drugey 148 23 active active JJ work_rujstqwje5gkdm2bqer4drugey 148 24 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 148 25 , , , work_rujstqwje5gkdm2bqer4drugey 148 26 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 148 27 instead instead RB work_rujstqwje5gkdm2bqer4drugey 148 28 report report VBP work_rujstqwje5gkdm2bqer4drugey 148 29 language language NN work_rujstqwje5gkdm2bqer4drugey 148 30 quality quality NN work_rujstqwje5gkdm2bqer4drugey 148 31 scores score NNS work_rujstqwje5gkdm2bqer4drugey 148 32 as as IN work_rujstqwje5gkdm2bqer4drugey 148 33 the the DT work_rujstqwje5gkdm2bqer4drugey 148 34 aver- aver- JJ work_rujstqwje5gkdm2bqer4drugey 148 35 age age NN work_rujstqwje5gkdm2bqer4drugey 148 36 per per IN work_rujstqwje5gkdm2bqer4drugey 148 37 - - HYPH work_rujstqwje5gkdm2bqer4drugey 148 38 Turker turker NN work_rujstqwje5gkdm2bqer4drugey 148 39 quality quality NN work_rujstqwje5gkdm2bqer4drugey 148 40 , , , work_rujstqwje5gkdm2bqer4drugey 148 41 where where WRB work_rujstqwje5gkdm2bqer4drugey 148 42 a a DT work_rujstqwje5gkdm2bqer4drugey 148 43 Turker Turker NNP work_rujstqwje5gkdm2bqer4drugey 148 44 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 148 45 quality quality NN work_rujstqwje5gkdm2bqer4drugey 148 46 is be VBZ work_rujstqwje5gkdm2bqer4drugey 148 47 the the DT work_rujstqwje5gkdm2bqer4drugey 148 48 average average JJ work_rujstqwje5gkdm2bqer4drugey 148 49 quality quality NN work_rujstqwje5gkdm2bqer4drugey 148 50 of of IN work_rujstqwje5gkdm2bqer4drugey 148 51 all all PDT work_rujstqwje5gkdm2bqer4drugey 148 52 the the DT work_rujstqwje5gkdm2bqer4drugey 148 53 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 148 54 that that WDT work_rujstqwje5gkdm2bqer4drugey 148 55 she -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 148 56 completed complete VBD work_rujstqwje5gkdm2bqer4drugey 148 57 : : : work_rujstqwje5gkdm2bqer4drugey 148 58 Quality(ti Quality(ti NNP work_rujstqwje5gkdm2bqer4drugey 148 59 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 148 60 = = NFP work_rujstqwje5gkdm2bqer4drugey 148 61 ∑ ∑ . work_rujstqwje5gkdm2bqer4drugey 148 62 aj∈assigns[i aj∈assigns[i NN work_rujstqwje5gkdm2bqer4drugey 148 63 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 148 64 Quality(aj Quality(aj NNP work_rujstqwje5gkdm2bqer4drugey 148 65 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 148 66 | | NNP work_rujstqwje5gkdm2bqer4drugey 148 67 assigns[i assigns[i NNP work_rujstqwje5gkdm2bqer4drugey 148 68 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 148 69 | | NNP work_rujstqwje5gkdm2bqer4drugey 148 70 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 148 71 2 2 CD work_rujstqwje5gkdm2bqer4drugey 148 72 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 148 73 where where WRB work_rujstqwje5gkdm2bqer4drugey 148 74 assigns[i assigns[i NN work_rujstqwje5gkdm2bqer4drugey 148 75 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 148 76 is be VBZ work_rujstqwje5gkdm2bqer4drugey 148 77 the the DT work_rujstqwje5gkdm2bqer4drugey 148 78 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 148 79 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 148 80 by by IN work_rujstqwje5gkdm2bqer4drugey 148 81 Turker Turker NNP work_rujstqwje5gkdm2bqer4drugey 148 82 i i PRP work_rujstqwje5gkdm2bqer4drugey 148 83 , , , work_rujstqwje5gkdm2bqer4drugey 148 84 and and CC work_rujstqwje5gkdm2bqer4drugey 148 85 Quality(a Quality(a NNP work_rujstqwje5gkdm2bqer4drugey 148 86 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 148 87 is be VBZ work_rujstqwje5gkdm2bqer4drugey 148 88 as as IN work_rujstqwje5gkdm2bqer4drugey 148 89 above above RB work_rujstqwje5gkdm2bqer4drugey 148 90 . . . work_rujstqwje5gkdm2bqer4drugey 149 1 Quality quality NN work_rujstqwje5gkdm2bqer4drugey 149 2 for for IN work_rujstqwje5gkdm2bqer4drugey 149 3 a a DT work_rujstqwje5gkdm2bqer4drugey 149 4 language language NN work_rujstqwje5gkdm2bqer4drugey 149 5 is be VBZ work_rujstqwje5gkdm2bqer4drugey 149 6 then then RB work_rujstqwje5gkdm2bqer4drugey 149 7 given give VBN work_rujstqwje5gkdm2bqer4drugey 149 8 by by IN work_rujstqwje5gkdm2bqer4drugey 149 9 Quality(li Quality(li NNP work_rujstqwje5gkdm2bqer4drugey 149 10 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 149 11 = = NFP work_rujstqwje5gkdm2bqer4drugey 149 12 ∑ ∑ . work_rujstqwje5gkdm2bqer4drugey 149 13 tj∈turkers[i tj∈turkers[i NN work_rujstqwje5gkdm2bqer4drugey 149 14 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 149 15 Quality(tj Quality(tj NNP work_rujstqwje5gkdm2bqer4drugey 149 16 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 149 17 | | NNP work_rujstqwje5gkdm2bqer4drugey 149 18 turkers[i turkers[i NNP work_rujstqwje5gkdm2bqer4drugey 149 19 ] ] -RRB- work_rujstqwje5gkdm2bqer4drugey 149 20 | | NNP work_rujstqwje5gkdm2bqer4drugey 149 21 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 149 22 3 3 LS work_rujstqwje5gkdm2bqer4drugey 149 23 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 149 24 When when WRB work_rujstqwje5gkdm2bqer4drugey 149 25 a a DT work_rujstqwje5gkdm2bqer4drugey 149 26 Turker Turker NNP work_rujstqwje5gkdm2bqer4drugey 149 27 completed complete VBD work_rujstqwje5gkdm2bqer4drugey 149 28 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 149 29 in in IN work_rujstqwje5gkdm2bqer4drugey 149 30 more more JJR work_rujstqwje5gkdm2bqer4drugey 149 31 than than IN work_rujstqwje5gkdm2bqer4drugey 149 32 one one CD work_rujstqwje5gkdm2bqer4drugey 149 33 language language NN work_rujstqwje5gkdm2bqer4drugey 149 34 , , , work_rujstqwje5gkdm2bqer4drugey 149 35 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 149 36 quality quality NN work_rujstqwje5gkdm2bqer4drugey 149 37 was be VBD work_rujstqwje5gkdm2bqer4drugey 149 38 computed compute VBN work_rujstqwje5gkdm2bqer4drugey 149 39 separately separately RB work_rujstqwje5gkdm2bqer4drugey 149 40 for for IN work_rujstqwje5gkdm2bqer4drugey 149 41 each each DT work_rujstqwje5gkdm2bqer4drugey 149 42 language language NN work_rujstqwje5gkdm2bqer4drugey 149 43 . . . work_rujstqwje5gkdm2bqer4drugey 150 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 150 2 4 4 CD work_rujstqwje5gkdm2bqer4drugey 150 3 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 150 4 the the DT work_rujstqwje5gkdm2bqer4drugey 150 5 transla- transla- NN work_rujstqwje5gkdm2bqer4drugey 150 6 tion tion NN work_rujstqwje5gkdm2bqer4drugey 150 7 quality quality NN work_rujstqwje5gkdm2bqer4drugey 150 8 for for IN work_rujstqwje5gkdm2bqer4drugey 150 9 languages language NNS work_rujstqwje5gkdm2bqer4drugey 150 10 with with IN work_rujstqwje5gkdm2bqer4drugey 150 11 contributions contribution NNS work_rujstqwje5gkdm2bqer4drugey 150 12 from from IN work_rujstqwje5gkdm2bqer4drugey 150 13 at at RB work_rujstqwje5gkdm2bqer4drugey 150 14 least least JJS work_rujstqwje5gkdm2bqer4drugey 150 15 50 50 CD work_rujstqwje5gkdm2bqer4drugey 150 16 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 150 17 . . . work_rujstqwje5gkdm2bqer4drugey 151 1 Cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 151 2 using use VBG work_rujstqwje5gkdm2bqer4drugey 151 3 machine machine NN work_rujstqwje5gkdm2bqer4drugey 151 4 translation translation NN work_rujstqwje5gkdm2bqer4drugey 151 5 One one CD work_rujstqwje5gkdm2bqer4drugey 151 6 obvi- obvi- VBZ work_rujstqwje5gkdm2bqer4drugey 151 7 ous ous JJ work_rujstqwje5gkdm2bqer4drugey 151 8 way way NN work_rujstqwje5gkdm2bqer4drugey 151 9 for for IN work_rujstqwje5gkdm2bqer4drugey 151 10 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 151 11 to to TO work_rujstqwje5gkdm2bqer4drugey 151 12 cheat cheat VB work_rujstqwje5gkdm2bqer4drugey 151 13 is be VBZ work_rujstqwje5gkdm2bqer4drugey 151 14 to to TO work_rujstqwje5gkdm2bqer4drugey 151 15 use use VB work_rujstqwje5gkdm2bqer4drugey 151 16 available available JJ work_rujstqwje5gkdm2bqer4drugey 151 17 online online JJ work_rujstqwje5gkdm2bqer4drugey 151 18 translation translation NN work_rujstqwje5gkdm2bqer4drugey 151 19 tools tool NNS work_rujstqwje5gkdm2bqer4drugey 151 20 . . . work_rujstqwje5gkdm2bqer4drugey 152 1 Although although IN work_rujstqwje5gkdm2bqer4drugey 152 2 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 152 3 followed follow VBD work_rujstqwje5gkdm2bqer4drugey 152 4 best good JJS work_rujstqwje5gkdm2bqer4drugey 152 5 practices practice NNS work_rujstqwje5gkdm2bqer4drugey 152 6 to to TO work_rujstqwje5gkdm2bqer4drugey 152 7 deter deter VB work_rujstqwje5gkdm2bqer4drugey 152 8 copying copying NN work_rujstqwje5gkdm2bqer4drugey 152 9 - - : work_rujstqwje5gkdm2bqer4drugey 152 10 and and CC work_rujstqwje5gkdm2bqer4drugey 152 11 - - HYPH work_rujstqwje5gkdm2bqer4drugey 152 12 pasting pasting NN work_rujstqwje5gkdm2bqer4drugey 152 13 into into IN work_rujstqwje5gkdm2bqer4drugey 152 14 on- on- NNP work_rujstqwje5gkdm2bqer4drugey 152 15 line line NN work_rujstqwje5gkdm2bqer4drugey 152 16 MT MT NNP work_rujstqwje5gkdm2bqer4drugey 152 17 systems system NNS work_rujstqwje5gkdm2bqer4drugey 152 18 by by IN work_rujstqwje5gkdm2bqer4drugey 152 19 rendering render VBG work_rujstqwje5gkdm2bqer4drugey 152 20 words word NNS work_rujstqwje5gkdm2bqer4drugey 152 21 and and CC work_rujstqwje5gkdm2bqer4drugey 152 22 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 152 23 84 84 CD work_rujstqwje5gkdm2bqer4drugey 152 24 as as IN work_rujstqwje5gkdm2bqer4drugey 152 25 images image NNS work_rujstqwje5gkdm2bqer4drugey 152 26 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 152 27 Zaidan Zaidan NNP work_rujstqwje5gkdm2bqer4drugey 152 28 and and CC work_rujstqwje5gkdm2bqer4drugey 152 29 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 152 30 - - HYPH work_rujstqwje5gkdm2bqer4drugey 152 31 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 152 32 , , , work_rujstqwje5gkdm2bqer4drugey 152 33 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 152 34 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 152 35 , , , work_rujstqwje5gkdm2bqer4drugey 152 36 this this DT work_rujstqwje5gkdm2bqer4drugey 152 37 strategy strategy NN work_rujstqwje5gkdm2bqer4drugey 152 38 does do VBZ work_rujstqwje5gkdm2bqer4drugey 152 39 not not RB work_rujstqwje5gkdm2bqer4drugey 152 40 prevent prevent VB work_rujstqwje5gkdm2bqer4drugey 152 41 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 152 42 from from IN work_rujstqwje5gkdm2bqer4drugey 152 43 typing type VBG work_rujstqwje5gkdm2bqer4drugey 152 44 the the DT work_rujstqwje5gkdm2bqer4drugey 152 45 words word NNS work_rujstqwje5gkdm2bqer4drugey 152 46 into into IN work_rujstqwje5gkdm2bqer4drugey 152 47 an an DT work_rujstqwje5gkdm2bqer4drugey 152 48 MT MT NNP work_rujstqwje5gkdm2bqer4drugey 152 49 system system NN work_rujstqwje5gkdm2bqer4drugey 152 50 if if IN work_rujstqwje5gkdm2bqer4drugey 152 51 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 152 52 are be VBP work_rujstqwje5gkdm2bqer4drugey 152 53 able able JJ work_rujstqwje5gkdm2bqer4drugey 152 54 to to TO work_rujstqwje5gkdm2bqer4drugey 152 55 type type VB work_rujstqwje5gkdm2bqer4drugey 152 56 in in IN work_rujstqwje5gkdm2bqer4drugey 152 57 the the DT work_rujstqwje5gkdm2bqer4drugey 152 58 language language NN work_rujstqwje5gkdm2bqer4drugey 152 59 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 152 60 script script NN work_rujstqwje5gkdm2bqer4drugey 152 61 . . . work_rujstqwje5gkdm2bqer4drugey 153 1 To to TO work_rujstqwje5gkdm2bqer4drugey 153 2 identify identify VB work_rujstqwje5gkdm2bqer4drugey 153 3 and and CC work_rujstqwje5gkdm2bqer4drugey 153 4 remove remove VB work_rujstqwje5gkdm2bqer4drugey 153 5 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 153 6 who who WP work_rujstqwje5gkdm2bqer4drugey 153 7 appeared appear VBD work_rujstqwje5gkdm2bqer4drugey 153 8 to to TO work_rujstqwje5gkdm2bqer4drugey 153 9 be be VB work_rujstqwje5gkdm2bqer4drugey 153 10 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 153 11 by by IN work_rujstqwje5gkdm2bqer4drugey 153 12 using use VBG work_rujstqwje5gkdm2bqer4drugey 153 13 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 153 14 Translate Translate NNP work_rujstqwje5gkdm2bqer4drugey 153 15 , , , work_rujstqwje5gkdm2bqer4drugey 153 16 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 153 17 calcu- calcu- VBD work_rujstqwje5gkdm2bqer4drugey 153 18 lated late VBN work_rujstqwje5gkdm2bqer4drugey 153 19 each each DT work_rujstqwje5gkdm2bqer4drugey 153 20 worker worker NN work_rujstqwje5gkdm2bqer4drugey 153 21 ’s ’s , work_rujstqwje5gkdm2bqer4drugey 153 22 overlap overlap VBP work_rujstqwje5gkdm2bqer4drugey 153 23 with with IN work_rujstqwje5gkdm2bqer4drugey 153 24 the the DT work_rujstqwje5gkdm2bqer4drugey 153 25 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 153 26 transla- transla- NN work_rujstqwje5gkdm2bqer4drugey 153 27 tions tion NNS work_rujstqwje5gkdm2bqer4drugey 153 28 . . . work_rujstqwje5gkdm2bqer4drugey 154 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 154 2 used use VBD work_rujstqwje5gkdm2bqer4drugey 154 3 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 154 4 to to TO work_rujstqwje5gkdm2bqer4drugey 154 5 translate translate VB work_rujstqwje5gkdm2bqer4drugey 154 6 all all DT work_rujstqwje5gkdm2bqer4drugey 154 7 10,000 10,000 CD work_rujstqwje5gkdm2bqer4drugey 154 8 words word NNS work_rujstqwje5gkdm2bqer4drugey 154 9 for for IN work_rujstqwje5gkdm2bqer4drugey 154 10 the the DT work_rujstqwje5gkdm2bqer4drugey 154 11 51 51 CD work_rujstqwje5gkdm2bqer4drugey 154 12 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 154 13 languages language NNS work_rujstqwje5gkdm2bqer4drugey 154 14 that that WDT work_rujstqwje5gkdm2bqer4drugey 154 15 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 154 16 Trans- Trans- NNP work_rujstqwje5gkdm2bqer4drugey 154 17 late late RB work_rujstqwje5gkdm2bqer4drugey 154 18 covered cover VBN work_rujstqwje5gkdm2bqer4drugey 154 19 at at IN work_rujstqwje5gkdm2bqer4drugey 154 20 the the DT work_rujstqwje5gkdm2bqer4drugey 154 21 time time NN work_rujstqwje5gkdm2bqer4drugey 154 22 of of IN work_rujstqwje5gkdm2bqer4drugey 154 23 the the DT work_rujstqwje5gkdm2bqer4drugey 154 24 study study NN work_rujstqwje5gkdm2bqer4drugey 154 25 . . . work_rujstqwje5gkdm2bqer4drugey 155 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 155 2 mea- mea- VBP work_rujstqwje5gkdm2bqer4drugey 155 3 sured sure VBD work_rujstqwje5gkdm2bqer4drugey 155 4 the the DT work_rujstqwje5gkdm2bqer4drugey 155 5 percent percent NN work_rujstqwje5gkdm2bqer4drugey 155 6 of of IN work_rujstqwje5gkdm2bqer4drugey 155 7 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 155 8 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 155 9 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 155 10 that that WDT work_rujstqwje5gkdm2bqer4drugey 155 11 ex- ex- VBP work_rujstqwje5gkdm2bqer4drugey 155 12 actly actly RB work_rujstqwje5gkdm2bqer4drugey 155 13 matched match VBD work_rujstqwje5gkdm2bqer4drugey 155 14 the the DT work_rujstqwje5gkdm2bqer4drugey 155 15 translation translation NN work_rujstqwje5gkdm2bqer4drugey 155 16 returned return VBN work_rujstqwje5gkdm2bqer4drugey 155 17 from from IN work_rujstqwje5gkdm2bqer4drugey 155 18 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 155 19 . . . work_rujstqwje5gkdm2bqer4drugey 156 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 156 2 5a 5a NN work_rujstqwje5gkdm2bqer4drugey 156 3 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 156 4 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 156 5 between between IN work_rujstqwje5gkdm2bqer4drugey 156 6 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 156 7 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 156 8 trans- trans- JJ work_rujstqwje5gkdm2bqer4drugey 156 9 lations lation NNS work_rujstqwje5gkdm2bqer4drugey 156 10 and and CC work_rujstqwje5gkdm2bqer4drugey 156 11 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 156 12 Translate Translate NNP work_rujstqwje5gkdm2bqer4drugey 156 13 . . . work_rujstqwje5gkdm2bqer4drugey 157 1 When when WRB work_rujstqwje5gkdm2bqer4drugey 157 2 overlap overlap NNP work_rujstqwje5gkdm2bqer4drugey 157 3 is be VBZ work_rujstqwje5gkdm2bqer4drugey 157 4 high high JJ work_rujstqwje5gkdm2bqer4drugey 157 5 , , , work_rujstqwje5gkdm2bqer4drugey 157 6 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 157 7 seems seem VBZ work_rujstqwje5gkdm2bqer4drugey 157 8 likely likely JJ work_rujstqwje5gkdm2bqer4drugey 157 9 that that IN work_rujstqwje5gkdm2bqer4drugey 157 10 those those DT work_rujstqwje5gkdm2bqer4drugey 157 11 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 157 12 are be VBP work_rujstqwje5gkdm2bqer4drugey 157 13 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 157 14 . . . work_rujstqwje5gkdm2bqer4drugey 158 1 It -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 158 2 is be VBZ work_rujstqwje5gkdm2bqer4drugey 158 3 also also RB work_rujstqwje5gkdm2bqer4drugey 158 4 reasonable reasonable JJ work_rujstqwje5gkdm2bqer4drugey 158 5 to to TO work_rujstqwje5gkdm2bqer4drugey 158 6 assume assume VB work_rujstqwje5gkdm2bqer4drugey 158 7 that that IN work_rujstqwje5gkdm2bqer4drugey 158 8 honest honest JJ work_rujstqwje5gkdm2bqer4drugey 158 9 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 158 10 will will MD work_rujstqwje5gkdm2bqer4drugey 158 11 overlap overlap VB work_rujstqwje5gkdm2bqer4drugey 158 12 with with IN work_rujstqwje5gkdm2bqer4drugey 158 13 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 158 14 some some DT work_rujstqwje5gkdm2bqer4drugey 158 15 amount amount NN work_rujstqwje5gkdm2bqer4drugey 158 16 of of IN work_rujstqwje5gkdm2bqer4drugey 158 17 the the DT work_rujstqwje5gkdm2bqer4drugey 158 18 time time NN work_rujstqwje5gkdm2bqer4drugey 158 19 as as IN work_rujstqwje5gkdm2bqer4drugey 158 20 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 158 21 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 158 22 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 158 23 are be VBP work_rujstqwje5gkdm2bqer4drugey 158 24 usually usually RB work_rujstqwje5gkdm2bqer4drugey 158 25 accurate accurate JJ work_rujstqwje5gkdm2bqer4drugey 158 26 . . . work_rujstqwje5gkdm2bqer4drugey 159 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 159 2 di- di- RB work_rujstqwje5gkdm2bqer4drugey 159 3 vide vide VBP work_rujstqwje5gkdm2bqer4drugey 159 4 the the DT work_rujstqwje5gkdm2bqer4drugey 159 5 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 159 6 into into IN work_rujstqwje5gkdm2bqer4drugey 159 7 three three CD work_rujstqwje5gkdm2bqer4drugey 159 8 groups group NNS work_rujstqwje5gkdm2bqer4drugey 159 9 : : : work_rujstqwje5gkdm2bqer4drugey 159 10 those those DT work_rujstqwje5gkdm2bqer4drugey 159 11 with with IN work_rujstqwje5gkdm2bqer4drugey 159 12 very very RB work_rujstqwje5gkdm2bqer4drugey 159 13 high high JJ work_rujstqwje5gkdm2bqer4drugey 159 14 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 159 15 with with IN work_rujstqwje5gkdm2bqer4drugey 159 16 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 159 17 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 159 18 likely likely RB work_rujstqwje5gkdm2bqer4drugey 159 19 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 159 20 by by IN work_rujstqwje5gkdm2bqer4drugey 159 21 using use VBG work_rujstqwje5gkdm2bqer4drugey 159 22 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 159 23 to to TO work_rujstqwje5gkdm2bqer4drugey 159 24 translate translate VB work_rujstqwje5gkdm2bqer4drugey 159 25 words word NNS work_rujstqwje5gkdm2bqer4drugey 159 26 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 159 27 , , , work_rujstqwje5gkdm2bqer4drugey 159 28 those those DT work_rujstqwje5gkdm2bqer4drugey 159 29 with with IN work_rujstqwje5gkdm2bqer4drugey 159 30 reasonable reasonable JJ work_rujstqwje5gkdm2bqer4drugey 159 31 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 159 32 , , , work_rujstqwje5gkdm2bqer4drugey 159 33 and and CC work_rujstqwje5gkdm2bqer4drugey 159 34 those those DT work_rujstqwje5gkdm2bqer4drugey 159 35 with with IN work_rujstqwje5gkdm2bqer4drugey 159 36 no no DT work_rujstqwje5gkdm2bqer4drugey 159 37 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 159 38 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 159 39 likely likely RB work_rujstqwje5gkdm2bqer4drugey 159 40 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 159 41 by by IN work_rujstqwje5gkdm2bqer4drugey 159 42 other other JJ work_rujstqwje5gkdm2bqer4drugey 159 43 means mean NNS work_rujstqwje5gkdm2bqer4drugey 159 44 , , , work_rujstqwje5gkdm2bqer4drugey 159 45 for for IN work_rujstqwje5gkdm2bqer4drugey 159 46 instance instance NN work_rujstqwje5gkdm2bqer4drugey 159 47 , , , work_rujstqwje5gkdm2bqer4drugey 159 48 by by IN work_rujstqwje5gkdm2bqer4drugey 159 49 submitting submit VBG work_rujstqwje5gkdm2bqer4drugey 159 50 random random JJ work_rujstqwje5gkdm2bqer4drugey 159 51 text text NN work_rujstqwje5gkdm2bqer4drugey 159 52 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 159 53 . . . work_rujstqwje5gkdm2bqer4drugey 160 1 Our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 160 2 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 160 3 - - HYPH work_rujstqwje5gkdm2bqer4drugey 160 4 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 160 5 controls control NNS work_rujstqwje5gkdm2bqer4drugey 160 6 are be VBP work_rujstqwje5gkdm2bqer4drugey 160 7 designed design VBN work_rujstqwje5gkdm2bqer4drugey 160 8 to to TO work_rujstqwje5gkdm2bqer4drugey 160 9 iden- iden- VB work_rujstqwje5gkdm2bqer4drugey 160 10 tify tify JJ work_rujstqwje5gkdm2bqer4drugey 160 11 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 160 12 that that WDT work_rujstqwje5gkdm2bqer4drugey 160 13 fall fall VBP work_rujstqwje5gkdm2bqer4drugey 160 14 into into IN work_rujstqwje5gkdm2bqer4drugey 160 15 the the DT work_rujstqwje5gkdm2bqer4drugey 160 16 third third JJ work_rujstqwje5gkdm2bqer4drugey 160 17 group group NN work_rujstqwje5gkdm2bqer4drugey 160 18 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 160 19 those those DT work_rujstqwje5gkdm2bqer4drugey 160 20 who who WP work_rujstqwje5gkdm2bqer4drugey 160 21 are be VBP work_rujstqwje5gkdm2bqer4drugey 160 22 spamming spamme VBG work_rujstqwje5gkdm2bqer4drugey 160 23 or or CC work_rujstqwje5gkdm2bqer4drugey 160 24 providing provide VBG work_rujstqwje5gkdm2bqer4drugey 160 25 useless useless JJ work_rujstqwje5gkdm2bqer4drugey 160 26 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 160 27 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 160 28 , , , work_rujstqwje5gkdm2bqer4drugey 160 29 but but CC work_rujstqwje5gkdm2bqer4drugey 160 30 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 160 31 will will MD work_rujstqwje5gkdm2bqer4drugey 160 32 not not RB work_rujstqwje5gkdm2bqer4drugey 160 33 effectively effectively RB work_rujstqwje5gkdm2bqer4drugey 160 34 flag flag VB work_rujstqwje5gkdm2bqer4drugey 160 35 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 160 36 who who WP work_rujstqwje5gkdm2bqer4drugey 160 37 are be VBP work_rujstqwje5gkdm2bqer4drugey 160 38 cheat- cheat- NN work_rujstqwje5gkdm2bqer4drugey 160 39 ing e VBG work_rujstqwje5gkdm2bqer4drugey 160 40 with with IN work_rujstqwje5gkdm2bqer4drugey 160 41 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 160 42 Translate Translate NNP work_rujstqwje5gkdm2bqer4drugey 160 43 . . . work_rujstqwje5gkdm2bqer4drugey 161 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 161 2 therefore therefore RB work_rujstqwje5gkdm2bqer4drugey 161 3 remove remove VBP work_rujstqwje5gkdm2bqer4drugey 161 4 the the DT work_rujstqwje5gkdm2bqer4drugey 161 5 500 500 CD work_rujstqwje5gkdm2bqer4drugey 161 6 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 161 7 with with IN work_rujstqwje5gkdm2bqer4drugey 161 8 the the DT work_rujstqwje5gkdm2bqer4drugey 161 9 highest high JJS work_rujstqwje5gkdm2bqer4drugey 161 10 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 161 11 with with IN work_rujstqwje5gkdm2bqer4drugey 161 12 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 161 13 . . . work_rujstqwje5gkdm2bqer4drugey 162 1 This this DT work_rujstqwje5gkdm2bqer4drugey 162 2 equates equate VBZ work_rujstqwje5gkdm2bqer4drugey 162 3 to to IN work_rujstqwje5gkdm2bqer4drugey 162 4 removing remove VBG work_rujstqwje5gkdm2bqer4drugey 162 5 all all DT work_rujstqwje5gkdm2bqer4drugey 162 6 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 162 7 with with IN work_rujstqwje5gkdm2bqer4drugey 162 8 greater great JJR work_rujstqwje5gkdm2bqer4drugey 162 9 than than IN work_rujstqwje5gkdm2bqer4drugey 162 10 70 70 CD work_rujstqwje5gkdm2bqer4drugey 162 11 % % NN work_rujstqwje5gkdm2bqer4drugey 162 12 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 162 13 . . . work_rujstqwje5gkdm2bqer4drugey 163 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 163 2 5b 5b NN work_rujstqwje5gkdm2bqer4drugey 163 3 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 163 4 that that IN work_rujstqwje5gkdm2bqer4drugey 163 5 removing remove VBG work_rujstqwje5gkdm2bqer4drugey 163 6 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 163 7 at at IN work_rujstqwje5gkdm2bqer4drugey 163 8 or or CC work_rujstqwje5gkdm2bqer4drugey 163 9 above above IN work_rujstqwje5gkdm2bqer4drugey 163 10 the the DT work_rujstqwje5gkdm2bqer4drugey 163 11 70 70 CD work_rujstqwje5gkdm2bqer4drugey 163 12 % % NN work_rujstqwje5gkdm2bqer4drugey 163 13 threshold threshold NN work_rujstqwje5gkdm2bqer4drugey 163 14 retains retain VBZ work_rujstqwje5gkdm2bqer4drugey 163 15 90 90 CD work_rujstqwje5gkdm2bqer4drugey 163 16 % % NN work_rujstqwje5gkdm2bqer4drugey 163 17 of of IN work_rujstqwje5gkdm2bqer4drugey 163 18 the the DT work_rujstqwje5gkdm2bqer4drugey 163 19 collected collect VBN work_rujstqwje5gkdm2bqer4drugey 163 20 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 163 21 and and CC work_rujstqwje5gkdm2bqer4drugey 163 22 over over IN work_rujstqwje5gkdm2bqer4drugey 163 23 90 90 CD work_rujstqwje5gkdm2bqer4drugey 163 24 % % NN work_rujstqwje5gkdm2bqer4drugey 163 25 of of IN work_rujstqwje5gkdm2bqer4drugey 163 26 the the DT work_rujstqwje5gkdm2bqer4drugey 163 27 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 163 28 . . . work_rujstqwje5gkdm2bqer4drugey 164 1 Quality quality NN work_rujstqwje5gkdm2bqer4drugey 164 2 scores score NNS work_rujstqwje5gkdm2bqer4drugey 164 3 reported report VBD work_rujstqwje5gkdm2bqer4drugey 164 4 throughout throughout IN work_rujstqwje5gkdm2bqer4drugey 164 5 the the DT work_rujstqwje5gkdm2bqer4drugey 164 6 paper paper NN work_rujstqwje5gkdm2bqer4drugey 164 7 re- re- RB work_rujstqwje5gkdm2bqer4drugey 164 8 flect flect VBP work_rujstqwje5gkdm2bqer4drugey 164 9 only only JJ work_rujstqwje5gkdm2bqer4drugey 164 10 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 164 11 from from IN work_rujstqwje5gkdm2bqer4drugey 164 12 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 164 13 whose whose WP$ work_rujstqwje5gkdm2bqer4drugey 164 14 overlap overlap VBP work_rujstqwje5gkdm2bqer4drugey 164 15 with with IN work_rujstqwje5gkdm2bqer4drugey 164 16 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 164 17 falls fall VBZ work_rujstqwje5gkdm2bqer4drugey 164 18 below below IN work_rujstqwje5gkdm2bqer4drugey 164 19 this this DT work_rujstqwje5gkdm2bqer4drugey 164 20 70 70 CD work_rujstqwje5gkdm2bqer4drugey 164 21 % % NN work_rujstqwje5gkdm2bqer4drugey 164 22 threshold threshold NN work_rujstqwje5gkdm2bqer4drugey 164 23 . . . work_rujstqwje5gkdm2bqer4drugey 165 1 5 5 CD work_rujstqwje5gkdm2bqer4drugey 165 2 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 165 3 Analysis Analysis NNP work_rujstqwje5gkdm2bqer4drugey 165 4 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 165 5 performed perform VBD work_rujstqwje5gkdm2bqer4drugey 165 6 an an DT work_rujstqwje5gkdm2bqer4drugey 165 7 analysis analysis NN work_rujstqwje5gkdm2bqer4drugey 165 8 of of IN work_rujstqwje5gkdm2bqer4drugey 165 9 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 165 10 data datum NNS work_rujstqwje5gkdm2bqer4drugey 165 11 to to TO work_rujstqwje5gkdm2bqer4drugey 165 12 address address VB work_rujstqwje5gkdm2bqer4drugey 165 13 the the DT work_rujstqwje5gkdm2bqer4drugey 165 14 following follow VBG work_rujstqwje5gkdm2bqer4drugey 165 15 questions question NNS work_rujstqwje5gkdm2bqer4drugey 165 16 : : : work_rujstqwje5gkdm2bqer4drugey 165 17 • • VB work_rujstqwje5gkdm2bqer4drugey 165 18 Do do VBP work_rujstqwje5gkdm2bqer4drugey 165 19 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 165 20 accurately accurately RB work_rujstqwje5gkdm2bqer4drugey 165 21 represent represent VB work_rujstqwje5gkdm2bqer4drugey 165 22 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 165 23 language language NN work_rujstqwje5gkdm2bqer4drugey 165 24 abilities ability NNS work_rujstqwje5gkdm2bqer4drugey 165 25 ? ? . work_rujstqwje5gkdm2bqer4drugey 166 1 Should Should MD work_rujstqwje5gkdm2bqer4drugey 166 2 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 166 3 constrain constrain VB work_rujstqwje5gkdm2bqer4drugey 166 4 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 166 5 by by IN work_rujstqwje5gkdm2bqer4drugey 166 6 region region NN work_rujstqwje5gkdm2bqer4drugey 166 7 ? ? . work_rujstqwje5gkdm2bqer4drugey 167 1 • • VB work_rujstqwje5gkdm2bqer4drugey 167 2 How how WRB work_rujstqwje5gkdm2bqer4drugey 167 3 quickly quickly RB work_rujstqwje5gkdm2bqer4drugey 167 4 can can MD work_rujstqwje5gkdm2bqer4drugey 167 5 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 167 6 expect expect VB work_rujstqwje5gkdm2bqer4drugey 167 7 work work NN work_rujstqwje5gkdm2bqer4drugey 167 8 to to TO work_rujstqwje5gkdm2bqer4drugey 167 9 be be VB work_rujstqwje5gkdm2bqer4drugey 167 10 com- com- RB work_rujstqwje5gkdm2bqer4drugey 167 11 pleted plete VBN work_rujstqwje5gkdm2bqer4drugey 167 12 in in IN work_rujstqwje5gkdm2bqer4drugey 167 13 a a DT work_rujstqwje5gkdm2bqer4drugey 167 14 particular particular JJ work_rujstqwje5gkdm2bqer4drugey 167 15 language language NN work_rujstqwje5gkdm2bqer4drugey 167 16 ? ? . work_rujstqwje5gkdm2bqer4drugey 168 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 168 2 a a LS work_rujstqwje5gkdm2bqer4drugey 168 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 168 4 Individual individual JJ work_rujstqwje5gkdm2bqer4drugey 168 5 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 168 6 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 168 7 overlap overlap VBP work_rujstqwje5gkdm2bqer4drugey 168 8 with with IN work_rujstqwje5gkdm2bqer4drugey 168 9 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 168 10 Translate Translate NNP work_rujstqwje5gkdm2bqer4drugey 168 11 . . . work_rujstqwje5gkdm2bqer4drugey 169 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 169 2 removed remove VBD work_rujstqwje5gkdm2bqer4drugey 169 3 the the DT work_rujstqwje5gkdm2bqer4drugey 169 4 500 500 CD work_rujstqwje5gkdm2bqer4drugey 169 5 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 169 6 with with IN work_rujstqwje5gkdm2bqer4drugey 169 7 the the DT work_rujstqwje5gkdm2bqer4drugey 169 8 highest high JJS work_rujstqwje5gkdm2bqer4drugey 169 9 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 169 10 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 169 11 shaded shaded JJ work_rujstqwje5gkdm2bqer4drugey 169 12 region region NN work_rujstqwje5gkdm2bqer4drugey 169 13 on on IN work_rujstqwje5gkdm2bqer4drugey 169 14 the the DT work_rujstqwje5gkdm2bqer4drugey 169 15 left left NN work_rujstqwje5gkdm2bqer4drugey 169 16 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 169 17 from from IN work_rujstqwje5gkdm2bqer4drugey 169 18 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 169 19 analyses analysis NNS work_rujstqwje5gkdm2bqer4drugey 169 20 , , , work_rujstqwje5gkdm2bqer4drugey 169 21 as as IN work_rujstqwje5gkdm2bqer4drugey 169 22 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 169 23 is be VBZ work_rujstqwje5gkdm2bqer4drugey 169 24 rea- rea- RB work_rujstqwje5gkdm2bqer4drugey 169 25 sonable sonable JJ work_rujstqwje5gkdm2bqer4drugey 169 26 to to TO work_rujstqwje5gkdm2bqer4drugey 169 27 assume assume VB work_rujstqwje5gkdm2bqer4drugey 169 28 these these DT work_rujstqwje5gkdm2bqer4drugey 169 29 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 169 30 are be VBP work_rujstqwje5gkdm2bqer4drugey 169 31 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 169 32 by by IN work_rujstqwje5gkdm2bqer4drugey 169 33 submit- submit- JJ work_rujstqwje5gkdm2bqer4drugey 169 34 ting ting NN work_rujstqwje5gkdm2bqer4drugey 169 35 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 169 36 from from IN work_rujstqwje5gkdm2bqer4drugey 169 37 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 169 38 . . . work_rujstqwje5gkdm2bqer4drugey 170 1 Workers worker NNS work_rujstqwje5gkdm2bqer4drugey 170 2 with with IN work_rujstqwje5gkdm2bqer4drugey 170 3 no no DT work_rujstqwje5gkdm2bqer4drugey 170 4 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 170 5 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 170 6 shaded shaded JJ work_rujstqwje5gkdm2bqer4drugey 170 7 region region NN work_rujstqwje5gkdm2bqer4drugey 170 8 on on IN work_rujstqwje5gkdm2bqer4drugey 170 9 the the DT work_rujstqwje5gkdm2bqer4drugey 170 10 right right NN work_rujstqwje5gkdm2bqer4drugey 170 11 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 170 12 are be VBP work_rujstqwje5gkdm2bqer4drugey 170 13 also also RB work_rujstqwje5gkdm2bqer4drugey 170 14 likely likely JJ work_rujstqwje5gkdm2bqer4drugey 170 15 to to TO work_rujstqwje5gkdm2bqer4drugey 170 16 be be VB work_rujstqwje5gkdm2bqer4drugey 170 17 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 170 18 , , , work_rujstqwje5gkdm2bqer4drugey 170 19 e.g. e.g. RB work_rujstqwje5gkdm2bqer4drugey 171 1 by by IN work_rujstqwje5gkdm2bqer4drugey 171 2 submitting submit VBG work_rujstqwje5gkdm2bqer4drugey 171 3 random random JJ work_rujstqwje5gkdm2bqer4drugey 171 4 text text NN work_rujstqwje5gkdm2bqer4drugey 171 5 . . . work_rujstqwje5gkdm2bqer4drugey 172 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 172 2 b b LS work_rujstqwje5gkdm2bqer4drugey 172 3 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 172 4 Cumulative cumulative JJ work_rujstqwje5gkdm2bqer4drugey 172 5 distribution distribution NN work_rujstqwje5gkdm2bqer4drugey 172 6 of of IN work_rujstqwje5gkdm2bqer4drugey 172 7 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 172 8 with with IN work_rujstqwje5gkdm2bqer4drugey 172 9 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 172 10 trans- trans- NN work_rujstqwje5gkdm2bqer4drugey 172 11 late late RB work_rujstqwje5gkdm2bqer4drugey 172 12 for for IN work_rujstqwje5gkdm2bqer4drugey 172 13 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 172 14 and and CC work_rujstqwje5gkdm2bqer4drugey 172 15 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 172 16 . . . work_rujstqwje5gkdm2bqer4drugey 173 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 173 2 see see VBP work_rujstqwje5gkdm2bqer4drugey 173 3 that that IN work_rujstqwje5gkdm2bqer4drugey 173 4 eliminating eliminate VBG work_rujstqwje5gkdm2bqer4drugey 173 5 all all DT work_rujstqwje5gkdm2bqer4drugey 173 6 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 173 7 with with IN work_rujstqwje5gkdm2bqer4drugey 173 8 > > XX work_rujstqwje5gkdm2bqer4drugey 173 9 70 70 CD work_rujstqwje5gkdm2bqer4drugey 173 10 % % NN work_rujstqwje5gkdm2bqer4drugey 173 11 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 173 12 with with IN work_rujstqwje5gkdm2bqer4drugey 173 13 google google NNP work_rujstqwje5gkdm2bqer4drugey 173 14 translate translate NN work_rujstqwje5gkdm2bqer4drugey 173 15 still still RB work_rujstqwje5gkdm2bqer4drugey 173 16 preserves preserve VBZ work_rujstqwje5gkdm2bqer4drugey 173 17 90 90 CD work_rujstqwje5gkdm2bqer4drugey 173 18 % % NN work_rujstqwje5gkdm2bqer4drugey 173 19 of of IN work_rujstqwje5gkdm2bqer4drugey 173 20 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 173 21 and and CC work_rujstqwje5gkdm2bqer4drugey 173 22 > > XX work_rujstqwje5gkdm2bqer4drugey 173 23 90 90 CD work_rujstqwje5gkdm2bqer4drugey 173 24 % % NN work_rujstqwje5gkdm2bqer4drugey 173 25 of of IN work_rujstqwje5gkdm2bqer4drugey 173 26 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 173 27 . . . work_rujstqwje5gkdm2bqer4drugey 174 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 174 2 5 5 CD work_rujstqwje5gkdm2bqer4drugey 174 3 • • NN work_rujstqwje5gkdm2bqer4drugey 174 4 Can Can MD work_rujstqwje5gkdm2bqer4drugey 174 5 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 174 6 ’ ’ POS work_rujstqwje5gkdm2bqer4drugey 174 7 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 174 8 be be VB work_rujstqwje5gkdm2bqer4drugey 174 9 used use VBN work_rujstqwje5gkdm2bqer4drugey 174 10 to to TO work_rujstqwje5gkdm2bqer4drugey 174 11 train train VB work_rujstqwje5gkdm2bqer4drugey 174 12 MT MT NNP work_rujstqwje5gkdm2bqer4drugey 174 13 systems system NNS work_rujstqwje5gkdm2bqer4drugey 174 14 ? ? . work_rujstqwje5gkdm2bqer4drugey 175 1 • • VB work_rujstqwje5gkdm2bqer4drugey 175 2 Do do VBP work_rujstqwje5gkdm2bqer4drugey 175 3 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 175 4 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 175 5 improve improve VB work_rujstqwje5gkdm2bqer4drugey 175 6 MT MT NNP work_rujstqwje5gkdm2bqer4drugey 175 7 quality quality NN work_rujstqwje5gkdm2bqer4drugey 175 8 ? ? . work_rujstqwje5gkdm2bqer4drugey 176 1 Language language NN work_rujstqwje5gkdm2bqer4drugey 176 2 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 176 3 and and CC work_rujstqwje5gkdm2bqer4drugey 176 4 location location NN work_rujstqwje5gkdm2bqer4drugey 176 5 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 176 6 measured measure VBD work_rujstqwje5gkdm2bqer4drugey 176 7 the the DT work_rujstqwje5gkdm2bqer4drugey 176 8 average average JJ work_rujstqwje5gkdm2bqer4drugey 176 9 quality quality NN work_rujstqwje5gkdm2bqer4drugey 176 10 of of IN work_rujstqwje5gkdm2bqer4drugey 176 11 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 176 12 who who WP work_rujstqwje5gkdm2bqer4drugey 176 13 were be VBD work_rujstqwje5gkdm2bqer4drugey 176 14 in in IN work_rujstqwje5gkdm2bqer4drugey 176 15 countries country NNS work_rujstqwje5gkdm2bqer4drugey 176 16 that that WDT work_rujstqwje5gkdm2bqer4drugey 176 17 plausibly plausibly RB work_rujstqwje5gkdm2bqer4drugey 176 18 speak speak VBP work_rujstqwje5gkdm2bqer4drugey 176 19 a a DT work_rujstqwje5gkdm2bqer4drugey 176 20 language language NN work_rujstqwje5gkdm2bqer4drugey 176 21 , , , work_rujstqwje5gkdm2bqer4drugey 176 22 versus versus IN work_rujstqwje5gkdm2bqer4drugey 176 23 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 176 24 from from IN work_rujstqwje5gkdm2bqer4drugey 176 25 countries country NNS work_rujstqwje5gkdm2bqer4drugey 176 26 that that WDT work_rujstqwje5gkdm2bqer4drugey 176 27 did do VBD work_rujstqwje5gkdm2bqer4drugey 176 28 not not RB work_rujstqwje5gkdm2bqer4drugey 176 29 have have VB work_rujstqwje5gkdm2bqer4drugey 176 30 large large JJ work_rujstqwje5gkdm2bqer4drugey 176 31 speaker speaker NN work_rujstqwje5gkdm2bqer4drugey 176 32 populations population NNS work_rujstqwje5gkdm2bqer4drugey 176 33 of of IN work_rujstqwje5gkdm2bqer4drugey 176 34 that that DT work_rujstqwje5gkdm2bqer4drugey 176 35 language language NN work_rujstqwje5gkdm2bqer4drugey 176 36 . . . work_rujstqwje5gkdm2bqer4drugey 177 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 177 2 used use VBD work_rujstqwje5gkdm2bqer4drugey 177 3 the the DT work_rujstqwje5gkdm2bqer4drugey 177 4 Ethnologue Ethnologue NNP work_rujstqwje5gkdm2bqer4drugey 177 5 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 177 6 Lewis Lewis NNP work_rujstqwje5gkdm2bqer4drugey 177 7 85 85 CD work_rujstqwje5gkdm2bqer4drugey 177 8 Avg Avg NNP work_rujstqwje5gkdm2bqer4drugey 177 9 . . . work_rujstqwje5gkdm2bqer4drugey 178 1 Turker turker NN work_rujstqwje5gkdm2bqer4drugey 178 2 quality quality NN work_rujstqwje5gkdm2bqer4drugey 178 3 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 4 # # NN work_rujstqwje5gkdm2bqer4drugey 178 5 Ts Ts NNP work_rujstqwje5gkdm2bqer4drugey 178 6 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 7 Primary primary JJ work_rujstqwje5gkdm2bqer4drugey 178 8 locations location NNS work_rujstqwje5gkdm2bqer4drugey 178 9 Primary primary JJ work_rujstqwje5gkdm2bqer4drugey 178 10 locations location NNS work_rujstqwje5gkdm2bqer4drugey 178 11 In in IN work_rujstqwje5gkdm2bqer4drugey 178 12 region region NN work_rujstqwje5gkdm2bqer4drugey 178 13 Out out IN work_rujstqwje5gkdm2bqer4drugey 178 14 of of IN work_rujstqwje5gkdm2bqer4drugey 178 15 region region NN work_rujstqwje5gkdm2bqer4drugey 178 16 of of IN work_rujstqwje5gkdm2bqer4drugey 178 17 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 178 18 in in IN work_rujstqwje5gkdm2bqer4drugey 178 19 region region NN work_rujstqwje5gkdm2bqer4drugey 178 20 of of IN work_rujstqwje5gkdm2bqer4drugey 178 21 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 178 22 out out IN work_rujstqwje5gkdm2bqer4drugey 178 23 of of IN work_rujstqwje5gkdm2bqer4drugey 178 24 region region NN work_rujstqwje5gkdm2bqer4drugey 178 25 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 178 26 0.63 0.63 CD work_rujstqwje5gkdm2bqer4drugey 178 27 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 28 296 296 CD work_rujstqwje5gkdm2bqer4drugey 178 29 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 30 0.69 0.69 CD work_rujstqwje5gkdm2bqer4drugey 178 31 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 32 7 7 CD work_rujstqwje5gkdm2bqer4drugey 178 33 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 34 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 35 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 36 284 284 CD work_rujstqwje5gkdm2bqer4drugey 178 37 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 38 UAE UAE NNP work_rujstqwje5gkdm2bqer4drugey 178 39 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 40 5 5 CD work_rujstqwje5gkdm2bqer4drugey 178 41 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 42 UK UK NNP work_rujstqwje5gkdm2bqer4drugey 178 43 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 44 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 45 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 46 Saudi Saudi NNP work_rujstqwje5gkdm2bqer4drugey 178 47 Arabia Arabia NNP work_rujstqwje5gkdm2bqer4drugey 178 48 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 49 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 50 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 51 Russia Russia NNP work_rujstqwje5gkdm2bqer4drugey 178 52 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 53 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 54 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 55 Oman Oman NNP work_rujstqwje5gkdm2bqer4drugey 178 56 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 57 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 58 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 59 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 178 60 0.65 0.65 CD work_rujstqwje5gkdm2bqer4drugey 178 61 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 62 273 273 CD work_rujstqwje5gkdm2bqer4drugey 178 63 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 64 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 65 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 66 0.25 0.25 CD work_rujstqwje5gkdm2bqer4drugey 178 67 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 68 2 2 CD work_rujstqwje5gkdm2bqer4drugey 178 69 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 70 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 71 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 72 266 266 CD work_rujstqwje5gkdm2bqer4drugey 178 73 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 74 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 75 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 76 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 77 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 78 Canada Canada NNP work_rujstqwje5gkdm2bqer4drugey 178 79 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 80 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 81 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 82 Tunisia Tunisia NNP work_rujstqwje5gkdm2bqer4drugey 178 83 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 84 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 85 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 86 Egypt Egypt NNP work_rujstqwje5gkdm2bqer4drugey 178 87 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 88 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 89 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 90 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 178 91 0.76 0.76 CD work_rujstqwje5gkdm2bqer4drugey 178 92 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 93 234 234 CD work_rujstqwje5gkdm2bqer4drugey 178 94 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 95 0.83 0.83 CD work_rujstqwje5gkdm2bqer4drugey 178 96 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 97 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 98 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 99 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 100 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 101 223 223 CD work_rujstqwje5gkdm2bqer4drugey 178 102 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 103 UAE UAE NNP work_rujstqwje5gkdm2bqer4drugey 178 104 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 105 6 6 CD work_rujstqwje5gkdm2bqer4drugey 178 106 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 107 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 108 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 109 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 110 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 111 Saudi Saudi NNP work_rujstqwje5gkdm2bqer4drugey 178 112 Arabia Arabia NNP work_rujstqwje5gkdm2bqer4drugey 178 113 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 114 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 115 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 116 Maldives maldive NNS work_rujstqwje5gkdm2bqer4drugey 178 117 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 118 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 119 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 120 Spanish Spanish NNP work_rujstqwje5gkdm2bqer4drugey 178 121 0.81 0.81 CD work_rujstqwje5gkdm2bqer4drugey 178 122 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 123 191 191 CD work_rujstqwje5gkdm2bqer4drugey 178 124 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 125 0.84 0.84 CD work_rujstqwje5gkdm2bqer4drugey 178 126 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 127 18 18 CD work_rujstqwje5gkdm2bqer4drugey 178 128 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 129 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 130 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 131 122 122 CD work_rujstqwje5gkdm2bqer4drugey 178 132 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 133 Mexico Mexico NNP work_rujstqwje5gkdm2bqer4drugey 178 134 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 135 16 16 CD work_rujstqwje5gkdm2bqer4drugey 178 136 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 137 Spain Spain NNP work_rujstqwje5gkdm2bqer4drugey 178 138 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 139 14 14 CD work_rujstqwje5gkdm2bqer4drugey 178 140 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 141 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 142 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 143 15 15 CD work_rujstqwje5gkdm2bqer4drugey 178 144 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 145 New New NNP work_rujstqwje5gkdm2bqer4drugey 178 146 Zealand Zealand NNP work_rujstqwje5gkdm2bqer4drugey 178 147 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 148 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 149 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 150 Brazil Brazil NNP work_rujstqwje5gkdm2bqer4drugey 178 151 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 152 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 153 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 154 French french JJ work_rujstqwje5gkdm2bqer4drugey 178 155 0.75 0.75 CD work_rujstqwje5gkdm2bqer4drugey 178 156 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 157 170 170 CD work_rujstqwje5gkdm2bqer4drugey 178 158 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 159 0.82 0.82 CD work_rujstqwje5gkdm2bqer4drugey 178 160 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 161 11 11 CD work_rujstqwje5gkdm2bqer4drugey 178 162 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 163 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 164 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 165 62 62 CD work_rujstqwje5gkdm2bqer4drugey 178 166 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 167 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 168 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 169 45 45 CD work_rujstqwje5gkdm2bqer4drugey 178 170 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 171 France France NNP work_rujstqwje5gkdm2bqer4drugey 178 172 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 173 23 23 CD work_rujstqwje5gkdm2bqer4drugey 178 174 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 175 Greece Greece NNP work_rujstqwje5gkdm2bqer4drugey 178 176 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 177 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 178 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 179 Netherlands Netherlands NNP work_rujstqwje5gkdm2bqer4drugey 178 180 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 181 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 182 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 183 Japan Japan NNP work_rujstqwje5gkdm2bqer4drugey 178 184 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 185 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 186 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 187 Chinese chinese JJ work_rujstqwje5gkdm2bqer4drugey 178 188 0.60 0.60 CD work_rujstqwje5gkdm2bqer4drugey 178 189 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 190 116 116 CD work_rujstqwje5gkdm2bqer4drugey 178 191 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 192 0.55 0.55 CD work_rujstqwje5gkdm2bqer4drugey 178 193 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 194 21 21 CD work_rujstqwje5gkdm2bqer4drugey 178 195 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 196 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 197 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 198 75 75 CD work_rujstqwje5gkdm2bqer4drugey 178 199 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 200 Singapore Singapore NNP work_rujstqwje5gkdm2bqer4drugey 178 201 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 202 13 13 CD work_rujstqwje5gkdm2bqer4drugey 178 203 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 204 China China NNP work_rujstqwje5gkdm2bqer4drugey 178 205 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 206 9 9 CD work_rujstqwje5gkdm2bqer4drugey 178 207 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 208 Hong Hong NNP work_rujstqwje5gkdm2bqer4drugey 178 209 Kong Kong NNP work_rujstqwje5gkdm2bqer4drugey 178 210 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 211 6 6 CD work_rujstqwje5gkdm2bqer4drugey 178 212 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 213 Australia Australia NNP work_rujstqwje5gkdm2bqer4drugey 178 214 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 215 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 216 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 217 Germany Germany NNP work_rujstqwje5gkdm2bqer4drugey 178 218 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 219 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 220 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 221 German german JJ work_rujstqwje5gkdm2bqer4drugey 178 222 0.82 0.82 CD work_rujstqwje5gkdm2bqer4drugey 178 223 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 224 91 91 CD work_rujstqwje5gkdm2bqer4drugey 178 225 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 226 0.77 0.77 CD work_rujstqwje5gkdm2bqer4drugey 178 227 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 228 41 41 CD work_rujstqwje5gkdm2bqer4drugey 178 229 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 230 Germany Germany NNP work_rujstqwje5gkdm2bqer4drugey 178 231 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 232 48 48 CD work_rujstqwje5gkdm2bqer4drugey 178 233 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 234 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 235 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 236 25 25 CD work_rujstqwje5gkdm2bqer4drugey 178 237 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 238 Austria Austria NNP work_rujstqwje5gkdm2bqer4drugey 178 239 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 240 7 7 LS work_rujstqwje5gkdm2bqer4drugey 178 241 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 242 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 243 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 244 34 34 CD work_rujstqwje5gkdm2bqer4drugey 178 245 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 246 Netherlands Netherlands NNP work_rujstqwje5gkdm2bqer4drugey 178 247 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 248 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 249 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 250 Greece Greece NNP work_rujstqwje5gkdm2bqer4drugey 178 251 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 252 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 253 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 254 Italian italian JJ work_rujstqwje5gkdm2bqer4drugey 178 255 0.86 0.86 CD work_rujstqwje5gkdm2bqer4drugey 178 256 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 257 90 90 CD work_rujstqwje5gkdm2bqer4drugey 178 258 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 259 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 260 0.80 0.80 CD work_rujstqwje5gkdm2bqer4drugey 178 261 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 262 42 42 CD work_rujstqwje5gkdm2bqer4drugey 178 263 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 264 Italy Italy NNP work_rujstqwje5gkdm2bqer4drugey 178 265 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 266 42 42 CD work_rujstqwje5gkdm2bqer4drugey 178 267 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 268 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 269 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 270 29 29 CD work_rujstqwje5gkdm2bqer4drugey 178 271 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 272 Romania Romania NNP work_rujstqwje5gkdm2bqer4drugey 178 273 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 274 7 7 LS work_rujstqwje5gkdm2bqer4drugey 178 275 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 276 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 277 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 278 33 33 CD work_rujstqwje5gkdm2bqer4drugey 178 279 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 280 Ireland Ireland NNP work_rujstqwje5gkdm2bqer4drugey 178 281 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 282 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 283 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 284 Spain Spain NNP work_rujstqwje5gkdm2bqer4drugey 178 285 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 286 2 2 CD work_rujstqwje5gkdm2bqer4drugey 178 287 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 288 Amharic Amharic NNP work_rujstqwje5gkdm2bqer4drugey 178 289 0.14 0.14 CD work_rujstqwje5gkdm2bqer4drugey 178 290 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 291 16 16 CD work_rujstqwje5gkdm2bqer4drugey 178 292 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 293 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 294 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 295 0.01 0.01 CD work_rujstqwje5gkdm2bqer4drugey 178 296 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 297 99 99 CD work_rujstqwje5gkdm2bqer4drugey 178 298 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 299 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 300 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 301 14 14 CD work_rujstqwje5gkdm2bqer4drugey 178 302 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 303 Ethiopia Ethiopia NNP work_rujstqwje5gkdm2bqer4drugey 178 304 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 305 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 306 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 307 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 308 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 309 70 70 CD work_rujstqwje5gkdm2bqer4drugey 178 310 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 311 Georgia Georgia NNP work_rujstqwje5gkdm2bqer4drugey 178 312 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 313 9 9 CD work_rujstqwje5gkdm2bqer4drugey 178 314 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 315 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 316 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 317 5 5 CD work_rujstqwje5gkdm2bqer4drugey 178 318 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 319 Kannada Kannada NNP work_rujstqwje5gkdm2bqer4drugey 178 320 0.70 0.70 CD work_rujstqwje5gkdm2bqer4drugey 178 321 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 322 105 105 CD work_rujstqwje5gkdm2bqer4drugey 178 323 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 324 NA NA NNP work_rujstqwje5gkdm2bqer4drugey 178 325 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 326 0 0 NFP work_rujstqwje5gkdm2bqer4drugey 178 327 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 328 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 329 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 330 105 105 CD work_rujstqwje5gkdm2bqer4drugey 178 331 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 332 Arabic arabic JJ work_rujstqwje5gkdm2bqer4drugey 178 333 0.74 0.74 CD work_rujstqwje5gkdm2bqer4drugey 178 334 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 335 60 60 CD work_rujstqwje5gkdm2bqer4drugey 178 336 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 337 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 338 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 339 0.60 0.60 CD work_rujstqwje5gkdm2bqer4drugey 178 340 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 341 45 45 CD work_rujstqwje5gkdm2bqer4drugey 178 342 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 343 Egypt Egypt NNP work_rujstqwje5gkdm2bqer4drugey 178 344 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 345 19 19 CD work_rujstqwje5gkdm2bqer4drugey 178 346 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 347 Jordan Jordan NNP work_rujstqwje5gkdm2bqer4drugey 178 348 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 349 16 16 CD work_rujstqwje5gkdm2bqer4drugey 178 350 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 351 Morocco Morocco NNP work_rujstqwje5gkdm2bqer4drugey 178 352 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 353 9 9 CD work_rujstqwje5gkdm2bqer4drugey 178 354 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 355 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 356 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 357 19 19 CD work_rujstqwje5gkdm2bqer4drugey 178 358 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 359 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 360 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 361 11 11 CD work_rujstqwje5gkdm2bqer4drugey 178 362 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 363 Canada Canada NNP work_rujstqwje5gkdm2bqer4drugey 178 364 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 365 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 366 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 367 Sindhi Sindhi NNP work_rujstqwje5gkdm2bqer4drugey 178 368 0.19 0.19 CD work_rujstqwje5gkdm2bqer4drugey 178 369 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 370 96 96 CD work_rujstqwje5gkdm2bqer4drugey 178 371 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 372 0.06 0.06 CD work_rujstqwje5gkdm2bqer4drugey 178 373 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 374 9 9 CD work_rujstqwje5gkdm2bqer4drugey 178 375 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 376 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 377 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 378 58 58 CD work_rujstqwje5gkdm2bqer4drugey 178 379 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 380 Pakistan Pakistan NNP work_rujstqwje5gkdm2bqer4drugey 178 381 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 382 37 37 CD work_rujstqwje5gkdm2bqer4drugey 178 383 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 384 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 385 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 386 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 387 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 388 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 389 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 390 4 4 LS work_rujstqwje5gkdm2bqer4drugey 178 391 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 392 Georgia Georgia NNP work_rujstqwje5gkdm2bqer4drugey 178 393 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 394 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 395 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 396 Indonesia Indonesia NNP work_rujstqwje5gkdm2bqer4drugey 178 397 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 398 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 399 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 400 Portuguese portuguese JJ work_rujstqwje5gkdm2bqer4drugey 178 401 0.87 0.87 CD work_rujstqwje5gkdm2bqer4drugey 178 402 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 403 101 101 CD work_rujstqwje5gkdm2bqer4drugey 178 404 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 405 0.96 0.96 CD work_rujstqwje5gkdm2bqer4drugey 178 406 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 407 3 3 CD work_rujstqwje5gkdm2bqer4drugey 178 408 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 409 Brazil Brazil NNP work_rujstqwje5gkdm2bqer4drugey 178 410 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 411 44 44 CD work_rujstqwje5gkdm2bqer4drugey 178 412 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 413 Portugal Portugal NNP work_rujstqwje5gkdm2bqer4drugey 178 414 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 415 31 31 CD work_rujstqwje5gkdm2bqer4drugey 178 416 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 417 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 418 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 419 15 15 CD work_rujstqwje5gkdm2bqer4drugey 178 420 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 421 Romania Romania NNP work_rujstqwje5gkdm2bqer4drugey 178 422 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 423 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 424 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 425 Japan Japan NNP work_rujstqwje5gkdm2bqer4drugey 178 426 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 427 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 428 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 429 Israel Israel NNP work_rujstqwje5gkdm2bqer4drugey 178 430 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 431 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 432 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 433 Turkish turkish JJ work_rujstqwje5gkdm2bqer4drugey 178 434 0.76 0.76 CD work_rujstqwje5gkdm2bqer4drugey 178 435 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 436 76 76 CD work_rujstqwje5gkdm2bqer4drugey 178 437 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 438 0.80 0.80 CD work_rujstqwje5gkdm2bqer4drugey 178 439 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 440 27 27 CD work_rujstqwje5gkdm2bqer4drugey 178 441 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 442 Turkey Turkey NNP work_rujstqwje5gkdm2bqer4drugey 178 443 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 444 38 38 CD work_rujstqwje5gkdm2bqer4drugey 178 445 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 446 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 447 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 448 18 18 CD work_rujstqwje5gkdm2bqer4drugey 178 449 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 450 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 451 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 452 8) 8) CD work_rujstqwje5gkdm2bqer4drugey 178 453 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 454 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 455 19 19 CD work_rujstqwje5gkdm2bqer4drugey 178 456 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 457 Pakistan Pakistan NNP work_rujstqwje5gkdm2bqer4drugey 178 458 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 459 4 4 LS work_rujstqwje5gkdm2bqer4drugey 178 460 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 461 Taiwan Taiwan NNP work_rujstqwje5gkdm2bqer4drugey 178 462 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 463 1 1 CD work_rujstqwje5gkdm2bqer4drugey 178 464 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 465 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 178 466 0.80 0.80 CD work_rujstqwje5gkdm2bqer4drugey 178 467 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 468 102 102 CD work_rujstqwje5gkdm2bqer4drugey 178 469 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 470 0.50 0.50 CD work_rujstqwje5gkdm2bqer4drugey 178 471 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 472 1 1 CD work_rujstqwje5gkdm2bqer4drugey 178 473 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 474 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 475 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 476 98 98 CD work_rujstqwje5gkdm2bqer4drugey 178 477 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 478 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 479 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 480 3 3 CD work_rujstqwje5gkdm2bqer4drugey 178 481 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 482 UAE UAE NNP work_rujstqwje5gkdm2bqer4drugey 178 483 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 484 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 485 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 486 Saudi Saudi NNP work_rujstqwje5gkdm2bqer4drugey 178 487 Arabia Arabia NNP work_rujstqwje5gkdm2bqer4drugey 178 488 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 489 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 490 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 491 Irish irish JJ work_rujstqwje5gkdm2bqer4drugey 178 492 0.74 0.74 CD work_rujstqwje5gkdm2bqer4drugey 178 493 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 494 54 54 CD work_rujstqwje5gkdm2bqer4drugey 178 495 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 496 0.71 0.71 CD work_rujstqwje5gkdm2bqer4drugey 178 497 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 498 47 47 CD work_rujstqwje5gkdm2bqer4drugey 178 499 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 500 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 501 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 502 39 39 CD work_rujstqwje5gkdm2bqer4drugey 178 503 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 504 Ireland Ireland NNP work_rujstqwje5gkdm2bqer4drugey 178 505 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 506 13 13 CD work_rujstqwje5gkdm2bqer4drugey 178 507 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 508 UK UK NNP work_rujstqwje5gkdm2bqer4drugey 178 509 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 510 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 511 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 512 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 513 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 514 36 36 CD work_rujstqwje5gkdm2bqer4drugey 178 515 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 516 Romania Romania NNP work_rujstqwje5gkdm2bqer4drugey 178 517 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 518 5 5 CD work_rujstqwje5gkdm2bqer4drugey 178 519 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 520 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 521 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 522 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 523 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 524 Swedish swedish JJ work_rujstqwje5gkdm2bqer4drugey 178 525 0.73 0.73 CD work_rujstqwje5gkdm2bqer4drugey 178 526 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 527 54 54 CD work_rujstqwje5gkdm2bqer4drugey 178 528 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 529 0.71 0.71 CD work_rujstqwje5gkdm2bqer4drugey 178 530 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 531 45 45 CD work_rujstqwje5gkdm2bqer4drugey 178 532 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 533 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 534 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 535 25 25 CD work_rujstqwje5gkdm2bqer4drugey 178 536 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 537 Sweden Sweden NNP work_rujstqwje5gkdm2bqer4drugey 178 538 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 539 22 22 CD work_rujstqwje5gkdm2bqer4drugey 178 540 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 541 Finland finland NN work_rujstqwje5gkdm2bqer4drugey 178 542 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 543 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 544 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 545 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 546 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 547 23 23 CD work_rujstqwje5gkdm2bqer4drugey 178 548 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 549 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 550 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 551 6 6 CD work_rujstqwje5gkdm2bqer4drugey 178 552 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 553 Croatia Croatia NNP work_rujstqwje5gkdm2bqer4drugey 178 554 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 555 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 556 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 557 Czech czech JJ work_rujstqwje5gkdm2bqer4drugey 178 558 0.71 0.71 CD work_rujstqwje5gkdm2bqer4drugey 178 559 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 560 45 45 CD work_rujstqwje5gkdm2bqer4drugey 178 561 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 562 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 563 0.61 0.61 CD work_rujstqwje5gkdm2bqer4drugey 178 564 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 565 50 50 CD work_rujstqwje5gkdm2bqer4drugey 178 566 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 567 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 568 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 569 17 17 CD work_rujstqwje5gkdm2bqer4drugey 178 570 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 571 Czech Czech NNP work_rujstqwje5gkdm2bqer4drugey 178 572 Republic Republic NNP work_rujstqwje5gkdm2bqer4drugey 178 573 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 574 14 14 CD work_rujstqwje5gkdm2bqer4drugey 178 575 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 576 Serbia Serbia NNP work_rujstqwje5gkdm2bqer4drugey 178 577 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 578 5 5 CD work_rujstqwje5gkdm2bqer4drugey 178 579 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 580 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 581 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 582 22 22 CD work_rujstqwje5gkdm2bqer4drugey 178 583 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 584 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 585 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 586 10 10 CD work_rujstqwje5gkdm2bqer4drugey 178 587 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 588 UK UK NNP work_rujstqwje5gkdm2bqer4drugey 178 589 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 590 5 5 LS work_rujstqwje5gkdm2bqer4drugey 178 591 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 592 Russian Russian NNP work_rujstqwje5gkdm2bqer4drugey 178 593 0.15 0.15 CD work_rujstqwje5gkdm2bqer4drugey 178 594 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 595 67 67 CD work_rujstqwje5gkdm2bqer4drugey 178 596 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 597 * * NFP work_rujstqwje5gkdm2bqer4drugey 178 598 0.12 0.12 CD work_rujstqwje5gkdm2bqer4drugey 178 599 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 600 27 27 CD work_rujstqwje5gkdm2bqer4drugey 178 601 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 602 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 603 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 604 36 36 CD work_rujstqwje5gkdm2bqer4drugey 178 605 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 606 Moldova Moldova NNP work_rujstqwje5gkdm2bqer4drugey 178 607 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 608 7 7 LS work_rujstqwje5gkdm2bqer4drugey 178 609 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 610 Russia Russia NNP work_rujstqwje5gkdm2bqer4drugey 178 611 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 612 6 6 CD work_rujstqwje5gkdm2bqer4drugey 178 613 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 614 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 615 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 616 14 14 CD work_rujstqwje5gkdm2bqer4drugey 178 617 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 618 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 619 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 620 4 4 LS work_rujstqwje5gkdm2bqer4drugey 178 621 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 622 UK UK NNP work_rujstqwje5gkdm2bqer4drugey 178 623 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 624 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 625 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 626 Breton Breton NNP work_rujstqwje5gkdm2bqer4drugey 178 627 0.17 0.17 CD work_rujstqwje5gkdm2bqer4drugey 178 628 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 629 3 3 CD work_rujstqwje5gkdm2bqer4drugey 178 630 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 631 0.18 0.18 CD work_rujstqwje5gkdm2bqer4drugey 178 632 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 633 89 89 CD work_rujstqwje5gkdm2bqer4drugey 178 634 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 635 US US NNP work_rujstqwje5gkdm2bqer4drugey 178 636 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 637 3 3 LS work_rujstqwje5gkdm2bqer4drugey 178 638 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 639 India India NNP work_rujstqwje5gkdm2bqer4drugey 178 640 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 641 83 83 CD work_rujstqwje5gkdm2bqer4drugey 178 642 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 643 Macedonia Macedonia NNP work_rujstqwje5gkdm2bqer4drugey 178 644 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 645 2 2 LS work_rujstqwje5gkdm2bqer4drugey 178 646 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 647 China China NNP work_rujstqwje5gkdm2bqer4drugey 178 648 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 178 649 1 1 LS work_rujstqwje5gkdm2bqer4drugey 178 650 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 178 651 Table table NN work_rujstqwje5gkdm2bqer4drugey 178 652 3 3 CD work_rujstqwje5gkdm2bqer4drugey 178 653 : : : work_rujstqwje5gkdm2bqer4drugey 178 654 Translation translation NN work_rujstqwje5gkdm2bqer4drugey 178 655 quality quality NN work_rujstqwje5gkdm2bqer4drugey 178 656 when when WRB work_rujstqwje5gkdm2bqer4drugey 178 657 partitioning partition VBG work_rujstqwje5gkdm2bqer4drugey 178 658 the the DT work_rujstqwje5gkdm2bqer4drugey 178 659 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 178 660 into into IN work_rujstqwje5gkdm2bqer4drugey 178 661 two two CD work_rujstqwje5gkdm2bqer4drugey 178 662 groups group NNS work_rujstqwje5gkdm2bqer4drugey 178 663 , , , work_rujstqwje5gkdm2bqer4drugey 178 664 one one CD work_rujstqwje5gkdm2bqer4drugey 178 665 containing contain VBG work_rujstqwje5gkdm2bqer4drugey 178 666 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 178 667 submitted submit VBN work_rujstqwje5gkdm2bqer4drugey 178 668 by by IN work_rujstqwje5gkdm2bqer4drugey 178 669 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 178 670 whose whose WP$ work_rujstqwje5gkdm2bqer4drugey 178 671 location location NN work_rujstqwje5gkdm2bqer4drugey 178 672 is be VBZ work_rujstqwje5gkdm2bqer4drugey 178 673 within within IN work_rujstqwje5gkdm2bqer4drugey 178 674 regions region NNS work_rujstqwje5gkdm2bqer4drugey 178 675 that that WDT work_rujstqwje5gkdm2bqer4drugey 178 676 plausibly plausibly RB work_rujstqwje5gkdm2bqer4drugey 178 677 speak speak VBP work_rujstqwje5gkdm2bqer4drugey 178 678 the the DT work_rujstqwje5gkdm2bqer4drugey 178 679 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 178 680 language language NN work_rujstqwje5gkdm2bqer4drugey 178 681 , , , work_rujstqwje5gkdm2bqer4drugey 178 682 and and CC work_rujstqwje5gkdm2bqer4drugey 178 683 the the DT work_rujstqwje5gkdm2bqer4drugey 178 684 other other JJ work_rujstqwje5gkdm2bqer4drugey 178 685 containing contain VBG work_rujstqwje5gkdm2bqer4drugey 178 686 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 178 687 from from IN work_rujstqwje5gkdm2bqer4drugey 178 688 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 178 689 outside outside IN work_rujstqwje5gkdm2bqer4drugey 178 690 those those DT work_rujstqwje5gkdm2bqer4drugey 178 691 regions region NNS work_rujstqwje5gkdm2bqer4drugey 178 692 . . . work_rujstqwje5gkdm2bqer4drugey 179 1 In in IN work_rujstqwje5gkdm2bqer4drugey 179 2 general general JJ work_rujstqwje5gkdm2bqer4drugey 179 3 , , , work_rujstqwje5gkdm2bqer4drugey 179 4 in in IN work_rujstqwje5gkdm2bqer4drugey 179 5 - - HYPH work_rujstqwje5gkdm2bqer4drugey 179 6 region region NN work_rujstqwje5gkdm2bqer4drugey 179 7 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 179 8 provide provide VBP work_rujstqwje5gkdm2bqer4drugey 179 9 higher high JJR work_rujstqwje5gkdm2bqer4drugey 179 10 quality quality NN work_rujstqwje5gkdm2bqer4drugey 179 11 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 179 12 . . . work_rujstqwje5gkdm2bqer4drugey 180 1 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 180 2 * * NFP work_rujstqwje5gkdm2bqer4drugey 180 3 * * NFP work_rujstqwje5gkdm2bqer4drugey 180 4 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 180 5 indicates indicate VBZ work_rujstqwje5gkdm2bqer4drugey 180 6 differences difference NNS work_rujstqwje5gkdm2bqer4drugey 180 7 significant significant JJ work_rujstqwje5gkdm2bqer4drugey 180 8 at at IN work_rujstqwje5gkdm2bqer4drugey 180 9 p=0.05 p=0.05 NNP work_rujstqwje5gkdm2bqer4drugey 180 10 , , , work_rujstqwje5gkdm2bqer4drugey 180 11 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 180 12 * * NFP work_rujstqwje5gkdm2bqer4drugey 180 13 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 180 14 at at IN work_rujstqwje5gkdm2bqer4drugey 180 15 p=0.10 p=0.10 NNP work_rujstqwje5gkdm2bqer4drugey 180 16 . . . work_rujstqwje5gkdm2bqer4drugey 181 1 et et NNP work_rujstqwje5gkdm2bqer4drugey 181 2 al al NNP work_rujstqwje5gkdm2bqer4drugey 181 3 . . NNP work_rujstqwje5gkdm2bqer4drugey 181 4 , , , work_rujstqwje5gkdm2bqer4drugey 181 5 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 181 6 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 181 7 to to TO work_rujstqwje5gkdm2bqer4drugey 181 8 compile compile VB work_rujstqwje5gkdm2bqer4drugey 181 9 the the DT work_rujstqwje5gkdm2bqer4drugey 181 10 list list NN work_rujstqwje5gkdm2bqer4drugey 181 11 of of IN work_rujstqwje5gkdm2bqer4drugey 181 12 countries country NNS work_rujstqwje5gkdm2bqer4drugey 181 13 where where WRB work_rujstqwje5gkdm2bqer4drugey 181 14 each each DT work_rujstqwje5gkdm2bqer4drugey 181 15 language language NN work_rujstqwje5gkdm2bqer4drugey 181 16 is be VBZ work_rujstqwje5gkdm2bqer4drugey 181 17 spoken speak VBN work_rujstqwje5gkdm2bqer4drugey 181 18 . . . work_rujstqwje5gkdm2bqer4drugey 182 1 Table table NN work_rujstqwje5gkdm2bqer4drugey 182 2 3 3 CD work_rujstqwje5gkdm2bqer4drugey 182 3 compares compare VBZ work_rujstqwje5gkdm2bqer4drugey 182 4 the the DT work_rujstqwje5gkdm2bqer4drugey 182 5 av- av- JJ work_rujstqwje5gkdm2bqer4drugey 182 6 erage erage NN work_rujstqwje5gkdm2bqer4drugey 182 7 translation translation NN work_rujstqwje5gkdm2bqer4drugey 182 8 quality quality NN work_rujstqwje5gkdm2bqer4drugey 182 9 of of IN work_rujstqwje5gkdm2bqer4drugey 182 10 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 182 11 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 182 12 within within IN work_rujstqwje5gkdm2bqer4drugey 182 13 the the DT work_rujstqwje5gkdm2bqer4drugey 182 14 region region NN work_rujstqwje5gkdm2bqer4drugey 182 15 of of IN work_rujstqwje5gkdm2bqer4drugey 182 16 each each DT work_rujstqwje5gkdm2bqer4drugey 182 17 language language NN work_rujstqwje5gkdm2bqer4drugey 182 18 , , , work_rujstqwje5gkdm2bqer4drugey 182 19 and and CC work_rujstqwje5gkdm2bqer4drugey 182 20 compares compare VBZ work_rujstqwje5gkdm2bqer4drugey 182 21 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 182 22 to to IN work_rujstqwje5gkdm2bqer4drugey 182 23 the the DT work_rujstqwje5gkdm2bqer4drugey 182 24 quality quality NN work_rujstqwje5gkdm2bqer4drugey 182 25 of of IN work_rujstqwje5gkdm2bqer4drugey 182 26 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 182 27 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 182 28 outside outside IN work_rujstqwje5gkdm2bqer4drugey 182 29 that that DT work_rujstqwje5gkdm2bqer4drugey 182 30 region region NN work_rujstqwje5gkdm2bqer4drugey 182 31 . . . work_rujstqwje5gkdm2bqer4drugey 183 1 Our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 183 2 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 183 3 reported report VBD work_rujstqwje5gkdm2bqer4drugey 183 4 speaking speak VBG work_rujstqwje5gkdm2bqer4drugey 183 5 95 95 CD work_rujstqwje5gkdm2bqer4drugey 183 6 languages language NNS work_rujstqwje5gkdm2bqer4drugey 183 7 na- na- VBP work_rujstqwje5gkdm2bqer4drugey 183 8 tively tively RB work_rujstqwje5gkdm2bqer4drugey 183 9 . . . work_rujstqwje5gkdm2bqer4drugey 184 1 US US NNP work_rujstqwje5gkdm2bqer4drugey 184 2 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 184 3 alone alone RB work_rujstqwje5gkdm2bqer4drugey 184 4 reported report VBD work_rujstqwje5gkdm2bqer4drugey 184 5 61 61 CD work_rujstqwje5gkdm2bqer4drugey 184 6 native native JJ work_rujstqwje5gkdm2bqer4drugey 184 7 lan- lan- NN work_rujstqwje5gkdm2bqer4drugey 184 8 guages guage NNS work_rujstqwje5gkdm2bqer4drugey 184 9 . . . work_rujstqwje5gkdm2bqer4drugey 185 1 Overall overall RB work_rujstqwje5gkdm2bqer4drugey 185 2 , , , work_rujstqwje5gkdm2bqer4drugey 185 3 4,297 4,297 CD work_rujstqwje5gkdm2bqer4drugey 185 4 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 185 5 were be VBD work_rujstqwje5gkdm2bqer4drugey 185 6 located locate VBN work_rujstqwje5gkdm2bqer4drugey 185 7 in in IN work_rujstqwje5gkdm2bqer4drugey 185 8 a a DT work_rujstqwje5gkdm2bqer4drugey 185 9 region region NN work_rujstqwje5gkdm2bqer4drugey 185 10 likely likely JJ work_rujstqwje5gkdm2bqer4drugey 185 11 to to TO work_rujstqwje5gkdm2bqer4drugey 185 12 speak speak VB work_rujstqwje5gkdm2bqer4drugey 185 13 the the DT work_rujstqwje5gkdm2bqer4drugey 185 14 language language NN work_rujstqwje5gkdm2bqer4drugey 185 15 from from IN work_rujstqwje5gkdm2bqer4drugey 185 16 which which WDT work_rujstqwje5gkdm2bqer4drugey 185 17 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 185 18 were be VBD work_rujstqwje5gkdm2bqer4drugey 185 19 translating translate VBG work_rujstqwje5gkdm2bqer4drugey 185 20 , , , work_rujstqwje5gkdm2bqer4drugey 185 21 and and CC work_rujstqwje5gkdm2bqer4drugey 185 22 2,778 2,778 CD work_rujstqwje5gkdm2bqer4drugey 185 23 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 185 24 were be VBD work_rujstqwje5gkdm2bqer4drugey 185 25 located locate VBN work_rujstqwje5gkdm2bqer4drugey 185 26 in in IN work_rujstqwje5gkdm2bqer4drugey 185 27 countries country NNS work_rujstqwje5gkdm2bqer4drugey 185 28 considered consider VBN work_rujstqwje5gkdm2bqer4drugey 185 29 out out IN work_rujstqwje5gkdm2bqer4drugey 185 30 of of IN work_rujstqwje5gkdm2bqer4drugey 185 31 region region NN work_rujstqwje5gkdm2bqer4drugey 185 32 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 185 33 meaning mean VBG work_rujstqwje5gkdm2bqer4drugey 185 34 that that IN work_rujstqwje5gkdm2bqer4drugey 185 35 about about IN work_rujstqwje5gkdm2bqer4drugey 185 36 a a DT work_rujstqwje5gkdm2bqer4drugey 185 37 third third NN work_rujstqwje5gkdm2bqer4drugey 185 38 of of IN work_rujstqwje5gkdm2bqer4drugey 185 39 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 185 40 5,281 5,281 CD work_rujstqwje5gkdm2bqer4drugey 185 41 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 185 42 completed complete VBD work_rujstqwje5gkdm2bqer4drugey 185 43 HITs hit NNS work_rujstqwje5gkdm2bqer4drugey 185 44 in in IN work_rujstqwje5gkdm2bqer4drugey 185 45 multiple multiple JJ work_rujstqwje5gkdm2bqer4drugey 185 46 languages language NNS work_rujstqwje5gkdm2bqer4drugey 185 47 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 185 48 . . . work_rujstqwje5gkdm2bqer4drugey 186 1 Table table NN work_rujstqwje5gkdm2bqer4drugey 186 2 3 3 CD work_rujstqwje5gkdm2bqer4drugey 186 3 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 186 4 the the DT work_rujstqwje5gkdm2bqer4drugey 186 5 differences difference NNS work_rujstqwje5gkdm2bqer4drugey 186 6 in in IN work_rujstqwje5gkdm2bqer4drugey 186 7 translation translation NN work_rujstqwje5gkdm2bqer4drugey 186 8 qual- qual- NN work_rujstqwje5gkdm2bqer4drugey 186 9 ity ity NN work_rujstqwje5gkdm2bqer4drugey 186 10 when when WRB work_rujstqwje5gkdm2bqer4drugey 186 11 computed compute VBN work_rujstqwje5gkdm2bqer4drugey 186 12 using use VBG work_rujstqwje5gkdm2bqer4drugey 186 13 in in IN work_rujstqwje5gkdm2bqer4drugey 186 14 - - HYPH work_rujstqwje5gkdm2bqer4drugey 186 15 region region NN work_rujstqwje5gkdm2bqer4drugey 186 16 versus versus IN work_rujstqwje5gkdm2bqer4drugey 186 17 out out RB work_rujstqwje5gkdm2bqer4drugey 186 18 - - HYPH work_rujstqwje5gkdm2bqer4drugey 186 19 of- of- CD work_rujstqwje5gkdm2bqer4drugey 186 20 region region NN work_rujstqwje5gkdm2bqer4drugey 186 21 Turkers Turkers NNP work_rujstqwje5gkdm2bqer4drugey 186 22 , , , work_rujstqwje5gkdm2bqer4drugey 186 23 for for IN work_rujstqwje5gkdm2bqer4drugey 186 24 the the DT work_rujstqwje5gkdm2bqer4drugey 186 25 languages language NNS work_rujstqwje5gkdm2bqer4drugey 186 26 with with IN work_rujstqwje5gkdm2bqer4drugey 186 27 the the DT work_rujstqwje5gkdm2bqer4drugey 186 28 greatest great JJS work_rujstqwje5gkdm2bqer4drugey 186 29 number number NN work_rujstqwje5gkdm2bqer4drugey 186 30 of of IN work_rujstqwje5gkdm2bqer4drugey 186 31 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 186 32 . . . work_rujstqwje5gkdm2bqer4drugey 187 1 Within within IN work_rujstqwje5gkdm2bqer4drugey 187 2 region region NN work_rujstqwje5gkdm2bqer4drugey 187 3 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 187 4 typi- typi- VBP work_rujstqwje5gkdm2bqer4drugey 187 5 cally cally RB work_rujstqwje5gkdm2bqer4drugey 187 6 produced produce VBD work_rujstqwje5gkdm2bqer4drugey 187 7 higher high JJR work_rujstqwje5gkdm2bqer4drugey 187 8 quality quality NN work_rujstqwje5gkdm2bqer4drugey 187 9 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 187 10 . . . work_rujstqwje5gkdm2bqer4drugey 188 1 Given give VBN work_rujstqwje5gkdm2bqer4drugey 188 2 the the DT work_rujstqwje5gkdm2bqer4drugey 188 3 number number NN work_rujstqwje5gkdm2bqer4drugey 188 4 of of IN work_rujstqwje5gkdm2bqer4drugey 188 5 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 188 6 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 188 7 on on IN work_rujstqwje5gkdm2bqer4drugey 188 8 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 188 9 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 188 10 , , , work_rujstqwje5gkdm2bqer4drugey 188 11 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 188 12 is be VBZ work_rujstqwje5gkdm2bqer4drugey 188 13 unsurprising unsurprise VBG work_rujstqwje5gkdm2bqer4drugey 188 14 that that WDT work_rujstqwje5gkdm2bqer4drugey 188 15 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 188 16 represent represent VBP work_rujstqwje5gkdm2bqer4drugey 188 17 majority majority NN work_rujstqwje5gkdm2bqer4drugey 188 18 of of IN work_rujstqwje5gkdm2bqer4drugey 188 19 out- out- IN work_rujstqwje5gkdm2bqer4drugey 188 20 of of IN work_rujstqwje5gkdm2bqer4drugey 188 21 - - HYPH work_rujstqwje5gkdm2bqer4drugey 188 22 region region NN work_rujstqwje5gkdm2bqer4drugey 188 23 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 188 24 . . . work_rujstqwje5gkdm2bqer4drugey 189 1 For for IN work_rujstqwje5gkdm2bqer4drugey 189 2 the the DT work_rujstqwje5gkdm2bqer4drugey 189 3 languages language NNS work_rujstqwje5gkdm2bqer4drugey 189 4 that that WDT work_rujstqwje5gkdm2bqer4drugey 189 5 had have VBD work_rujstqwje5gkdm2bqer4drugey 189 6 more more JJR work_rujstqwje5gkdm2bqer4drugey 189 7 than than IN work_rujstqwje5gkdm2bqer4drugey 189 8 75 75 CD work_rujstqwje5gkdm2bqer4drugey 189 9 out out IN work_rujstqwje5gkdm2bqer4drugey 189 10 of of IN work_rujstqwje5gkdm2bqer4drugey 189 11 region region NN work_rujstqwje5gkdm2bqer4drugey 189 12 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 189 13 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 189 14 Malay Malay NNP work_rujstqwje5gkdm2bqer4drugey 189 15 , , , work_rujstqwje5gkdm2bqer4drugey 189 16 Amharic Amharic NNP work_rujstqwje5gkdm2bqer4drugey 189 17 , , , work_rujstqwje5gkdm2bqer4drugey 189 18 Ice- Ice- NNP work_rujstqwje5gkdm2bqer4drugey 189 19 landic landic NN work_rujstqwje5gkdm2bqer4drugey 189 20 , , , work_rujstqwje5gkdm2bqer4drugey 189 21 Sicilian Sicilian NNP work_rujstqwje5gkdm2bqer4drugey 189 22 , , , work_rujstqwje5gkdm2bqer4drugey 189 23 Wolof Wolof NNP work_rujstqwje5gkdm2bqer4drugey 189 24 , , , work_rujstqwje5gkdm2bqer4drugey 189 25 and and CC work_rujstqwje5gkdm2bqer4drugey 189 26 Breton Breton NNP work_rujstqwje5gkdm2bqer4drugey 189 27 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 189 28 , , , work_rujstqwje5gkdm2bqer4drugey 189 29 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 189 30 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 189 31 represented represent VBD work_rujstqwje5gkdm2bqer4drugey 189 32 at at RB work_rujstqwje5gkdm2bqer4drugey 189 33 least least RBS work_rujstqwje5gkdm2bqer4drugey 189 34 70 70 CD work_rujstqwje5gkdm2bqer4drugey 189 35 % % NN work_rujstqwje5gkdm2bqer4drugey 189 36 of of IN work_rujstqwje5gkdm2bqer4drugey 189 37 the the DT work_rujstqwje5gkdm2bqer4drugey 189 38 out out NN work_rujstqwje5gkdm2bqer4drugey 189 39 of of IN work_rujstqwje5gkdm2bqer4drugey 189 40 region region NN work_rujstqwje5gkdm2bqer4drugey 189 41 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 189 42 in in IN work_rujstqwje5gkdm2bqer4drugey 189 43 each each DT work_rujstqwje5gkdm2bqer4drugey 189 44 language language NN work_rujstqwje5gkdm2bqer4drugey 189 45 . . . work_rujstqwje5gkdm2bqer4drugey 190 1 A a DT work_rujstqwje5gkdm2bqer4drugey 190 2 few few JJ work_rujstqwje5gkdm2bqer4drugey 190 3 languages language NNS work_rujstqwje5gkdm2bqer4drugey 190 4 stand stand VBP work_rujstqwje5gkdm2bqer4drugey 190 5 out out RP work_rujstqwje5gkdm2bqer4drugey 190 6 for for IN work_rujstqwje5gkdm2bqer4drugey 190 7 having have VBG work_rujstqwje5gkdm2bqer4drugey 190 8 suspiciously suspiciously RB work_rujstqwje5gkdm2bqer4drugey 190 9 strong strong JJ work_rujstqwje5gkdm2bqer4drugey 190 10 performance performance NN work_rujstqwje5gkdm2bqer4drugey 190 11 by by IN work_rujstqwje5gkdm2bqer4drugey 190 12 out out IN work_rujstqwje5gkdm2bqer4drugey 190 13 of of IN work_rujstqwje5gkdm2bqer4drugey 190 14 region region NN work_rujstqwje5gkdm2bqer4drugey 190 15 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 190 16 , , , work_rujstqwje5gkdm2bqer4drugey 190 17 no- no- XX work_rujstqwje5gkdm2bqer4drugey 190 18 tably tably RB work_rujstqwje5gkdm2bqer4drugey 190 19 Irish irish JJ work_rujstqwje5gkdm2bqer4drugey 190 20 and and CC work_rujstqwje5gkdm2bqer4drugey 190 21 Swedish swedish JJ work_rujstqwje5gkdm2bqer4drugey 190 22 , , , work_rujstqwje5gkdm2bqer4drugey 190 23 for for IN work_rujstqwje5gkdm2bqer4drugey 190 24 which which WDT work_rujstqwje5gkdm2bqer4drugey 190 25 out out IN work_rujstqwje5gkdm2bqer4drugey 190 26 of of IN work_rujstqwje5gkdm2bqer4drugey 190 27 region region NN work_rujstqwje5gkdm2bqer4drugey 190 28 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 190 29 account account VBP work_rujstqwje5gkdm2bqer4drugey 190 30 for for IN work_rujstqwje5gkdm2bqer4drugey 190 31 a a DT work_rujstqwje5gkdm2bqer4drugey 190 32 near near JJ work_rujstqwje5gkdm2bqer4drugey 190 33 equivalent equivalent JJ work_rujstqwje5gkdm2bqer4drugey 190 34 volume volume NN work_rujstqwje5gkdm2bqer4drugey 190 35 and and CC work_rujstqwje5gkdm2bqer4drugey 190 36 quality quality NN work_rujstqwje5gkdm2bqer4drugey 190 37 of of IN work_rujstqwje5gkdm2bqer4drugey 190 38 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 190 39 to to IN work_rujstqwje5gkdm2bqer4drugey 190 40 the the DT work_rujstqwje5gkdm2bqer4drugey 190 41 in in IN work_rujstqwje5gkdm2bqer4drugey 190 42 region region NN work_rujstqwje5gkdm2bqer4drugey 190 43 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 190 44 . . . work_rujstqwje5gkdm2bqer4drugey 191 1 This this DT work_rujstqwje5gkdm2bqer4drugey 191 2 is be VBZ work_rujstqwje5gkdm2bqer4drugey 191 3 admittedly admittedly RB work_rujstqwje5gkdm2bqer4drugey 191 4 implausible implausible JJ work_rujstqwje5gkdm2bqer4drugey 191 5 , , , work_rujstqwje5gkdm2bqer4drugey 191 6 considering consider VBG work_rujstqwje5gkdm2bqer4drugey 191 7 the the DT work_rujstqwje5gkdm2bqer4drugey 191 8 relatively relatively RB work_rujstqwje5gkdm2bqer4drugey 191 9 small small JJ work_rujstqwje5gkdm2bqer4drugey 191 10 number number NN work_rujstqwje5gkdm2bqer4drugey 191 11 of of IN work_rujstqwje5gkdm2bqer4drugey 191 12 Irish irish JJ work_rujstqwje5gkdm2bqer4drugey 191 13 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 191 14 worldwide worldwide RB work_rujstqwje5gkdm2bqer4drugey 191 15 , , , work_rujstqwje5gkdm2bqer4drugey 191 16 and and CC work_rujstqwje5gkdm2bqer4drugey 191 17 the the DT work_rujstqwje5gkdm2bqer4drugey 191 18 very very RB work_rujstqwje5gkdm2bqer4drugey 191 19 low low JJ work_rujstqwje5gkdm2bqer4drugey 191 20 number number NN work_rujstqwje5gkdm2bqer4drugey 191 21 living live VBG work_rujstqwje5gkdm2bqer4drugey 191 22 in in IN work_rujstqwje5gkdm2bqer4drugey 191 23 the the DT work_rujstqwje5gkdm2bqer4drugey 191 24 countries country NNS work_rujstqwje5gkdm2bqer4drugey 191 25 in in IN work_rujstqwje5gkdm2bqer4drugey 191 26 which which WDT work_rujstqwje5gkdm2bqer4drugey 191 27 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 191 28 Turkers turker NNS work_rujstqwje5gkdm2bqer4drugey 191 29 were be VBD work_rujstqwje5gkdm2bqer4drugey 191 30 based base VBN work_rujstqwje5gkdm2bqer4drugey 191 31 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 191 32 primarily primarily RB work_rujstqwje5gkdm2bqer4drugey 191 33 India India NNP work_rujstqwje5gkdm2bqer4drugey 191 34 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 191 35 . . . work_rujstqwje5gkdm2bqer4drugey 192 1 Such such JJ work_rujstqwje5gkdm2bqer4drugey 192 2 results result NNS work_rujstqwje5gkdm2bqer4drugey 192 3 highlight highlight VBP work_rujstqwje5gkdm2bqer4drugey 192 4 the the DT work_rujstqwje5gkdm2bqer4drugey 192 5 fact fact NN work_rujstqwje5gkdm2bqer4drugey 192 6 that that IN work_rujstqwje5gkdm2bqer4drugey 192 7 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 192 8 using use VBG work_rujstqwje5gkdm2bqer4drugey 192 9 online online JJ work_rujstqwje5gkdm2bqer4drugey 192 10 transla- transla- NN work_rujstqwje5gkdm2bqer4drugey 192 11 tion tion NN work_rujstqwje5gkdm2bqer4drugey 192 12 resources resource NNS work_rujstqwje5gkdm2bqer4drugey 192 13 is be VBZ work_rujstqwje5gkdm2bqer4drugey 192 14 a a DT work_rujstqwje5gkdm2bqer4drugey 192 15 real real JJ work_rujstqwje5gkdm2bqer4drugey 192 16 problem problem NN work_rujstqwje5gkdm2bqer4drugey 192 17 , , , work_rujstqwje5gkdm2bqer4drugey 192 18 and and CC work_rujstqwje5gkdm2bqer4drugey 192 19 despite despite IN work_rujstqwje5gkdm2bqer4drugey 192 20 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 192 21 best good JJS work_rujstqwje5gkdm2bqer4drugey 192 22 efforts effort NNS work_rujstqwje5gkdm2bqer4drugey 192 23 to to TO work_rujstqwje5gkdm2bqer4drugey 192 24 remove remove VB work_rujstqwje5gkdm2bqer4drugey 192 25 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 192 26 using use VBG work_rujstqwje5gkdm2bqer4drugey 192 27 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 192 28 Translate Translate NNP work_rujstqwje5gkdm2bqer4drugey 192 29 , , , work_rujstqwje5gkdm2bqer4drugey 192 30 some some DT work_rujstqwje5gkdm2bqer4drugey 192 31 cheating cheating NN work_rujstqwje5gkdm2bqer4drugey 192 32 is be VBZ work_rujstqwje5gkdm2bqer4drugey 192 33 still still RB work_rujstqwje5gkdm2bqer4drugey 192 34 evident evident JJ work_rujstqwje5gkdm2bqer4drugey 192 35 . . . work_rujstqwje5gkdm2bqer4drugey 193 1 Restricting restrict VBG work_rujstqwje5gkdm2bqer4drugey 193 2 to to IN work_rujstqwje5gkdm2bqer4drugey 193 3 within within IN work_rujstqwje5gkdm2bqer4drugey 193 4 region region NN work_rujstqwje5gkdm2bqer4drugey 193 5 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 193 6 is be VBZ work_rujstqwje5gkdm2bqer4drugey 193 7 an an DT work_rujstqwje5gkdm2bqer4drugey 193 8 effective effective JJ work_rujstqwje5gkdm2bqer4drugey 193 9 way way NN work_rujstqwje5gkdm2bqer4drugey 193 10 to to TO work_rujstqwje5gkdm2bqer4drugey 193 11 reduce reduce VB work_rujstqwje5gkdm2bqer4drugey 193 12 the the DT work_rujstqwje5gkdm2bqer4drugey 193 13 prevalence prevalence NN work_rujstqwje5gkdm2bqer4drugey 193 14 of of IN work_rujstqwje5gkdm2bqer4drugey 193 15 cheating cheating NN work_rujstqwje5gkdm2bqer4drugey 193 16 . . . work_rujstqwje5gkdm2bqer4drugey 194 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 194 2 discuss discuss VBP work_rujstqwje5gkdm2bqer4drugey 194 3 the the DT work_rujstqwje5gkdm2bqer4drugey 194 4 languages language NNS work_rujstqwje5gkdm2bqer4drugey 194 5 which which WDT work_rujstqwje5gkdm2bqer4drugey 194 6 are be VBP work_rujstqwje5gkdm2bqer4drugey 194 7 best well RBS work_rujstqwje5gkdm2bqer4drugey 194 8 supported support VBN work_rujstqwje5gkdm2bqer4drugey 194 9 by by IN work_rujstqwje5gkdm2bqer4drugey 194 10 true true JJ work_rujstqwje5gkdm2bqer4drugey 194 11 native native JJ work_rujstqwje5gkdm2bqer4drugey 194 12 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 194 13 in in IN work_rujstqwje5gkdm2bqer4drugey 194 14 section section NN work_rujstqwje5gkdm2bqer4drugey 194 15 6 6 CD work_rujstqwje5gkdm2bqer4drugey 194 16 . . . work_rujstqwje5gkdm2bqer4drugey 195 1 Speed speed NN work_rujstqwje5gkdm2bqer4drugey 195 2 of of IN work_rujstqwje5gkdm2bqer4drugey 195 3 translation translation NN work_rujstqwje5gkdm2bqer4drugey 195 4 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 195 5 2 2 CD work_rujstqwje5gkdm2bqer4drugey 195 6 gives give VBZ work_rujstqwje5gkdm2bqer4drugey 195 7 the the DT work_rujstqwje5gkdm2bqer4drugey 195 8 comple- comple- NN work_rujstqwje5gkdm2bqer4drugey 195 9 tion tion NN work_rujstqwje5gkdm2bqer4drugey 195 10 times time NNS work_rujstqwje5gkdm2bqer4drugey 195 11 for for IN work_rujstqwje5gkdm2bqer4drugey 195 12 40 40 CD work_rujstqwje5gkdm2bqer4drugey 195 13 languages language NNS work_rujstqwje5gkdm2bqer4drugey 195 14 . . . work_rujstqwje5gkdm2bqer4drugey 196 1 The the DT work_rujstqwje5gkdm2bqer4drugey 196 2 10 10 CD work_rujstqwje5gkdm2bqer4drugey 196 3 languages language NNS work_rujstqwje5gkdm2bqer4drugey 196 4 to to TO work_rujstqwje5gkdm2bqer4drugey 196 5 finish finish VB work_rujstqwje5gkdm2bqer4drugey 196 6 in in IN work_rujstqwje5gkdm2bqer4drugey 196 7 the the DT work_rujstqwje5gkdm2bqer4drugey 196 8 shortest short JJS work_rujstqwje5gkdm2bqer4drugey 196 9 amount amount NN work_rujstqwje5gkdm2bqer4drugey 196 10 of of IN work_rujstqwje5gkdm2bqer4drugey 196 11 time time NN work_rujstqwje5gkdm2bqer4drugey 196 12 were be VBD work_rujstqwje5gkdm2bqer4drugey 196 13 : : : work_rujstqwje5gkdm2bqer4drugey 196 14 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 196 15 , , , work_rujstqwje5gkdm2bqer4drugey 196 16 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 196 17 , , , work_rujstqwje5gkdm2bqer4drugey 196 18 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 196 19 , , , work_rujstqwje5gkdm2bqer4drugey 196 20 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 196 21 , , , work_rujstqwje5gkdm2bqer4drugey 196 22 Macedonian Macedonian NNP work_rujstqwje5gkdm2bqer4drugey 196 23 , , , work_rujstqwje5gkdm2bqer4drugey 196 24 Spanish spanish JJ work_rujstqwje5gkdm2bqer4drugey 196 25 , , , work_rujstqwje5gkdm2bqer4drugey 196 26 Serbian serbian JJ work_rujstqwje5gkdm2bqer4drugey 196 27 , , , work_rujstqwje5gkdm2bqer4drugey 196 28 Romanian Romanian NNP work_rujstqwje5gkdm2bqer4drugey 196 29 , , , work_rujstqwje5gkdm2bqer4drugey 196 30 Gujarati Gujarati NNP work_rujstqwje5gkdm2bqer4drugey 196 31 , , , work_rujstqwje5gkdm2bqer4drugey 196 32 and and CC work_rujstqwje5gkdm2bqer4drugey 196 33 Marathi Marathi NNP work_rujstqwje5gkdm2bqer4drugey 196 34 . . . work_rujstqwje5gkdm2bqer4drugey 197 1 Seven seven CD work_rujstqwje5gkdm2bqer4drugey 197 2 of of IN work_rujstqwje5gkdm2bqer4drugey 197 3 the the DT work_rujstqwje5gkdm2bqer4drugey 197 4 ten ten CD work_rujstqwje5gkdm2bqer4drugey 197 5 fastest fast JJS work_rujstqwje5gkdm2bqer4drugey 197 6 languages language NNS work_rujstqwje5gkdm2bqer4drugey 197 7 are be VBP work_rujstqwje5gkdm2bqer4drugey 197 8 from from IN work_rujstqwje5gkdm2bqer4drugey 197 9 India India NNP work_rujstqwje5gkdm2bqer4drugey 197 10 , , , work_rujstqwje5gkdm2bqer4drugey 197 11 which which WDT work_rujstqwje5gkdm2bqer4drugey 197 12 is be VBZ work_rujstqwje5gkdm2bqer4drugey 197 13 un- un- CD work_rujstqwje5gkdm2bqer4drugey 197 14 86 86 CD work_rujstqwje5gkdm2bqer4drugey 197 15 320 320 CD work_rujstqwje5gkdm2bqer4drugey 197 16 2 2 CD work_rujstqwje5gkdm2bqer4drugey 197 17 4 4 CD work_rujstqwje5gkdm2bqer4drugey 197 18 6 6 CD work_rujstqwje5gkdm2bqer4drugey 197 19 8 8 CD work_rujstqwje5gkdm2bqer4drugey 197 20 10 10 CD work_rujstqwje5gkdm2bqer4drugey 197 21 12 12 CD work_rujstqwje5gkdm2bqer4drugey 197 22 14 14 CD work_rujstqwje5gkdm2bqer4drugey 197 23 16 16 CD work_rujstqwje5gkdm2bqer4drugey 197 24 18 18 CD work_rujstqwje5gkdm2bqer4drugey 197 25 20 20 CD work_rujstqwje5gkdm2bqer4drugey 197 26 22 22 CD work_rujstqwje5gkdm2bqer4drugey 197 27 24 24 CD work_rujstqwje5gkdm2bqer4drugey 197 28 26 26 CD work_rujstqwje5gkdm2bqer4drugey 197 29 28 28 CD work_rujstqwje5gkdm2bqer4drugey 197 30 30 30 CD work_rujstqwje5gkdm2bqer4drugey 197 31 800,000 800,000 CD work_rujstqwje5gkdm2bqer4drugey 197 32 0 0 CD work_rujstqwje5gkdm2bqer4drugey 197 33 100,000 100,000 CD work_rujstqwje5gkdm2bqer4drugey 197 34 200,000 200,000 CD work_rujstqwje5gkdm2bqer4drugey 197 35 300,000 300,000 CD work_rujstqwje5gkdm2bqer4drugey 197 36 400,000 400,000 CD work_rujstqwje5gkdm2bqer4drugey 197 37 500,000 500,000 CD work_rujstqwje5gkdm2bqer4drugey 197 38 600,000 600,000 CD work_rujstqwje5gkdm2bqer4drugey 197 39 700,000 700,000 CD work_rujstqwje5gkdm2bqer4drugey 197 40 M M NNP work_rujstqwje5gkdm2bqer4drugey 197 41 al al NNP work_rujstqwje5gkdm2bqer4drugey 197 42 ay ay NNP work_rujstqwje5gkdm2bqer4drugey 197 43 al al NNP work_rujstqwje5gkdm2bqer4drugey 197 44 am be VBP work_rujstqwje5gkdm2bqer4drugey 197 45 Ta Ta NNP work_rujstqwje5gkdm2bqer4drugey 197 46 m m NNP work_rujstqwje5gkdm2bqer4drugey 197 47 il il NNP work_rujstqwje5gkdm2bqer4drugey 197 48 Tel Tel NNP work_rujstqwje5gkdm2bqer4drugey 197 49 ugu ugu NN work_rujstqwje5gkdm2bqer4drugey 197 50 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 197 51 Urd Urd NNP work_rujstqwje5gkdm2bqer4drugey 197 52 u u NNP work_rujstqwje5gkdm2bqer4drugey 197 53 Ben Ben NNP work_rujstqwje5gkdm2bqer4drugey 197 54 gal gal NNP work_rujstqwje5gkdm2bqer4drugey 197 55 i i PRP work_rujstqwje5gkdm2bqer4drugey 197 56 Figure Figure NNP work_rujstqwje5gkdm2bqer4drugey 197 57 6 6 CD work_rujstqwje5gkdm2bqer4drugey 197 58 : : : work_rujstqwje5gkdm2bqer4drugey 197 59 The the DT work_rujstqwje5gkdm2bqer4drugey 197 60 total total JJ work_rujstqwje5gkdm2bqer4drugey 197 61 volume volume NN work_rujstqwje5gkdm2bqer4drugey 197 62 of of IN work_rujstqwje5gkdm2bqer4drugey 197 63 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 197 64 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 197 65 measured measure VBN work_rujstqwje5gkdm2bqer4drugey 197 66 in in IN work_rujstqwje5gkdm2bqer4drugey 197 67 English english JJ work_rujstqwje5gkdm2bqer4drugey 197 68 words word NNS work_rujstqwje5gkdm2bqer4drugey 197 69 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 197 70 as as IN work_rujstqwje5gkdm2bqer4drugey 197 71 a a DT work_rujstqwje5gkdm2bqer4drugey 197 72 function function NN work_rujstqwje5gkdm2bqer4drugey 197 73 of of IN work_rujstqwje5gkdm2bqer4drugey 197 74 elapsed elapse VBN work_rujstqwje5gkdm2bqer4drugey 197 75 days day NNS work_rujstqwje5gkdm2bqer4drugey 197 76 . . . work_rujstqwje5gkdm2bqer4drugey 198 1 sentence sentence NNP work_rujstqwje5gkdm2bqer4drugey 198 2 English English NNP work_rujstqwje5gkdm2bqer4drugey 198 3 + + SYM work_rujstqwje5gkdm2bqer4drugey 198 4 dictionary dictionary JJ work_rujstqwje5gkdm2bqer4drugey 198 5 language language NN work_rujstqwje5gkdm2bqer4drugey 198 6 pairs pair NNS work_rujstqwje5gkdm2bqer4drugey 198 7 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 198 8 words word NNS work_rujstqwje5gkdm2bqer4drugey 198 9 entries entrie VBZ work_rujstqwje5gkdm2bqer4drugey 198 10 Bengali Bengali NNP work_rujstqwje5gkdm2bqer4drugey 198 11 22k 22k NNS work_rujstqwje5gkdm2bqer4drugey 198 12 732k 732k IN work_rujstqwje5gkdm2bqer4drugey 198 13 22k 22k NNS work_rujstqwje5gkdm2bqer4drugey 198 14 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 198 15 40k 40k CD work_rujstqwje5gkdm2bqer4drugey 198 16 1,488k 1,488k CD work_rujstqwje5gkdm2bqer4drugey 198 17 22k 22k NNPS work_rujstqwje5gkdm2bqer4drugey 198 18 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 198 19 32k 32k NNS work_rujstqwje5gkdm2bqer4drugey 198 20 863k 863k CD work_rujstqwje5gkdm2bqer4drugey 198 21 23k 23k NNS work_rujstqwje5gkdm2bqer4drugey 198 22 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 198 23 38k 38k NNPS work_rujstqwje5gkdm2bqer4drugey 198 24 916k 916k CD work_rujstqwje5gkdm2bqer4drugey 198 25 25k 25k CD work_rujstqwje5gkdm2bqer4drugey 198 26 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 198 27 46k 46k CD work_rujstqwje5gkdm2bqer4drugey 198 28 1,097k 1,097k CD work_rujstqwje5gkdm2bqer4drugey 198 29 21k 21k CD work_rujstqwje5gkdm2bqer4drugey 198 30 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 198 31 35k 35k CD work_rujstqwje5gkdm2bqer4drugey 198 32 1,356k 1,356k CD work_rujstqwje5gkdm2bqer4drugey 198 33 20k 20k NNS work_rujstqwje5gkdm2bqer4drugey 198 34 Table table NN work_rujstqwje5gkdm2bqer4drugey 198 35 4 4 CD work_rujstqwje5gkdm2bqer4drugey 198 36 : : : work_rujstqwje5gkdm2bqer4drugey 198 37 Size size NN work_rujstqwje5gkdm2bqer4drugey 198 38 of of IN work_rujstqwje5gkdm2bqer4drugey 198 39 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 198 40 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 198 41 and and CC work_rujstqwje5gkdm2bqer4drugey 198 42 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 198 43 dic- dic- NN work_rujstqwje5gkdm2bqer4drugey 198 44 tionaries tionarie NNS work_rujstqwje5gkdm2bqer4drugey 198 45 collected collect VBN work_rujstqwje5gkdm2bqer4drugey 198 46 for for IN work_rujstqwje5gkdm2bqer4drugey 198 47 each each DT work_rujstqwje5gkdm2bqer4drugey 198 48 language language NN work_rujstqwje5gkdm2bqer4drugey 198 49 . . . work_rujstqwje5gkdm2bqer4drugey 199 1 surprising surprising JJ work_rujstqwje5gkdm2bqer4drugey 199 2 given give VBN work_rujstqwje5gkdm2bqer4drugey 199 3 the the DT work_rujstqwje5gkdm2bqer4drugey 199 4 geographic geographic JJ work_rujstqwje5gkdm2bqer4drugey 199 5 distribution distribution NN work_rujstqwje5gkdm2bqer4drugey 199 6 of of IN work_rujstqwje5gkdm2bqer4drugey 199 7 work- work- JJ work_rujstqwje5gkdm2bqer4drugey 199 8 ers er NNS work_rujstqwje5gkdm2bqer4drugey 199 9 . . . work_rujstqwje5gkdm2bqer4drugey 200 1 Some some DT work_rujstqwje5gkdm2bqer4drugey 200 2 languages language NNS work_rujstqwje5gkdm2bqer4drugey 200 3 follow follow VBP work_rujstqwje5gkdm2bqer4drugey 200 4 the the DT work_rujstqwje5gkdm2bqer4drugey 200 5 pattern pattern NN work_rujstqwje5gkdm2bqer4drugey 200 6 of of IN work_rujstqwje5gkdm2bqer4drugey 200 7 having have VBG work_rujstqwje5gkdm2bqer4drugey 200 8 a a DT work_rujstqwje5gkdm2bqer4drugey 200 9 smattering smattering NN work_rujstqwje5gkdm2bqer4drugey 200 10 of of IN work_rujstqwje5gkdm2bqer4drugey 200 11 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 200 12 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 200 13 early early RB work_rujstqwje5gkdm2bqer4drugey 200 14 , , , work_rujstqwje5gkdm2bqer4drugey 200 15 with with IN work_rujstqwje5gkdm2bqer4drugey 200 16 the the DT work_rujstqwje5gkdm2bqer4drugey 200 17 rate rate NN work_rujstqwje5gkdm2bqer4drugey 200 18 picking pick VBG work_rujstqwje5gkdm2bqer4drugey 200 19 up up RP work_rujstqwje5gkdm2bqer4drugey 200 20 later later RB work_rujstqwje5gkdm2bqer4drugey 200 21 . . . work_rujstqwje5gkdm2bqer4drugey 201 1 Figure figure NN work_rujstqwje5gkdm2bqer4drugey 201 2 6 6 CD work_rujstqwje5gkdm2bqer4drugey 201 3 gives give VBZ work_rujstqwje5gkdm2bqer4drugey 201 4 the the DT work_rujstqwje5gkdm2bqer4drugey 201 5 throughput throughput NN work_rujstqwje5gkdm2bqer4drugey 201 6 of of IN work_rujstqwje5gkdm2bqer4drugey 201 7 the the DT work_rujstqwje5gkdm2bqer4drugey 201 8 full full JJ work_rujstqwje5gkdm2bqer4drugey 201 9 - - HYPH work_rujstqwje5gkdm2bqer4drugey 201 10 sentence sentence NN work_rujstqwje5gkdm2bqer4drugey 201 11 translation translation NN work_rujstqwje5gkdm2bqer4drugey 201 12 task task NN work_rujstqwje5gkdm2bqer4drugey 201 13 for for IN work_rujstqwje5gkdm2bqer4drugey 201 14 the the DT work_rujstqwje5gkdm2bqer4drugey 201 15 six six CD work_rujstqwje5gkdm2bqer4drugey 201 16 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 201 17 languages language NNS work_rujstqwje5gkdm2bqer4drugey 201 18 . . . work_rujstqwje5gkdm2bqer4drugey 202 1 The the DT work_rujstqwje5gkdm2bqer4drugey 202 2 fastest fast JJS work_rujstqwje5gkdm2bqer4drugey 202 3 language language NN work_rujstqwje5gkdm2bqer4drugey 202 4 was be VBD work_rujstqwje5gkdm2bqer4drugey 202 5 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 202 6 , , , work_rujstqwje5gkdm2bqer4drugey 202 7 for for IN work_rujstqwje5gkdm2bqer4drugey 202 8 which which WDT work_rujstqwje5gkdm2bqer4drugey 202 9 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 202 10 col- col- VBP work_rujstqwje5gkdm2bqer4drugey 202 11 lected lecte VBD work_rujstqwje5gkdm2bqer4drugey 202 12 half half PDT work_rujstqwje5gkdm2bqer4drugey 202 13 a a DT work_rujstqwje5gkdm2bqer4drugey 202 14 million million CD work_rujstqwje5gkdm2bqer4drugey 202 15 words word NNS work_rujstqwje5gkdm2bqer4drugey 202 16 of of IN work_rujstqwje5gkdm2bqer4drugey 202 17 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 202 18 in in IN work_rujstqwje5gkdm2bqer4drugey 202 19 just just RB work_rujstqwje5gkdm2bqer4drugey 202 20 un- un- RB work_rujstqwje5gkdm2bqer4drugey 202 21 der der XX work_rujstqwje5gkdm2bqer4drugey 202 22 a a DT work_rujstqwje5gkdm2bqer4drugey 202 23 week week NN work_rujstqwje5gkdm2bqer4drugey 202 24 . . . work_rujstqwje5gkdm2bqer4drugey 203 1 Table table NN work_rujstqwje5gkdm2bqer4drugey 203 2 4 4 CD work_rujstqwje5gkdm2bqer4drugey 203 3 gives give VBZ work_rujstqwje5gkdm2bqer4drugey 203 4 the the DT work_rujstqwje5gkdm2bqer4drugey 203 5 size size NN work_rujstqwje5gkdm2bqer4drugey 203 6 of of IN work_rujstqwje5gkdm2bqer4drugey 203 7 the the DT work_rujstqwje5gkdm2bqer4drugey 203 8 data data NN work_rujstqwje5gkdm2bqer4drugey 203 9 set set NN work_rujstqwje5gkdm2bqer4drugey 203 10 that that IN work_rujstqwje5gkdm2bqer4drugey 203 11 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 203 12 created create VBD work_rujstqwje5gkdm2bqer4drugey 203 13 for for IN work_rujstqwje5gkdm2bqer4drugey 203 14 each each DT work_rujstqwje5gkdm2bqer4drugey 203 15 of of IN work_rujstqwje5gkdm2bqer4drugey 203 16 these these DT work_rujstqwje5gkdm2bqer4drugey 203 17 languages language NNS work_rujstqwje5gkdm2bqer4drugey 203 18 . . . work_rujstqwje5gkdm2bqer4drugey 204 1 Training Training NNP work_rujstqwje5gkdm2bqer4drugey 204 2 SMT SMT NNP work_rujstqwje5gkdm2bqer4drugey 204 3 systems system NNS work_rujstqwje5gkdm2bqer4drugey 204 4 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 204 5 trained train VBD work_rujstqwje5gkdm2bqer4drugey 204 6 statistical statistical JJ work_rujstqwje5gkdm2bqer4drugey 204 7 translation translation NN work_rujstqwje5gkdm2bqer4drugey 204 8 models model NNS work_rujstqwje5gkdm2bqer4drugey 204 9 from from IN work_rujstqwje5gkdm2bqer4drugey 204 10 the the DT work_rujstqwje5gkdm2bqer4drugey 204 11 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 204 12 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 204 13 that that WDT work_rujstqwje5gkdm2bqer4drugey 204 14 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 204 15 created create VBD work_rujstqwje5gkdm2bqer4drugey 204 16 for for IN work_rujstqwje5gkdm2bqer4drugey 204 17 the the DT work_rujstqwje5gkdm2bqer4drugey 204 18 six six CD work_rujstqwje5gkdm2bqer4drugey 204 19 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 204 20 languages language NNS work_rujstqwje5gkdm2bqer4drugey 204 21 using use VBG work_rujstqwje5gkdm2bqer4drugey 204 22 the the DT work_rujstqwje5gkdm2bqer4drugey 204 23 Joshua Joshua NNP work_rujstqwje5gkdm2bqer4drugey 204 24 machine machine NN work_rujstqwje5gkdm2bqer4drugey 204 25 translation translation NN work_rujstqwje5gkdm2bqer4drugey 204 26 system system NN work_rujstqwje5gkdm2bqer4drugey 204 27 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 204 28 Post Post NNP work_rujstqwje5gkdm2bqer4drugey 204 29 et et NNP work_rujstqwje5gkdm2bqer4drugey 204 30 al al NNP work_rujstqwje5gkdm2bqer4drugey 204 31 . . NNP work_rujstqwje5gkdm2bqer4drugey 204 32 , , , work_rujstqwje5gkdm2bqer4drugey 204 33 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 204 34 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 204 35 . . . work_rujstqwje5gkdm2bqer4drugey 205 1 Table table NN work_rujstqwje5gkdm2bqer4drugey 205 2 5 5 CD work_rujstqwje5gkdm2bqer4drugey 205 3 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 205 4 the the DT work_rujstqwje5gkdm2bqer4drugey 205 5 translation translation NN work_rujstqwje5gkdm2bqer4drugey 205 6 performance performance NN work_rujstqwje5gkdm2bqer4drugey 205 7 when when WRB work_rujstqwje5gkdm2bqer4drugey 205 8 trained train VBN work_rujstqwje5gkdm2bqer4drugey 205 9 on on IN work_rujstqwje5gkdm2bqer4drugey 205 10 the the DT work_rujstqwje5gkdm2bqer4drugey 205 11 bitexts bitexts NN work_rujstqwje5gkdm2bqer4drugey 205 12 alone alone RB work_rujstqwje5gkdm2bqer4drugey 205 13 , , , work_rujstqwje5gkdm2bqer4drugey 205 14 and and CC work_rujstqwje5gkdm2bqer4drugey 205 15 when when WRB work_rujstqwje5gkdm2bqer4drugey 205 16 incorporating incorporate VBG work_rujstqwje5gkdm2bqer4drugey 205 17 the the DT work_rujstqwje5gkdm2bqer4drugey 205 18 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 205 19 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 205 20 created create VBN work_rujstqwje5gkdm2bqer4drugey 205 21 in in IN work_rujstqwje5gkdm2bqer4drugey 205 22 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 205 23 earlier early JJR work_rujstqwje5gkdm2bqer4drugey 205 24 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 205 25 . . . work_rujstqwje5gkdm2bqer4drugey 206 1 The the DT work_rujstqwje5gkdm2bqer4drugey 206 2 scores score NNS work_rujstqwje5gkdm2bqer4drugey 206 3 reflect reflect VBP work_rujstqwje5gkdm2bqer4drugey 206 4 the the DT work_rujstqwje5gkdm2bqer4drugey 206 5 performance performance NN work_rujstqwje5gkdm2bqer4drugey 206 6 when when WRB work_rujstqwje5gkdm2bqer4drugey 206 7 tested test VBN work_rujstqwje5gkdm2bqer4drugey 206 8 on on IN work_rujstqwje5gkdm2bqer4drugey 206 9 held hold VBD work_rujstqwje5gkdm2bqer4drugey 206 10 out out RP work_rujstqwje5gkdm2bqer4drugey 206 11 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 206 12 from from IN work_rujstqwje5gkdm2bqer4drugey 206 13 the the DT work_rujstqwje5gkdm2bqer4drugey 206 14 training training NN work_rujstqwje5gkdm2bqer4drugey 206 15 data datum NNS work_rujstqwje5gkdm2bqer4drugey 206 16 . . . work_rujstqwje5gkdm2bqer4drugey 207 1 Adding add VBG work_rujstqwje5gkdm2bqer4drugey 207 2 the the DT work_rujstqwje5gkdm2bqer4drugey 207 3 dic- dic- NN work_rujstqwje5gkdm2bqer4drugey 207 4 trained train VBN work_rujstqwje5gkdm2bqer4drugey 207 5 on on IN work_rujstqwje5gkdm2bqer4drugey 207 6 bitext bitext NN work_rujstqwje5gkdm2bqer4drugey 207 7 + + CC work_rujstqwje5gkdm2bqer4drugey 207 8 BLEU BLEU NNP work_rujstqwje5gkdm2bqer4drugey 207 9 language language NN work_rujstqwje5gkdm2bqer4drugey 207 10 bitexts bitexts NN work_rujstqwje5gkdm2bqer4drugey 207 11 alone alone RB work_rujstqwje5gkdm2bqer4drugey 207 12 dictionaries dictionarie VBZ work_rujstqwje5gkdm2bqer4drugey 207 13 ∆ ∆ VBP work_rujstqwje5gkdm2bqer4drugey 207 14 Bengali Bengali NNP work_rujstqwje5gkdm2bqer4drugey 207 15 12.03 12.03 CD work_rujstqwje5gkdm2bqer4drugey 207 16 17.29 17.29 CD work_rujstqwje5gkdm2bqer4drugey 207 17 5.26 5.26 CD work_rujstqwje5gkdm2bqer4drugey 207 18 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 207 19 16.19 16.19 CD work_rujstqwje5gkdm2bqer4drugey 207 20 18.10 18.10 CD work_rujstqwje5gkdm2bqer4drugey 207 21 1.91 1.91 CD work_rujstqwje5gkdm2bqer4drugey 207 22 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 207 23 6.65 6.65 CD work_rujstqwje5gkdm2bqer4drugey 207 24 9.72 9.72 CD work_rujstqwje5gkdm2bqer4drugey 207 25 3.07 3.07 CD work_rujstqwje5gkdm2bqer4drugey 207 26 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 207 27 8.08 8.08 CD work_rujstqwje5gkdm2bqer4drugey 207 28 9.66 9.66 CD work_rujstqwje5gkdm2bqer4drugey 207 29 1.58 1.58 CD work_rujstqwje5gkdm2bqer4drugey 207 30 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 207 31 11.94 11.94 CD work_rujstqwje5gkdm2bqer4drugey 207 32 13.70 13.70 CD work_rujstqwje5gkdm2bqer4drugey 207 33 1.76 1.76 CD work_rujstqwje5gkdm2bqer4drugey 207 34 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 207 35 19.22 19.22 CD work_rujstqwje5gkdm2bqer4drugey 207 36 21.98 21.98 CD work_rujstqwje5gkdm2bqer4drugey 207 37 2.76 2.76 CD work_rujstqwje5gkdm2bqer4drugey 207 38 Table table NN work_rujstqwje5gkdm2bqer4drugey 207 39 5 5 CD work_rujstqwje5gkdm2bqer4drugey 207 40 : : : work_rujstqwje5gkdm2bqer4drugey 207 41 BLEU BLEU NNP work_rujstqwje5gkdm2bqer4drugey 207 42 scores score NNS work_rujstqwje5gkdm2bqer4drugey 207 43 for for IN work_rujstqwje5gkdm2bqer4drugey 207 44 translating translate VBG work_rujstqwje5gkdm2bqer4drugey 207 45 into into IN work_rujstqwje5gkdm2bqer4drugey 207 46 English English NNP work_rujstqwje5gkdm2bqer4drugey 207 47 using use VBG work_rujstqwje5gkdm2bqer4drugey 207 48 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 207 49 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 207 50 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 207 51 by by IN work_rujstqwje5gkdm2bqer4drugey 207 52 themselves -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 207 53 , , , work_rujstqwje5gkdm2bqer4drugey 207 54 and and CC work_rujstqwje5gkdm2bqer4drugey 207 55 with with IN work_rujstqwje5gkdm2bqer4drugey 207 56 the the DT work_rujstqwje5gkdm2bqer4drugey 207 57 addition addition NN work_rujstqwje5gkdm2bqer4drugey 207 58 of of IN work_rujstqwje5gkdm2bqer4drugey 207 59 single single JJ work_rujstqwje5gkdm2bqer4drugey 207 60 - - HYPH work_rujstqwje5gkdm2bqer4drugey 207 61 word word NN work_rujstqwje5gkdm2bqer4drugey 207 62 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 207 63 . . . work_rujstqwje5gkdm2bqer4drugey 208 1 Scores score NNS work_rujstqwje5gkdm2bqer4drugey 208 2 are be VBP work_rujstqwje5gkdm2bqer4drugey 208 3 calculated calculate VBN work_rujstqwje5gkdm2bqer4drugey 208 4 using use VBG work_rujstqwje5gkdm2bqer4drugey 208 5 four four CD work_rujstqwje5gkdm2bqer4drugey 208 6 reference reference NN work_rujstqwje5gkdm2bqer4drugey 208 7 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 208 8 and and CC work_rujstqwje5gkdm2bqer4drugey 208 9 represent represent VB work_rujstqwje5gkdm2bqer4drugey 208 10 the the DT work_rujstqwje5gkdm2bqer4drugey 208 11 mean mean NN work_rujstqwje5gkdm2bqer4drugey 208 12 of of IN work_rujstqwje5gkdm2bqer4drugey 208 13 three three CD work_rujstqwje5gkdm2bqer4drugey 208 14 MERT MERT NNP work_rujstqwje5gkdm2bqer4drugey 208 15 runs run NNS work_rujstqwje5gkdm2bqer4drugey 208 16 . . . work_rujstqwje5gkdm2bqer4drugey 209 1 tionaries tionarie NNS work_rujstqwje5gkdm2bqer4drugey 209 2 to to IN work_rujstqwje5gkdm2bqer4drugey 209 3 the the DT work_rujstqwje5gkdm2bqer4drugey 209 4 training training NN work_rujstqwje5gkdm2bqer4drugey 209 5 set set NN work_rujstqwje5gkdm2bqer4drugey 209 6 produces produce VBZ work_rujstqwje5gkdm2bqer4drugey 209 7 consistent consistent JJ work_rujstqwje5gkdm2bqer4drugey 209 8 per- per- NN work_rujstqwje5gkdm2bqer4drugey 209 9 formance formance NN work_rujstqwje5gkdm2bqer4drugey 209 10 gains gain NNS work_rujstqwje5gkdm2bqer4drugey 209 11 , , , work_rujstqwje5gkdm2bqer4drugey 209 12 ranging range VBG work_rujstqwje5gkdm2bqer4drugey 209 13 from from IN work_rujstqwje5gkdm2bqer4drugey 209 14 1 1 CD work_rujstqwje5gkdm2bqer4drugey 209 15 to to IN work_rujstqwje5gkdm2bqer4drugey 209 16 5 5 CD work_rujstqwje5gkdm2bqer4drugey 209 17 BLEU BLEU NNP work_rujstqwje5gkdm2bqer4drugey 209 18 points point NNS work_rujstqwje5gkdm2bqer4drugey 209 19 . . . work_rujstqwje5gkdm2bqer4drugey 210 1 This this DT work_rujstqwje5gkdm2bqer4drugey 210 2 represents represent VBZ work_rujstqwje5gkdm2bqer4drugey 210 3 a a DT work_rujstqwje5gkdm2bqer4drugey 210 4 substantial substantial JJ work_rujstqwje5gkdm2bqer4drugey 210 5 improvement improvement NN work_rujstqwje5gkdm2bqer4drugey 210 6 . . . work_rujstqwje5gkdm2bqer4drugey 211 1 It -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 211 2 is be VBZ work_rujstqwje5gkdm2bqer4drugey 211 3 worth worth JJ work_rujstqwje5gkdm2bqer4drugey 211 4 noting note VBG work_rujstqwje5gkdm2bqer4drugey 211 5 , , , work_rujstqwje5gkdm2bqer4drugey 211 6 however however RB work_rujstqwje5gkdm2bqer4drugey 211 7 , , , work_rujstqwje5gkdm2bqer4drugey 211 8 that that IN work_rujstqwje5gkdm2bqer4drugey 211 9 while while IN work_rujstqwje5gkdm2bqer4drugey 211 10 the the DT work_rujstqwje5gkdm2bqer4drugey 211 11 source source NN work_rujstqwje5gkdm2bqer4drugey 211 12 doc- doc- VBP work_rujstqwje5gkdm2bqer4drugey 211 13 uments ument NNS work_rujstqwje5gkdm2bqer4drugey 211 14 for for IN work_rujstqwje5gkdm2bqer4drugey 211 15 the the DT work_rujstqwje5gkdm2bqer4drugey 211 16 full full JJ work_rujstqwje5gkdm2bqer4drugey 211 17 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 211 18 used use VBN work_rujstqwje5gkdm2bqer4drugey 211 19 for for IN work_rujstqwje5gkdm2bqer4drugey 211 20 testing testing NN work_rujstqwje5gkdm2bqer4drugey 211 21 were be VBD work_rujstqwje5gkdm2bqer4drugey 211 22 kept keep VBN work_rujstqwje5gkdm2bqer4drugey 211 23 disjoint disjoint NN work_rujstqwje5gkdm2bqer4drugey 211 24 from from IN work_rujstqwje5gkdm2bqer4drugey 211 25 those those DT work_rujstqwje5gkdm2bqer4drugey 211 26 used use VBN work_rujstqwje5gkdm2bqer4drugey 211 27 for for IN work_rujstqwje5gkdm2bqer4drugey 211 28 training training NN work_rujstqwje5gkdm2bqer4drugey 211 29 , , , work_rujstqwje5gkdm2bqer4drugey 211 30 there there EX work_rujstqwje5gkdm2bqer4drugey 211 31 is be VBZ work_rujstqwje5gkdm2bqer4drugey 211 32 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 211 33 between between IN work_rujstqwje5gkdm2bqer4drugey 211 34 the the DT work_rujstqwje5gkdm2bqer4drugey 211 35 source source NN work_rujstqwje5gkdm2bqer4drugey 211 36 materials material NNS work_rujstqwje5gkdm2bqer4drugey 211 37 for for IN work_rujstqwje5gkdm2bqer4drugey 211 38 the the DT work_rujstqwje5gkdm2bqer4drugey 211 39 dictio- dictio- NN work_rujstqwje5gkdm2bqer4drugey 211 40 naries narie NNS work_rujstqwje5gkdm2bqer4drugey 211 41 and and CC work_rujstqwje5gkdm2bqer4drugey 211 42 those those DT work_rujstqwje5gkdm2bqer4drugey 211 43 from from IN work_rujstqwje5gkdm2bqer4drugey 211 44 the the DT work_rujstqwje5gkdm2bqer4drugey 211 45 test test NN work_rujstqwje5gkdm2bqer4drugey 211 46 set set NN work_rujstqwje5gkdm2bqer4drugey 211 47 , , , work_rujstqwje5gkdm2bqer4drugey 211 48 since since IN work_rujstqwje5gkdm2bqer4drugey 211 49 both both CC work_rujstqwje5gkdm2bqer4drugey 211 50 the the DT work_rujstqwje5gkdm2bqer4drugey 211 51 dic- dic- XX work_rujstqwje5gkdm2bqer4drugey 211 52 tionaries tionarie NNS work_rujstqwje5gkdm2bqer4drugey 211 53 and and CC work_rujstqwje5gkdm2bqer4drugey 211 54 the the DT work_rujstqwje5gkdm2bqer4drugey 211 55 bitext bitext NN work_rujstqwje5gkdm2bqer4drugey 211 56 source source NN work_rujstqwje5gkdm2bqer4drugey 211 57 sentences sentence NNS work_rujstqwje5gkdm2bqer4drugey 211 58 were be VBD work_rujstqwje5gkdm2bqer4drugey 211 59 drawn draw VBN work_rujstqwje5gkdm2bqer4drugey 211 60 from from IN work_rujstqwje5gkdm2bqer4drugey 211 61 Wikipedia Wikipedia NNP work_rujstqwje5gkdm2bqer4drugey 211 62 . . . work_rujstqwje5gkdm2bqer4drugey 212 1 6 6 CD work_rujstqwje5gkdm2bqer4drugey 212 2 Discussion Discussion NNP work_rujstqwje5gkdm2bqer4drugey 212 3 Crowdsourcing Crowdsourcing NNP work_rujstqwje5gkdm2bqer4drugey 212 4 platforms platform NNS work_rujstqwje5gkdm2bqer4drugey 212 5 like like IN work_rujstqwje5gkdm2bqer4drugey 212 6 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 212 7 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 212 8 give give VBP work_rujstqwje5gkdm2bqer4drugey 212 9 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 212 10 instant instant JJ work_rujstqwje5gkdm2bqer4drugey 212 11 access access NN work_rujstqwje5gkdm2bqer4drugey 212 12 to to IN work_rujstqwje5gkdm2bqer4drugey 212 13 a a DT work_rujstqwje5gkdm2bqer4drugey 212 14 diverse diverse JJ work_rujstqwje5gkdm2bqer4drugey 212 15 set set NN work_rujstqwje5gkdm2bqer4drugey 212 16 of of IN work_rujstqwje5gkdm2bqer4drugey 212 17 bilin- bilin- NN work_rujstqwje5gkdm2bqer4drugey 212 18 gual gual JJ work_rujstqwje5gkdm2bqer4drugey 212 19 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 212 20 . . . work_rujstqwje5gkdm2bqer4drugey 213 1 This this DT work_rujstqwje5gkdm2bqer4drugey 213 2 opens open VBZ work_rujstqwje5gkdm2bqer4drugey 213 3 up up RP work_rujstqwje5gkdm2bqer4drugey 213 4 exciting exciting JJ work_rujstqwje5gkdm2bqer4drugey 213 5 new new JJ work_rujstqwje5gkdm2bqer4drugey 213 6 avenues avenue NNS work_rujstqwje5gkdm2bqer4drugey 213 7 for for IN work_rujstqwje5gkdm2bqer4drugey 213 8 researchers researcher NNS work_rujstqwje5gkdm2bqer4drugey 213 9 to to TO work_rujstqwje5gkdm2bqer4drugey 213 10 develop develop VB work_rujstqwje5gkdm2bqer4drugey 213 11 new new JJ work_rujstqwje5gkdm2bqer4drugey 213 12 multilingual multilingual JJ work_rujstqwje5gkdm2bqer4drugey 213 13 systems system NNS work_rujstqwje5gkdm2bqer4drugey 213 14 . . . work_rujstqwje5gkdm2bqer4drugey 214 1 The the DT work_rujstqwje5gkdm2bqer4drugey 214 2 demographics demographic NNS work_rujstqwje5gkdm2bqer4drugey 214 3 reported report VBD work_rujstqwje5gkdm2bqer4drugey 214 4 in in IN work_rujstqwje5gkdm2bqer4drugey 214 5 this this DT work_rujstqwje5gkdm2bqer4drugey 214 6 study study NN work_rujstqwje5gkdm2bqer4drugey 214 7 are be VBP work_rujstqwje5gkdm2bqer4drugey 214 8 likely likely JJ work_rujstqwje5gkdm2bqer4drugey 214 9 to to TO work_rujstqwje5gkdm2bqer4drugey 214 10 shift shift VB work_rujstqwje5gkdm2bqer4drugey 214 11 over over IN work_rujstqwje5gkdm2bqer4drugey 214 12 time time NN work_rujstqwje5gkdm2bqer4drugey 214 13 . . . work_rujstqwje5gkdm2bqer4drugey 215 1 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 215 2 may may MD work_rujstqwje5gkdm2bqer4drugey 215 3 expand expand VB work_rujstqwje5gkdm2bqer4drugey 215 4 its -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 215 5 payments payment NNS work_rujstqwje5gkdm2bqer4drugey 215 6 to to IN work_rujstqwje5gkdm2bqer4drugey 215 7 new new JJ work_rujstqwje5gkdm2bqer4drugey 215 8 currencies currency NNS work_rujstqwje5gkdm2bqer4drugey 215 9 . . . work_rujstqwje5gkdm2bqer4drugey 216 1 Posting post VBG work_rujstqwje5gkdm2bqer4drugey 216 2 long long RB work_rujstqwje5gkdm2bqer4drugey 216 3 - - HYPH work_rujstqwje5gkdm2bqer4drugey 216 4 running run VBG work_rujstqwje5gkdm2bqer4drugey 216 5 HITs hit NNS work_rujstqwje5gkdm2bqer4drugey 216 6 in in IN work_rujstqwje5gkdm2bqer4drugey 216 7 other other JJ work_rujstqwje5gkdm2bqer4drugey 216 8 languages language NNS work_rujstqwje5gkdm2bqer4drugey 216 9 may may MD work_rujstqwje5gkdm2bqer4drugey 216 10 recruit recruit VB work_rujstqwje5gkdm2bqer4drugey 216 11 more more JJR work_rujstqwje5gkdm2bqer4drugey 216 12 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 216 13 of of IN work_rujstqwje5gkdm2bqer4drugey 216 14 those those DT work_rujstqwje5gkdm2bqer4drugey 216 15 lan- lan- NN work_rujstqwje5gkdm2bqer4drugey 216 16 guages guage NNS work_rujstqwje5gkdm2bqer4drugey 216 17 . . . work_rujstqwje5gkdm2bqer4drugey 217 1 New new JJ work_rujstqwje5gkdm2bqer4drugey 217 2 crowdsourcing crowdsourcing JJ work_rujstqwje5gkdm2bqer4drugey 217 3 platforms platform NNS work_rujstqwje5gkdm2bqer4drugey 217 4 may may MD work_rujstqwje5gkdm2bqer4drugey 217 5 emerge emerge VB work_rujstqwje5gkdm2bqer4drugey 217 6 . . . work_rujstqwje5gkdm2bqer4drugey 218 1 The the DT work_rujstqwje5gkdm2bqer4drugey 218 2 data datum NNS work_rujstqwje5gkdm2bqer4drugey 218 3 presented present VBN work_rujstqwje5gkdm2bqer4drugey 218 4 here here RB work_rujstqwje5gkdm2bqer4drugey 218 5 provides provide VBZ work_rujstqwje5gkdm2bqer4drugey 218 6 a a DT work_rujstqwje5gkdm2bqer4drugey 218 7 valuable valuable JJ work_rujstqwje5gkdm2bqer4drugey 218 8 snap- snap- NN work_rujstqwje5gkdm2bqer4drugey 218 9 shot shot NN work_rujstqwje5gkdm2bqer4drugey 218 10 of of IN work_rujstqwje5gkdm2bqer4drugey 218 11 the the DT work_rujstqwje5gkdm2bqer4drugey 218 12 current current JJ work_rujstqwje5gkdm2bqer4drugey 218 13 state state NN work_rujstqwje5gkdm2bqer4drugey 218 14 of of IN work_rujstqwje5gkdm2bqer4drugey 218 15 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 218 16 , , , work_rujstqwje5gkdm2bqer4drugey 218 17 and and CC work_rujstqwje5gkdm2bqer4drugey 218 18 the the DT work_rujstqwje5gkdm2bqer4drugey 218 19 methods method NNS work_rujstqwje5gkdm2bqer4drugey 218 20 used use VBN work_rujstqwje5gkdm2bqer4drugey 218 21 can can MD work_rujstqwje5gkdm2bqer4drugey 218 22 be be VB work_rujstqwje5gkdm2bqer4drugey 218 23 applied apply VBN work_rujstqwje5gkdm2bqer4drugey 218 24 generally generally RB work_rujstqwje5gkdm2bqer4drugey 218 25 in in IN work_rujstqwje5gkdm2bqer4drugey 218 26 future future JJ work_rujstqwje5gkdm2bqer4drugey 218 27 research research NN work_rujstqwje5gkdm2bqer4drugey 218 28 . . . work_rujstqwje5gkdm2bqer4drugey 219 1 Based base VBN work_rujstqwje5gkdm2bqer4drugey 219 2 on on IN work_rujstqwje5gkdm2bqer4drugey 219 3 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 219 4 study study NN work_rujstqwje5gkdm2bqer4drugey 219 5 , , , work_rujstqwje5gkdm2bqer4drugey 219 6 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 219 7 can can MD work_rujstqwje5gkdm2bqer4drugey 219 8 confidently confidently RB work_rujstqwje5gkdm2bqer4drugey 219 9 recom- recom- VB work_rujstqwje5gkdm2bqer4drugey 219 10 mend mend NN work_rujstqwje5gkdm2bqer4drugey 219 11 13 13 CD work_rujstqwje5gkdm2bqer4drugey 219 12 languages language NNS work_rujstqwje5gkdm2bqer4drugey 219 13 as as IN work_rujstqwje5gkdm2bqer4drugey 219 14 good good JJ work_rujstqwje5gkdm2bqer4drugey 219 15 candidates candidate NNS work_rujstqwje5gkdm2bqer4drugey 219 16 for for IN work_rujstqwje5gkdm2bqer4drugey 219 17 research research NN work_rujstqwje5gkdm2bqer4drugey 219 18 now now RB work_rujstqwje5gkdm2bqer4drugey 219 19 : : : work_rujstqwje5gkdm2bqer4drugey 219 20 Dutch dutch JJ work_rujstqwje5gkdm2bqer4drugey 219 21 , , , work_rujstqwje5gkdm2bqer4drugey 219 22 French french JJ work_rujstqwje5gkdm2bqer4drugey 219 23 , , , work_rujstqwje5gkdm2bqer4drugey 219 24 German german JJ work_rujstqwje5gkdm2bqer4drugey 219 25 , , , work_rujstqwje5gkdm2bqer4drugey 219 26 Gujarati Gujarati NNP work_rujstqwje5gkdm2bqer4drugey 219 27 , , , work_rujstqwje5gkdm2bqer4drugey 219 28 Italian Italian NNP work_rujstqwje5gkdm2bqer4drugey 219 29 , , , work_rujstqwje5gkdm2bqer4drugey 219 30 Kan- Kan- NNP work_rujstqwje5gkdm2bqer4drugey 219 31 nada nada NNP work_rujstqwje5gkdm2bqer4drugey 219 32 , , , work_rujstqwje5gkdm2bqer4drugey 219 33 Malayalam Malayalam NNP work_rujstqwje5gkdm2bqer4drugey 219 34 , , , work_rujstqwje5gkdm2bqer4drugey 219 35 Portuguese portuguese JJ work_rujstqwje5gkdm2bqer4drugey 219 36 , , , work_rujstqwje5gkdm2bqer4drugey 219 37 Romanian romanian JJ work_rujstqwje5gkdm2bqer4drugey 219 38 , , , work_rujstqwje5gkdm2bqer4drugey 219 39 Serbian serbian JJ work_rujstqwje5gkdm2bqer4drugey 219 40 , , , work_rujstqwje5gkdm2bqer4drugey 219 41 Spanish Spanish NNP work_rujstqwje5gkdm2bqer4drugey 219 42 , , , work_rujstqwje5gkdm2bqer4drugey 219 43 Tagalog Tagalog NNP work_rujstqwje5gkdm2bqer4drugey 219 44 , , , work_rujstqwje5gkdm2bqer4drugey 219 45 and and CC work_rujstqwje5gkdm2bqer4drugey 219 46 Telugu Telugu NNP work_rujstqwje5gkdm2bqer4drugey 219 47 . . . work_rujstqwje5gkdm2bqer4drugey 220 1 These these DT work_rujstqwje5gkdm2bqer4drugey 220 2 languages language NNS work_rujstqwje5gkdm2bqer4drugey 220 3 have have VBP work_rujstqwje5gkdm2bqer4drugey 220 4 large large JJ work_rujstqwje5gkdm2bqer4drugey 220 5 Turker Turker NNP work_rujstqwje5gkdm2bqer4drugey 220 6 populations population NNS work_rujstqwje5gkdm2bqer4drugey 220 7 who who WP work_rujstqwje5gkdm2bqer4drugey 220 8 complete complete VBP work_rujstqwje5gkdm2bqer4drugey 220 9 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 220 10 quickly quickly RB work_rujstqwje5gkdm2bqer4drugey 220 11 and and CC work_rujstqwje5gkdm2bqer4drugey 220 12 accurately accurately RB work_rujstqwje5gkdm2bqer4drugey 220 13 . . . work_rujstqwje5gkdm2bqer4drugey 221 1 Table table NN work_rujstqwje5gkdm2bqer4drugey 221 2 6 6 CD work_rujstqwje5gkdm2bqer4drugey 221 3 summarizes summarize VBZ work_rujstqwje5gkdm2bqer4drugey 221 4 the the DT work_rujstqwje5gkdm2bqer4drugey 221 5 strengths strength NNS work_rujstqwje5gkdm2bqer4drugey 221 6 and and CC work_rujstqwje5gkdm2bqer4drugey 221 7 weaknesses weakness NNS work_rujstqwje5gkdm2bqer4drugey 221 8 of of IN work_rujstqwje5gkdm2bqer4drugey 221 9 all all DT work_rujstqwje5gkdm2bqer4drugey 221 10 100 100 CD work_rujstqwje5gkdm2bqer4drugey 221 11 languages language NNS work_rujstqwje5gkdm2bqer4drugey 221 12 cov- cov- RB work_rujstqwje5gkdm2bqer4drugey 221 13 ered ered JJ work_rujstqwje5gkdm2bqer4drugey 221 14 in in IN work_rujstqwje5gkdm2bqer4drugey 221 15 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 221 16 study study NN work_rujstqwje5gkdm2bqer4drugey 221 17 . . . work_rujstqwje5gkdm2bqer4drugey 222 1 Several several JJ work_rujstqwje5gkdm2bqer4drugey 222 2 other other JJ work_rujstqwje5gkdm2bqer4drugey 222 3 languages language NNS work_rujstqwje5gkdm2bqer4drugey 222 4 are be VBP work_rujstqwje5gkdm2bqer4drugey 222 5 viable viable JJ work_rujstqwje5gkdm2bqer4drugey 222 6 87 87 CD work_rujstqwje5gkdm2bqer4drugey 222 7 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 222 8 quality quality NN work_rujstqwje5gkdm2bqer4drugey 222 9 speed speed NN work_rujstqwje5gkdm2bqer4drugey 222 10 many many JJ work_rujstqwje5gkdm2bqer4drugey 222 11 high high JJ work_rujstqwje5gkdm2bqer4drugey 222 12 fast fast JJ work_rujstqwje5gkdm2bqer4drugey 222 13 Dutch dutch JJ work_rujstqwje5gkdm2bqer4drugey 222 14 , , , work_rujstqwje5gkdm2bqer4drugey 222 15 French french JJ work_rujstqwje5gkdm2bqer4drugey 222 16 , , , work_rujstqwje5gkdm2bqer4drugey 222 17 German german JJ work_rujstqwje5gkdm2bqer4drugey 222 18 , , , work_rujstqwje5gkdm2bqer4drugey 222 19 Gu- gu- CC work_rujstqwje5gkdm2bqer4drugey 222 20 jarati jarati NNS work_rujstqwje5gkdm2bqer4drugey 222 21 , , , work_rujstqwje5gkdm2bqer4drugey 222 22 Italian Italian NNP work_rujstqwje5gkdm2bqer4drugey 222 23 , , , work_rujstqwje5gkdm2bqer4drugey 222 24 Kannada Kannada NNP work_rujstqwje5gkdm2bqer4drugey 222 25 , , , work_rujstqwje5gkdm2bqer4drugey 222 26 Malay- Malay- NNP work_rujstqwje5gkdm2bqer4drugey 222 27 alam alam NNP work_rujstqwje5gkdm2bqer4drugey 222 28 , , , work_rujstqwje5gkdm2bqer4drugey 222 29 Portuguese portuguese JJ work_rujstqwje5gkdm2bqer4drugey 222 30 , , , work_rujstqwje5gkdm2bqer4drugey 222 31 Romanian romanian JJ work_rujstqwje5gkdm2bqer4drugey 222 32 , , , work_rujstqwje5gkdm2bqer4drugey 222 33 Serbian serbian JJ work_rujstqwje5gkdm2bqer4drugey 222 34 , , , work_rujstqwje5gkdm2bqer4drugey 222 35 Spanish Spanish NNP work_rujstqwje5gkdm2bqer4drugey 222 36 , , , work_rujstqwje5gkdm2bqer4drugey 222 37 Tagalog Tagalog NNP work_rujstqwje5gkdm2bqer4drugey 222 38 , , , work_rujstqwje5gkdm2bqer4drugey 222 39 Tel- Tel- NNP work_rujstqwje5gkdm2bqer4drugey 222 40 ugu ugu NN work_rujstqwje5gkdm2bqer4drugey 222 41 slow slow JJ work_rujstqwje5gkdm2bqer4drugey 222 42 Arabic Arabic NNP work_rujstqwje5gkdm2bqer4drugey 222 43 , , , work_rujstqwje5gkdm2bqer4drugey 222 44 Hebrew hebrew JJ work_rujstqwje5gkdm2bqer4drugey 222 45 , , , work_rujstqwje5gkdm2bqer4drugey 222 46 Irish Irish NNP work_rujstqwje5gkdm2bqer4drugey 222 47 , , , work_rujstqwje5gkdm2bqer4drugey 222 48 Punjabi Punjabi NNP work_rujstqwje5gkdm2bqer4drugey 222 49 , , , work_rujstqwje5gkdm2bqer4drugey 222 50 Swedish swedish JJ work_rujstqwje5gkdm2bqer4drugey 222 51 , , , work_rujstqwje5gkdm2bqer4drugey 222 52 Turkish turkish JJ work_rujstqwje5gkdm2bqer4drugey 222 53 low low JJ work_rujstqwje5gkdm2bqer4drugey 222 54 fast fast JJ work_rujstqwje5gkdm2bqer4drugey 222 55 Hindi Hindi NNP work_rujstqwje5gkdm2bqer4drugey 222 56 , , , work_rujstqwje5gkdm2bqer4drugey 222 57 Marathi Marathi NNP work_rujstqwje5gkdm2bqer4drugey 222 58 , , , work_rujstqwje5gkdm2bqer4drugey 222 59 Tamil Tamil NNP work_rujstqwje5gkdm2bqer4drugey 222 60 , , , work_rujstqwje5gkdm2bqer4drugey 222 61 Urdu Urdu NNP work_rujstqwje5gkdm2bqer4drugey 222 62 or or CC work_rujstqwje5gkdm2bqer4drugey 222 63 medium medium JJ work_rujstqwje5gkdm2bqer4drugey 222 64 slow slow JJ work_rujstqwje5gkdm2bqer4drugey 222 65 Bengali Bengali NNP work_rujstqwje5gkdm2bqer4drugey 222 66 , , , work_rujstqwje5gkdm2bqer4drugey 222 67 Bishnupriya Bishnupriya NNP work_rujstqwje5gkdm2bqer4drugey 222 68 Ma- Ma- NNP work_rujstqwje5gkdm2bqer4drugey 222 69 nipuri nipuri NN work_rujstqwje5gkdm2bqer4drugey 222 70 , , , work_rujstqwje5gkdm2bqer4drugey 222 71 Cebuano Cebuano NNP work_rujstqwje5gkdm2bqer4drugey 222 72 , , , work_rujstqwje5gkdm2bqer4drugey 222 73 Chinese Chinese NNPS work_rujstqwje5gkdm2bqer4drugey 222 74 , , , work_rujstqwje5gkdm2bqer4drugey 222 75 Nepali Nepali NNP work_rujstqwje5gkdm2bqer4drugey 222 76 , , , work_rujstqwje5gkdm2bqer4drugey 222 77 Newar Newar NNP work_rujstqwje5gkdm2bqer4drugey 222 78 , , , work_rujstqwje5gkdm2bqer4drugey 222 79 Polish polish JJ work_rujstqwje5gkdm2bqer4drugey 222 80 , , , work_rujstqwje5gkdm2bqer4drugey 222 81 Russian russian JJ work_rujstqwje5gkdm2bqer4drugey 222 82 , , , work_rujstqwje5gkdm2bqer4drugey 222 83 Sindhi Sindhi NNP work_rujstqwje5gkdm2bqer4drugey 222 84 , , , work_rujstqwje5gkdm2bqer4drugey 222 85 Tibetan tibetan JJ work_rujstqwje5gkdm2bqer4drugey 222 86 few few JJ work_rujstqwje5gkdm2bqer4drugey 222 87 high high JJ work_rujstqwje5gkdm2bqer4drugey 222 88 fast fast JJ work_rujstqwje5gkdm2bqer4drugey 222 89 Bosnia Bosnia NNP work_rujstqwje5gkdm2bqer4drugey 222 90 , , , work_rujstqwje5gkdm2bqer4drugey 222 91 Croatian Croatian NNP work_rujstqwje5gkdm2bqer4drugey 222 92 , , , work_rujstqwje5gkdm2bqer4drugey 222 93 Macedonian Macedonian NNP work_rujstqwje5gkdm2bqer4drugey 222 94 , , , work_rujstqwje5gkdm2bqer4drugey 222 95 Malay Malay NNP work_rujstqwje5gkdm2bqer4drugey 222 96 , , , work_rujstqwje5gkdm2bqer4drugey 222 97 Serbo serbo JJ work_rujstqwje5gkdm2bqer4drugey 222 98 - - HYPH work_rujstqwje5gkdm2bqer4drugey 222 99 Croatian croatian JJ work_rujstqwje5gkdm2bqer4drugey 222 100 slow slow NN work_rujstqwje5gkdm2bqer4drugey 222 101 Afrikaans Afrikaans NNPS work_rujstqwje5gkdm2bqer4drugey 222 102 , , , work_rujstqwje5gkdm2bqer4drugey 222 103 Albanian albanian JJ work_rujstqwje5gkdm2bqer4drugey 222 104 , , , work_rujstqwje5gkdm2bqer4drugey 222 105 Aragonese aragonese JJ work_rujstqwje5gkdm2bqer4drugey 222 106 , , , work_rujstqwje5gkdm2bqer4drugey 222 107 Asturian asturian JJ work_rujstqwje5gkdm2bqer4drugey 222 108 , , , work_rujstqwje5gkdm2bqer4drugey 222 109 Basque basque JJ work_rujstqwje5gkdm2bqer4drugey 222 110 , , , work_rujstqwje5gkdm2bqer4drugey 222 111 Belarusian belarusian JJ work_rujstqwje5gkdm2bqer4drugey 222 112 , , , work_rujstqwje5gkdm2bqer4drugey 222 113 Bulgarian bulgarian JJ work_rujstqwje5gkdm2bqer4drugey 222 114 , , , work_rujstqwje5gkdm2bqer4drugey 222 115 Central Central NNP work_rujstqwje5gkdm2bqer4drugey 222 116 Bicolano Bicolano NNP work_rujstqwje5gkdm2bqer4drugey 222 117 , , , work_rujstqwje5gkdm2bqer4drugey 222 118 Czech Czech NNP work_rujstqwje5gkdm2bqer4drugey 222 119 , , , work_rujstqwje5gkdm2bqer4drugey 222 120 Danish Danish NNP work_rujstqwje5gkdm2bqer4drugey 222 121 , , , work_rujstqwje5gkdm2bqer4drugey 222 122 Finnish finnish JJ work_rujstqwje5gkdm2bqer4drugey 222 123 , , , work_rujstqwje5gkdm2bqer4drugey 222 124 Galacian galacian JJ work_rujstqwje5gkdm2bqer4drugey 222 125 , , , work_rujstqwje5gkdm2bqer4drugey 222 126 Greek Greek NNP work_rujstqwje5gkdm2bqer4drugey 222 127 , , , work_rujstqwje5gkdm2bqer4drugey 222 128 Haitian haitian JJ work_rujstqwje5gkdm2bqer4drugey 222 129 , , , work_rujstqwje5gkdm2bqer4drugey 222 130 Hungarian hungarian JJ work_rujstqwje5gkdm2bqer4drugey 222 131 , , , work_rujstqwje5gkdm2bqer4drugey 222 132 Icelandic Icelandic NNP work_rujstqwje5gkdm2bqer4drugey 222 133 , , , work_rujstqwje5gkdm2bqer4drugey 222 134 Ilokano Ilokano NNP work_rujstqwje5gkdm2bqer4drugey 222 135 , , , work_rujstqwje5gkdm2bqer4drugey 222 136 Indonesian indonesian JJ work_rujstqwje5gkdm2bqer4drugey 222 137 , , , work_rujstqwje5gkdm2bqer4drugey 222 138 Japanese japanese JJ work_rujstqwje5gkdm2bqer4drugey 222 139 , , , work_rujstqwje5gkdm2bqer4drugey 222 140 Javanese Javanese NNP work_rujstqwje5gkdm2bqer4drugey 222 141 , , , work_rujstqwje5gkdm2bqer4drugey 222 142 Kapampangan Kapampangan NNP work_rujstqwje5gkdm2bqer4drugey 222 143 , , , work_rujstqwje5gkdm2bqer4drugey 222 144 Kazakh Kazakh NNP work_rujstqwje5gkdm2bqer4drugey 222 145 , , , work_rujstqwje5gkdm2bqer4drugey 222 146 Korean korean JJ work_rujstqwje5gkdm2bqer4drugey 222 147 , , , work_rujstqwje5gkdm2bqer4drugey 222 148 Lithuanian lithuanian JJ work_rujstqwje5gkdm2bqer4drugey 222 149 , , , work_rujstqwje5gkdm2bqer4drugey 222 150 Low Low NNP work_rujstqwje5gkdm2bqer4drugey 222 151 Saxon Saxon NNP work_rujstqwje5gkdm2bqer4drugey 222 152 , , , work_rujstqwje5gkdm2bqer4drugey 222 153 Malagasy Malagasy NNP work_rujstqwje5gkdm2bqer4drugey 222 154 , , , work_rujstqwje5gkdm2bqer4drugey 222 155 Nor- Nor- NNP work_rujstqwje5gkdm2bqer4drugey 222 156 wegian wegian NN work_rujstqwje5gkdm2bqer4drugey 222 157 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 222 158 Bokmal Bokmal NNP work_rujstqwje5gkdm2bqer4drugey 222 159 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 222 160 , , , work_rujstqwje5gkdm2bqer4drugey 222 161 Sicilian Sicilian NNP work_rujstqwje5gkdm2bqer4drugey 222 162 , , , work_rujstqwje5gkdm2bqer4drugey 222 163 Slovak Slovak NNP work_rujstqwje5gkdm2bqer4drugey 222 164 , , , work_rujstqwje5gkdm2bqer4drugey 222 165 Slovenian Slovenian NNP work_rujstqwje5gkdm2bqer4drugey 222 166 , , , work_rujstqwje5gkdm2bqer4drugey 222 167 Thai Thai NNP work_rujstqwje5gkdm2bqer4drugey 222 168 , , , work_rujstqwje5gkdm2bqer4drugey 222 169 UKra- UKra- NNP work_rujstqwje5gkdm2bqer4drugey 222 170 nian nian NN work_rujstqwje5gkdm2bqer4drugey 222 171 , , , work_rujstqwje5gkdm2bqer4drugey 222 172 Uzbek Uzbek NNP work_rujstqwje5gkdm2bqer4drugey 222 173 , , , work_rujstqwje5gkdm2bqer4drugey 222 174 Waray Waray NNP work_rujstqwje5gkdm2bqer4drugey 222 175 - - HYPH work_rujstqwje5gkdm2bqer4drugey 222 176 Waray Waray NNP work_rujstqwje5gkdm2bqer4drugey 222 177 , , , work_rujstqwje5gkdm2bqer4drugey 222 178 West West NNP work_rujstqwje5gkdm2bqer4drugey 222 179 Frisian Frisian NNP work_rujstqwje5gkdm2bqer4drugey 222 180 , , , work_rujstqwje5gkdm2bqer4drugey 222 181 Yoruba Yoruba NNP work_rujstqwje5gkdm2bqer4drugey 222 182 low low JJ work_rujstqwje5gkdm2bqer4drugey 222 183 fast fast RB work_rujstqwje5gkdm2bqer4drugey 222 184 – – : work_rujstqwje5gkdm2bqer4drugey 222 185 or or CC work_rujstqwje5gkdm2bqer4drugey 222 186 medium medium NN work_rujstqwje5gkdm2bqer4drugey 222 187 slow slow JJ work_rujstqwje5gkdm2bqer4drugey 222 188 Amharic Amharic NNP work_rujstqwje5gkdm2bqer4drugey 222 189 , , , work_rujstqwje5gkdm2bqer4drugey 222 190 Armenian Armenian NNP work_rujstqwje5gkdm2bqer4drugey 222 191 , , , work_rujstqwje5gkdm2bqer4drugey 222 192 Azer- Azer- NNP work_rujstqwje5gkdm2bqer4drugey 222 193 baijani baijani NN work_rujstqwje5gkdm2bqer4drugey 222 194 , , , work_rujstqwje5gkdm2bqer4drugey 222 195 Breton Breton NNP work_rujstqwje5gkdm2bqer4drugey 222 196 , , , work_rujstqwje5gkdm2bqer4drugey 222 197 Catalan Catalan NNP work_rujstqwje5gkdm2bqer4drugey 222 198 , , , work_rujstqwje5gkdm2bqer4drugey 222 199 Georgian Georgian NNP work_rujstqwje5gkdm2bqer4drugey 222 200 , , , work_rujstqwje5gkdm2bqer4drugey 222 201 Latvian Latvian NNP work_rujstqwje5gkdm2bqer4drugey 222 202 , , , work_rujstqwje5gkdm2bqer4drugey 222 203 Luxembour- Luxembour- NNP work_rujstqwje5gkdm2bqer4drugey 222 204 gish gish NN work_rujstqwje5gkdm2bqer4drugey 222 205 , , , work_rujstqwje5gkdm2bqer4drugey 222 206 Neapolitian Neapolitian NNP work_rujstqwje5gkdm2bqer4drugey 222 207 , , , work_rujstqwje5gkdm2bqer4drugey 222 208 Norwegian Norwegian NNP work_rujstqwje5gkdm2bqer4drugey 222 209 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 222 210 Nynorsk Nynorsk NNP work_rujstqwje5gkdm2bqer4drugey 222 211 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 222 212 , , , work_rujstqwje5gkdm2bqer4drugey 222 213 Pashto Pashto NNP work_rujstqwje5gkdm2bqer4drugey 222 214 , , , work_rujstqwje5gkdm2bqer4drugey 222 215 Pied- Pied- NNP work_rujstqwje5gkdm2bqer4drugey 222 216 montese montese NNP work_rujstqwje5gkdm2bqer4drugey 222 217 , , , work_rujstqwje5gkdm2bqer4drugey 222 218 Somali somali JJ work_rujstqwje5gkdm2bqer4drugey 222 219 , , , work_rujstqwje5gkdm2bqer4drugey 222 220 Sudanese Sudanese NNP work_rujstqwje5gkdm2bqer4drugey 222 221 , , , work_rujstqwje5gkdm2bqer4drugey 222 222 Swahili Swahili NNP work_rujstqwje5gkdm2bqer4drugey 222 223 , , , work_rujstqwje5gkdm2bqer4drugey 222 224 Tatar Tatar NNP work_rujstqwje5gkdm2bqer4drugey 222 225 , , , work_rujstqwje5gkdm2bqer4drugey 222 226 Vietnamese Vietnamese NNP work_rujstqwje5gkdm2bqer4drugey 222 227 , , , work_rujstqwje5gkdm2bqer4drugey 222 228 Walloon Walloon NNP work_rujstqwje5gkdm2bqer4drugey 222 229 , , , work_rujstqwje5gkdm2bqer4drugey 222 230 Welsh Welsh NNP work_rujstqwje5gkdm2bqer4drugey 222 231 none none NN work_rujstqwje5gkdm2bqer4drugey 222 232 low low JJ work_rujstqwje5gkdm2bqer4drugey 222 233 or or CC work_rujstqwje5gkdm2bqer4drugey 222 234 medium medium NN work_rujstqwje5gkdm2bqer4drugey 222 235 slow slow JJ work_rujstqwje5gkdm2bqer4drugey 222 236 Esperanto Esperanto NNP work_rujstqwje5gkdm2bqer4drugey 222 237 , , , work_rujstqwje5gkdm2bqer4drugey 222 238 Ido Ido NNP work_rujstqwje5gkdm2bqer4drugey 222 239 , , , work_rujstqwje5gkdm2bqer4drugey 222 240 Kurdish Kurdish NNP work_rujstqwje5gkdm2bqer4drugey 222 241 , , , work_rujstqwje5gkdm2bqer4drugey 222 242 Per- Per- NNP work_rujstqwje5gkdm2bqer4drugey 222 243 sian sian NN work_rujstqwje5gkdm2bqer4drugey 222 244 , , , work_rujstqwje5gkdm2bqer4drugey 222 245 Quechua Quechua NNP work_rujstqwje5gkdm2bqer4drugey 222 246 , , , work_rujstqwje5gkdm2bqer4drugey 222 247 Wolof Wolof NNP work_rujstqwje5gkdm2bqer4drugey 222 248 , , , work_rujstqwje5gkdm2bqer4drugey 222 249 Zazaki Zazaki NNP work_rujstqwje5gkdm2bqer4drugey 222 250 Table Table NNP work_rujstqwje5gkdm2bqer4drugey 222 251 6 6 CD work_rujstqwje5gkdm2bqer4drugey 222 252 : : : work_rujstqwje5gkdm2bqer4drugey 222 253 The the DT work_rujstqwje5gkdm2bqer4drugey 222 254 green green JJ work_rujstqwje5gkdm2bqer4drugey 222 255 box box NN work_rujstqwje5gkdm2bqer4drugey 222 256 shows show VBZ work_rujstqwje5gkdm2bqer4drugey 222 257 the the DT work_rujstqwje5gkdm2bqer4drugey 222 258 best good JJS work_rujstqwje5gkdm2bqer4drugey 222 259 languages language NNS work_rujstqwje5gkdm2bqer4drugey 222 260 to to TO work_rujstqwje5gkdm2bqer4drugey 222 261 target target VB work_rujstqwje5gkdm2bqer4drugey 222 262 on on IN work_rujstqwje5gkdm2bqer4drugey 222 263 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 222 264 . . . work_rujstqwje5gkdm2bqer4drugey 223 1 These these DT work_rujstqwje5gkdm2bqer4drugey 223 2 languages language NNS work_rujstqwje5gkdm2bqer4drugey 223 3 have have VBP work_rujstqwje5gkdm2bqer4drugey 223 4 many many JJ work_rujstqwje5gkdm2bqer4drugey 223 5 work- work- NN work_rujstqwje5gkdm2bqer4drugey 223 6 ers er NNS work_rujstqwje5gkdm2bqer4drugey 223 7 who who WP work_rujstqwje5gkdm2bqer4drugey 223 8 generate generate VBP work_rujstqwje5gkdm2bqer4drugey 223 9 high high JJ work_rujstqwje5gkdm2bqer4drugey 223 10 quality quality NN work_rujstqwje5gkdm2bqer4drugey 223 11 results result NNS work_rujstqwje5gkdm2bqer4drugey 223 12 quickly quickly RB work_rujstqwje5gkdm2bqer4drugey 223 13 . . . work_rujstqwje5gkdm2bqer4drugey 224 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 224 2 defined define VBD work_rujstqwje5gkdm2bqer4drugey 224 3 many many JJ work_rujstqwje5gkdm2bqer4drugey 224 4 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 224 5 as as IN work_rujstqwje5gkdm2bqer4drugey 224 6 50 50 CD work_rujstqwje5gkdm2bqer4drugey 224 7 or or CC work_rujstqwje5gkdm2bqer4drugey 224 8 more more RBR work_rujstqwje5gkdm2bqer4drugey 224 9 active active JJ work_rujstqwje5gkdm2bqer4drugey 224 10 in in IN work_rujstqwje5gkdm2bqer4drugey 224 11 - - HYPH work_rujstqwje5gkdm2bqer4drugey 224 12 region region NN work_rujstqwje5gkdm2bqer4drugey 224 13 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 224 14 , , , work_rujstqwje5gkdm2bqer4drugey 224 15 high high JJ work_rujstqwje5gkdm2bqer4drugey 224 16 quality quality NN work_rujstqwje5gkdm2bqer4drugey 224 17 as as IN work_rujstqwje5gkdm2bqer4drugey 224 18 ≥70 ≥70 CD work_rujstqwje5gkdm2bqer4drugey 224 19 % % NN work_rujstqwje5gkdm2bqer4drugey 224 20 accuracy accuracy NN work_rujstqwje5gkdm2bqer4drugey 224 21 on on IN work_rujstqwje5gkdm2bqer4drugey 224 22 the the DT work_rujstqwje5gkdm2bqer4drugey 224 23 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 224 24 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 224 25 controls control NNS work_rujstqwje5gkdm2bqer4drugey 224 26 , , , work_rujstqwje5gkdm2bqer4drugey 224 27 and and CC work_rujstqwje5gkdm2bqer4drugey 224 28 fast fast VB work_rujstqwje5gkdm2bqer4drugey 224 29 if if IN work_rujstqwje5gkdm2bqer4drugey 224 30 all all DT work_rujstqwje5gkdm2bqer4drugey 224 31 of of IN work_rujstqwje5gkdm2bqer4drugey 224 32 the the DT work_rujstqwje5gkdm2bqer4drugey 224 33 10,000 10,000 CD work_rujstqwje5gkdm2bqer4drugey 224 34 words word NNS work_rujstqwje5gkdm2bqer4drugey 224 35 were be VBD work_rujstqwje5gkdm2bqer4drugey 224 36 completed complete VBN work_rujstqwje5gkdm2bqer4drugey 224 37 within within IN work_rujstqwje5gkdm2bqer4drugey 224 38 two two CD work_rujstqwje5gkdm2bqer4drugey 224 39 weeks week NNS work_rujstqwje5gkdm2bqer4drugey 224 40 . . . work_rujstqwje5gkdm2bqer4drugey 225 1 candidates candidate NNS work_rujstqwje5gkdm2bqer4drugey 225 2 provided provide VBD work_rujstqwje5gkdm2bqer4drugey 225 3 adequate adequate JJ work_rujstqwje5gkdm2bqer4drugey 225 4 quality quality NN work_rujstqwje5gkdm2bqer4drugey 225 5 control control NN work_rujstqwje5gkdm2bqer4drugey 225 6 mech- mech- JJ work_rujstqwje5gkdm2bqer4drugey 225 7 anisms anism NNS work_rujstqwje5gkdm2bqer4drugey 225 8 are be VBP work_rujstqwje5gkdm2bqer4drugey 225 9 used use VBN work_rujstqwje5gkdm2bqer4drugey 225 10 to to TO work_rujstqwje5gkdm2bqer4drugey 225 11 select select VB work_rujstqwje5gkdm2bqer4drugey 225 12 good good JJ work_rujstqwje5gkdm2bqer4drugey 225 13 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 225 14 . . . work_rujstqwje5gkdm2bqer4drugey 226 1 Since since IN work_rujstqwje5gkdm2bqer4drugey 226 2 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 226 3 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 226 4 provides provide VBZ work_rujstqwje5gkdm2bqer4drugey 226 5 financial financial JJ work_rujstqwje5gkdm2bqer4drugey 226 6 incen- incen- NN work_rujstqwje5gkdm2bqer4drugey 226 7 tives tive NNS work_rujstqwje5gkdm2bqer4drugey 226 8 for for IN work_rujstqwje5gkdm2bqer4drugey 226 9 participation participation NN work_rujstqwje5gkdm2bqer4drugey 226 10 , , , work_rujstqwje5gkdm2bqer4drugey 226 11 many many JJ work_rujstqwje5gkdm2bqer4drugey 226 12 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 226 13 attempt attempt VBP work_rujstqwje5gkdm2bqer4drugey 226 14 to to TO work_rujstqwje5gkdm2bqer4drugey 226 15 complete complete VB work_rujstqwje5gkdm2bqer4drugey 226 16 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 226 17 even even RB work_rujstqwje5gkdm2bqer4drugey 226 18 if if IN work_rujstqwje5gkdm2bqer4drugey 226 19 they -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 226 20 do do VBP work_rujstqwje5gkdm2bqer4drugey 226 21 not not RB work_rujstqwje5gkdm2bqer4drugey 226 22 have have VB work_rujstqwje5gkdm2bqer4drugey 226 23 the the DT work_rujstqwje5gkdm2bqer4drugey 226 24 lan- lan- NN work_rujstqwje5gkdm2bqer4drugey 226 25 guage guage NN work_rujstqwje5gkdm2bqer4drugey 226 26 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 226 27 necessary necessary JJ work_rujstqwje5gkdm2bqer4drugey 226 28 to to TO work_rujstqwje5gkdm2bqer4drugey 226 29 do do VB work_rujstqwje5gkdm2bqer4drugey 226 30 so so RB work_rujstqwje5gkdm2bqer4drugey 226 31 . . . work_rujstqwje5gkdm2bqer4drugey 227 1 Since since IN work_rujstqwje5gkdm2bqer4drugey 227 2 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 227 3 does do VBZ work_rujstqwje5gkdm2bqer4drugey 227 4 not not RB work_rujstqwje5gkdm2bqer4drugey 227 5 provide provide VB work_rujstqwje5gkdm2bqer4drugey 227 6 any any DT work_rujstqwje5gkdm2bqer4drugey 227 7 information information NN work_rujstqwje5gkdm2bqer4drugey 227 8 about about IN work_rujstqwje5gkdm2bqer4drugey 227 9 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 227 10 demo- demo- NN work_rujstqwje5gkdm2bqer4drugey 227 11 graphics graphic NNS work_rujstqwje5gkdm2bqer4drugey 227 12 , , , work_rujstqwje5gkdm2bqer4drugey 227 13 including include VBG work_rujstqwje5gkdm2bqer4drugey 227 14 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 227 15 language language NN work_rujstqwje5gkdm2bqer4drugey 227 16 competencies competency NNS work_rujstqwje5gkdm2bqer4drugey 227 17 , , , work_rujstqwje5gkdm2bqer4drugey 227 18 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 227 19 can can MD work_rujstqwje5gkdm2bqer4drugey 227 20 be be VB work_rujstqwje5gkdm2bqer4drugey 227 21 hard hard JJ work_rujstqwje5gkdm2bqer4drugey 227 22 to to TO work_rujstqwje5gkdm2bqer4drugey 227 23 exclude exclude VB work_rujstqwje5gkdm2bqer4drugey 227 24 such such JJ work_rujstqwje5gkdm2bqer4drugey 227 25 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 227 26 . . . work_rujstqwje5gkdm2bqer4drugey 228 1 As as IN work_rujstqwje5gkdm2bqer4drugey 228 2 a a DT work_rujstqwje5gkdm2bqer4drugey 228 3 result result NN work_rujstqwje5gkdm2bqer4drugey 228 4 naive naive JJ work_rujstqwje5gkdm2bqer4drugey 228 5 data datum NNS work_rujstqwje5gkdm2bqer4drugey 228 6 collection collection NN work_rujstqwje5gkdm2bqer4drugey 228 7 on on IN work_rujstqwje5gkdm2bqer4drugey 228 8 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 228 9 may may MD work_rujstqwje5gkdm2bqer4drugey 228 10 result result VB work_rujstqwje5gkdm2bqer4drugey 228 11 in in IN work_rujstqwje5gkdm2bqer4drugey 228 12 noisy noisy JJ work_rujstqwje5gkdm2bqer4drugey 228 13 data datum NNS work_rujstqwje5gkdm2bqer4drugey 228 14 . . . work_rujstqwje5gkdm2bqer4drugey 229 1 A a DT work_rujstqwje5gkdm2bqer4drugey 229 2 variety variety NN work_rujstqwje5gkdm2bqer4drugey 229 3 of of IN work_rujstqwje5gkdm2bqer4drugey 229 4 techniques technique NNS work_rujstqwje5gkdm2bqer4drugey 229 5 should should MD work_rujstqwje5gkdm2bqer4drugey 229 6 be be VB work_rujstqwje5gkdm2bqer4drugey 229 7 incorporated incorporate VBN work_rujstqwje5gkdm2bqer4drugey 229 8 into into IN work_rujstqwje5gkdm2bqer4drugey 229 9 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 229 10 pipelines pipeline NNS work_rujstqwje5gkdm2bqer4drugey 229 11 to to TO work_rujstqwje5gkdm2bqer4drugey 229 12 ensure ensure VB work_rujstqwje5gkdm2bqer4drugey 229 13 high high JJ work_rujstqwje5gkdm2bqer4drugey 229 14 quality quality NN work_rujstqwje5gkdm2bqer4drugey 229 15 data datum NNS work_rujstqwje5gkdm2bqer4drugey 229 16 . . . work_rujstqwje5gkdm2bqer4drugey 230 1 As as IN work_rujstqwje5gkdm2bqer4drugey 230 2 a a DT work_rujstqwje5gkdm2bqer4drugey 230 3 best good JJS work_rujstqwje5gkdm2bqer4drugey 230 4 practice practice NN work_rujstqwje5gkdm2bqer4drugey 230 5 , , , work_rujstqwje5gkdm2bqer4drugey 230 6 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 230 7 suggest suggest VBP work_rujstqwje5gkdm2bqer4drugey 230 8 : : : work_rujstqwje5gkdm2bqer4drugey 230 9 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 230 10 1 1 LS work_rujstqwje5gkdm2bqer4drugey 230 11 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 230 12 restricting restrict VBG work_rujstqwje5gkdm2bqer4drugey 230 13 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 230 14 to to IN work_rujstqwje5gkdm2bqer4drugey 230 15 countries country NNS work_rujstqwje5gkdm2bqer4drugey 230 16 that that WDT work_rujstqwje5gkdm2bqer4drugey 230 17 plausibly plausibly RB work_rujstqwje5gkdm2bqer4drugey 230 18 speak speak VBP work_rujstqwje5gkdm2bqer4drugey 230 19 the the DT work_rujstqwje5gkdm2bqer4drugey 230 20 foreign foreign JJ work_rujstqwje5gkdm2bqer4drugey 230 21 language language NN work_rujstqwje5gkdm2bqer4drugey 230 22 of of IN work_rujstqwje5gkdm2bqer4drugey 230 23 interest interest NN work_rujstqwje5gkdm2bqer4drugey 230 24 , , , work_rujstqwje5gkdm2bqer4drugey 230 25 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 230 26 2 2 LS work_rujstqwje5gkdm2bqer4drugey 230 27 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 230 28 embedding embed VBG work_rujstqwje5gkdm2bqer4drugey 230 29 gold gold JJ work_rujstqwje5gkdm2bqer4drugey 230 30 standard standard JJ work_rujstqwje5gkdm2bqer4drugey 230 31 controls control NNS work_rujstqwje5gkdm2bqer4drugey 230 32 or or CC work_rujstqwje5gkdm2bqer4drugey 230 33 administering administer VBG work_rujstqwje5gkdm2bqer4drugey 230 34 language language NN work_rujstqwje5gkdm2bqer4drugey 230 35 pretests pretest NNS work_rujstqwje5gkdm2bqer4drugey 230 36 , , , work_rujstqwje5gkdm2bqer4drugey 230 37 rather rather RB work_rujstqwje5gkdm2bqer4drugey 230 38 than than IN work_rujstqwje5gkdm2bqer4drugey 230 39 relying rely VBG work_rujstqwje5gkdm2bqer4drugey 230 40 solely solely RB work_rujstqwje5gkdm2bqer4drugey 230 41 on on IN work_rujstqwje5gkdm2bqer4drugey 230 42 self self NN work_rujstqwje5gkdm2bqer4drugey 230 43 - - HYPH work_rujstqwje5gkdm2bqer4drugey 230 44 reported report VBN work_rujstqwje5gkdm2bqer4drugey 230 45 language language NN work_rujstqwje5gkdm2bqer4drugey 230 46 skills skill NNS work_rujstqwje5gkdm2bqer4drugey 230 47 , , , work_rujstqwje5gkdm2bqer4drugey 230 48 and and CC work_rujstqwje5gkdm2bqer4drugey 230 49 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 230 50 3 3 LS work_rujstqwje5gkdm2bqer4drugey 230 51 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 230 52 excluding exclude VBG work_rujstqwje5gkdm2bqer4drugey 230 53 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 230 54 whose whose WP$ work_rujstqwje5gkdm2bqer4drugey 230 55 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 230 56 have have VBP work_rujstqwje5gkdm2bqer4drugey 230 57 high high JJ work_rujstqwje5gkdm2bqer4drugey 230 58 overlap overlap NN work_rujstqwje5gkdm2bqer4drugey 230 59 with with IN work_rujstqwje5gkdm2bqer4drugey 230 60 online online JJ work_rujstqwje5gkdm2bqer4drugey 230 61 machine machine NN work_rujstqwje5gkdm2bqer4drugey 230 62 translation translation NN work_rujstqwje5gkdm2bqer4drugey 230 63 sys- sys- NN work_rujstqwje5gkdm2bqer4drugey 230 64 tems tem NNS work_rujstqwje5gkdm2bqer4drugey 230 65 like like IN work_rujstqwje5gkdm2bqer4drugey 230 66 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 230 67 translate translate NN work_rujstqwje5gkdm2bqer4drugey 230 68 . . . work_rujstqwje5gkdm2bqer4drugey 231 1 If if IN work_rujstqwje5gkdm2bqer4drugey 231 2 cheating cheat VBG work_rujstqwje5gkdm2bqer4drugey 231 3 using use VBG work_rujstqwje5gkdm2bqer4drugey 231 4 exter- exter- NN work_rujstqwje5gkdm2bqer4drugey 231 5 nal nal NNP work_rujstqwje5gkdm2bqer4drugey 231 6 resources resource NNS work_rujstqwje5gkdm2bqer4drugey 231 7 is be VBZ work_rujstqwje5gkdm2bqer4drugey 231 8 likely likely JJ work_rujstqwje5gkdm2bqer4drugey 231 9 , , , work_rujstqwje5gkdm2bqer4drugey 231 10 then then RB work_rujstqwje5gkdm2bqer4drugey 231 11 also also RB work_rujstqwje5gkdm2bqer4drugey 231 12 consider consider VB work_rujstqwje5gkdm2bqer4drugey 231 13 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 231 14 4 4 CD work_rujstqwje5gkdm2bqer4drugey 231 15 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 231 16 record- record- NN work_rujstqwje5gkdm2bqer4drugey 231 17 ing ing NN work_rujstqwje5gkdm2bqer4drugey 231 18 information information NN work_rujstqwje5gkdm2bqer4drugey 231 19 like like IN work_rujstqwje5gkdm2bqer4drugey 231 20 time time NN work_rujstqwje5gkdm2bqer4drugey 231 21 spent spend VBN work_rujstqwje5gkdm2bqer4drugey 231 22 on on IN work_rujstqwje5gkdm2bqer4drugey 231 23 a a DT work_rujstqwje5gkdm2bqer4drugey 231 24 HIT hit NN work_rujstqwje5gkdm2bqer4drugey 231 25 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 231 26 cumulative cumulative JJ work_rujstqwje5gkdm2bqer4drugey 231 27 and and CC work_rujstqwje5gkdm2bqer4drugey 231 28 on on IN work_rujstqwje5gkdm2bqer4drugey 231 29 individual individual JJ work_rujstqwje5gkdm2bqer4drugey 231 30 items item NNS work_rujstqwje5gkdm2bqer4drugey 231 31 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 231 32 , , , work_rujstqwje5gkdm2bqer4drugey 231 33 patterns pattern NNS work_rujstqwje5gkdm2bqer4drugey 231 34 in in IN work_rujstqwje5gkdm2bqer4drugey 231 35 keystroke keystroke NNP work_rujstqwje5gkdm2bqer4drugey 231 36 logs logs NNP work_rujstqwje5gkdm2bqer4drugey 231 37 , , , work_rujstqwje5gkdm2bqer4drugey 231 38 tab tab NNP work_rujstqwje5gkdm2bqer4drugey 231 39 / / SYM work_rujstqwje5gkdm2bqer4drugey 231 40 window window NN work_rujstqwje5gkdm2bqer4drugey 231 41 focus focus NN work_rujstqwje5gkdm2bqer4drugey 231 42 , , , work_rujstqwje5gkdm2bqer4drugey 231 43 etc etc FW work_rujstqwje5gkdm2bqer4drugey 231 44 . . . work_rujstqwje5gkdm2bqer4drugey 232 1 Although although IN work_rujstqwje5gkdm2bqer4drugey 232 2 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 232 3 study study NN work_rujstqwje5gkdm2bqer4drugey 232 4 targeted target VBD work_rujstqwje5gkdm2bqer4drugey 232 5 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 232 6 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 232 7 on on IN work_rujstqwje5gkdm2bqer4drugey 232 8 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 232 9 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 232 10 , , , work_rujstqwje5gkdm2bqer4drugey 232 11 and and CC work_rujstqwje5gkdm2bqer4drugey 232 12 neglected neglect VBD work_rujstqwje5gkdm2bqer4drugey 232 13 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 232 14 work- work- NN work_rujstqwje5gkdm2bqer4drugey 232 15 ers ers NNP work_rujstqwje5gkdm2bqer4drugey 232 16 , , , work_rujstqwje5gkdm2bqer4drugey 232 17 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 232 18 believe believe VBP work_rujstqwje5gkdm2bqer4drugey 232 19 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 232 20 results result NNS work_rujstqwje5gkdm2bqer4drugey 232 21 reliably reliably RB work_rujstqwje5gkdm2bqer4drugey 232 22 represent represent VBP work_rujstqwje5gkdm2bqer4drugey 232 23 the the DT work_rujstqwje5gkdm2bqer4drugey 232 24 cur- cur- NN work_rujstqwje5gkdm2bqer4drugey 232 25 rent rent NN work_rujstqwje5gkdm2bqer4drugey 232 26 speaker speaker NN work_rujstqwje5gkdm2bqer4drugey 232 27 populations population NNS work_rujstqwje5gkdm2bqer4drugey 232 28 , , , work_rujstqwje5gkdm2bqer4drugey 232 29 since since IN work_rujstqwje5gkdm2bqer4drugey 232 30 the the DT work_rujstqwje5gkdm2bqer4drugey 232 31 vast vast JJ work_rujstqwje5gkdm2bqer4drugey 232 32 majority majority NN work_rujstqwje5gkdm2bqer4drugey 232 33 of of IN work_rujstqwje5gkdm2bqer4drugey 232 34 the the DT work_rujstqwje5gkdm2bqer4drugey 232 35 work work NN work_rujstqwje5gkdm2bqer4drugey 232 36 available available JJ work_rujstqwje5gkdm2bqer4drugey 232 37 on on IN work_rujstqwje5gkdm2bqer4drugey 232 38 the the DT work_rujstqwje5gkdm2bqer4drugey 232 39 crowdsourced crowdsourced JJ work_rujstqwje5gkdm2bqer4drugey 232 40 platform platform NN work_rujstqwje5gkdm2bqer4drugey 232 41 is be VBZ work_rujstqwje5gkdm2bqer4drugey 232 42 currently currently RB work_rujstqwje5gkdm2bqer4drugey 232 43 English English NNP work_rujstqwje5gkdm2bqer4drugey 232 44 - - HYPH work_rujstqwje5gkdm2bqer4drugey 232 45 only only RB work_rujstqwje5gkdm2bqer4drugey 232 46 . . . work_rujstqwje5gkdm2bqer4drugey 233 1 We -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 233 2 therefore therefore RB work_rujstqwje5gkdm2bqer4drugey 233 3 assume assume VBP work_rujstqwje5gkdm2bqer4drugey 233 4 the the DT work_rujstqwje5gkdm2bqer4drugey 233 5 number number NN work_rujstqwje5gkdm2bqer4drugey 233 6 of of IN work_rujstqwje5gkdm2bqer4drugey 233 7 non non JJ work_rujstqwje5gkdm2bqer4drugey 233 8 - - JJ work_rujstqwje5gkdm2bqer4drugey 233 9 English english JJ work_rujstqwje5gkdm2bqer4drugey 233 10 speakers speaker NNS work_rujstqwje5gkdm2bqer4drugey 233 11 is be VBZ work_rujstqwje5gkdm2bqer4drugey 233 12 small small JJ work_rujstqwje5gkdm2bqer4drugey 233 13 . . . work_rujstqwje5gkdm2bqer4drugey 234 1 In in IN work_rujstqwje5gkdm2bqer4drugey 234 2 the the DT work_rujstqwje5gkdm2bqer4drugey 234 3 fu- fu- JJ work_rujstqwje5gkdm2bqer4drugey 234 4 ture ture NN work_rujstqwje5gkdm2bqer4drugey 234 5 , , , work_rujstqwje5gkdm2bqer4drugey 234 6 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 234 7 may may MD work_rujstqwje5gkdm2bqer4drugey 234 8 be be VB work_rujstqwje5gkdm2bqer4drugey 234 9 desirable desirable JJ work_rujstqwje5gkdm2bqer4drugey 234 10 to to TO work_rujstqwje5gkdm2bqer4drugey 234 11 recruit recruit VB work_rujstqwje5gkdm2bqer4drugey 234 12 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 234 13 for- for- NN work_rujstqwje5gkdm2bqer4drugey 234 14 eign eign JJ work_rujstqwje5gkdm2bqer4drugey 234 15 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 234 16 . . . work_rujstqwje5gkdm2bqer4drugey 235 1 In in IN work_rujstqwje5gkdm2bqer4drugey 235 2 such such JJ work_rujstqwje5gkdm2bqer4drugey 235 3 cases case NNS work_rujstqwje5gkdm2bqer4drugey 235 4 , , , work_rujstqwje5gkdm2bqer4drugey 235 5 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 235 6 recommend recommend VBP work_rujstqwje5gkdm2bqer4drugey 235 7 other other JJ work_rujstqwje5gkdm2bqer4drugey 235 8 tests test NNS work_rujstqwje5gkdm2bqer4drugey 235 9 to to TO work_rujstqwje5gkdm2bqer4drugey 235 10 validate validate VB work_rujstqwje5gkdm2bqer4drugey 235 11 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 235 12 language language NN work_rujstqwje5gkdm2bqer4drugey 235 13 abilities ability NNS work_rujstqwje5gkdm2bqer4drugey 235 14 in in IN work_rujstqwje5gkdm2bqer4drugey 235 15 place place NN work_rujstqwje5gkdm2bqer4drugey 235 16 of of IN work_rujstqwje5gkdm2bqer4drugey 235 17 our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 235 18 translation translation NN work_rujstqwje5gkdm2bqer4drugey 235 19 test test NN work_rujstqwje5gkdm2bqer4drugey 235 20 . . . work_rujstqwje5gkdm2bqer4drugey 236 1 These these DT work_rujstqwje5gkdm2bqer4drugey 236 2 could could MD work_rujstqwje5gkdm2bqer4drugey 236 3 include include VB work_rujstqwje5gkdm2bqer4drugey 236 4 perform- perform- NNP work_rujstqwje5gkdm2bqer4drugey 236 5 ing ing NNP work_rujstqwje5gkdm2bqer4drugey 236 6 narrative narrative JJ work_rujstqwje5gkdm2bqer4drugey 236 7 cloze cloze NN work_rujstqwje5gkdm2bqer4drugey 236 8 , , , work_rujstqwje5gkdm2bqer4drugey 236 9 or or CC work_rujstqwje5gkdm2bqer4drugey 236 10 listening listen VBG work_rujstqwje5gkdm2bqer4drugey 236 11 to to IN work_rujstqwje5gkdm2bqer4drugey 236 12 audio audio JJ work_rujstqwje5gkdm2bqer4drugey 236 13 files file NNS work_rujstqwje5gkdm2bqer4drugey 236 14 con- con- NN work_rujstqwje5gkdm2bqer4drugey 236 15 taining taine VBG work_rujstqwje5gkdm2bqer4drugey 236 16 speech speech NN work_rujstqwje5gkdm2bqer4drugey 236 17 in in IN work_rujstqwje5gkdm2bqer4drugey 236 18 different different JJ work_rujstqwje5gkdm2bqer4drugey 236 19 language language NN work_rujstqwje5gkdm2bqer4drugey 236 20 and and CC work_rujstqwje5gkdm2bqer4drugey 236 21 identifying identify VBG work_rujstqwje5gkdm2bqer4drugey 236 22 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 236 23 language language NN work_rujstqwje5gkdm2bqer4drugey 236 24 . . . work_rujstqwje5gkdm2bqer4drugey 237 1 7 7 CD work_rujstqwje5gkdm2bqer4drugey 237 2 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 237 3 release release NN work_rujstqwje5gkdm2bqer4drugey 237 4 With with IN work_rujstqwje5gkdm2bqer4drugey 237 5 the the DT work_rujstqwje5gkdm2bqer4drugey 237 6 publication publication NN work_rujstqwje5gkdm2bqer4drugey 237 7 of of IN work_rujstqwje5gkdm2bqer4drugey 237 8 this this DT work_rujstqwje5gkdm2bqer4drugey 237 9 paper paper NN work_rujstqwje5gkdm2bqer4drugey 237 10 , , , work_rujstqwje5gkdm2bqer4drugey 237 11 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 237 12 are be VBP work_rujstqwje5gkdm2bqer4drugey 237 13 releasing release VBG work_rujstqwje5gkdm2bqer4drugey 237 14 all all DT work_rujstqwje5gkdm2bqer4drugey 237 15 data datum NNS work_rujstqwje5gkdm2bqer4drugey 237 16 and and CC work_rujstqwje5gkdm2bqer4drugey 237 17 code code NN work_rujstqwje5gkdm2bqer4drugey 237 18 used use VBN work_rujstqwje5gkdm2bqer4drugey 237 19 in in IN work_rujstqwje5gkdm2bqer4drugey 237 20 this this DT work_rujstqwje5gkdm2bqer4drugey 237 21 study study NN work_rujstqwje5gkdm2bqer4drugey 237 22 . . . work_rujstqwje5gkdm2bqer4drugey 238 1 Our -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 238 2 data data NN work_rujstqwje5gkdm2bqer4drugey 238 3 release release NN work_rujstqwje5gkdm2bqer4drugey 238 4 includes include VBZ work_rujstqwje5gkdm2bqer4drugey 238 5 the the DT work_rujstqwje5gkdm2bqer4drugey 238 6 raw raw JJ work_rujstqwje5gkdm2bqer4drugey 238 7 data datum NNS work_rujstqwje5gkdm2bqer4drugey 238 8 , , , work_rujstqwje5gkdm2bqer4drugey 238 9 along along IN work_rujstqwje5gkdm2bqer4drugey 238 10 with with IN work_rujstqwje5gkdm2bqer4drugey 238 11 bilingual bilingual JJ work_rujstqwje5gkdm2bqer4drugey 238 12 dictionar- dictionar- NN work_rujstqwje5gkdm2bqer4drugey 238 13 ies ie NNS work_rujstqwje5gkdm2bqer4drugey 238 14 that that WDT work_rujstqwje5gkdm2bqer4drugey 238 15 are be VBP work_rujstqwje5gkdm2bqer4drugey 238 16 filtered filter VBN work_rujstqwje5gkdm2bqer4drugey 238 17 to to TO work_rujstqwje5gkdm2bqer4drugey 238 18 be be VB work_rujstqwje5gkdm2bqer4drugey 238 19 high high JJ work_rujstqwje5gkdm2bqer4drugey 238 20 quality quality NN work_rujstqwje5gkdm2bqer4drugey 238 21 . . . work_rujstqwje5gkdm2bqer4drugey 239 1 It -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 239 2 will will MD work_rujstqwje5gkdm2bqer4drugey 239 3 include include VB work_rujstqwje5gkdm2bqer4drugey 239 4 256,604 256,604 CD work_rujstqwje5gkdm2bqer4drugey 239 5 translation translation NN work_rujstqwje5gkdm2bqer4drugey 239 6 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 239 7 from from IN work_rujstqwje5gkdm2bqer4drugey 239 8 5,281 5,281 CD work_rujstqwje5gkdm2bqer4drugey 239 9 Turkers Turkers NNPS work_rujstqwje5gkdm2bqer4drugey 239 10 and and CC work_rujstqwje5gkdm2bqer4drugey 239 11 20,952 20,952 CD work_rujstqwje5gkdm2bqer4drugey 239 12 synonym synonym NN work_rujstqwje5gkdm2bqer4drugey 239 13 assignments assignment NNS work_rujstqwje5gkdm2bqer4drugey 239 14 from from IN work_rujstqwje5gkdm2bqer4drugey 239 15 1,005 1,005 CD work_rujstqwje5gkdm2bqer4drugey 239 16 Turk- Turk- NNP work_rujstqwje5gkdm2bqer4drugey 239 17 ers er NNS work_rujstqwje5gkdm2bqer4drugey 239 18 , , , work_rujstqwje5gkdm2bqer4drugey 239 19 along along IN work_rujstqwje5gkdm2bqer4drugey 239 20 with with IN work_rujstqwje5gkdm2bqer4drugey 239 21 meta meta JJ work_rujstqwje5gkdm2bqer4drugey 239 22 information information NN work_rujstqwje5gkdm2bqer4drugey 239 23 like like IN work_rujstqwje5gkdm2bqer4drugey 239 24 geolocation geolocation NN work_rujstqwje5gkdm2bqer4drugey 239 25 88 88 CD work_rujstqwje5gkdm2bqer4drugey 239 26 and and CC work_rujstqwje5gkdm2bqer4drugey 239 27 time time NN work_rujstqwje5gkdm2bqer4drugey 239 28 submitted submit VBN work_rujstqwje5gkdm2bqer4drugey 239 29 , , , work_rujstqwje5gkdm2bqer4drugey 239 30 plus plus CC work_rujstqwje5gkdm2bqer4drugey 239 31 external external JJ work_rujstqwje5gkdm2bqer4drugey 239 32 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 239 33 used use VBN work_rujstqwje5gkdm2bqer4drugey 239 34 for for IN work_rujstqwje5gkdm2bqer4drugey 239 35 validation validation NN work_rujstqwje5gkdm2bqer4drugey 239 36 . . . work_rujstqwje5gkdm2bqer4drugey 240 1 The the DT work_rujstqwje5gkdm2bqer4drugey 240 2 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 240 3 will will MD work_rujstqwje5gkdm2bqer4drugey 240 4 contain contain VB work_rujstqwje5gkdm2bqer4drugey 240 5 1.5 1.5 CD work_rujstqwje5gkdm2bqer4drugey 240 6 M M NNP work_rujstqwje5gkdm2bqer4drugey 240 7 total total NN work_rujstqwje5gkdm2bqer4drugey 240 8 translated translate VBN work_rujstqwje5gkdm2bqer4drugey 240 9 words word NNS work_rujstqwje5gkdm2bqer4drugey 240 10 in in IN work_rujstqwje5gkdm2bqer4drugey 240 11 100 100 CD work_rujstqwje5gkdm2bqer4drugey 240 12 languages language NNS work_rujstqwje5gkdm2bqer4drugey 240 13 , , , work_rujstqwje5gkdm2bqer4drugey 240 14 along along IN work_rujstqwje5gkdm2bqer4drugey 240 15 with with IN work_rujstqwje5gkdm2bqer4drugey 240 16 code code NN work_rujstqwje5gkdm2bqer4drugey 240 17 to to TO work_rujstqwje5gkdm2bqer4drugey 240 18 filter filter VB work_rujstqwje5gkdm2bqer4drugey 240 19 the the DT work_rujstqwje5gkdm2bqer4drugey 240 20 dictionaries dictionary NNS work_rujstqwje5gkdm2bqer4drugey 240 21 based base VBN work_rujstqwje5gkdm2bqer4drugey 240 22 on on IN work_rujstqwje5gkdm2bqer4drugey 240 23 different different JJ work_rujstqwje5gkdm2bqer4drugey 240 24 cri- cri- NN work_rujstqwje5gkdm2bqer4drugey 240 25 teria teria NN work_rujstqwje5gkdm2bqer4drugey 240 26 . . . work_rujstqwje5gkdm2bqer4drugey 241 1 The the DT work_rujstqwje5gkdm2bqer4drugey 241 2 data datum NNS work_rujstqwje5gkdm2bqer4drugey 241 3 also also RB work_rujstqwje5gkdm2bqer4drugey 241 4 includes include VBZ work_rujstqwje5gkdm2bqer4drugey 241 5 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 241 6 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 241 7 for for IN work_rujstqwje5gkdm2bqer4drugey 241 8 six six CD work_rujstqwje5gkdm2bqer4drugey 241 9 Indian indian JJ work_rujstqwje5gkdm2bqer4drugey 241 10 languages language NNS work_rujstqwje5gkdm2bqer4drugey 241 11 , , , work_rujstqwje5gkdm2bqer4drugey 241 12 ranging range VBG work_rujstqwje5gkdm2bqer4drugey 241 13 in in IN work_rujstqwje5gkdm2bqer4drugey 241 14 size size NN work_rujstqwje5gkdm2bqer4drugey 241 15 between between IN work_rujstqwje5gkdm2bqer4drugey 241 16 700,000 700,000 CD work_rujstqwje5gkdm2bqer4drugey 241 17 to to TO work_rujstqwje5gkdm2bqer4drugey 241 18 1.5 1.5 CD work_rujstqwje5gkdm2bqer4drugey 241 19 million million CD work_rujstqwje5gkdm2bqer4drugey 241 20 words word NNS work_rujstqwje5gkdm2bqer4drugey 241 21 . . . work_rujstqwje5gkdm2bqer4drugey 242 1 8 8 CD work_rujstqwje5gkdm2bqer4drugey 242 2 Acknowledgements acknowledgement NNS work_rujstqwje5gkdm2bqer4drugey 242 3 This this DT work_rujstqwje5gkdm2bqer4drugey 242 4 material material NN work_rujstqwje5gkdm2bqer4drugey 242 5 is be VBZ work_rujstqwje5gkdm2bqer4drugey 242 6 based base VBN work_rujstqwje5gkdm2bqer4drugey 242 7 on on IN work_rujstqwje5gkdm2bqer4drugey 242 8 research research NN work_rujstqwje5gkdm2bqer4drugey 242 9 sponsored sponsor VBN work_rujstqwje5gkdm2bqer4drugey 242 10 by by IN work_rujstqwje5gkdm2bqer4drugey 242 11 a a DT work_rujstqwje5gkdm2bqer4drugey 242 12 DARPA DARPA NNP work_rujstqwje5gkdm2bqer4drugey 242 13 Computer Computer NNP work_rujstqwje5gkdm2bqer4drugey 242 14 Science Science NNP work_rujstqwje5gkdm2bqer4drugey 242 15 Study Study NNP work_rujstqwje5gkdm2bqer4drugey 242 16 Panel Panel NNP work_rujstqwje5gkdm2bqer4drugey 242 17 phase phase NN work_rujstqwje5gkdm2bqer4drugey 242 18 3 3 CD work_rujstqwje5gkdm2bqer4drugey 242 19 award award NN work_rujstqwje5gkdm2bqer4drugey 242 20 entitled entitle VBN work_rujstqwje5gkdm2bqer4drugey 242 21 “ " `` work_rujstqwje5gkdm2bqer4drugey 242 22 Crowdsourcing Crowdsourcing NNP work_rujstqwje5gkdm2bqer4drugey 242 23 Translation Translation NNP work_rujstqwje5gkdm2bqer4drugey 242 24 ” " '' work_rujstqwje5gkdm2bqer4drugey 242 25 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 242 26 con- con- NN work_rujstqwje5gkdm2bqer4drugey 242 27 tract tract NNP work_rujstqwje5gkdm2bqer4drugey 242 28 D12PC00368 D12PC00368 NNP work_rujstqwje5gkdm2bqer4drugey 242 29 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 242 30 . . . work_rujstqwje5gkdm2bqer4drugey 243 1 The the DT work_rujstqwje5gkdm2bqer4drugey 243 2 views view NNS work_rujstqwje5gkdm2bqer4drugey 243 3 and and CC work_rujstqwje5gkdm2bqer4drugey 243 4 conclusions conclusion NNS work_rujstqwje5gkdm2bqer4drugey 243 5 contained contain VBN work_rujstqwje5gkdm2bqer4drugey 243 6 in in IN work_rujstqwje5gkdm2bqer4drugey 243 7 this this DT work_rujstqwje5gkdm2bqer4drugey 243 8 publication publication NN work_rujstqwje5gkdm2bqer4drugey 243 9 are be VBP work_rujstqwje5gkdm2bqer4drugey 243 10 those those DT work_rujstqwje5gkdm2bqer4drugey 243 11 of of IN work_rujstqwje5gkdm2bqer4drugey 243 12 the the DT work_rujstqwje5gkdm2bqer4drugey 243 13 authors author NNS work_rujstqwje5gkdm2bqer4drugey 243 14 and and CC work_rujstqwje5gkdm2bqer4drugey 243 15 should should MD work_rujstqwje5gkdm2bqer4drugey 243 16 not not RB work_rujstqwje5gkdm2bqer4drugey 243 17 be be VB work_rujstqwje5gkdm2bqer4drugey 243 18 interpreted interpret VBN work_rujstqwje5gkdm2bqer4drugey 243 19 as as IN work_rujstqwje5gkdm2bqer4drugey 243 20 representing represent VBG work_rujstqwje5gkdm2bqer4drugey 243 21 offi- offi- JJ work_rujstqwje5gkdm2bqer4drugey 243 22 cial cial JJ work_rujstqwje5gkdm2bqer4drugey 243 23 policies policy NNS work_rujstqwje5gkdm2bqer4drugey 243 24 or or CC work_rujstqwje5gkdm2bqer4drugey 243 25 endorsements endorsement NNS work_rujstqwje5gkdm2bqer4drugey 243 26 by by IN work_rujstqwje5gkdm2bqer4drugey 243 27 DARPA DARPA NNP work_rujstqwje5gkdm2bqer4drugey 243 28 or or CC work_rujstqwje5gkdm2bqer4drugey 243 29 the the DT work_rujstqwje5gkdm2bqer4drugey 243 30 U.S. U.S. NNP work_rujstqwje5gkdm2bqer4drugey 243 31 Government Government NNP work_rujstqwje5gkdm2bqer4drugey 243 32 . . . work_rujstqwje5gkdm2bqer4drugey 244 1 This this DT work_rujstqwje5gkdm2bqer4drugey 244 2 research research NN work_rujstqwje5gkdm2bqer4drugey 244 3 was be VBD work_rujstqwje5gkdm2bqer4drugey 244 4 supported support VBN work_rujstqwje5gkdm2bqer4drugey 244 5 by by IN work_rujstqwje5gkdm2bqer4drugey 244 6 the the DT work_rujstqwje5gkdm2bqer4drugey 244 7 Johns Johns NNP work_rujstqwje5gkdm2bqer4drugey 244 8 Hopkins Hopkins NNP work_rujstqwje5gkdm2bqer4drugey 244 9 University University NNP work_rujstqwje5gkdm2bqer4drugey 244 10 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 244 11 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 244 12 Tech- Tech- NNP work_rujstqwje5gkdm2bqer4drugey 244 13 nology nology NNP work_rujstqwje5gkdm2bqer4drugey 244 14 Center Center NNP work_rujstqwje5gkdm2bqer4drugey 244 15 of of IN work_rujstqwje5gkdm2bqer4drugey 244 16 Excellence Excellence NNP work_rujstqwje5gkdm2bqer4drugey 244 17 and and CC work_rujstqwje5gkdm2bqer4drugey 244 18 through through IN work_rujstqwje5gkdm2bqer4drugey 244 19 gifts gift NNS work_rujstqwje5gkdm2bqer4drugey 244 20 from from IN work_rujstqwje5gkdm2bqer4drugey 244 21 Microsoft Microsoft NNP work_rujstqwje5gkdm2bqer4drugey 244 22 and and CC work_rujstqwje5gkdm2bqer4drugey 244 23 Google Google NNP work_rujstqwje5gkdm2bqer4drugey 244 24 . . . work_rujstqwje5gkdm2bqer4drugey 245 1 The the DT work_rujstqwje5gkdm2bqer4drugey 245 2 authors author NNS work_rujstqwje5gkdm2bqer4drugey 245 3 would would MD work_rujstqwje5gkdm2bqer4drugey 245 4 like like VB work_rujstqwje5gkdm2bqer4drugey 245 5 to to TO work_rujstqwje5gkdm2bqer4drugey 245 6 thank thank VB work_rujstqwje5gkdm2bqer4drugey 245 7 the the DT work_rujstqwje5gkdm2bqer4drugey 245 8 anonymous anonymous JJ work_rujstqwje5gkdm2bqer4drugey 245 9 reviewers reviewer NNS work_rujstqwje5gkdm2bqer4drugey 245 10 for for IN work_rujstqwje5gkdm2bqer4drugey 245 11 their -PRON- PRP$ work_rujstqwje5gkdm2bqer4drugey 245 12 thoughtful thoughtful JJ work_rujstqwje5gkdm2bqer4drugey 245 13 comments comment NNS work_rujstqwje5gkdm2bqer4drugey 245 14 , , , work_rujstqwje5gkdm2bqer4drugey 245 15 which which WDT work_rujstqwje5gkdm2bqer4drugey 245 16 sub- sub- DT work_rujstqwje5gkdm2bqer4drugey 245 17 stantially stantially RB work_rujstqwje5gkdm2bqer4drugey 245 18 improved improve VBD work_rujstqwje5gkdm2bqer4drugey 245 19 this this DT work_rujstqwje5gkdm2bqer4drugey 245 20 paper paper NN work_rujstqwje5gkdm2bqer4drugey 245 21 . . . work_rujstqwje5gkdm2bqer4drugey 246 1 References References NNPS work_rujstqwje5gkdm2bqer4drugey 246 2 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 246 3 . . . work_rujstqwje5gkdm2bqer4drugey 247 1 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 247 2 . . . work_rujstqwje5gkdm2bqer4drugey 248 1 Service service NN work_rujstqwje5gkdm2bqer4drugey 248 2 summary summary NN work_rujstqwje5gkdm2bqer4drugey 248 3 tour tour NN work_rujstqwje5gkdm2bqer4drugey 248 4 for for IN work_rujstqwje5gkdm2bqer4drugey 248 5 re- re- JJ work_rujstqwje5gkdm2bqer4drugey 248 6 questers quester NNS work_rujstqwje5gkdm2bqer4drugey 248 7 on on IN work_rujstqwje5gkdm2bqer4drugey 248 8 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 248 9 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 248 10 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 248 11 . . . work_rujstqwje5gkdm2bqer4drugey 249 1 https:// https:// NNP work_rujstqwje5gkdm2bqer4drugey 249 2 requester.mturk.com/tour requester.mturk.com/tour NNP work_rujstqwje5gkdm2bqer4drugey 249 3 . . . work_rujstqwje5gkdm2bqer4drugey 250 1 Vamshi Vamshi NNP work_rujstqwje5gkdm2bqer4drugey 250 2 Ambati Ambati NNP work_rujstqwje5gkdm2bqer4drugey 250 3 and and CC work_rujstqwje5gkdm2bqer4drugey 250 4 Stephan Stephan NNP work_rujstqwje5gkdm2bqer4drugey 250 5 Vogel Vogel NNP work_rujstqwje5gkdm2bqer4drugey 250 6 . . . work_rujstqwje5gkdm2bqer4drugey 251 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 251 2 . . . work_rujstqwje5gkdm2bqer4drugey 252 1 Can Can MD work_rujstqwje5gkdm2bqer4drugey 252 2 crowds crowd NNS work_rujstqwje5gkdm2bqer4drugey 252 3 build build VB work_rujstqwje5gkdm2bqer4drugey 252 4 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 252 5 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 252 6 for for IN work_rujstqwje5gkdm2bqer4drugey 252 7 machine machine NN work_rujstqwje5gkdm2bqer4drugey 252 8 translation translation NN work_rujstqwje5gkdm2bqer4drugey 252 9 systems system NNS work_rujstqwje5gkdm2bqer4drugey 252 10 ? ? . work_rujstqwje5gkdm2bqer4drugey 253 1 In in IN work_rujstqwje5gkdm2bqer4drugey 253 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 253 3 of of IN work_rujstqwje5gkdm2bqer4drugey 253 4 the the DT work_rujstqwje5gkdm2bqer4drugey 253 5 NAACL NAACL NNP work_rujstqwje5gkdm2bqer4drugey 253 6 HLT HLT NNP work_rujstqwje5gkdm2bqer4drugey 253 7 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 253 8 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 253 9 on on IN work_rujstqwje5gkdm2bqer4drugey 253 10 Creating Creating NNP work_rujstqwje5gkdm2bqer4drugey 253 11 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 253 12 and and CC work_rujstqwje5gkdm2bqer4drugey 253 13 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 253 14 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 253 15 with with IN work_rujstqwje5gkdm2bqer4drugey 253 16 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 253 17 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 253 18 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 253 19 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 253 20 . . . work_rujstqwje5gkdm2bqer4drugey 254 1 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 254 2 for for IN work_rujstqwje5gkdm2bqer4drugey 254 3 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 254 4 Lin- Lin- NNP work_rujstqwje5gkdm2bqer4drugey 254 5 guistics guistic NNS work_rujstqwje5gkdm2bqer4drugey 254 6 . . . work_rujstqwje5gkdm2bqer4drugey 255 1 Vamshi Vamshi NNP work_rujstqwje5gkdm2bqer4drugey 255 2 Ambati Ambati NNPS work_rujstqwje5gkdm2bqer4drugey 255 3 , , , work_rujstqwje5gkdm2bqer4drugey 255 4 Stephan Stephan NNP work_rujstqwje5gkdm2bqer4drugey 255 5 Vogel Vogel NNP work_rujstqwje5gkdm2bqer4drugey 255 6 , , , work_rujstqwje5gkdm2bqer4drugey 255 7 and and CC work_rujstqwje5gkdm2bqer4drugey 255 8 Jaime Jaime NNP work_rujstqwje5gkdm2bqer4drugey 255 9 Carbonell Carbonell NNP work_rujstqwje5gkdm2bqer4drugey 255 10 . . . work_rujstqwje5gkdm2bqer4drugey 256 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 256 2 . . . work_rujstqwje5gkdm2bqer4drugey 257 1 Active active JJ work_rujstqwje5gkdm2bqer4drugey 257 2 learning learning NN work_rujstqwje5gkdm2bqer4drugey 257 3 and and CC work_rujstqwje5gkdm2bqer4drugey 257 4 crowd crowd NN work_rujstqwje5gkdm2bqer4drugey 257 5 - - HYPH work_rujstqwje5gkdm2bqer4drugey 257 6 sourcing source VBG work_rujstqwje5gkdm2bqer4drugey 257 7 for for IN work_rujstqwje5gkdm2bqer4drugey 257 8 ma- ma- JJ work_rujstqwje5gkdm2bqer4drugey 257 9 chine chine JJ work_rujstqwje5gkdm2bqer4drugey 257 10 translation translation NN work_rujstqwje5gkdm2bqer4drugey 257 11 . . . work_rujstqwje5gkdm2bqer4drugey 258 1 In in IN work_rujstqwje5gkdm2bqer4drugey 258 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 258 3 of of IN work_rujstqwje5gkdm2bqer4drugey 258 4 the the DT work_rujstqwje5gkdm2bqer4drugey 258 5 7th 7th JJ work_rujstqwje5gkdm2bqer4drugey 258 6 Interna- Interna- NNP work_rujstqwje5gkdm2bqer4drugey 258 7 tional tional JJ work_rujstqwje5gkdm2bqer4drugey 258 8 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 258 9 on on IN work_rujstqwje5gkdm2bqer4drugey 258 10 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 258 11 Resources Resources NNPS work_rujstqwje5gkdm2bqer4drugey 258 12 and and CC work_rujstqwje5gkdm2bqer4drugey 258 13 Evalu- Evalu- NNP work_rujstqwje5gkdm2bqer4drugey 258 14 ation ation NN work_rujstqwje5gkdm2bqer4drugey 258 15 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 258 16 LREC LREC NNP work_rujstqwje5gkdm2bqer4drugey 258 17 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 258 18 . . . work_rujstqwje5gkdm2bqer4drugey 259 1 Vamshi Vamshi NNP work_rujstqwje5gkdm2bqer4drugey 259 2 Ambati Ambati NNP work_rujstqwje5gkdm2bqer4drugey 259 3 . . . work_rujstqwje5gkdm2bqer4drugey 260 1 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 260 2 . . . work_rujstqwje5gkdm2bqer4drugey 261 1 Active Active NNP work_rujstqwje5gkdm2bqer4drugey 261 2 Learning Learning NNP work_rujstqwje5gkdm2bqer4drugey 261 3 and and CC work_rujstqwje5gkdm2bqer4drugey 261 4 Crowd- Crowd- NNP work_rujstqwje5gkdm2bqer4drugey 261 5 sourcing source VBG work_rujstqwje5gkdm2bqer4drugey 261 6 for for IN work_rujstqwje5gkdm2bqer4drugey 261 7 Machine Machine NNP work_rujstqwje5gkdm2bqer4drugey 261 8 Translation Translation NNP work_rujstqwje5gkdm2bqer4drugey 261 9 in in IN work_rujstqwje5gkdm2bqer4drugey 261 10 Low Low NNP work_rujstqwje5gkdm2bqer4drugey 261 11 Resource Resource NNP work_rujstqwje5gkdm2bqer4drugey 261 12 Scenarios Scenarios NNPS work_rujstqwje5gkdm2bqer4drugey 261 13 . . . work_rujstqwje5gkdm2bqer4drugey 262 1 Ph.D. Ph.D. NNP work_rujstqwje5gkdm2bqer4drugey 262 2 thesis thesis NNP work_rujstqwje5gkdm2bqer4drugey 262 3 , , , work_rujstqwje5gkdm2bqer4drugey 262 4 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 262 5 Technologies Technologies NNP work_rujstqwje5gkdm2bqer4drugey 262 6 In- In- NNP work_rujstqwje5gkdm2bqer4drugey 262 7 stitute stitute NN work_rujstqwje5gkdm2bqer4drugey 262 8 , , , work_rujstqwje5gkdm2bqer4drugey 262 9 School School NNP work_rujstqwje5gkdm2bqer4drugey 262 10 of of IN work_rujstqwje5gkdm2bqer4drugey 262 11 Computer Computer NNP work_rujstqwje5gkdm2bqer4drugey 262 12 Science Science NNP work_rujstqwje5gkdm2bqer4drugey 262 13 , , , work_rujstqwje5gkdm2bqer4drugey 262 14 Carnegie Carnegie NNP work_rujstqwje5gkdm2bqer4drugey 262 15 Mellon Mellon NNP work_rujstqwje5gkdm2bqer4drugey 262 16 University University NNP work_rujstqwje5gkdm2bqer4drugey 262 17 , , , work_rujstqwje5gkdm2bqer4drugey 262 18 Pittsburgh Pittsburgh NNP work_rujstqwje5gkdm2bqer4drugey 262 19 , , , work_rujstqwje5gkdm2bqer4drugey 262 20 PA PA NNP work_rujstqwje5gkdm2bqer4drugey 262 21 . . . work_rujstqwje5gkdm2bqer4drugey 262 22 Michael Michael NNP work_rujstqwje5gkdm2bqer4drugey 262 23 S. S. NNP work_rujstqwje5gkdm2bqer4drugey 262 24 Bernstein Bernstein NNP work_rujstqwje5gkdm2bqer4drugey 262 25 , , , work_rujstqwje5gkdm2bqer4drugey 262 26 Greg Greg NNP work_rujstqwje5gkdm2bqer4drugey 262 27 Little Little NNP work_rujstqwje5gkdm2bqer4drugey 262 28 , , , work_rujstqwje5gkdm2bqer4drugey 262 29 Robert Robert NNP work_rujstqwje5gkdm2bqer4drugey 262 30 C. C. NNP work_rujstqwje5gkdm2bqer4drugey 262 31 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 262 32 , , , work_rujstqwje5gkdm2bqer4drugey 262 33 Bjrn Bjrn NNP work_rujstqwje5gkdm2bqer4drugey 262 34 Hartmann Hartmann NNP work_rujstqwje5gkdm2bqer4drugey 262 35 , , , work_rujstqwje5gkdm2bqer4drugey 262 36 Mark Mark NNP work_rujstqwje5gkdm2bqer4drugey 262 37 S. S. NNP work_rujstqwje5gkdm2bqer4drugey 262 38 Ackerman Ackerman NNP work_rujstqwje5gkdm2bqer4drugey 262 39 , , , work_rujstqwje5gkdm2bqer4drugey 262 40 David David NNP work_rujstqwje5gkdm2bqer4drugey 262 41 R. R. NNP work_rujstqwje5gkdm2bqer4drugey 262 42 Karger Karger NNP work_rujstqwje5gkdm2bqer4drugey 262 43 , , , work_rujstqwje5gkdm2bqer4drugey 262 44 David David NNP work_rujstqwje5gkdm2bqer4drugey 262 45 Crowell Crowell NNP work_rujstqwje5gkdm2bqer4drugey 262 46 , , , work_rujstqwje5gkdm2bqer4drugey 262 47 and and CC work_rujstqwje5gkdm2bqer4drugey 262 48 Katrina Katrina NNP work_rujstqwje5gkdm2bqer4drugey 262 49 Panovich Panovich NNP work_rujstqwje5gkdm2bqer4drugey 262 50 . . . work_rujstqwje5gkdm2bqer4drugey 263 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 263 2 . . . work_rujstqwje5gkdm2bqer4drugey 264 1 Soylent soylent NN work_rujstqwje5gkdm2bqer4drugey 264 2 : : : work_rujstqwje5gkdm2bqer4drugey 264 3 a a DT work_rujstqwje5gkdm2bqer4drugey 264 4 word word NN work_rujstqwje5gkdm2bqer4drugey 264 5 processor processor NN work_rujstqwje5gkdm2bqer4drugey 264 6 with with IN work_rujstqwje5gkdm2bqer4drugey 264 7 a a DT work_rujstqwje5gkdm2bqer4drugey 264 8 crowd crowd NN work_rujstqwje5gkdm2bqer4drugey 264 9 inside inside RB work_rujstqwje5gkdm2bqer4drugey 264 10 . . . work_rujstqwje5gkdm2bqer4drugey 265 1 In in IN work_rujstqwje5gkdm2bqer4drugey 265 2 Proceed- Proceed- NNP work_rujstqwje5gkdm2bqer4drugey 265 3 ings ing NNS work_rujstqwje5gkdm2bqer4drugey 265 4 of of IN work_rujstqwje5gkdm2bqer4drugey 265 5 the the DT work_rujstqwje5gkdm2bqer4drugey 265 6 ACM ACM NNP work_rujstqwje5gkdm2bqer4drugey 265 7 Symposium Symposium NNP work_rujstqwje5gkdm2bqer4drugey 265 8 on on IN work_rujstqwje5gkdm2bqer4drugey 265 9 User User NNP work_rujstqwje5gkdm2bqer4drugey 265 10 Interface Interface NNP work_rujstqwje5gkdm2bqer4drugey 265 11 Soft- soft- JJ work_rujstqwje5gkdm2bqer4drugey 265 12 ware ware NN work_rujstqwje5gkdm2bqer4drugey 265 13 and and CC work_rujstqwje5gkdm2bqer4drugey 265 14 Technology Technology NNP work_rujstqwje5gkdm2bqer4drugey 265 15 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 265 16 UIST UIST NNP work_rujstqwje5gkdm2bqer4drugey 265 17 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 265 18 . . . work_rujstqwje5gkdm2bqer4drugey 266 1 Jeffrey Jeffrey NNP work_rujstqwje5gkdm2bqer4drugey 266 2 P. P. NNP work_rujstqwje5gkdm2bqer4drugey 266 3 Bigham Bigham NNP work_rujstqwje5gkdm2bqer4drugey 266 4 , , , work_rujstqwje5gkdm2bqer4drugey 266 5 Chandrika Chandrika NNP work_rujstqwje5gkdm2bqer4drugey 266 6 Jayant Jayant NNP work_rujstqwje5gkdm2bqer4drugey 266 7 , , , work_rujstqwje5gkdm2bqer4drugey 266 8 Hanjie Hanjie NNP work_rujstqwje5gkdm2bqer4drugey 266 9 Ji Ji NNP work_rujstqwje5gkdm2bqer4drugey 266 10 , , , work_rujstqwje5gkdm2bqer4drugey 266 11 Greg Greg NNP work_rujstqwje5gkdm2bqer4drugey 266 12 Lit- Lit- NNP work_rujstqwje5gkdm2bqer4drugey 266 13 tle tle NN work_rujstqwje5gkdm2bqer4drugey 266 14 , , , work_rujstqwje5gkdm2bqer4drugey 266 15 Andrew Andrew NNP work_rujstqwje5gkdm2bqer4drugey 266 16 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 266 17 , , , work_rujstqwje5gkdm2bqer4drugey 266 18 Robert Robert NNP work_rujstqwje5gkdm2bqer4drugey 266 19 C. C. NNP work_rujstqwje5gkdm2bqer4drugey 266 20 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 266 21 , , , work_rujstqwje5gkdm2bqer4drugey 266 22 Robin Robin NNP work_rujstqwje5gkdm2bqer4drugey 266 23 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 266 24 , , , work_rujstqwje5gkdm2bqer4drugey 266 25 Aubrey Aubrey NNP work_rujstqwje5gkdm2bqer4drugey 266 26 Tatarowicz Tatarowicz NNP work_rujstqwje5gkdm2bqer4drugey 266 27 , , , work_rujstqwje5gkdm2bqer4drugey 266 28 Brandyn Brandyn NNP work_rujstqwje5gkdm2bqer4drugey 266 29 White White NNP work_rujstqwje5gkdm2bqer4drugey 266 30 , , , work_rujstqwje5gkdm2bqer4drugey 266 31 Samual Samual NNP work_rujstqwje5gkdm2bqer4drugey 266 32 White White NNP work_rujstqwje5gkdm2bqer4drugey 266 33 , , , work_rujstqwje5gkdm2bqer4drugey 266 34 and and CC work_rujstqwje5gkdm2bqer4drugey 266 35 Tom Tom NNP work_rujstqwje5gkdm2bqer4drugey 266 36 Yeh Yeh NNP work_rujstqwje5gkdm2bqer4drugey 266 37 . . . work_rujstqwje5gkdm2bqer4drugey 267 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 267 2 . . . work_rujstqwje5gkdm2bqer4drugey 268 1 VizWiz vizwiz NN work_rujstqwje5gkdm2bqer4drugey 268 2 : : : work_rujstqwje5gkdm2bqer4drugey 268 3 nearly nearly RB work_rujstqwje5gkdm2bqer4drugey 268 4 real real JJ work_rujstqwje5gkdm2bqer4drugey 268 5 - - HYPH work_rujstqwje5gkdm2bqer4drugey 268 6 time time NN work_rujstqwje5gkdm2bqer4drugey 268 7 an- an- XX work_rujstqwje5gkdm2bqer4drugey 268 8 swers swer NNS work_rujstqwje5gkdm2bqer4drugey 268 9 to to IN work_rujstqwje5gkdm2bqer4drugey 268 10 visual visual JJ work_rujstqwje5gkdm2bqer4drugey 268 11 questions question NNS work_rujstqwje5gkdm2bqer4drugey 268 12 . . . work_rujstqwje5gkdm2bqer4drugey 269 1 In in IN work_rujstqwje5gkdm2bqer4drugey 269 2 Proceedings Proceedings NNP work_rujstqwje5gkdm2bqer4drugey 269 3 of of IN work_rujstqwje5gkdm2bqer4drugey 269 4 the the DT work_rujstqwje5gkdm2bqer4drugey 269 5 ACM ACM NNP work_rujstqwje5gkdm2bqer4drugey 269 6 Symposium Symposium NNP work_rujstqwje5gkdm2bqer4drugey 269 7 on on IN work_rujstqwje5gkdm2bqer4drugey 269 8 User User NNP work_rujstqwje5gkdm2bqer4drugey 269 9 Interface Interface NNP work_rujstqwje5gkdm2bqer4drugey 269 10 Software Software NNP work_rujstqwje5gkdm2bqer4drugey 269 11 and and CC work_rujstqwje5gkdm2bqer4drugey 269 12 Technol- Technol- NNP work_rujstqwje5gkdm2bqer4drugey 269 13 ogy ogy NN work_rujstqwje5gkdm2bqer4drugey 269 14 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 269 15 UIST UIST NNP work_rujstqwje5gkdm2bqer4drugey 269 16 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 269 17 . . . work_rujstqwje5gkdm2bqer4drugey 270 1 Michael Michael NNP work_rujstqwje5gkdm2bqer4drugey 270 2 Bloodgood Bloodgood NNP work_rujstqwje5gkdm2bqer4drugey 270 3 and and CC work_rujstqwje5gkdm2bqer4drugey 270 4 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 270 5 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 270 6 - - HYPH work_rujstqwje5gkdm2bqer4drugey 270 7 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 270 8 . . . work_rujstqwje5gkdm2bqer4drugey 271 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 271 2 . . . work_rujstqwje5gkdm2bqer4drugey 272 1 Large large JJ work_rujstqwje5gkdm2bqer4drugey 272 2 - - HYPH work_rujstqwje5gkdm2bqer4drugey 272 3 scale scale NN work_rujstqwje5gkdm2bqer4drugey 272 4 cost cost NN work_rujstqwje5gkdm2bqer4drugey 272 5 - - HYPH work_rujstqwje5gkdm2bqer4drugey 272 6 focused focus VBN work_rujstqwje5gkdm2bqer4drugey 272 7 active active JJ work_rujstqwje5gkdm2bqer4drugey 272 8 learning learning NN work_rujstqwje5gkdm2bqer4drugey 272 9 for for IN work_rujstqwje5gkdm2bqer4drugey 272 10 statisti- statisti- NN work_rujstqwje5gkdm2bqer4drugey 272 11 cal cal NN work_rujstqwje5gkdm2bqer4drugey 272 12 machine machine NN work_rujstqwje5gkdm2bqer4drugey 272 13 translation translation NN work_rujstqwje5gkdm2bqer4drugey 272 14 . . . work_rujstqwje5gkdm2bqer4drugey 273 1 In in IN work_rujstqwje5gkdm2bqer4drugey 273 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 273 3 of of IN work_rujstqwje5gkdm2bqer4drugey 273 4 the the DT work_rujstqwje5gkdm2bqer4drugey 273 5 48th 48th JJ work_rujstqwje5gkdm2bqer4drugey 273 6 Annual Annual NNP work_rujstqwje5gkdm2bqer4drugey 273 7 Meeting Meeting NNP work_rujstqwje5gkdm2bqer4drugey 273 8 of of IN work_rujstqwje5gkdm2bqer4drugey 273 9 the the DT work_rujstqwje5gkdm2bqer4drugey 273 10 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 273 11 for for IN work_rujstqwje5gkdm2bqer4drugey 273 12 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 273 13 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 273 14 . . . work_rujstqwje5gkdm2bqer4drugey 274 1 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 274 2 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 274 3 - - HYPH work_rujstqwje5gkdm2bqer4drugey 274 4 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 274 5 and and CC work_rujstqwje5gkdm2bqer4drugey 274 6 Mark Mark NNP work_rujstqwje5gkdm2bqer4drugey 274 7 Dredze Dredze NNP work_rujstqwje5gkdm2bqer4drugey 274 8 . . . work_rujstqwje5gkdm2bqer4drugey 275 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 275 2 . . . work_rujstqwje5gkdm2bqer4drugey 276 1 Creating create VBG work_rujstqwje5gkdm2bqer4drugey 276 2 speech speech NN work_rujstqwje5gkdm2bqer4drugey 276 3 and and CC work_rujstqwje5gkdm2bqer4drugey 276 4 language language NN work_rujstqwje5gkdm2bqer4drugey 276 5 data datum NNS work_rujstqwje5gkdm2bqer4drugey 276 6 with with IN work_rujstqwje5gkdm2bqer4drugey 276 7 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 276 8 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 276 9 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 276 10 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 276 11 . . . work_rujstqwje5gkdm2bqer4drugey 277 1 In in IN work_rujstqwje5gkdm2bqer4drugey 277 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 277 3 of of IN work_rujstqwje5gkdm2bqer4drugey 277 4 the the DT work_rujstqwje5gkdm2bqer4drugey 277 5 NAACL NAACL NNP work_rujstqwje5gkdm2bqer4drugey 277 6 HLT HLT NNP work_rujstqwje5gkdm2bqer4drugey 277 7 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 277 8 Work- work- NN work_rujstqwje5gkdm2bqer4drugey 277 9 shop shop NN work_rujstqwje5gkdm2bqer4drugey 277 10 on on IN work_rujstqwje5gkdm2bqer4drugey 277 11 Creating Creating NNP work_rujstqwje5gkdm2bqer4drugey 277 12 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 277 13 and and CC work_rujstqwje5gkdm2bqer4drugey 277 14 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 277 15 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 277 16 with with IN work_rujstqwje5gkdm2bqer4drugey 277 17 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 277 18 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 277 19 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 277 20 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 277 21 , , , work_rujstqwje5gkdm2bqer4drugey 277 22 pages page NNS work_rujstqwje5gkdm2bqer4drugey 277 23 1–12 1–12 CD work_rujstqwje5gkdm2bqer4drugey 277 24 , , , work_rujstqwje5gkdm2bqer4drugey 277 25 Los Los NNP work_rujstqwje5gkdm2bqer4drugey 277 26 Angeles Angeles NNP work_rujstqwje5gkdm2bqer4drugey 277 27 , , , work_rujstqwje5gkdm2bqer4drugey 277 28 June June NNP work_rujstqwje5gkdm2bqer4drugey 277 29 . . . work_rujstqwje5gkdm2bqer4drugey 278 1 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 278 2 for for IN work_rujstqwje5gkdm2bqer4drugey 278 3 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 278 4 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 278 5 . . . work_rujstqwje5gkdm2bqer4drugey 279 1 Jia Jia NNP work_rujstqwje5gkdm2bqer4drugey 279 2 Deng Deng NNP work_rujstqwje5gkdm2bqer4drugey 279 3 , , , work_rujstqwje5gkdm2bqer4drugey 279 4 Alexander Alexander NNP work_rujstqwje5gkdm2bqer4drugey 279 5 Berg Berg NNP work_rujstqwje5gkdm2bqer4drugey 279 6 , , , work_rujstqwje5gkdm2bqer4drugey 279 7 Kai Kai NNP work_rujstqwje5gkdm2bqer4drugey 279 8 Li Li NNP work_rujstqwje5gkdm2bqer4drugey 279 9 , , , work_rujstqwje5gkdm2bqer4drugey 279 10 and and CC work_rujstqwje5gkdm2bqer4drugey 279 11 Li Li NNP work_rujstqwje5gkdm2bqer4drugey 279 12 Fei Fei NNP work_rujstqwje5gkdm2bqer4drugey 279 13 - - HYPH work_rujstqwje5gkdm2bqer4drugey 279 14 Fei Fei NNP work_rujstqwje5gkdm2bqer4drugey 279 15 . . . work_rujstqwje5gkdm2bqer4drugey 280 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 280 2 . . . work_rujstqwje5gkdm2bqer4drugey 281 1 What what WP work_rujstqwje5gkdm2bqer4drugey 281 2 does do VBZ work_rujstqwje5gkdm2bqer4drugey 281 3 classifying classify VBG work_rujstqwje5gkdm2bqer4drugey 281 4 more more JJR work_rujstqwje5gkdm2bqer4drugey 281 5 than than IN work_rujstqwje5gkdm2bqer4drugey 281 6 10,000 10,000 CD work_rujstqwje5gkdm2bqer4drugey 281 7 image image NN work_rujstqwje5gkdm2bqer4drugey 281 8 cate- cate- XX work_rujstqwje5gkdm2bqer4drugey 281 9 gories gorie NNS work_rujstqwje5gkdm2bqer4drugey 281 10 tell tell VBP work_rujstqwje5gkdm2bqer4drugey 281 11 us -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 281 12 ? ? . work_rujstqwje5gkdm2bqer4drugey 282 1 In in IN work_rujstqwje5gkdm2bqer4drugey 282 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 282 3 of of IN work_rujstqwje5gkdm2bqer4drugey 282 4 the the DT work_rujstqwje5gkdm2bqer4drugey 282 5 12th 12th JJ work_rujstqwje5gkdm2bqer4drugey 282 6 European European NNP work_rujstqwje5gkdm2bqer4drugey 282 7 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 282 8 of of IN work_rujstqwje5gkdm2bqer4drugey 282 9 Computer Computer NNP work_rujstqwje5gkdm2bqer4drugey 282 10 Vision Vision NNP work_rujstqwje5gkdm2bqer4drugey 282 11 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 282 12 ECCV ECCV NNP work_rujstqwje5gkdm2bqer4drugey 282 13 , , , work_rujstqwje5gkdm2bqer4drugey 282 14 pages page NNS work_rujstqwje5gkdm2bqer4drugey 282 15 71–84 71–84 CD work_rujstqwje5gkdm2bqer4drugey 282 16 . . . work_rujstqwje5gkdm2bqer4drugey 283 1 Maxine Maxine NNP work_rujstqwje5gkdm2bqer4drugey 283 2 Eskenazi Eskenazi NNP work_rujstqwje5gkdm2bqer4drugey 283 3 , , , work_rujstqwje5gkdm2bqer4drugey 283 4 Gina Gina NNP work_rujstqwje5gkdm2bqer4drugey 283 5 - - HYPH work_rujstqwje5gkdm2bqer4drugey 283 6 Anne Anne NNP work_rujstqwje5gkdm2bqer4drugey 283 7 Levow Levow NNP work_rujstqwje5gkdm2bqer4drugey 283 8 , , , work_rujstqwje5gkdm2bqer4drugey 283 9 Helen Helen NNP work_rujstqwje5gkdm2bqer4drugey 283 10 Meng Meng NNP work_rujstqwje5gkdm2bqer4drugey 283 11 , , , work_rujstqwje5gkdm2bqer4drugey 283 12 Gabriel Gabriel NNP work_rujstqwje5gkdm2bqer4drugey 283 13 Parent Parent NNP work_rujstqwje5gkdm2bqer4drugey 283 14 , , , work_rujstqwje5gkdm2bqer4drugey 283 15 and and CC work_rujstqwje5gkdm2bqer4drugey 283 16 David David NNP work_rujstqwje5gkdm2bqer4drugey 283 17 Suendermann Suendermann NNP work_rujstqwje5gkdm2bqer4drugey 283 18 . . . work_rujstqwje5gkdm2bqer4drugey 284 1 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 284 2 . . . work_rujstqwje5gkdm2bqer4drugey 285 1 Crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 285 2 for for IN work_rujstqwje5gkdm2bqer4drugey 285 3 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 285 4 Processing Processing NNP work_rujstqwje5gkdm2bqer4drugey 285 5 , , , work_rujstqwje5gkdm2bqer4drugey 285 6 Applications Applications NNPS work_rujstqwje5gkdm2bqer4drugey 285 7 to to IN work_rujstqwje5gkdm2bqer4drugey 285 8 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 285 9 Collection Collection NNP work_rujstqwje5gkdm2bqer4drugey 285 10 , , , work_rujstqwje5gkdm2bqer4drugey 285 11 Transcription Transcription NNP work_rujstqwje5gkdm2bqer4drugey 285 12 and and CC work_rujstqwje5gkdm2bqer4drugey 285 13 Assessment Assessment NNP work_rujstqwje5gkdm2bqer4drugey 285 14 . . . work_rujstqwje5gkdm2bqer4drugey 286 1 Wi- Wi- NNP work_rujstqwje5gkdm2bqer4drugey 286 2 ley ley NNP work_rujstqwje5gkdm2bqer4drugey 286 3 . . . work_rujstqwje5gkdm2bqer4drugey 287 1 Siamak Siamak NNP work_rujstqwje5gkdm2bqer4drugey 287 2 Faridani Faridani NNP work_rujstqwje5gkdm2bqer4drugey 287 3 , , , work_rujstqwje5gkdm2bqer4drugey 287 4 Björn björn CD work_rujstqwje5gkdm2bqer4drugey 287 5 Hartmann Hartmann NNP work_rujstqwje5gkdm2bqer4drugey 287 6 , , , work_rujstqwje5gkdm2bqer4drugey 287 7 and and CC work_rujstqwje5gkdm2bqer4drugey 287 8 Panagiotis Panagiotis NNP work_rujstqwje5gkdm2bqer4drugey 287 9 G. G. NNP work_rujstqwje5gkdm2bqer4drugey 287 10 Ipeirotis Ipeirotis NNP work_rujstqwje5gkdm2bqer4drugey 287 11 . . . work_rujstqwje5gkdm2bqer4drugey 288 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 288 2 . . . work_rujstqwje5gkdm2bqer4drugey 289 1 What what WP work_rujstqwje5gkdm2bqer4drugey 289 2 ’s ’ VBZ work_rujstqwje5gkdm2bqer4drugey 289 3 the the DT work_rujstqwje5gkdm2bqer4drugey 289 4 right right JJ work_rujstqwje5gkdm2bqer4drugey 289 5 price price NN work_rujstqwje5gkdm2bqer4drugey 289 6 ? ? . work_rujstqwje5gkdm2bqer4drugey 290 1 pricing pricing NN work_rujstqwje5gkdm2bqer4drugey 290 2 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 290 3 for for IN work_rujstqwje5gkdm2bqer4drugey 290 4 finishing finish VBG work_rujstqwje5gkdm2bqer4drugey 290 5 on on IN work_rujstqwje5gkdm2bqer4drugey 290 6 time time NN work_rujstqwje5gkdm2bqer4drugey 290 7 . . . work_rujstqwje5gkdm2bqer4drugey 291 1 In in IN work_rujstqwje5gkdm2bqer4drugey 291 2 Third Third NNP work_rujstqwje5gkdm2bqer4drugey 291 3 AAAI AAAI NNP work_rujstqwje5gkdm2bqer4drugey 291 4 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 291 5 Compu- Compu- NNP work_rujstqwje5gkdm2bqer4drugey 291 6 tation tation NN work_rujstqwje5gkdm2bqer4drugey 291 7 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 291 8 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 291 9 HCOMP’11 HCOMP’11 NNP work_rujstqwje5gkdm2bqer4drugey 291 10 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 291 11 . . . work_rujstqwje5gkdm2bqer4drugey 292 1 Ulrich Ulrich NNP work_rujstqwje5gkdm2bqer4drugey 292 2 Germann Germann NNP work_rujstqwje5gkdm2bqer4drugey 292 3 . . . work_rujstqwje5gkdm2bqer4drugey 293 1 2001 2001 CD work_rujstqwje5gkdm2bqer4drugey 293 2 . . . work_rujstqwje5gkdm2bqer4drugey 294 1 Building build VBG work_rujstqwje5gkdm2bqer4drugey 294 2 a a DT work_rujstqwje5gkdm2bqer4drugey 294 3 statistical statistical JJ work_rujstqwje5gkdm2bqer4drugey 294 4 machine machine NN work_rujstqwje5gkdm2bqer4drugey 294 5 translation translation NN work_rujstqwje5gkdm2bqer4drugey 294 6 system system NN work_rujstqwje5gkdm2bqer4drugey 294 7 from from IN work_rujstqwje5gkdm2bqer4drugey 294 8 scratch scratch NN work_rujstqwje5gkdm2bqer4drugey 294 9 : : : work_rujstqwje5gkdm2bqer4drugey 294 10 How how WRB work_rujstqwje5gkdm2bqer4drugey 294 11 much much JJ work_rujstqwje5gkdm2bqer4drugey 294 12 bang bang NN work_rujstqwje5gkdm2bqer4drugey 294 13 for for IN work_rujstqwje5gkdm2bqer4drugey 294 14 the the DT work_rujstqwje5gkdm2bqer4drugey 294 15 buck buck NN work_rujstqwje5gkdm2bqer4drugey 294 16 can can MD work_rujstqwje5gkdm2bqer4drugey 294 17 we -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 294 18 expect expect VB work_rujstqwje5gkdm2bqer4drugey 294 19 ? ? . work_rujstqwje5gkdm2bqer4drugey 295 1 In in IN work_rujstqwje5gkdm2bqer4drugey 295 2 ACL ACL NNP work_rujstqwje5gkdm2bqer4drugey 295 3 2001 2001 CD work_rujstqwje5gkdm2bqer4drugey 295 4 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 295 5 on on IN work_rujstqwje5gkdm2bqer4drugey 295 6 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 295 7 - - HYPH work_rujstqwje5gkdm2bqer4drugey 295 8 Driven Driven NNP work_rujstqwje5gkdm2bqer4drugey 295 9 Machine Machine NNP work_rujstqwje5gkdm2bqer4drugey 295 10 Translation Translation NNP work_rujstqwje5gkdm2bqer4drugey 295 11 , , , work_rujstqwje5gkdm2bqer4drugey 295 12 Toulouse Toulouse NNP work_rujstqwje5gkdm2bqer4drugey 295 13 , , , work_rujstqwje5gkdm2bqer4drugey 295 14 France France NNP work_rujstqwje5gkdm2bqer4drugey 295 15 . . . work_rujstqwje5gkdm2bqer4drugey 296 1 Chang Chang NNP work_rujstqwje5gkdm2bqer4drugey 296 2 Hu Hu NNP work_rujstqwje5gkdm2bqer4drugey 296 3 , , , work_rujstqwje5gkdm2bqer4drugey 296 4 Benjamin Benjamin NNP work_rujstqwje5gkdm2bqer4drugey 296 5 B. B. NNP work_rujstqwje5gkdm2bqer4drugey 296 6 Bederson Bederson NNP work_rujstqwje5gkdm2bqer4drugey 296 7 , , , work_rujstqwje5gkdm2bqer4drugey 296 8 and and CC work_rujstqwje5gkdm2bqer4drugey 296 9 Philip Philip NNP work_rujstqwje5gkdm2bqer4drugey 296 10 Resnik Resnik NNP work_rujstqwje5gkdm2bqer4drugey 296 11 . . . work_rujstqwje5gkdm2bqer4drugey 297 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 297 2 . . . work_rujstqwje5gkdm2bqer4drugey 298 1 Translation translation NN work_rujstqwje5gkdm2bqer4drugey 298 2 by by IN work_rujstqwje5gkdm2bqer4drugey 298 3 iterative iterative JJ work_rujstqwje5gkdm2bqer4drugey 298 4 collaboration collaboration NN work_rujstqwje5gkdm2bqer4drugey 298 5 between between IN work_rujstqwje5gkdm2bqer4drugey 298 6 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 298 7 users user NNS work_rujstqwje5gkdm2bqer4drugey 298 8 . . . work_rujstqwje5gkdm2bqer4drugey 299 1 In in IN work_rujstqwje5gkdm2bqer4drugey 299 2 Proceedings Proceedings NNP work_rujstqwje5gkdm2bqer4drugey 299 3 of of IN work_rujstqwje5gkdm2bqer4drugey 299 4 ACM ACM NNP work_rujstqwje5gkdm2bqer4drugey 299 5 SIGKDD SIGKDD NNP work_rujstqwje5gkdm2bqer4drugey 299 6 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 299 7 on on IN work_rujstqwje5gkdm2bqer4drugey 299 8 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 299 9 Computation Computation NNP work_rujstqwje5gkdm2bqer4drugey 299 10 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 299 11 HCOMP HCOMP NNP work_rujstqwje5gkdm2bqer4drugey 299 12 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 299 13 . . . work_rujstqwje5gkdm2bqer4drugey 300 1 Chang Chang NNP work_rujstqwje5gkdm2bqer4drugey 300 2 Hu Hu NNP work_rujstqwje5gkdm2bqer4drugey 300 3 , , , work_rujstqwje5gkdm2bqer4drugey 300 4 Philip Philip NNP work_rujstqwje5gkdm2bqer4drugey 300 5 Resnik Resnik NNP work_rujstqwje5gkdm2bqer4drugey 300 6 , , , work_rujstqwje5gkdm2bqer4drugey 300 7 Yakov Yakov NNP work_rujstqwje5gkdm2bqer4drugey 300 8 Kronrod Kronrod NNP work_rujstqwje5gkdm2bqer4drugey 300 9 , , , work_rujstqwje5gkdm2bqer4drugey 300 10 Vladimir Vladimir NNP work_rujstqwje5gkdm2bqer4drugey 300 11 Ei- Ei- NNP work_rujstqwje5gkdm2bqer4drugey 300 12 delman delman NN work_rujstqwje5gkdm2bqer4drugey 300 13 , , , work_rujstqwje5gkdm2bqer4drugey 300 14 Olivia Olivia NNP work_rujstqwje5gkdm2bqer4drugey 300 15 Buzek Buzek NNP work_rujstqwje5gkdm2bqer4drugey 300 16 , , , work_rujstqwje5gkdm2bqer4drugey 300 17 and and CC work_rujstqwje5gkdm2bqer4drugey 300 18 Benjamin Benjamin NNP work_rujstqwje5gkdm2bqer4drugey 300 19 B. B. NNP work_rujstqwje5gkdm2bqer4drugey 300 20 Bederson Bederson NNP work_rujstqwje5gkdm2bqer4drugey 300 21 . . . work_rujstqwje5gkdm2bqer4drugey 301 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 301 2 . . . work_rujstqwje5gkdm2bqer4drugey 302 1 The the DT work_rujstqwje5gkdm2bqer4drugey 302 2 value value NN work_rujstqwje5gkdm2bqer4drugey 302 3 of of IN work_rujstqwje5gkdm2bqer4drugey 302 4 monolingual monolingual JJ work_rujstqwje5gkdm2bqer4drugey 302 5 crowdsourcing crowdsourcing NN work_rujstqwje5gkdm2bqer4drugey 302 6 in in IN work_rujstqwje5gkdm2bqer4drugey 302 7 a a DT work_rujstqwje5gkdm2bqer4drugey 302 8 real real JJ work_rujstqwje5gkdm2bqer4drugey 302 9 - - HYPH work_rujstqwje5gkdm2bqer4drugey 302 10 world world NN work_rujstqwje5gkdm2bqer4drugey 302 11 translation translation NN work_rujstqwje5gkdm2bqer4drugey 302 12 scenario scenario NN work_rujstqwje5gkdm2bqer4drugey 302 13 : : : work_rujstqwje5gkdm2bqer4drugey 302 14 Simulation simulation NN work_rujstqwje5gkdm2bqer4drugey 302 15 using use VBG work_rujstqwje5gkdm2bqer4drugey 302 16 haitian haitian JJ work_rujstqwje5gkdm2bqer4drugey 302 17 creole creole NNP work_rujstqwje5gkdm2bqer4drugey 302 18 emergency emergency NN work_rujstqwje5gkdm2bqer4drugey 302 19 sms sms NN work_rujstqwje5gkdm2bqer4drugey 302 20 messages message NNS work_rujstqwje5gkdm2bqer4drugey 302 21 . . . work_rujstqwje5gkdm2bqer4drugey 303 1 In in IN work_rujstqwje5gkdm2bqer4drugey 303 2 Pro- Pro- NNP work_rujstqwje5gkdm2bqer4drugey 303 3 ceedings ceeding NNS work_rujstqwje5gkdm2bqer4drugey 303 4 of of IN work_rujstqwje5gkdm2bqer4drugey 303 5 the the DT work_rujstqwje5gkdm2bqer4drugey 303 6 Sixth Sixth NNP work_rujstqwje5gkdm2bqer4drugey 303 7 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 303 8 on on IN work_rujstqwje5gkdm2bqer4drugey 303 9 Statistical Statistical NNP work_rujstqwje5gkdm2bqer4drugey 303 10 Ma- Ma- NNP work_rujstqwje5gkdm2bqer4drugey 303 11 chine chine NN work_rujstqwje5gkdm2bqer4drugey 303 12 Translation translation NN work_rujstqwje5gkdm2bqer4drugey 303 13 , , , work_rujstqwje5gkdm2bqer4drugey 303 14 pages page VBZ work_rujstqwje5gkdm2bqer4drugey 303 15 399–404 399–404 CD work_rujstqwje5gkdm2bqer4drugey 303 16 , , , work_rujstqwje5gkdm2bqer4drugey 303 17 Edinburgh Edinburgh NNP work_rujstqwje5gkdm2bqer4drugey 303 18 , , , work_rujstqwje5gkdm2bqer4drugey 303 19 Scot- Scot- NNP work_rujstqwje5gkdm2bqer4drugey 303 20 land land NN work_rujstqwje5gkdm2bqer4drugey 303 21 , , , work_rujstqwje5gkdm2bqer4drugey 303 22 July July NNP work_rujstqwje5gkdm2bqer4drugey 303 23 . . . work_rujstqwje5gkdm2bqer4drugey 304 1 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 304 2 for for IN work_rujstqwje5gkdm2bqer4drugey 304 3 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 304 4 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 304 5 . . . work_rujstqwje5gkdm2bqer4drugey 305 1 Panagiotis Panagiotis NNP work_rujstqwje5gkdm2bqer4drugey 305 2 G. G. NNP work_rujstqwje5gkdm2bqer4drugey 305 3 Ipeirotis Ipeirotis NNP work_rujstqwje5gkdm2bqer4drugey 305 4 . . . work_rujstqwje5gkdm2bqer4drugey 306 1 2010a 2010a CD work_rujstqwje5gkdm2bqer4drugey 306 2 . . . work_rujstqwje5gkdm2bqer4drugey 307 1 Analyzing analyze VBG work_rujstqwje5gkdm2bqer4drugey 307 2 the the DT work_rujstqwje5gkdm2bqer4drugey 307 3 mechani- mechani- NN work_rujstqwje5gkdm2bqer4drugey 307 4 cal cal XX work_rujstqwje5gkdm2bqer4drugey 307 5 turk turk NN work_rujstqwje5gkdm2bqer4drugey 307 6 marketplace marketplace NN work_rujstqwje5gkdm2bqer4drugey 307 7 . . . work_rujstqwje5gkdm2bqer4drugey 308 1 In in IN work_rujstqwje5gkdm2bqer4drugey 308 2 ACM ACM NNP work_rujstqwje5gkdm2bqer4drugey 308 3 XRDS XRDS NNP work_rujstqwje5gkdm2bqer4drugey 308 4 , , , work_rujstqwje5gkdm2bqer4drugey 308 5 December December NNP work_rujstqwje5gkdm2bqer4drugey 308 6 . . . work_rujstqwje5gkdm2bqer4drugey 309 1 Panagiotis Panagiotis NNP work_rujstqwje5gkdm2bqer4drugey 309 2 G. G. NNP work_rujstqwje5gkdm2bqer4drugey 309 3 Ipeirotis Ipeirotis NNP work_rujstqwje5gkdm2bqer4drugey 309 4 . . . work_rujstqwje5gkdm2bqer4drugey 310 1 2010b 2010b CD work_rujstqwje5gkdm2bqer4drugey 310 2 . . . work_rujstqwje5gkdm2bqer4drugey 311 1 Demographics Demographics NNP work_rujstqwje5gkdm2bqer4drugey 311 2 of of IN work_rujstqwje5gkdm2bqer4drugey 311 3 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 311 4 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 311 5 . . . work_rujstqwje5gkdm2bqer4drugey 312 1 Technical Technical NNP work_rujstqwje5gkdm2bqer4drugey 312 2 Report Report NNP work_rujstqwje5gkdm2bqer4drugey 312 3 Working Working NNP work_rujstqwje5gkdm2bqer4drugey 312 4 paper paper NN work_rujstqwje5gkdm2bqer4drugey 312 5 89 89 CD work_rujstqwje5gkdm2bqer4drugey 312 6 CeDER-10 CeDER-10 NNP work_rujstqwje5gkdm2bqer4drugey 312 7 - - HYPH work_rujstqwje5gkdm2bqer4drugey 312 8 01 01 CD work_rujstqwje5gkdm2bqer4drugey 312 9 , , , work_rujstqwje5gkdm2bqer4drugey 312 10 New New NNP work_rujstqwje5gkdm2bqer4drugey 312 11 York York NNP work_rujstqwje5gkdm2bqer4drugey 312 12 University University NNP work_rujstqwje5gkdm2bqer4drugey 312 13 , , , work_rujstqwje5gkdm2bqer4drugey 312 14 Stern Stern NNP work_rujstqwje5gkdm2bqer4drugey 312 15 School School NNP work_rujstqwje5gkdm2bqer4drugey 312 16 of of IN work_rujstqwje5gkdm2bqer4drugey 312 17 Business Business NNP work_rujstqwje5gkdm2bqer4drugey 312 18 . . . work_rujstqwje5gkdm2bqer4drugey 313 1 Ann Ann NNP work_rujstqwje5gkdm2bqer4drugey 313 2 Irvine Irvine NNP work_rujstqwje5gkdm2bqer4drugey 313 3 and and CC work_rujstqwje5gkdm2bqer4drugey 313 4 Alexandre Alexandre NNP work_rujstqwje5gkdm2bqer4drugey 313 5 Klementiev Klementiev NNP work_rujstqwje5gkdm2bqer4drugey 313 6 . . . work_rujstqwje5gkdm2bqer4drugey 314 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 314 2 . . . work_rujstqwje5gkdm2bqer4drugey 315 1 Using use VBG work_rujstqwje5gkdm2bqer4drugey 315 2 Me- Me- NNP work_rujstqwje5gkdm2bqer4drugey 315 3 chanical chanical JJ work_rujstqwje5gkdm2bqer4drugey 315 4 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 315 5 to to TO work_rujstqwje5gkdm2bqer4drugey 315 6 annotate annotate VB work_rujstqwje5gkdm2bqer4drugey 315 7 lexicons lexicon NNS work_rujstqwje5gkdm2bqer4drugey 315 8 for for IN work_rujstqwje5gkdm2bqer4drugey 315 9 less less RBR work_rujstqwje5gkdm2bqer4drugey 315 10 commonly commonly RB work_rujstqwje5gkdm2bqer4drugey 315 11 used use VBN work_rujstqwje5gkdm2bqer4drugey 315 12 languages language NNS work_rujstqwje5gkdm2bqer4drugey 315 13 . . . work_rujstqwje5gkdm2bqer4drugey 316 1 In in IN work_rujstqwje5gkdm2bqer4drugey 316 2 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 316 3 on on IN work_rujstqwje5gkdm2bqer4drugey 316 4 Creating Creating NNP work_rujstqwje5gkdm2bqer4drugey 316 5 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 316 6 and and CC work_rujstqwje5gkdm2bqer4drugey 316 7 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 316 8 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 316 9 with with IN work_rujstqwje5gkdm2bqer4drugey 316 10 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 316 11 . . . work_rujstqwje5gkdm2bqer4drugey 317 1 Ian Ian NNP work_rujstqwje5gkdm2bqer4drugey 317 2 Lane Lane NNP work_rujstqwje5gkdm2bqer4drugey 317 3 , , , work_rujstqwje5gkdm2bqer4drugey 317 4 Matthias Matthias NNP work_rujstqwje5gkdm2bqer4drugey 317 5 Eck Eck NNP work_rujstqwje5gkdm2bqer4drugey 317 6 , , , work_rujstqwje5gkdm2bqer4drugey 317 7 Kay Kay NNP work_rujstqwje5gkdm2bqer4drugey 317 8 Rottmann Rottmann NNP work_rujstqwje5gkdm2bqer4drugey 317 9 , , , work_rujstqwje5gkdm2bqer4drugey 317 10 and and CC work_rujstqwje5gkdm2bqer4drugey 317 11 Alex Alex NNP work_rujstqwje5gkdm2bqer4drugey 317 12 Waibel Waibel NNP work_rujstqwje5gkdm2bqer4drugey 317 13 . . . work_rujstqwje5gkdm2bqer4drugey 318 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 318 2 . . . work_rujstqwje5gkdm2bqer4drugey 319 1 Tools tool NNS work_rujstqwje5gkdm2bqer4drugey 319 2 for for IN work_rujstqwje5gkdm2bqer4drugey 319 3 collecting collect VBG work_rujstqwje5gkdm2bqer4drugey 319 4 speech speech NN work_rujstqwje5gkdm2bqer4drugey 319 5 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 319 6 via via IN work_rujstqwje5gkdm2bqer4drugey 319 7 mechanical mechanical NNP work_rujstqwje5gkdm2bqer4drugey 319 8 - - HYPH work_rujstqwje5gkdm2bqer4drugey 319 9 turk turk NN work_rujstqwje5gkdm2bqer4drugey 319 10 . . . work_rujstqwje5gkdm2bqer4drugey 320 1 In in IN work_rujstqwje5gkdm2bqer4drugey 320 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 320 3 of of IN work_rujstqwje5gkdm2bqer4drugey 320 4 the the DT work_rujstqwje5gkdm2bqer4drugey 320 5 NAACL NAACL NNP work_rujstqwje5gkdm2bqer4drugey 320 6 HLT HLT NNP work_rujstqwje5gkdm2bqer4drugey 320 7 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 320 8 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 320 9 on on IN work_rujstqwje5gkdm2bqer4drugey 320 10 Creating Creating NNP work_rujstqwje5gkdm2bqer4drugey 320 11 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 320 12 and and CC work_rujstqwje5gkdm2bqer4drugey 320 13 Lan- Lan- NNP work_rujstqwje5gkdm2bqer4drugey 320 14 guage guage NN work_rujstqwje5gkdm2bqer4drugey 320 15 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 320 16 with with IN work_rujstqwje5gkdm2bqer4drugey 320 17 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 320 18 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 320 19 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 320 20 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 320 21 , , , work_rujstqwje5gkdm2bqer4drugey 320 22 Los Los NNP work_rujstqwje5gkdm2bqer4drugey 320 23 An- An- NNP work_rujstqwje5gkdm2bqer4drugey 320 24 geles gele NNS work_rujstqwje5gkdm2bqer4drugey 320 25 . . . work_rujstqwje5gkdm2bqer4drugey 321 1 Florian Florian NNP work_rujstqwje5gkdm2bqer4drugey 321 2 Laws Laws NNPS work_rujstqwje5gkdm2bqer4drugey 321 3 , , , work_rujstqwje5gkdm2bqer4drugey 321 4 Christian Christian NNP work_rujstqwje5gkdm2bqer4drugey 321 5 Scheible Scheible NNP work_rujstqwje5gkdm2bqer4drugey 321 6 , , , work_rujstqwje5gkdm2bqer4drugey 321 7 and and CC work_rujstqwje5gkdm2bqer4drugey 321 8 Hinrich Hinrich NNP work_rujstqwje5gkdm2bqer4drugey 321 9 Schütze Schütze NNP work_rujstqwje5gkdm2bqer4drugey 321 10 . . . work_rujstqwje5gkdm2bqer4drugey 322 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 322 2 . . . work_rujstqwje5gkdm2bqer4drugey 323 1 Active active JJ work_rujstqwje5gkdm2bqer4drugey 323 2 learning learn VBG work_rujstqwje5gkdm2bqer4drugey 323 3 with with IN work_rujstqwje5gkdm2bqer4drugey 323 4 amazon amazon NNP work_rujstqwje5gkdm2bqer4drugey 323 5 mechanical mechanical NNP work_rujstqwje5gkdm2bqer4drugey 323 6 turk turk NNP work_rujstqwje5gkdm2bqer4drugey 323 7 . . . work_rujstqwje5gkdm2bqer4drugey 324 1 In in IN work_rujstqwje5gkdm2bqer4drugey 324 2 Proceedings Proceedings NNP work_rujstqwje5gkdm2bqer4drugey 324 3 of of IN work_rujstqwje5gkdm2bqer4drugey 324 4 the the DT work_rujstqwje5gkdm2bqer4drugey 324 5 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 324 6 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 324 7 on on IN work_rujstqwje5gkdm2bqer4drugey 324 8 Empirical Empirical NNP work_rujstqwje5gkdm2bqer4drugey 324 9 Methods Methods NNPS work_rujstqwje5gkdm2bqer4drugey 324 10 in in IN work_rujstqwje5gkdm2bqer4drugey 324 11 Natural Natural NNP work_rujstqwje5gkdm2bqer4drugey 324 12 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 324 13 Processing Processing NNP work_rujstqwje5gkdm2bqer4drugey 324 14 , , , work_rujstqwje5gkdm2bqer4drugey 324 15 Edinburgh Edinburgh NNP work_rujstqwje5gkdm2bqer4drugey 324 16 , , , work_rujstqwje5gkdm2bqer4drugey 324 17 Scotland Scotland NNP work_rujstqwje5gkdm2bqer4drugey 324 18 . . . work_rujstqwje5gkdm2bqer4drugey 325 1 Matthew Matthew NNP work_rujstqwje5gkdm2bqer4drugey 325 2 Lease Lease NNP work_rujstqwje5gkdm2bqer4drugey 325 3 , , , work_rujstqwje5gkdm2bqer4drugey 325 4 Jessica Jessica NNP work_rujstqwje5gkdm2bqer4drugey 325 5 Hullman Hullman NNP work_rujstqwje5gkdm2bqer4drugey 325 6 , , , work_rujstqwje5gkdm2bqer4drugey 325 7 Jeffrey Jeffrey NNP work_rujstqwje5gkdm2bqer4drugey 325 8 P. P. NNP work_rujstqwje5gkdm2bqer4drugey 325 9 Bigham Bigham NNP work_rujstqwje5gkdm2bqer4drugey 325 10 , , , work_rujstqwje5gkdm2bqer4drugey 325 11 Juho Juho NNP work_rujstqwje5gkdm2bqer4drugey 325 12 Kim Kim NNP work_rujstqwje5gkdm2bqer4drugey 325 13 Michael Michael NNP work_rujstqwje5gkdm2bqer4drugey 325 14 S. S. NNP work_rujstqwje5gkdm2bqer4drugey 325 15 Bernstein Bernstein NNP work_rujstqwje5gkdm2bqer4drugey 325 16 and and CC work_rujstqwje5gkdm2bqer4drugey 325 17 , , , work_rujstqwje5gkdm2bqer4drugey 325 18 Walter Walter NNP work_rujstqwje5gkdm2bqer4drugey 325 19 Lasecki Lasecki NNP work_rujstqwje5gkdm2bqer4drugey 325 20 , , , work_rujstqwje5gkdm2bqer4drugey 325 21 Saeideh Saeideh NNP work_rujstqwje5gkdm2bqer4drugey 325 22 Bakhshi Bakhshi NNP work_rujstqwje5gkdm2bqer4drugey 325 23 , , , work_rujstqwje5gkdm2bqer4drugey 325 24 Tanushree Tanushree NNP work_rujstqwje5gkdm2bqer4drugey 325 25 Mitra Mitra NNP work_rujstqwje5gkdm2bqer4drugey 325 26 , , , work_rujstqwje5gkdm2bqer4drugey 325 27 and and CC work_rujstqwje5gkdm2bqer4drugey 325 28 Robert Robert NNP work_rujstqwje5gkdm2bqer4drugey 325 29 C. C. NNP work_rujstqwje5gkdm2bqer4drugey 325 30 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 325 31 . . . work_rujstqwje5gkdm2bqer4drugey 326 1 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 326 2 . . . work_rujstqwje5gkdm2bqer4drugey 327 1 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 327 2 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 327 3 is be VBZ work_rujstqwje5gkdm2bqer4drugey 327 4 not not RB work_rujstqwje5gkdm2bqer4drugey 327 5 anony- anony- NN work_rujstqwje5gkdm2bqer4drugey 327 6 mous mous JJ work_rujstqwje5gkdm2bqer4drugey 327 7 . . . work_rujstqwje5gkdm2bqer4drugey 328 1 http://dx.doi.org/10.2139/ssrn http://dx.doi.org/10.2139/ssrn ADD work_rujstqwje5gkdm2bqer4drugey 328 2 . . . work_rujstqwje5gkdm2bqer4drugey 329 1 2228728 2228728 CD work_rujstqwje5gkdm2bqer4drugey 329 2 . . . work_rujstqwje5gkdm2bqer4drugey 330 1 Vili Vili NNP work_rujstqwje5gkdm2bqer4drugey 330 2 Lehdonvirta Lehdonvirta NNP work_rujstqwje5gkdm2bqer4drugey 330 3 and and CC work_rujstqwje5gkdm2bqer4drugey 330 4 Mirko Mirko NNP work_rujstqwje5gkdm2bqer4drugey 330 5 Ernkvist Ernkvist NNP work_rujstqwje5gkdm2bqer4drugey 330 6 . . . work_rujstqwje5gkdm2bqer4drugey 331 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 331 2 . . . work_rujstqwje5gkdm2bqer4drugey 332 1 Knowl- Knowl- NNP work_rujstqwje5gkdm2bqer4drugey 332 2 edge edge NN work_rujstqwje5gkdm2bqer4drugey 332 3 map map NN work_rujstqwje5gkdm2bqer4drugey 332 4 of of IN work_rujstqwje5gkdm2bqer4drugey 332 5 the the DT work_rujstqwje5gkdm2bqer4drugey 332 6 virtual virtual JJ work_rujstqwje5gkdm2bqer4drugey 332 7 economy economy NN work_rujstqwje5gkdm2bqer4drugey 332 8 : : : work_rujstqwje5gkdm2bqer4drugey 332 9 Converting convert VBG work_rujstqwje5gkdm2bqer4drugey 332 10 the the DT work_rujstqwje5gkdm2bqer4drugey 332 11 virtual virtual JJ work_rujstqwje5gkdm2bqer4drugey 332 12 economy economy NN work_rujstqwje5gkdm2bqer4drugey 332 13 into into IN work_rujstqwje5gkdm2bqer4drugey 332 14 development development NN work_rujstqwje5gkdm2bqer4drugey 332 15 potential potential NN work_rujstqwje5gkdm2bqer4drugey 332 16 . . . work_rujstqwje5gkdm2bqer4drugey 333 1 http://www.infodev.org/en/Document http://www.infodev.org/en/Document NNP work_rujstqwje5gkdm2bqer4drugey 333 2 . . . work_rujstqwje5gkdm2bqer4drugey 334 1 1056.pdf 1056.pdf LS work_rujstqwje5gkdm2bqer4drugey 334 2 , , , work_rujstqwje5gkdm2bqer4drugey 334 3 April April NNP work_rujstqwje5gkdm2bqer4drugey 334 4 . . . work_rujstqwje5gkdm2bqer4drugey 335 1 An an DT work_rujstqwje5gkdm2bqer4drugey 335 2 InfoDev InfoDev NNP work_rujstqwje5gkdm2bqer4drugey 335 3 Publication Publication NNP work_rujstqwje5gkdm2bqer4drugey 335 4 . . . work_rujstqwje5gkdm2bqer4drugey 336 1 M. M. NNP work_rujstqwje5gkdm2bqer4drugey 336 2 Paul Paul NNP work_rujstqwje5gkdm2bqer4drugey 336 3 Lewis Lewis NNP work_rujstqwje5gkdm2bqer4drugey 336 4 , , , work_rujstqwje5gkdm2bqer4drugey 336 5 Gary Gary NNP work_rujstqwje5gkdm2bqer4drugey 336 6 F. F. NNP work_rujstqwje5gkdm2bqer4drugey 336 7 Simons Simons NNP work_rujstqwje5gkdm2bqer4drugey 336 8 , , , work_rujstqwje5gkdm2bqer4drugey 336 9 and and CC work_rujstqwje5gkdm2bqer4drugey 336 10 Charles Charles NNP work_rujstqwje5gkdm2bqer4drugey 336 11 D. D. NNP work_rujstqwje5gkdm2bqer4drugey 336 12 Fennig Fennig NNP work_rujstqwje5gkdm2bqer4drugey 336 13 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 336 14 eds eds NNP work_rujstqwje5gkdm2bqer4drugey 336 15 . . . work_rujstqwje5gkdm2bqer4drugey 336 16 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 336 17 . . . work_rujstqwje5gkdm2bqer4drugey 337 1 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 337 2 . . . work_rujstqwje5gkdm2bqer4drugey 338 1 Ethnologue ethnologue NN work_rujstqwje5gkdm2bqer4drugey 338 2 : : : work_rujstqwje5gkdm2bqer4drugey 338 3 Languages language NNS work_rujstqwje5gkdm2bqer4drugey 338 4 of of IN work_rujstqwje5gkdm2bqer4drugey 338 5 the the DT work_rujstqwje5gkdm2bqer4drugey 338 6 world world NN work_rujstqwje5gkdm2bqer4drugey 338 7 , , , work_rujstqwje5gkdm2bqer4drugey 338 8 seventeenth seventeenth JJ work_rujstqwje5gkdm2bqer4drugey 338 9 edition edition NN work_rujstqwje5gkdm2bqer4drugey 338 10 . . . work_rujstqwje5gkdm2bqer4drugey 339 1 http://www.ethnologue http://www.ethnologue NNP work_rujstqwje5gkdm2bqer4drugey 339 2 . . . work_rujstqwje5gkdm2bqer4drugey 340 1 com com NN work_rujstqwje5gkdm2bqer4drugey 340 2 . . . work_rujstqwje5gkdm2bqer4drugey 341 1 Greg Greg NNP work_rujstqwje5gkdm2bqer4drugey 341 2 Little Little NNP work_rujstqwje5gkdm2bqer4drugey 341 3 , , , work_rujstqwje5gkdm2bqer4drugey 341 4 Lydia Lydia NNP work_rujstqwje5gkdm2bqer4drugey 341 5 B. B. NNP work_rujstqwje5gkdm2bqer4drugey 341 6 Chilton Chilton NNP work_rujstqwje5gkdm2bqer4drugey 341 7 , , , work_rujstqwje5gkdm2bqer4drugey 341 8 Rob Rob NNP work_rujstqwje5gkdm2bqer4drugey 341 9 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 341 10 , , , work_rujstqwje5gkdm2bqer4drugey 341 11 and and CC work_rujstqwje5gkdm2bqer4drugey 341 12 Max Max NNP work_rujstqwje5gkdm2bqer4drugey 341 13 Gold- Gold- NNP work_rujstqwje5gkdm2bqer4drugey 341 14 man man NN work_rujstqwje5gkdm2bqer4drugey 341 15 . . . work_rujstqwje5gkdm2bqer4drugey 342 1 2009 2009 CD work_rujstqwje5gkdm2bqer4drugey 342 2 . . . work_rujstqwje5gkdm2bqer4drugey 343 1 Turkit Turkit NNS work_rujstqwje5gkdm2bqer4drugey 343 2 : : : work_rujstqwje5gkdm2bqer4drugey 343 3 Tools tool NNS work_rujstqwje5gkdm2bqer4drugey 343 4 for for IN work_rujstqwje5gkdm2bqer4drugey 343 5 iterative iterative JJ work_rujstqwje5gkdm2bqer4drugey 343 6 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 343 7 on on IN work_rujstqwje5gkdm2bqer4drugey 343 8 me- me- CD work_rujstqwje5gkdm2bqer4drugey 343 9 chanical chanical JJ work_rujstqwje5gkdm2bqer4drugey 343 10 turk turk NN work_rujstqwje5gkdm2bqer4drugey 343 11 . . . work_rujstqwje5gkdm2bqer4drugey 344 1 In in IN work_rujstqwje5gkdm2bqer4drugey 344 2 Proceedings Proceedings NNP work_rujstqwje5gkdm2bqer4drugey 344 3 of of IN work_rujstqwje5gkdm2bqer4drugey 344 4 the the DT work_rujstqwje5gkdm2bqer4drugey 344 5 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 344 6 on on IN work_rujstqwje5gkdm2bqer4drugey 344 7 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 344 8 Computation Computation NNP work_rujstqwje5gkdm2bqer4drugey 344 9 at at IN work_rujstqwje5gkdm2bqer4drugey 344 10 the the DT work_rujstqwje5gkdm2bqer4drugey 344 11 International International NNP work_rujstqwje5gkdm2bqer4drugey 344 12 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 344 13 on on IN work_rujstqwje5gkdm2bqer4drugey 344 14 Knowledge Knowledge NNP work_rujstqwje5gkdm2bqer4drugey 344 15 Discovery Discovery NNP work_rujstqwje5gkdm2bqer4drugey 344 16 and and CC work_rujstqwje5gkdm2bqer4drugey 344 17 Data Data NNPS work_rujstqwje5gkdm2bqer4drugey 344 18 Mining Mining NNP work_rujstqwje5gkdm2bqer4drugey 344 19 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 344 20 KDD- KDD- NNP work_rujstqwje5gkdm2bqer4drugey 344 21 HCOMP HCOMP NNP work_rujstqwje5gkdm2bqer4drugey 344 22 ’ ' '' work_rujstqwje5gkdm2bqer4drugey 344 23 09 09 CD work_rujstqwje5gkdm2bqer4drugey 344 24 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 344 25 , , , work_rujstqwje5gkdm2bqer4drugey 344 26 Paris Paris NNP work_rujstqwje5gkdm2bqer4drugey 344 27 . . . work_rujstqwje5gkdm2bqer4drugey 345 1 Matthew Matthew NNP work_rujstqwje5gkdm2bqer4drugey 345 2 Marge Marge NNP work_rujstqwje5gkdm2bqer4drugey 345 3 , , , work_rujstqwje5gkdm2bqer4drugey 345 4 Satanjeev Satanjeev NNP work_rujstqwje5gkdm2bqer4drugey 345 5 Banerjee Banerjee NNP work_rujstqwje5gkdm2bqer4drugey 345 6 , , , work_rujstqwje5gkdm2bqer4drugey 345 7 and and CC work_rujstqwje5gkdm2bqer4drugey 345 8 Alexander Alexander NNP work_rujstqwje5gkdm2bqer4drugey 345 9 Rudnicky Rudnicky NNP work_rujstqwje5gkdm2bqer4drugey 345 10 . . . work_rujstqwje5gkdm2bqer4drugey 346 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 346 2 . . . work_rujstqwje5gkdm2bqer4drugey 347 1 Using use VBG work_rujstqwje5gkdm2bqer4drugey 347 2 the the DT work_rujstqwje5gkdm2bqer4drugey 347 3 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 347 4 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 347 5 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 347 6 to to TO work_rujstqwje5gkdm2bqer4drugey 347 7 transcribe transcribe NN work_rujstqwje5gkdm2bqer4drugey 347 8 and and CC work_rujstqwje5gkdm2bqer4drugey 347 9 annotate annotate NN work_rujstqwje5gkdm2bqer4drugey 347 10 meeting meeting NN work_rujstqwje5gkdm2bqer4drugey 347 11 speech speech NN work_rujstqwje5gkdm2bqer4drugey 347 12 for for IN work_rujstqwje5gkdm2bqer4drugey 347 13 extrac- extrac- NNP work_rujstqwje5gkdm2bqer4drugey 347 14 tive tive JJ work_rujstqwje5gkdm2bqer4drugey 347 15 summarization summarization NN work_rujstqwje5gkdm2bqer4drugey 347 16 . . . work_rujstqwje5gkdm2bqer4drugey 348 1 In in IN work_rujstqwje5gkdm2bqer4drugey 348 2 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 348 3 on on IN work_rujstqwje5gkdm2bqer4drugey 348 4 Creating Creating NNP work_rujstqwje5gkdm2bqer4drugey 348 5 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 348 6 and and CC work_rujstqwje5gkdm2bqer4drugey 348 7 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 348 8 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 348 9 with with IN work_rujstqwje5gkdm2bqer4drugey 348 10 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 348 11 . . . work_rujstqwje5gkdm2bqer4drugey 349 1 George George NNP work_rujstqwje5gkdm2bqer4drugey 349 2 A. A. NNP work_rujstqwje5gkdm2bqer4drugey 349 3 Miller Miller NNP work_rujstqwje5gkdm2bqer4drugey 349 4 . . . work_rujstqwje5gkdm2bqer4drugey 350 1 1995 1995 CD work_rujstqwje5gkdm2bqer4drugey 350 2 . . . work_rujstqwje5gkdm2bqer4drugey 351 1 WordNet WordNet NNP work_rujstqwje5gkdm2bqer4drugey 351 2 : : : work_rujstqwje5gkdm2bqer4drugey 351 3 a a DT work_rujstqwje5gkdm2bqer4drugey 351 4 lexical lexical JJ work_rujstqwje5gkdm2bqer4drugey 351 5 database database NN work_rujstqwje5gkdm2bqer4drugey 351 6 for for IN work_rujstqwje5gkdm2bqer4drugey 351 7 english english NNP work_rujstqwje5gkdm2bqer4drugey 351 8 . . . work_rujstqwje5gkdm2bqer4drugey 352 1 Communications communication NNS work_rujstqwje5gkdm2bqer4drugey 352 2 of of IN work_rujstqwje5gkdm2bqer4drugey 352 3 the the DT work_rujstqwje5gkdm2bqer4drugey 352 4 ACM ACM NNP work_rujstqwje5gkdm2bqer4drugey 352 5 , , , work_rujstqwje5gkdm2bqer4drugey 352 6 38(11):39–41 38(11):39–41 CD work_rujstqwje5gkdm2bqer4drugey 352 7 . . . work_rujstqwje5gkdm2bqer4drugey 353 1 Robert Robert NNP work_rujstqwje5gkdm2bqer4drugey 353 2 Munro Munro NNP work_rujstqwje5gkdm2bqer4drugey 353 3 and and CC work_rujstqwje5gkdm2bqer4drugey 353 4 Hal Hal NNP work_rujstqwje5gkdm2bqer4drugey 353 5 Tily Tily NNP work_rujstqwje5gkdm2bqer4drugey 353 6 . . . work_rujstqwje5gkdm2bqer4drugey 354 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 354 2 . . . work_rujstqwje5gkdm2bqer4drugey 355 1 The the DT work_rujstqwje5gkdm2bqer4drugey 355 2 start start NN work_rujstqwje5gkdm2bqer4drugey 355 3 of of IN work_rujstqwje5gkdm2bqer4drugey 355 4 the the DT work_rujstqwje5gkdm2bqer4drugey 355 5 art art NN work_rujstqwje5gkdm2bqer4drugey 355 6 : : : work_rujstqwje5gkdm2bqer4drugey 355 7 Introduction introduction NN work_rujstqwje5gkdm2bqer4drugey 355 8 to to IN work_rujstqwje5gkdm2bqer4drugey 355 9 the the DT work_rujstqwje5gkdm2bqer4drugey 355 10 workshop workshop NN work_rujstqwje5gkdm2bqer4drugey 355 11 on on IN work_rujstqwje5gkdm2bqer4drugey 355 12 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 355 13 technologies technology NNS work_rujstqwje5gkdm2bqer4drugey 355 14 for for IN work_rujstqwje5gkdm2bqer4drugey 355 15 language language NN work_rujstqwje5gkdm2bqer4drugey 355 16 and and CC work_rujstqwje5gkdm2bqer4drugey 355 17 cognition cognition NN work_rujstqwje5gkdm2bqer4drugey 355 18 studies study NNS work_rujstqwje5gkdm2bqer4drugey 355 19 . . . work_rujstqwje5gkdm2bqer4drugey 356 1 In in IN work_rujstqwje5gkdm2bqer4drugey 356 2 Crowdsourcing Crowdsourcing NNP work_rujstqwje5gkdm2bqer4drugey 356 3 Technologies Technologies NNPS work_rujstqwje5gkdm2bqer4drugey 356 4 for for IN work_rujstqwje5gkdm2bqer4drugey 356 5 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 356 6 and and CC work_rujstqwje5gkdm2bqer4drugey 356 7 Cog- cog- CD work_rujstqwje5gkdm2bqer4drugey 356 8 nition nition NN work_rujstqwje5gkdm2bqer4drugey 356 9 Studies Studies NNPS work_rujstqwje5gkdm2bqer4drugey 356 10 , , , work_rujstqwje5gkdm2bqer4drugey 356 11 Boulder Boulder NNP work_rujstqwje5gkdm2bqer4drugey 356 12 . . . work_rujstqwje5gkdm2bqer4drugey 357 1 Scott Scott NNP work_rujstqwje5gkdm2bqer4drugey 357 2 Novotney Novotney NNP work_rujstqwje5gkdm2bqer4drugey 357 3 and and CC work_rujstqwje5gkdm2bqer4drugey 357 4 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 357 5 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 357 6 - - HYPH work_rujstqwje5gkdm2bqer4drugey 357 7 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 357 8 . . . work_rujstqwje5gkdm2bqer4drugey 358 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 358 2 . . . work_rujstqwje5gkdm2bqer4drugey 359 1 Cheap cheap JJ work_rujstqwje5gkdm2bqer4drugey 359 2 , , , work_rujstqwje5gkdm2bqer4drugey 359 3 fast fast JJ work_rujstqwje5gkdm2bqer4drugey 359 4 and and CC work_rujstqwje5gkdm2bqer4drugey 359 5 good good JJ work_rujstqwje5gkdm2bqer4drugey 359 6 enough enough RB work_rujstqwje5gkdm2bqer4drugey 359 7 : : : work_rujstqwje5gkdm2bqer4drugey 359 8 Automatic automatic JJ work_rujstqwje5gkdm2bqer4drugey 359 9 speech speech NN work_rujstqwje5gkdm2bqer4drugey 359 10 recognition recognition NN work_rujstqwje5gkdm2bqer4drugey 359 11 with with IN work_rujstqwje5gkdm2bqer4drugey 359 12 non non JJ work_rujstqwje5gkdm2bqer4drugey 359 13 - - JJ work_rujstqwje5gkdm2bqer4drugey 359 14 expert expert JJ work_rujstqwje5gkdm2bqer4drugey 359 15 transcription transcription NN work_rujstqwje5gkdm2bqer4drugey 359 16 . . . work_rujstqwje5gkdm2bqer4drugey 360 1 In in IN work_rujstqwje5gkdm2bqer4drugey 360 2 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 360 3 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 360 4 Technologies Technologies NNPS work_rujstqwje5gkdm2bqer4drugey 360 5 : : : work_rujstqwje5gkdm2bqer4drugey 360 6 The the DT work_rujstqwje5gkdm2bqer4drugey 360 7 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 360 8 Annual Annual NNP work_rujstqwje5gkdm2bqer4drugey 360 9 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 360 10 of of IN work_rujstqwje5gkdm2bqer4drugey 360 11 the the DT work_rujstqwje5gkdm2bqer4drugey 360 12 North north JJ work_rujstqwje5gkdm2bqer4drugey 360 13 American American NNP work_rujstqwje5gkdm2bqer4drugey 360 14 Chapter Chapter NNP work_rujstqwje5gkdm2bqer4drugey 360 15 of of IN work_rujstqwje5gkdm2bqer4drugey 360 16 the the DT work_rujstqwje5gkdm2bqer4drugey 360 17 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 360 18 for for IN work_rujstqwje5gkdm2bqer4drugey 360 19 Com- Com- NNP work_rujstqwje5gkdm2bqer4drugey 360 20 putational putational JJ work_rujstqwje5gkdm2bqer4drugey 360 21 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 360 22 , , , work_rujstqwje5gkdm2bqer4drugey 360 23 pages page VBZ work_rujstqwje5gkdm2bqer4drugey 360 24 207–215 207–215 CD work_rujstqwje5gkdm2bqer4drugey 360 25 . . . work_rujstqwje5gkdm2bqer4drugey 361 1 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 361 2 for for IN work_rujstqwje5gkdm2bqer4drugey 361 3 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 361 4 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 361 5 . . . work_rujstqwje5gkdm2bqer4drugey 362 1 Gabriel Gabriel NNP work_rujstqwje5gkdm2bqer4drugey 362 2 Parent Parent NNP work_rujstqwje5gkdm2bqer4drugey 362 3 and and CC work_rujstqwje5gkdm2bqer4drugey 362 4 Maxine Maxine NNP work_rujstqwje5gkdm2bqer4drugey 362 5 Eskenazi Eskenazi NNP work_rujstqwje5gkdm2bqer4drugey 362 6 . . . work_rujstqwje5gkdm2bqer4drugey 363 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 363 2 . . . work_rujstqwje5gkdm2bqer4drugey 364 1 Speaking speak VBG work_rujstqwje5gkdm2bqer4drugey 364 2 to to IN work_rujstqwje5gkdm2bqer4drugey 364 3 the the DT work_rujstqwje5gkdm2bqer4drugey 364 4 crowd crowd NN work_rujstqwje5gkdm2bqer4drugey 364 5 : : : work_rujstqwje5gkdm2bqer4drugey 364 6 looking look VBG work_rujstqwje5gkdm2bqer4drugey 364 7 at at IN work_rujstqwje5gkdm2bqer4drugey 364 8 past past JJ work_rujstqwje5gkdm2bqer4drugey 364 9 achievements achievement NNS work_rujstqwje5gkdm2bqer4drugey 364 10 in in IN work_rujstqwje5gkdm2bqer4drugey 364 11 using use VBG work_rujstqwje5gkdm2bqer4drugey 364 12 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 364 13 for for IN work_rujstqwje5gkdm2bqer4drugey 364 14 speech speech NN work_rujstqwje5gkdm2bqer4drugey 364 15 and and CC work_rujstqwje5gkdm2bqer4drugey 364 16 predicting predict VBG work_rujstqwje5gkdm2bqer4drugey 364 17 future future JJ work_rujstqwje5gkdm2bqer4drugey 364 18 chal- chal- NN work_rujstqwje5gkdm2bqer4drugey 364 19 lenges lenge NNS work_rujstqwje5gkdm2bqer4drugey 364 20 . . . work_rujstqwje5gkdm2bqer4drugey 365 1 In in IN work_rujstqwje5gkdm2bqer4drugey 365 2 Proceedings Proceedings NNP work_rujstqwje5gkdm2bqer4drugey 365 3 Interspeech Interspeech NNP work_rujstqwje5gkdm2bqer4drugey 365 4 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 365 5 , , , work_rujstqwje5gkdm2bqer4drugey 365 6 Special Special NNP work_rujstqwje5gkdm2bqer4drugey 365 7 Ses- Ses- NNP work_rujstqwje5gkdm2bqer4drugey 365 8 sion sion NN work_rujstqwje5gkdm2bqer4drugey 365 9 on on IN work_rujstqwje5gkdm2bqer4drugey 365 10 Crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 365 11 . . . work_rujstqwje5gkdm2bqer4drugey 366 1 Matt Matt NNP work_rujstqwje5gkdm2bqer4drugey 366 2 Post Post NNP work_rujstqwje5gkdm2bqer4drugey 366 3 , , , work_rujstqwje5gkdm2bqer4drugey 366 4 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 366 5 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 366 6 - - HYPH work_rujstqwje5gkdm2bqer4drugey 366 7 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 366 8 , , , work_rujstqwje5gkdm2bqer4drugey 366 9 and and CC work_rujstqwje5gkdm2bqer4drugey 366 10 Miles Miles NNP work_rujstqwje5gkdm2bqer4drugey 366 11 Osborne Osborne NNP work_rujstqwje5gkdm2bqer4drugey 366 12 . . . work_rujstqwje5gkdm2bqer4drugey 367 1 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 367 2 . . . work_rujstqwje5gkdm2bqer4drugey 368 1 Constructing construct VBG work_rujstqwje5gkdm2bqer4drugey 368 2 parallel parallel JJ work_rujstqwje5gkdm2bqer4drugey 368 3 corpora corpora NN work_rujstqwje5gkdm2bqer4drugey 368 4 for for IN work_rujstqwje5gkdm2bqer4drugey 368 5 six six CD work_rujstqwje5gkdm2bqer4drugey 368 6 indian indian JJ work_rujstqwje5gkdm2bqer4drugey 368 7 languages language NNS work_rujstqwje5gkdm2bqer4drugey 368 8 via via IN work_rujstqwje5gkdm2bqer4drugey 368 9 crowdsourcing crowdsource VBG work_rujstqwje5gkdm2bqer4drugey 368 10 . . . work_rujstqwje5gkdm2bqer4drugey 369 1 In in IN work_rujstqwje5gkdm2bqer4drugey 369 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 369 3 of of IN work_rujstqwje5gkdm2bqer4drugey 369 4 the the DT work_rujstqwje5gkdm2bqer4drugey 369 5 Seventh Seventh NNP work_rujstqwje5gkdm2bqer4drugey 369 6 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 369 7 on on IN work_rujstqwje5gkdm2bqer4drugey 369 8 Statistical Statistical NNP work_rujstqwje5gkdm2bqer4drugey 369 9 Machine Machine NNP work_rujstqwje5gkdm2bqer4drugey 369 10 Translation Translation NNP work_rujstqwje5gkdm2bqer4drugey 369 11 , , , work_rujstqwje5gkdm2bqer4drugey 369 12 pages page VBZ work_rujstqwje5gkdm2bqer4drugey 369 13 401–409 401–409 CD work_rujstqwje5gkdm2bqer4drugey 369 14 , , , work_rujstqwje5gkdm2bqer4drugey 369 15 Montréal Montréal NNP work_rujstqwje5gkdm2bqer4drugey 369 16 , , , work_rujstqwje5gkdm2bqer4drugey 369 17 Canada Canada NNP work_rujstqwje5gkdm2bqer4drugey 369 18 , , , work_rujstqwje5gkdm2bqer4drugey 369 19 June June NNP work_rujstqwje5gkdm2bqer4drugey 369 20 . . . work_rujstqwje5gkdm2bqer4drugey 370 1 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 370 2 for for IN work_rujstqwje5gkdm2bqer4drugey 370 3 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 370 4 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 370 5 . . . work_rujstqwje5gkdm2bqer4drugey 371 1 Alexander Alexander NNP work_rujstqwje5gkdm2bqer4drugey 371 2 J. J. NNP work_rujstqwje5gkdm2bqer4drugey 371 3 Quinn Quinn NNP work_rujstqwje5gkdm2bqer4drugey 371 4 and and CC work_rujstqwje5gkdm2bqer4drugey 371 5 Benjamin Benjamin NNP work_rujstqwje5gkdm2bqer4drugey 371 6 B. B. NNP work_rujstqwje5gkdm2bqer4drugey 371 7 Bederson Bederson NNP work_rujstqwje5gkdm2bqer4drugey 371 8 . . . work_rujstqwje5gkdm2bqer4drugey 372 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 372 2 . . . work_rujstqwje5gkdm2bqer4drugey 373 1 Human human JJ work_rujstqwje5gkdm2bqer4drugey 373 2 computation computation NN work_rujstqwje5gkdm2bqer4drugey 373 3 : : : work_rujstqwje5gkdm2bqer4drugey 373 4 A a DT work_rujstqwje5gkdm2bqer4drugey 373 5 survey survey NN work_rujstqwje5gkdm2bqer4drugey 373 6 and and CC work_rujstqwje5gkdm2bqer4drugey 373 7 taxonomy taxonomy NN work_rujstqwje5gkdm2bqer4drugey 373 8 of of IN work_rujstqwje5gkdm2bqer4drugey 373 9 a a DT work_rujstqwje5gkdm2bqer4drugey 373 10 growing grow VBG work_rujstqwje5gkdm2bqer4drugey 373 11 field field NN work_rujstqwje5gkdm2bqer4drugey 373 12 . . . work_rujstqwje5gkdm2bqer4drugey 374 1 In in IN work_rujstqwje5gkdm2bqer4drugey 374 2 Computer Computer NNP work_rujstqwje5gkdm2bqer4drugey 374 3 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 374 4 Interaction Interaction NNP work_rujstqwje5gkdm2bqer4drugey 374 5 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 374 6 CHI CHI NNP work_rujstqwje5gkdm2bqer4drugey 374 7 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 374 8 . . . work_rujstqwje5gkdm2bqer4drugey 375 1 Cyrus Cyrus NNP work_rujstqwje5gkdm2bqer4drugey 375 2 Rashtchian Rashtchian NNP work_rujstqwje5gkdm2bqer4drugey 375 3 , , , work_rujstqwje5gkdm2bqer4drugey 375 4 Peter Peter NNP work_rujstqwje5gkdm2bqer4drugey 375 5 Young Young NNP work_rujstqwje5gkdm2bqer4drugey 375 6 , , , work_rujstqwje5gkdm2bqer4drugey 375 7 Micah Micah NNP work_rujstqwje5gkdm2bqer4drugey 375 8 Hodosh Hodosh NNP work_rujstqwje5gkdm2bqer4drugey 375 9 , , , work_rujstqwje5gkdm2bqer4drugey 375 10 and and CC work_rujstqwje5gkdm2bqer4drugey 375 11 Ju- Ju- NNP work_rujstqwje5gkdm2bqer4drugey 375 12 lia lia NN work_rujstqwje5gkdm2bqer4drugey 375 13 Hockenmaier Hockenmaier NNP work_rujstqwje5gkdm2bqer4drugey 375 14 . . . work_rujstqwje5gkdm2bqer4drugey 376 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 376 2 . . . work_rujstqwje5gkdm2bqer4drugey 377 1 Collecting collect VBG work_rujstqwje5gkdm2bqer4drugey 377 2 image image NN work_rujstqwje5gkdm2bqer4drugey 377 3 annotations annotation NNS work_rujstqwje5gkdm2bqer4drugey 377 4 using use VBG work_rujstqwje5gkdm2bqer4drugey 377 5 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 377 6 ’s ’s POS work_rujstqwje5gkdm2bqer4drugey 377 7 Mechanical Mechanical NNP work_rujstqwje5gkdm2bqer4drugey 377 8 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 377 9 . . . work_rujstqwje5gkdm2bqer4drugey 378 1 In in IN work_rujstqwje5gkdm2bqer4drugey 378 2 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 378 3 on on IN work_rujstqwje5gkdm2bqer4drugey 378 4 Creating Creating NNP work_rujstqwje5gkdm2bqer4drugey 378 5 Speech Speech NNP work_rujstqwje5gkdm2bqer4drugey 378 6 and and CC work_rujstqwje5gkdm2bqer4drugey 378 7 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 378 8 Data Data NNP work_rujstqwje5gkdm2bqer4drugey 378 9 with with IN work_rujstqwje5gkdm2bqer4drugey 378 10 MTurk MTurk NNP work_rujstqwje5gkdm2bqer4drugey 378 11 . . . work_rujstqwje5gkdm2bqer4drugey 379 1 Joel Joel NNP work_rujstqwje5gkdm2bqer4drugey 379 2 Ross Ross NNP work_rujstqwje5gkdm2bqer4drugey 379 3 , , , work_rujstqwje5gkdm2bqer4drugey 379 4 Lilly Lilly NNP work_rujstqwje5gkdm2bqer4drugey 379 5 Irani Irani NNP work_rujstqwje5gkdm2bqer4drugey 379 6 , , , work_rujstqwje5gkdm2bqer4drugey 379 7 M. M. NNP work_rujstqwje5gkdm2bqer4drugey 379 8 Six Six NNP work_rujstqwje5gkdm2bqer4drugey 379 9 Silberman Silberman NNP work_rujstqwje5gkdm2bqer4drugey 379 10 , , , work_rujstqwje5gkdm2bqer4drugey 379 11 Andrew Andrew NNP work_rujstqwje5gkdm2bqer4drugey 379 12 Zal- Zal- NNP work_rujstqwje5gkdm2bqer4drugey 379 13 divar divar NN work_rujstqwje5gkdm2bqer4drugey 379 14 , , , work_rujstqwje5gkdm2bqer4drugey 379 15 and and CC work_rujstqwje5gkdm2bqer4drugey 379 16 Bill Bill NNP work_rujstqwje5gkdm2bqer4drugey 379 17 Tomlinson Tomlinson NNP work_rujstqwje5gkdm2bqer4drugey 379 18 . . . work_rujstqwje5gkdm2bqer4drugey 380 1 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 380 2 . . . work_rujstqwje5gkdm2bqer4drugey 380 3 Who who WP work_rujstqwje5gkdm2bqer4drugey 380 4 are be VBP work_rujstqwje5gkdm2bqer4drugey 380 5 the the DT work_rujstqwje5gkdm2bqer4drugey 380 6 crowd- crowd- NN work_rujstqwje5gkdm2bqer4drugey 380 7 workers worker NNS work_rujstqwje5gkdm2bqer4drugey 380 8 ? ? . work_rujstqwje5gkdm2bqer4drugey 381 1 : : : work_rujstqwje5gkdm2bqer4drugey 381 2 Shifting shift VBG work_rujstqwje5gkdm2bqer4drugey 381 3 demographics demographic NNS work_rujstqwje5gkdm2bqer4drugey 381 4 in in IN work_rujstqwje5gkdm2bqer4drugey 381 5 Amazon Amazon NNP work_rujstqwje5gkdm2bqer4drugey 381 6 Mechan- Mechan- NNP work_rujstqwje5gkdm2bqer4drugey 381 7 ical ical JJ work_rujstqwje5gkdm2bqer4drugey 381 8 Turk Turk NNP work_rujstqwje5gkdm2bqer4drugey 381 9 . . . work_rujstqwje5gkdm2bqer4drugey 382 1 In in IN work_rujstqwje5gkdm2bqer4drugey 382 2 alt alt NN work_rujstqwje5gkdm2bqer4drugey 382 3 . . . work_rujstqwje5gkdm2bqer4drugey 382 4 CHI CHI NNP work_rujstqwje5gkdm2bqer4drugey 382 5 session session NN work_rujstqwje5gkdm2bqer4drugey 382 6 of of IN work_rujstqwje5gkdm2bqer4drugey 382 7 CHI CHI NNP work_rujstqwje5gkdm2bqer4drugey 382 8 2010 2010 CD work_rujstqwje5gkdm2bqer4drugey 382 9 extended extended JJ work_rujstqwje5gkdm2bqer4drugey 382 10 abstracts abstract NNS work_rujstqwje5gkdm2bqer4drugey 382 11 on on IN work_rujstqwje5gkdm2bqer4drugey 382 12 human human JJ work_rujstqwje5gkdm2bqer4drugey 382 13 factors factor NNS work_rujstqwje5gkdm2bqer4drugey 382 14 in in IN work_rujstqwje5gkdm2bqer4drugey 382 15 computing compute VBG work_rujstqwje5gkdm2bqer4drugey 382 16 systems system NNS work_rujstqwje5gkdm2bqer4drugey 382 17 , , , work_rujstqwje5gkdm2bqer4drugey 382 18 At- At- NNP work_rujstqwje5gkdm2bqer4drugey 382 19 lanta lanta NNP work_rujstqwje5gkdm2bqer4drugey 382 20 , , , work_rujstqwje5gkdm2bqer4drugey 382 21 Georgia Georgia NNP work_rujstqwje5gkdm2bqer4drugey 382 22 . . . work_rujstqwje5gkdm2bqer4drugey 383 1 Yaron Yaron NNP work_rujstqwje5gkdm2bqer4drugey 383 2 Singer Singer NNP work_rujstqwje5gkdm2bqer4drugey 383 3 and and CC work_rujstqwje5gkdm2bqer4drugey 383 4 Manas Manas NNP work_rujstqwje5gkdm2bqer4drugey 383 5 Mittal Mittal NNP work_rujstqwje5gkdm2bqer4drugey 383 6 . . . work_rujstqwje5gkdm2bqer4drugey 384 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 384 2 . . . work_rujstqwje5gkdm2bqer4drugey 385 1 Pricing price VBG work_rujstqwje5gkdm2bqer4drugey 385 2 mecha- mecha- NN work_rujstqwje5gkdm2bqer4drugey 385 3 nisms nisms NNP work_rujstqwje5gkdm2bqer4drugey 385 4 for for IN work_rujstqwje5gkdm2bqer4drugey 385 5 online online JJ work_rujstqwje5gkdm2bqer4drugey 385 6 labor labor NN work_rujstqwje5gkdm2bqer4drugey 385 7 markets market NNS work_rujstqwje5gkdm2bqer4drugey 385 8 . . . work_rujstqwje5gkdm2bqer4drugey 386 1 In in IN work_rujstqwje5gkdm2bqer4drugey 386 2 Third Third NNP work_rujstqwje5gkdm2bqer4drugey 386 3 AAAI AAAI NNP work_rujstqwje5gkdm2bqer4drugey 386 4 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 386 5 Computation Computation NNP work_rujstqwje5gkdm2bqer4drugey 386 6 Workshop Workshop NNP work_rujstqwje5gkdm2bqer4drugey 386 7 ( ( -LRB- work_rujstqwje5gkdm2bqer4drugey 386 8 HCOMP’11 HCOMP’11 NNP work_rujstqwje5gkdm2bqer4drugey 386 9 ) ) -RRB- work_rujstqwje5gkdm2bqer4drugey 386 10 . . . work_rujstqwje5gkdm2bqer4drugey 387 1 Rion Rion NNP work_rujstqwje5gkdm2bqer4drugey 387 2 Snow Snow NNP work_rujstqwje5gkdm2bqer4drugey 387 3 , , , work_rujstqwje5gkdm2bqer4drugey 387 4 Brendan Brendan NNP work_rujstqwje5gkdm2bqer4drugey 387 5 O’Connor O’Connor NNP work_rujstqwje5gkdm2bqer4drugey 387 6 , , , work_rujstqwje5gkdm2bqer4drugey 387 7 Daniel Daniel NNP work_rujstqwje5gkdm2bqer4drugey 387 8 Jurafsky Jurafsky NNP work_rujstqwje5gkdm2bqer4drugey 387 9 , , , work_rujstqwje5gkdm2bqer4drugey 387 10 and and CC work_rujstqwje5gkdm2bqer4drugey 387 11 Andrew Andrew NNP work_rujstqwje5gkdm2bqer4drugey 387 12 Y. Y. NNP work_rujstqwje5gkdm2bqer4drugey 387 13 Ng Ng NNP work_rujstqwje5gkdm2bqer4drugey 387 14 . . . work_rujstqwje5gkdm2bqer4drugey 388 1 2008 2008 CD work_rujstqwje5gkdm2bqer4drugey 388 2 . . . work_rujstqwje5gkdm2bqer4drugey 389 1 Cheap cheap JJ work_rujstqwje5gkdm2bqer4drugey 389 2 and and CC work_rujstqwje5gkdm2bqer4drugey 389 3 fast fast RB work_rujstqwje5gkdm2bqer4drugey 389 4 - - HYPH work_rujstqwje5gkdm2bqer4drugey 389 5 but but CC work_rujstqwje5gkdm2bqer4drugey 389 6 is be VBZ work_rujstqwje5gkdm2bqer4drugey 389 7 it -PRON- PRP work_rujstqwje5gkdm2bqer4drugey 389 8 good good JJ work_rujstqwje5gkdm2bqer4drugey 389 9 ? ? . work_rujstqwje5gkdm2bqer4drugey 390 1 Evaluating evaluate VBG work_rujstqwje5gkdm2bqer4drugey 390 2 non non JJ work_rujstqwje5gkdm2bqer4drugey 390 3 - - JJ work_rujstqwje5gkdm2bqer4drugey 390 4 expert expert JJ work_rujstqwje5gkdm2bqer4drugey 390 5 annotations annotation NNS work_rujstqwje5gkdm2bqer4drugey 390 6 for for IN work_rujstqwje5gkdm2bqer4drugey 390 7 natural natural JJ work_rujstqwje5gkdm2bqer4drugey 390 8 language language NN work_rujstqwje5gkdm2bqer4drugey 390 9 tasks task NNS work_rujstqwje5gkdm2bqer4drugey 390 10 . . . work_rujstqwje5gkdm2bqer4drugey 391 1 In in IN work_rujstqwje5gkdm2bqer4drugey 391 2 Proceedings Proceedings NNP work_rujstqwje5gkdm2bqer4drugey 391 3 of of IN work_rujstqwje5gkdm2bqer4drugey 391 4 EMNLP EMNLP NNP work_rujstqwje5gkdm2bqer4drugey 391 5 . . . work_rujstqwje5gkdm2bqer4drugey 392 1 Alexander Alexander NNP work_rujstqwje5gkdm2bqer4drugey 392 2 Sorokin Sorokin NNP work_rujstqwje5gkdm2bqer4drugey 392 3 and and CC work_rujstqwje5gkdm2bqer4drugey 392 4 David David NNP work_rujstqwje5gkdm2bqer4drugey 392 5 Forsyth Forsyth NNP work_rujstqwje5gkdm2bqer4drugey 392 6 . . . work_rujstqwje5gkdm2bqer4drugey 393 1 2008 2008 CD work_rujstqwje5gkdm2bqer4drugey 393 2 . . . work_rujstqwje5gkdm2bqer4drugey 394 1 Utility utility NN work_rujstqwje5gkdm2bqer4drugey 394 2 data data NN work_rujstqwje5gkdm2bqer4drugey 394 3 annotation annotation NN work_rujstqwje5gkdm2bqer4drugey 394 4 with with IN work_rujstqwje5gkdm2bqer4drugey 394 5 amazon amazon NNP work_rujstqwje5gkdm2bqer4drugey 394 6 mechanical mechanical NNP work_rujstqwje5gkdm2bqer4drugey 394 7 turk turk NNP work_rujstqwje5gkdm2bqer4drugey 394 8 . . . work_rujstqwje5gkdm2bqer4drugey 395 1 In in IN work_rujstqwje5gkdm2bqer4drugey 395 2 First first JJ work_rujstqwje5gkdm2bqer4drugey 395 3 IEEE ieee JJ work_rujstqwje5gkdm2bqer4drugey 395 4 Workshop workshop NN work_rujstqwje5gkdm2bqer4drugey 395 5 on on IN work_rujstqwje5gkdm2bqer4drugey 395 6 Internet internet NN work_rujstqwje5gkdm2bqer4drugey 395 7 Vision vision NN work_rujstqwje5gkdm2bqer4drugey 395 8 at at IN work_rujstqwje5gkdm2bqer4drugey 395 9 CVPR CVPR NNP work_rujstqwje5gkdm2bqer4drugey 395 10 . . . work_rujstqwje5gkdm2bqer4drugey 396 1 Luis Luis NNP work_rujstqwje5gkdm2bqer4drugey 396 2 von von NNP work_rujstqwje5gkdm2bqer4drugey 396 3 Ahn Ahn NNP work_rujstqwje5gkdm2bqer4drugey 396 4 . . . work_rujstqwje5gkdm2bqer4drugey 397 1 2005 2005 CD work_rujstqwje5gkdm2bqer4drugey 397 2 . . . work_rujstqwje5gkdm2bqer4drugey 398 1 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 398 2 Computation Computation NNP work_rujstqwje5gkdm2bqer4drugey 398 3 . . . work_rujstqwje5gkdm2bqer4drugey 399 1 Ph.D. Ph.D. NNP work_rujstqwje5gkdm2bqer4drugey 399 2 thesis thesis NNP work_rujstqwje5gkdm2bqer4drugey 399 3 , , , work_rujstqwje5gkdm2bqer4drugey 399 4 School School NNP work_rujstqwje5gkdm2bqer4drugey 399 5 of of IN work_rujstqwje5gkdm2bqer4drugey 399 6 Computer Computer NNP work_rujstqwje5gkdm2bqer4drugey 399 7 Science Science NNP work_rujstqwje5gkdm2bqer4drugey 399 8 , , , work_rujstqwje5gkdm2bqer4drugey 399 9 Carnegie Carnegie NNP work_rujstqwje5gkdm2bqer4drugey 399 10 Mellon Mellon NNP work_rujstqwje5gkdm2bqer4drugey 399 11 Uni- Uni- NNP work_rujstqwje5gkdm2bqer4drugey 399 12 versity versity NN work_rujstqwje5gkdm2bqer4drugey 399 13 , , , work_rujstqwje5gkdm2bqer4drugey 399 14 Pittsburgh Pittsburgh NNP work_rujstqwje5gkdm2bqer4drugey 399 15 , , , work_rujstqwje5gkdm2bqer4drugey 399 16 PA PA NNP work_rujstqwje5gkdm2bqer4drugey 399 17 . . . work_rujstqwje5gkdm2bqer4drugey 399 18 Omar Omar NNP work_rujstqwje5gkdm2bqer4drugey 399 19 F. F. NNP work_rujstqwje5gkdm2bqer4drugey 399 20 Zaidan Zaidan NNP work_rujstqwje5gkdm2bqer4drugey 399 21 and and CC work_rujstqwje5gkdm2bqer4drugey 399 22 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 399 23 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 399 24 - - HYPH work_rujstqwje5gkdm2bqer4drugey 399 25 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 399 26 . . . work_rujstqwje5gkdm2bqer4drugey 400 1 2011 2011 CD work_rujstqwje5gkdm2bqer4drugey 400 2 . . . work_rujstqwje5gkdm2bqer4drugey 401 1 Crowd- Crowd- NNP work_rujstqwje5gkdm2bqer4drugey 401 2 sourcing source VBG work_rujstqwje5gkdm2bqer4drugey 401 3 translation translation NN work_rujstqwje5gkdm2bqer4drugey 401 4 : : : work_rujstqwje5gkdm2bqer4drugey 401 5 Professional professional JJ work_rujstqwje5gkdm2bqer4drugey 401 6 quality quality NN work_rujstqwje5gkdm2bqer4drugey 401 7 from from IN work_rujstqwje5gkdm2bqer4drugey 401 8 non- non- NN work_rujstqwje5gkdm2bqer4drugey 401 9 professionals professional NNS work_rujstqwje5gkdm2bqer4drugey 401 10 . . . work_rujstqwje5gkdm2bqer4drugey 402 1 In in IN work_rujstqwje5gkdm2bqer4drugey 402 2 Proceedings proceeding NNS work_rujstqwje5gkdm2bqer4drugey 402 3 of of IN work_rujstqwje5gkdm2bqer4drugey 402 4 the the DT work_rujstqwje5gkdm2bqer4drugey 402 5 49th 49th JJ work_rujstqwje5gkdm2bqer4drugey 402 6 Annual Annual NNP work_rujstqwje5gkdm2bqer4drugey 402 7 Meeting Meeting NNP work_rujstqwje5gkdm2bqer4drugey 402 8 of of IN work_rujstqwje5gkdm2bqer4drugey 402 9 the the DT work_rujstqwje5gkdm2bqer4drugey 402 10 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 402 11 for for IN work_rujstqwje5gkdm2bqer4drugey 402 12 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 402 13 Lin- Lin- NNP work_rujstqwje5gkdm2bqer4drugey 402 14 guistics guistic NNS work_rujstqwje5gkdm2bqer4drugey 402 15 : : : work_rujstqwje5gkdm2bqer4drugey 402 16 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 402 17 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 402 18 Technologies Technologies NNPS work_rujstqwje5gkdm2bqer4drugey 402 19 , , , work_rujstqwje5gkdm2bqer4drugey 402 20 pages page NNS work_rujstqwje5gkdm2bqer4drugey 402 21 1220 1220 CD work_rujstqwje5gkdm2bqer4drugey 402 22 – – : work_rujstqwje5gkdm2bqer4drugey 402 23 1229 1229 CD work_rujstqwje5gkdm2bqer4drugey 402 24 . . . work_rujstqwje5gkdm2bqer4drugey 403 1 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 403 2 for for IN work_rujstqwje5gkdm2bqer4drugey 403 3 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 403 4 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 403 5 . . . work_rujstqwje5gkdm2bqer4drugey 404 1 Rabih Rabih NNP work_rujstqwje5gkdm2bqer4drugey 404 2 Zbib Zbib NNP work_rujstqwje5gkdm2bqer4drugey 404 3 , , , work_rujstqwje5gkdm2bqer4drugey 404 4 Erika Erika NNP work_rujstqwje5gkdm2bqer4drugey 404 5 Malchiodi Malchiodi NNP work_rujstqwje5gkdm2bqer4drugey 404 6 , , , work_rujstqwje5gkdm2bqer4drugey 404 7 Jacob Jacob NNP work_rujstqwje5gkdm2bqer4drugey 404 8 Devlin Devlin NNP work_rujstqwje5gkdm2bqer4drugey 404 9 , , , work_rujstqwje5gkdm2bqer4drugey 404 10 David David NNP work_rujstqwje5gkdm2bqer4drugey 404 11 Stallard Stallard NNP work_rujstqwje5gkdm2bqer4drugey 404 12 , , , work_rujstqwje5gkdm2bqer4drugey 404 13 Spyros Spyros NNP work_rujstqwje5gkdm2bqer4drugey 404 14 Matsoukas Matsoukas NNP work_rujstqwje5gkdm2bqer4drugey 404 15 , , , work_rujstqwje5gkdm2bqer4drugey 404 16 Richard Richard NNP work_rujstqwje5gkdm2bqer4drugey 404 17 Schwartz Schwartz NNP work_rujstqwje5gkdm2bqer4drugey 404 18 , , , work_rujstqwje5gkdm2bqer4drugey 404 19 John John NNP work_rujstqwje5gkdm2bqer4drugey 404 20 Makhoul Makhoul NNP work_rujstqwje5gkdm2bqer4drugey 404 21 , , , work_rujstqwje5gkdm2bqer4drugey 404 22 Omar Omar NNP work_rujstqwje5gkdm2bqer4drugey 404 23 F. F. NNP work_rujstqwje5gkdm2bqer4drugey 404 24 Zaidan Zaidan NNP work_rujstqwje5gkdm2bqer4drugey 404 25 , , , work_rujstqwje5gkdm2bqer4drugey 404 26 and and CC work_rujstqwje5gkdm2bqer4drugey 404 27 Chris Chris NNP work_rujstqwje5gkdm2bqer4drugey 404 28 Callison Callison NNP work_rujstqwje5gkdm2bqer4drugey 404 29 - - HYPH work_rujstqwje5gkdm2bqer4drugey 404 30 Burch Burch NNP work_rujstqwje5gkdm2bqer4drugey 404 31 . . . work_rujstqwje5gkdm2bqer4drugey 405 1 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 405 2 . . . work_rujstqwje5gkdm2bqer4drugey 406 1 Machine machine NN work_rujstqwje5gkdm2bqer4drugey 406 2 translation translation NN work_rujstqwje5gkdm2bqer4drugey 406 3 of of IN work_rujstqwje5gkdm2bqer4drugey 406 4 Arabic arabic JJ work_rujstqwje5gkdm2bqer4drugey 406 5 dialects dialect NNS work_rujstqwje5gkdm2bqer4drugey 406 6 . . . work_rujstqwje5gkdm2bqer4drugey 407 1 In in IN work_rujstqwje5gkdm2bqer4drugey 407 2 The the DT work_rujstqwje5gkdm2bqer4drugey 407 3 2012 2012 CD work_rujstqwje5gkdm2bqer4drugey 407 4 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 407 5 of of IN work_rujstqwje5gkdm2bqer4drugey 407 6 the the DT work_rujstqwje5gkdm2bqer4drugey 407 7 North north JJ work_rujstqwje5gkdm2bqer4drugey 407 8 American American NNP work_rujstqwje5gkdm2bqer4drugey 407 9 Chapter Chapter NNP work_rujstqwje5gkdm2bqer4drugey 407 10 of of IN work_rujstqwje5gkdm2bqer4drugey 407 11 the the DT work_rujstqwje5gkdm2bqer4drugey 407 12 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 407 13 for for IN work_rujstqwje5gkdm2bqer4drugey 407 14 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 407 15 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 407 16 . . . work_rujstqwje5gkdm2bqer4drugey 408 1 Asso- asso- IN work_rujstqwje5gkdm2bqer4drugey 408 2 ciation ciation NN work_rujstqwje5gkdm2bqer4drugey 408 3 for for IN work_rujstqwje5gkdm2bqer4drugey 408 4 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 408 5 Linguistics Linguistics NNP work_rujstqwje5gkdm2bqer4drugey 408 6 . . . work_rujstqwje5gkdm2bqer4drugey 409 1 90 90 CD work_rujstqwje5gkdm2bqer4drugey 409 2 Rabih Rabih NNP work_rujstqwje5gkdm2bqer4drugey 409 3 Zbib Zbib NNP work_rujstqwje5gkdm2bqer4drugey 409 4 , , , work_rujstqwje5gkdm2bqer4drugey 409 5 Gretchen Gretchen NNP work_rujstqwje5gkdm2bqer4drugey 409 6 Markiewicz Markiewicz NNP work_rujstqwje5gkdm2bqer4drugey 409 7 , , , work_rujstqwje5gkdm2bqer4drugey 409 8 Spyros Spyros NNP work_rujstqwje5gkdm2bqer4drugey 409 9 Matsoukas Matsoukas NNP work_rujstqwje5gkdm2bqer4drugey 409 10 , , , work_rujstqwje5gkdm2bqer4drugey 409 11 Richard Richard NNP work_rujstqwje5gkdm2bqer4drugey 409 12 Schwartz Schwartz NNP work_rujstqwje5gkdm2bqer4drugey 409 13 , , , work_rujstqwje5gkdm2bqer4drugey 409 14 and and CC work_rujstqwje5gkdm2bqer4drugey 409 15 John John NNP work_rujstqwje5gkdm2bqer4drugey 409 16 Makhoul Makhoul NNP work_rujstqwje5gkdm2bqer4drugey 409 17 . . . work_rujstqwje5gkdm2bqer4drugey 410 1 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 410 2 . . . work_rujstqwje5gkdm2bqer4drugey 411 1 Sys- Sys- NNP work_rujstqwje5gkdm2bqer4drugey 411 2 tematic tematic JJ work_rujstqwje5gkdm2bqer4drugey 411 3 comparison comparison NN work_rujstqwje5gkdm2bqer4drugey 411 4 of of IN work_rujstqwje5gkdm2bqer4drugey 411 5 professional professional NNP work_rujstqwje5gkdm2bqer4drugey 411 6 and and CC work_rujstqwje5gkdm2bqer4drugey 411 7 crowdsourced crowdsourced JJ work_rujstqwje5gkdm2bqer4drugey 411 8 reference reference NN work_rujstqwje5gkdm2bqer4drugey 411 9 translations translation NNS work_rujstqwje5gkdm2bqer4drugey 411 10 for for IN work_rujstqwje5gkdm2bqer4drugey 411 11 machine machine NN work_rujstqwje5gkdm2bqer4drugey 411 12 translation translation NN work_rujstqwje5gkdm2bqer4drugey 411 13 . . . work_rujstqwje5gkdm2bqer4drugey 412 1 In in IN work_rujstqwje5gkdm2bqer4drugey 412 2 Pro- Pro- NNP work_rujstqwje5gkdm2bqer4drugey 412 3 ceedings ceeding NNS work_rujstqwje5gkdm2bqer4drugey 412 4 of of IN work_rujstqwje5gkdm2bqer4drugey 412 5 the the DT work_rujstqwje5gkdm2bqer4drugey 412 6 2013 2013 CD work_rujstqwje5gkdm2bqer4drugey 412 7 Conference Conference NNP work_rujstqwje5gkdm2bqer4drugey 412 8 of of IN work_rujstqwje5gkdm2bqer4drugey 412 9 the the DT work_rujstqwje5gkdm2bqer4drugey 412 10 North North NNP work_rujstqwje5gkdm2bqer4drugey 412 11 Amer- amer- JJ work_rujstqwje5gkdm2bqer4drugey 412 12 ican ican JJ work_rujstqwje5gkdm2bqer4drugey 412 13 Chapter chapter NN work_rujstqwje5gkdm2bqer4drugey 412 14 of of IN work_rujstqwje5gkdm2bqer4drugey 412 15 the the DT work_rujstqwje5gkdm2bqer4drugey 412 16 Association Association NNP work_rujstqwje5gkdm2bqer4drugey 412 17 for for IN work_rujstqwje5gkdm2bqer4drugey 412 18 Computational Computational NNP work_rujstqwje5gkdm2bqer4drugey 412 19 Linguistics Linguistics NNPS work_rujstqwje5gkdm2bqer4drugey 412 20 : : : work_rujstqwje5gkdm2bqer4drugey 412 21 Human Human NNP work_rujstqwje5gkdm2bqer4drugey 412 22 Language Language NNP work_rujstqwje5gkdm2bqer4drugey 412 23 Technologies Technologies NNPS work_rujstqwje5gkdm2bqer4drugey 412 24 , , , work_rujstqwje5gkdm2bqer4drugey 412 25 Atlanta Atlanta NNP work_rujstqwje5gkdm2bqer4drugey 412 26 , , , work_rujstqwje5gkdm2bqer4drugey 412 27 Georgia Georgia NNP work_rujstqwje5gkdm2bqer4drugey 412 28 . . . work_rujstqwje5gkdm2bqer4drugey 413 1 91 91 CD work_rujstqwje5gkdm2bqer4drugey 413 2 92 92 CD