mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-troyExtinctCity-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/1124.txt inflating: ./tmp/input/input-file/1790.txt inflating: ./tmp/input/input-file/257.txt inflating: ./tmp/input/input-file/658.txt inflating: ./tmp/input/input-file/32326.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-troyExtinctCity-gutenberg FILE: cache/1124.txt OUTPUT: txt/1124.txt FILE: cache/658.txt OUTPUT: txt/658.txt FILE: cache/257.txt OUTPUT: txt/257.txt FILE: cache/1790.txt OUTPUT: txt/1790.txt FILE: cache/32326.txt OUTPUT: txt/32326.txt === file2bib.sh === id: 1124 author: Shakespeare, William title: The History of Troilus and Cressida date: pages: extension: .txt txt: ./txt/1124.txt cache: ./cache/1124.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'1124.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 1790 author: Shakespeare, William title: Troilus and Cressida date: pages: extension: .txt txt: ./txt/1790.txt cache: ./cache/1790.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'1790.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 1124 txt/../pos/1124.pos 1790 txt/../wrd/1790.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 1790 txt/../ent/1790.ent 1790 txt/../pos/1790.pos 1124 txt/../ent/1124.ent 1124 txt/../wrd/1124.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 257 txt/../pos/257.pos 257 txt/../ent/257.ent 257 txt/../wrd/257.wrd 658 txt/../pos/658.pos 32326 txt/../pos/32326.pos 658 txt/../wrd/658.wrd 658 txt/../ent/658.ent 32326 txt/../wrd/32326.wrd 32326 txt/../ent/32326.ent === file2bib.sh === id: 257 author: Chaucer, Geoffrey title: Troilus and Criseyde date: pages: extension: .txt txt: ./txt/257.txt cache: ./cache/257.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'257.txt' === file2bib.sh === id: 32326 author: Lang, Andrew title: Tales of Troy and Greece date: pages: extension: .txt txt: ./txt/32326.txt cache: ./cache/32326.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'32326.txt' === file2bib.sh === id: 658 author: Quintus, Smyrnaeus, active 4th century title: The Fall of Troy date: pages: extension: .txt txt: ./txt/658.txt cache: ./cache/658.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'658.txt' Done mapping. Reducing subject-troyExtinctCity-gutenberg === reduce.pl bib === id = 257 author = Chaucer, Geoffrey title = Troilus and Criseyde date = pages = extension = .txt mime = text/plain words = 68841 sentences = 8087 flesch = 105 summary = For love of thee, whan thou tornest ful ofte! Right as thy-selven list, wol doon by thee, And seyd swich thing wher-with thy god is plesed, And thee right nought, yet al is seyd or shal; 'Ful wel, I thanke it god,' quod Pandarus, 155 Go love, for, olde, ther wol no wight of thee. She seyde, that to slepe wel hir leste. 'And I my-self shal ther-with to hir goon; And gan to Iape, and seyde, 'Y-wis, myn herte, Ther-as thou mayst thy-self hir preye of grace. Sin god hath wrought me for I shal yow serve, 1290 Whan that hir hertes wel assured were, 1395 Of Troilus gan in hir herte shette For, god it wot, hir herte on other thing is, Wher shal I seye to yow "wel come" or no, That thou hir see, that cause is of thy sorwe. As she that hadde hir herte on Troilus cache = ./cache/257.txt txt = ./txt/257.txt === reduce.pl bib === id = 32326 author = Lang, Andrew title = Tales of Troy and Greece date = pages = extension = .txt mime = text/plain words = 94131 sentences = 4038 flesch = 86 summary = palace of his father, King Laertes, but Ulysses, with his own hands, men stood to fight with sword and spear when there was a battle at sea. 'Come, then, let us be going,' said Ulysses, 'for the night is late, and Now Ulysses saw Dolon as he came, and said to Diomede, 'Let us suffer Then the Trojans all with one voice said that Ulysses was the best man ship of Ulysses, like men wrecked on a desert island, who keep watch 'Tell me pray,' said Ulysses, 'what land is this, and what men At last Ulysses told Telemachus how he had come home in a ship of the She prayed, and said, 'Father Zeus, King of Gods and men, loudly hast 'Look to my horses and man,' said Theseus; 'I come to see your master.' 'His ship we could burn, and his men we could slay,' said Theseus; and cache = ./cache/32326.txt txt = ./txt/32326.txt === reduce.pl bib === === reduce.pl bib === id = 658 author = Quintus, Smyrnaeus, active 4th century title = The Fall of Troy date = pages = extension = .txt mime = text/plain words = 81422 sentences = 6348 flesch = 94 summary = A battle-fury like the War-god's wrath Thee not thy sire the War-god now shall pluck All round the Trojan men's heart-stricken wail, How Memnon, Son of the Dawn, for Troy's sake fell in the Battle. Closed round the corpse of strong-heart Aeacus' son, Their tears fell round the dead man, Aeacus' son; Though Peleus' son hath died, shall have small heart And Atreus' son, lord of all Argive men, Till Aias locked his strong hands round the son Who lost a son, slain by the hands of foes, "O valiant-hearted son, so like thy sire, Son of the man whose long spear smote thy sire, Than all strong Gods, all weakling sons of men. The mighty men of Troy: with heart and soul Then the strong Argives' battle-eager sons With a good heart: war-staunch Achilles' son "Fierce-hearted son of Achilles strong in war, Thy noble son: thee shall our loving hands cache = ./cache/658.txt txt = ./txt/658.txt === reduce.pl bib === Building ./etc/reader.txt 32326 658 257 257 32326 658 number of items: 5 sum of words: 244,394 average size in words: 81,464 average readability score: 95 nouns: men; man; son; heart; day; sea; war; battle; hands; love; ships; night; death; spear; king; hand; earth; father; thing; ulysses; blood; ship; way; feet; sons; herte; head; fight; sword; fire; eyes; time; gods; arms; strength; house; people; folk; land; quod; nought; world; place; thy; might; gold; armour; mother; child; city verbs: was; is; had; were; be; have; said; came; come; been; see; went; fell; did; made; do; are; saw; hir; go; stood; lay; told; shal; took; am; slain; set; gave; left; take; let; gan; make; brought; knew; cried; called; wel; spake; heard; laid; slew; rose; know; sat; thought; give; seen; rushed adjectives: great; other; own; many; long; strong; old; good; dead; more; mighty; beautiful; last; ful; young; fair; high; dark; little; wild; full; swift; eager; seyde; such; sore; wide; white; glad; right; golden; black; best; deep; glorious; brave; deadly; wise; bitter; heavy; fierce; cruel; huge; goodly; hearted; terrible; dear; bright; red; strange adverbs: so; not; now; then; up; down; never; thus; here; there; ever; yet; still; away; far; out; forth; back; even; more; again; on; as; right; all; very; long; only; first; also; most; ther; too; swiftly; home; in; therefore; no; soon; hard; off; alone; once; together; round; well; always; fast; afar; high pronouns: he; his; i; him; they; it; she; her; their; me; my; them; you; your; we; thy; us; our; thee; himself; its; ay; themselves; herself; mine; yow; ye; theseus; thyself; myself; theirs; yourself; thenk; ourselves; ours; one; hers; yours; ne; itself; ys; yit; womanhode; tresour; thou; sik; haply; em; chere; agreen proper nouns: al; thou; ye; god; hir; ulysses; achilles; troy; trojans; greeks; y; ne; troilus; theseus; myn; whan; zeus; yow; wel; hem; criseyde; hector; lord; herte; perseus; aias; helen; han; priam; gan; hath; argives; paris; king; alle; pandarus; o''er; ben; agamemnon; �; gods; menelaus; Ã; eek; swich; heaven; un; diomede; trojan; thee keywords: troy; trojans; paris; greeks; aias; achilles; zeus; yow; whan; wel; unto; ulysses; troye; troilus; thetis; theseus; ther; telemachus; son; sin; shal; right; quod; priam; perseus; peleus; pandarus; pandare; odysseus; menelaus; man; love; like; king; ioye; hir; helen; hector; grekes; gods; god; ful; fate; eurypylus; dawn; danaans; criseyde; argives; allas; agamemnon one topic; one dimension: men file(s): titles(s): The History of Troilus and Cressida three topics; one dimension: men; hir; cowardly file(s): ./cache/658.txt, ./cache/257.txt, titles(s): The Fall of Troy | Troilus and Criseyde | The History of Troilus and Cressida five topics; three dimensions: son men heart; ulysses men said; hir al ye; english cloudy horned; english cloudy horned file(s): ./cache/658.txt, ./cache/32326.txt, ./cache/257.txt, , titles(s): The Fall of Troy | Tales of Troy and Greece | Troilus and Criseyde | The History of Troilus and Cressida | The History of Troilus and Cressida Type: gutenberg title: subject-troyExtinctCity-gutenberg date: 2021-06-10 time: 16:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Troy (Extinct city)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 257 author: Chaucer, Geoffrey title: Troilus and Criseyde date: words: 68841.0 sentences: 8087.0 pages: flesch: 105.0 cache: ./cache/257.txt txt: ./txt/257.txt summary: For love of thee, whan thou tornest ful ofte! Right as thy-selven list, wol doon by thee, And seyd swich thing wher-with thy god is plesed, And thee right nought, yet al is seyd or shal; ''Ful wel, I thanke it god,'' quod Pandarus, 155 Go love, for, olde, ther wol no wight of thee. She seyde, that to slepe wel hir leste. ''And I my-self shal ther-with to hir goon; And gan to Iape, and seyde, ''Y-wis, myn herte, Ther-as thou mayst thy-self hir preye of grace. Sin god hath wrought me for I shal yow serve, 1290 Whan that hir hertes wel assured were, 1395 Of Troilus gan in hir herte shette For, god it wot, hir herte on other thing is, Wher shal I seye to yow "wel come" or no, That thou hir see, that cause is of thy sorwe. As she that hadde hir herte on Troilus id: 32326 author: Lang, Andrew title: Tales of Troy and Greece date: words: 94131.0 sentences: 4038.0 pages: flesch: 86.0 cache: ./cache/32326.txt txt: ./txt/32326.txt summary: palace of his father, King Laertes, but Ulysses, with his own hands, men stood to fight with sword and spear when there was a battle at sea. ''Come, then, let us be going,'' said Ulysses, ''for the night is late, and Now Ulysses saw Dolon as he came, and said to Diomede, ''Let us suffer Then the Trojans all with one voice said that Ulysses was the best man ship of Ulysses, like men wrecked on a desert island, who keep watch ''Tell me pray,'' said Ulysses, ''what land is this, and what men At last Ulysses told Telemachus how he had come home in a ship of the She prayed, and said, ''Father Zeus, King of Gods and men, loudly hast ''Look to my horses and man,'' said Theseus; ''I come to see your master.'' ''His ship we could burn, and his men we could slay,'' said Theseus; and id: 658 author: Quintus, Smyrnaeus, active 4th century title: The Fall of Troy date: words: 81422.0 sentences: 6348.0 pages: flesch: 94.0 cache: ./cache/658.txt txt: ./txt/658.txt summary: A battle-fury like the War-god''s wrath Thee not thy sire the War-god now shall pluck All round the Trojan men''s heart-stricken wail, How Memnon, Son of the Dawn, for Troy''s sake fell in the Battle. Closed round the corpse of strong-heart Aeacus'' son, Their tears fell round the dead man, Aeacus'' son; Though Peleus'' son hath died, shall have small heart And Atreus'' son, lord of all Argive men, Till Aias locked his strong hands round the son Who lost a son, slain by the hands of foes, "O valiant-hearted son, so like thy sire, Son of the man whose long spear smote thy sire, Than all strong Gods, all weakling sons of men. The mighty men of Troy: with heart and soul Then the strong Argives'' battle-eager sons With a good heart: war-staunch Achilles'' son "Fierce-hearted son of Achilles strong in war, Thy noble son: thee shall our loving hands id: 1124 author: Shakespeare, William title: The History of Troilus and Cressida date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 1790 author: Shakespeare, William title: Troilus and Cressida date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel