mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named cervantes-from-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24754.txt inflating: ./tmp/input/input-file/14420.txt inflating: ./tmp/input/input-file/35993.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === updating bibliographic database Building study carrel named cervantes-from-gutenberg FILE: cache/24754.txt OUTPUT: txt/24754.txt FILE: cache/14420.txt OUTPUT: txt/14420.txt FILE: cache/35993.txt OUTPUT: txt/35993.txt === file2bib.sh === id: 24754 author: Cervantes Saavedra, Miguel de title: Wit and Wisdom of Don Quixote date: pages: extension: .txt txt: ./txt/24754.txt cache: ./cache/24754.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'24754.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24754 txt/../ent/24754.ent 24754 txt/../wrd/24754.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24754 txt/../pos/24754.pos 14420 txt/../pos/14420.pos 14420 txt/../wrd/14420.wrd 35993 txt/../pos/35993.pos 14420 txt/../ent/14420.ent 35993 txt/../wrd/35993.wrd 35993 txt/../ent/35993.ent === file2bib.sh === id: 14420 author: Cervantes Saavedra, Miguel de title: The Exemplary Novels of Cervantes date: pages: extension: .txt txt: ./txt/14420.txt cache: ./cache/14420.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'14420.txt' === file2bib.sh === id: 35993 author: Cervantes Saavedra, Miguel de title: The History of Don Quixote de la Mancha date: pages: extension: .txt txt: ./txt/35993.txt cache: ./cache/35993.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 13 resourceName b'35993.txt' Done mapping. Reducing cervantes-from-gutenberg === reduce.pl bib === === reduce.pl bib === id = 14420 author = Cervantes Saavedra, Miguel de title = The Exemplary Novels of Cervantes date = pages = extension = .txt mime = text/plain words = 187339 sentences = 7396 flesch = 75 summary = beautiful lady, she said, "If you desire that I should relate my story, Having said this, the lady fell back on the bed, and the two friends Don Juan said to her, "If up to the present moment, beautiful lady, my her arms Seeing her come in, Cornelia instantly said, "You come in good At this moment one of the old hornets came in and said, "I come to tell A boy one day said to him, "Señor Glasscase, I have a mind to run away he met him, and said, "Señor Glasscase, you are to know that a great "These things are said of good poets; but, as respects the bad ones--the "You know a great deal, Preciosa," said the lieutenant; "say no more, "Wait a moment," said Preciosa, "let me whisper certain words in his took her leave, she said to Don Juan, "Every day of the week, señor, is cache = ./cache/14420.txt txt = ./txt/14420.txt === reduce.pl bib === id = 35993 author = Cervantes Saavedra, Miguel de title = The History of Don Quixote de la Mancha date = pages = extension = .txt mime = text/plain words = 233136 sentences = 9545 flesch = 75 summary = second time." "I have already told thee, Sancho," replied Don Quixote, "How little dost thou know, Sancho," answered Don Quixote, "of what sorrow." "Fear not, Sancho," said Don Quixote; "Heaven will deal more knight-errant." "Sancho," said Don Quixote, "the knowledge of thy manner of telling a story, Sancho," said Don Quixote, "thou wilt so run," quoth Don Quixote, "that all thou hast said may come to pass; art no good Christian, Sancho," said Don Quixote, "since thou dost not "In faith, Sancho," answered Don Quixote, "if thou didst but know, as thee, Sancho," said Don Quixote, "that thou art an eternal babbler, "However, friend Sancho," said Don Quixote, "thou hadst best think we want the island." "Come, Sancho," said Don Quixote, "hope for the Sancho seeing his master perplexed, said to him, "Sir, the day comes believe, Sancho," said Don Quixote, "that the Knight of the Mirrors cache = ./cache/35993.txt txt = ./txt/35993.txt Building ./etc/reader.txt 35993 14420 24754 35993 14420 24754 number of items: 3 sum of words: 420,475 average size in words: 210,237 average readability score: 75 nouns: time; master; man; knight; day; lady; life; house; way; place; eyes; nothing; world; night; hand; father; name; one; things; thing; heart; men; head; days; friend; hands; duke; worship; word; part; beauty; arms; gentleman; wife; person; love; sir; face; words; squire; truth; honour; son; account; death; parents; city; end; company; mind verbs: was; is; be; had; have; said; are; were; do; am; been; has; know; made; see; being; let; say; make; give; take; having; come; go; did; replied; tell; answered; came; found; went; put; told; find; took; cried; done; heard; think; gave; left; called; saw; seen; given; set; get; began; thought; brought adjectives: other; good; great; such; more; own; many; same; little; much; whole; old; poor; first; true; last; young; better; best; short; quoth; least; new; present; very; long; full; certain; beautiful; large; rich; famous; fair; able; less; fine; few; sure; next; pleased; strange; ready; small; dead; noble; happy; extraordinary; right; honest; possible adverbs: not; so; now; then; up; as; well; out; very; more; only; here; never; most; ever; much; there; off; down; thus; therefore; even; again; too; no; also; away; soon; on; still; indeed; once; yet; just; however; always; all; already; rather; immediately; in; together; far; first; long; n''t; before; back; about; truly pronouns: i; he; his; it; you; my; her; him; they; me; she; your; them; their; we; himself; us; our; myself; thy; its; thee; themselves; herself; yourself; mine; one; itself; yours; ourselves; thyself; hers; ours; theirs; yourselves; ye; oneself; whereof; them,"--here; follows:--"you; discourtesy; din; ay; ''s proper nouns: don; quixote; sancho; _; thou; heaven; god; juan; preciosa; dulcinea; knight; de; panza; isabella; antonio; sir; señor; lord; andrew; lady; richard; rozinante; la; mancha; leonisa; fernando; monipodio; cornelia; spain; lorenzo; ricardo; dorothea; del; cervantes; toboso; leocadia; seville; chapter; lucinda; sigñor; rodaja; dapple; master; scip; duke; berg; doña; diego; costanza; leonora keywords: spain; heaven; good; god; don; antonio; wood; turks; tomas; toboso; thou; teresa; sir; signor; seville; scip; sancho; rozinante; roque; rodaja; richard; ricardo; rafael; quixote; preciosa; peter; panza; mr.; montesinos; monipodio; master; marco; mancha; mahmoud; lucinda; lorenzo; lope; loaysa; let; leonora; leonisa; leocadia; lady; know; knight; juan; isabella; hold; hassan; ferrara one topic; one dimension: don file(s): titles(s): Wit and Wisdom of Don Quixote three topics; one dimension: don; said; saluting file(s): ./cache/35993.txt, ./cache/14420.txt, titles(s): The History of Don Quixote de la Mancha | The Exemplary Novels of Cervantes | Wit and Wisdom of Don Quixote five topics; three dimensions: don said quixote; experiences supereminent pennons; experiences supereminent pennons; experiences supereminent pennons; experiences supereminent pennons file(s): ./cache/35993.txt, , , , titles(s): The History of Don Quixote de la Mancha | Wit and Wisdom of Don Quixote | Wit and Wisdom of Don Quixote | Wit and Wisdom of Don Quixote | Wit and Wisdom of Don Quixote Type: gutenberg title: cervantes-from-gutenberg date: 2021-01-08 time: 20:45 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: author:"Cervantes Saavedra, Miguel de" NOT title:part ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 24754 author: Cervantes Saavedra, Miguel de title: Wit and Wisdom of Don Quixote date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 14420 author: Cervantes Saavedra, Miguel de title: The Exemplary Novels of Cervantes date: words: 187339.0 sentences: 7396.0 pages: flesch: 75.0 cache: ./cache/14420.txt txt: ./txt/14420.txt summary: beautiful lady, she said, "If you desire that I should relate my story, Having said this, the lady fell back on the bed, and the two friends Don Juan said to her, "If up to the present moment, beautiful lady, my her arms Seeing her come in, Cornelia instantly said, "You come in good At this moment one of the old hornets came in and said, "I come to tell A boy one day said to him, "Señor Glasscase, I have a mind to run away he met him, and said, "Señor Glasscase, you are to know that a great "These things are said of good poets; but, as respects the bad ones--the "You know a great deal, Preciosa," said the lieutenant; "say no more, "Wait a moment," said Preciosa, "let me whisper certain words in his took her leave, she said to Don Juan, "Every day of the week, señor, is id: 35993 author: Cervantes Saavedra, Miguel de title: The History of Don Quixote de la Mancha date: words: 233136.0 sentences: 9545.0 pages: flesch: 75.0 cache: ./cache/35993.txt txt: ./txt/35993.txt summary: second time." "I have already told thee, Sancho," replied Don Quixote, "How little dost thou know, Sancho," answered Don Quixote, "of what sorrow." "Fear not, Sancho," said Don Quixote; "Heaven will deal more knight-errant." "Sancho," said Don Quixote, "the knowledge of thy manner of telling a story, Sancho," said Don Quixote, "thou wilt so run," quoth Don Quixote, "that all thou hast said may come to pass; art no good Christian, Sancho," said Don Quixote, "since thou dost not "In faith, Sancho," answered Don Quixote, "if thou didst but know, as thee, Sancho," said Don Quixote, "that thou art an eternal babbler, "However, friend Sancho," said Don Quixote, "thou hadst best think we want the island." "Come, Sancho," said Don Quixote, "hope for the Sancho seeing his master perplexed, said to him, "Sir, the day comes believe, Sancho," said Don Quixote, "that the Knight of the Mirrors ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel