mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-authorsGerman-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/19753.txt inflating: ./tmp/input/input-file/3267.txt inflating: ./tmp/input/input-file/2780.txt inflating: ./tmp/input/input-file/5733.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-authorsGerman-gutenberg FILE: cache/3267.txt OUTPUT: txt/3267.txt FILE: cache/2780.txt OUTPUT: txt/2780.txt FILE: cache/5733.txt OUTPUT: txt/5733.txt FILE: cache/19753.txt OUTPUT: txt/19753.txt === file2bib.sh === id: 2780 author: May, Karl title: My Life and My Efforts date: pages: extension: .txt txt: ./txt/2780.txt cache: ./cache/2780.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'2780.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 3267 author: Le Gallienne, Richard title: Old Love Stories Retold date: pages: extension: .txt txt: ./txt/3267.txt cache: ./cache/3267.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'3267.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 2780 txt/../wrd/2780.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 3267 txt/../ent/3267.ent 3267 txt/../pos/3267.pos 2780 txt/../ent/2780.ent 3267 txt/../wrd/3267.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2780 txt/../pos/2780.pos 19753 txt/../pos/19753.pos 19753 txt/../wrd/19753.wrd 19753 txt/../ent/19753.ent 5733 txt/../pos/5733.pos 5733 txt/../wrd/5733.wrd 5733 txt/../ent/5733.ent === file2bib.sh === id: 19753 author: Brown, Peter Hume title: The Youth of Goethe date: pages: extension: .txt txt: ./txt/19753.txt cache: ./cache/19753.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 9 resourceName b'19753.txt' === file2bib.sh === id: 5733 author: Goethe, Johann Wolfgang von title: Autobiography: Truth and Fiction Relating to My Life date: pages: extension: .txt txt: ./txt/5733.txt cache: ./cache/5733.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 11 resourceName b'5733.txt' Done mapping. Reducing subject-authorsGerman-gutenberg === reduce.pl bib === id = 19753 author = Brown, Peter Hume title = The Youth of Goethe date = pages = extension = .txt mime = text/plain words = 79380 sentences = 4331 flesch = 71 summary = [Footnote 4: In his later years Goethe preferred life in a small town. [Footnote 5: To Chancellor von Müller Goethe said: "Mein Vater war ein [Footnote 8: Goethe's letters addressed to Cornelia from Leipzig, when it was, in the course of life which Goethe was to follow in Leipzig we [Footnote 13: So Weislingen (in _Götz von Berlichingen_), whom Goethe follow the career of Goethe from the day he entered Leipzig till the during these Leipzig years Goethe played a sufficient number of pranks [Footnote 48: Referring to the time he now spent in Frankfort, Goethe [Footnote 78: Writing to a correspondent in 1780, Goethe says: "Herder [Footnote 82: Herder himself says of his influence on Goethe: "Ich The day following the writing of the letter just quoted, Goethe wrote Goethe's life, to the period of his sojourn in Italy, when years had cache = ./cache/19753.txt txt = ./txt/19753.txt === reduce.pl bib === === reduce.pl bib === === reduce.pl bib === id = 5733 author = Goethe, Johann Wolfgang von title = Autobiography: Truth and Fiction Relating to My Life date = pages = extension = .txt mime = text/plain words = 153485 sentences = 5858 flesch = 66 summary = reading him he felt, he said, like a blind man who suddenly receives his long time to come, but a great deal of small gear of the same ware had every thing was quiet in the house, I whiled away the time with my pots At that time the general interchange of personal good wishes made the small, thin man of lively good nature, that in his earlier years he had But for this the good old man cared but little, days he let me sit as long as I could read, many times alone; after a disturb them; but 'there is a time for all things,'--an excellent great rapidly, and it needs not a man's life-time to bring such things to feeling of revering a great man; so did a new friend, whom I gained at Time is infinitely long; and each day is a vessel into which a great cache = ./cache/5733.txt txt = ./txt/5733.txt Building ./etc/reader.txt 19753 5733 3267 5733 19753 3267 number of items: 4 sum of words: 232,865 average size in words: 116,432 average readability score: 68 nouns: time; man; life; father; world; way; years; nature; one; day; thing; house; men; mind; others; part; nothing; hand; friend; place; heart; work; character; things; manner; art; people; friends; city; something; influence; period; family; children; youth; year; self; interest; form; persons; end; relations; mother; love; eyes; sister; side; times; son; moment verbs: was; had; is; be; were; have; been; are; made; has; did; found; said; came; do; see; took; seen; seemed; make; gave; being; went; take; come; saw; brought; wrote; give; thought; written; left; felt; know; let; find; given; taken; became; called; become; remained; say; put; set; kept; go; received; knew; stood adjectives: other; own; many; great; such; first; good; little; same; more; old; last; young; new; whole; much; certain; german; long; different; best; natural; general; few; second; large; least; beautiful; important; greatest; necessary; later; true; present; possible; human; literary; high; strange; various; several; french; able; greater; full; small; former; short; pleasant; better adverbs: not; so; more; now; only; very; most; even; as; well; also; up; always; thus; out; still; then; often; already; indeed; once; here; too; again; much; never; however; therefore; soon; yet; there; far; quite; long; first; together; just; enough; off; down; immediately; on; especially; ever; in; away; afterwards; rather; less; forth pronouns: his; he; i; it; my; me; we; him; they; her; their; himself; us; them; she; its; our; you; myself; themselves; itself; one; your; ourselves; herself; yourself; thy; thee; mine; thyself; yours; ours; hers; silicum/; goethe; unself; tatoo; passion,--; inself; delf proper nouns: _; goethe; frankfort; footnote; von; leipzig; werther; strassburg; lili; herder; götz; lavater; kestner; god; merck; wetzlar; autobiography; weimar; clavigo; lotte; gretchen; germany; friederike; behrisch; wieland; berlichingen; shakespeare; faust; oeser; i.; french; darmstadt; august; fräulein; spinoza; ib; der; ich; briefe; werke; und; salzmann; prometheus; klopstock; jacobi; frau; la; german; cornelia; beaumarchais keywords: leipzig; goethe; god; german; frankfort; footnote; young; year; work; wieland; wetzlar; werther; werke; weimar; way; von; time; thing; strassburg; strasburg; spinoza; shakespeare; prometheus; place; old; oeser; merck; lotte; long; little; lili; like; life; lavater; kestner; house; herder; hand; götz; gretchen; great; good; gellert; friend; friederike; french; form; faust; father; english one topic; one dimension: goethe file(s): ./cache/19753.txt titles(s): The Youth of Goethe three topics; one dimension: time; goethe; boasted file(s): ./cache/5733.txt, ./cache/19753.txt, titles(s): Autobiography: Truth and Fiction Relating to My Life | The Youth of Goethe | My Life and My Efforts five topics; three dimensions: time man great; goethe footnote life; boasted alleviated naïve; boasted alleviated naïve; boasted alleviated naïve file(s): ./cache/5733.txt, ./cache/19753.txt, , , titles(s): Autobiography: Truth and Fiction Relating to My Life | The Youth of Goethe | My Life and My Efforts | My Life and My Efforts | My Life and My Efforts Type: gutenberg title: subject-authorsGerman-gutenberg date: 2021-06-01 time: 13:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Authors, German" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 19753 author: Brown, Peter Hume title: The Youth of Goethe date: words: 79380.0 sentences: 4331.0 pages: flesch: 71.0 cache: ./cache/19753.txt txt: ./txt/19753.txt summary: [Footnote 4: In his later years Goethe preferred life in a small town. [Footnote 5: To Chancellor von Müller Goethe said: "Mein Vater war ein [Footnote 8: Goethe''s letters addressed to Cornelia from Leipzig, when it was, in the course of life which Goethe was to follow in Leipzig we [Footnote 13: So Weislingen (in _Götz von Berlichingen_), whom Goethe follow the career of Goethe from the day he entered Leipzig till the during these Leipzig years Goethe played a sufficient number of pranks [Footnote 48: Referring to the time he now spent in Frankfort, Goethe [Footnote 78: Writing to a correspondent in 1780, Goethe says: "Herder [Footnote 82: Herder himself says of his influence on Goethe: "Ich The day following the writing of the letter just quoted, Goethe wrote Goethe''s life, to the period of his sojourn in Italy, when years had id: 5733 author: Goethe, Johann Wolfgang von title: Autobiography: Truth and Fiction Relating to My Life date: words: 153485.0 sentences: 5858.0 pages: flesch: 66.0 cache: ./cache/5733.txt txt: ./txt/5733.txt summary: reading him he felt, he said, like a blind man who suddenly receives his long time to come, but a great deal of small gear of the same ware had every thing was quiet in the house, I whiled away the time with my pots At that time the general interchange of personal good wishes made the small, thin man of lively good nature, that in his earlier years he had But for this the good old man cared but little, days he let me sit as long as I could read, many times alone; after a disturb them; but ''there is a time for all things,''--an excellent great rapidly, and it needs not a man''s life-time to bring such things to feeling of revering a great man; so did a new friend, whom I gained at Time is infinitely long; and each day is a vessel into which a great id: 3267 author: Le Gallienne, Richard title: Old Love Stories Retold date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 2780 author: May, Karl title: My Life and My Efforts date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel