mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-comets-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/5109.txt inflating: ./tmp/input/input-file/3797.txt inflating: ./tmp/input/input-file/37448.txt inflating: ./tmp/input/input-file/41606.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-comets-gutenberg FILE: cache/41606.txt OUTPUT: txt/41606.txt FILE: cache/37448.txt OUTPUT: txt/37448.txt FILE: cache/5109.txt OUTPUT: txt/5109.txt FILE: cache/3797.txt OUTPUT: txt/3797.txt === file2bib.sh === id: 3797 author: Wells, H. G. (Herbert George) title: In the Days of the Comet date: pages: extension: .txt txt: ./txt/3797.txt cache: ./cache/3797.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'3797.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 37448 txt/../pos/37448.pos 37448 txt/../ent/37448.ent 3797 txt/../pos/3797.pos 3797 txt/../ent/3797.ent 37448 txt/../wrd/37448.wrd 3797 txt/../wrd/3797.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point === file2bib.sh === id: 37448 author: Gallun, Raymond Z. title: Comet's Burial date: pages: extension: .txt txt: ./txt/37448.txt cache: ./cache/37448.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'37448.txt' 41606 txt/../pos/41606.pos 41606 txt/../wrd/41606.wrd 41606 txt/../ent/41606.ent === file2bib.sh === id: 41606 author: Kirkwood, Daniel title: Comets and Meteors Their phenomena in all ages; their mutual relations; and the theory of their origin. date: pages: extension: .txt txt: ./txt/41606.txt cache: ./cache/41606.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'41606.txt' 5109 txt/../wrd/5109.wrd 5109 txt/../pos/5109.pos 5109 txt/../ent/5109.ent === file2bib.sh === id: 5109 author: Donnelly, Ignatius title: Ragnarok : the Age of Fire and Gravel date: pages: extension: .txt txt: ./txt/5109.txt cache: ./cache/5109.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 10 resourceName b'5109.txt' Done mapping. Reducing subject-comets-gutenberg === reduce.pl bib === id = 5109 author = Donnelly, Ignatius title = Ragnarok : the Age of Fire and Gravel date = pages = extension = .txt mime = text/plain words = 125938 sentences = 7882 flesch = 82 summary = Hence it fell on the earth like a great snow-storm most remote ages, of a comet having struck the earth, of the great Comet over a large part of the earth; the "seats of the gods" means We have seen that during the Drift age the great clefts in the earth, heavens, and a great conflagration of things upon the earth_ gods, the sun began his motion in the heavens; and a man called say, the great heat was drying up the water-courses of the earth. "when the world was in _great darkness and chaos_, when the earth was If neither ice nor water ground up the earth-surface into the Drift, And on the fourth day "God made two great lights," the sun and moon. earth in great quantities; but the heat, as in the last Drift Age, And from such a world God will fend off the comets with his great cache = ./cache/5109.txt txt = ./txt/5109.txt === reduce.pl bib === === reduce.pl bib === id = 41606 author = Kirkwood, Daniel title = Comets and Meteors Their phenomena in all ages; their mutual relations; and the theory of their origin. date = pages = extension = .txt mime = text/plain words = 20970 sentences = 1501 flesch = 74 summary = years before our era, a large comet was observed not far from the sun. years, Halley announced this as the time of the comet's revolution, and comets per century[5] were observed during the same period. the remarkable fact that the orbits of the earth and comet intersect COMETS WHOSE ELEMENTS INDICATE PERIODICITY, BUT WHOSE RETURNS HAVE NOT periodic comets are near the orbits of the major planets. the two bodies will occur in 1985, when the form of the comet's orbit years, in an orbit somewhat more eccentric than that of Halley's comet. 4. That the orbits of some meteors and periodic comets have been The fact, then, that meteors move in the same orbits with comets is but great number of meteoric stones fell to the earth, generally penetrating discovery that comets and meteors are actually moving in the same orbits Neither the period of the meteors nor that of the comet can yet be cache = ./cache/41606.txt txt = ./txt/41606.txt === reduce.pl bib === id = 37448 author = Gallun, Raymond Z. title = Comet's Burial date = pages = extension = .txt mime = text/plain words = 47 sentences = 6 flesch = 83 summary = research did not uncover any evidence that the U.S. copyright on this publication was renewed. page 62 original: Many hours later, and may miles farther changed to: Many hours later, and many miles farther page 69 no change: Embitted, there was no warmth in Copeland retained Embitted cache = ./cache/37448.txt txt = ./txt/37448.txt Building ./etc/reader.txt 5109 41606 3797 5109 41606 3797 number of items: 4 sum of words: 146,955 average size in words: 48,985 average readability score: 79 nouns: p.; earth; comet; sun; time; world; man; fire; ice; legends; day; comets; land; years; men; stones; race; water; people; feet; clay; light; period; rocks; heat; part; miles; darkness; sea; age; place; waters; things; surface; clouds; stars; life; orbit; face; cave; legend; air; fact; mankind; gods; gravel; days; island; way; snow verbs: is; was; have; are; be; were; been; had; has; found; says; seen; made; see; did; came; say; find; come; do; let; fell; being; called; said; observed; told; covered; go; does; formed; read; make; having; produced; know; following; discovered; given; destroyed; caused; seems; falling; carried; became; passed; appeared; tell; pass; according adjectives: great; same; other; many; first; such; ancient; long; human; more; large; meteoric; whole; last; deep; vast; glacial; own; cold; terrible; few; high; -; several; different; old; small; mighty; greater; true; little; dead; solar; thick; remarkable; civilized; white; full; former; american; present; poor; very; extraordinary; remote; dark; less; visible; third; red adverbs: not; up; then; so; here; now; down; out; again; even; only; more; also; very; most; first; together; still; away; probably; as; however; far; there; therefore; yet; nearly; once; forth; about; back; all; too; thus; almost; off; much; long; ever; never; already; just; enough; hence; on; well; sometimes; indeed; gradually; soon pronouns: it; they; we; he; his; their; its; i; them; him; our; us; my; you; me; themselves; itself; her; thy; himself; your; she; thee; one; ourselves; myself; yourself; herself; ye; ours; us[6; themselves,--they; theirs; na proper nouns: _; god; drift; heaven; job; age; europe; heavens; thou; america; great; vol; mr.; lord; ibid; professor; november; new; chap; ice; jupiter; iii; dr.; comet; chapter; ovid; world; north; darkness; atlantic; october; indians; american; m.; iv; atlantis; verse; sun; glacial; biela; vi; science; phaëton; geikie; england; east; comets; man; earth; april keywords: great; comet; world; water; time; sun; science; races; professor; phaëton; ovid; orbit; november; north; new; native; myth; mr.; man; lord; legend; jupiter; job; indians; ice; hour; god; fire; find; fall; europe; earth; drift; distance; day; darkness; chapter; atlantic; april; america; age; a.d. one topic; one dimension: earth file(s): ./cache/5109.txt titles(s): Ragnarok : the Age of Fire and Gravel three topics; one dimension: earth; comet; warmth file(s): ./cache/5109.txt, ./cache/41606.txt, titles(s): Ragnarok : the Age of Fire and Gravel | Comets and Meteors Their phenomena in all ages; their mutual relations; and the theory of their origin. | In the Days of the Comet five topics; three dimensions: earth great sun; comet comets sun; retained warmth renewed; retained warmth renewed; retained warmth renewed file(s): ./cache/5109.txt, ./cache/41606.txt, , , titles(s): Ragnarok : the Age of Fire and Gravel | Comets and Meteors Their phenomena in all ages; their mutual relations; and the theory of their origin. | In the Days of the Comet | In the Days of the Comet | In the Days of the Comet Type: gutenberg title: subject-comets-gutenberg date: 2021-06-03 time: 19:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Comets" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 5109 author: Donnelly, Ignatius title: Ragnarok : the Age of Fire and Gravel date: words: 125938.0 sentences: 7882.0 pages: flesch: 82.0 cache: ./cache/5109.txt txt: ./txt/5109.txt summary: Hence it fell on the earth like a great snow-storm most remote ages, of a comet having struck the earth, of the great Comet over a large part of the earth; the "seats of the gods" means We have seen that during the Drift age the great clefts in the earth, heavens, and a great conflagration of things upon the earth_ gods, the sun began his motion in the heavens; and a man called say, the great heat was drying up the water-courses of the earth. "when the world was in _great darkness and chaos_, when the earth was If neither ice nor water ground up the earth-surface into the Drift, And on the fourth day "God made two great lights," the sun and moon. earth in great quantities; but the heat, as in the last Drift Age, And from such a world God will fend off the comets with his great id: 37448 author: Gallun, Raymond Z. title: Comet''s Burial date: words: 47.0 sentences: 6.0 pages: flesch: 83.0 cache: ./cache/37448.txt txt: ./txt/37448.txt summary: research did not uncover any evidence that the U.S. copyright on this publication was renewed. page 62 original: Many hours later, and may miles farther changed to: Many hours later, and many miles farther page 69 no change: Embitted, there was no warmth in Copeland retained Embitted id: 41606 author: Kirkwood, Daniel title: Comets and Meteors Their phenomena in all ages; their mutual relations; and the theory of their origin. date: words: 20970.0 sentences: 1501.0 pages: flesch: 74.0 cache: ./cache/41606.txt txt: ./txt/41606.txt summary: years before our era, a large comet was observed not far from the sun. years, Halley announced this as the time of the comet''s revolution, and comets per century[5] were observed during the same period. the remarkable fact that the orbits of the earth and comet intersect COMETS WHOSE ELEMENTS INDICATE PERIODICITY, BUT WHOSE RETURNS HAVE NOT periodic comets are near the orbits of the major planets. the two bodies will occur in 1985, when the form of the comet''s orbit years, in an orbit somewhat more eccentric than that of Halley''s comet. 4. That the orbits of some meteors and periodic comets have been The fact, then, that meteors move in the same orbits with comets is but great number of meteoric stones fell to the earth, generally penetrating discovery that comets and meteors are actually moving in the same orbits Neither the period of the meteors nor that of the comet can yet be id: 3797 author: Wells, H. G. (Herbert George) title: In the Days of the Comet date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel