mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-merchantMariners-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/31497.txt inflating: ./tmp/input/input-file/21557.txt inflating: ./tmp/input/input-file/2864.txt inflating: ./tmp/input/input-file/11243.txt inflating: ./tmp/input/input-file/8118.txt inflating: ./tmp/input/input-file/12959.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-merchantMariners-gutenberg FILE: cache/31497.txt OUTPUT: txt/31497.txt FILE: cache/8118.txt OUTPUT: txt/8118.txt FILE: cache/11243.txt OUTPUT: txt/11243.txt FILE: cache/2864.txt OUTPUT: txt/2864.txt FILE: cache/21557.txt OUTPUT: txt/21557.txt FILE: cache/12959.txt OUTPUT: txt/12959.txt === file2bib.sh === id: 8118 author: Melville, Herman title: Redburn. His First Voyage Being the Sailor Boy Confessions and Reminiscences of the Son-Of-A-Gentleman in the Merchant Navy date: pages: extension: .txt txt: ./txt/8118.txt cache: ./cache/8118.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'8118.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 8118 txt/../pos/8118.pos 8118 txt/../ent/8118.ent 8118 txt/../wrd/8118.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 31497 txt/../wrd/31497.wrd 31497 txt/../pos/31497.pos 31497 txt/../ent/31497.ent 2864 txt/../pos/2864.pos 2864 txt/../wrd/2864.wrd 21557 txt/../pos/21557.pos 12959 txt/../wrd/12959.wrd 11243 txt/../pos/11243.pos 12959 txt/../pos/12959.pos 21557 txt/../wrd/21557.wrd 11243 txt/../wrd/11243.wrd 2864 txt/../ent/2864.ent === file2bib.sh === id: 31497 author: Bone, David W. (David William) title: The Brassbounder: A Tale of the Sea date: pages: extension: .txt txt: ./txt/31497.txt cache: ./cache/31497.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'31497.txt' 12959 txt/../ent/12959.ent 21557 txt/../ent/21557.ent 11243 txt/../ent/11243.ent === file2bib.sh === id: 2864 author: Hardy, Thomas title: The Trumpet-Major date: pages: extension: .txt txt: ./txt/2864.txt cache: ./cache/2864.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'2864.txt' === file2bib.sh === id: 21557 author: Marryat, Frederick title: Newton Forster; Or, The Merchant Service date: pages: extension: .txt txt: ./txt/21557.txt cache: ./cache/21557.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'21557.txt' === file2bib.sh === id: 12959 author: Marryat, Frederick title: Newton Forster date: pages: extension: .txt txt: ./txt/12959.txt cache: ./cache/12959.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'12959.txt' === file2bib.sh === id: 11243 author: Cooper, James Fenimore title: Miles Wallingford Sequel to "Afloat and Ashore" date: pages: extension: .txt txt: ./txt/11243.txt cache: ./cache/11243.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'11243.txt' Done mapping. Reducing subject-merchantMariners-gutenberg === reduce.pl bib === id = 11243 author = Cooper, James Fenimore title = Miles Wallingford Sequel to "Afloat and Ashore" date = pages = extension = .txt mime = text/plain words = 171199 sentences = 8272 flesch = 79 summary = appeared to think much of Lucy, and very little of my poor sister. all on deck so busy, that it was some little time ere I saw Lucy again. The old woman gazed at Marble like one who scarce know what to make of times like these, when not a day passes that something good does not offer "I think that is little probable, Miles," answered Grace, who lived and But feelings of this nature could not long absorb a man like Mr. Hardinge, who soon regained as much of the appearance of composure as it "Miles," Lucy said, after a long and thoughtful pause, "it is not good for long and thoughtful look at the actual state of things--"On the whole, Mr. Marble, it may be well to take in our light sails, haul our wind, and let "Marble, my dear fellow, why, how fare you?" said our old ship-mate, cache = ./cache/11243.txt txt = ./txt/11243.txt === reduce.pl bib === id = 2864 author = Hardy, Thomas title = The Trumpet-Major date = pages = extension = .txt mime = text/plain words = 116981 sentences = 7393 flesch = 86 summary = 'Do you think we ought to go, mother?' said Anne slowly, and looking at trumpet-major went and put his head outside, and said, 'All right--coming 'Here's my little girl,' said Mrs. Garland, and the trumpet-major looked 'You often come this way?' said Festus to Anne rather before he had said, as John Loveday, tired of looking for Anne at the stile, passed the ''Tis old Mr. Derriman come home!' said Anne. Anne and Loveday said yes, and Festus ran back to the house, followed by 'Nonsense, Anne,' said Mrs. Garland, who had come near, and smiled John Loveday at the same time wished his father and Bob good-night, and went to his father as soon as they got home, and begged him to get Mrs. Loveday to tell Anne the true reason of John's objection to Miss Johnson 'William,' said Mrs. Loveday to the miller when Anne was gone and Bob had cache = ./cache/2864.txt txt = ./txt/2864.txt === reduce.pl bib === id = 12959 author = Marryat, Frederick title = Newton Forster date = pages = extension = .txt mime = text/plain words = 137297 sentences = 7241 flesch = 77 summary = Newton Forster sailed in his vessel with a cargo to be delivered at the Newton had quitted the room where Mrs Forster lay in a deplorable "Why, I have been mad for a long time," replied Mrs Forster; "the "I think our little guns will soon reach her," observed Newton. "My dear father," replied Newton, taking his hand, "did not you receive away Newton Forster appeared to be the least likely to "lead to "Not upon legal business--humph!" replied Mr Forster, eyeing Newton. "Good-bye," replied John, without looking up; and Newton with his father, "Like most young ladies, sir, a little giddy," replied Isabel. "Between the two, sir," observed Newton, handing Captain Drawlock his "With pleasure, my friend," replied Newton, taking the old man's hand, "It's rather awkward, Newton," said Mr John Forster, about ten days "What do you think of her spars, Forster?" said Captain Oughton to Newton, cache = ./cache/12959.txt txt = ./txt/12959.txt === reduce.pl bib === id = 21557 author = Marryat, Frederick title = Newton Forster; Or, The Merchant Service date = pages = extension = .txt mime = text/plain words = 137232 sentences = 7133 flesch = 77 summary = Newton Forster, or the Merchant Service, by Captain Marryat. NEWTON FORSTER, OR THE MERCHANT SERVICE, BY CAPTAIN FREDERICK MARRYAT. Newton had quitted the room where Mrs Forster lay in a deplorable In the mean time Newton Forster had made every despatch, and returned to "And in the mean time my poor father may starve," said Newton, with a "I think our little guns will soon reach her," observed Newton. "My dear father," replied Newton, taking his hand, "did not you receive away Newton Forster appeared to be the least likely to "lead to "Like most young ladies, sir, a little giddy," replied Isabel. "Between the two, sir," observed Newton, handing Captain Drawlock his time below, Captain Drawlock would hand over to Newton's charge any one "With pleasure, my friend," replied Newton, taking the old man's hand, "It's rather awkward, Newton," said Mr John Forster, about ten days cache = ./cache/21557.txt txt = ./txt/21557.txt === reduce.pl bib === id = 31497 author = Bone, David W. (David William) title = The Brassbounder: A Tale of the Sea date = pages = extension = .txt mime = text/plain words = 59676 sentences = 4863 flesch = 93 summary = It seemed a long time before the Old Man saw the 'smooth' he was the old man), and went aft, leaving Munro and me to weather Martin's "I wos at the wheel one day, an' I 'eard th' Old Man an' th' Mate "Where's she from, Mister?" said the Old Man to the Mate who stood with "Good business for us, anyway," said the Old Man, and told the Mate to all be righted before the Old Man comes on deck. The boats were a long time gone, and the Old Man was growing impatient, the Old Man and the Mate shouting cross orders, the boat swinging "A hand t' th' wheel, here," roars the Old Man. Martin looks up 'No time was to be lost,' as the Old Man had said. "It's no use talking," the Old Man had said when he and the Mate were cache = ./cache/31497.txt txt = ./txt/31497.txt === reduce.pl bib === Building ./etc/reader.txt 21557 12959 11243 31497 12959 21557 number of items: 6 sum of words: 622,385 average size in words: 124,477 average readability score: 82 nouns: time; man; ship; day; men; sir; way; father; deck; boat; sea; wind; nothing; head; water; hand; vessel; house; night; room; brother; door; board; eyes; mother; hands; place; moment; course; life; hour; side; captain; years; morning; woman; days; mind; face; name; mate; lady; thing; part; sail; heart; colonel; country; one; people verbs: was; had; be; is; have; were; been; said; do; are; did; ''s; has; see; made; am; know; come; say; go; replied; being; take; think; came; make; went; having; get; found; thought; put; let; left; heard; took; passed; got; saw; continued; tell; give; felt; taken; seen; done; going; looked; knew; observed adjectives: little; old; other; good; own; more; first; few; last; young; great; many; much; same; dear; such; long; short; poor; true; small; next; large; french; new; most; better; ready; whole; best; major; necessary; happy; main; fine; several; certain; right; full; english; present; sure; dead; least; heavy; high; easy; possible; only; white adverbs: not; so; up; now; then; as; very; out; n''t; down; again; never; more; well; soon; away; only; off; here; too; just; still; there; much; even; in; all; most; on; long; ever; quite; however; once; indeed; back; enough; about; far; rather; before; no; over; home; yet; already; first; always; certainly; thus pronouns: i; his; he; it; you; her; my; she; we; they; him; me; their; your; them; our; us; its; himself; myself; herself; themselves; yourself; ''em; itself; one; mine; ourselves; yours; ye; thee; ours; thy; em; ''s; hers; theirs; ee; i''m; oneself; je; yourselves; yerself; yer; oo; f''r; ye''r; when--_you; violated,--her; thyself proper nouns: _; newton; mr; forster; anne; john; captain; bob; mrs; lucy; miss; loveday; mr.; nicholas; marble; ye; miles; isabel; de; fontanges; mrs.; festus; neb; old; god; garland; wallingford; revel; grace; monsieur; castle; lord; english; amber; rupert; man; england; clawbonny; mate; jackson; dawn; hardinge; drawlock; sir; oughton; derriman; windsor; plausible; th; india keywords: john; captain; miss; french; god; english; windsor; time; sullivan; revel; plausible; oughton; nicholas; newton; mrs.; mrs; mr.; madame; jackson; isabel; india; forster; fontanges; ferguson; england; edward; drawlock; dragwell; castle; carrington; aveleyn; amber; york; work; wind; wetmore; welsh; wallingford; volume; van; uncle; tassel; speedy; sir; ship; sennit; sea; sail; rupert; robert one topic; one dimension: said file(s): ./cache/31497.txt titles(s): The Brassbounder: A Tale of the Sea three topics; one dimension: said; newton; clucking file(s): ./cache/2864.txt, ./cache/21557.txt, titles(s): The Trumpet-Major | Newton Forster; Or, The Merchant Service | Redburn. His First Voyage Being the Sailor Boy Confessions and Reminiscences of the Son-Of-A-Gentleman in the Merchant Navy five topics; three dimensions: said man time; newton mr forster; ed lookout pairs; ed lookout pairs; ed lookout pairs file(s): ./cache/2864.txt, ./cache/21557.txt, , , titles(s): The Trumpet-Major | Newton Forster; Or, The Merchant Service | Redburn. His First Voyage Being the Sailor Boy Confessions and Reminiscences of the Son-Of-A-Gentleman in the Merchant Navy | Redburn. His First Voyage Being the Sailor Boy Confessions and Reminiscences of the Son-Of-A-Gentleman in the Merchant Navy | Redburn. His First Voyage Being the Sailor Boy Confessions and Reminiscences of the Son-Of-A-Gentleman in the Merchant Navy Type: gutenberg title: subject-merchantMariners-gutenberg date: 2021-06-06 time: 22:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Merchant mariners" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 31497 author: Bone, David W. (David William) title: The Brassbounder: A Tale of the Sea date: words: 59676.0 sentences: 4863.0 pages: flesch: 93.0 cache: ./cache/31497.txt txt: ./txt/31497.txt summary: It seemed a long time before the Old Man saw the ''smooth'' he was the old man), and went aft, leaving Munro and me to weather Martin''s "I wos at the wheel one day, an'' I ''eard th'' Old Man an'' th'' Mate "Where''s she from, Mister?" said the Old Man to the Mate who stood with "Good business for us, anyway," said the Old Man, and told the Mate to all be righted before the Old Man comes on deck. The boats were a long time gone, and the Old Man was growing impatient, the Old Man and the Mate shouting cross orders, the boat swinging "A hand t'' th'' wheel, here," roars the Old Man. Martin looks up ''No time was to be lost,'' as the Old Man had said. "It''s no use talking," the Old Man had said when he and the Mate were id: 11243 author: Cooper, James Fenimore title: Miles Wallingford Sequel to "Afloat and Ashore" date: words: 171199.0 sentences: 8272.0 pages: flesch: 79.0 cache: ./cache/11243.txt txt: ./txt/11243.txt summary: appeared to think much of Lucy, and very little of my poor sister. all on deck so busy, that it was some little time ere I saw Lucy again. The old woman gazed at Marble like one who scarce know what to make of times like these, when not a day passes that something good does not offer "I think that is little probable, Miles," answered Grace, who lived and But feelings of this nature could not long absorb a man like Mr. Hardinge, who soon regained as much of the appearance of composure as it "Miles," Lucy said, after a long and thoughtful pause, "it is not good for long and thoughtful look at the actual state of things--"On the whole, Mr. Marble, it may be well to take in our light sails, haul our wind, and let "Marble, my dear fellow, why, how fare you?" said our old ship-mate, id: 2864 author: Hardy, Thomas title: The Trumpet-Major date: words: 116981.0 sentences: 7393.0 pages: flesch: 86.0 cache: ./cache/2864.txt txt: ./txt/2864.txt summary: ''Do you think we ought to go, mother?'' said Anne slowly, and looking at trumpet-major went and put his head outside, and said, ''All right--coming ''Here''s my little girl,'' said Mrs. Garland, and the trumpet-major looked ''You often come this way?'' said Festus to Anne rather before he had said, as John Loveday, tired of looking for Anne at the stile, passed the ''''Tis old Mr. Derriman come home!'' said Anne. Anne and Loveday said yes, and Festus ran back to the house, followed by ''Nonsense, Anne,'' said Mrs. Garland, who had come near, and smiled John Loveday at the same time wished his father and Bob good-night, and went to his father as soon as they got home, and begged him to get Mrs. Loveday to tell Anne the true reason of John''s objection to Miss Johnson ''William,'' said Mrs. Loveday to the miller when Anne was gone and Bob had id: 21557 author: Marryat, Frederick title: Newton Forster; Or, The Merchant Service date: words: 137232.0 sentences: 7133.0 pages: flesch: 77.0 cache: ./cache/21557.txt txt: ./txt/21557.txt summary: Newton Forster, or the Merchant Service, by Captain Marryat. NEWTON FORSTER, OR THE MERCHANT SERVICE, BY CAPTAIN FREDERICK MARRYAT. Newton had quitted the room where Mrs Forster lay in a deplorable In the mean time Newton Forster had made every despatch, and returned to "And in the mean time my poor father may starve," said Newton, with a "I think our little guns will soon reach her," observed Newton. "My dear father," replied Newton, taking his hand, "did not you receive away Newton Forster appeared to be the least likely to "lead to "Like most young ladies, sir, a little giddy," replied Isabel. "Between the two, sir," observed Newton, handing Captain Drawlock his time below, Captain Drawlock would hand over to Newton''s charge any one "With pleasure, my friend," replied Newton, taking the old man''s hand, "It''s rather awkward, Newton," said Mr John Forster, about ten days id: 12959 author: Marryat, Frederick title: Newton Forster date: words: 137297.0 sentences: 7241.0 pages: flesch: 77.0 cache: ./cache/12959.txt txt: ./txt/12959.txt summary: Newton Forster sailed in his vessel with a cargo to be delivered at the Newton had quitted the room where Mrs Forster lay in a deplorable "Why, I have been mad for a long time," replied Mrs Forster; "the "I think our little guns will soon reach her," observed Newton. "My dear father," replied Newton, taking his hand, "did not you receive away Newton Forster appeared to be the least likely to "lead to "Not upon legal business--humph!" replied Mr Forster, eyeing Newton. "Good-bye," replied John, without looking up; and Newton with his father, "Like most young ladies, sir, a little giddy," replied Isabel. "Between the two, sir," observed Newton, handing Captain Drawlock his "With pleasure, my friend," replied Newton, taking the old man''s hand, "It''s rather awkward, Newton," said Mr John Forster, about ten days "What do you think of her spars, Forster?" said Captain Oughton to Newton, id: 8118 author: Melville, Herman title: Redburn. His First Voyage Being the Sailor Boy Confessions and Reminiscences of the Son-Of-A-Gentleman in the Merchant Navy date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel