mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-seaStoriesAmerican-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/18062.txt inflating: ./tmp/input/input-file/23539.txt inflating: ./tmp/input/input-file/24880.txt inflating: ./tmp/input/input-file/26862.txt inflating: ./tmp/input/input-file/973.txt inflating: ./tmp/input/input-file/60811.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-seaStoriesAmerican-gutenberg FILE: cache/18062.txt OUTPUT: txt/18062.txt FILE: cache/60811.txt OUTPUT: txt/60811.txt FILE: cache/24880.txt OUTPUT: txt/24880.txt FILE: cache/973.txt OUTPUT: txt/973.txt FILE: cache/23539.txt OUTPUT: txt/23539.txt FILE: cache/26862.txt OUTPUT: txt/26862.txt 24880 txt/../ent/24880.ent === file2bib.sh === id: 24880 author: Robertson, Morgan title: The Wreck of the Titan or, Futility date: pages: extension: .txt txt: ./txt/24880.txt cache: ./cache/24880.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'24880.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24880 txt/../wrd/24880.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24880 txt/../pos/24880.pos 18062 txt/../wrd/18062.wrd 18062 txt/../pos/18062.pos 18062 txt/../ent/18062.ent === file2bib.sh === id: 18062 author: London, Jack title: Stories of Ships and the Sea date: pages: extension: .txt txt: ./txt/18062.txt cache: ./cache/18062.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'18062.txt' 60811 txt/../pos/60811.pos 60811 txt/../wrd/60811.wrd 60811 txt/../ent/60811.ent 973 txt/../wrd/973.wrd 23539 txt/../wrd/23539.wrd 23539 txt/../pos/23539.pos 973 txt/../pos/973.pos 26862 txt/../pos/26862.pos 26862 txt/../wrd/26862.wrd 23539 txt/../ent/23539.ent 973 txt/../ent/973.ent === file2bib.sh === id: 60811 author: Janvier, Thomas A. (Thomas Allibone) title: In Great Waters: Four Stories date: pages: extension: .txt txt: ./txt/60811.txt cache: ./cache/60811.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'60811.txt' 26862 txt/../ent/26862.ent === file2bib.sh === id: 973 author: Pyle, Howard title: Howard Pyle's Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main date: pages: extension: .txt txt: ./txt/973.txt cache: ./cache/973.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'973.txt' === file2bib.sh === id: 23539 author: Robertson, Morgan title: "Where Angels Fear to Tread" and Other Stories of the Sea date: pages: extension: .txt txt: ./txt/23539.txt cache: ./cache/23539.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'23539.txt' === file2bib.sh === id: 26862 author: Pyle, Howard title: Howard Pyle's Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main date: pages: extension: .txt txt: ./txt/26862.txt cache: ./cache/26862.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'26862.txt' Done mapping. Reducing subject-seaStoriesAmerican-gutenberg === reduce.pl bib === id = 18062 author = London, Jack title = Stories of Ships and the Sea date = pages = extension = .txt mime = text/plain words = 15343 sentences = 1018 flesch = 88 summary = seaman sing out, 'Boy, der water-jug!' you vood jump quick, like a shot, when the order came forward for the watch on deck to stand by to heave The sailing-master gave his last orders, and away we went, pulling three white, over which the light wind swept on its way out to sea. Away we went before the wind with a single reef in our sail. The _Mary Thomas_ ran into the eye of the wind, lost headway, and fell "Be a good boy, Bub," the captain called to him, as the boat drew away For Old Jerry had been a sailor, and had followed the sea till middle Old Jerry never went back to the sea. "We've got to get across, Jerry," Spillane said, at the same time It was not the first time Jerry had worked the cable, but it was the cache = ./cache/18062.txt txt = ./txt/18062.txt === reduce.pl bib === id = 23539 author = Robertson, Morgan title = "Where Angels Fear to Tread" and Other Stories of the Sea date = pages = extension = .txt mime = text/plain words = 70778 sentences = 4054 flesch = 84 summary = "Look here, old horse," he said; "I don't know whether you're captain "Now, men," said the captain, "what's this trouble about? The captain took a turn or two along the deck, then faced them, and answer." Up went the signal, and as the men on the main-deck were to, very slowly, head to sea, while the men on the ship, who had been to an Oswego sailor whether he shipped as captain, mate, engineer, of sound over which no man above the water-line could lift his voice. The young man's face changed, and his hand went to his cap in salute; "Angel," said the captain to his mate, who stood close to him, "we're Captain Swarth looked at the square-rigged ship, now on the port "You may ask, of course," said the man,--it was Elisha,--"but we'd like and dead-lights appeared faces; and those on deck, officers and men, cache = ./cache/23539.txt txt = ./txt/23539.txt === reduce.pl bib === === reduce.pl bib === id = 26862 author = Pyle, Howard title = Howard Pyle's Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main date = pages = extension = .txt mime = text/plain words = 87423 sentences = 4282 flesch = 80 summary = The pirates came all in good time, and then, in spite of the brave a great big pistol, he said, and Barnaby could hear every word he The man went straight to the great cabin, and poor Barnaby, his brain Barnaby sitting there holding her hand, she with her face turned away, Barnaby," the good old man said, as he led the way through the hall, For Captain Morgan, if he had felt a liking for the young man of the chest, she cried out in a great loud voice that the Good Man That was the year that the famous pirate captain, coming up from the pirate captain and the two men carrying the chest had gone. Meantime the pirate captain had stopped, and now stood with his hand "Why," said the New York captain,--"why, has a--a bloody p-pirate like "That," said the lady, "must have been Captain Keitt's pirate cache = ./cache/26862.txt txt = ./txt/26862.txt === reduce.pl bib === id = 973 author = Pyle, Howard title = Howard Pyle's Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main date = pages = extension = .txt mime = text/plain words = 73876 sentences = 3473 flesch = 81 summary = The pirates came all in good time, and then, in spite of the brave After that the lieutenant cut off the pirate's head, and sailed away in The man went straight to the great cabin, and poor Barnaby, his brain Barnaby sitting there holding her hand, she with her face turned away, the good old man said, as he led the way through the hall, holding up For Captain Morgan, if he had felt a liking for the young man a boat came from a man-of-war, and who should come stepping aboard but An Old-time Story of the Days of Captain Kidd That was the year that the famous pirate captain, coming up from the Meantime the pirate captain had stopped, and now stood with his hand "Why," said the New York captain,--"why, has a--a bloody p-pirate like Lieutenant Maynard stood looking out forward at the pirate vessel, which cache = ./cache/973.txt txt = ./txt/973.txt === reduce.pl bib === id = 60811 author = Janvier, Thomas A. (Thomas Allibone) title = In Great Waters: Four Stories date = pages = extension = .txt mime = text/plain words = 47783 sentences = 2440 flesch = 88 summary = sure, the thought did cross her mind that Krelis might not come to her At this Geert's red cheeks grew a little redder, and her big black eyes Just as the set was forming, Krelis dropped Marretje's hand and said matters, pulled long faces when they talked about the little Krelis the little Krelis was laid away in the graveyard--what love he had to time one of the men would open the door a little and take a look It was old Jan himself who told me this, and he said that when Krelis come into a bubble of water that set the boat to dancing like a cork. boat was lying; and when we were come close to her I said suddenly, as My little Tess came to me, a sea upcast, after one of our great That was the way that my Tess came to me: and I know now how good my cache = ./cache/60811.txt txt = ./txt/60811.txt Building ./etc/reader.txt 26862 973 23539 26862 973 60811 number of items: 6 sum of words: 295,203 average size in words: 59,040 average readability score: 84 nouns: man; time; men; captain; boat; way; face; eyes; sea; water; ship; hand; deck; pirates; day; head; life; wind; night; moment; nothing; sand; voice; crew; hero; hands; end; place; side; house; town; part; light; others; pirate; feet; cabin; something; one; name; vessel; lieutenant; mate; while; money; mind; word; heart; door; days verbs: was; had; were; be; have; said; is; been; do; did; came; come; ''s; went; are; see; made; go; know; stood; get; knew; being; found; take; saw; lay; looked; say; tell; make; left; having; seemed; began; got; turned; put; set; am; fell; heard; looking; called; took; ''re; gone; brought; answered; think adjectives: little; other; great; old; good; own; more; black; first; last; white; such; long; same; young; dead; full; few; many; next; red; small; strong; spanish; poor; open; strange; whole; sure; big; true; pirate; much; large; second; heavy; fine; wild; half; right; short; sudden; silent; very; ready; best; new; close; sharp; enough adverbs: not; so; then; out; up; now; down; again; away; n''t; very; only; as; there; back; still; here; off; just; even; never; more; well; together; all; in; over; ever; on; too; almost; once; suddenly; far; most; enough; forward; no; first; presently; indeed; soon; close; around; always; also; long; ashore; slowly; perhaps pronouns: he; his; it; i; him; you; they; her; she; them; their; me; we; my; himself; our; its; your; us; themselves; ''em; thee; itself; herself; myself; one; mine; thy; ye; yourself; yours; em; hers; ourselves; ''s; theirs; ours; yer; hehself; ha; youahself; yo; na; youah; track,--you; thyself; implanted,--the; hisself; earnestness,--"you proper nouns: _; captain; tom; hiram; barnaby; mr.; levi; morgan; john; krelis; west; chist; blackbeard; new; york; spaniards; mainwaring; malyoe; jones; maltham; ye; sir; blueskin; jonathan; parson; squire; jan; tess; master; god; marretje; cooper; harry; yo; major; indies; hall; geert; ulrica; scarfield; yankee; white; jamaica; magali; johnson; jack; jaap; martin; capt; maynard keywords: man; york; tom; new; mr.; john; captain; west; spanish; spaniards; sir; morgan; malyoe; mainwaring; levi; jones; hiram; chist; blackbeard; barnaby; ulrica; todd; thomas; tess; swarth; spillane; ship; seldom; point; mate; mary; marretje; marken; maltham; major; magali; look; krelis; jonathan; johnson; jerry; jan; jackson; jaap; illustration; hand; geert; finnegan; elisha; deck one topic; one dimension: said file(s): ./cache/23539.txt titles(s): "Where Angels Fear to Tread" and Other Stories of the Sea three topics; one dimension: said; captain; stubbornness file(s): ./cache/26862.txt, ./cache/23539.txt, titles(s): Howard Pyle''s Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main | "Where Angels Fear to Tread" and Other Stories of the Sea | The Wreck of the Titan or, Futility five topics; three dimensions: captain said man; captain man men; little said did; alf chris schooner; blacker paying adventure file(s): ./cache/26862.txt, ./cache/23539.txt, ./cache/60811.txt, ./cache/18062.txt, titles(s): Howard Pyle''s Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main | "Where Angels Fear to Tread" and Other Stories of the Sea | In Great Waters: Four Stories | Stories of Ships and the Sea | The Wreck of the Titan or, Futility Type: gutenberg title: subject-seaStoriesAmerican-gutenberg date: 2021-06-09 time: 23:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Sea stories, American" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 60811 author: Janvier, Thomas A. (Thomas Allibone) title: In Great Waters: Four Stories date: words: 47783.0 sentences: 2440.0 pages: flesch: 88.0 cache: ./cache/60811.txt txt: ./txt/60811.txt summary: sure, the thought did cross her mind that Krelis might not come to her At this Geert''s red cheeks grew a little redder, and her big black eyes Just as the set was forming, Krelis dropped Marretje''s hand and said matters, pulled long faces when they talked about the little Krelis the little Krelis was laid away in the graveyard--what love he had to time one of the men would open the door a little and take a look It was old Jan himself who told me this, and he said that when Krelis come into a bubble of water that set the boat to dancing like a cork. boat was lying; and when we were come close to her I said suddenly, as My little Tess came to me, a sea upcast, after one of our great That was the way that my Tess came to me: and I know now how good my id: 18062 author: London, Jack title: Stories of Ships and the Sea date: words: 15343.0 sentences: 1018.0 pages: flesch: 88.0 cache: ./cache/18062.txt txt: ./txt/18062.txt summary: seaman sing out, ''Boy, der water-jug!'' you vood jump quick, like a shot, when the order came forward for the watch on deck to stand by to heave The sailing-master gave his last orders, and away we went, pulling three white, over which the light wind swept on its way out to sea. Away we went before the wind with a single reef in our sail. The _Mary Thomas_ ran into the eye of the wind, lost headway, and fell "Be a good boy, Bub," the captain called to him, as the boat drew away For Old Jerry had been a sailor, and had followed the sea till middle Old Jerry never went back to the sea. "We''ve got to get across, Jerry," Spillane said, at the same time It was not the first time Jerry had worked the cable, but it was the id: 26862 author: Pyle, Howard title: Howard Pyle''s Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main date: words: 87423.0 sentences: 4282.0 pages: flesch: 80.0 cache: ./cache/26862.txt txt: ./txt/26862.txt summary: The pirates came all in good time, and then, in spite of the brave a great big pistol, he said, and Barnaby could hear every word he The man went straight to the great cabin, and poor Barnaby, his brain Barnaby sitting there holding her hand, she with her face turned away, Barnaby," the good old man said, as he led the way through the hall, For Captain Morgan, if he had felt a liking for the young man of the chest, she cried out in a great loud voice that the Good Man That was the year that the famous pirate captain, coming up from the pirate captain and the two men carrying the chest had gone. Meantime the pirate captain had stopped, and now stood with his hand "Why," said the New York captain,--"why, has a--a bloody p-pirate like "That," said the lady, "must have been Captain Keitt''s pirate id: 973 author: Pyle, Howard title: Howard Pyle''s Book of Pirates Fiction, Fact & Fancy Concerning the Buccaneers & Marooners of the Spanish Main date: words: 73876.0 sentences: 3473.0 pages: flesch: 81.0 cache: ./cache/973.txt txt: ./txt/973.txt summary: The pirates came all in good time, and then, in spite of the brave After that the lieutenant cut off the pirate''s head, and sailed away in The man went straight to the great cabin, and poor Barnaby, his brain Barnaby sitting there holding her hand, she with her face turned away, the good old man said, as he led the way through the hall, holding up For Captain Morgan, if he had felt a liking for the young man a boat came from a man-of-war, and who should come stepping aboard but An Old-time Story of the Days of Captain Kidd That was the year that the famous pirate captain, coming up from the Meantime the pirate captain had stopped, and now stood with his hand "Why," said the New York captain,--"why, has a--a bloody p-pirate like Lieutenant Maynard stood looking out forward at the pirate vessel, which id: 23539 author: Robertson, Morgan title: "Where Angels Fear to Tread" and Other Stories of the Sea date: words: 70778.0 sentences: 4054.0 pages: flesch: 84.0 cache: ./cache/23539.txt txt: ./txt/23539.txt summary: "Look here, old horse," he said; "I don''t know whether you''re captain "Now, men," said the captain, "what''s this trouble about? The captain took a turn or two along the deck, then faced them, and answer." Up went the signal, and as the men on the main-deck were to, very slowly, head to sea, while the men on the ship, who had been to an Oswego sailor whether he shipped as captain, mate, engineer, of sound over which no man above the water-line could lift his voice. The young man''s face changed, and his hand went to his cap in salute; "Angel," said the captain to his mate, who stood close to him, "we''re Captain Swarth looked at the square-rigged ship, now on the port "You may ask, of course," said the man,--it was Elisha,--"but we''d like and dead-lights appeared faces; and those on deck, officers and men, id: 24880 author: Robertson, Morgan title: The Wreck of the Titan or, Futility date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel