mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Error: near line 1: database is locked Send options without primary recipient specified. Usage: mailx -eiIUdEFntBDNHRVv~ -T FILE -u USER -h hops -r address -s SUBJECT -a FILE -q FILE -f FILE -A ACCOUNT -b USERS -c USERS -S OPTION users Creating study carrel named subject-southPole-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/19731.txt inflating: ./tmp/input/input-file/3415.txt inflating: ./tmp/input/input-file/3414.txt inflating: ./tmp/input/input-file/4229.txt inflating: ./tmp/input/input-file/11579.txt inflating: ./tmp/input/input-file/6721.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-southPole-gutenberg FILE: cache/19731.txt OUTPUT: txt/19731.txt FILE: cache/3414.txt OUTPUT: txt/3414.txt FILE: cache/6721.txt OUTPUT: txt/6721.txt FILE: cache/3415.txt OUTPUT: txt/3415.txt FILE: cache/4229.txt OUTPUT: txt/4229.txt FILE: cache/11579.txt OUTPUT: txt/11579.txt === file2bib.sh === id: 3414 author: Amundsen, Roald title: The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-1912 — Volume 1 date: pages: extension: .txt txt: ./txt/3414.txt cache: ./cache/3414.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'3414.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' === file2bib.sh === id: 3415 author: Amundsen, Roald title: The South Pole; an account of the Norwegian antarctic expedition in the "Fram," 1910-1912 — Volume 2 date: pages: extension: .txt txt: ./txt/3415.txt cache: ./cache/3415.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'3415.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 3415 txt/../ent/3415.ent 3415 txt/../pos/3415.pos 3414 txt/../ent/3414.ent 3414 txt/../pos/3414.pos 3414 txt/../wrd/3414.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 3415 txt/../wrd/3415.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 19731 txt/../wrd/19731.wrd 19731 txt/../pos/19731.pos 19731 txt/../ent/19731.ent 6721 txt/../pos/6721.pos 6721 txt/../wrd/6721.wrd === file2bib.sh === id: 19731 author: Rockwood, Roy title: Under the Ocean to the South Pole; Or, the Strange Cruise of the Submarine Wonder date: pages: extension: .txt txt: ./txt/19731.txt cache: ./cache/19731.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'19731.txt' 6721 txt/../ent/6721.ent 11579 txt/../wrd/11579.wrd 11579 txt/../pos/11579.pos 4229 txt/../pos/4229.pos 4229 txt/../wrd/4229.wrd 11579 txt/../ent/11579.ent 4229 txt/../ent/4229.ent === file2bib.sh === id: 6721 author: Turley, Charles title: The Voyages of Captain Scott : Retold from the Voyage of the Discovery and Scott's Last Expedition date: pages: extension: .txt txt: ./txt/6721.txt cache: ./cache/6721.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 17 resourceName b'6721.txt' === file2bib.sh === id: 11579 author: Scott, Robert Falcon title: Scott's Last Expedition, Volume I Being the journals of Captain R. F. Scott date: pages: extension: .txt txt: ./txt/11579.txt cache: ./cache/11579.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 22 resourceName b'11579.txt' === file2bib.sh === id: 4229 author: Amundsen, Roald title: The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-12 — Volume 1 and Volume 2 date: pages: extension: .txt txt: ./txt/4229.txt cache: ./cache/4229.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 17 resourceName b'4229.txt' Done mapping. Reducing subject-southPole-gutenberg === reduce.pl bib === id = 19731 author = Rockwood, Roy title = Under the Ocean to the South Pole; Or, the Strange Cruise of the Submarine Wonder date = pages = extension = .txt mime = text/plain words = 51017 sentences = 4161 flesch = 90 summary = "Hand me that wrench, Mark," called Professor Amos Henderson to a boy "Do you think the ship will work, Professor?" he asked. "Now boys, we'll see if she works so far," said the professor. "We are only going down a little way," the professor said, "and only At the sound of the voice the professor started and Mark and Jack "I think I'll go a little nearer the surface," said the professor to "What is it?" asked Mark, as, followed by Jack, he came forward. "I think you and Mark will have to make a trip to town," he said to Jack "It's Washington!" cried Mark, as he saw Professor Henderson's colored The manhole cover was opened and Andy, with Jack and Mark, went out on water had come to the surface, the professor, came up on deck to take a "Reverse the ship!" cried Professor Henderson. cache = ./cache/19731.txt txt = ./txt/19731.txt === reduce.pl bib === === reduce.pl bib === id = 4229 author = Amundsen, Roald title = The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-12 — Volume 1 and Volume 2 date = pages = extension = .txt mime = text/plain words = 226262 sentences = 12311 flesch = 81 summary = New Year's Day came and went without any change in the ice. but these men succeeded in working their way on foot over sea-ice place came the south-west wind with rain, fog, and foul weather in carry dogs, too, aboard this ship," he would say, every time he came on days, and before the month was half over we had come a good way into long sea voyage, and probably many on board the Fram looked forward dogs themselves saw to its covering with ice, and for the time being a mass of dogs it took some little time before they came across each this way for the first time going south, Hanssen's dogs had fallen That day we crossed the last crevasse for a long time to come, and reached our good little house again, with two sledges and eleven dogs; was the best day's work the Fram had done up to that time. cache = ./cache/4229.txt txt = ./txt/4229.txt === reduce.pl bib === id = 6721 author = Turley, Charles title = The Voyages of Captain Scott : Retold from the Voyage of the Discovery and Scott's Last Expedition date = pages = extension = .txt mime = text/plain words = 115444 sentences = 5715 flesch = 79 summary = days the ship had really to fight her way, and Scott gave high As the days of March went by Scott began really to wonder whether miles off, but hope it is not so much; nine hours' work to-day work that when the second long Polar night ended, Scott was able to With ponies, motor sledges, dogs, and men parties working hard, following day Scott drove his team to the ship, and when the men For the depôt laying journey Scott's party consisted of 12 men on Scott saw their sledge track leading round on the sea-ice. Armitage, Scott and his party soon started back to Safety Camp, Gran at Corner Camp, and on the following day Scott, Crean and Two days later another depôt party started to Corner Camp, E. every day, Scott hoped to march longer hours and to make the requisite cache = ./cache/6721.txt txt = ./txt/6721.txt === reduce.pl bib === === reduce.pl bib === id = 11579 author = Scott, Robert Falcon title = Scott's Last Expedition, Volume I Being the journals of Captain R. F. Scott date = pages = extension = .txt mime = text/plain words = 180533 sentences = 12028 flesch = 84 summary = Well--A Head Wind--Bad Conditions Continue--At One Ton Camp--Winter We have run 190 miles to-day: a good start, but inconvenient in one Crozier on New Year's Day. 8 P.M.--Our calm soon came to an end, the breeze at 3 P.M. coming ice for water, snow for the animals, good slopes for ski-ing, vast ponies to come out, and we commenced a good day's work. 1/4 mile off Hut Point got a clear run to Glacier Tongue. and 2 from Hut Point--a cold east wind; to-night the temperature 19°. Last night the temperature fell to -6° after the wind dropped--to-day Started on a bad surface--ponies plunging a good deal for 2 miles or blowing from 30 to 40 miles an hour all day; drift bad, and to-night Have exercised the ponies to-day and got my first good look at them. Light snow has fallen during the day--to-night the wind cache = ./cache/11579.txt txt = ./txt/11579.txt Building ./etc/reader.txt 4229 11579 6721 11579 6721 4229 number of items: 6 sum of words: 573,256 average size in words: 143,314 average readability score: 83 nouns: time; day; ice; dogs; wind; snow; way; ship; miles; night; water; work; surface; sledge; days; morning; sea; weather; party; ponies; feet; course; °; man; men; tent; side; page; sledges; temperature; part; nothing; journey; hours; one; land; end; camp; place; food; air; ski; afternoon; things; conditions; hour; sun; march; south; north verbs: was; had; is; be; were; have; been; are; has; made; get; went; came; see; did; do; found; got; go; going; left; come; seen; make; saw; take; being; said; put; think; took; done; taken; thought; seemed; started; looked; find; getting; began; reached; brought; ''s; set; lay; know; gave; turned; covered; keep adjectives: good; little; great; first; last; more; other; long; same; few; many; such; small; much; whole; old; next; bad; able; possible; heavy; cold; clear; better; big; fine; full; open; best; high; large; hard; several; new; short; ready; thick; own; difficult; strong; second; warm; excellent; fresh; only; light; right; poor; most; impossible adverbs: not; very; up; so; out; now; then; again; as; only; well; on; more; down; here; off; far; about; most; back; still; soon; n''t; away; all; much; too; there; just; however; even; also; in; quite; never; once; enough; long; first; ever; later; over; almost; always; rather; nearly; therefore; thus; suddenly; yet pronouns: we; it; i; they; he; our; his; their; them; us; him; my; you; its; one; me; her; she; himself; themselves; ourselves; itself; myself; your; oneself; ours; ''em; ''s; herself; yourself; mine; em; yours; theirs; ye; yo; ye''d; thee; n.b.--the; i''m; ay proper nouns: _; scott; barrier; evans; hut; wilson; fram; cape; south; s.; pole; march; jack; camp; washington; mark; point; c.; glacier; discovery; mr.; january; henderson; december; bowers; oates; atkinson; hanssen; bay; e.; island; porpoise; february; meares; captain; r.; andy; f.; party; sunday; lindström; bjaaland; ross; november; cherry; °; polar; garrard; framheim; land keywords: pole; january; december; barrier; wilson; scott; point; p.m.; oates; meares; march; hut; glacier; garrard; february; evans; cherry; cape; camp; bowers; atkinson; wisting; whales; wednesday; washington; tuesday; tom; thursday; sunday; stubberud; south; ship; sea; school; saturday; ross; professor; porpoise; polar; party; page; p.o.; november; mr.; mount; monday; mark; lindström; lashly; land one topic; one dimension: day file(s): ./cache/19731.txt titles(s): Under the Ocean to the South Pole; Or, the Strange Cruise of the Submarine Wonder three topics; one dimension: day; time; professor file(s): ./cache/11579.txt, ./cache/4229.txt, ./cache/19731.txt titles(s): Scott''s Last Expedition, Volume I Being the journals of Captain R. F. Scott | The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-12 — Volume 1 and Volume 2 | Under the Ocean to the South Pole; Or, the Strange Cruise of the Submarine Wonder five topics; three dimensions: time dogs day; ice day wind; scott page day; professor ship jack; shudder flapping chattering file(s): ./cache/4229.txt, ./cache/11579.txt, ./cache/6721.txt, ./cache/19731.txt, titles(s): The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-12 — Volume 1 and Volume 2 | Scott''s Last Expedition, Volume I Being the journals of Captain R. F. Scott | The Voyages of Captain Scott : Retold from the Voyage of the Discovery and Scott''s Last Expedition | Under the Ocean to the South Pole; Or, the Strange Cruise of the Submarine Wonder | The South Pole; an account of the Norwegian antarctic expedition in the "Fram," 1910-1912 — Volume 2 Type: gutenberg title: subject-southPole-gutenberg date: 2021-06-10 time: 13:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"South Pole" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 3415 author: Amundsen, Roald title: The South Pole; an account of the Norwegian antarctic expedition in the "Fram," 1910-1912 — Volume 2 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 3414 author: Amundsen, Roald title: The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-1912 — Volume 1 date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 4229 author: Amundsen, Roald title: The South Pole; an account of the Norwegian Antarctic expedition in the "Fram," 1910-12 — Volume 1 and Volume 2 date: words: 226262.0 sentences: 12311.0 pages: flesch: 81.0 cache: ./cache/4229.txt txt: ./txt/4229.txt summary: New Year''s Day came and went without any change in the ice. but these men succeeded in working their way on foot over sea-ice place came the south-west wind with rain, fog, and foul weather in carry dogs, too, aboard this ship," he would say, every time he came on days, and before the month was half over we had come a good way into long sea voyage, and probably many on board the Fram looked forward dogs themselves saw to its covering with ice, and for the time being a mass of dogs it took some little time before they came across each this way for the first time going south, Hanssen''s dogs had fallen That day we crossed the last crevasse for a long time to come, and reached our good little house again, with two sledges and eleven dogs; was the best day''s work the Fram had done up to that time. id: 19731 author: Rockwood, Roy title: Under the Ocean to the South Pole; Or, the Strange Cruise of the Submarine Wonder date: words: 51017.0 sentences: 4161.0 pages: flesch: 90.0 cache: ./cache/19731.txt txt: ./txt/19731.txt summary: "Hand me that wrench, Mark," called Professor Amos Henderson to a boy "Do you think the ship will work, Professor?" he asked. "Now boys, we''ll see if she works so far," said the professor. "We are only going down a little way," the professor said, "and only At the sound of the voice the professor started and Mark and Jack "I think I''ll go a little nearer the surface," said the professor to "What is it?" asked Mark, as, followed by Jack, he came forward. "I think you and Mark will have to make a trip to town," he said to Jack "It''s Washington!" cried Mark, as he saw Professor Henderson''s colored The manhole cover was opened and Andy, with Jack and Mark, went out on water had come to the surface, the professor, came up on deck to take a "Reverse the ship!" cried Professor Henderson. id: 11579 author: Scott, Robert Falcon title: Scott''s Last Expedition, Volume I Being the journals of Captain R. F. Scott date: words: 180533.0 sentences: 12028.0 pages: flesch: 84.0 cache: ./cache/11579.txt txt: ./txt/11579.txt summary: Well--A Head Wind--Bad Conditions Continue--At One Ton Camp--Winter We have run 190 miles to-day: a good start, but inconvenient in one Crozier on New Year''s Day. 8 P.M.--Our calm soon came to an end, the breeze at 3 P.M. coming ice for water, snow for the animals, good slopes for ski-ing, vast ponies to come out, and we commenced a good day''s work. 1/4 mile off Hut Point got a clear run to Glacier Tongue. and 2 from Hut Point--a cold east wind; to-night the temperature 19°. Last night the temperature fell to -6° after the wind dropped--to-day Started on a bad surface--ponies plunging a good deal for 2 miles or blowing from 30 to 40 miles an hour all day; drift bad, and to-night Have exercised the ponies to-day and got my first good look at them. Light snow has fallen during the day--to-night the wind id: 6721 author: Turley, Charles title: The Voyages of Captain Scott : Retold from the Voyage of the Discovery and Scott''s Last Expedition date: words: 115444.0 sentences: 5715.0 pages: flesch: 79.0 cache: ./cache/6721.txt txt: ./txt/6721.txt summary: days the ship had really to fight her way, and Scott gave high As the days of March went by Scott began really to wonder whether miles off, but hope it is not so much; nine hours'' work to-day work that when the second long Polar night ended, Scott was able to With ponies, motor sledges, dogs, and men parties working hard, following day Scott drove his team to the ship, and when the men For the depôt laying journey Scott''s party consisted of 12 men on Scott saw their sledge track leading round on the sea-ice. Armitage, Scott and his party soon started back to Safety Camp, Gran at Corner Camp, and on the following day Scott, Crean and Two days later another depôt party started to Corner Camp, E. every day, Scott hoped to march longer hours and to make the requisite ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel