mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-nileRiver-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/3668.txt inflating: ./tmp/input/input-file/3233.txt inflating: ./tmp/input/input-file/3284.txt inflating: ./tmp/input/input-file/2125.txt inflating: ./tmp/input/input-file/8417.txt inflating: ./tmp/input/input-file/32995.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-nileRiver-gutenberg FILE: cache/8417.txt OUTPUT: txt/8417.txt FILE: cache/3668.txt OUTPUT: txt/3668.txt FILE: cache/32995.txt OUTPUT: txt/32995.txt FILE: cache/2125.txt OUTPUT: txt/2125.txt FILE: cache/3233.txt OUTPUT: txt/3233.txt FILE: cache/3284.txt OUTPUT: txt/3284.txt === file2bib.sh === id: 2125 author: Baker, Samuel White, Sir title: The Nile Tributaries of Abyssinia, and the Sword Hunters of the Hamran Arabs date: pages: extension: .txt txt: ./txt/2125.txt cache: ./cache/2125.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'2125.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 3668 txt/../ent/3668.ent === file2bib.sh === id: 3668 author: Baker, Samuel White, Sir title: The Albert N'Yanza, Great Basin of the Nile, And Explorations of the Nile Sources date: pages: extension: .txt txt: ./txt/3668.txt cache: ./cache/3668.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'3668.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 2125 txt/../ent/2125.ent 3668 txt/../pos/3668.pos 2125 txt/../wrd/2125.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 3668 txt/../wrd/3668.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 2125 txt/../pos/2125.pos 32995 txt/../pos/32995.pos 32995 txt/../wrd/32995.wrd 32995 txt/../ent/32995.ent === file2bib.sh === id: 32995 author: Jackson, Louis title: Our Caughnawagas in Egypt a narrative of what was seen and accomplished by the contingent of North American Indian voyageurs who led the British boat Expedition for the Relief of Khartoum up the Cataracts of the Nile. date: pages: extension: .txt txt: ./txt/32995.txt cache: ./cache/32995.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'32995.txt' 3233 txt/../pos/3233.pos 3233 txt/../wrd/3233.wrd 8417 txt/../pos/8417.pos 3233 txt/../ent/3233.ent 8417 txt/../wrd/8417.wrd 8417 txt/../ent/8417.ent 3284 txt/../pos/3284.pos 3284 txt/../wrd/3284.wrd 3284 txt/../ent/3284.ent === file2bib.sh === id: 3233 author: Baker, Samuel White, Sir title: In the Heart of Africa date: pages: extension: .txt txt: ./txt/3233.txt cache: ./cache/3233.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'3233.txt' === file2bib.sh === id: 8417 author: Speke, John Hanning title: What Led to the Discovery of the Source of the Nile date: pages: extension: .txt txt: ./txt/8417.txt cache: ./cache/8417.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 10 resourceName b'8417.txt' === file2bib.sh === id: 3284 author: Speke, John Hanning title: The Discovery of the Source of the Nile date: pages: extension: .txt txt: ./txt/3284.txt cache: ./cache/3284.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 17 resourceName b'3284.txt' Done mapping. Reducing subject-nileRiver-gutenberg === reduce.pl bib === === reduce.pl bib === id = 3233 author = Baker, Samuel White, Sir title = In the Heart of Africa date = pages = extension = .txt mime = text/plain words = 90418 sentences = 4121 flesch = 75 summary = but the great event had occurred; the river had arrived "like a thief in Thus was the great river at work upon our arrival on its bank at the arms, head, legs, hands, appeared like a confused mass of dislocation; forward past the huge body, I fired the left-hand barrel at an elephant miles distant, to engage men, and to procure a slave in place of old Mahomet returned, accompanied by a large party of Hamran Arabs, these Hamran Arabs; the horse and man appeared to be one animal, and Some of our men, who had followed the runaway horses, shortly returned camel, men and others were engaged in cutting up the dead elephants, the On the following morning I sent ten of my men with a party of Ibrahim's a few men to the bank of the river where we had landed the day before, cache = ./cache/3233.txt txt = ./txt/3233.txt === reduce.pl bib === id = 3284 author = Speke, John Hanning title = The Discovery of the Source of the Nile date = pages = extension = .txt mime = text/plain words = 211631 sentences = 7504 flesch = 72 summary = Having gone to work again, I found that Sheikh Said had brought ten men, slave for each, and told Sheikh said to look out for some men at once, As nearly all the men had now returned, Grant and I spent New Year's Day men, this time really provoked, said they would fight it out;--a king To do royal honours to the king of this charming land, I ordered my men out of the lake, and said, if I liked to ask the king's leave to visit even Bombay, should come near me; for the king had caused my men to your dinner." My men n'yanzigged--the king walked away, giving orders Bombay did not return within four days, Kamrasi would send other men men, who came with Bombay, said they would escort us to their country, king's orders for escorting us to Gani; but now they sent the men, the cache = ./cache/3284.txt txt = ./txt/3284.txt === reduce.pl bib === === reduce.pl bib === id = 8417 author = Speke, John Hanning title = What Led to the Discovery of the Source of the Nile date = pages = extension = .txt mime = text/plain words = 101037 sentences = 3722 flesch = 67 summary = country--a large tract of land lying due south of Aden, and separated winds two days, during which time I went on shore and paid my respects me to return; they said the sultan was on his way, and would arrive in the interior journey to the great lake, Captain Burton bethought arrival, came down the hill of which this island is formed, in great succeeding sunny day, and, making good our time, reached the old tree On coming up the lake, we travelled the first half up the east coast, the time in taking notes from the travelled Arabs of all the countries fortunate that the sultan was a good man, and was present at the time the place a day or two on my return from the Lake, as they expressed Mansur has all this time been living, like the slaves of the country, cache = ./cache/8417.txt txt = ./txt/8417.txt === reduce.pl bib === id = 32995 author = Jackson, Louis title = Our Caughnawagas in Egypt a narrative of what was seen and accomplished by the contingent of North American Indian voyageurs who led the British boat Expedition for the Relief of Khartoum up the Cataracts of the Nile. date = pages = extension = .txt mime = text/plain words = 9737 sentences = 505 flesch = 82 summary = about half an inch of mud off our faces with Nile river water, went to Nile river water of good taste but muddy and we generally left it following morning were ordered to take the light boats up the cataract We walked back the three miles took another boat and tried the channel officers taking a boat each of different numbers, reached Sarras about 5 the river with the lesser current, the boats being such good travellers mile wide, and full of large rocks between which the water came down Dal cataract is said to be five miles long. the river, there being no place for the men to stand and pull, the water well as the cataracts, the sailing qualities of the boats were all Placing a captain in each boat we started, but were charge with my Iroquois in passing boats up the Dal cataract, until the cache = ./cache/32995.txt txt = ./txt/32995.txt Building ./etc/reader.txt 3284 8417 3233 8417 3284 32995 number of items: 6 sum of words: 412,823 average size in words: 103,205 average readability score: 74 nouns: men; king; country; time; day; man; way; river; people; place; water; lake; head; ground; camp; women; palace; side; one; night; morning; beads; days; miles; party; nothing; chief; village; journey; feet; orders; land; hands; manner; boats; animals; anything; officers; hills; road; yards; cows; hand; line; coast; arrival; march; everything; cloth; natives verbs: was; had; were; be; is; have; been; said; are; being; sent; do; did; see; came; go; found; made; gave; give; told; having; called; went; brought; take; come; arrived; took; left; heard; thought; saw; seen; make; given; wished; get; done; has; ordered; say; asked; knew; returned; send; begged; going; kept; saying adjectives: great; other; same; little; large; more; many; such; good; first; small; few; own; old; last; long; whole; white; high; much; next; full; several; short; only; usual; best; second; black; ready; certain; wild; present; arab; deep; necessary; fine; different; new; young; beautiful; strong; distant; poor; better; open; able; dead; possible; common adverbs: not; so; then; now; up; very; as; only; again; here; out; off; once; more; away; well; down; never; most; about; on; much; there; also; however; in; back; still; too; even; far; ever; soon; just; thus; immediately; all; therefore; over; together; first; no; instead; always; before; else; quite; long; sooner; rather pronouns: i; he; his; my; it; we; they; their; me; him; them; us; our; her; you; she; its; himself; myself; themselves; your; one; ourselves; itself; herself; mine; yourself; theirs; ours; yours; yourselves; thy; ya; there; thee; speke_.--"where; hers; ay; ''s proper nouns: kamrasi; bombay; nile; arabs; grant; uganda; mtesa; rumanika; _; zanzibar; baraka; waganda; africa; unyoro; karague; hut; n''yanza; march; gani; bana; burton; musa; captain; gondokoro; suwarora; maula; wakungu; aden; wahuma; speke; sheikh; england; petherick; somali; lumeresi; mahamed; wanguana; kaze; mahomet; budja; sultan; manua; kamraviona; abban; lake; k''yengo; turks; khartoum; victoria; usui keywords: nile; arabs; africa; zanzibar; man; kamrasi; grant; bombay; white; watuta; warsingali; wanguana; wakungu; wahuma; waganda; usui; unyoro; ujiji; uganda; turks; tokrooris; tanganyika; taher; suwarora; sumunter; sultan; speke; soudan; somali; sherrif; sheikh; sera; saat; rumanika; petherick; musa; mtesa; maula; manua; mahomet; mahamed; lumeresi; lieutenant; lake; king; kidi; khartoum; kazé; kaze; karague one topic; one dimension: men file(s): titles(s): The Albert N'Yanza, Great Basin of the Nile, And Explorations of the Nile Sources three topics; one dimension: men; men; cataract file(s): ./cache/3284.txt, ./cache/3233.txt, ./cache/32995.txt titles(s): The Discovery of the Source of the Nile | In the Heart of Africa | Our Caughnawagas in Egypt a narrative of what was seen and accomplished by the contingent of North American Indian voyageurs who led the British boat Expedition for the Relief of Khartoum up the Cataracts of the Nile. five topics; three dimensions: men king said; men country great; cataract boats river; away palace chief; away palace chief file(s): ./cache/3284.txt, ./cache/3233.txt, ./cache/32995.txt, , titles(s): The Discovery of the Source of the Nile | In the Heart of Africa | Our Caughnawagas in Egypt a narrative of what was seen and accomplished by the contingent of North American Indian voyageurs who led the British boat Expedition for the Relief of Khartoum up the Cataracts of the Nile. | The Albert N'Yanza, Great Basin of the Nile, And Explorations of the Nile Sources | The Albert N'Yanza, Great Basin of the Nile, And Explorations of the Nile Sources Type: gutenberg title: subject-nileRiver-gutenberg date: 2021-06-07 time: 12:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Nile River" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 3668 author: Baker, Samuel White, Sir title: The Albert N'Yanza, Great Basin of the Nile, And Explorations of the Nile Sources date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 3233 author: Baker, Samuel White, Sir title: In the Heart of Africa date: words: 90418.0 sentences: 4121.0 pages: flesch: 75.0 cache: ./cache/3233.txt txt: ./txt/3233.txt summary: but the great event had occurred; the river had arrived "like a thief in Thus was the great river at work upon our arrival on its bank at the arms, head, legs, hands, appeared like a confused mass of dislocation; forward past the huge body, I fired the left-hand barrel at an elephant miles distant, to engage men, and to procure a slave in place of old Mahomet returned, accompanied by a large party of Hamran Arabs, these Hamran Arabs; the horse and man appeared to be one animal, and Some of our men, who had followed the runaway horses, shortly returned camel, men and others were engaged in cutting up the dead elephants, the On the following morning I sent ten of my men with a party of Ibrahim''s a few men to the bank of the river where we had landed the day before, id: 2125 author: Baker, Samuel White, Sir title: The Nile Tributaries of Abyssinia, and the Sword Hunters of the Hamran Arabs date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 32995 author: Jackson, Louis title: Our Caughnawagas in Egypt a narrative of what was seen and accomplished by the contingent of North American Indian voyageurs who led the British boat Expedition for the Relief of Khartoum up the Cataracts of the Nile. date: words: 9737.0 sentences: 505.0 pages: flesch: 82.0 cache: ./cache/32995.txt txt: ./txt/32995.txt summary: about half an inch of mud off our faces with Nile river water, went to Nile river water of good taste but muddy and we generally left it following morning were ordered to take the light boats up the cataract We walked back the three miles took another boat and tried the channel officers taking a boat each of different numbers, reached Sarras about 5 the river with the lesser current, the boats being such good travellers mile wide, and full of large rocks between which the water came down Dal cataract is said to be five miles long. the river, there being no place for the men to stand and pull, the water well as the cataracts, the sailing qualities of the boats were all Placing a captain in each boat we started, but were charge with my Iroquois in passing boats up the Dal cataract, until the id: 3284 author: Speke, John Hanning title: The Discovery of the Source of the Nile date: words: 211631.0 sentences: 7504.0 pages: flesch: 72.0 cache: ./cache/3284.txt txt: ./txt/3284.txt summary: Having gone to work again, I found that Sheikh Said had brought ten men, slave for each, and told Sheikh said to look out for some men at once, As nearly all the men had now returned, Grant and I spent New Year''s Day men, this time really provoked, said they would fight it out;--a king To do royal honours to the king of this charming land, I ordered my men out of the lake, and said, if I liked to ask the king''s leave to visit even Bombay, should come near me; for the king had caused my men to your dinner." My men n''yanzigged--the king walked away, giving orders Bombay did not return within four days, Kamrasi would send other men men, who came with Bombay, said they would escort us to their country, king''s orders for escorting us to Gani; but now they sent the men, the id: 8417 author: Speke, John Hanning title: What Led to the Discovery of the Source of the Nile date: words: 101037.0 sentences: 3722.0 pages: flesch: 67.0 cache: ./cache/8417.txt txt: ./txt/8417.txt summary: country--a large tract of land lying due south of Aden, and separated winds two days, during which time I went on shore and paid my respects me to return; they said the sultan was on his way, and would arrive in the interior journey to the great lake, Captain Burton bethought arrival, came down the hill of which this island is formed, in great succeeding sunny day, and, making good our time, reached the old tree On coming up the lake, we travelled the first half up the east coast, the time in taking notes from the travelled Arabs of all the countries fortunate that the sultan was a good man, and was present at the time the place a day or two on my return from the Lake, as they expressed Mansur has all this time been living, like the slaves of the country, ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel