mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-haiti-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/24120.txt inflating: ./tmp/input/input-file/35025.txt inflating: ./tmp/input/input-file/47511.txt inflating: ./tmp/input/input-file/38764.txt inflating: ./tmp/input/input-file/44974.txt inflating: ./tmp/input/input-file/59533.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-haiti-gutenberg FILE: cache/35025.txt OUTPUT: txt/35025.txt FILE: cache/47511.txt OUTPUT: txt/47511.txt FILE: cache/44974.txt OUTPUT: txt/44974.txt FILE: cache/24120.txt OUTPUT: txt/24120.txt FILE: cache/59533.txt OUTPUT: txt/59533.txt FILE: cache/38764.txt OUTPUT: txt/38764.txt === file2bib.sh === id: 24120 author: Martineau, Harriet title: The Hour and the Man, An Historical Romance date: pages: extension: .txt txt: ./txt/24120.txt cache: ./cache/24120.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24120.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24120 txt/../ent/24120.ent 24120 txt/../pos/24120.pos 24120 txt/../wrd/24120.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 47511 txt/../pos/47511.pos 44974 txt/../pos/44974.pos 44974 txt/../wrd/44974.wrd 35025 txt/../wrd/35025.wrd 47511 txt/../wrd/47511.wrd 35025 txt/../pos/35025.pos 44974 txt/../ent/44974.ent 35025 txt/../ent/35025.ent 47511 txt/../ent/47511.ent === file2bib.sh === id: 44974 author: H. L. L. title: A short account of the extraordinary life and travels of H. L. L.---- native of St. Domingo, now a prisoner of war at Ashbourn, in Derbyshire, shewing the remarkable steps of Divine providence towards him, and the means of his conversion to God date: pages: extension: .txt txt: ./txt/44974.txt cache: ./cache/44974.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'44974.txt' === file2bib.sh === id: 47511 author: Kuser, John Dryden title: Haiti: Its dawn of progress after years in a night of revolution date: pages: extension: .txt txt: ./txt/47511.txt cache: ./cache/47511.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'47511.txt' === file2bib.sh === id: 35025 author: Johnson, James Weldon title: Self-Determining Haiti Four articles reprinted from The Nation embodying a report of an investigation made for the National Association for the Advancement of Colored People. date: pages: extension: .txt txt: ./txt/35025.txt cache: ./cache/35025.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'35025.txt' 59533 txt/../pos/59533.pos 59533 txt/../wrd/59533.wrd 59533 txt/../ent/59533.ent === file2bib.sh === id: 59533 author: Sansay, Leonora title: Secret History; or, the Horrors of St. Domingo In a Series of Letters, Written by a Lady at Cape Francois, to Colonel Burr, Late Vice-President of the United States, Principally During the Command of General Rochambeu date: pages: extension: .txt txt: ./txt/59533.txt cache: ./cache/59533.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'59533.txt' 38764 txt/../wrd/38764.wrd 38764 txt/../pos/38764.pos 38764 txt/../ent/38764.ent === file2bib.sh === id: 38764 author: Henty, G. A. (George Alfred) title: A Roving Commission; Or, Through the Black Insurrection at Hayti date: pages: extension: .txt txt: ./txt/38764.txt cache: ./cache/38764.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'38764.txt' Done mapping. Reducing subject-haiti-gutenberg === reduce.pl bib === id = 35025 author = Johnson, James Weldon title = Self-Determining Haiti Four articles reprinted from The Nation embodying a report of an investigation made for the National Association for the Advancement of Colored People. date = pages = extension = .txt mime = text/plain words = 17908 sentences = 780 flesch = 58 summary = National City Bank of New York is very much interested in Haiti. part of the United States this government was seeking to compel Haiti to the American government unless Haiti accepted and signed the project of project the Haitian government submitted to the American commission a In Article I the United States promises to "aid the Haitian the financial engulfment of Haiti by the National City Bank of New York, With that American aid the Haitian Government defaulted its revenues collected in the name of the Haitian Government by the American Financial Adviser who is, according to the Haitian-American Convention, President of the United States, a Financial Adviser who shall President of the United States, a Financial Adviser who shall President of the Republic of Haiti and the Haitian Minister of Finance of the Government that the Financial Adviser, a Haitian United States and the National City Bank, the Government of the cache = ./cache/35025.txt txt = ./txt/35025.txt === reduce.pl bib === id = 47511 author = Kuser, John Dryden title = Haiti: Its dawn of progress after years in a night of revolution date = pages = extension = .txt mime = text/plain words = 15560 sentences = 818 flesch = 75 summary = the Haitian-American treaty, part of the government is being run Port-au-Prince, Haiti, three are exclusively for Haitian ports, Haiti in the French days, and many of whose present inhabitants are of Haiti, to-day Port-au-Prince is the capital as well as the most throughout Haiti as "cacos," attempted to make a raid upon the chief in the mountain town of Mirebalais, became the caco leader. "new world." Ownership of Haiti has changed hands four times in this The men left in Haiti by Columbus and those who followed the forced the existing government of Haiti to accept a treaty which At the time the treaty was made between Haiti and the United States, were already at work and in town the "white wings"--an American In Port-au-Prince and all of southern Haiti we were in the Port-au-Prince, but it was the capital in the French days, and the cache = ./cache/47511.txt txt = ./txt/47511.txt === reduce.pl bib === id = 38764 author = Henty, G. A. (George Alfred) title = A Roving Commission; Or, Through the Black Insurrection at Hayti date = pages = extension = .txt mime = text/plain words = 133300 sentences = 7477 flesch = 87 summary = Taking half a dozen hands with buckets, Nat went on board the prize and As soon as they all came on board Nat said: "I thought they would hardly come up as far as this," Nat said; "negroes As soon as these were all housed in the cave, Nat said to Myra, "I will "I don't like your going, Nat," Myra said when, the shawl having been "They thought rightly," Nat said, "though it has been a long time "You are looking very white, Nat," Myra said; "I am afraid that your "The negroes have been beaten," Nat said, "and our men are pursuing "Good-bye, Madame Duchesne!" Nat said, shaking the thin hand she held "I think we are going to have a good time," one of the others said as over it," Nat said; "let each fire as his gun comes to bear." There was cache = ./cache/38764.txt txt = ./txt/38764.txt === reduce.pl bib === === reduce.pl bib === id = 59533 author = Sansay, Leonora title = Secret History; or, the Horrors of St. Domingo In a Series of Letters, Written by a Lady at Cape Francois, to Colonel Burr, Late Vice-President of the United States, Principally During the Command of General Rochambeu date = pages = extension = .txt mime = text/plain words = 35172 sentences = 1810 flesch = 75 summary = the town, ordering all the women to leave their houses--the men had On the third day the negroes evacuated the place, and the fleet entered Madame Le Clerc is very kind to general Boyer, and that her husband that the confidence General Le Clerc placed in the negroes was highly The general followed, and meeting her husband, asked Three of your letters arriving at the same time, my dear friend, have In the evening the general sent an officer to tell Clara that he had I know your conduct madam, he cried, on entering, you left the house He said that he had been sent by the general to take Clara to his house The general, thinking Clara was sent away against her will, and The general arrived first, and jumping from his horse, told Clara that than him, said Clara, trembling at the idea of having been seen by St. Louis. cache = ./cache/59533.txt txt = ./txt/59533.txt === reduce.pl bib === id = 44974 author = H. L. L. title = A short account of the extraordinary life and travels of H. L. L.---- native of St. Domingo, now a prisoner of war at Ashbourn, in Derbyshire, shewing the remarkable steps of Divine providence towards him, and the means of his conversion to God date = pages = extension = .txt mime = text/plain words = 16609 sentences = 715 flesch = 80 summary = ill, in which state I remained for some days; at the same time the Captain of the Ship came to let my Father know that he could not wait Sea we saw a Ship, and chased her; in the mean time that we were for a long while, and having captured no Ships we went into the Town, I went and asked her for my money, that I wanted it to begin down: at the time I was pouring out my soul unto GOD in prayers, a to return the same day, I waited till morning: but what was my great I was for three weeks night and day fighting, some times came some times to see her; well, said I, if he comes I will be ready time hoping that some Ship would hear us and come to our assistance, I stay'd in that place for some time, and went home with cache = ./cache/44974.txt txt = ./txt/44974.txt Building ./etc/reader.txt 38764 59533 44974 35025 38764 47511 number of items: 6 sum of words: 218,549 average size in words: 43,709 average readability score: 75 nouns: time; men; place; negroes; board; day; town; man; way; guns; sir; house; days; ship; side; nothing; island; captain; country; people; work; water; course; thing; night; part; hands; frigate; morning; hand; schooner; fire; one; life; others; brigantine; slaves; officers; shore; hour; officer; moment; husband; years; deck; crew; news; head; blacks; war verbs: was; is; had; have; be; were; are; been; said; do; has; see; go; take; am; get; think; being; went; know; come; made; did; came; say; going; make; taken; having; put; found; done; took; heard; find; told; got; thought; give; sent; saw; left; brought; tell; seen; keep; received; killed; arrived; given adjectives: other; good; great; many; little; first; more; few; own; french; same; young; white; haitian; able; sure; american; last; full; such; long; much; old; possible; small; several; new; large; better; short; likely; present; next; best; general; strong; black; necessary; terrible; least; certain; glad; ready; bad; most; native; impossible; safe; right; second adverbs: not; so; up; now; very; as; out; down; here; then; soon; well; again; only; off; there; once; n''t; away; most; more; on; never; in; just; too; even; back; much; all; still; indeed; however; almost; no; long; together; quite; far; also; over; already; enough; certainly; ever; later; always; therefore; yet; before pronouns: i; it; you; he; they; we; her; his; she; their; them; my; me; him; your; us; our; its; himself; themselves; myself; one; herself; yourself; itself; ourselves; thy; thee; theirs; yours; ours; mine; oneself; hers; ob; ''em; thyself; tears--"what; lodg''d; bookshelf proper nouns: _; nat; mr.; haiti; dinah; st.; glover; monsieur; duchesne; myra; madame; port; prince; de; dat; au; united; states; haitian; clara; government; france; turnbull; french; toussaint; dey; cape; american; god; president; louis; pickard; republic; national; english; agile; hill; general; bank; playford; jamaica; henty; adviser; spartane; lippincott; haitians; financial; occupation; england; françois keywords: french; toussaint; states; st.; madame; illustration; haitian; haiti; american; united; turnbull; town; spartane; ship; sea; rochambeau; republic; prince; president; port; playford; pickard; orpheus; national; nat; myra; mr.; monsieur; louis; lippincott; letter; jago; hill; government; god; glover; general; françois; france; father; duchesne; don; dinah; cuba; clara; cape; brother; agile; adviser one topic; one dimension: said file(s): ./cache/35025.txt titles(s): Self-Determining Haiti Four articles reprinted from The Nation embodying a report of an investigation made for the National Association for the Advancement of Colored People. three topics; one dimension: said; haiti; irregularities file(s): ./cache/38764.txt, ./cache/35025.txt, titles(s): A Roving Commission; Or, Through the Black Insurrection at Hayti | Self-Determining Haiti Four articles reprinted from The Nation embodying a report of an investigation made for the National Association for the Advancement of Colored People. | The Hour and the Man, An Historical Romance five topics; three dimensions: said nat men; haiti haitian american; general clara st; went god time; corrected vanity escaping file(s): ./cache/38764.txt, ./cache/35025.txt, ./cache/59533.txt, ./cache/44974.txt, titles(s): A Roving Commission; Or, Through the Black Insurrection at Hayti | Self-Determining Haiti Four articles reprinted from The Nation embodying a report of an investigation made for the National Association for the Advancement of Colored People. | Secret History; or, the Horrors of St. Domingo In a Series of Letters, Written by a Lady at Cape Francois, to Colonel Burr, Late Vice-President of the United States, Principally During the Command of General Rochambeu | A short account of the extraordinary life and travels of H. L. L.---- native of St. Domingo, now a prisoner of war at Ashbourn, in Derbyshire, shewing the remarkable steps of Divine providence towards him, and the means of his conversion to God | The Hour and the Man, An Historical Romance Type: gutenberg title: subject-haiti-gutenberg date: 2021-06-06 time: 16:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Haiti" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 44974 author: H. L. L. title: A short account of the extraordinary life and travels of H. L. L.---- native of St. Domingo, now a prisoner of war at Ashbourn, in Derbyshire, shewing the remarkable steps of Divine providence towards him, and the means of his conversion to God date: words: 16609.0 sentences: 715.0 pages: flesch: 80.0 cache: ./cache/44974.txt txt: ./txt/44974.txt summary: ill, in which state I remained for some days; at the same time the Captain of the Ship came to let my Father know that he could not wait Sea we saw a Ship, and chased her; in the mean time that we were for a long while, and having captured no Ships we went into the Town, I went and asked her for my money, that I wanted it to begin down: at the time I was pouring out my soul unto GOD in prayers, a to return the same day, I waited till morning: but what was my great I was for three weeks night and day fighting, some times came some times to see her; well, said I, if he comes I will be ready time hoping that some Ship would hear us and come to our assistance, I stay''d in that place for some time, and went home with id: 38764 author: Henty, G. A. (George Alfred) title: A Roving Commission; Or, Through the Black Insurrection at Hayti date: words: 133300.0 sentences: 7477.0 pages: flesch: 87.0 cache: ./cache/38764.txt txt: ./txt/38764.txt summary: Taking half a dozen hands with buckets, Nat went on board the prize and As soon as they all came on board Nat said: "I thought they would hardly come up as far as this," Nat said; "negroes As soon as these were all housed in the cave, Nat said to Myra, "I will "I don''t like your going, Nat," Myra said when, the shawl having been "They thought rightly," Nat said, "though it has been a long time "You are looking very white, Nat," Myra said; "I am afraid that your "The negroes have been beaten," Nat said, "and our men are pursuing "Good-bye, Madame Duchesne!" Nat said, shaking the thin hand she held "I think we are going to have a good time," one of the others said as over it," Nat said; "let each fire as his gun comes to bear." There was id: 35025 author: Johnson, James Weldon title: Self-Determining Haiti Four articles reprinted from The Nation embodying a report of an investigation made for the National Association for the Advancement of Colored People. date: words: 17908.0 sentences: 780.0 pages: flesch: 58.0 cache: ./cache/35025.txt txt: ./txt/35025.txt summary: National City Bank of New York is very much interested in Haiti. part of the United States this government was seeking to compel Haiti to the American government unless Haiti accepted and signed the project of project the Haitian government submitted to the American commission a In Article I the United States promises to "aid the Haitian the financial engulfment of Haiti by the National City Bank of New York, With that American aid the Haitian Government defaulted its revenues collected in the name of the Haitian Government by the American Financial Adviser who is, according to the Haitian-American Convention, President of the United States, a Financial Adviser who shall President of the United States, a Financial Adviser who shall President of the Republic of Haiti and the Haitian Minister of Finance of the Government that the Financial Adviser, a Haitian United States and the National City Bank, the Government of the id: 47511 author: Kuser, John Dryden title: Haiti: Its dawn of progress after years in a night of revolution date: words: 15560.0 sentences: 818.0 pages: flesch: 75.0 cache: ./cache/47511.txt txt: ./txt/47511.txt summary: the Haitian-American treaty, part of the government is being run Port-au-Prince, Haiti, three are exclusively for Haitian ports, Haiti in the French days, and many of whose present inhabitants are of Haiti, to-day Port-au-Prince is the capital as well as the most throughout Haiti as "cacos," attempted to make a raid upon the chief in the mountain town of Mirebalais, became the caco leader. "new world." Ownership of Haiti has changed hands four times in this The men left in Haiti by Columbus and those who followed the forced the existing government of Haiti to accept a treaty which At the time the treaty was made between Haiti and the United States, were already at work and in town the "white wings"--an American In Port-au-Prince and all of southern Haiti we were in the Port-au-Prince, but it was the capital in the French days, and the id: 24120 author: Martineau, Harriet title: The Hour and the Man, An Historical Romance date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 59533 author: Sansay, Leonora title: Secret History; or, the Horrors of St. Domingo In a Series of Letters, Written by a Lady at Cape Francois, to Colonel Burr, Late Vice-President of the United States, Principally During the Command of General Rochambeu date: words: 35172.0 sentences: 1810.0 pages: flesch: 75.0 cache: ./cache/59533.txt txt: ./txt/59533.txt summary: the town, ordering all the women to leave their houses--the men had On the third day the negroes evacuated the place, and the fleet entered Madame Le Clerc is very kind to general Boyer, and that her husband that the confidence General Le Clerc placed in the negroes was highly The general followed, and meeting her husband, asked Three of your letters arriving at the same time, my dear friend, have In the evening the general sent an officer to tell Clara that he had I know your conduct madam, he cried, on entering, you left the house He said that he had been sent by the general to take Clara to his house The general, thinking Clara was sent away against her will, and The general arrived first, and jumping from his horse, told Clara that than him, said Clara, trembling at the idea of having been seen by St. Louis. ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel