mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-lafayetteMarieJosephPaulYvesRochGilbertDuMotierMarquisDe-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/27777.txt inflating: ./tmp/input/input-file/24494.txt inflating: ./tmp/input/input-file/7449.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-lafayetteMarieJosephPaulYvesRochGilbertDuMotierMarquisDe-gutenberg FILE: cache/24494.txt OUTPUT: txt/24494.txt FILE: cache/27777.txt OUTPUT: txt/27777.txt FILE: cache/7449.txt OUTPUT: txt/7449.txt === file2bib.sh === id: 24494 author: Hallowell, James Mott title: The Spirit of Lafayette date: pages: extension: .txt txt: ./txt/24494.txt cache: ./cache/24494.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'24494.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24494 txt/../ent/24494.ent 24494 txt/../pos/24494.pos 24494 txt/../wrd/24494.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 27777 txt/../pos/27777.pos 27777 txt/../wrd/27777.wrd 27777 txt/../ent/27777.ent 7449 txt/../pos/7449.pos 7449 txt/../wrd/7449.wrd 7449 txt/../ent/7449.ent === file2bib.sh === id: 27777 author: Crow, Martha Foote title: Lafayette date: pages: extension: .txt txt: ./txt/27777.txt cache: ./cache/27777.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'27777.txt' === file2bib.sh === id: 7449 author: Knapp, Samuel L. (Samuel Lorenzo) title: Memoirs of General Lafayette With an Account of His Visit to America and His Reception By the People of the United States; From His Arrival, August 15th, to the Celebration at Yorktown, October 19th, 1824. date: pages: extension: .txt txt: ./txt/7449.txt cache: ./cache/7449.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'7449.txt' Done mapping. Reducing subject-lafayetteMarieJosephPaulYvesRochGilbertDuMotierMarquisDe-gutenberg === reduce.pl bib === id = 27777 author = Crow, Martha Foote title = Lafayette date = pages = extension = .txt mime = text/plain words = 42960 sentences = 2163 flesch = 71 summary = By this time Lafayette was a tall, slender young fellow, of commanding some who were to follow Lafayette in his adventure to the New World in aid until Lafayette had been made an officer in the American army. Lafayette, now a major general in the American army, attended the Lafayette accompanied General Washington to the battle. Lafayette and the other generals felt great bitterness on that day General Washington, on his part, wrote to Lafayette in this wise: 1781, that General Washington wrote to Lafayette, giving him full The time was coming when Lafayette could begin to move the British Important among the men under General Lafayette's command was Following his return from America at this time, Lafayette made a long During this time Lafayette had two great interests: one, a public life It did as much good to the American people as it did to Lafayette to cache = ./cache/27777.txt txt = ./txt/27777.txt === reduce.pl bib === === reduce.pl bib === id = 7449 author = Knapp, Samuel L. (Samuel Lorenzo) title = Memoirs of General Lafayette With an Account of His Visit to America and His Reception By the People of the United States; From His Arrival, August 15th, to the Celebration at Yorktown, October 19th, 1824. date = pages = extension = .txt mime = text/plain words = 72249 sentences = 2926 flesch = 59 summary = country of more than two years, Lafayette visited France: not however, When General Lafayette visited the United States in 1784, he was follows--"That the merit and services of General Lafayette render it received Lafayette when he arrived in the United States, in 1777,) made son of Lafayette the generous & noble feelings of Washington induced him Lafayette received the gratulations of a great number of the citizens; of General Lafayette to visit this part of our country, at the period of arrangements present their respectful salutations to General Lafayette, General Lafayette expressed great satisfaction of the proposal. General Lafayette passed three days in the city of New-York, on his The Governor of the State having been presented, General Lafayette, we now delight to honor, General Lafayette, whose whole life has been In no city which General Lafayette visited, had he met with a more General Lafayette arrived in the city of Washington, according to cache = ./cache/7449.txt txt = ./txt/7449.txt Building ./etc/reader.txt 7449 27777 24494 7449 27777 24494 number of items: 3 sum of words: 115,209 average size in words: 57,604 average readability score: 65 nouns: country; people; time; liberty; army; citizens; men; friend; man; life; city; part; day; cause; years; troops; family; officers; place; nation; name; friends; letter; services; power; honor; gratitude; way; state; heart; rights; government; world; occasion; soldiers; war; moment; principles; days; happiness; character; affection; freedom; revolution; order; command; respect; enemy; feelings; visit verbs: was; were; had; be; have; is; been; are; made; has; received; being; said; did; passed; receive; came; make; found; gave; took; take; am; see; given; do; sent; following; left; give; go; find; having; wrote; presented; welcome; taken; met; come; visit; attended; proceeded; called; followed; felt; reached; thought; done; assembled; visited adjectives: great; american; many; other; young; own; french; public; military; such; british; whole; first; happy; several; good; same; old; more; present; distinguished; revolutionary; personal; large; few; grateful; generous; much; long; free; last; high; dear; new; civil; beloved; affectionate; national; little; interesting; honorable; general; noble; early; important; possible; cordial; private; glorious; splendid adverbs: not; so; most; then; now; also; more; as; very; here; only; still; well; up; never; out; soon; again; ever; about; too; however; even; much; once; first; far; long; there; together; on; always; thus; almost; indeed; highly; before; yet; immediately; back; particularly; just; afterwards; therefore; nearly; away; off; down; justly; in pronouns: he; his; it; their; him; i; you; they; our; my; your; we; them; her; me; its; she; himself; us; myself; themselves; thy; itself; herself; yourself; one; thee; ourselves; yours; theirs; ours; yourselves; means_--they; him,--resolved; hers proper nouns: lafayette; _; general; washington; france; america; states; united; de; congress; new; york; marquis; boston; paris; sir; mr.; president; british; virginia; huger; governor; yorktown; philadelphia; cornwallis; king; state; colonel; americans; mayor; madame; bollman; american; louis; french; national; c.; england; assembly; major; la; europe; council; committee; olmutz; army; olmütz; october; m.; cincinnati keywords: york; washington; united; states; paris; new; marquis; lafayette; general; french; france; congress; british; president; philadelphia; mr.; mayor; king; huger; governor; english; england; boston; american; america one topic; one dimension: lafayette file(s): ./cache/27777.txt titles(s): Lafayette three topics; one dimension: lafayette; lafayette; congratulate file(s): ./cache/7449.txt, ./cache/27777.txt, titles(s): Memoirs of General Lafayette With an Account of His Visit to America and His Reception By the People of the United States; From His Arrival, August 15th, to the Celebration at Yorktown, October 19th, 1824. | Lafayette | The Spirit of Lafayette five topics; three dimensions: lafayette general country; lafayette general washington; misery canopy conqueror; misery canopy conqueror; misery canopy conqueror file(s): ./cache/7449.txt, ./cache/27777.txt, , , titles(s): Memoirs of General Lafayette With an Account of His Visit to America and His Reception By the People of the United States; From His Arrival, August 15th, to the Celebration at Yorktown, October 19th, 1824. | Lafayette | The Spirit of Lafayette | The Spirit of Lafayette | The Spirit of Lafayette Type: gutenberg title: subject-lafayetteMarieJosephPaulYvesRochGilbertDuMotierMarquisDe-gutenberg date: 2021-06-06 time: 21:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Lafayette, Marie Joseph Paul Yves Roch Gilbert Du Motier, marquis de, 1757-1834" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 27777 author: Crow, Martha Foote title: Lafayette date: words: 42960.0 sentences: 2163.0 pages: flesch: 71.0 cache: ./cache/27777.txt txt: ./txt/27777.txt summary: By this time Lafayette was a tall, slender young fellow, of commanding some who were to follow Lafayette in his adventure to the New World in aid until Lafayette had been made an officer in the American army. Lafayette, now a major general in the American army, attended the Lafayette accompanied General Washington to the battle. Lafayette and the other generals felt great bitterness on that day General Washington, on his part, wrote to Lafayette in this wise: 1781, that General Washington wrote to Lafayette, giving him full The time was coming when Lafayette could begin to move the British Important among the men under General Lafayette''s command was Following his return from America at this time, Lafayette made a long During this time Lafayette had two great interests: one, a public life It did as much good to the American people as it did to Lafayette to id: 24494 author: Hallowell, James Mott title: The Spirit of Lafayette date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 7449 author: Knapp, Samuel L. (Samuel Lorenzo) title: Memoirs of General Lafayette With an Account of His Visit to America and His Reception By the People of the United States; From His Arrival, August 15th, to the Celebration at Yorktown, October 19th, 1824. date: words: 72249.0 sentences: 2926.0 pages: flesch: 59.0 cache: ./cache/7449.txt txt: ./txt/7449.txt summary: country of more than two years, Lafayette visited France: not however, When General Lafayette visited the United States in 1784, he was follows--"That the merit and services of General Lafayette render it received Lafayette when he arrived in the United States, in 1777,) made son of Lafayette the generous & noble feelings of Washington induced him Lafayette received the gratulations of a great number of the citizens; of General Lafayette to visit this part of our country, at the period of arrangements present their respectful salutations to General Lafayette, General Lafayette expressed great satisfaction of the proposal. General Lafayette passed three days in the city of New-York, on his The Governor of the State having been presented, General Lafayette, we now delight to honor, General Lafayette, whose whole life has been In no city which General Lafayette visited, had he met with a more General Lafayette arrived in the city of Washington, according to ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel