mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-foxes-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/18667.txt inflating: ./tmp/input/input-file/22611.txt inflating: ./tmp/input/input-file/25650.txt inflating: ./tmp/input/input-file/14814.txt inflating: ./tmp/input/input-file/5955.txt inflating: ./tmp/input/input-file/10337.txt inflating: ./tmp/input/input-file/44347.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-foxes-gutenberg FILE: cache/22611.txt OUTPUT: txt/22611.txt FILE: cache/5955.txt OUTPUT: txt/5955.txt FILE: cache/14814.txt OUTPUT: txt/14814.txt FILE: cache/44347.txt OUTPUT: txt/44347.txt FILE: cache/25650.txt OUTPUT: txt/25650.txt FILE: cache/18667.txt OUTPUT: txt/18667.txt FILE: cache/10337.txt OUTPUT: txt/10337.txt === file2bib.sh === id: 25650 author: Anonymous title: All About the Little Small Red Hen date: pages: extension: .txt txt: ./txt/25650.txt cache: ./cache/25650.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'25650.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 25650 txt/../wrd/25650.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 25650 txt/../ent/25650.ent 25650 txt/../pos/25650.pos 14814 txt/../wrd/14814.wrd 14814 txt/../pos/14814.pos 22611 txt/../wrd/22611.wrd 22611 txt/../pos/22611.pos 14814 txt/../ent/14814.ent 22611 txt/../ent/22611.ent === file2bib.sh === id: 14814 author: Potter, Beatrix title: The Tale of Jemima Puddle-Duck date: pages: extension: .txt txt: ./txt/14814.txt cache: ./cache/14814.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'14814.txt' === file2bib.sh === id: 22611 author: Anonymous title: The Fox and the Geese; and The Wonderful History of Henny-Penny date: pages: extension: .txt txt: ./txt/22611.txt cache: ./cache/22611.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'22611.txt' 18667 txt/../pos/18667.pos 18667 txt/../wrd/18667.wrd 5955 txt/../wrd/5955.wrd 5955 txt/../pos/5955.pos 10337 txt/../wrd/10337.wrd 10337 txt/../pos/10337.pos 18667 txt/../ent/18667.ent === file2bib.sh === id: 5955 author: Bailey, Arthur Scott title: The Tale of Tommy Fox date: pages: extension: .txt txt: ./txt/5955.txt cache: ./cache/5955.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'5955.txt' 5955 txt/../ent/5955.ent 44347 txt/../pos/44347.pos === file2bib.sh === id: 18667 author: Hinkle, Thomas C. (Thomas Clark) title: Doctor Rabbit and Brushtail the Fox date: pages: extension: .txt txt: ./txt/18667.txt cache: ./cache/18667.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'18667.txt' 44347 txt/../wrd/44347.wrd 44347 txt/../ent/44347.ent 10337 txt/../ent/10337.ent === file2bib.sh === id: 10337 author: Garnett, David title: Lady into Fox date: pages: extension: .txt txt: ./txt/10337.txt cache: ./cache/10337.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'10337.txt' === file2bib.sh === id: 44347 author: Tregarthen, J. C. (John Coulson) title: Master Reynard: The History of a Fox date: pages: extension: .txt txt: ./txt/44347.txt cache: ./cache/44347.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'44347.txt' Done mapping. Reducing subject-foxes-gutenberg === reduce.pl bib === id = 18667 author = Hinkle, Thomas C. (Thomas Clark) title = Doctor Rabbit and Brushtail the Fox date = pages = extension = .txt mime = text/plain words = 16124 sentences = 1239 flesch = 93 summary = "He's Brushtail the Fox," Doctor Rabbit said. heard Chatty Squirrel scolding Brushtail the Fox. Doctor Rabbit, to Brushtail the Fox ran after Doctor Rabbit as fast as he could go, but That surely surprised Brushtail, but when he saw Doctor Rabbit's home When Brushtail slunk away through the bushes, Doctor Rabbit called to Doctor Rabbit did not see Brushtail the Fox again for several days. "Perhaps," thought Doctor Rabbit, "old Brushtail is in there right now While Doctor Rabbit was looking at Mrs. Brushtail she yawned, Doctor Rabbit thought to himself, "Mrs. Brushtail is going over to the Rabbit saw Mrs. Brushtail coming through the woods. As soon as Doctor Rabbit heard Farmer Roe coming through the woods he said Doctor Rabbit to himself, "is where Mr. and Mrs. Brushtail and Brushtail the Fox. That was one fine thing about Doctor Rabbit--he Then Doctor Rabbit saw his mistake, for when Brushtail the Fox heard cache = ./cache/18667.txt txt = ./txt/18667.txt === reduce.pl bib === id = 22611 author = Anonymous title = The Fox and the Geese; and The Wonderful History of Henny-Penny date = pages = extension = .txt mime = text/plain words = 2179 sentences = 197 flesch = 99 summary = THE FOX AND THE GEESE; AND THE WONDERFUL HISTORY OF HENNY-PENNY. "There's a Mr. Fox," said she, "that I know, Soon scented the goose near the pond; "'T was that villain the Fox," said good Mr. Drake, "O dear!" said the Fox, "I can't really tell "Many thanks for your news," said Ganderee, For of Reynard she felt much fear; "I'll hide you," she said, "in my nice new churn." "Where are you going to-day, Cocky-locky and Henny-penny?" So Ducky-daddles, and Cocky-locky, and Henny-penny, they gaed, and they So the Goose said,-"I will go with you, Ducky-daddles, Cocky-locky, and Henny-penny." So Goosie-poosie, and Ducky-daddles, and Cocky-locky, and Henny-penny, "Where are you going to-day, Goosie-poosie, Ducky-daddles, Cocky-locky, So Turkey-lurky, and Goosie-poosie, and Ducky-daddles, and Cocky-locky, "Oh, Mr. Fox, the clouds are falling, and we are going to tell And the Fox said,-THE FOX AND THE GEESE, 9 Illustrations, price 8 cts. cache = ./cache/22611.txt txt = ./txt/22611.txt === reduce.pl bib === id = 14814 author = Potter, Beatrix title = The Tale of Jemima Puddle-Duck date = pages = extension = .txt mime = text/plain words = 1377 sentences = 132 flesch = 88 summary = THE TALE OF JEMIMA PUDDLE-DUCK --Listen to the story of Jemima Puddle-duck, who was annoyed because the Jemima Puddle-duck. Jemima Puddle-duck became quite desperate. "Quack?" said Jemima Puddle-duck, with her head and her bonnet on one indeed!" said the gentleman with sandy whiskers, looking Jemima Puddle-duck was rather surprised to find such a vast quantity of When she came out, the sandy whiskered gentleman was sitting on a log Jemima Puddle-duck came every afternoon; she laid nine eggs in the nest. Where do you go every afternoon by yourself, Jemima Puddle-duck?" Jemima Puddle-duck went up the cart-road for the last time, on a sunny Jemima Puddle-duck had never heard him speak like Presently Kep opened the door of the shed, and let out Jemima Puddle-duck. Jemima Puddle-duck was escorted home in tears on account of those eggs. Jemima Puddle-duck said that it was because of her nerves; but she had cache = ./cache/14814.txt txt = ./txt/14814.txt === reduce.pl bib === === reduce.pl bib === id = 5955 author = Bailey, Arthur Scott title = The Tale of Tommy Fox date = pages = extension = .txt mime = text/plain words = 15983 sentences = 1282 flesch = 96 summary = When Tommy Fox discovered old Mother Grouse crouched beneath the of old Mother Grouse's relations for him to eat; and Tommy knew of Tommy Fox was hunting crickets in the field near his mother's house. When Mrs. Fox thought that Tommy had learned enough for that day they had brought home the live woodchuck, Tommy Fox went off into the woods Now, sly old Mother Grouse had played a trick on Tommy Fox. If he had _They_ knew what to do when their mother led Tommy Fox away. As Mr. Gray Squirrel watched, he thought he saw one of Tommy Fox's Tommy Fox went up into Farmer Green's back-pasture, which, lay even A few days after Tommy Fox caught old Mr. Woodchuck, something Green's hen-house," Mrs. Fox said to Tommy, as they picked the bones When Mrs. Fox reached home she found Tommy safe inside their house. cache = ./cache/5955.txt txt = ./txt/5955.txt === reduce.pl bib === id = 10337 author = Garnett, David title = Lady into Fox date = pages = extension = .txt mime = text/plain words = 24696 sentences = 1110 flesch = 83 summary = difficulty to my mind is that the metamorphosis occurred when Mrs. Tebrick was a full-grown woman, and that it happened suddenly in so husband and wife went for a walk in the copse on the little hill above door saw the poor fox dressed in my lady's little jacket lying back in Mr. Tebrick sat silently looking out of window for some time, then he Had the old woman come the day before it is likely enough that Mr. Tebrick would have sent her packing. Mr. Tebrick let his vixen out into the garden after breakfast, stayed old Nanny who kept wringing her hands and told them Mr. Tebrick's wife Mr. Tebrick looked at his wife again and spoke to her, calling her a up, and presently Mr. Tebrick saw his vixen come towards them. Silvia went running on a little before while Mr. Tebrick followed after cache = ./cache/10337.txt txt = ./txt/10337.txt === reduce.pl bib === id = 44347 author = Tregarthen, J. C. (John Coulson) title = Master Reynard: The History of a Fox date = pages = extension = .txt mime = text/plain words = 27872 sentences = 1251 flesch = 82 summary = There on the bare dry ground the vixen laid us--my two sisters and me. watching him, for his eyes often turned our way. time in our lives, by swimming crossed deep water. take me all my time to reach the earth before dawn, even by way of the When I reached the earth the vixen and my sisters were lying near the vixen disappeared round the corner of the long wall than I left my The only time I got in his way he turned his nervous face and snarled vixen and my little sister coming along the open bank of the stream, wing-beats of passing wild-fowl and, raising my eyes, saw the long on the open water, and at times a sound that was new to me, a wild These latter had for some time held their heads turned my way; so, cache = ./cache/44347.txt txt = ./txt/44347.txt Building ./etc/reader.txt 5955 18667 10337 18667 5955 44347 number of items: 7 sum of words: 88,231 average size in words: 14,705 average readability score: 90 nouns: time; way; fox; mother; eyes; night; day; tree; head; vixen; house; ground; dog; wife; water; thicket; something; woods; earth; nothing; place; morning; life; side; sight; thing; door; face; home; illustration; feet; hole; moment; times; snow; foot; foxes; days; creature; rabbit; man; friends; legs; hen; end; edge; noise; hounds; fish; field verbs: was; had; were; have; be; is; did; see; been; said; came; saw; made; do; get; went; thought; knew; go; are; come; looked; heard; got; found; ran; going; began; know; lay; find; let; kept; catch; think; seemed; has; took; looking; ''s; seen; sat; run; being; felt; left; say; tell; turned; reached adjectives: little; old; big; great; good; other; more; long; few; last; first; many; sure; new; poor; own; wild; white; dead; such; small; much; next; short; same; strange; several; least; safe; sharp; happy; afraid; open; surprised; hard; young; fine; close; better; hungry; cold; black; whole; terrible; full; dry; angry; able; true; strong adverbs: not; so; then; up; out; very; now; just; as; away; n''t; never; there; down; again; back; only; too; still; even; right; all; more; soon; once; off; enough; quite; indeed; over; far; ever; much; well; always; almost; here; first; on; in; home; yet; suddenly; most; before; along; presently; at; thus; pretty pronouns: he; i; his; it; her; she; him; my; you; they; me; them; we; our; their; himself; us; your; its; myself; herself; themselves; ourselves; itself; yourself; theirs; one; mine; ''s; thy; ours; hers; yours; thee; ''em proper nouns: tommy; rabbit; fox; doctor; brushtail; mr.; mrs.; tebrick; farmer; _; green; woodchuck; chatty; squirrel; roe; spot; silvia; grouse; mother; johnnie; yappy; cheepy; jemima; big; vixen; woods; jack; chipmunk; coon; ray; crow; gray; thomas; fen; red; puddle; orig; possum; locky; cork; murmuring; cocky; brook; stubby; ducky; o.; goose; god; turkey; solomon keywords: fox; mrs.; mr.; look; wife; way; water; vixen; tommy; time; tebrick; silvia; reach; rabbit; orig; night; illustration; henny; green; eye; earth; doctor; cork; brushtail one topic; one dimension: fox file(s): ./cache/22611.txt titles(s): The Fox and the Geese; and The Wonderful History of Henny-Penny three topics; one dimension: tebrick; tommy; rabbit file(s): ./cache/44347.txt, ./cache/5955.txt, ./cache/18667.txt titles(s): Master Reynard: The History of a Fox | The Tale of Tommy Fox | Doctor Rabbit and Brushtail the Fox five topics; three dimensions: tebrick vixen mr; rabbit brushtail doctor; tommy fox mother; said fox henny; loved bad determined file(s): ./cache/44347.txt, ./cache/18667.txt, ./cache/5955.txt, ./cache/22611.txt, titles(s): Master Reynard: The History of a Fox | Doctor Rabbit and Brushtail the Fox | The Tale of Tommy Fox | The Fox and the Geese; and The Wonderful History of Henny-Penny | All About the Little Small Red Hen Type: gutenberg title: subject-foxes-gutenberg date: 2021-06-06 time: 15:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Foxes" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 22611 author: Anonymous title: The Fox and the Geese; and The Wonderful History of Henny-Penny date: words: 2179.0 sentences: 197.0 pages: flesch: 99.0 cache: ./cache/22611.txt txt: ./txt/22611.txt summary: THE FOX AND THE GEESE; AND THE WONDERFUL HISTORY OF HENNY-PENNY. "There''s a Mr. Fox," said she, "that I know, Soon scented the goose near the pond; "''T was that villain the Fox," said good Mr. Drake, "O dear!" said the Fox, "I can''t really tell "Many thanks for your news," said Ganderee, For of Reynard she felt much fear; "I''ll hide you," she said, "in my nice new churn." "Where are you going to-day, Cocky-locky and Henny-penny?" So Ducky-daddles, and Cocky-locky, and Henny-penny, they gaed, and they So the Goose said,-"I will go with you, Ducky-daddles, Cocky-locky, and Henny-penny." So Goosie-poosie, and Ducky-daddles, and Cocky-locky, and Henny-penny, "Where are you going to-day, Goosie-poosie, Ducky-daddles, Cocky-locky, So Turkey-lurky, and Goosie-poosie, and Ducky-daddles, and Cocky-locky, "Oh, Mr. Fox, the clouds are falling, and we are going to tell And the Fox said,-THE FOX AND THE GEESE, 9 Illustrations, price 8 cts. id: 25650 author: Anonymous title: All About the Little Small Red Hen date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 5955 author: Bailey, Arthur Scott title: The Tale of Tommy Fox date: words: 15983.0 sentences: 1282.0 pages: flesch: 96.0 cache: ./cache/5955.txt txt: ./txt/5955.txt summary: When Tommy Fox discovered old Mother Grouse crouched beneath the of old Mother Grouse''s relations for him to eat; and Tommy knew of Tommy Fox was hunting crickets in the field near his mother''s house. When Mrs. Fox thought that Tommy had learned enough for that day they had brought home the live woodchuck, Tommy Fox went off into the woods Now, sly old Mother Grouse had played a trick on Tommy Fox. If he had _They_ knew what to do when their mother led Tommy Fox away. As Mr. Gray Squirrel watched, he thought he saw one of Tommy Fox''s Tommy Fox went up into Farmer Green''s back-pasture, which, lay even A few days after Tommy Fox caught old Mr. Woodchuck, something Green''s hen-house," Mrs. Fox said to Tommy, as they picked the bones When Mrs. Fox reached home she found Tommy safe inside their house. id: 10337 author: Garnett, David title: Lady into Fox date: words: 24696.0 sentences: 1110.0 pages: flesch: 83.0 cache: ./cache/10337.txt txt: ./txt/10337.txt summary: difficulty to my mind is that the metamorphosis occurred when Mrs. Tebrick was a full-grown woman, and that it happened suddenly in so husband and wife went for a walk in the copse on the little hill above door saw the poor fox dressed in my lady''s little jacket lying back in Mr. Tebrick sat silently looking out of window for some time, then he Had the old woman come the day before it is likely enough that Mr. Tebrick would have sent her packing. Mr. Tebrick let his vixen out into the garden after breakfast, stayed old Nanny who kept wringing her hands and told them Mr. Tebrick''s wife Mr. Tebrick looked at his wife again and spoke to her, calling her a up, and presently Mr. Tebrick saw his vixen come towards them. Silvia went running on a little before while Mr. Tebrick followed after id: 18667 author: Hinkle, Thomas C. (Thomas Clark) title: Doctor Rabbit and Brushtail the Fox date: words: 16124.0 sentences: 1239.0 pages: flesch: 93.0 cache: ./cache/18667.txt txt: ./txt/18667.txt summary: "He''s Brushtail the Fox," Doctor Rabbit said. heard Chatty Squirrel scolding Brushtail the Fox. Doctor Rabbit, to Brushtail the Fox ran after Doctor Rabbit as fast as he could go, but That surely surprised Brushtail, but when he saw Doctor Rabbit''s home When Brushtail slunk away through the bushes, Doctor Rabbit called to Doctor Rabbit did not see Brushtail the Fox again for several days. "Perhaps," thought Doctor Rabbit, "old Brushtail is in there right now While Doctor Rabbit was looking at Mrs. Brushtail she yawned, Doctor Rabbit thought to himself, "Mrs. Brushtail is going over to the Rabbit saw Mrs. Brushtail coming through the woods. As soon as Doctor Rabbit heard Farmer Roe coming through the woods he said Doctor Rabbit to himself, "is where Mr. and Mrs. Brushtail and Brushtail the Fox. That was one fine thing about Doctor Rabbit--he Then Doctor Rabbit saw his mistake, for when Brushtail the Fox heard id: 14814 author: Potter, Beatrix title: The Tale of Jemima Puddle-Duck date: words: 1377.0 sentences: 132.0 pages: flesch: 88.0 cache: ./cache/14814.txt txt: ./txt/14814.txt summary: THE TALE OF JEMIMA PUDDLE-DUCK --Listen to the story of Jemima Puddle-duck, who was annoyed because the Jemima Puddle-duck. Jemima Puddle-duck became quite desperate. "Quack?" said Jemima Puddle-duck, with her head and her bonnet on one indeed!" said the gentleman with sandy whiskers, looking Jemima Puddle-duck was rather surprised to find such a vast quantity of When she came out, the sandy whiskered gentleman was sitting on a log Jemima Puddle-duck came every afternoon; she laid nine eggs in the nest. Where do you go every afternoon by yourself, Jemima Puddle-duck?" Jemima Puddle-duck went up the cart-road for the last time, on a sunny Jemima Puddle-duck had never heard him speak like Presently Kep opened the door of the shed, and let out Jemima Puddle-duck. Jemima Puddle-duck was escorted home in tears on account of those eggs. Jemima Puddle-duck said that it was because of her nerves; but she had id: 44347 author: Tregarthen, J. C. (John Coulson) title: Master Reynard: The History of a Fox date: words: 27872.0 sentences: 1251.0 pages: flesch: 82.0 cache: ./cache/44347.txt txt: ./txt/44347.txt summary: There on the bare dry ground the vixen laid us--my two sisters and me. watching him, for his eyes often turned our way. time in our lives, by swimming crossed deep water. take me all my time to reach the earth before dawn, even by way of the When I reached the earth the vixen and my sisters were lying near the vixen disappeared round the corner of the long wall than I left my The only time I got in his way he turned his nervous face and snarled vixen and my little sister coming along the open bank of the stream, wing-beats of passing wild-fowl and, raising my eyes, saw the long on the open water, and at times a sound that was new to me, a wild These latter had for some time held their heads turned my way; so, ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel