mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named twain-from-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/19484.txt inflating: ./tmp/input/input-file/2431.txt inflating: ./tmp/input/input-file/2572.txt inflating: ./tmp/input/input-file/1892.txt inflating: ./tmp/input/input-file/1213.txt inflating: ./tmp/input/input-file/7556.txt inflating: ./tmp/input/input-file/32325.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === updating bibliographic database Building study carrel named twain-from-gutenberg FILE: cache/2572.txt OUTPUT: txt/2572.txt FILE: cache/19484.txt OUTPUT: txt/19484.txt FILE: cache/7556.txt OUTPUT: txt/7556.txt FILE: cache/2431.txt OUTPUT: txt/2431.txt FILE: cache/1213.txt OUTPUT: txt/1213.txt FILE: cache/1892.txt OUTPUT: txt/1892.txt FILE: cache/32325.txt OUTPUT: txt/32325.txt 2572 txt/../pos/2572.pos 7556 txt/../ent/7556.ent 2572 txt/../ent/2572.ent 7556 txt/../pos/7556.pos 2572 txt/../wrd/2572.wrd 7556 txt/../wrd/7556.wrd 1892 txt/../pos/1892.pos 1892 txt/../wrd/1892.wrd === file2bib.sh === id: 2572 author: Twain, Mark title: On the Decay of the Art of Lying date: pages: extension: .txt txt: ./txt/2572.txt cache: ./cache/2572.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'2572.txt' === file2bib.sh === id: 7556 author: Twain, Mark title: Quotes and Images From The Works of Mark Twain date: pages: extension: .txt txt: ./txt/7556.txt cache: ./cache/7556.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'7556.txt' 1892 txt/../ent/1892.ent === file2bib.sh === id: 1892 author: Twain, Mark title: Extracts from Adam's Diary, translated from the original ms. date: pages: extension: .txt txt: ./txt/1892.txt cache: ./cache/1892.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'1892.txt' 19484 txt/../pos/19484.pos 19484 txt/../wrd/19484.wrd 19484 txt/../ent/19484.ent === file2bib.sh === id: 19484 author: Twain, Mark title: Editorial Wild Oats date: pages: extension: .txt txt: ./txt/19484.txt cache: ./cache/19484.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'19484.txt' 1213 txt/../pos/1213.pos 1213 txt/../wrd/1213.wrd 2431 txt/../pos/2431.pos 2431 txt/../wrd/2431.wrd 2431 txt/../ent/2431.ent 1213 txt/../ent/1213.ent === file2bib.sh === id: 1213 author: Twain, Mark title: The Man That Corrupted Hadleyburg date: pages: extension: .txt txt: ./txt/1213.txt cache: ./cache/1213.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'1213.txt' === file2bib.sh === id: 2431 author: Twain, Mark title: Is Shakespeare Dead? From My Autobiography date: pages: extension: .txt txt: ./txt/2431.txt cache: ./cache/2431.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'2431.txt' 32325 txt/../pos/32325.pos 32325 txt/../wrd/32325.wrd 32325 txt/../ent/32325.ent === file2bib.sh === id: 32325 author: Twain, Mark title: The Adventures of Huckleberry Finn (Tom Sawyer's Comrade) date: pages: extension: .txt txt: ./txt/32325.txt cache: ./cache/32325.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'32325.txt' Done mapping. Reducing twain-from-gutenberg === reduce.pl bib === id = 19484 author = Twain, Mark title = Editorial Wild Oats date = pages = extension = .txt mime = text/plain words = 10021 sentences = 632 flesch = 81 summary = and on a lucky summer's day he left town to be gone a week, and The paper came out, and I never knew any little thing attract so "That stove is utterly ruined," said the chief editor. The chief said: "That was the Colonel, likely. "I am the boss," said the editor, following this curious bit of "Don't want anybody fur to learn the business, 'tain't likely?" "Do you think you would like to learn the printing business?" already gone to press, but knowing that our friend would consider The regular editor of the paper was going off for a with his handkerchief, he said, "Are you the new editor?" I first read it this morning, I said to myself, I never, never I said I could make your paper of interest to read the paper instantly.[1] However, Cæsar shook him off, and Cæsar saw his old friend Brutus step forward armed with a cache = ./cache/19484.txt txt = ./txt/19484.txt === reduce.pl bib === id = 1213 author = Twain, Mark title = The Man That Corrupted Hadleyburg date = pages = extension = .txt mime = text/plain words = 18361 sentences = 1440 flesch = 89 summary = for no stranger would trust such a thing to any town but Hadleyburg, and "Mary, maybe the stranger knows him better than this village does." "Mary, Burgess is not a bad man." and guessed that the late Goodson was the only man in the town who could Time-table for Brixton and all the towns beyond changed today, sir--had to get the papers in twenty minutes earlier than common. "But, Mary, you know how we have been trained all our lives long, like money-sack, and wondering if the right man would be found, and hoping make dashing free-hand pictures of the sack, and of Richards's house, and Meantime Mary had spent six thousand dollars on a new house for herself "What I was going to say is this: We know your good heart, Mr. Richards, man whom Hadleyburg delights to honour--Edward Richards." "Very good." Then the stranger got up and said to the house: cache = ./cache/1213.txt txt = ./txt/1213.txt === reduce.pl bib === id = 2572 author = Twain, Mark title = On the Decay of the Art of Lying date = pages = extension = .txt mime = text/plain words = 2286 sentences = 129 flesch = 78 summary = time of need, the fourth Grace, the tenth Muse, man's best and surest lie is often as ineffectual as the truth. with an habitual truth-teller; but thank goodness none of us has to. voice, saying, "We made sixteen calls and found fourteen of them out" I think that all this courteous lying is a sweet and loving art, and injurious truth lest his soul be not saved if he do otherwise, should An injurious lie is an uncommendable thing; and so, also, and in the matter and said, "I have made a rule of my life to never tell a lie; and hospital people sent to you by the hand of the sick-nurse when she came fault to find in that matter." She said, "Oh, was that a lie? been cruel." I said, "One ought always to lie, when one can do good by She could have said, "In one respect this sick-nurse is perfection--when cache = ./cache/2572.txt txt = ./txt/2572.txt === reduce.pl bib === id = 32325 author = Twain, Mark title = The Adventures of Huckleberry Finn (Tom Sawyer's Comrade) date = pages = extension = .txt mime = text/plain words = 116074 sentences = 8386 flesch = 98 summary = Niggers would come miles to hear Jim tell about it, and he was more Well, I got a good going-over in the morning from old Miss Watson on the dollar I got from the judge.) I said it was pretty bad money, but that had just come, and he didn't know the old man; so he said courts When he got out the new judge said he was a-going to make a man of coming all the time; but I got her hid; and then I out and looked went to bed; there ain't no better way to put in time when you are had as good as helped to run away, coming right out flat-footed and "No," says the old man, "I reckon there ain't going to be any; and you "Why, Tom Sawyer, how you talk," I says; "Jim ain't got no use for a cache = ./cache/32325.txt txt = ./txt/32325.txt === reduce.pl bib === id = 1892 author = Twain, Mark title = Extracts from Adam's Diary, translated from the original ms. date = pages = extension = .txt mime = text/plain words = 4446 sentences = 301 flesch = 90 summary = This new creature with the long hair is a good deal in the way. The new creature calls it Niagara Falls--why, Says it looks like Niagara Falls. same pretext is offered--it looks like the thing. The new creature says it is all woods and new creature trying to clod apples out of that forbidden tree. The new creature says its name is Eve. That is all right, I have I escaped last Tuesday night, and travelled two days, and built she has tamed and calls a wolf, and came making that pitiful noise among others, trying to study out why the animals called lions and Tonawanda--says it looks like that. thing, she says it is ordered that we work for our living hereafter. that it is a different and new kind of animal--a fish, perhaps, tail, sufficiently indicates that this is a new kind of bear. cache = ./cache/1892.txt txt = ./txt/1892.txt === reduce.pl bib === id = 7556 author = Twain, Mark title = Quotes and Images From The Works of Mark Twain date = pages = extension = .txt mime = text/plain words = 3229 sentences = 334 flesch = 83 summary = The man with a new idea is a Crank Wasn't worth a cent two years ago, and If the man doesn't believe as we do, we say he is a crank Natural desire to have more of a good thing than he needs The man with a new idea is a Crank until the idea succeeds Tourists showing how things ought to be managed I had a delicacy about going home and getting thrashed Room to turn around in, but not to swing a cat We all like to see people seasick when we are not, ourselves List of things which we had seen and some other people had not Money is most difficult to get when people need it most Very pleasant man if you were not in his way Women always want to know what is going on Dead people who go through the motions of life cache = ./cache/7556.txt txt = ./txt/7556.txt === reduce.pl bib === id = 2431 author = Twain, Mark title = Is Shakespeare Dead? From My Autobiography date = pages = extension = .txt mime = text/plain words = 21643 sentences = 1114 flesch = 75 summary = couldn't have written Shakespeare's works, for the reason that the man happened to Shakespeare_, so far as anybody knows. literary folk of Shakespeare's time passed from life! So far as any one _knows and can prove_, Shakespeare of Stratford wrote Stratford from the time he was seven years old till he was thirteen. important fact, of Shakespeare's life in Stratford. the only play--ain't it?--that the Stratford Shakespeare ever wrote; and The next addition to the young Shakespeare's Stratford history comes recollections of Shakespeare-Bacon talk abide with me--his law-equipment. times in Shakespeare's thirty-four plays, and only in one single instance Shakespeare uses his law just as freely in his first plays, written in quite convinces me that the man who wrote Shakespeare's Works knew all Since the Stratford Shakespeare couldn't have written the Works, we infer history: a thing which cannot be done for the Stratford Shakespeare, for cache = ./cache/2431.txt txt = ./txt/2431.txt Building ./etc/reader.txt 32325 1213 2431 32325 19484 1213 number of items: 7 sum of words: 176,060 average size in words: 25,151 average readability score: 84 nouns: time; way; man; nothing; thing; people; day; night; town; things; king; place; head; one; house; river; nigger; money; everybody; anything; years; something; duke; raft; men; kind; hand; nobody; minute; hands; name; life; side; water; trouble; bed; door; everything; anybody; dollars; world; mile; law; word; days; paper; mind; times; woods; rest verbs: was; is; do; had; ''s; got; says; be; did; said; have; see; come; get; know; go; went; been; ai; made; done; say; going; are; make; tell; take; let; think; has; took; want; were; put; told; give; set; ''ve; reckon; found; look; keep; read; gone; find; wanted; looked; does; being; heard adjectives: good; old; other; little; more; right; long; last; same; big; first; many; much; next; young; dead; new; poor; own; such; whole; great; glad; best; bad; full; better; ready; most; legal; easy; free; high; sick; open; considerable; white; only; dark; worth; asleep; low; mighty; awful; rich; different; comfortable; black; satisfied; safe adverbs: n''t; so; up; then; out; not; down; now; there; just; never; all; ever; again; too; in; off; here; as; away; on; only; back; around; right; along; pretty; over; most; very; always; about; more; still; soon; enough; well; long; yet; of; maybe; before; better; first; even; no; far; much; once; by pronouns: i; it; he; you; we; his; they; me; him; she; them; my; her; your; their; us; our; its; myself; himself; ''em; herself; yourself; itself; themselves; ourselves; one; mine; yt; ours; em; yours; thy; ''s; yourselves; you''ll; i''m; hers; you?--that; you?--boat; yonder!--up; yo''self; yit; ye?--i; uv; theirselves; theirs; thee; that_--you; sho proper nouns: _; jim; tom; shakespeare; de; mary; mr.; dat; huck; dey; miss; aunt; stratford; richards; sawyer; sally; jane; edward; buck; ben; gwyne; burgess; bacon; lord; goodson; william; hadleyburg; chair; t''other; sid; nigger; finn; wilson; uncle; london; watson; silas; mars; mark; cæsar; duke; sunday; pap; billson; peter; new; george; england; chapter; mrs. keywords: mr.; time; mary; man; good; yes; year; work; watson; truth; tom; tell; stratford; silas; sid; shakespeare; sawyer; sally; right; richards; people; penzance; paper; nicodemus; new; miss; lord; look; london; like; lie; law; jim; jane; illustration; huck; hadleyburg; goodson; falls; edward; editor; cæsar; claimant; chapter; chair; burgess; buck; brutus; bacon; aunt one topic; one dimension: got file(s): ./cache/19484.txt titles(s): Editorial Wild Oats three topics; one dimension: says; said; shakespeare file(s): ./cache/32325.txt, ./cache/1213.txt, ./cache/2431.txt titles(s): The Adventures of Huckleberry Finn (Tom Sawyer''s Comrade) | The Man That Corrupted Hadleyburg | Is Shakespeare Dead? From My Autobiography five topics; three dimensions: says got said; said man know; shakespeare years law; said paper cæsar; hearty _i attitude file(s): ./cache/32325.txt, ./cache/1213.txt, ./cache/2431.txt, ./cache/19484.txt, ./cache/2572.txt titles(s): The Adventures of Huckleberry Finn (Tom Sawyer''s Comrade) | The Man That Corrupted Hadleyburg | Is Shakespeare Dead? From My Autobiography | Editorial Wild Oats | On the Decay of the Art of Lying Type: gutenberg title: twain-from-gutenberg date: 2021-01-08 time: 20:37 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: author:"Twain, Mark" NOT title:index NOT title:gutenberg NOT title:part NOT title:volume NOT title:chapters ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 19484 author: Twain, Mark title: Editorial Wild Oats date: words: 10021 sentences: 632 pages: flesch: 81 cache: ./cache/19484.txt txt: ./txt/19484.txt summary: and on a lucky summer''s day he left town to be gone a week, and The paper came out, and I never knew any little thing attract so "That stove is utterly ruined," said the chief editor. The chief said: "That was the Colonel, likely. "I am the boss," said the editor, following this curious bit of "Don''t want anybody fur to learn the business, ''tain''t likely?" "Do you think you would like to learn the printing business?" already gone to press, but knowing that our friend would consider The regular editor of the paper was going off for a with his handkerchief, he said, "Are you the new editor?" I first read it this morning, I said to myself, I never, never I said I could make your paper of interest to read the paper instantly.[1] However, Cæsar shook him off, and Cæsar saw his old friend Brutus step forward armed with a id: 2431 author: Twain, Mark title: Is Shakespeare Dead? From My Autobiography date: words: 21643 sentences: 1114 pages: flesch: 75 cache: ./cache/2431.txt txt: ./txt/2431.txt summary: couldn''t have written Shakespeare''s works, for the reason that the man happened to Shakespeare_, so far as anybody knows. literary folk of Shakespeare''s time passed from life! So far as any one _knows and can prove_, Shakespeare of Stratford wrote Stratford from the time he was seven years old till he was thirteen. important fact, of Shakespeare''s life in Stratford. the only play--ain''t it?--that the Stratford Shakespeare ever wrote; and The next addition to the young Shakespeare''s Stratford history comes recollections of Shakespeare-Bacon talk abide with me--his law-equipment. times in Shakespeare''s thirty-four plays, and only in one single instance Shakespeare uses his law just as freely in his first plays, written in quite convinces me that the man who wrote Shakespeare''s Works knew all Since the Stratford Shakespeare couldn''t have written the Works, we infer history: a thing which cannot be done for the Stratford Shakespeare, for id: 2572 author: Twain, Mark title: On the Decay of the Art of Lying date: words: 2286 sentences: 129 pages: flesch: 78 cache: ./cache/2572.txt txt: ./txt/2572.txt summary: time of need, the fourth Grace, the tenth Muse, man''s best and surest lie is often as ineffectual as the truth. with an habitual truth-teller; but thank goodness none of us has to. voice, saying, "We made sixteen calls and found fourteen of them out" I think that all this courteous lying is a sweet and loving art, and injurious truth lest his soul be not saved if he do otherwise, should An injurious lie is an uncommendable thing; and so, also, and in the matter and said, "I have made a rule of my life to never tell a lie; and hospital people sent to you by the hand of the sick-nurse when she came fault to find in that matter." She said, "Oh, was that a lie? been cruel." I said, "One ought always to lie, when one can do good by She could have said, "In one respect this sick-nurse is perfection--when id: 1892 author: Twain, Mark title: Extracts from Adam''s Diary, translated from the original ms. date: words: 4446 sentences: 301 pages: flesch: 90 cache: ./cache/1892.txt txt: ./txt/1892.txt summary: This new creature with the long hair is a good deal in the way. The new creature calls it Niagara Falls--why, Says it looks like Niagara Falls. same pretext is offered--it looks like the thing. The new creature says it is all woods and new creature trying to clod apples out of that forbidden tree. The new creature says its name is Eve. That is all right, I have I escaped last Tuesday night, and travelled two days, and built she has tamed and calls a wolf, and came making that pitiful noise among others, trying to study out why the animals called lions and Tonawanda--says it looks like that. thing, she says it is ordered that we work for our living hereafter. that it is a different and new kind of animal--a fish, perhaps, tail, sufficiently indicates that this is a new kind of bear. id: 1213 author: Twain, Mark title: The Man That Corrupted Hadleyburg date: words: 18361 sentences: 1440 pages: flesch: 89 cache: ./cache/1213.txt txt: ./txt/1213.txt summary: for no stranger would trust such a thing to any town but Hadleyburg, and "Mary, maybe the stranger knows him better than this village does." "Mary, Burgess is not a bad man." and guessed that the late Goodson was the only man in the town who could Time-table for Brixton and all the towns beyond changed today, sir--had to get the papers in twenty minutes earlier than common. "But, Mary, you know how we have been trained all our lives long, like money-sack, and wondering if the right man would be found, and hoping make dashing free-hand pictures of the sack, and of Richards''s house, and Meantime Mary had spent six thousand dollars on a new house for herself "What I was going to say is this: We know your good heart, Mr. Richards, man whom Hadleyburg delights to honour--Edward Richards." "Very good." Then the stranger got up and said to the house: id: 7556 author: Twain, Mark title: Quotes and Images From The Works of Mark Twain date: words: 3229 sentences: 334 pages: flesch: 83 cache: ./cache/7556.txt txt: ./txt/7556.txt summary: The man with a new idea is a Crank Wasn''t worth a cent two years ago, and If the man doesn''t believe as we do, we say he is a crank Natural desire to have more of a good thing than he needs The man with a new idea is a Crank until the idea succeeds Tourists showing how things ought to be managed I had a delicacy about going home and getting thrashed Room to turn around in, but not to swing a cat We all like to see people seasick when we are not, ourselves List of things which we had seen and some other people had not Money is most difficult to get when people need it most Very pleasant man if you were not in his way Women always want to know what is going on Dead people who go through the motions of life id: 32325 author: Twain, Mark title: The Adventures of Huckleberry Finn (Tom Sawyer''s Comrade) date: words: 116074 sentences: 8386 pages: flesch: 98 cache: ./cache/32325.txt txt: ./txt/32325.txt summary: Niggers would come miles to hear Jim tell about it, and he was more Well, I got a good going-over in the morning from old Miss Watson on the dollar I got from the judge.) I said it was pretty bad money, but that had just come, and he didn''t know the old man; so he said courts When he got out the new judge said he was a-going to make a man of coming all the time; but I got her hid; and then I out and looked went to bed; there ain''t no better way to put in time when you are had as good as helped to run away, coming right out flat-footed and "No," says the old man, "I reckon there ain''t going to be any; and you "Why, Tom Sawyer, how you talk," I says; "Jim ain''t got no use for a ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel