mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-fraud-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/21043.txt inflating: ./tmp/input/input-file/19802.txt inflating: ./tmp/input/input-file/29582.txt inflating: ./tmp/input/input-file/24544.txt inflating: ./tmp/input/input-file/34942.txt inflating: ./tmp/input/input-file/42125.txt inflating: ./tmp/input/input-file/56602.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-fraud-gutenberg FILE: cache/19802.txt OUTPUT: txt/19802.txt FILE: cache/56602.txt OUTPUT: txt/56602.txt FILE: cache/42125.txt OUTPUT: txt/42125.txt FILE: cache/21043.txt OUTPUT: txt/21043.txt FILE: cache/24544.txt OUTPUT: txt/24544.txt FILE: cache/34942.txt OUTPUT: txt/34942.txt FILE: cache/29582.txt OUTPUT: txt/29582.txt === file2bib.sh === id: 24544 author: Optic, Oliver title: Desk and Debit; or, The Catastrophes of a Clerk date: pages: extension: .txt txt: ./txt/24544.txt cache: ./cache/24544.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'24544.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 24544 txt/../pos/24544.pos 24544 txt/../wrd/24544.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 24544 txt/../ent/24544.ent 29582 txt/../pos/29582.pos 29582 txt/../ent/29582.ent 29582 txt/../wrd/29582.wrd === file2bib.sh === id: 29582 author: Thomson, John, active 1732 title: The Tricks of the Town: or, Ways and Means of getting Money date: pages: extension: .txt txt: ./txt/29582.txt cache: ./cache/29582.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'29582.txt' 56602 txt/../wrd/56602.wrd 56602 txt/../pos/56602.pos 34942 txt/../pos/34942.pos 34942 txt/../wrd/34942.wrd 34942 txt/../ent/34942.ent 21043 txt/../wrd/21043.wrd 19802 txt/../pos/19802.pos 56602 txt/../ent/56602.ent 21043 txt/../pos/21043.pos 19802 txt/../wrd/19802.wrd === file2bib.sh === id: 56602 author: Alger, Horatio, Jr. title: Frank Hunter's Peril date: pages: extension: .txt txt: ./txt/56602.txt cache: ./cache/56602.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'56602.txt' 21043 txt/../ent/21043.ent === file2bib.sh === id: 34942 author: Newman, John title: Scamping Tricks and Odd Knowledge Occasionally Practised upon Public Works date: pages: extension: .txt txt: ./txt/34942.txt cache: ./cache/34942.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 3 resourceName b'34942.txt' 42125 txt/../wrd/42125.wrd 42125 txt/../pos/42125.pos 19802 txt/../ent/19802.ent 42125 txt/../ent/42125.ent === file2bib.sh === id: 21043 author: Reed, Talbot Baines title: Reginald Cruden A Tale of City Life date: pages: extension: .txt txt: ./txt/21043.txt cache: ./cache/21043.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'21043.txt' === file2bib.sh === id: 19802 author: Stretton, Hesba title: Cobwebs and Cables date: pages: extension: .txt txt: ./txt/19802.txt cache: ./cache/19802.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'19802.txt' === file2bib.sh === id: 42125 author: Besant, Walter title: Armorel of Lyonesse: A Romance of To-day date: pages: extension: .txt txt: ./txt/42125.txt cache: ./cache/42125.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 9 resourceName b'42125.txt' Done mapping. Reducing subject-fraud-gutenberg === reduce.pl bib === id = 19802 author = Stretton, Hesba title = Cobwebs and Cables date = pages = extension = .txt mime = text/plain words = 116427 sentences = 6497 flesch = 84 summary = years old to-day; and when I'm a man I'm going to be a pastor, like "But she knows where Mr. Sefton is," answered Phebe, "and we must ask "Phebe Marlowe!" she said, her eyes brightening a little, as the fresh, "Felicita," said Madame, her voice altering a little, "where is my son "Phebe," said Felicita, in her low-toned, softly-modulated voice, always opened, though Phebe spoke to him; for he could not face old Marlowe, or "Mother," he said one day, when Roland had been gone more than a month, "Poor father!" said Phebe aloud, with a little sob. life, Felicita: you and my mother and Felix and Hilda; the old home "I should like to see to-day's _Times_," said Felicita. "I worship my mother still," said Felix one day to Phebe, "but I feel "Canon Pascal said to me," answered Phebe, "that your noble life and the cache = ./cache/19802.txt txt = ./txt/19802.txt === reduce.pl bib === id = 21043 author = Reed, Talbot Baines title = Reginald Cruden A Tale of City Life date = pages = extension = .txt mime = text/plain words = 93848 sentences = 6357 flesch = 87 summary = "Well," said Reginald laughing, "I can hardly fancy Horace the head of The boys walked for some time in silence; then Horace said,-"We want to see the manager," said Reginald, offended at the man's tone, Mr Durfy mused for some time, then, turning to Reginald, he said,-"My poor boy!" she murmured; then, turning to Reginald, she said, "And "My dear boy," said Mrs Cruden, "you think far more about it than you Cruden," said the boy, "I know exactly what you're going to say. "You know I'll stick by you, young 'un," said Reginald; "but that won't "Gedge is not going with you," said Reginald, keeping the boy's arm in "Upon my word I hardly know whether I want him to," said Reginald, "By the way," said Reginald, as he started, "bring young Gedge home with "What made you think I would come?" said Reginald, looking down with cache = ./cache/21043.txt txt = ./txt/21043.txt === reduce.pl bib === id = 29582 author = Thomson, John, active 1732 title = The Tricks of the Town: or, Ways and Means of getting Money date = pages = extension = .txt mime = text/plain words = 17814 sentences = 700 flesch = 71 summary = Hands it was done; and the Lady is teaz'd almost to death with People proper time for _setting_ them is generally soon after Seven in the assist the People, he got clear off with two or three blind old Women patience, I paid, and went to my Friend's House, about twenty Doors Years, having laid hands on a good number of Acres, and got an Goods, to her Husband's House, naming a very eminent Surgeon at St. _James's_. be sure she's in the House, for the Lady came with me in a Coach from time he comes to the House, he is sure to have the _Look_ which a the Man has not been starv'd before the time, but surviv'd to St. _Stephen_'s Day, and seen his wonderful Prediction happen and come to a good number of them, but it would give him a great deal of Trouble cache = ./cache/29582.txt txt = ./txt/29582.txt === reduce.pl bib === === reduce.pl bib === id = 42125 author = Besant, Walter title = Armorel of Lyonesse: A Romance of To-day date = pages = extension = .txt mime = text/plain words = 160491 sentences = 13421 flesch = 90 summary = what things Armorel did and how she looked on this day? Armorel plays the fiddle and makes the old lady 'A long time ago,' Armorel went on, 'these islands formed part of the 'Roland Lee,' said the girl, 'you are talking like your friend Dick 'One day last year,' said Armorel--'it was in July, after a fortnight but little to make a young man open his heart to a girl; only a pair 'There was an old allegory, Armorel,' this young man went on, 'of a When you come to stand before a great picture, Armorel, perhaps you 'She has trained her eye, and knows good work,' Armorel repeated. 'I will play if you like,' said Armorel, simply. 'I did not think that Alec was that kind of man,' said Philippa, still 'I have come to ask a favour,' said Armorel, taking the hand that was cache = ./cache/42125.txt txt = ./txt/42125.txt === reduce.pl bib === id = 34942 author = Newman, John title = Scamping Tricks and Odd Knowledge Occasionally Practised upon Public Works date = pages = extension = .txt mime = text/plain words = 63900 sentences = 4282 flesch = 86 summary = known screw piles to penetrate hard and dense sand, gravel, soft sandy "I have seen piles screwed into a kind of clay rock seam, the end of We were working two triangles of screw piles I thought lovely, and like disc piles better for sand, those that sink by water-pressure I any cast-iron screw piles that are less than half an inch in thickness. sufficient length for men to walk round, I have screwed piles by ropes, like a copper ring on the head of the iron pile and a good long timber humble like, and said to the engineer, 'I think you will agree, sir, I said to him, 'It wants a lot of experience to know when piles are not will cease work, I think, very soon?' 'They will,' said the engineer. 'extra' profit string of my brain worked right, and I pointed and said, cache = ./cache/34942.txt txt = ./txt/34942.txt === reduce.pl bib === id = 56602 author = Alger, Horatio, Jr. title = Frank Hunter's Peril date = pages = extension = .txt mime = text/plain words = 52355 sentences = 4775 flesch = 92 summary = "Seems to me he has a good deal of business with mother," Frank said "I am afraid Frank won't like the idea of my marrying again," said Mrs. Hunter, anxiously. "He takes it very well," thought Frank, as Mr. Craven said good-night. "Good morning, sir," said Frank, for the first time noticing the "I thought perhaps I ought to save up the surplus for Frank," said Mrs. Craven, hesitating. "You--you don't think he is likely to be taken away?" said Mrs. Craven, "Do you want Mr. Craven to be guardian with you, mother?" asked Frank, "Frank," said Mr. Craven, "this is my friend, Colonel Sharpley. "He seems a little so," said Frank; "but I hope, Mr. Tarbox, you won't "I care very little what Mr. Craven would like," said Frank. "I think we'll go now, Frank," said Sharpley. "Then," said Mrs. Craven, "Frank may be alive." cache = ./cache/56602.txt txt = ./txt/56602.txt Building ./etc/reader.txt 42125 19802 21043 19802 21043 56602 number of items: 7 sum of words: 504,835 average size in words: 84,139 average readability score: 85 nouns: man; time; day; nothing; way; face; mother; boy; work; one; eyes; life; girl; room; father; money; place; name; hand; things; years; men; night; thing; something; heart; world; people; head; anything; mind; voice; door; days; house; home; feet; morning; woman; hands; evening; friend; sea; moment; piles; business; children; water; words; letter verbs: was; had; is; be; have; said; do; are; were; been; know; did; ''s; has; see; go; think; come; say; made; am; tell; make; get; knew; went; take; came; let; got; done; looked; thought; going; found; asked; put; give; find; being; left; told; look; took; seemed; like; want; gone; heard; does adjectives: old; little; good; other; own; more; young; great; last; much; few; many; same; poor; first; long; such; new; dear; right; full; best; better; dead; sure; true; small; next; short; low; least; whole; happy; quiet; able; afraid; dark; white; possible; certain; large; bad; strange; beautiful; glad; rich; only; strong; most; ready adverbs: not; so; n''t; up; then; now; out; very; never; as; only; here; down; again; more; well; too; all; even; away; back; there; always; still; just; on; once; ever; in; off; much; perhaps; yet; quite; long; most; over; soon; enough; almost; really; far; at; also; indeed; no; rather; first; together; else pronouns: i; he; it; you; his; her; she; him; they; me; my; we; them; your; their; himself; us; its; our; herself; myself; one; yourself; themselves; itself; yours; mine; hers; ourselves; ''em; ''s; em; ay; thy; theirs; hisself; oneself; yourselves; ye; ours; you''re; you''ll; yit; yesterday----; wrong----; whosoever; whispered,--; whether----; us''d; unsympathetic--''you proper nouns: _; mr.; armorel; reginald; roland; phebe; frank; craven; mr; felicita; felix; cruden; horace; sharpley; mrs.; london; alec; sefton; mrs; durfy; effie; merle; samson; god; tarbox; clifford; jean; katy; chapter; zoe; philippa; marlowe; feilding; medlock; pascal; madame; alice; hilda; canon; st.; peter; miss; street; scilly; england; blandford; riversborough; dorcas; lady; liverpool keywords: mr.; mrs.; london; roland; man; lady; chapter; zoe; work; way; waterford; treatise; tavern; tarbox; street; steam; st.; shuckleford; sharpley; shanklin; sefton; screw; scilly; samson; sam; rosevean; rocket; robert; riversborough; right; richmond; reginald; practical; portland; pile; philippa; phebe; peter; person; people; pascal; paris; nixey; mrs; merle; mercer; medlock; marlowe; madame; machinery one topic; one dimension: said file(s): ./cache/19802.txt titles(s): Cobwebs and Cables three topics; one dimension: armorel; said; phebe file(s): ./cache/42125.txt, ./cache/21043.txt, ./cache/19802.txt titles(s): Armorel of Lyonesse: A Romance of To-day | Reginald Cruden A Tale of City Life | Cobwebs and Cables five topics; three dimensions: armorel man said; said mr reginald; phebe felicita said; piles pile said; visibly worried provide file(s): ./cache/42125.txt, ./cache/56602.txt, ./cache/19802.txt, ./cache/34942.txt, titles(s): Armorel of Lyonesse: A Romance of To-day | Frank Hunter''s Peril | Cobwebs and Cables | Scamping Tricks and Odd Knowledge Occasionally Practised upon Public Works | Desk and Debit; or, The Catastrophes of a Clerk Type: gutenberg title: subject-fraud-gutenberg date: 2021-06-06 time: 15:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Fraud" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 56602 author: Alger, Horatio, Jr. title: Frank Hunter''s Peril date: words: 52355.0 sentences: 4775.0 pages: flesch: 92.0 cache: ./cache/56602.txt txt: ./txt/56602.txt summary: "Seems to me he has a good deal of business with mother," Frank said "I am afraid Frank won''t like the idea of my marrying again," said Mrs. Hunter, anxiously. "He takes it very well," thought Frank, as Mr. Craven said good-night. "Good morning, sir," said Frank, for the first time noticing the "I thought perhaps I ought to save up the surplus for Frank," said Mrs. Craven, hesitating. "You--you don''t think he is likely to be taken away?" said Mrs. Craven, "Do you want Mr. Craven to be guardian with you, mother?" asked Frank, "Frank," said Mr. Craven, "this is my friend, Colonel Sharpley. "He seems a little so," said Frank; "but I hope, Mr. Tarbox, you won''t "I care very little what Mr. Craven would like," said Frank. "I think we''ll go now, Frank," said Sharpley. "Then," said Mrs. Craven, "Frank may be alive." id: 42125 author: Besant, Walter title: Armorel of Lyonesse: A Romance of To-day date: words: 160491.0 sentences: 13421.0 pages: flesch: 90.0 cache: ./cache/42125.txt txt: ./txt/42125.txt summary: what things Armorel did and how she looked on this day? Armorel plays the fiddle and makes the old lady ''A long time ago,'' Armorel went on, ''these islands formed part of the ''Roland Lee,'' said the girl, ''you are talking like your friend Dick ''One day last year,'' said Armorel--''it was in July, after a fortnight but little to make a young man open his heart to a girl; only a pair ''There was an old allegory, Armorel,'' this young man went on, ''of a When you come to stand before a great picture, Armorel, perhaps you ''She has trained her eye, and knows good work,'' Armorel repeated. ''I will play if you like,'' said Armorel, simply. ''I did not think that Alec was that kind of man,'' said Philippa, still ''I have come to ask a favour,'' said Armorel, taking the hand that was id: 34942 author: Newman, John title: Scamping Tricks and Odd Knowledge Occasionally Practised upon Public Works date: words: 63900.0 sentences: 4282.0 pages: flesch: 86.0 cache: ./cache/34942.txt txt: ./txt/34942.txt summary: known screw piles to penetrate hard and dense sand, gravel, soft sandy "I have seen piles screwed into a kind of clay rock seam, the end of We were working two triangles of screw piles I thought lovely, and like disc piles better for sand, those that sink by water-pressure I any cast-iron screw piles that are less than half an inch in thickness. sufficient length for men to walk round, I have screwed piles by ropes, like a copper ring on the head of the iron pile and a good long timber humble like, and said to the engineer, ''I think you will agree, sir, I said to him, ''It wants a lot of experience to know when piles are not will cease work, I think, very soon?'' ''They will,'' said the engineer. ''extra'' profit string of my brain worked right, and I pointed and said, id: 24544 author: Optic, Oliver title: Desk and Debit; or, The Catastrophes of a Clerk date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 21043 author: Reed, Talbot Baines title: Reginald Cruden A Tale of City Life date: words: 93848.0 sentences: 6357.0 pages: flesch: 87.0 cache: ./cache/21043.txt txt: ./txt/21043.txt summary: "Well," said Reginald laughing, "I can hardly fancy Horace the head of The boys walked for some time in silence; then Horace said,-"We want to see the manager," said Reginald, offended at the man''s tone, Mr Durfy mused for some time, then, turning to Reginald, he said,-"My poor boy!" she murmured; then, turning to Reginald, she said, "And "My dear boy," said Mrs Cruden, "you think far more about it than you Cruden," said the boy, "I know exactly what you''re going to say. "You know I''ll stick by you, young ''un," said Reginald; "but that won''t "Gedge is not going with you," said Reginald, keeping the boy''s arm in "Upon my word I hardly know whether I want him to," said Reginald, "By the way," said Reginald, as he started, "bring young Gedge home with "What made you think I would come?" said Reginald, looking down with id: 19802 author: Stretton, Hesba title: Cobwebs and Cables date: words: 116427.0 sentences: 6497.0 pages: flesch: 84.0 cache: ./cache/19802.txt txt: ./txt/19802.txt summary: years old to-day; and when I''m a man I''m going to be a pastor, like "But she knows where Mr. Sefton is," answered Phebe, "and we must ask "Phebe Marlowe!" she said, her eyes brightening a little, as the fresh, "Felicita," said Madame, her voice altering a little, "where is my son "Phebe," said Felicita, in her low-toned, softly-modulated voice, always opened, though Phebe spoke to him; for he could not face old Marlowe, or "Mother," he said one day, when Roland had been gone more than a month, "Poor father!" said Phebe aloud, with a little sob. life, Felicita: you and my mother and Felix and Hilda; the old home "I should like to see to-day''s _Times_," said Felicita. "I worship my mother still," said Felix one day to Phebe, "but I feel "Canon Pascal said to me," answered Phebe, "that your noble life and the id: 29582 author: Thomson, John, active 1732 title: The Tricks of the Town: or, Ways and Means of getting Money date: words: 17814.0 sentences: 700.0 pages: flesch: 71.0 cache: ./cache/29582.txt txt: ./txt/29582.txt summary: Hands it was done; and the Lady is teaz''d almost to death with People proper time for _setting_ them is generally soon after Seven in the assist the People, he got clear off with two or three blind old Women patience, I paid, and went to my Friend''s House, about twenty Doors Years, having laid hands on a good number of Acres, and got an Goods, to her Husband''s House, naming a very eminent Surgeon at St. _James''s_. be sure she''s in the House, for the Lady came with me in a Coach from time he comes to the House, he is sure to have the _Look_ which a the Man has not been starv''d before the time, but surviv''d to St. _Stephen_''s Day, and seen his wonderful Prediction happen and come to a good number of them, but it would give him a great deal of Trouble ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel