mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-barsetshireEnglandImaginaryPlace-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/2432.txt inflating: ./tmp/input/input-file/3409.txt inflating: ./tmp/input/input-file/3166.txt inflating: ./tmp/input/input-file/2860.txt inflating: ./tmp/input/input-file/4599.txt inflating: ./tmp/input/input-file/619.txt inflating: ./tmp/input/input-file/3045.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-barsetshireEnglandImaginaryPlace-gutenberg FILE: cache/619.txt OUTPUT: txt/619.txt FILE: cache/2432.txt OUTPUT: txt/2432.txt FILE: cache/2860.txt OUTPUT: txt/2860.txt FILE: cache/3409.txt OUTPUT: txt/3409.txt FILE: cache/3166.txt OUTPUT: txt/3166.txt FILE: cache/4599.txt OUTPUT: txt/4599.txt FILE: cache/3045.txt OUTPUT: txt/3045.txt === file2bib.sh === id: 2432 author: Trollope, Anthony title: Barchester Towers date: pages: extension: .txt txt: ./txt/2432.txt cache: ./cache/2432.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 1 resourceName b'2432.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 2432 txt/../ent/2432.ent 2432 txt/../pos/2432.pos 2432 txt/../wrd/2432.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 619 txt/../pos/619.pos 619 txt/../wrd/619.wrd 619 txt/../ent/619.ent 3409 txt/../pos/3409.pos === file2bib.sh === id: 619 author: Trollope, Anthony title: The Warden date: pages: extension: .txt txt: ./txt/619.txt cache: ./cache/619.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 6 resourceName b'619.txt' 2860 txt/../pos/2860.pos 3409 txt/../wrd/3409.wrd 3166 txt/../pos/3166.pos 2860 txt/../wrd/2860.wrd 4599 txt/../pos/4599.pos 3166 txt/../wrd/3166.wrd 4599 txt/../wrd/4599.wrd 3409 txt/../ent/3409.ent 2860 txt/../ent/2860.ent 3166 txt/../ent/3166.ent 3045 txt/../pos/3045.pos 3045 txt/../wrd/3045.wrd 4599 txt/../ent/4599.ent 3045 txt/../ent/3045.ent === file2bib.sh === id: 3409 author: Trollope, Anthony title: Barchester Towers date: pages: extension: .txt txt: ./txt/3409.txt cache: ./cache/3409.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 12 resourceName b'3409.txt' === file2bib.sh === id: 2860 author: Trollope, Anthony title: Framley Parsonage date: pages: extension: .txt txt: ./txt/2860.txt cache: ./cache/2860.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 8 resourceName b'2860.txt' === file2bib.sh === id: 3166 author: Trollope, Anthony title: Doctor Thorne date: pages: extension: .txt txt: ./txt/3166.txt cache: ./cache/3166.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 12 resourceName b'3166.txt' === file2bib.sh === id: 4599 author: Trollope, Anthony title: The Small House at Allington date: pages: extension: .txt txt: ./txt/4599.txt cache: ./cache/4599.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 24 resourceName b'4599.txt' === file2bib.sh === id: 3045 author: Trollope, Anthony title: The Last Chronicle of Barset date: pages: extension: .txt txt: ./txt/3045.txt cache: ./cache/3045.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 11 resourceName b'3045.txt' Done mapping. Reducing subject-barsetshireEnglandImaginaryPlace-gutenberg === reduce.pl bib === === reduce.pl bib === id = 3409 author = Trollope, Anthony title = Barchester Towers date = pages = extension = .txt mime = text/plain words = 201874 sentences = 11220 flesch = 81 summary = "I don't think I shall ever like that Mr. Slope," said Mr. Harding. Mr. Harding mused awhile and then said he didn't think the new bishop "I declare I thought Mrs. Proudie was the worst of the two," said Mr. Harding. "Pray, Mr. Slope, let her brother take it to her," said Mrs. Proudie, "Not at all," said Mrs. Proudie; "you little know how determined the "You mean Mrs. Grantly," said Slope. "Oh, Mrs. Bold!" said Mr. Slope in a manner almost impassioned. "Mr. Slope seems to think!" said Mrs. Proudie in a tone of voice From Mr. Slope the conversation turned to the Stanhopes, and Mrs. Grantly was listening with some interest to Eleanor's account of the "I wonder," said Dr. Grantly, "if it be true that Mr. Slope and Mrs. Bold came here together. "My name, Mr. Slope, is Mrs. Bold," said Eleanor, who, though cache = ./cache/3409.txt txt = ./txt/3409.txt === reduce.pl bib === id = 619 author = Trollope, Anthony title = The Warden date = pages = extension = .txt mime = text/plain words = 73113 sentences = 3345 flesch = 78 summary = Eleanor Harding has not plighted her troth to John Bold, nor has she, Nor is there any good reason why Eleanor Harding should not love John "Pray, Mr Harding--pray don't let me disturb you," said Bold; "you "I've knowed Job Skulpit, man and boy, sixty years," said Bunce, "I think Sir Abraham will not be long in letting Master Bold know what day following, John Bold met Miss Harding in one of the quiet, sombre, "Yes," said the archdeacon; "Sir Abraham has given most minute "What a question for a man to ask!" said the archdeacon, throwing up "Would you like Bunce to come in, papa?" said Eleanor, thinking that Eleanor Harding should appeal, on behalf of her father, to Bold's "Oh, Mr Bold," said Eleanor, "do not speak so; I ask nothing for Harding will return," said the bishop; "and if we cannot, it will be cache = ./cache/619.txt txt = ./txt/619.txt === reduce.pl bib === id = 3045 author = Trollope, Anthony title = The Last Chronicle of Barset date = pages = extension = .txt mime = text/plain words = 349659 sentences = 23246 flesch = 88 summary = "You don't mean to say, archdeacon, that you think that Mr. Crawley--a clergyman--stole it!" said Mrs. Grantly. "I hope he won't marry the girl, with all my heart," said Mrs. Grantly. "My dear," said the eldest Miss Prettyman to poor Grace Crawley, "in "I did not know that Grace Crawley was here," said Miss Anne. wonder if Grace were over here to-day," said Mrs. Crawley. him an angel of the church," said Mrs. Crawley, coming up to him and For two days the major said not a word of Grace Crawley to any one. has gone to Allington to propose to Miss Crawley," said Mrs. Grantly. "Good morning, Mr. Chadwick," said Mrs. Proudie, coming into the room good in the world," said Mrs. Dale; "and of course you ought to know "I think, my dear, I will go over and see Mrs. Crawley," said Lady "Of course we know that is possible," said Mrs. Crawley. cache = ./cache/3045.txt txt = ./txt/3045.txt === reduce.pl bib === id = 3166 author = Trollope, Anthony title = Doctor Thorne date = pages = extension = .txt mime = text/plain words = 221834 sentences = 13678 flesch = 86 summary = "I know he used," said Lady de Courcy, looking very wise, and rather "His father, you know, died when he was very young," said Frank. "Come in, Mary," said Beatrice, "you know my cousin Alexandrina." "You know I never interfere," said the Lady Arabella; "I never liked "Much better, I would think," said the Lady Arabella; "but you know, "It is a great deal of money, certainly," said Lady Arabella. "Yes," said Mary, "I know he is rich; and a rich man I suppose can "Now, doctor, don't let him talk that way, don't," said Lady about the money, you know, doctor," said she; "of course Sir Roger "Shall I go now," said the doctor, "and send Lady Scatcherd to you?" "As I said before, Frank is, to my thinking, an excellent young man. "I am engaged to Frank Gresham," and having so said, Mary looked her cache = ./cache/3166.txt txt = ./txt/3166.txt === reduce.pl bib === id = 2860 author = Trollope, Anthony title = Framley Parsonage date = pages = extension = .txt mime = text/plain words = 212336 sentences = 12552 flesch = 86 summary = "Oh, Lady Lufton, don't say that," said Mrs. Robarts, with tears in "Especially when the bishop is coupled up with the devil, as Mr. Robarts has done," said Lady Lufton; "he can join the duke with them "I don't think you will consider Lucy a beauty," said Mrs. Robarts. "Small, retiring, and--" so far Lord Lufton had gone, when Mrs. Robarts finished by the word, "plain." She had liked Lucy's face, but "Dear Lady Lufton!" said Griselda, putting up her hand so as to way, since the day on which Lady Lufton had hinted her fears to Mrs. Robarts. "But, dear Lady Lufton," said Mrs. Grantly, "is it not possible that "I don't know whether Lord Lufton sees much of her now," said Mrs. Grantly, thinking perhaps of that promise of Lady Lufton's with "I don't know about that," said Mrs. Robarts, thinking of poor Lucy. cache = ./cache/2860.txt txt = ./txt/2860.txt === reduce.pl bib === id = 4599 author = Trollope, Anthony title = The Small House at Allington date = pages = extension = .txt mime = text/plain words = 263252 sentences = 17611 flesch = 89 summary = "Then Johnny Eames is a mere clerk," said Lily; "and Mr. Crosbie "Lily, my love," said Mrs. Dale, when they were all together in her "I have come to say good-by, Lily," said Johnny Eames, following the "I declare, Mr. Eames," said Mrs. Lupex, "I'm glad you've come. "There is Lily coming across the lawn," said Mrs. Dale. "I suppose we shall come back this way," Crosbie said, as they "I say, Dale," Crosbie said, as in the course of their day's work "Yes; we did come early," said Mrs. Eames, "because Mary thought she "You mustn't think of going away from us," Mrs. Boyce said, speaking "I hope I shall, Lady Julia," said Lily, with a little laugh; "at any "I believe Lady Julia to be a very good woman," said Mrs. Dale, "and "I know Lady Dumbello," said Crosbie; not meaning, however, to boast cache = ./cache/4599.txt txt = ./txt/4599.txt Building ./etc/reader.txt 3045 3409 2860 2860 3045 3166 number of items: 7 sum of words: 1,322,068 average size in words: 220,344 average readability score: 84 nouns: man; nothing; way; room; house; time; bishop; day; wife; father; doctor; world; matter; mother; friend; word; archdeacon; men; moment; mind; hand; money; life; love; heart; course; anything; things; woman; letter; squire; one; lady; words; something; son; thing; morning; place; people; days; family; face; daughter; rate; hands; eyes; sister; truth; years verbs: was; had; be; said; have; is; do; been; were; did; know; are; think; say; has; come; go; made; ''s; am; see; make; tell; thought; knew; done; told; take; went; give; going; came; let; put; got; felt; found; get; heard; having; does; left; suppose; being; speak; believe; look; ''m; understand; like adjectives: own; such; other; little; good; old; much; great; more; young; poor; last; sure; first; better; many; same; dear; present; true; possible; new; happy; best; few; necessary; right; least; able; certain; whole; wrong; long; full; next; angry; high; bad; anxious; strong; hard; aware; small; glad; impossible; very; pleasant; large; afraid; ready adverbs: not; so; very; n''t; then; now; up; never; as; well; there; only; much; here; out; again; yet; too; also; quite; all; more; even; indeed; ever; down; always; still; perhaps; once; almost; away; just; over; hardly; back; on; therefore; however; grantly; certainly; of; at; soon; most; together; enough; rather; course; off pronouns: he; i; it; his; you; her; she; him; me; my; they; himself; your; we; them; their; herself; us; our; myself; its; yourself; themselves; one; itself; yours; mine; ourselves; hers; ''em; thy; thee; hisself; ours; theirs; ''s; thyself; oneself; i''m; em; you''ll; yes;--that; ye; theeself; ee; bookshelf; yourselves; you,--you; you,--unless; you''re proper nouns: mr.; mrs.; lady; miss; crawley; lily; lufton; mr; mary; frank; thorne; dale; slope; lord; crosbie; barchester; sir; harding; proudie; robarts; john; dr.; eames; eleanor; arabin; _; lucy; gresham; london; johnny; dunstable; dr; bell; courcy; bold; grace; sowerby; mark; greshamsbury; grantly; arabella; de; earl; scatcherd; framley; broughton; amelia; smith; bernard; allington keywords: miss; london; barchester; mrs.; mr.; lady; dr.; thorne; proudie; mary; john; grantly; sir; robarts; lufton; lord; lily; johnny; harding; gresham; gazebee; framley; eleanor; eames; dunstable; dumbello; dale; crosbie; crawley; courcy; bold; arabin; yes; walker; van; ullathorne; tozer; towers; toogood; tom; thumble; tempest; supplehouse; stanhope; st.; sowerby; smith; slope; silverbridge; signora one topic; one dimension: said file(s): ./cache/3045.txt titles(s): The Last Chronicle of Barset three topics; one dimension: said; mr; wildest file(s): ./cache/4599.txt, ./cache/619.txt, titles(s): The Small House at Allington | The Warden | Barchester Towers five topics; three dimensions: said lady mr; said lily mrs; mr said slope; said mr mrs; officer continuation arouse file(s): ./cache/3166.txt, ./cache/4599.txt, ./cache/3409.txt, ./cache/3045.txt, titles(s): Doctor Thorne | The Small House at Allington | Barchester Towers | The Last Chronicle of Barset | Barchester Towers Type: gutenberg title: subject-barsetshireEnglandImaginaryPlace-gutenberg date: 2021-06-01 time: 13:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Barsetshire (England: Imaginary place)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 2432 author: Trollope, Anthony title: Barchester Towers date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 3409 author: Trollope, Anthony title: Barchester Towers date: words: 201874.0 sentences: 11220.0 pages: flesch: 81.0 cache: ./cache/3409.txt txt: ./txt/3409.txt summary: "I don''t think I shall ever like that Mr. Slope," said Mr. Harding. Mr. Harding mused awhile and then said he didn''t think the new bishop "I declare I thought Mrs. Proudie was the worst of the two," said Mr. Harding. "Pray, Mr. Slope, let her brother take it to her," said Mrs. Proudie, "Not at all," said Mrs. Proudie; "you little know how determined the "You mean Mrs. Grantly," said Slope. "Oh, Mrs. Bold!" said Mr. Slope in a manner almost impassioned. "Mr. Slope seems to think!" said Mrs. Proudie in a tone of voice From Mr. Slope the conversation turned to the Stanhopes, and Mrs. Grantly was listening with some interest to Eleanor''s account of the "I wonder," said Dr. Grantly, "if it be true that Mr. Slope and Mrs. Bold came here together. "My name, Mr. Slope, is Mrs. Bold," said Eleanor, who, though id: 3166 author: Trollope, Anthony title: Doctor Thorne date: words: 221834.0 sentences: 13678.0 pages: flesch: 86.0 cache: ./cache/3166.txt txt: ./txt/3166.txt summary: "I know he used," said Lady de Courcy, looking very wise, and rather "His father, you know, died when he was very young," said Frank. "Come in, Mary," said Beatrice, "you know my cousin Alexandrina." "You know I never interfere," said the Lady Arabella; "I never liked "Much better, I would think," said the Lady Arabella; "but you know, "It is a great deal of money, certainly," said Lady Arabella. "Yes," said Mary, "I know he is rich; and a rich man I suppose can "Now, doctor, don''t let him talk that way, don''t," said Lady about the money, you know, doctor," said she; "of course Sir Roger "Shall I go now," said the doctor, "and send Lady Scatcherd to you?" "As I said before, Frank is, to my thinking, an excellent young man. "I am engaged to Frank Gresham," and having so said, Mary looked her id: 2860 author: Trollope, Anthony title: Framley Parsonage date: words: 212336.0 sentences: 12552.0 pages: flesch: 86.0 cache: ./cache/2860.txt txt: ./txt/2860.txt summary: "Oh, Lady Lufton, don''t say that," said Mrs. Robarts, with tears in "Especially when the bishop is coupled up with the devil, as Mr. Robarts has done," said Lady Lufton; "he can join the duke with them "I don''t think you will consider Lucy a beauty," said Mrs. Robarts. "Small, retiring, and--" so far Lord Lufton had gone, when Mrs. Robarts finished by the word, "plain." She had liked Lucy''s face, but "Dear Lady Lufton!" said Griselda, putting up her hand so as to way, since the day on which Lady Lufton had hinted her fears to Mrs. Robarts. "But, dear Lady Lufton," said Mrs. Grantly, "is it not possible that "I don''t know whether Lord Lufton sees much of her now," said Mrs. Grantly, thinking perhaps of that promise of Lady Lufton''s with "I don''t know about that," said Mrs. Robarts, thinking of poor Lucy. id: 4599 author: Trollope, Anthony title: The Small House at Allington date: words: 263252.0 sentences: 17611.0 pages: flesch: 89.0 cache: ./cache/4599.txt txt: ./txt/4599.txt summary: "Then Johnny Eames is a mere clerk," said Lily; "and Mr. Crosbie "Lily, my love," said Mrs. Dale, when they were all together in her "I have come to say good-by, Lily," said Johnny Eames, following the "I declare, Mr. Eames," said Mrs. Lupex, "I''m glad you''ve come. "There is Lily coming across the lawn," said Mrs. Dale. "I suppose we shall come back this way," Crosbie said, as they "I say, Dale," Crosbie said, as in the course of their day''s work "Yes; we did come early," said Mrs. Eames, "because Mary thought she "You mustn''t think of going away from us," Mrs. Boyce said, speaking "I hope I shall, Lady Julia," said Lily, with a little laugh; "at any "I believe Lady Julia to be a very good woman," said Mrs. Dale, "and "I know Lady Dumbello," said Crosbie; not meaning, however, to boast id: 619 author: Trollope, Anthony title: The Warden date: words: 73113.0 sentences: 3345.0 pages: flesch: 78.0 cache: ./cache/619.txt txt: ./txt/619.txt summary: Eleanor Harding has not plighted her troth to John Bold, nor has she, Nor is there any good reason why Eleanor Harding should not love John "Pray, Mr Harding--pray don''t let me disturb you," said Bold; "you "I''ve knowed Job Skulpit, man and boy, sixty years," said Bunce, "I think Sir Abraham will not be long in letting Master Bold know what day following, John Bold met Miss Harding in one of the quiet, sombre, "Yes," said the archdeacon; "Sir Abraham has given most minute "What a question for a man to ask!" said the archdeacon, throwing up "Would you like Bunce to come in, papa?" said Eleanor, thinking that Eleanor Harding should appeal, on behalf of her father, to Bold''s "Oh, Mr Bold," said Eleanor, "do not speak so; I ask nothing for Harding will return," said the bishop; "and if we cannot, it will be id: 3045 author: Trollope, Anthony title: The Last Chronicle of Barset date: words: 349659.0 sentences: 23246.0 pages: flesch: 88.0 cache: ./cache/3045.txt txt: ./txt/3045.txt summary: "You don''t mean to say, archdeacon, that you think that Mr. Crawley--a clergyman--stole it!" said Mrs. Grantly. "I hope he won''t marry the girl, with all my heart," said Mrs. Grantly. "My dear," said the eldest Miss Prettyman to poor Grace Crawley, "in "I did not know that Grace Crawley was here," said Miss Anne. wonder if Grace were over here to-day," said Mrs. Crawley. him an angel of the church," said Mrs. Crawley, coming up to him and For two days the major said not a word of Grace Crawley to any one. has gone to Allington to propose to Miss Crawley," said Mrs. Grantly. "Good morning, Mr. Chadwick," said Mrs. Proudie, coming into the room good in the world," said Mrs. Dale; "and of course you ought to know "I think, my dear, I will go over and see Mrs. Crawley," said Lady "Of course we know that is possible," said Mrs. Crawley. ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel