mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-rejectionPsychology-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/15265.txt inflating: ./tmp/input/input-file/1118.txt inflating: ./tmp/input/input-file/1783.txt inflating: ./tmp/input/input-file/1520.txt inflating: ./tmp/input/input-file/105.txt inflating: ./tmp/input/input-file/2240.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-rejectionPsychology-gutenberg FILE: cache/1783.txt OUTPUT: txt/1783.txt FILE: cache/1520.txt OUTPUT: txt/1520.txt FILE: cache/15265.txt OUTPUT: txt/15265.txt FILE: cache/1118.txt OUTPUT: txt/1118.txt FILE: cache/2240.txt OUTPUT: txt/2240.txt FILE: cache/105.txt OUTPUT: txt/105.txt === file2bib.sh === id: 1520 author: Shakespeare, William title: Much Ado about Nothing date: pages: extension: .txt txt: ./txt/1520.txt cache: ./cache/1520.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'1520.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 1520 txt/../ent/1520.ent 2240 txt/../ent/2240.ent === file2bib.sh === id: 2240 author: Shakespeare, William title: Much Ado about Nothing date: pages: extension: .txt txt: ./txt/2240.txt cache: ./cache/2240.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'2240.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 1783 txt/../ent/1783.ent 2240 txt/../wrd/2240.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 1520 txt/../wrd/1520.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 1520 txt/../pos/1520.pos 2240 txt/../pos/2240.pos 1783 txt/../pos/1783.pos 1783 txt/../wrd/1783.wrd === file2bib.sh === id: 1783 author: Shakespeare, William title: Much Ado about Nothing date: pages: extension: .txt txt: ./txt/1783.txt cache: ./cache/1783.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'1783.txt' 1118 txt/../pos/1118.pos 1118 txt/../wrd/1118.wrd === file2bib.sh === id: 1118 author: Shakespeare, William title: Much Ado about Nothing date: pages: extension: .txt txt: ./txt/1118.txt cache: ./cache/1118.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 4 resourceName b'1118.txt' 1118 txt/../ent/1118.ent 105 txt/../pos/105.pos 105 txt/../wrd/105.wrd 105 txt/../ent/105.ent 15265 txt/../pos/15265.pos 15265 txt/../wrd/15265.wrd 15265 txt/../ent/15265.ent === file2bib.sh === id: 105 author: Austen, Jane title: Persuasion date: pages: extension: .txt txt: ./txt/105.txt cache: ./cache/105.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 5 resourceName b'105.txt' === file2bib.sh === id: 15265 author: Du Bois, W. E. B. (William Edward Burghardt) title: The Quest of the Silver Fleece: A Novel date: pages: extension: .txt txt: ./txt/15265.txt cache: ./cache/15265.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 7 resourceName b'15265.txt' Done mapping. Reducing subject-rejectionPsychology-gutenberg === reduce.pl bib === id = 15265 author = Du Bois, W. E. B. (William Edward Burghardt) title = The Quest of the Silver Fleece: A Novel date = pages = extension = .txt mime = text/plain words = 111677 sentences = 9397 flesch = 89 summary = South, where Miss Smith worked and Miss Taylor drudged and Bles and Zora Zora bent forward and looked squarely into Miss Taylor's blue eyes. "Ask Miss Helen to come down," said Mr. Cresswell. English manufacturer, and Lady Creighton, Mr. and Mrs. Vanderpool, Mr. Harry Cresswell and his sister, John Taylor and his sister, and Mr. Charles Smith, whom the evening papers mentioned as likely to be United "But, Mr. Cresswell, you surely believe in schools like Miss Smith's?" Miss Taylor reddened; Mrs. Grey looked surprised; Mrs. Vanderpool smiled; but Mr. Cresswell darkened with anger. Miss Taylor felt that her worst suspicions had been confirmed; but Mrs. Vanderpool was curious as to the cause of Cresswell's anger. for the best interests of black folk, and in particular I object to Mr. Cresswell," said Miss Smith, slowly but very distinctly, "because his the way, I learn from Miss Smith that the boy, Bles Alwyn, in whom Zora cache = ./cache/15265.txt txt = ./txt/15265.txt === reduce.pl bib === id = 1118 author = Shakespeare, William title = Much Ado about Nothing date = pages = extension = .txt mime = text/plain words = 23379 sentences = 3393 flesch = 99 summary = Enter Leonato (Governor of Messina), Hero (his Daughter), and Beatrice Good Signior Leonato, are you come to meet your trouble? Benedick, didst thou note the daughter of Signior Leonato? I shall see thee, ere I die, look pale with love. a man of mine: the Prince discovered to Claudio that he loved my Enter Leonato, [Antonio] his Brother, Hero his Daughter, and Beatrice Enter Claudio and Beatrice, Leonato, Hero. your cousin, that she shall fall in love with Benedick; and I, Claudio alone; tell them that you know that Hero loves me; intend your niece Beatrice was in love with Signior Benedick? --I did never think that lady would have loved any man. If thou dost love, my kindness shall incite thee Dog. A good old man, sir; he will be talking. Think you in your soul the Count Claudio hath wrong'd Hero? Dog. Yea, marry, let them come before me. cache = ./cache/1118.txt txt = ./txt/1118.txt === reduce.pl bib === id = 1783 author = Shakespeare, William title = Much Ado about Nothing date = pages = extension = .txt mime = text/plain words = 40 sentences = 10 flesch = 88 summary = THIS EBOOK WAS ONE OF PROJECT GUTENBERG'S EARLY FILES PRODUCED AT A TIME WHEN PROOFING METHODS AND TOOLS WERE NOT WELL DEVELOPED. IS AN IMPROVED EDITION OF THIS TITLE WHICH MAY BE VIEWED AS EBOOK (#1519) at https://www.gutenberg.org/ebooks/1519 cache = ./cache/1783.txt txt = ./txt/1783.txt === reduce.pl bib === === reduce.pl bib === id = 105 author = Austen, Jane title = Persuasion date = pages = extension = .txt mime = text/plain words = 84172 sentences = 4254 flesch = 77 summary = known then, that Sir Walter, like a good father, (having met with one Lady Russell felt obliged to oppose her dear Anne's known wishes. hear that Captain Wentworth's sister was likely to live at Kellynch Anne, Sir Walter and your sister are gone; and what part of Bath do you From this time Captain Wentworth and Anne Elliot were repeatedly in the One morning, about this time Charles Musgrove and Captain Wentworth and to Lyme they were to go--Charles, Mary, Anne, Henrietta, Louisa, as to being Anne's acquaintance," said Mary, "I think he is rather Miss Elliot would give Mrs Smith, and Anne therefore lost no time in Anne found in Mrs Smith the good sense and agreeable manners which she enquiry after Mrs Charles Musgrove, and her fine little boys, Anne was "I thought Captain Benwick a very pleasing young man," said Anne, "and cache = ./cache/105.txt txt = ./txt/105.txt === reduce.pl bib === Building ./etc/reader.txt 15265 105 1118 15265 105 2240 number of items: 6 sum of words: 219,268 average size in words: 54,817 average readability score: 88 nouns: man; time; eyes; nothing; woman; way; world; day; cotton; men; school; father; people; night; girl; moment; room; something; hand; swamp; face; hands; morning; heart; things; bene; thing; house; life; claud; place; work; love; sister; mind; years; head; friend; one; door; beat; lady; brother; money; others; child; word; land; children; husband verbs: was; had; be; is; have; were; do; been; said; did; are; ''s; know; see; think; come; came; go; am; being; say; looked; seemed; make; knew; asked; thought; saw; made; has; let; going; found; felt; heard; get; give; went; tell; take; sat; want; turned; done; hear; lay; got; stood; believe; look adjectives: good; little; great; other; more; own; black; white; old; young; such; much; last; first; new; many; long; sure; same; few; poor; dark; better; next; happy; full; possible; high; dear; true; short; low; whole; strong; best; glad; right; present; least; bad; silent; big; only; worth; certain; red; fine; different; ready; small adverbs: not; so; very; then; n''t; now; up; too; again; only; here; out; never; well; as; down; more; back; there; just; away; still; yet; always; all; soon; even; almost; much; most; quite; ever; off; slowly; long; on; in; perhaps; indeed; however; rather; once; far; over; together; enough; suddenly; first; before; really pronouns: she; i; her; he; it; you; his; him; they; my; me; them; we; their; your; herself; its; himself; our; us; thee; myself; themselves; one; thy; itself; mine; yourself; yours; ''em; ''s; hers; theirs; ours; ourselves; i''m; you''re; you''ll; thyself; yourselves; yes--; us''d; then,--; sho; on''t; is"--she; him--; hesitated,--"i; bookshelf proper nouns: miss; zora; cresswell; anne; smith; taylor; mrs.; captain; mrs; elliot; mary; _; mr; bles; mr.; wentworth; lady; vanderpool; colonel; alwyn; charles; john; sir; pedro; russell; walter; god; musgrove; leon; hero; harry; louisa; wynn; bath; grey; elizabeth; senator; thou; claudio; harville; uppercross; kellynch; henrietta; benwick; negro; benedick; south; fleece; clay; lyme keywords: miss; mary; john; god; zora; wynn; wentworth; washington; walter; vanderpool; taylor; stillings; south; smith; sir; silver; senator; russell; prince; pedro; new; negro; musgrove; mrs.; mrs; mr.; louisa; leonato; lady; hero; harry; grey; fleece; elspeth; elliot; elizabeth; ebook; easterly; don; cresswell; colonel; claudio; charles; captain; bles; benedick; beatrice; bath; anne; alwyn one topic; one dimension: mrs file(s): ./cache/1118.txt titles(s): Much Ado about Nothing three topics; one dimension: zora; anne; 1519 file(s): ./cache/15265.txt, ./cache/105.txt, ./cache/1783.txt titles(s): The Quest of the Silver Fleece: A Novel | Persuasion | Much Ado about Nothing five topics; three dimensions: zora cresswell miss; anne captain mrs; pedro bene claud; 1519 ebook gutenberg; title project time file(s): ./cache/15265.txt, ./cache/105.txt, ./cache/1118.txt, ./cache/1783.txt, titles(s): The Quest of the Silver Fleece: A Novel | Persuasion | Much Ado about Nothing | Much Ado about Nothing | Much Ado about Nothing Type: gutenberg title: subject-rejectionPsychology-gutenberg date: 2021-06-09 time: 18:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Rejection (Psychology)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 105 author: Austen, Jane title: Persuasion date: words: 84172.0 sentences: 4254.0 pages: flesch: 77.0 cache: ./cache/105.txt txt: ./txt/105.txt summary: known then, that Sir Walter, like a good father, (having met with one Lady Russell felt obliged to oppose her dear Anne''s known wishes. hear that Captain Wentworth''s sister was likely to live at Kellynch Anne, Sir Walter and your sister are gone; and what part of Bath do you From this time Captain Wentworth and Anne Elliot were repeatedly in the One morning, about this time Charles Musgrove and Captain Wentworth and to Lyme they were to go--Charles, Mary, Anne, Henrietta, Louisa, as to being Anne''s acquaintance," said Mary, "I think he is rather Miss Elliot would give Mrs Smith, and Anne therefore lost no time in Anne found in Mrs Smith the good sense and agreeable manners which she enquiry after Mrs Charles Musgrove, and her fine little boys, Anne was "I thought Captain Benwick a very pleasing young man," said Anne, "and id: 15265 author: Du Bois, W. E. B. (William Edward Burghardt) title: The Quest of the Silver Fleece: A Novel date: words: 111677.0 sentences: 9397.0 pages: flesch: 89.0 cache: ./cache/15265.txt txt: ./txt/15265.txt summary: South, where Miss Smith worked and Miss Taylor drudged and Bles and Zora Zora bent forward and looked squarely into Miss Taylor''s blue eyes. "Ask Miss Helen to come down," said Mr. Cresswell. English manufacturer, and Lady Creighton, Mr. and Mrs. Vanderpool, Mr. Harry Cresswell and his sister, John Taylor and his sister, and Mr. Charles Smith, whom the evening papers mentioned as likely to be United "But, Mr. Cresswell, you surely believe in schools like Miss Smith''s?" Miss Taylor reddened; Mrs. Grey looked surprised; Mrs. Vanderpool smiled; but Mr. Cresswell darkened with anger. Miss Taylor felt that her worst suspicions had been confirmed; but Mrs. Vanderpool was curious as to the cause of Cresswell''s anger. for the best interests of black folk, and in particular I object to Mr. Cresswell," said Miss Smith, slowly but very distinctly, "because his the way, I learn from Miss Smith that the boy, Bles Alwyn, in whom Zora id: 1118 author: Shakespeare, William title: Much Ado about Nothing date: words: 23379.0 sentences: 3393.0 pages: flesch: 99.0 cache: ./cache/1118.txt txt: ./txt/1118.txt summary: Enter Leonato (Governor of Messina), Hero (his Daughter), and Beatrice Good Signior Leonato, are you come to meet your trouble? Benedick, didst thou note the daughter of Signior Leonato? I shall see thee, ere I die, look pale with love. a man of mine: the Prince discovered to Claudio that he loved my Enter Leonato, [Antonio] his Brother, Hero his Daughter, and Beatrice Enter Claudio and Beatrice, Leonato, Hero. your cousin, that she shall fall in love with Benedick; and I, Claudio alone; tell them that you know that Hero loves me; intend your niece Beatrice was in love with Signior Benedick? --I did never think that lady would have loved any man. If thou dost love, my kindness shall incite thee Dog. A good old man, sir; he will be talking. Think you in your soul the Count Claudio hath wrong''d Hero? Dog. Yea, marry, let them come before me. id: 1783 author: Shakespeare, William title: Much Ado about Nothing date: words: 40.0 sentences: 10.0 pages: flesch: 88.0 cache: ./cache/1783.txt txt: ./txt/1783.txt summary: THIS EBOOK WAS ONE OF PROJECT GUTENBERG''S EARLY FILES PRODUCED AT A TIME WHEN PROOFING METHODS AND TOOLS WERE NOT WELL DEVELOPED. IS AN IMPROVED EDITION OF THIS TITLE WHICH MAY BE VIEWED AS EBOOK (#1519) at https://www.gutenberg.org/ebooks/1519 id: 1520 author: Shakespeare, William title: Much Ado about Nothing date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: id: 2240 author: Shakespeare, William title: Much Ado about Nothing date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel