mv: ‘./input-file.zip’ and ‘./input-file.zip’ are the same file Creating study carrel named subject-edinburghScotland-gutenberg Initializing database Unzipping Archive: input-file.zip creating: ./tmp/input/input-file/ inflating: ./tmp/input/input-file/25701.txt inflating: ./tmp/input/input-file/36014.txt inflating: ./tmp/input/input-file/metadata.csv caution: excluded filename not matched: *MACOSX* === DIRECTORIES: ./tmp/input === DIRECTORY: ./tmp/input/input-file === metadata file: ./tmp/input/input-file/metadata.csv === found metadata file === updating bibliographic database Building study carrel named subject-edinburghScotland-gutenberg FILE: cache/25701.txt OUTPUT: txt/25701.txt FILE: cache/36014.txt OUTPUT: txt/36014.txt === file2bib.sh === id: 25701 author: Oliphant, Mrs. (Margaret) title: Royal Edinburgh: Her Saints, Kings, Prophets and Poets date: pages: extension: .txt txt: ./txt/25701.txt cache: ./cache/25701.txt Content-Encoding ISO-8859-1 Content-Type text/plain; charset=ISO-8859-1 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'25701.txt' Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/file2bib.py", line 107, in text = textacy.preprocessing.normalize.normalize_quotation_marks( text ) File "/data-disk/python/lib/python3.8/site-packages/textacy/preprocessing/normalize.py", line 32, in normalize_quotation_marks return text.translate(QUOTE_TRANSLATION_TABLE) AttributeError: 'NoneType' object has no attribute 'translate' 25701 txt/../pos/25701.pos 25701 txt/../ent/25701.ent 25701 txt/../wrd/25701.wrd Traceback (most recent call last): File "/data-disk/reader-compute/reader-classic/bin/txt2keywords.py", line 54, in for keyword, score in ( yake( doc, ngrams=NGRAMS, topn=TOPN ) ) : File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 96, in yake word_scores = _compute_word_scores(doc, word_occ_vals, word_freqs, stop_words) File "/data-disk/python/lib/python3.8/site-packages/textacy/ke/yake.py", line 205, in _compute_word_scores freq_baseline = statistics.mean(freqs_nsw) + statistics.stdev(freqs_nsw) File "/data-disk/python/lib/python3.8/statistics.py", line 315, in mean raise StatisticsError('mean requires at least one data point') statistics.StatisticsError: mean requires at least one data point 36014 txt/../pos/36014.pos 36014 txt/../wrd/36014.wrd 36014 txt/../ent/36014.ent === file2bib.sh === id: 36014 author: Bird, Isabella L. (Isabella Lucy) title: Notes on Old Edinburgh date: pages: extension: .txt txt: ./txt/36014.txt cache: ./cache/36014.txt Content-Encoding UTF-8 Content-Type text/plain; charset=UTF-8 X-Parsed-By ['org.apache.tika.parser.DefaultParser', 'org.apache.tika.parser.csv.TextAndCSVParser'] X-TIKA:content_handler ToTextContentHandler X-TIKA:embedded_depth 0 X-TIKA:parse_time_millis 2 resourceName b'36014.txt' Done mapping. Reducing subject-edinburghScotland-gutenberg === reduce.pl bib === id = 36014 author = Bird, Isabella L. (Isabella Lucy) title = Notes on Old Edinburgh date = pages = extension = .txt mime = text/plain words = 14262 sentences = 785 flesch = 78 summary = High Street, Cowgate, and West Port, going by "house-row." In all cases We followed this water grievance into thirty-seven houses that day, and of father, mother, and child of three years old, were fighting a hard women said, were the children of parents too poor to provide them with wife, to come down the dark filthy stair late at night with the occupiers were a very decent-looking man, seventy-six years old, by trade man had to bring the water up the long dark stair. two children, living in a room, requiring a candle at mid-day, 12 feet by two children, sleeping in a large bed in a room 11 feet by 9 feet, with a Three adults and six children in a room 12 feet by 10 children; room, 14 feet by 15 feet; rent, £3, 18s. closes and the street, and that there was no sign that the night had come, cache = ./cache/36014.txt txt = ./txt/36014.txt === reduce.pl bib === Building ./etc/reader.txt 36014 25701 36014 25701 number of items: 2 sum of words: 14,262 average size in words: 14,262 average readability score: 78 nouns: room; feet; children; water; man; day; night; light; people; rooms; houses; floor; close; women; city; stair; families; bed; years; work; nothing; mother; house; life; air; wife; rent; men; circumstances; woman; straw; side; population; passage; closes; street; land; family; dens; window; week; vice; places; morning; father; dwellings; child; way; persons; partitions verbs: was; is; were; are; be; had; have; been; do; said; has; come; came; did; visited; broken; sitting; made; looking; give; found; ''s; see; having; compelled; seemed; put; living; covered; lying; let; known; keep; gone; going; get; done; containing; called; being; went; taken; take; seen; say; locked; left; lay; lapsed; know adjectives: old; dark; many; poor; such; other; more; good; long; small; next; better; wretched; young; large; decent; little; human; filthy; same; most; first; drunk; close; clean; several; respectable; public; own; much; miserable; great; worst; worse; various; rich; ragged; only; narrow; bad; whole; vicious; similar; rotten; outer; larger; few; direct; unwholesome; sore adverbs: not; very; so; up; only; here; well; as; even; too; out; nearly; more; most; in; down; there; much; almost; scarcely; often; now; n''t; then; never; off; together; about; all; utterly; still; once; on; just; far; elsewhere; else; below; away; also; absolutely; rather; partly; ever; enough; before; apparently; sometimes; shortly; possibly pronouns: it; they; we; them; their; i; he; she; her; his; its; our; us; themselves; my; you; him; me; your; thy; itself; herself; himself; ourselves; myself proper nouns: _; edinburgh; 6d; street; high; close; price; old; god; town; john; foolscap; cowgate; wynd; subsecivæ; sewed; new; horæ; dr.; brown; west; st.; rab; grassmarket; father; edition; w.; sir; sabbath; rev.; port; london; heaven; hallam; dr; cloth; chapter; canongate; blackfriars; arthur; .; wayside; vol; thoughts; thou; thompson; poor; philosophy; j.; i. keywords: street; room; price; man; high; foot; edinburgh; close; child one topic; one dimension: room file(s): titles(s): Royal Edinburgh: Her Saints, Kings, Prophets and Poets three topics; one dimension: room; zeal; zeal file(s): ./cache/36014.txt, , titles(s): Notes on Old Edinburgh | Royal Edinburgh: Her Saints, Kings, Prophets and Poets | Royal Edinburgh: Her Saints, Kings, Prophets and Poets five topics; three dimensions: room feet close; zeal matter mauling; zeal matter mauling; zeal matter mauling; zeal matter mauling file(s): ./cache/36014.txt, , , , titles(s): Notes on Old Edinburgh | Royal Edinburgh: Her Saints, Kings, Prophets and Poets | Royal Edinburgh: Her Saints, Kings, Prophets and Poets | Royal Edinburgh: Her Saints, Kings, Prophets and Poets | Royal Edinburgh: Her Saints, Kings, Prophets and Poets Type: gutenberg title: subject-edinburghScotland-gutenberg date: 2021-06-05 time: 14:06 username: emorgan patron: Eric Morgan email: emorgan@nd.edu input: facet_subject:"Edinburgh (Scotland)" ==== make-pages.sh htm files ==== make-pages.sh complex files ==== make-pages.sh named enities ==== making bibliographics id: 36014 author: Bird, Isabella L. (Isabella Lucy) title: Notes on Old Edinburgh date: words: 14262.0 sentences: 785.0 pages: flesch: 78.0 cache: ./cache/36014.txt txt: ./txt/36014.txt summary: High Street, Cowgate, and West Port, going by "house-row." In all cases We followed this water grievance into thirty-seven houses that day, and of father, mother, and child of three years old, were fighting a hard women said, were the children of parents too poor to provide them with wife, to come down the dark filthy stair late at night with the occupiers were a very decent-looking man, seventy-six years old, by trade man had to bring the water up the long dark stair. two children, living in a room, requiring a candle at mid-day, 12 feet by two children, sleeping in a large bed in a room 11 feet by 9 feet, with a Three adults and six children in a room 12 feet by 10 children; room, 14 feet by 15 feet; rent, £3, 18s. closes and the street, and that there was no sign that the night had come, id: 25701 author: Oliphant, Mrs. (Margaret) title: Royal Edinburgh: Her Saints, Kings, Prophets and Poets date: words: nan sentences: nan pages: flesch: nan cache: txt: summary: ==== make-pages.sh questions ==== make-pages.sh search ==== make-pages.sh topic modeling corpus Zipping study carrel