[PDF] Toward a statistical mechanics of four letter words | Semantic Scholar Skip to search formSkip to main content> Semantic Scholar's Logo Search Sign InCreate Free Account You are currently offline. Some features of the site may not work correctly. DOI:10.1103/PhysRevE.81.066119 Corpus ID: 13216093Toward a statistical mechanics of four letter words @article{Stephens2007TowardAS, title={Toward a statistical mechanics of four letter words}, author={G. Stephens and W. Bialek}, journal={ArXiv}, year={2007}, volume={abs/0801.0253} } G. Stephens, W. Bialek Published 2007 Biology, Computer Science, Physics ArXiv We consider words as a network of interacting letters, and approximate the probability distribution of states taken on by this network. Despite the intuition that the rules of English spelling are highly combinatorial (and arbitrary), we find that maximum entropy models consistent with pairwise correlations among letters provide a surprisingly good approximation to the full statistics of four letter words, capturing ∼ 92% of the multi–information among letters and even ‘discovering’ real words… Expand View PDF on arXiv Save to Library Create Alert Cite Launch Research Feed Share This Paper 6 CitationsBackground Citations 2 View All Figures, Tables, and Topics from this paper figure 1 figure 2 figure 3 table I Principle of maximum entropy Maxima and minima Interaction Approximation algorithm 6 Citations Citation Type Citation Type All Types Cites Results Cites Methods Cites Background Has PDF Publication Type Author More Filters More Filters Filters Sort by Relevance Sort by Most Influenced Papers Sort by Citation Count Sort by Recency Keyword Detection in Natural Language Based on Statistical Mechanics of Words in Written Texts K. Koroutchev, Jian Shen, E. Korutcheva, Manuel Cebrian Computer Science ArXiv 2009 Save Alert Research Feed Constraint satisfaction problems and neural networks: A statistical physics perspective M. Mézard, T. Mora Computer Science, Biology Journal of Physiology-Paris 2009 105 PDF View 3 excerpts, cites background Save Alert Research Feed Style Imitation and Chord Invention in Polyphonic Music with Exponential Families Gaëtan Hadjeres, J. Sakellariou, F. Pachet Computer Science ArXiv 2016 17 PDF View 1 excerpt, cites background Save Alert Research Feed Probabilistic and Flux Landscapes of the Phage lambda Genetic Switch N. Borggren Chemistry, Physics 2011 PDF Save Alert Research Feed Applications exploratoires des modeles de spins au Traitement Automatique de la Langue E. H. Poincar, H. Poincar, I. Nancy, Ecole Doctorale Emma Computer Science 2009 5 PDF Save Alert Research Feed Applications exploratoires des modèles de spins au Traitement Automatique de la Langue. (Exploratory applications of spin models in Natural Language Processing) Silvia Fernandez Sabido Computer Science, Physics 2009 2 PDF Save Alert Research Feed References SHOWING 1-10 OF 19 REFERENCES SORT BYRelevance Most Influenced Papers Recency Rediscovering the power of pairwise interactions W. Bialek, R. Ranganathan Biology, Mathematics 2007 52 PDF View 2 excerpts, references background and methods Save Alert Research Feed Ising models for networks of real neurons G. Tkačik, Elad Schneidman, Michael J. Berry, W. Bialek Mathematics, Biology 2006 127 PDF View 2 excerpts, references background Save Alert Research Feed Weak pairwise correlations imply strongly correlated network states in a neural population Elad Schneidman, Michael J. Berry, R. Segev, W. Bialek Physics, Biology Nature 2006 1,407 PDF View 2 excerpts, references methods and background Save Alert Research Feed Random texts exhibit Zipf's-law-like word frequency distribution Wentian Li Mathematics, Computer Science IEEE Trans. Inf. Theory 1992 473 PDF View 2 excerpts, references background Save Alert Research Feed A Maximum Entropy Approach to Natural Language Processing A. Berger, S. D. Pietra, V. D. Pietra Computer Science Comput. Linguistics 1996 3,344 PDF View 2 excerpts, references background Save Alert Research Feed The neural code for written words: a proposal S. Dehaene, L. Cohen, M. Sigman, F. Vinckier Psychology, Medicine Trends in Cognitive Sciences 2005 834 PDF Save Alert Research Feed Formal grammar and information theory: together again? Fernando C Pereira Mathematics Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences 2000 129 PDF View 3 excerpts, references background Save Alert Research Feed Faster solutions of the inverse pairwise Ising problem T. Broderick, M. Dudík, G. Tkačik, R. Schapire, W. Bialek Computer Science, Biology 2008 83 PDF View 2 excerpts, references background Save Alert Research Feed Three Models for the Description of Language Alaa Kharbouch, Z. Karam 2006 1,330 PDF View 2 excerpts, references background Save Alert Research Feed Information Theory and Statistical Mechanics E. Jaynes Mathematics 1957 10,096 PDF View 2 excerpts, references background Save Alert Research Feed ... 1 2 ... Related Papers Abstract Figures, Tables, and Topics 6 Citations 19 References Related Papers Stay Connected With Semantic Scholar Sign Up About Semantic Scholar Semantic Scholar is a free, AI-powered research tool for scientific literature, based at the Allen Institute for AI. Learn More → Resources DatasetsSupp.aiAPIOpen Corpus Organization About UsResearchPublishing PartnersData Partners   FAQContact Proudly built by AI2 with the help of our Collaborators Terms of Service•Privacy Policy The Allen Institute for AI By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy, Terms of Service, and Dataset License ACCEPT & CONTINUE