Answers are grounded in this paper and cite their sources.
My paper with Patrick Hanks on PMI (pointwise mutual information) was the most successful paper I ever wrote, or ever will write. I believe the paper was successful because it appealed to a number of different audiences for a number of different purposes. Patrick Hanks was more interested in applications in lexicography and I was more interested in applications in engineering. The first section on background will discuss the role our PMI paper played in moving computational linguistics from Rationalism to Empiricism. The second section will connect the dots between PMI and much of the recent excitement in Artificial Intelligence over bots like DeepSeek and large language models (LLMs).
No takes yet. Share an insight, caveat, or question.
Kenneth Church (2025) studied this question.
Synapse has enriched 10 related papers. Consider them for comparative context: