Convention: A Philosophical Study

Reference: Lewis, D. K. (1969). Convention: A Philosophical Study. Harvard University Press, Cambridge MA. (Reprinted 2002, Blackwell.) SEP entry on Convention · Wiley publisher page (book; no full-text OA.)

Summary

Lewis offers the first rigorous game-theoretic analysis of how shared conventions — including, paradigmatically, the conventions of language — arise and sustain themselves among rational agents without explicit agreement. The book opens by defining a coordination problem: a situation in which several agents have multiple equilibria available, all parties prefer reaching some equilibrium to none, and they are largely indifferent (or have non-conflicting preferences) over which equilibrium they reach. Lewis’s central thesis is that a convention is a regularity in behaviour that is one solution to a coordination problem, sustained by mutual expectation — each party expects the others to follow the regularity, expects the others to expect them to follow it, and so on up an infinite hierarchy that Lewis was the first to formalise as common knowledge. The book applies this analysis to driving conventions (drive on the right vs left), signalling, currency, and at length to language: the conventions of meaning are coordination equilibria sustained by mutual expectation in a population of speakers; semantic content is what would be the case if the convention were followed. Lewis’s framework supplies the philosophical foundation for every later treatment of emergent and negotiated meaning — emergent-communication research in MAS and deep learning, the ACL evolution programme, and the language-games tradition (Wittgenstein operationally, Steels formally) all proceed in the conceptual space Lewis defined. The common-knowledge construction is independently a foundational result for distributed-systems theory (Halpern & Moses 1990) and game theory (Aumann 1976).

Key Ideas

Coordination problem: a strategic situation with multiple Pareto-comparable equilibria where no party prefers a non-equilibrium outcome and the parties’ preferences over equilibria largely coincide. The classical examples — driving side, meeting place — generalise to language, money, social roles.
Convention as a self-sustaining regularity: a regularity R is a convention iff (i) almost everyone conforms to R, (ii) almost everyone expects almost everyone else to conform to R, (iii) almost everyone prefers conforming on the assumption that others conform, and (iv) some alternative regularity could have been the convention instead (no party of the convention is intrinsically preferred).
Common knowledge: the infinite hierarchy of mutual expectation that sustains a convention — A knows that B follows R; A knows that B knows that A follows R; and so on. Lewis was the first to give a formal account of this in social terms; the construction was rediscovered by Aumann in game theory and Halpern–Moses in distributed systems.
Salience and precedent as convention selectors: when multiple equilibria are available, salient features (Schelling’s focal points, see The Strategy of Conflict) and historical precedent select among them. There is no rationality-driven argument for which equilibrium becomes conventional; the answer is contingent on saliency.
Language as convention: meaning is what would obtain if the convention were followed. Truth-conditions, communicative force, and reference are all conventionally fixed — but the convention is not arbitrary, it is sustained by everyone’s expectation that everyone else will use words a particular way.
Conventions vs explicit agreements: Lewis argues that explicit agreement is neither necessary nor sufficient for convention — many conventions arise without agreement (precedent does the work) and many agreements never become conventions (because mutual expectation does not develop).
Population vs pair: conventions are population-level facts; one cannot have a convention with a single partner. Mutual expectation must extend across the relevant community for the regularity to be convention-grade.

Connections

Conceptual Contribution

Claim: Conventions — including the conventions of language — are best analysed as solutions to coordination problems sustained by mutual expectation (formally, common knowledge) in a population of rational agents. There is nothing arbitrary about the convention’s function, but the particular regularity that becomes conventional is contingent on salience, precedent, and historical accident.
Mechanism: Game-theoretic analysis of coordination problems with multiple equilibria; definition of convention via four clauses (conformity, mutual expectation, conditional preference, alternativeness); explicit construction of common knowledge as an infinite hierarchy of expectations; application to driving conventions, signalling, currency, and at length to language semantics.
Concepts introduced/used: Coordination Game, Convention (Lewis), Common Knowledge (Convention), Mutual Expectation, Focal Point (via dialogue with Schelling), Salience, Precedent, Convention vs Agreement.
Stance: foundational philosophical monograph.
Relates to: Direct philosophical foundation for every later treatment of emergent meaning and negotiated language: Steels’ language games are operational realisations of Lewis’s coordination-problem analysis with explicit interaction protocols; Lazaridou et al. and the deep-learning emergent-communication line train neural agents to converge on Lewis-style conventions in referential games. The ACL-evolution programme (Toward Automated Evolution of ACLs, Towards Automating the Evolution of Linguistic Competence) treats the ACL itself as an evolving Lewis-convention. Lewis’s common-knowledge construction is independently the foundation of Halpern & Moses 1990 in distributed systems and Aumann (1976) in game theory — distributed protocols and conventional language share the same mathematical object. The framework also clarifies what is at stake in the Mentalistic Semantics vs Public Semantics debate in ACLs: Lewis-style conventions are public-semantics objects (mutual-expectation regularities) but their stability depends on something close to mentalistic conditions (each agent’s expectations about others’ beliefs), so the two semantic families are dual aspects of the same phenomenon rather than competitors. Why AI Agents Communicate In Human Language revisits Lewis from the LLM-agent angle: natural language is a particular Lewis-convention (a contingent equilibrium) and not necessarily the optimal one for inter-agent coordination.

Tags

#convention #coordination #common-knowledge #lewis #philosophy-of-language #foundations #emergent-meaning

Backlinks

Linked Pages

Why AI Agents Communicate In Human Language

Why do AI agents communicate in human language?

Reference: Zhou, Feng, Julaiti, Yang (2025). arXiv:2506.02739. Source file: 2506.02739v1.pdf. URL

Summary

The authors argue that natural language, inherited from single-agent LLM pretraining, is fundamentally misaligned with the needs of multi-agent coordination. Because LLMs are trained to maximize likelihood over discrete token sequences, their internal representations are high-dimensional and continuous, but their outputs are forced into a sparse, ambiguous, non-differentiable symbolic form that loses information when used as an inter-agent channel.

They formalize this as a semantic misalignment problem: cascading encode/decode cycles across agents accumulate lossy projection errors and prevent gradient flow. The paper calls for a new multi-agent modeling paradigm where agents coordinate via structured, learnable representations shaped by role persistence, state tracking, and explicit coordination graphs, rather than free-form natural-language dialogue.

Key Ideas

Natural language is a lossy, non-differentiable projection of LLM hidden states.
Cascading communication rounds accumulate semantic error.
Protocol-induced misbehavior: naive-literal interpretation and action-state decoupling.
Advocates structured message schemas, role-consistent embeddings, coordination graphs.
Critique of AutoGen, MetaGPT, CAMEL-style NL-based multi-agent frameworks.

Connections

Agent Communication Languages
Multi-Agent Systems
LLM Agents
Ripple Effect Protocol
CBCL - Safe Self-Extending Agent Communication — structural alternative to free-form NL: a DCFL-bounded ACL whose grammar makes coordination semantics explicit and parser-equivalent across implementations.

Conceptual Contribution

Claim: Natural language is an accidental, lossy, non-differentiable channel for inter-LLM Agents coordination; multi-agent AI needs a purpose-built representational substrate.
Mechanism: Formalises repeated encode/decode cycles as error-accumulating projections from continuous hidden states to sparse tokens; diagnoses “protocol-induced misbehavior” (naive-literal reading, action-state decoupling); prescribes structured schemas, role-consistent embeddings, and explicit coordination graphs.
Concepts introduced/used: Semantic Misalignment, Emergent Communication, Coordination Graphs, Multi-Agent Systems, LLM Agents, Agent Communication Languages, Differentiable Protocols
Stance: critique
Relates to: Provides the theoretical motivation that Ripple Effect Protocol and Levels Of Social Orchestration operationalise; contrasts with the symbolic, performative-centric designs of KQML and FIPA-ACL by rejecting symbolic channels entirely.

Tags

Public Semantics

ACL semantics grounded in externally observable facts (commitments, roles, institutional state) rather than private mental state.

In this vault

ACL Rethinking Principles
Agent Communication And Institutional Reality
Commitment-based Semantics
Mentalistic Semantics
CBCL - Safe Self-Extending Agent Communication — dialect installation as a public commitment

Mentalistic Semantics

ACL semantics in which each message commits the sender’s (and sometimes receiver’s) beliefs and intentions — powerful but unverifiable from outside.

In this vault

Knowledge and Common Knowledge in a Distributed Environment

Reference

Halpern, J. Y., & Moses, Y. (1990). “Knowledge and Common Knowledge in a Distributed Environment.” Journal of the ACM, 37(3), 549-587. URL

Summary

Halpern and Moses recast distributed protocol design as knowledge transformation: sending a message changes the knowledge state of the system, and correctness specifications can be stated in terms of what individual processes, groups, or “the system” know at various points. The paper develops a formal epistemic logic for distributed systems with operators K_i (agent i knows), E (everyone knows), and C (common knowledge — everyone knows that everyone knows, to infinite depth).

The central technical result is striking: in a truly asynchronous distributed system, common knowledge is unattainable. The classical “coordinated attack” problem (two generals must attack simultaneously but communicate only via lossy messengers) is unsolvable because simultaneous action requires common knowledge of the time to attack, and no finite message chain ever reaches the fixpoint. The muddy children puzzle — a beloved epistemic set piece walked through in the opening — shows how a public announcement can create common knowledge that sequential private reasoning cannot, illuminating why synchronous broadcast matters.

Because strict common knowledge is unattainable, the paper introduces and characterises weaker variants: eventual common knowledge, ε-common knowledge (bounded delay), timestamped common knowledge, and concurrent common knowledge. Each corresponds to a different system model (synchronous, partially synchronous, etc.) and a different class of solvable coordination tasks. This framework turned “what does a protocol achieve?” into a precise epistemic question and seeded the entire field of Theoretical Aspects of Reasoning about Knowledge (TARK).

Key Ideas

Epistemic hierarchy: distributed knowledge ⊑ someone knows ⊑ everyone knows (E) ⊑ common knowledge (C).
Common knowledge (C): fixpoint E^ω — needed for any simultaneous coordinated action.
Coordinated attack / muddy children: canonical illustrations of how public announcements create C.
Impossibility: in async or even synchronous-with-uncertain-delivery systems, C cannot be attained by message exchange.
Weakenings: ε-C (bounded-time C), eventual C, timestamped C, concurrent C — each aligned with a synchrony assumption.
Protocols as knowledge transformers: specifications are claims about K_i, E, C; message sends are knowledge updates.
Runs-and-systems semantics: each global history is a “run”; agent’s knowledge is the set of runs it cannot distinguish from the actual one.

Connections

Epistemic Logic
Epistemic S5
Knowing What vs Knowing That
The Synthesis of Digital Machines with Provable Epistemic Properties — Rosenschein-Kaelbling operationalise this framework.
Time Clocks and the Ordering of Events in a Distributed System — the “local history” underpinning indistinguishable runs is Lamport’s past-cone.
Impossibility of Distributed Consensus with One Faulty Process — consensus impossibility has an epistemic reading: common knowledge of a decision cannot be attained.
CAP Theorem

Conceptual Contribution

Towards Automating the Evolution of Linguistic Competence

Towards Automating the Evolution of Linguistic Competence in Artificial Agents

Reference: Gmytrasiewicz, P. J., Gopal, D. (2000). Technical article, University of Texas at Arlington. Source file: Towards_Automating_the_Evolution_of_Linguistic_Com.pdf. URL

Summary

Gmytrasiewicz and Gopal propose a decision-theoretic framework for artificial agents to autonomously enrich and evolve their shared agent communication language. Each agent has a frame/object-based knowledge representation language (KRL) encoding beliefs about the world and nested beliefs about other agents. Decisions about which messages to send are grounded in expected-utility computations over the effect on the hearer’s mental state, so every well-defined message carries measurable value to the speaker.

When the ACL proves inadequate to express content the agent wishes to communicate, the agents engage in game-theoretic negotiation (after Rubinstein-style alternating offers) over new lexicon items and grammatical rules. Utilities trade off implementation cost, time-discounting, and communicative gain. The framework thus gives a concrete mechanism for pidgin-like emergence of shared ACLs among rational, knowledge-based agents.

Key Ideas

KRL as agents’ “language of thought”; ACL is a translation target.
Message value = expected-utility impact on hearer’s mental state.
Negotiation over lexicon and grammar when ACL is insufficient.
Nested agent models enable rational communication choices.
Decision-theoretic, game-theoretic grounding for language emergence.

Connections

Conceptual Contribution

Claim: The content and extension of an agent communication language can be derived from rational-decision principles: every message carries measurable expected utility, and when the current ACL is insufficient, agents rationally negotiate new lexicon and grammar.
Mechanism: Each agent has a frame-based KRL representing nested beliefs about others; message utility is computed as the expected change in the hearer’s mental state weighed against action value. When no existing ACL expression suffices, Rubinstein-style alternating-offers bargaining over new lexicon items and grammar rules trades off implementation cost, time-discount, and future communicative gain, producing a pidgin-like convergence path.
Concepts introduced/used: Knowledge Representation Language, Expected Utility Communication, Rubinstein Bargaining, Nested Beliefs, Lexicon Negotiation, Pidgin Emergence, Decision-Theoretic ACL
Stance: formal-semantic
Relates to: Provides a decision-theoretic counterpart to the situated emergence of Language Games for Autonomous Robots and the neural emergence studied in On the Pitfalls of Measuring Emergent Communication; its utility-grounded messages contrast with the mentalistic sincerity conditions of Agent-Oriented Programming and FIPA-ACL.

Tags

Toward Automated Evolution of ACLs

Toward Automated Evolution of Agent Communication Languages

Reference: Piotr J. Gmytrasiewicz, Matthew Summers, Dhruva Gopal (2001). AAAI (American Association for Artificial Intelligence). Source file: gmytrasiewicz02towardAutomated.pdf. URL

Summary

Instead of designing ACLs centrally (like KQML or FIPA), the authors propose letting rational, self-interested agents evolve a shared ACL on the fly when they encounter each other. Each agent has its own internal knowledge representation language (KRL) and decides, via Bayesian decision theory and expected-utility calculations, which messages are worth sending and which new ACL constructs are worth negotiating into the shared vocabulary.

Language creation is modeled as a negotiation game drawing on Rubinstein bargaining: agents propose grammatical rules and terminal labels, weigh them against translation/implementation costs and the value of faster communication, and reach Nash-equilibrium agreements. They illustrate with a Wumpus-world scenario, showing how pidgin ACLs grow into richer creole-like languages via unsupervised learning of transducers and negotiation of new lexicon/grammar productions.

Key Ideas

ACL emerges from pairwise negotiation instead of top-down standardization.
Rational agents use expected-utility gains from communication to drive language extension.
Translator modeled as a finite-state transducer between KRL and ACL.
Rubinstein bargaining gives closed-form agreement on new ACL constructs.
Evolution from pidgin to creole through repeated interaction.

Connections

Conceptual Contribution

Claim: Agent communication languages need not be standardised top-down (KQML, FIPA); rational agents can initiate, enrich, and evolve a shared ACL through game-theoretic negotiation driven by expected-utility gains from improved communication.
Mechanism: Each agent owns a private KRL and a finite-state transducer translating KRL ↔ ACL; decision-theoretic message selection (Bayesian, utility-maximising) identifies candidate new lexical/grammatical constructs; a Rubinstein-bargaining model with time discounting, implementation cost, and identity assumptions yields Nash-equilibrium agreements that extend the shared ACL grammar. Illustrated on a Wumpus-world example.
Concepts introduced/used: ACL Evolution, Knowledge Representation Language, Finite-State Transducer, Rubinstein Bargaining, Pidgin and Creole, Value of Communication, Unsupervised Grammar Induction, Mechanism Design
Stance: formal-semantic / engineering
Relates to: Offers a decentralised alternative to the standardisation stance of KQML Overview and FIPA-ACL; resonates with Emergence of Grounded Compositional Language in Multi-Agent Populations and Emergent Communication which study language emergence from interaction; the bargaining apparatus parallels commitment-based approaches in Agent Communication And Institutional Reality.

Tags

Multi-Agent Cooperation and the Emergence of Natural Language

Multi-Agent Cooperation and the Emergence of (Natural) Language

Reference: Angeliki Lazaridou, Alexander Peysakhovich, and Marco Baroni (2017). ICLR 2017. Source file: 1612.07182v2.pdf. URL

Summary

Introduces a referential-game framework for studying emergent communication: a sender sees a target/distractor image pair and sends a single symbol from a fixed vocabulary; a receiver must identify the target using that symbol. The agents are blank-slate neural networks trained only by communication-success reward. The paper studies whether agents converge, whether the emergent symbols align with human-interpretable semantics, and how to nudge the system toward natural-language-compatible codes.

Two sender architectures (agnostic vs informed) are compared; the informed sender produces richer vocabulary usage. A supplementary supervised image-labelling objective is shown to ground agent symbols to human concepts, making them partially interpretable to crowd-workers.

Key Ideas

Referential games as minimal test-beds for emergent protocols
Informed (feature-aware) sender yields more human-like symbol usage
Symbol purity measured against conceptual (McRae) categories
Mixing self-play with supervised labelling grounds emergent codes to natural language
Foundational for later emergent-communication literature

Connections

Conceptual Contribution

Claim: Two neural-network agents playing a referential game (sender/receiver over image pairs) can develop a symbolic code from scratch; with architectural and supervisory nudges, that code can be made to align with human-interpretable object categories.
Mechanism: Lewis-style signalling game with REINFORCE training; contrast agnostic vs informed sender architectures; analyse symbol-to-category purity; then mix supervised image-labelling with self-play to ground emergent symbols in human vocabulary (AlphaGo-inspired). Crowdsourced evaluation shows humans can guess the correct image 68% of the time from emitted symbols.
Concepts introduced/used: Emergent Communication, Referential Games, Lewis Signalling Games, Language Games, Grounding in Human Language, Symbol Grounding Problem, Cheap Talk, Symbol-Category Purity, REINFORCE, Compositionality
Stance: empirical / deep-learning
Relates to: Companion/precursor to Emergence of Grounded Compositional Language in Multi-Agent Populations (physical grounding, >2 agents). Feeds the emergent-protocol thesis of A Scalable Communication Protocol for Networks of LLMs. Contrasts with stipulated-semantics ACLs (KQML as an Agent Communication Language, FIPA-ACL).

Tags

Language Games for Autonomous Robots

Reference: Steels, L. (2001). IEEE Intelligent Systems, Sept/Oct 2001. Source file: steels01languageGames.pdf. URL

Summary

Steels presents language games as a paradigm for creating grounded, open-ended dialogue between autonomous robots and humans. A language game is a scripted verbal interaction situated in a shared environment that simultaneously exercises perception, conceptualization, verbalization, interpretation, and action. By playing repeated games, agents integrate disparate AI components (vision, speech, planning, learning) into a coherent whole and bootstrap shared vocabulary and meaning without a central designer.

The paper details the guessing game as a canonical example: a speaker picks a topic, conceptualizes a distinguishing feature, verbalizes it, and the listener tries to identify the referent — feedback updates their lexicons’ association scores. Experiments on Sony AIBO and the “Talking Heads” setup show how robots acquire words like color and spatial terms through embodied interaction. Language games thus provide a framework for studying the emergence of grounded communication conventions.

Key Ideas

Language games integrate perception, conceptualization, and action.
Guessing game as a minimal grounded-dialogue protocol.
Shared context + feedback drives lexicon convergence.
Talking Heads experiment: lexicons emerge via population interaction.
Language games tackle integration and grounding jointly.

Connections

Conceptual Contribution

Claim: Grounded, open-ended communication in robots can emerge from repeated situated “language games” that co-exercise perception, conceptualisation, verbalisation and action — with no central designer of the lexicon.
Mechanism: Steels formalises the guessing-game protocol: speaker selects a topic in shared scene, computes a distinguishing category, encodes it as a word; listener decodes, points, and success/failure feeds back to associative lexicon scores. Embodied populations of Sony AIBOs and the Talking Heads platform empirically show lexicon convergence over colour, spatial and proper-name vocabularies, demonstrating that integration of AI sub-systems and semantic grounding are solved jointly rather than separately.
Concepts introduced/used: Language Game, Guessing Game, Grounding, Lexicon Convergence, Talking Heads Experiment, Semiotic Cycle, Emergent Communication
Stance: empirical
Relates to: Provides an embodied-situated counterpart to the decision-theoretic language emergence of Towards Automating the Evolution of Linguistic Competence and the neural-MARL emergence of Emergence of Grounded Compositional Language in Multi-Agent Populations; its feedback-driven convergence contrasts with the top-down protocol stipulation of FIPA-ACL.

Tags

Focal Point

Schelling’s (1960) concept: in a coordination game with multiple equilibria, the equilibrium parties converge on by virtue of salience — some feature that “stands out” in their shared informational and cultural background, distinguishing it from the others. Salience is not derivable from the payoff structure alone — it depends on context, prominence, simplicity, history. The cognitive mechanism by which Lewis-style conventions emerge without explicit agreement.

In this vault

Mutual Expectation

The infinite hierarchy of expectations that sustains a Convention (Lewis): each party expects others to follow R, expects others to expect them to follow R, and so on. Equivalent to (and rediscovered as) common knowledge in game theory and distributed systems. The operative epistemic condition that makes a regularity self-sustaining without explicit agreement.

In this vault

Common Knowledge (Convention)

The infinite hierarchy of mutual expectation introduced by Lewis (1969) and rediscovered by Aumann (1976) in game theory and Halpern–Moses (1990) in distributed systems: A knows p, A knows that B knows p, A knows that B knows that A knows p, … all the way up. A convention is sustained by common knowledge of the regularity. The construction has the same mathematical content in three independent fields — Lewis-style social philosophy, game theory, and distributed-systems epistemology — and is unattainable in fully asynchronous distributed systems (Halpern & Moses), with deep consequences for what coordination protocols can achieve.

In this vault

Convention (Lewis)

David Lewis’s (1969) game-theoretic analysis of conventions: a regularity R in the behaviour of a population is a convention iff almost everyone conforms to R, almost everyone expects almost everyone else to conform, almost everyone prefers conforming on the assumption that others conform, and some alternative regularity could equally have served. Sustained by Mutual Expectation / common knowledge. Foundational analysis of how shared meaning, currency, and social roles arise without explicit agreement.

In this vault

Coordination Game

In game theory, a strategic situation with multiple Pareto-comparable equilibria where players prefer reaching any equilibrium to none, with limited or no preference over which one. The driving-side game (drive-on-the-right vs drive-on-the-left), Schelling’s meeting-place games, and the conventional-language game are paradigm examples. Lewis’s conventions are precisely the regularities that solve coordination games for a population of agents.

In this vault

The Society of Mind

Reference: Marvin Minsky (1986). Simon & Schuster (Touchstone). ISBN 0-671-65713-5. Source file: minsky-society-of-mind.pdf. URL

Summary

Minsky’s landmark synthesis: mind is built from many small agents each of which by itself can only do very simple things, yet collectively — through the right kinds of organisation — give rise to intelligence. Thirty short chapters (each a few pages of essays numbered by subsection) develop a cognitive architecture in which no single agent is conscious, no single agent thinks, and no single agent understands — understanding is always a property of a society of agents working together.

The book ranges across agent theory (agents and agencies, hierarchies and heterarchies), memory (K-lines as activatable sets of agents that were co-active when something was learned), introspection (B-brains watching A-brains watching the world), language (polynemes, isonomes, micronemes, pronomes as classes of inter-agent signals), frames (trans-frames for actions, scripts for scenes), reasoning (chains, uniframes, negation), emotion and development (attachment learning, Papert’s principle), individuality (no unified self — an illusion produced by conflicting agencies), and consciousness (a coarse-grained access to the immediately prior mental state). Across all of it the architectural thesis is the same: agencies, not agents, do the work; and the agencies are themselves agencies all the way down.

As a cognitive-architecture proposal the book is a precise anti-unitarian manifesto — against the idea that there is a single central “thinker”, a single logical reasoner, or a single goal-pursuing executive. It is also the philosophical wellspring of modern multi-agent AI: Shoham’s Agent-Oriented Programming, Wooldridge & Jennings’ agent theory, the BDI tradition, and today’s LLM Agents frameworks (MetaGPT, CAMEL, AutoGen, AGENTS) all descend from — and often explicitly cite — this picture.

Key Ideas

Agents and agencies: the mind is a society; each agent is a specialist that knows little on its own; intelligence is organisational
Parts and wholes: a mind has no single “centre”; every whole is made of parts that are themselves wholes of smaller parts
Hierarchies and heterarchies: not pure trees — agencies form overlapping networks with mutual reciprocity
K-lines: Minsky’s theory of memory — a memory is a K-line that, when activated, re-arouses the set of agents whose joint activity earlier constituted the experience
B-brains and levels of introspection: a brain that watches another brain (and so on); the basis of self-knowledge, but also of systematic error
Frames and trans-frames: structured templates for objects and actions; trans-frames carry the origin/trajectory/destination pattern that underwrites verbs and planning
Polynemes / isonomes / micronemes / pronomes: categories of inter-agent signals — the ‘language’ in which agencies speak to each other
Papert’s Principle: genuine mental growth depends less on acquiring new skills than on acquiring better managerial agents that coordinate old ones
Uniframes and the Exception Principle: concepts are unified by exceptions-as-features, not by defining necessary-and-sufficient conditions
The self as society: personal identity is the persistent organisation of one’s agencies, not a unitary soul or homunculus
No sharp line between reasoning and perception: they are the same agency-activation process with different inputs

Connections

Ascribing Mental Qualities to Machines — McCarthy’s companion stance on design-stance mentalism
Intelligent Agents Theory and Practice — Wooldridge & Jennings’ weak/strong agency taxonomy
Agent-Oriented Programming — Shoham’s first-class “agent” abstraction descends from Minsky’s
Multi-Agent Systems
Multiagent Systems Sycara
BDI
Mental State
The Knowledge Level — Newell’s complementary stratification
Computational Boundary of a Self — Levin’s scale-free generalisation of the individual-as-society idea
Theory of Self-Reproducing Automata — the complication-threshold thesis is a direct ancestor
Self-Adaptive Systems
Agents Framework - Zhou et al
MetaGPT Meta Programming for Multi-Agent Collaboration
CAMEL Communicative Agents for Mind Exploration of LLM Society
AutoGen - Multi-Agent Conversation Framework
Multi-Agent Collaboration in AI - Wasif Tunkel
The Rise and Potential of LLM-Based Agents
Why Do Multi-Agent LLM Systems Fail
Language Games for Autonomous Robots
Myconet Fungi Inspired Superpeer Overlay
Ethical Governor
Metacognitive Loop
Ensuring Trustworthy and Ethical Behaviour in Intelligent Logical Agents
Subsumption Architecture
Semantic Information Processing
Common Sense Reasoning

Conceptual Contribution

Claim: Minds — human or artificial — are built from many simple specialist agents whose organised interactions produce intelligence. There is no single locus of thought, understanding, or selfhood; all mental phenomena are agency-level properties that dissolve if you look for them at the single-agent level.
Mechanism: Thirty small chapters each arguing from introspective examples, developmental psychology, and computational thought-experiments to commit to a specific architectural hypothesis — K-lines for memory, trans-frames for action, pronomes/polynemes for inter-agent signalling, B-brains for introspection, Papert’s principle for growth, the exception principle for concepts. No single chapter is decisive; the book’s force is cumulative.
Concepts introduced/used: Society of Mind, Agents (Minsky), Agencies, K-Lines, Trans-Frames, Pronomes, Polynemes, Isonomes, Micronemes, B-brains, Papert’s Principle, Uniframes, Difference-Engines, Frames (AI), Exception Principle, Investment Principle, Society-of-More
Stance: foundational / essay
Relates to: Minsky’s book is the direct ancestor of the Multi-Agent Systems paradigm. Agent-Oriented Programming, Intelligent Agents Theory and Practice, Multiagent Systems Sycara all inherit the agent-as-specialist framing. The modern LLM-agent revival (MetaGPT Meta Programming for Multi-Agent Collaboration, CAMEL Communicative Agents for Mind Exploration of LLM Society — note the name! — AutoGen - Multi-Agent Conversation Framework, The Rise and Potential of LLM-Based Agents) explicitly returns to the Society-of-Mind idiom: competence emerges from societies of small specialists talking to each other, not from a single monolithic model. B-brains prefigure the runtime self-oversight loop of Ensuring Trustworthy and Ethical Behaviour in Intelligent Logical Agents and the Metacognitive Loop / Ethical Governor. The anti-unitarian account of the self sits beside Computational Boundary of a Self (Levin) and the scale-free-cognition programme. Read alongside The Knowledge Level: Newell describes what such a system means at the agent level; Minsky gives a candidate how.

Cooperative Principle

Grice: the over-arching rule that participants in a conversation cooperate — contribute what is required, when required, at the required level of quality, relevance, and clarity.

In this vault

Logic and Conversation

Reference: Grice, H. P. (1975). In P. Cole & J. L. Morgan (Eds.), Syntax and Semantics, Vol. 3: Speech Acts, pp. 41–58. Academic Press. (Originally delivered as the 1967 William James Lectures at Harvard.) Source file: grice_logic_and_conversation.pdf. URL

Summary

Grice’s foundational paper introduces the theory of conversational implicature: the mechanism by which speakers convey more than they literally say. Starting from the divergences formalists find between natural-language connectives (and, or, if, not, all, some) and their formal analogues, Grice argues the divergences do not show natural language is defective; rather, they arise from principles governing rational cooperative exchange, not from logical form.

At the centre is the Cooperative Principle: “Make your conversational contribution such as is required, at the stage at which it occurs, by the accepted purpose or direction of the talk exchange in which you are engaged.” The principle decomposes into four categories of maxims — Quantity (be as informative as required, no more), Quality (try to make your contribution true), Relation (be relevant), and Manner (be perspicuous). Speakers exploit these maxims — by apparently flouting them while the Cooperative Principle remains in force — to generate conversational implicatures that the hearer can calculate. The paper distinguishes what is said from what is implicated, and conventional from conversational implicatures, establishing the framework in which pragmatics has operated ever since. Its picture of communication as rational, cooperative, defeasible inference over an idealised shared purpose became a touchstone for ACL design, HCI dialogue systems, and the pragmatics of LLM prompting.

Key Ideas

What is said vs. what is implicated.
Conventional vs. conversational implicature.
Cooperative Principle as constitutive of rational discourse.
Four maxim categories: Quantity, Quality, Relation, Manner.
Implicatures arise from (apparent) maxim-flouting under the CP.
Implicatures are calculable, cancellable, non-detachable.
Natural-language/formal-logic divergences need not reflect semantic defect.

Connections

Conceptual Contribution

Claim: Successful communication rests on a presumed Cooperative Principle and its four categories of maxims; apparent violations of the maxims, against the background of presumed cooperation, generate implicatures — inferences about speaker meaning that go beyond literal content.
Mechanism: Grice frames discourse as goal-directed rational cooperation; derives the Cooperative Principle as a rationality constraint on contributions; distinguishes its maxims by Kantian category; shows that a speaker who says p while flouting a maxim (e.g., irrelevantly, uninformatively, or obscurely) signals that a further proposition q must be inferred to restore the presumption of cooperation — q is then conversationally implicated. Implicatures are calculable from the maxims plus context, cancellable without contradiction, and non-detachable from what is said.
Concepts introduced/used: Cooperative Principle, Conversational Implicature, Conventional Implicature, Gricean Maxims, Speaker Meaning, What Is Said
Stance: philosophical/pragmatic theory
Relates to: Complements the illocutionary classification of A Taxonomy of Illocutionary Acts by supplying a theory of pragmatic enrichment; informs the semantic/pragmatic layer distinctions in Agent Communication Languages and critiques of mentalistic ACL semantics in Agent Communication Languages - Rethinking the Principles; underpins the rational-speaker assumptions implicit in prompt engineering and LLM Agents.

Tags

Speech Act Theory

Philosophy-of-language framework (Austin, Searle, Vanderveken) in which utterances perform actions (illocutionary acts) — the semantic backbone of most Agent Communication Languages.

Sources

Foundations Of Illocutionary Logic — Searle & Vanderveken
Three Models for the Description of Language — Chomsky, foundations
Agent Communication And Institutional Reality

Applied in

Lineage

graph TD
  A["Austin (1962)<br/>How to Do Things with Words"] --> A1[Locutionary]
  A --> A2[Illocutionary]
  A --> A3[Perlocutionary]
  A2 --> S["Searle (1969, 1975)<br/>Speech Acts · Taxonomy of Illocutionary Acts"]
  S --> S1[Assertives]
  S --> S2[Directives]
  S --> S3[Commissives]
  S --> S4[Expressives]
  S --> S5[Declarations]
  G["Grice (1975)<br/>Logic and Conversation"] -.cooperative principle.-> S
  S --> V["Searle & Vanderveken (1985)<br/>Foundations of Illocutionary Logic"]
  V --> M["McCarthy (1989)<br/>Elephant 2000"]
  V --> KQML[KQML performatives]
  V --> FIPA[FIPA-ACL performatives]
  M --> FIPA
  KQML --> ACL[[Agent Communication Languages]]
  FIPA --> ACL

Papers: How to Do Things with Words · Speech Acts - An Essay in the Philosophy of Language · A Taxonomy of Illocutionary Acts · Logic and Conversation · Foundations Of Illocutionary Logic · Elephant 2000 - A Programming Language Based on Speech Acts

Norms and Obligations

Deontic-logic concepts: norms are rules governing conduct; obligations are their modal counterparts an agent is required to satisfy — BOID gives them first-class status alongside beliefs and desires.

In this vault

Common Business Communication Language

The Common Business Communication Language

Reference: John McCarthy (1975/1982, revised 1998/1999). Stanford CS Department. Source file: cbcl2.pdf. URL

Summary

McCarthy’s 1975 memo (revived in 1998 with footnotes anticipating XML and electronic commerce) sketches a Common Business Communication Language (CBCL) allowing computers from different organizations to exchange business messages - requests for quotations, offers, order status, delivery queries - without pre-arranged bilateral formats. The paper enumerates requirements: open-endedness, pre-existing compatibility, independence of internal data formats, and ability to fall back to human-readable form when a receiver does not understand a new message.

He proposes messages as nested parenthesized lists (a Lisp-like syntax McCarthy argues is isomorphic to but simpler than XML), adjectival modifiers (ADJECTIVE FOO YELLOW), and Russell description operators for referring expressions. The essay prefigures KQML-style performatives and electronic data interchange, and closes with 1998 advice to XML, W3C, and ICE on extensibility, Lisp-style syntax, and standard time formats.

Key Ideas

Inter-organizational computer communication without pre-arranged formats.
Lisp-style S-expression syntax isomorphic to but simpler than XML.
Adjectival modifiers (ADJECTIVE x y as a kind of y) for partial understanding.
Non-monotonic reasoning required for natural-language-like expressivity.
Proto-KQML vision of semantic business messaging.

Connections

KQML
Agent Communication Languages
Three Models For The Description Of Language
Ontologies
Elephant 2000 - A Programming Language Based on Speech Acts — companion McCarthy proposal; CBCL messages are the inter-organisational counterpart of Elephant’s intra-program speech acts.
First Order Theories of Individual Concepts and Propositions — supplies the sense/denotation machinery CBCL tacitly relies on for descriptions.
Circumscription - A Form of Nonmonotonic Reasoning — the non-monotonic reading of ADJECTIVE and partial-understanding fallback rests on circumscription-style defaults.
Ascribing Mental Qualities to Machines
CBCL - Safe Self-Extending Agent Communication — O’Connor 2026 (LangSec ’26): Lean-verified contemporary realisation of this proposal.

Conceptual Contribution

Claim: Organisations should exchange business messages in a common, open-ended language without pre-arranged bilateral formats; partial understanding must degrade gracefully to human-readable fallback.
Mechanism: Lisp-style S-expression messages (isomorphic to but simpler than XML), adjectival modifiers (ADJECTIVE x y) for partial-match semantics, Russell description operators for referring expressions, non-monotonic reasoning for NL-like expressivity; 1998 footnotes advise XML/W3C/ICE communities.
Concepts introduced/used: Common Business Communication Language, S-expressions, EDI, Non-monotonic Reasoning, Adjectival Modifiers, Agent Communication Languages, Ontologies, Performatives, Speech Act Theory, KQML
Stance: foundational
Relates to: Anticipates the performative-based vision of KQML Language And Protocol and the open discovery ambitions of Agent Network Protocol / Survey Of Agent Interoperability Protocols; its syntactic minimalism resonates with REST’s uniform interface in Principled Design Of The Modern Web Architecture.

Tags

Lexicon Negotiation

A process by which agents in a population iteratively adjust their word-meaning mappings through interaction, converging on a shared vocabulary. A central mechanism in evolutionary and emergent-language models.

In this vault

On the Pitfalls of Measuring Emergent Communication

Reference: Lowe, Foerster, Boureau, Pineau, Dauphin (2019). AAMAS 2019 (Proc. 18th Intl. Conf. on Autonomous Agents and Multiagent Systems). Source file: p693.pdf. URL

Summary

This paper critically examines metrics used to detect and measure emergent communication in multi-agent reinforcement learning. The authors show that commonly used indicators — such as speaker consistency (SC), context independence (CI), mutual information between messages and actions, and message-entropy — can be misleading: agents trained with a communication channel that does not influence their behavior may still exhibit high values on these metrics, producing the illusion of communication.

To disentangle the phenomenon, they propose decomposing communication into positive signaling (messages carry information about a speaker’s observations) and positive listening (messages influence a listener’s subsequent actions). They introduce causal influence of communication (CIC), a causal-intervention-based metric measuring how an agent’s message changes another agent’s action distribution, and demonstrate its properties on matrix communication games (MCGs). They offer concrete recommendations for when each metric should be trusted.

Key Ideas

Speaker consistency can be positive even when no communication happens.
Separate positive signaling from positive listening.
Causal influence of communication (CIC) via interventions on messages.
Matrix Communication Games as a minimal testbed.
Entropy-based metrics are shape-dependent and deceptive.

Connections

Conceptual Contribution

Claim: Popular metrics for emergent communication in MARL cannot distinguish real communication from spurious correlations; communication must be analysed causally, decomposed into signalling and listening.
Mechanism: The authors construct Matrix Communication Games where a policy with a non-influential communication channel still scores high on speaker consistency, context independence, mutual information, and entropy-based measures. They then define positive signalling and positive listening as orthogonal properties, and introduce Causal Influence of Communication (CIC) as a do-calculus intervention that measures how replacing the sent message would change the listener’s action distribution.
Concepts introduced/used: Positive Signalling, Positive Listening, Causal Influence of Communication, Speaker Consistency, Context Independence, Matrix Communication Games, Emergent Communication
Stance: critique
Relates to: Sharpens the empirical agenda of Emergence of Grounded Compositional Language in Multi-Agent Populations and Emergent Communication; its causal framing complements the decision-theoretic message-value account in Towards Automating the Evolution of Linguistic Competence and offers a verifiability foothold missing from the mentalistic semantics critiqued by Agent Communication Languages - Rethinking the Principles.

Tags

Emergence of Grounded Compositional Language in Multi-Agent Populations

Reference: Igor Mordatch and Pieter Abbeel (2018). AAAI-18. Source file: 11492-13-15020-1-2-20201228.pdf. URL

Summary

Proposes a multi-agent environment and differentiable training procedure in which agents develop an abstract compositional communication protocol purely from the need to coordinate on non-linguistic goals (move-to-location, look-at, etc.) in a 2D world with landmarks. Agents emit streams of discrete symbols (Gumbel-Softmax relaxed) along with physical actions; symbols acquire stable, interpretable meanings corresponding to goal types, landmarks, and agent identities.

The emergent language exhibits syntactic ordering, vocabulary-size regularization via a Dirichlet-process-inspired penalty, and non-verbal strategies (pointing, guiding) when symbols are disabled. The paper is a foundational piece in the modern “emergent communication” literature.

Key Ideas

Communication emerges from cooperative multi-agent RL with shared reward
Gumbel-Softmax makes discrete symbol channels differentiable
Vocabulary-size penalty (DP-style) prevents symbol proliferation and encourages compositionality
Non-verbal channels (gaze, position) substitute when verbal is unavailable
Symbols ground to concepts: GOTO, color, landmark/agent identity

Connections

Conceptual Contribution

Claim: A basic compositional language with coherent vocabulary and rudimentary syntax can emerge from scratch among agents in a physically-grounded, cooperative multi-agent environment, driven purely by the need to coordinate on shared goals.
Mechanism: N agents with private goals share a continuous 2D environment and emit discrete symbol streams; policies are trained end-to-end with differentiable communication (Gumbel-Softmax), shared reward, plus a Dirichlet-process-inspired vocabulary-sparsity penalty and an auxiliary goal-prediction reward. Non-verbal strategies (pointing, gaze) emerge when symbolic channel is unavailable.
Concepts introduced/used: Emergent Communication, Grounded Compositional Language, Symbol Grounding Problem, Compositionality, Gumbel-Softmax, Multi-Agent Reinforcement Learning, Referential Games, Language Games, Non-verbal Communication, Vocabulary Size Penalty, Dirichlet Process
Stance: empirical / computational-simulation
Relates to: Companion to Multi-Agent Cooperation and the Emergence of Natural Language (also referential games but 2-player, image-based). Contrasts with the pre-designed KQML as an Agent Communication Language and FIPA-ACL approaches: here semantics emerge from task pressure rather than being stipulated. Resonates with the emergent-protocol behaviour Agora exhibits in A Scalable Communication Protocol for Networks of LLMs.

Tags

The Strategy of Conflict

Reference: Schelling, T. C. (1960). The Strategy of Conflict. Harvard University Press, Cambridge MA. (Reprinted 1980 with new preface.) Harvard UP page · Internet Archive borrow (book; no full-text OA.)

Summary

Schelling reframes game theory as the theory of strategic interdependence — the analysis of decision-making in situations where each party’s best move depends on what they expect the others to do, including in situations of mixed conflict and cooperation. The book opposes the prevailing post-von-Neumann emphasis on zero-sum games and pure conflict; Schelling’s central observation is that almost all real strategic situations have both conflict and cooperation elements, and the interesting analytic work is in the cooperation-within-conflict structure. The book’s most enduring concept is the focal point (or Schelling point): in a coordination problem with multiple equilibria, parties converge on the equilibrium that is salient — distinguished by some feature that “stands out” in the shared cultural / informational background. Schelling demonstrated this experimentally: subjects asked to meet a stranger in New York City on a particular day, with no prior communication, overwhelmingly converged on Grand Central Terminal at noon. There is no equilibrium-selection argument in classical game theory that picks Grand Central; saliency does. Other lasting contributions include the analysis of credible commitment (binding oneself in advance can be a strategic asset, not a constraint); the concept of the threat that leaves something to chance; precommitment via burning bridges; tacit bargaining; and an early treatment of arms-race dynamics. The book inaugurated the modern study of bargaining, conflict resolution, and coordination — and won Schelling the 2005 Nobel Prize in Economics. For agent communication, the central inheritance is the focal-point concept: when explicit communication is impossible or noisy, agents coordinate on salient features of their shared situation. Lewis’s <em>Convention</em> (1969) is its philosophical companion.

Key Ideas

Strategy is interdependent decision: the right object of study is the situation in which each party’s payoff depends on others’ actions, not the isolated decision-theoretic agent.
Mixed-motive games: real conflicts almost always combine conflicting and shared interests; pure-conflict zero-sum games are a degenerate special case.
Focal points / Schelling points: in coordination problems with multiple equilibria, parties converge on the equilibrium that is salient in the shared informational and cultural background. Salience is not derivable from the payoff structure alone — it depends on context, history, prominence, simplicity.
Credible commitment as strategic asset: a party that can publicly bind itself in advance often does better than one with full strategic flexibility, because the binding rules out outcomes the other party would prefer to avoid. Burning bridges, hostage-taking, automatic-response systems, and unilateral declarations are concrete devices.
The threat that leaves something to chance: an irrevocably probabilistic threat (a “doomsday machine” with random triggering, a brinksmanship strategy) can credibly deter when a deterministic threat could not — because the threatener does not control whether it will be carried out.
Tacit bargaining: parties can coordinate on outcomes without explicit communication by relying on shared salience and convention.
Arms-race stability vs instability: Schelling distinguishes situations in which arms accumulation reduces incentives to strike first (stabilising) from those in which it increases them (destabilising) — the foundational analysis behind nuclear deterrence theory.

Connections

Conceptual Contribution

Claim: Strategy is the analysis of interdependent decision-making in mixed-motive (conflict + cooperation) situations; the right concepts include credible commitment, focal-point convergence under saliency, the threat that leaves something to chance, and tacit bargaining. These are not derivable from classical zero-sum game theory.
Mechanism: Reframing of game theory as theory of strategic interdependence; experimental and conceptual demonstrations of focal-point coordination; analysis of commitment devices and probabilistic threats; case studies in industrial bargaining, nuclear deterrence, racial integration, and traffic.
Concepts introduced/used: Focal Point, Schelling Point, Tacit Coordination, Credible Commitment, Threat Leaving Something to Chance, Mixed-Motive Game.
Stance: foundational research monograph (Nobel-Prize-winning).
Relates to: Direct philosophical and analytical companion to Lewis 1969 — both treat the equilibrium-selection problem in coordination games, with Lewis emphasising the social-philosophical structure of mutual expectation and Schelling emphasising the cognitive structure of saliency. The two together supply the foundation for every analysis of how shared meaning, currency, social roles, and (now) ACL semantics arise without explicit agreement. In MAS, the focal-point concept underlies role assignment without communication, emergent coordination conventions in ad-hoc teamwork, and the whole study of zero-shot coordination in MARL. In the ACL evolution programme (Toward Automated Evolution of ACLs, Towards Automating the Evolution of Linguistic Competence), focal points appear implicitly as the salient features that drive lexicon convergence. In LLM-agent settings, focal-point reasoning is one of the principal mechanisms by which agents coordinate without protocols — and a primary attack surface, since what is salient to an LLM is shaped by training data in adversarially exploitable ways.

Tags

#game-theory #schelling #focal-points #coordination #bargaining #foundations #credible-commitment