Language Models Can Reduce Asymmetry in Information Markets
Reference: Rahaman, Weiss, Wüthrich, Bengio, Li, Pal & Schölkopf (2024). Language Models Can Reduce Asymmetry in Information Markets. arXiv:2403.14443 (Mila; Max-Planck; AWS AI Labs). URL.
Summary
The paper attacks the buyer’s inspection paradox in information markets — the same Arrow / Nelson disclosure paradox addressed contractually by NDAI Agreements. Buyers need to access information to assess its value; sellers must restrict access to prevent appropriation; in equilibrium, useful information often goes untraded. Rahaman et al. propose a mechanism-design solution using LLM agents with two abilities that humans lack: (i) the capacity to evaluate the quality of privileged information against a query, and (ii) the ability to forget — to be cryptographically or architecturally constrained to discard information when not retained.
They build an open-source simulated marketplace where LLM-powered buyer-agents and seller-agents transact information on behalf of external participants. The seller grants the buyer-agent temporary, evaluable access to proprietary information; if the agent judges the information non-essential, duplicative, or available more cheaply elsewhere, it can discard it without paying. The combination of evaluation + forgetting creates a credible commitment device: vendors can reveal information for valuation without losing it, and buyers can inspect without obligation.
Experiments yield three findings: (a) current LLMs exhibit systematic biases — anchoring, recency, and over-confidence — that produce irrational marketplace behaviour, but well-known debiasing techniques substantially mitigate them; (b) demand for informational goods responds to price in legible, economically intuitive ways; (c) both inspection access and higher budgets improve buyer outcome quality. The paper anticipates and complements the TCME / NDAI proposals that arrived a year later: it provides the agent-architectural version of the “trusted intermediary” thesis that Shumailov et al. and Stephenson et al. then formalise cryptographically/economically.
Key Ideas
- Buyer’s inspection paradox / Arrow Information Paradox: must access information to value it; must restrict access to prevent theft.
- Dual agent capability — evaluate + forget: LLM agents can judge quality of privileged information and be made to discard it.
- Open-source marketplace simulation: buyer-agents and seller-agents transact on behalf of external principals.
- Temporary-access commitment device: vendors safely reveal information for valuation because the agent’s forgetting is enforced.
- Biases identified: anchoring, recency, over-confidence in LLM-driven market behaviour; standard debiasing helps.
- Price elasticity of information: demand responds to price in legible ways — informational goods can be priced like other goods.
- Quality–budget–inspection relationship: inspection access and budget jointly determine outcome quality.
Connections
Conceptual Contribution