Language Models Can Reduce Asymmetry in Information Markets

2024

Technical Report

ei

This work addresses the buyer's inspection paradox for information markets. The paradox is that buyers need to access information to determine its value, while sellers need to limit access to prevent theft. To study this, we introduce an open-source simulated digital marketplace where intelligent agents, powered by language models, buy and sell information on behalf of external participants. The central mechanism enabling this marketplace is the agents' dual capabilities: they not only have the capacity to assess the quality of privileged information but also come equipped with the ability to forget. This ability to induce amnesia allows vendors to grant temporary access to proprietary information, significantly reducing the risk of unauthorized retention while enabling agents to accurately gauge the information's relevance to specific queries or tasks. To perform well, agents must make rational decisions, strategically explore the marketplace through generated sub-queries, and synthesize answers from purchased information. Concretely, our experiments (a) uncover biases in language models leading to irrational behavior and evaluate techniques to mitigate these biases, (b) investigate how price affects demand in the context of informational goods, and (c) show that inspection and higher budgets both lead to higher quality outcomes.

@techreport{WeiRahetal24,
  title = {Language Models Can Reduce Asymmetry in Information Markets},
  author = {Rahaman, Nasim and Weiss, Martin and W{\"u}thrich, Manuel and Bengio, Yoshua and Li, Li Erran and Pal, Chris and Sch{\"o}lkopf, Bernhard},
  howpublished = {arXiv:2403.14443},
  month = mar,
  year = {2024},
  note = {Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM)},
  doi = {},
  url = {https://arxiv.org/abs/2403.14443},
  month_numeric = {3}
}