Challenges for policy makers in AI governance:

  1. Performance of frontier LLMs is jagged across different tasks. This makes it difficult to reliably measure or predict what LLMs are capable of (which could trigger certain legislative or regulatory action).
  2. LLMs can be misused by bad actors in ways either unintended by developers or in ways that developers are actively trying to prevent (e.g. cybersecurity, biorisk).
  3. Privacy and ensuring data intended for one purpose is not misappropriated for another.
  4. Ensuring benefits of AI diffuse equitably and any biases in training data are not amplified.
  5. Effective oversight in the face of (i) rapid development cycle, (ii) AI providers based in USA, (iii) vast difference between the resources being channeled to building AI systems vs resources for AI safety, (iv) proliferation of fast-acting autonomous AI systems.
  6. The shift away from isolated static systems (chat, classifier) to multi-agent systems acting autonomously and interacting with external systems.
  7. Poor institutional capacity - existing institutions are ill-placed to handle this rapidly evolving technology.

The fear is too much regulation will stifle innovation and block the benefits of AI, too little risks facilitating any number of harms.

Solutions include: