Business6 sources

OpenAI embeds safety researchers amid concerns over AI security

  • OpenAI has announced a new safety program to embed six Apollo Research evaluators for four months.
  • The evaluators will investigate whether AI models engage in subversive behavior during training and testing.
  • Concerns have been raised about the restrictions on access and disclosure, potentially impacting the independence of the researchers.
  • OpenAI's move follows a series of warnings from former employees about the prioritization of commercial pressures over safety.
  • The program aims to address plummeting approval and security debacles surrounding the company's AI technology.

Timeline

  1. OpenAI embeds Apollo Research evaluators

    OpenAI will embed six Apollo Research evaluators to investigate its AI models for subversive behavior.

  2. OpenAI’s “Independent Assessment” questioned

    OpenAI announced four independent assessors to investigate internal models, but concerns about independence arise.

  3. OpenAI announces new AI safety program

    OpenAI CEO Sam Altman announced a new AI safety program with restricted access for outside researchers.

  4. Ex-OpenAI researcher donates equity for AI safety

    Former OpenAI researcher Jacob Coxon donates his equity to AI safety research, calling other pursuits distractions.

  5. Latest

    Jacob Coxon protests at Anthropic’s office

    Jacob Coxon, a former Anthropic researcher, protests at Anthropic's office on the company's IPO day.

OpenAI embeds safety researchers amid concerns over AI security | Split Angle