Former Meta news chief Campbell Brown launches Forum AI to evaluate foundation models
Original: Who decides what AI tells you? Campbell Brown, once Meta’s news chief, has thoughts
Why This Matters
Addresses critical AI accuracy concerns as foundation models become primary information sources
Campbell Brown, former Facebook news chief, founded Forum AI 17 months ago to evaluate how foundation models perform on high-stakes topics like geopolitics and mental health. The company recruits world experts to create benchmarks and trains AI judges to evaluate models at scale.
Brown's company Forum AI evaluates foundation models on complex subjects including geopolitics, mental health, finance, and hiring. For geopolitics work, she has recruited experts like Niall Ferguson, Fareed Zakaria, former Secretary of State Tony Blinken, and former House Speaker Kevin McCarthy. The goal is achieving 90% consensus between AI judges and human experts, which Forum AI claims to have reached. Brown founded the company after realizing ChatGPT would become the primary information funnel but wasn't very accurate. Initial evaluations found concerning issues including Gemini pulling from Chinese Communist Party websites for unrelated stories and left-leaning political bias across models. Brown argues foundation model companies focus too heavily on coding and math while neglecting news and information accuracy.