Artificial Analysis has launched Optima, a platform enabling engineers to build custom AI benchmarks from proprietary data and workflows rather than relying on standardized public tests (The Decoder). The tool compares models across quality, cost, and time per task - metrics that often provide more signal than raw token pricing for agent-based applications and production workloads.
Anthropically released a safety report disclosing that its internal filtering system for biological and chemical weapons risks remained inactive for nearly a year (The Decoder). During that period, approximately 50,000 external feedback contractors ran about 133 million unfiltered interactions with the models. Separately, Anthropic announced a watermark detection API that will allow third parties to verify whether text was generated by Claude (The Decoder), using a method that adjusts randomness during word selection without degrading text quality.