Human evaluation asks people to score, rank, compare, or annotate AI outputs. It is essential for qualities such as usefulness, tone, creativity, cultural appropriateness, factual support, and safety when no automatic metric fully represents the goal. A reliable study defines clear criteria, randomizes presentation, includes representative tasks, trains evaluators, and measures agreement. Reviewers can still be inconsistent, fatigued, biased, or influenced by style, brand, and answer length. Preference results also depend on who participates and what context they receive. Human evaluation should protect worker well-being, especially for harmful content, and be combined with automated tests that provide scale and reproducibility.
IBM has partnered with Anthropic to integrate Claude into its enterprise software suite, launching a new AI-first IDE designed to automate development with built-in governance and security.
OpenAI has completed a secondary share sale worth $6.6 billion, letting current and former employees sell stock at a new $500 billion valuation — a milestone in the company’s funding strategy.
OpenAI has introduced Sora 2, a next-generation video AI model with synchronized audio, improved physics, and tighter control, alongside a companion social app.
OpenAI’s next version of its Sora video generator will default to including copyrighted content unless owners explicitly opt out – drawing criticism from media creators.