News

Separating signal from noise in coding evaluations

OpenAI's audit of SWE-bench Pro reveals that roughly 30% of its tasks are broken due to overly strict tests, underspecified prompts, and other issues, leading the team to retract their earlier recommendation. The analysis used automated filtering, agent-assisted review, and human annotation to uncover these flaws, offering a sobering lesson in the difficulty of curating fair coding benchmarks for safety-critical evaluation.

Read MoreSeparating signal from noise in coding evaluations

General Intuition thinks robotics is about to have its ChatGPT moment

Before foundation models, building specialized NLP models meant collecting and training on vast amounts of task-specific data. Now, most teams start with a general model like GPT or Llama and fine-tune it. Pim de Witte, CEO of General Intuition, argues embodied AI is about to follow the same trajectory. He believes the current approach of gathering enormous real-world datasets for each robot, environment, and embodiment is redundant.

Read MoreGeneral Intuition thinks robotics is about to have its ChatGPT moment

SpaceXAI launches Grok 4.5 as a cheaper Opus-class model

SpaceXAI's Grok 4.5 enters the model wars with aggressive pricing at $2/$6 per million tokens, claiming Opus-class capability with twice the token efficiency. This release directly challenges the growing cost concerns AI consumers face, making it a strong option for budget-conscious builders who still need competitive performance for routine coding and knowledge work.

Read MoreSpaceXAI launches Grok 4.5 as a cheaper Opus-class model

Why open source AI isn’t hurting Anthropic’s revenue yet

A sharp look at the two-tier AI economy emerging right now: enterprise customers are moving production workloads to cheaper open source models, but frontier labs like Anthropic still capture most of the spend by dominating early-stage discovery. The article's lifecycle framework reframes open source as a complement, not a threat — at least for now.

Read MoreWhy open source AI isn’t hurting Anthropic’s revenue yet

Savi Security launches app to protect consumers from AI-generated scams

Savi Security, founded by brothers with deep tech backgrounds, launches an app to protect consumers from AI-generated scams like voice cloning and number spoofing. Using real-time call monitoring and AI models including Gemini, the app detects fraudulent patterns during live calls. The $8/month family plan reflects a new era of consumer security software.

Read MoreSavi Security launches app to protect consumers from AI-generated scams

First US Autonomous Ground Vehicles Deployed in Ukraine War Zone

Forterra's deployment of over 100 autonomous ATVs in Ukraine reveals that the immediate value isn't full autonomy but rugged, teleoperated logistics vehicles. The most critical takeaway is that real combat exposes the seams between human and machine, and the path forward requires cheaper, harder vehicles and new training data for battlefield-specific scenarios.

Read MoreFirst US Autonomous Ground Vehicles Deployed in Ukraine War Zone

Inside the $10B Forward-Deployed Engineering Boom

AI labs have committed $9.75B to forward-deployed engineering in 12 months, shifting the bottleneck from model capability to enterprise deployment. Three models are emerging—Microsoft and Amazon use internal headcount, OpenAI and Anthropic use standalone PE-backed entities, and Google Cloud uses partner funds—but all aim to create institutional switching costs that make FDE teams the moat.

Read MoreInside the $10B Forward-Deployed Engineering Boom