OpenAI brings ChatGPT Voice to desktop app with agent control

OpenAI has added ChatGPT Voice support to the ChatGPT desktop app, enabling users to control AI agents and execute tasks on their computer through spoken commands.

The feature is powered by the ChatGPT-Live voice model family, launched earlier this month.

It works with both ChatGPT Work and Codex, and can use computer-use skills to interact with websites and applications.

On macOS, the Appshots feature allows the app to access on-screen content, including alt-text.

Unlike the smartphone version of ChatGPT Voice, which was limited to conversation and could not take actions on the phone, the desktop update supports multi-step complex commands.

A demo showed a developer using a single voice command to create a new thread, make a pull request, and find the root cause of a bug.

OpenAI also noted that users can access ChatGPT Voice in Codex from the iOS app via remote access.

Anthropic simultaneously updated its voice mode for Claude, enabling it to use Opus, Sonnet, and Haiku models to complete tasks in apps such as Gmail, Calendar, Slack, Notion, and Canva.

OpenAI's new voice mode makes it to the ChatGPT desktop app | TechCrunch

View Original