Meta expands Muse with avatars, Mac control, email, and commerce

Meta used its annual Connect keynote in Menlo Park to detail a wave of new capabilities for Muse, the personal AI agent that launched in early September. The physical avatar for the agent is named Jolly, according to CEO Mark Zuckerberg, who framed Muse as the centerpiece of Meta‘s consumer AI bet and said it could grow into “the personal superintelligence that billions of people around the world are going to use.” Muse is powered by Muse Spark, Meta‘s multimodal AI model built for agentic work, and connects to users’ apps and services, including email and calendars. The company plans to keep Muse free for a large number of tokens and expects to profit over time by taking a small fee from transactions.

The most visible addition is Muse Realtime Avatar, a new AI model that gives the previously faceless agent a distinct digital avatar with a face, body, and voice. Users will be able to have live video conversations with this avatar, give it tasks, and ask it questions; the feature was demoed on stage. Muse will also be integrated with Meta‘s smart glasses line. A wake word summons the agent, which can guide users through a personalized workout, log meals, book an appointment, and buy products they see. Meta says Muse runs in the background and checks back in when it is done; the glasses integration is expected in the coming months.

Meta also confirmed that Muse computer work is coming to Mac, letting users delegate tasks to the agent while it operates any app on the desktop. Meta‘s chief AI officer Alexandr Wang said users can walk away from the computer and Muse keeps working on all the jobs lined up. The agent will also get its own email address, allowing users to add Muse to an email thread or forward emails to be handled on their behalf. Wang said these capabilities will be available “soon” without a more precise timeline.

On the commerce side, Meta has partnerships with Stripe and Shopify, and Muse can access the entire Shopify product catalog agentically, use Lync and Shop Pay to buy products online, and rely on expanded PayPal support. New retail partners include Best Buy, Gap, Sephora, Walmart, and Wayfair, with Expedia and soon Instacart also joining. For developers, Meta opened its platform to build custom connectors to services such as GitHub, Granola, and Notion. Wang said the company received more than 1,500 connector applications in less than a week, calling it “a generational opportunity to start building for a new platform as it takes off.”

Everything new coming to Meta's AI agent Muse | TechCrunch

View Original