Meta unveiled major expansions to its Muse AI agent at Connect 2024, adding video avatars, Mac integration, and retail partnerships that signal serious ambitions in consumer AI.
By Adam Makins·
Meta isn’t taking its foot off the gas with Muse. Just weeks after launching its personal AI agent in early September, CEO Mark Zuckerberg took the stage at Meta’s Connect event in Menlo Park to announce a wave of new capabilities that paint a picture of where the company believes consumer AI is headed: everywhere, integrated into everything, and always working on your behalf.
Muse, powered by Meta’s multimodal Muse Spark model, is designed to handle the repetitive grunt work that clutters our digital lives. It connects to your apps, email, calendar, and now, thanks to Wednesday’s announcements, it’s about to become significantly more personable and capable.
One of the more intriguing debuts is the Muse Realtime Avatar feature. Users will soon be able to create a distinct digital avatar for their agent and video chat with it in real time. This moves Muse from the realm of faceless software to something that actually looks back at you. Meta demoed the feature on stage, showing an agent with a body, voice, and personality that users can interact with naturally. It’s a calculated move to make AI assistance feel less transactional and more relational.
The avatar feature hints at Meta’s broader metaverse ambitions while also acknowledging something fundamental about human psychology: we connect better with faces. Whether that’s necessary for an AI agent to function is debatable, but it certainly makes the interaction more approachable for the average user.
Meta’s also bringing Muse to its smart glasses line. Users will soon be able to communicate with their agent simply by speaking to their glasses, activating it with a wake word. The agent can then guide you through workouts, log meals, book appointments, and help you buy products you see in real time. It works in the background, checking in when tasks are complete.
Then there’s the Mac integration. Much like similar agents from competitors, Muse will be able to operate any app on a user’s desktop, automating workflows for small businesses or just handling tedious work while you step away. Meta’s chief AI officer Alexandr Wang pitched it as the ultimate productivity multiplier.
To make this seamless, Meta is giving Muse its own email address. Users will be able to forward emails to the agent or add it directly to email threads, letting it work on tasks asynchronously. It’s a small detail that actually matters a lot for making an AI agent feel like a genuine team member.
Perhaps most revealing is Muse’s integration with retail and shopping. Meta has locked in partnerships with Stripe, Shopify, Best Buy, Gap, Sephora, Walmart, Wayfair, Expedia, and soon Instacart. The agent can access entire product catalogs and execute purchases across these platforms.
This is where Zuckerberg’s comment about Muse eventually making money for both users and Meta becomes clear. “We’re standing behind this by making Muse free for a huge number of tokens, with the expectation that over time we will profit by taking a small fee from transactions,” he said.
It’s a classic freemium play, but for AI agents. Meta gets you hooked on convenience, then takes a cut when the agent actually starts saving you time and money on purchases. The retailer partnerships suggest major companies are betting this strategy will work.
Meta opened up its platform to third-party developers, and the response was staggering: over 1,500 connector applications in less than a week. Wang called it “a generational opportunity to start building for a new platform as it takes off.”
That’s the real story here. Meta isn’t just building a single AI agent. It’s attempting to create an ecosystem where thousands of services can plug into Muse, making it increasingly indispensable. The more connectors available, the more useful Muse becomes, and the more entrenched it gets in users’ digital lives.
Zuckerberg’s vision is audacious: “In the coming years, I expect that Muse is going to grow into the personal superintelligence that billions of people around the world are going to use to accomplish their goals and improve their lives.”
Whether Meta can actually pull this off remains to be seen, but they’re clearly betting their consumer AI future on it. If Muse becomes truly pervasive across devices, services, and platforms, the question shifts from whether AI agents matter to whether any consumer company can afford not to integrate with Muse.
Source: TechCrunch
