Meta AI introduces voice chat and photo editing features

Meta has unveiled significant updates to its AI capabilities at Meta Connect 2024, bringing new features to Facebook, WhatsApp, Messenger, and Instagram DMs.

Key highlights of the Meta AI update include:

  • Voice conversations with Meta AI, including celebrity voices
  • Image analysis and information retrieval
  • AI-powered photo editing capabilities
  • Enhanced multimodal features powered by Llama 3.2 model

Voice conversations with Meta AI

Meta AI now supports two-way voice conversations across its major platforms. Users can interact with the AI using voice commands and receive both audio and text responses.

While voice interactions aren’t new in the AI chatbot world, Meta has added a unique twist by incorporating celebrity voices. Users can now converse with AI versions of:

  • Dame Judi Dench
  • Kristen Bell
  • Awkwafina
  • John Cena
  • Keegan Michael Key

This feature adds a fun and engaging element to AI interactions, potentially making them more appealing to a wider audience.

Image analysis and information retrieval

Meta AI now offers enhanced image recognition capabilities. Users can share images with the AI to obtain detailed information about the contents. For example:

  • Identify unknown plants or flowers
  • Get recipes for dishes based on food images
  • Learn about landmarks or objects in photos

AI-powered photo editing

One of the most impressive new features is Meta AI’s ability to edit photos based on user instructions. The AI can:

  • Add or remove objects from images
  • Change backgrounds
  • Alter clothing or outfits in photos

This feature, if it performs as advertised, could be a game-changer in the realm of AI-assisted photo editing. It offers capabilities that are typically found in more specialized AI tools or limited to high-end devices.

Additionally, Meta AI can generate custom backgrounds for Instagram stories that complement user-uploaded photos.

Multimodal capabilities and future developments

These new features are powered by Meta’s Llama 3.2 model, representing a significant step forward in multimodal AI capabilities. However, Meta acknowledges that there’s still room for improvement to compete with other leading AI platforms.

Other upcoming features include:

  • Translation tools for content creators
  • AI-generated content in user feeds (currently in testing)

While these advancements are impressive, some users may find Meta’s aggressive promotion of AI features across its platforms overwhelming. The company’s approach of integrating AI deeply into its services contrasts with other platforms that offer AI as an optional tool.

As these features roll out, users will have the opportunity to explore and evaluate the practical benefits of Meta’s enhanced AI capabilities in their daily social media interactions.