'ChatGPT can now see, hear, and speak': OpenAI introduces voice conversations, image analyzing capabilities

OpenAI announced Monday that it is gradually rolling out new voice conversation and image analyzing capabilities in ChatGPT. A blog article from the parent company stated, "ChatGPT can now see, hear, and speak."

The company explained that users will now be able to have back-and-forth voice conversations with the AI platform using a new text-to-speech model. The bot is even capable of understanding rambling, free-flowing conversations and open-ended questions.

ChatGPT was trained by voice actors and can now reply to inquiries and requests with realistic, "human-like audio," OpenAI said. It provides five "personas" to choose from with different tones and accents, the Washington Post reported.

Users can "settle a dinner table debate" or "speak with it on the go" using the platform's mobile app. A video shared by OpenAI featured ChatGPT generating and narrating a creative bedtime story.

The platform's capability to have conversations with users puts it in competition with Amazon's Alexa and Apple's Siri. OpenAI told the Post that by adding the voice feature, it hopes more people will interact with the interface.

OpenAI's vice president of consumer products, Peter Deng, stated, "That's our challenge here."

"One of the hardest jobs is taking that amazing technology and translating it to the simplicity that the next 300-400 million people are looking for," Deng said.

Spotify is currently using the technology to enable podcasters to translate their content into additional languages.

ChatGPT users can also use the AI-powered assistant to troubleshoot by uploading images.

"You can now show ChatGPT one or more images. Troubleshoot why your grill won't start, explore the contents of your fridge to plan a meal, or analyze a complex graph for work-related data. To focus on a specific part of the image, you can use the drawing tool in our mobile app," OpenAI stated.

"Snap a picture of a landmark while traveling and have a live conversation about what's interesting about it," the company said. "When you're home, snap pictures of your fridge and pantry to figure out what's for dinner (and ask follow-up questions for a step by step recipe). After dinner, help your child with a math problem by taking a photo, circling the problem set, and having it share hints with both of you."

The company noted that it plans to make these new features available gradually to mitigate risks and continue to make improvements to the technology. Over the next two weeks, ChatGPT users with Plus and Enterprise subscriptions will have access to the expanded capabilities.

Like Blaze News? Bypass the censors, sign up for our newsletters, and get stories like this direct to your inbox. Sign up here!