ChatGPT can now see, hear, and speak

Time: 2023-09-25

OpenAI is in the process of introducing new voice and image features to ChatGPT. These enhancements provide a fresh and intuitive interface that enables users to engage in voice conversations with ChatGPT or visually convey their topics of discussion.

Rolling out over next two weeks, Plus users will be able to have voice conversations with ChatGPT (iOS & Android) and to include images in conversations (all platforms).

Speak with ChatGPT and have it talk back

You can now employ your voice to participate in dynamic conversations with your virtual assistant. Whether you're on the move, seeking a bedtime story for your family, or resolving a dinner table dispute, it's at your service.

The latest voice feature is driven by a cutting-edge text-to-speech model, proficient in producing remarkably lifelike audio solely from text input and a brief sample of speech. OpenAI partnered with skilled voice actors to meticulously craft each of these voices.

OpenAI also employs Whisper, their open-source speech recognition system, to accurately transcribe your spoken words into text.

Chat about images

You can now present one or multiple images to ChatGPT. Whether you need assistance troubleshooting a non-starting grill, want to delve into your fridge's contents to prepare a meal, or require analysis of a intricate data graph for work purposes, ChatGPT is at your service. For precision in addressing specific aspects of an image, the mobile app also offers a drawing tool.

Original News: ChatGPT can now see, hear, and speak.