ChatGPT: voice conversations and image analysis for a better experience 🤖

Imagine being able to start a natural conversation with ChatGPT, just as you would with a friend, simply by using your voice, wherever you are. You could ask it to tell a story to your family when you’re out and about, or even resolve a heated debate at the dinner table. Well, now you can, thanks to ChatGPT.

If you’re familiar with using voice assistants, you already have an idea of how this type of interaction works. With the power of ChatGPT, the answers to your questions will be even more precise and natural.

This brand-new voice function is made possible by a brand-new text-to-speech model. It can take a simple text and a few seconds of sample speech to generate a human-like sound. OpenAI has worked in collaboration with professional actors to create each of the voices available. To transcribe your words into text, OpenAI’s open-source speech recognition system, Whisper, is used.

To start taking advantage of this feature, simply go to the mobile application’s settings. Look for the « New Features » option and select « Voice Conversations ». Then, on the home screen, click on the headset button in the top right-hand corner, and choose from five different voices the one that suits you best. It’s that easy!

ChatGPT can help you understand your environment

A few months ago, OpenAI announced that ChatGPT was now able to decrypt and understand images. This feature has been made even easier to use with the latest update to the virtual assistant.

Now you can present one or more images to ChatGPT. You can ask it to solve problems, such as why your barbecue won’t start, explore the contents of your fridge to plan a meal, or analyze complex work-related graphics. To emphasize a specific part of the image, you can use the drawing tool in our mobile application.

It probably reminds you of what Google offers with Google Lens. And once again, thanks to the power of ChatGPT, the experience is much improved.

To get started, press the photo button to capture or select an image. If you’re on iOS or Android, press the plus button first. You can also discuss multiple images or use our drawing tool to guide your assistant.