• By Vikas Yadav
  • Tue, 26 Sep 2023 09:57 AM (IST)
  • Source:JND

ChatGPT, the viral AI model developed by OpenAI, is getting fresh speech and revamped image capabilities. With the enhancements, users will be able to interact with the model via audio chats and present images to the model to get answers. These come as significant upgrades to the model's capabilities.

The company shared a few instances in which it can prove helpful. According to the blog post, users can click a photograph of a site and chat live with the model about its unique attributes. It can also share a guided tour of a recipe from the images of the available resources.

Also Read: Did You Know ChatGPT Knows Hindi, Punjabi, Bhojpuri And Many Other Indian Languages? Details Here

The voice and image capabilities for the model have started rolling out on the Plus and Enterprise plans. Voice will be available for smartphones (Android and iOS) from the settings and image-based conversations will be available across all platforms.

If you plan to harness these capabilities of ChatGPT, you can consider investing in a paid plan. (Image:Unsplash)

ChatGPT Can Now Speak

Users can ask diverse queries to the model for two-way communication using their voice, and the model will deliver the response via the same medium. In the demo shared by the AI research company, an instance of a bedtime story narrated by ChatGPT is presented. You can configure this from the settings on the mobile app from the 'New Features' section. The live transcription is backed by Whisper, the company's own speech recognition system.

Better Image Capabilities

ChatGPT users can fed multiple images to model and ask queries ranging from analysis of a graph, recipes from the available veggies in the photo and more. Additionally, paid subscribers can also ask the model to stay focused on a specific area of an image using the drawing tool. It is powered by the company's "multimodal GPT-3.5 and GPT-4."

Also Read: ChatGPT Will Now Generate Prompts And Answer Them Too; Top 6 Upcoming Features

If you plan to harness these capabilities of ChatGPT, you can consider investing in a paid plan of the model. For context, ChatGPT Plus starts from around Rs 1,600/month in India.