Bing Chat now offers image recognition 💻🖼️

Cliquez ici pour lire en français

With many tech companies rushing to embrace artificial intelligence, Microsoft’s Bing AI, powered by ChatGPT, has just added image recognition to get ahead of the game.

Bing Vision: Time for image recognition 💻🖼️

Currently being tested with a small number of chatbot users, Bing Vision allows people to upload an image for a query. In other words, instead of typing text, you can send the AI a photo, and it will identify it and provide information about the image.

On Twitter, some privileged users have had the opportunity to test this new feature, and their results demonstrate its usefulness and the right way to use it, allowing us to see a few use cases.

For example, a mathematical equation was scanned and submitted to the chatbot, which correctly identified it as the Schrödinger equation.

Testing the Bing Vision/GPT-4 Vision
Input: A image of the “Schrödinger equation”

Bing: https://t.co/vsSUdHe26q pic.twitter.com/9WfZHbwcG4

— 𝑨𝒓𝒕𝒊𝒇𝒊𝒄𝒊𝒂𝒍 𝑮𝒖𝒚 (@artificialguybr) June 21, 2023

In another example, a photo containing a fan with a sticker of a cartoon character is analyzed and explained by the AI.

OK, I am pretty blown away by what Bing/GPT-4 can do when its ability to process images are turned on. I think this is going to be very useful.

I pulled an image from Reddit from 5 months ago (so post training) and asked it for help – and look at its comment on the sticker! pic.twitter.com/x9JhEi4E2f

— Ethan Mollick (@emollick) June 22, 2023

We also have an example in which it can be used by history buffs to identify monuments or famous places from photos taken during their travels.

Oh, how cool is that! Just noticed that I have access to #Bing chat's image features! @MParakhin reading German text from images needs some work. ☺️ #ai pic.twitter.com/04JfV66PAL

— Karsten Lehmann (@Klehmann79) June 23, 2023

This new feature of Bing Vision offers many interesting possibilities. Mathematics students can also take advantage of it by submitting complex equations to the AI for explanations and solutions.

If you haven’t had a chance to see Bing AI’s image recognition capabilities yet, it’s because only a limited set of users currently benefit from this feature, as mentioned at the start of this article. According to Mikhail Parakhin, head of advertising and web services at Microsoft, this currently concerns just over 10% of the user base.

Bing Vision’s little extra ✅

In conclusion, the addition of image recognition functionality to Bing Vision represents a significant step forward in enhancing the user experience of Microsoft’s chatbot. This new capability enables users to obtain valuable information simply by submitting images, opening up a wide range of possibilities in various fields. Whether for history buffs, math students, security professionals or businesses, this promising feature offers exciting prospects.

Although it’s still in a limited testing phase, it’s exciting to imagine how it could be integrated into Microsoft’s products and services in the future. The future of AI and image recognition looks bright, and Bing Vision is certainly a cornerstone of that evolution.

Sources: Clubic, Neowin