Microsoft announces auto-generated captions for images in Edge

A simplified Microsoft Edge logo surrounded by teal circles

Microsoft announced a new accessibility feature for its browser to improve the user experience for visually impaired people. Edge now automatically generates image captions so that screen readers can describe visual content for those who depend on assistive technologies. Image captions or "alt text" is a crucial part of the accessible web that often gets ignored, and Microsoft wants to fix this problem by providing auto-generated captions.

Microsoft uses Azure Cognitive Services to analyze and describe pictures with missing "alt text." When Edge detects an unlabeled image, it sends it to Microsoft's servers for processing. Machine learning algorithms can work with the most common formats, such as JPEG, PNG, GIF, WEBP, and others, to provide descriptive summaries in 5 languages. Besides, Microsoft can analyze text on images in more than 120 languages.

As with other automated systems, auto-generated captions in Microsoft Edge are not perfect, and Microsoft warns that the quality will vary. For that reason, the company urges web developers and content managers to make sure images on their websites have user-generated alt text.

Also, Microsoft will not generate descriptions for decorative pictures, images smaller than 50 x 50 pixels, huge images, and explicit content (pornographic, sexually suggestive, or gory content).

Auto-generated captions toggle in Microsoft Edge Settings

If you want to try auto-generated captions in Microsoft Edge, update your browser to the latest version and navigate to Settings > Accessibility, then toggle on the "Get image descriptions from Microsoft for screen readers" feature. For now, it is available in Microsoft Edge for Windows, Linux, and macOS.

Report a problem with article
The new Galaxy A Series
Next Article

Samsung unveils the Galaxy A53 5G, Galaxy A33 5G, and Galaxy A73 5G

Microsoft News Logo in a Recycle Bin with the Windows 11 stock wallpaper on the background
Previous Article

Guide: Here's how to uninstall default Windows 11 apps

4 Comments - Add comment

Advertisement