Microsoft Surface Launch Event: Microsoft announced a host of Copilot+ PCs at its special event on May 20. Apart from the Surface Pro and Surface Laptop and partner OEM machines, the company announced generative AI features such as Recall to search apps, files, and more viewed recently. Plus, the company announced Image editing tools and live translation for the new PCs.
For a detailed look, here are the top AI features announced for Copilot+ PCs at the Surface launch event.
Recall: With Recall, users can access their activity similar to a photographic memory. "Copilot+ PCs organise information like we do – based on relationships and associations unique to each of our individual experiences." This can help recall things from the visual cues a user remembers. Users can view the snapshot timeline across apps, sites, documents and more. The "personal semantic index" is stored locally on the device and users can manage the feature and media from the Settings, pause activity from the System Tray or filter apps and sites from being saved.
Image Editing: The company announced new experiences aided by the new Neural Processing Units (NPUs) and small LLMs in Paint and Photos. With Cocreator, users can refine and edit the AI-generated images. Plus, the creativity slider can be used to adjust the results and Restyle Image allows editing in Photos. Users can select a pre-set to change the background, foreground or full picture. Moreover, Super Resolution can help upscale old and low-quality photos, according to TechCrunch. "On Copilot+ PCs you can generate endless images for free," Microsoft said.
Live Translations: Microsoft announced live translations in Live Captions to turn audio into English captions in real-time across apps via the new NPC on Copilot+ PCs. Users can also translate live or pre-recorded audio in an app or video platform from more than 40 languages into English captions. This will work even if the user is offline.
GPT-4o in Copilot: Microsoft announced it will introduce GPT-4o in Copilot for more natural voice conversations in Copilot+ PCs. Plus, Copilot will be integrated across more spaces on Windows 11 to perform operations in Settings, File Explorer and more, The Verge noted.
Microsoft highlighted the Windows Copilot Runtime (a collection of 40 generative AI models) that will power features like Recall and Super Resolution and allow select operation without the internet. Moreover, the company will also partner with Adobe, DaVinci Resolve Studio, CapCut, Cephable, LiquidText and djay Pro to bring new AI experiences to Copilot+ PCs.