What’s next for Windows? Microsoft may have just released the Windows 11 2024 Update (24H2), but the company has already revealed its plans for the next generation of Windows apps — and there are some very interesting AIfeatures coming before the holidays.
Microsoft has revealed that it is working on several AI features for Windows and Windows apps: improved Windows Search using natural description language, super resolution in Photos, generative fill and erase in Paint, and the debut of Recall. All features (except Recall) will appear as part of the Windows Insider program in October, with an expected launch in November All of these features will rely on the NPU inside Copilot+ PCs, which will now include PCs with Qualcomm Snapdragon X Elite processors as well as AMD’s Ryzen AI 300 and Intel’s Lunar Lake. Microsoft is also planning to launch more Copilot features that will run in the cloud, including Copilot Voice and Copilot Vision, similar to innovations used in rival AI services. The timing of these new features rolling out will vary by platform, though, as Snapdragon X PCs have been shipping for a few months; Microsoft will bring support to AMD and Intel Copilot+ PCs with its own updates. Microsoft has revealed more details about the improvements to Recall, and the company now says the feature can be bypassed when setting up a new PC or removed later. Windows Recall takes your screenshots from time to time, extracts the data, and then stores it in case you need it later. The feature has come under fire for violating user privacy and being unsafe. Now, Microsoft says it stores the screenshots and extracted data used in Recall in an encrypted area. Security researchers previously said the data was stored unencrypted. New AI features coming to Copilot+ PCs
Microsoft says it plans to improve search on PCs by using more natural language when searching for files on the PC. You may have seen this feature in apps like Microsoft Photos or Google Photos; for example, if you search for “beach,” the apps will use artificial intelligence to identify beach scenes. Microsoft will bring the same technology to File Explorer, but it’s not clear what folders or files they’ll apply to.
The improved Windows Search seems to be more context-aware than before: “BBQ party” is listed as an example search term in the demo below. “You no longer have to remember file names, settings locations, or even worry about spelling — just type what’s in your head to find it on your Copilot+ PC,” Microsoft says. However, it seems unlikely that you’ll be able to find a specific .ini file in your user folder as easily as you can find your aunt’s wedding photos.
The improved search feature will start in File Explorer and then expand to Windows Search and Settings in the “coming months.” “Super Resolution” in Photos is probably my favorite potential application for a few reasons: a.) I have a lot of old photos taken with old, low-quality digital cameras; and b.) Journalists often receive low-resolution photos that need to be enlarged or blown up before they can be published. Regardless, the new “Super Resolution” feature will hopefully solve these problems.
Microsoft announced the Auto Super Resolution feature to improve its gaming capabilities, but Photo Super Resolution seems more practical. Many websites and apps promise to offer upgrades, and it’s unclear whether this new app will surpass them. Photo Super Resolution will be free, though. Microsoft says that using Copilot+ PC’s AITOPS, you’ll be able to increase resolution by eight times. Super resolution will be part of the photo, which can already automatically adjust lighting and tones, remove backgrounds, add generative elements, and more.