Copilot in Windows 11 can now see your screen — it might be time to hide some tabs

Program Copilot for Windows 11 received a new feature — Copilot Vision, which allows the chatbot to see and interact with what is on your screen and in the OSThe feature was already available in Microsoft Edge, and now it can be tested on laptops and PCs running Windows 11 All permissions for the chatbot are controlled by the user — that is, you can choose which Copilot Vision program can view to help you.In a demonstration at Microsoft’s 50th anniversary, the chatbot interacted with Minecraft and told the user what armor was available and what it was for, then Copilot drew attention to the game’s vegetables, explaining how to harvest them.

Similarly, a chatbot can work with photo editing programs, prompting non-advanced users what and where to click to achieve the desired result.

More Microsoft has launched a file search test for Copilot on Windows — it will now be able to search for files in the formats.docx, .xlsx, .pptx, .txt, .pdf, .json.

Both of these features require only the Copilot app on Windows, not the full-fledged Copilot Plus PC, but the update is currently available in beta only to US residents — the rest will get the function Copilot Vision «in the coming weeks or months»