Microsoft Announces New AI Features for Windows 11 Users, Including Copilot Vision

Microsoft is set to introduce a range of new artificial intelligence features for Windows 11 users, with a gradual rollout planned. These updates encompass tools from Microsoft’s AI library. A key addition is the Copilot Vision tool, which allows users to analyze content displayed on their screens. Users can ask questions about what’s visible, across multiple apps and webpages. Copilot can also be used to perform tasks on the PC, such as enhancing the lighting in a picture. Microsoft also revealed that recent consumer AI reports indicated approximately 60% of individuals are using generative AI for work and business, with 64% using it for personal interests like art and music. The features will be available via the Copilot app. Snapdragon-powered Copilot Plus PCs will have access to the AI agent via the Settings app. An AI-powered “Click to Do” preview feature, which allows users to summarize text, enhance reading fluency, etc. is also being introduced. Other features include an AI-powered sticker generator in Paint, an object select tool for editing specific parts of an image, an AI lighting option in Photos, and a screenshot tool. The rollout is scheduled to begin in August, along with non-AI updates like a color picker in the Snipping Tool and a mechanism to automatically fix issues causing unexpected restarts.