Microsoft is preparing to introduce a series of new AI features to its Windows 11 operating system, enhancing the user experience with the integration of Copilot. One of the standout features is Copilot Vision, a tool that can analyze content displayed on the user’s screen, including physical items in the user’s environment. Users can query the AI about what it detects, effectively eliminating the need for separate photo documentation of documents like bills.
These new features are being rolled out gradually. Copilot Vision will be accessible through the Copilot app, allowing users to analyze content across multiple applications and web pages. Beyond content analysis, users can utilize Copilot to execute PC tasks such as enhancing the lighting in a photograph.
According to a Microsoft-commissioned consumer AI report, nearly 60% of individuals are using generative AI for work and business purposes, and 64% are using it for personal interests. The new features are designed to integrate AI into the daily activities on the PC, improving ease of use and efficiency.
Additionally, users of Snapdragon-powered Copilot Plus PCs can access the AI agent via the Settings app. The ‘Click to Do’ preview feature will provide a tool to summarize text, improve reading fluency, and aid in pronunciation. Other features include an AI-powered sticker generator in Paint, an object select tool to edit specific parts of an image, an AI lighting option in Photos, and an enhanced screenshot tool that utilizes AI to capture on-screen content precisely.
The rollout of most of these features will begin in August, coinciding with non-AI updates like a color picker within the Snipping Tool and a mechanism to automatically fix issues that lead to unexpected restarts.