Microsoft has announced an expansion of its Copilot Vision functionality, which will now be available not only on web pages but also in Windows and mobile apps. Copilot Vision enables real-time video analysis from a mobile phone camera, providing advice for various user situations. Starting today, this feature is available in the Copilot app for iOS and Android, and will soon be coming to Windows.
The updated Copilot on Windows will also allow the use of Copilot Vision to analyze images and web pages, as well as provide tips on using features in apps like Adobe Photoshop. This feature will become available to Windows Insiders next week, and after testing is complete, it will roll out more broadly. In addition, Microsoft is introducing a range of new capabilities, including memory support, personalization, web actions, podcast creation, and deep research.
One of the new features is “Actions,” which allows Copilot to perform tasks online using simple chat prompts. This includes booking restaurant tables, purchasing event tickets, and ordering goods. Launch partners include Booking.com, Expedia, Kayak, and other travel and leisure-focused services. The “Actions” feature supports most websites and can help users plan trips and organize leisure activities.
Microsoft has also added personalization features that let Copilot remember user preferences and provide tailored recommendations. Users can choose what information to save or opt out of this feature. The company notes that in the future, it will be possible to give Copilot a personalized appearance. All these innovations demonstrate Microsoft’s commitment to keeping its AI competitive, leveraging developments from OpenAI.
