Microsoft has started testing a new feature called Copilot Vision, which allows AI to see what you are viewing on pages in the Edge browser. This feature is available only to Copilot Pro subscribers through the Copilot Labs program in the US. Copilot Vision can analyze text and images on web pages, answer questions, translate text, and even assist with games.
Users can use Copilot Vision to get product recommendations while shopping online or to receive hints while playing games on Chess.com. “When you choose to enable Copilot Vision, it sees the page you’re on, reads along with you, and you can discuss the issue together,” the Copilot team writes in the blog.
Microsoft emphasizes privacy, stating that Copilot Vision does not retain data after the session. Processed audio, images, or text are not used to train models. Currently, the feature is restricted from accessing certain sites to avoid potential legal issues with publishers.
Microsoft promises to expand the list of sites available for Copilot Vision over time, taking into account feedback from users and publishers.
