To mark its 50th anniversary, Microsoft has revealed a host of new features for Copilot. The Redmond tech giant is adding capabilities like Memory, Actions, Vision, Deep Research, Podcasts, Pages, and more. With these upgrades, Copilot is becoming nearly as powerful as ChatGPT or Gemini. Here’s a breakdown of all the new features announced for Copilot.
Copilot Vision
Starting with Copilot Vision, it can now analyze your screen and access the camera to interact with you in real-time through voice chat. Previously available on the web, Microsoft is now bringing Copilot Vision to Android and iOS. Additionally, with the native Copilot app on Windows, you can use the Vision feature across all apps on the platform.
Regarding availability, Copilot Vision is rolling out on Android and iOS starting today, while Windows Insiders will get access to Vision beginning next week.
Copilot Actions
Next, Copilot now supports Actions, adding a level of agency to its capabilities. With Copilot Actions, it can perform tasks on your behalf, such as booking event tickets or reserving a restaurant table. While it works with most websites, Microsoft has partnered with several platforms to ensure a smoother experience.
The following websites have been optimized for Copilot Actions: Flowers.com, Booking.com, Expedia, Kayak, OpenTable, Priceline, Tripadvisor, Skyscanner, Viator, and Vrbo.https://youtu.be/aisTyhgZcUI
Memory and Personalization
In addition, Microsoft Copilot is becoming more personalized with the introduction of Memory support. It can remember your preferences from past conversations and tailor responses based on what it learns about you such as your favorite movies, location, food preferences, and more. If you’d rather not have certain memories stored, you can delete them or disable the feature entirely.
Microsoft is also experimenting with a new feature that lets users customize Copilot’s appearance. This allows you to design and personalize how Copilot looks, turning it into a more engaging and entertaining character.
Deep Research
Deep Research is a new AI tool coming to Copilot that enables you to complete multi-step research tasks in just minutes. It can browse the web, gather data from various sources, and extract information from large documents and images. After analyzing all the data, it creates a comprehensive, expert-level research document. This feature is similar to the Deep Research agent found in ChatGPT and Gemini.
Pages
Pages is another new feature coming to Copilot. With Pages, you can gather your thoughts, research notes, and content in one place, where Copilot will help organize them neatly. It’s perfect for brainstorming, planning, writing, studying, and keeping track of your scattered notes. Copilot makes it easy to refine and update your notes in Pages, streamlining the process.
Podcasts
Microsoft is also introducing AI-powered podcasts to Copilot. Copilot can generate personalized podcasts tailored to your interests, similar to NotebookLM. You can even provide your own notes or study material, and Copilot will create a custom podcast based on them. The best part is that you can interact with the generated podcast, asking questions to dive deeper into the topic. Essentially, you can create an interactive AI podcast on any subject you choose.
Shopping
Microsoft aims to make Copilot your personal shopper. For example, you can ask Copilot to recommend stylish cups, and it will do the research and suggest options within your budget. You can view the details and purchase directly through Copilot, though this feature is only available on partner websites. Additionally, Copilot can track price drops and compare products to help you make the best choice.
Copilot Search in Bing
Similar to Google’s AI Overviews, Microsoft is introducing Copilot Search to Bing. When you perform a search on Bing, Copilot Search scours the web, compiles information from relevant websites, and presents a detailed answer. It also includes citations, allowing you to verify the information.
Microsoft has announced that the new Copilot Search experience in Bing is rolling out today. However, it’s a limited rollout, and over the coming weeks and months, more users will gain access to Copilot Search in Bing.
