Microsoft Copilot now speaks and watches (but not in Europe)
October 1, 2024
0
Microsoft Copilot receives its biggest update yet. The most important innovations are Copilot Voice and Copilot Vision, which make interaction with the technology more intuitive and natural. With
Microsoft Copilot receives its biggest update yet. The most important innovations are Copilot Voice and Copilot Vision, which make interaction with the technology more intuitive and natural.
With the launch of Copilot Voice, Microsoft is giving users a new way to interact with their digital assistant. Users can issue voice commands to ask questions, share ideas, or simply unwind after a long day. Copilot Voice offers four different language options, making the assistant feel more personal. This feature is currently only available in English-speaking countries, including the United States, the United Kingdom, Canada, Australia, and New Zealand. However, Microsoft is working on expanding it to other languages and regions.
In addition, Microsoft is introducing Copilot Daily, a function that offers users a daily overview of news, weather and upcoming appointments. This information is read out in the voice of the chosen copilot voice. The content has been carefully compiled from verified sources such as Reuters, Axel Springer and the Financial Times.
Copilot Daily is designed to combat information overload and make it easy to quickly stay up to date on the most important developments. In the future, the feature will be expanded to include more resources and personalization options, allowing users to further customize their daily updates.
Visual support with Copilot Vision
One of the most useful new features is Copilot Vision. This feature offers users a new way to interact with the content on their screen. Copilot Vision can recognize and interpret both text and images on a web page, providing real-time suggestions without interrupting the user’s workflow. This can be useful, for example, when furnishing a new home, where Copilot Vision helps choose furniture, put together a color palette or even visualize the layout of the room.
Copilot Vision is currently available through Copilot Labs, a platform where Microsoft is testing experimental features with a limited number of users. The feature is currently only rolling out to users in the US, but Microsoft plans to make Copilot Vision more widely available in the future.
Experiments in Copilot Labs: Thinking Deeper
In addition to Copilot Vision, Microsoft is also introducing a new experimental feature in Copilot Labs: Think Deeper. This feature is designed for more complex questions and situations that require deeper analysis. Think Deeper takes more time to arrive at an answer, allowing Copilot to provide detailed and well-researched suggestions.
This can be helpful when comparing different options. Microsoft gives an example when you’re thinking about a new place to live or looking for the best car for your profile. Think Deeper is currently being tested in a limited group of English-speaking countries, including Australia, Canada, New Zealand, the United Kingdom and the United States.
Rollout and future plans
The updated Copilot with all the new features mentioned above will be available starting today on various platforms including iOS, Android and Windows. Users can also access the assistant via the web version of Copilot. Copilot also integrates deeper into the Microsoft Edge browser. Users can request help summarizing pages, translating text, or answering questions by simply typing “@copilot” in the address bar.
Microsoft emphasizes that data protection and security are at the forefront of these innovations. According to the software giant, the data processed through Copilot Vision is neither stored nor used for further training of the system. All sessions are temporary and entirely opt-in. In addition, the assistant does not work on websites with sensitive or paid content to ensure user safety.
In addition to the current features, Microsoft plans to further expand Copilot to new regions and platforms such as WhatsApp. This makes the assistant more accessible to a larger audience and more users can benefit from the possibilities that Copilot offers. More information will follow in the future.
As an experienced journalist and author, Mary has been reporting on the latest news and trends for over 5 years. With a passion for uncovering the stories behind the headlines, Mary has earned a reputation as a trusted voice in the world of journalism. Her writing style is insightful, engaging and thought-provoking, as she takes a deep dive into the most pressing issues of our time.