Microsoft teases Copilot Vision, the AI sidekick that judges your tabs
(2024/12/07)
- Reference: 1733580070
- News link: https://www.theregister.co.uk/2024/12/07/microsoft_copilot_vision/
- Source link:
Microsoft has rolled out a Copilot Vision preview that says more about how poorly websites are designed rather than justifying the need to bring more AI into users' lives.
The [1]preview is only available to Copilot Pro subscribers, and only in the US for the time being. The service "looks" at the website a user is viewing to provide contextual suggestions and insights.
Doing some holiday shopping? Copilot Vision can suggest products that match a user's needs and preferences. Thinking about taking a trip to a museum? Copilot Vision will highlight what a user might need to know. And so on.
[2]
Microsoft said: "Browsing no longer needs to be a lonely experience with just you and all your tabs," which makes The Reg wonder exactly what the company thinks its users are like. The tool will only work with Microsoft's browser and is accessed from the base of Edge's window.
[3]
[4]
"It's almost like having a second set of eyes as you browse," said Microsoft. "Just turn on Copilot Vision to instantly scan, analyze, and offer insights based on what it sees."
It is debatable if Copilot Vision would even be required if every website was designed with the user in mind.
[5]Windows 11 24H2 rolls out to more devices – with a growing list of known issues
[6]Microsoft says premature patch could make Windows Recall forget how to work
[7]GitHub's boast that Copilot produces high-quality code challenged
[8]Microsoft preps big guns to shift Copilot software and PCs
It also sounds like a potential privacy disaster, which is why Microsoft is keen to insist the service is "entirely opt-in." It is up to the user to decide when to turn it on. In addition, any shared data is deleted. However, remember that the service is governed by Microsoft's [9]Privacy Statement , meaning the company could theoretically collect data for its own purposes.
That said, in stark contrast to the [10]original unveiling of Recall , Microsoft is taking a tentative approach with this feature. The company said: "It's important to stress that Vision does not capture, store, or use any data from publishers to train our models. In short, we're prioritizing copyright, creators, and our users' privacy and safety – and are putting them all first."
[11]
Copilot Vision was first [12]announced in October, and this week's broader release reflects early feedback. It will also only work with a select set of websites. Microsoft said: "We're taking our time to gather feedback, iterate on the technology, and will expand access to more Pro subscribers and more websites over time." ®
Get our [13]Tech Resources
[1] https://www.microsoft.com/en-us/microsoft-copilot/blog/2024/12/05/copilot-vision-now-in-preview-a-new-way-to-browse/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2024/12/05/microsoft_windows_roll_out/
[6] https://www.theregister.com/2024/12/04/microsoft_update_recall_bug/
[7] https://www.theregister.com/2024/12/03/github_copilot_code_quality_claims/
[8] https://www.theregister.com/2024/11/29/microsoft_preps_big_guns_for/
[9] https://www.microsoft.com/en-us/privacy/privacystatement
[10] https://www.theregister.com/2024/05/22/windows_recall/
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[12] https://blogs.microsoft.com/blog/2024/10/01/an-ai-companion-for-everyone/
[13] https://whitepapers.theregister.com/
The [1]preview is only available to Copilot Pro subscribers, and only in the US for the time being. The service "looks" at the website a user is viewing to provide contextual suggestions and insights.
Doing some holiday shopping? Copilot Vision can suggest products that match a user's needs and preferences. Thinking about taking a trip to a museum? Copilot Vision will highlight what a user might need to know. And so on.
[2]
Microsoft said: "Browsing no longer needs to be a lonely experience with just you and all your tabs," which makes The Reg wonder exactly what the company thinks its users are like. The tool will only work with Microsoft's browser and is accessed from the base of Edge's window.
[3]
[4]
"It's almost like having a second set of eyes as you browse," said Microsoft. "Just turn on Copilot Vision to instantly scan, analyze, and offer insights based on what it sees."
It is debatable if Copilot Vision would even be required if every website was designed with the user in mind.
[5]Windows 11 24H2 rolls out to more devices – with a growing list of known issues
[6]Microsoft says premature patch could make Windows Recall forget how to work
[7]GitHub's boast that Copilot produces high-quality code challenged
[8]Microsoft preps big guns to shift Copilot software and PCs
It also sounds like a potential privacy disaster, which is why Microsoft is keen to insist the service is "entirely opt-in." It is up to the user to decide when to turn it on. In addition, any shared data is deleted. However, remember that the service is governed by Microsoft's [9]Privacy Statement , meaning the company could theoretically collect data for its own purposes.
That said, in stark contrast to the [10]original unveiling of Recall , Microsoft is taking a tentative approach with this feature. The company said: "It's important to stress that Vision does not capture, store, or use any data from publishers to train our models. In short, we're prioritizing copyright, creators, and our users' privacy and safety – and are putting them all first."
[11]
Copilot Vision was first [12]announced in October, and this week's broader release reflects early feedback. It will also only work with a select set of websites. Microsoft said: "We're taking our time to gather feedback, iterate on the technology, and will expand access to more Pro subscribers and more websites over time." ®
Get our [13]Tech Resources
[1] https://www.microsoft.com/en-us/microsoft-copilot/blog/2024/12/05/copilot-vision-now-in-preview-a-new-way-to-browse/
[2] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=2&c=2Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D2%26raptor%3Dcondor%26pos%3Dtop%26test%3D0
[3] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[4] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=3&c=33Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D3%26raptor%3Deagle%26pos%3Dmid%26test%3D0
[5] https://www.theregister.com/2024/12/05/microsoft_windows_roll_out/
[6] https://www.theregister.com/2024/12/04/microsoft_update_recall_bug/
[7] https://www.theregister.com/2024/12/03/github_copilot_code_quality_claims/
[8] https://www.theregister.com/2024/11/29/microsoft_preps_big_guns_for/
[9] https://www.microsoft.com/en-us/privacy/privacystatement
[10] https://www.theregister.com/2024/05/22/windows_recall/
[11] https://pubads.g.doubleclick.net/gampad/jump?co=1&iu=/6978/reg_onprem/personaltech&sz=300x50%7C300x100%7C300x250%7C300x251%7C300x252%7C300x600%7C300x601&tile=4&c=44Z1R_L9JudNbAEDmQc2xWowAAAAM&t=ct%3Dns%26unitnum%3D4%26raptor%3Dfalcon%26pos%3Dmid%26test%3D0
[12] https://blogs.microsoft.com/blog/2024/10/01/an-ai-companion-for-everyone/
[13] https://whitepapers.theregister.com/
re: everyone is painfully aware just how utterly shit that is.
Steve Davies 3
Just like trying to default to a full web search even though you know that the file you want is somewhere on your HDD (and certainly not on OneDrive)?
Just like almost everything that MS has introduced since Windows 8.0? (W10, once tamed was the exception)
Two more of my friends have thrown in the towel with W11 and gone to MacOS (running on their Intel PC's). So far, they love it. The biggest thing that they notice is the lack of Ads. Hey MS... are you listening? (yes, they know that W11 can be 'fixed' but those fixes seem to magically disappear with every patch applied... Strange thing that)
Its when its
Boris the Cockroach
combined with the webcam and says "Dr. herks penis enlargement pills are what you need now"
dirty mac time
"contextual suggestions and insights."...
Mentat74
Insights like :
HEY !!! LOOK AT THOSE ADS !!!
"Copilot Vision can suggest products that match a user's needs and preferences........Copilot Vision will highlight what a user might need to know."
Er.... No.
It'll suggest or highlight things it THINKS you'd want to know about. It's much like behavioural or targeted advertising. And I'm sure everyone is painfully aware just how utterly shit that is.