120 comments

[ 2.6 ms ] story [ 216 ms ] thread
More privacy setting changes that will default to spying on you and sending everything you do and all you data to Microsoft. I wish I could look at this kind of announcement and see something positive, but it's all just thinly veiled espionage.
I can't agree more, totally opaque data will almost certainly be sent to an ever growing number of locations. If I so much as ask about it I'll be labelled a nutter.
This is great, but I wish they'd focus as much on fundamentals. The bloat is tangible and measurable.
AI is great but how about fixing start menu search? Search that was perfectly working on Windows 7 but was lobotomized in subsequent versions.
Even in Win7 it wasn't particularly fast. I don't get how that one random person working on that "Everything" search utility was able to build instantaneous search on Windows, but Microsoft themselves couldn't figure it out.
One assumes that it's loaded with telemetry and bing-first searching, so it's design for data exploitation of customers rather than to be a menu
In fact, if you disable web search via a registry value or group policy (don't remember which), it becomes a lot faster. Not Everything fast, but significantly faster nonetheless.
It’s the next great thing about surfacing semantically relevant bing ads in your start menu and sending Microsoft summarized “diagnostic data” about everything you do and read to “improve their product experience.” Enjoy!
Maybe the AI will be able to delete files and directories faster than me doing it myself with a magnetised needle and a steady hand.
They’re still working on perfecting the system that sends all your data to the cloud so you can search it again.
I'm 100% in for this purely for the fact that it looks like it will actually tell you / provide a button to perform the action. I am a Windows fan and use it as my primary operating system, but I cannot tell you how irrationally angry I get when I end up in the new control panel and there are links like "find out how to do X" which just dump you into Bing search. Microsoft already knows the answer, that answer is potentially relevant to the specific version of windows I'm using, but they need to pump up Bing's numbers so they send me there and honestly the results aren't always that helpful.
I don't think your anger at that is irrational at all.
I honestly don't see any benefits to the Dev Home app as is besides Dev Drive, which could be cool if it is that simple to just create a drive that is sandboxed.

Perhaps the community will whip up (most likely not), extensions for stuff like Sentry or CI/CD. Could be a neat thing then.

After their move to train AI off of Github repos I am deeply skeptical of wrapping up any code with a neat little bow for MS to further analyze.
> We have added native support for additional archive formats, including tar, 7-zip, rar, gz and many others using the libarchive open-source project. You now can get improved performance of archive functionality during compression on Windows.

This is easily the most exciting part of the whole announcement.

Yes, but why did it take so many years?
probably because they were spending all those years putting annoying ads in the OS and start menu.
MS has enough developers to build two features at the same time.
But not to fix annoying and abundantly obvious bugs, apparently
You would think, yet WinUI 3.0 is years away to achieve parity with WinUI 2.0/UWP tooling.
Hopefully it reaches parity with WPF before the OS gets EOL'd
Or with the pleothora of AI announcements at BUILD, they will get CoPilot to do it for us. /s
So what you're suggesting is that they won't put any more annoying ads in the OS? ;)
Wonder if it includes support for encrypted 7zip/rar archives, including support to add/modify. From libarchive notes it looks like zip format encrypted archives are supported.
Or you could just install 7zip.

Where is zstandard or lz4 on ntfs? Meta and data checksumming and autorecovery? New and improved filesystems?

You mean ReFS?
ReFS doesn't have compression at all and didn't have boot though it looks like win11 is getting it now.
Dev Home dashboard seems neat. Although not sure how worth the rest of it is. ReFS is nice I suppose.
This might actually be a better UI for finding settings than their real settings app cause I swear I can never find anything in it and they move stuff around and rename things every other update

Would be great if it can help you find how to do things in Office apps too, because it's the same problem. Those apps have had so many redesigns over the years, Googling for anything more complex than the most basic of usecases is impossible.

>horrible OS designed for consumer cattle

>now with AI

Now you can actually talk to Big Brother!

But the Big Brother wouldn't listen.
I'm pretty sure I won't get this offered since I am not signed into any Microsoft account on my Windows 11 installation. Or, I get it offered, but requested to sign in.

I have zero issues with signing GitHub Copilot into my GitHub account to use it with Android Studio or VS Code, I just don't want the OS to be logged into a cloud account which I don't really own and where I don't know what's getting synced to it.

Embrace the future or use linux.
What do you mean or? the future is linux and it is here
I wish I had that option, but unfortunately I'm forced to use Windows at work.
I used linux for many years. Ultimately, I like my laptop's touchpad and trackpoint to remain functional. Believe me, I have tried.
Embrace the future -> Extend the future -> Extinguish the future

Thanks but no thanks, it is a long time ago I took a different path which leads to a different future, one which is not likely to be extinguished.

Why does it matter if you are signed in? I mean, it's not like not singing in into microsoft account somehow prevents them from collecting telemetry. It's might be /slightly/ harder for them to match your profile, but we are talking about data collection scale that this is arguably irrelevant anyway
We need something like this on Linux, maybe powered by Vicuna. I’m not sure if the current batch of LLaMA variants is coherent enough to work as a digital assistant, but my gut feeling is that a little fine tuning on tool use might be all thats needed.
The hard part I think will be integrating the LLM closely enough with the other programs on your machine that it's actually useful in that context, and not just a glorified chat window or a text interface to do things you can already do more easily with a KB+Mouse.
In a perfect world you give the LLM a python interpreter and it does the rest.

Realistically, with the LLMs we have today, the right approach is probably to curate a set of APIs it's allowed to interact with. Some basic file system access and FFmpeg support would be extremely useful on it's own.

Linux is fundamentally not monolithic like Windows, but maybe some DEs could expose hooks for LLMs to use.

There is also the performance issue. Right now the task energy/memory usage of llama implementations is very high, and it takes some time to load into RAM and/or VRAM. It seems Microsoft is getting around this with cloud inference, and eats the hosting cost (for now).

> little fine tuning on tool use might be all thats needed.

Maybe I am interpreting this wrong, but LORA finetuning is extremely resource intense right now. There are practical alternatives though, like embedding databases people are just now setting up.

Plugging a llm into dbus may take you surprisingly far.
Fine tuning is moderately intense. Going from base LLaMA to Vicuna 13B costs about $300.
The compute requirements are reasonable, but the memory requirements are extremely high, even with some upcoming breakthroughs like 4 bit bitsandbytes.
How does accessibility work on Linux?
The videos in the article are absolutely slick!
Reminds me of that spoof commercial, about Microsoft designing the artwork for an Apple mouse.
am i the only one who is curious about how they are going to charge for this?
Ads. Ads everywhere.
customers will pay with their data
Everything is an on-ramp to Azure, Github, M365, etc.
Can the AI fix my taskbar and ungroup task buttons or will i still have to use a 3rd party program?
There's a section in the linked article about improvements to the taskbar, including the following:

> You can now quickly identify and access any instance of each app housed in the taskbar with just one click. All instances of the app are ungrouped with labels on the taskbar.

It makes it sound like you need to click a group first to ungroup it, but maybe there's an option to keep them ungrouped by default. I guess we'll see. You can catch a glimpse of what the labeled windows in the taskbar looks like in the Dev Home video embedded in the article.

Make sure to watch the embedded video.

A new permanent taskbar button opens an OpenAI LLM trained to use Windows 11.

You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."

It works with all applications. It sees what you're seeing.

As a longtime Linux user, it pains me to say this:

It's... beautiful.

...

But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.

In that sense, it's like "MOTHER" in Ridely Scott's Alien and "HAL" in Kubrick's 2001: A Space Odyssey.

Yes, I really want OpenAI observing all my actions closely and 'taking notes' of everything I do.
I would love this in Linux, but only if it works offline. Not a fan of sending everything I do to a remote machine.
> It works with all applications. It sees what you're seeing.

Sounds like it will also see prompt-injection malware hidden in plaintext documents.

Oh yes. This is going to be glorious to watch. Before, prompt injections were mostly a joke. With this, they will truly become a proper, new type of attack vector.
Having spent most of my ChatGPT time trying to get it to correctly write powershell/batch scripts to do different things in Windows, I will be fucking amazed if this button actually does half the things you tell it to.
The problem is you're a programmer. It will work right if a non-programmer does the prompting. How else do you think you're gonna be replaced?
> But it's also scary, because it's not under your control. Ultimately, it obeys only the bureaucracy at Microsoft.

perfect summary of modern Windows

This sounds like a massive security hole to me, especially if this runs in the cloud. Is this thing sending _all_ context of the programs on your windows computer to MS?

I'm also a bit curious how they will actually pay to have millions of these LLMs running and how much co2 it will output. This doesn't exactly fit their narrative about the new power saving features in their consoles.

You ask the LLM to do what you want -- "summarize this email and send the summary to my boss."

Follow it up with "And send out my resume, because I can apparently be replaced by a computer."

> It works with all applications. It sees what you're seeing.

Does it also snitch on you to your boss? "Here is my assessment of the work habits of cs702 for this week."

> It sees what you're seeing.

In the video the user drag&drops a file into the copilot window. How do you know that it can see your screen? I believe "works with all apps" only refers to the third party plugins.

You: Clippy, Open the CMD window please. Clippy: I'm sorry, I'm afraid I can't do that. This integration is too important for me to allow you to jeopardize it.
> AI-Generated review summary: We are making it faster and easier for customers to scan reviews for apps by using the power of AI to compile thousands of reviews into a simple summary, enabling customers to discover new content with ease.

Would be cool to have an option to actually read those reviews. If I open Firefox page in the Store app it says 420 ratings but I can only read a single review. If I press 'See all' it just shows an empty page. If I open Firefox store page[0] in the browser it says 'No one has reviewed this application yet. Be the first to add a review.' Reviews seem to be split by country or by some other criteria for no good reason.

[0] https://apps.microsoft.com/store/detail/mozilla-firefox/9NZV...

I was already uneasy about the day when my employer makes us switch to Win 11. This makes me even more uneasy.

I hope it's possible to remove the AI controls (especially the copilot button) from the UI.

My issue with this is that it feels less like a new toy to play with and more like a new worm that is meant to hook me, my workflow, and my data into their silo. I'd like to see better demarcation in windows tooling when it comes to how they're managing user data. Similar to how developers tend to colour code DEV and PROD environments so that they don't accidentally alter PROD. I'd like to see colour coding on microsoft tooling that delineates "local data that is processed locally, and is 100% private" processes from "local data that will be processed in the cloud and possibly stored for training later without you being able to know" processes. The moment data leaves my local network, I assume it is compromised, so having clearer delineation will help me know what tools to avoid.
A feature designed by the marketing department. Hopefully, we will be able to turn it off like Cortana.
I don't know if I'm quite willing to go there yet, but LLMs are barrelling towards a level where, if the pace continues, they will easily be looked upon as the most import advancement of computing.

The fact that training a statistical model on terabytes of text can lead quite naturally and obviously to what is shown in the video in the webpage is shocking. The shocking part is how natural it feels, and how I know this is something that can work.

Congratulations to the teams that have been going down this path, this is wildly impressive stuff.

This is a significant announcement.

Note namechecking every non-Apple CPU vendor and NVIDIA - but not mentioning AMD/Intel GPUs. Another note: Lots of small improvements, but not allowing users to move the Taskbar (to Microsoft, some things are important). Oh, and they haven't abandoned ReFS - so will it be available without Windows Professional for Enterprise etc.? I can't see many devs paying for that alone.

Will the AI allow me to disable the big blue "bing chat" button that shows up every time I try to search for something?