Click to Do places an interactive overlay on a PC’s desktop screen and provides suggested actions for ways to interact with text and images. This could mean running a “visual search” of an image in Microsoft’s Bing search engine, for instance, or summarizing selected text on a webpage.
“Click to Do works by first understanding everything you’ve seen on your screen, then enabling useful shortcuts to actions that help you more quickly search, learn, edit, shop, or act on those items,” Yusuf Mehdi, Microsoft’s corporate vice president and consumer chief marketing officer, explained in a pre-recorded press briefing ahead of the announcement. “It works on any window, document, image or even video.”
Click to Do will be available in preview for Windows Insider members in November.
It’s one of several Windows features developed specifically for Copilot+ PCs sold by Microsoft and OEM partners. The “AI PCs” feature a neural processing unit (NPU) that runs AI workloads more effectively on-device.
Microsoft also provided more details on plans to make another flagship Copilot+ feature — its controversial Recall timeline search tool — available to Windows Insiders this month. This will start with Copilot+ PCs running on Qualcomm’s Snapdragon chips, with access expanded to Intel- and AMD-powered devices in November.
Announced in May, the launch of Recall was subsequently delayed in response to data privacy and security concerns. Microsoft has since made changes to Recall in response to the backlash; the company outlined those changes last week, and noted the feature will now be turned off by default.
There’s no word yet on when Recall will be made generally available, however, with Microsoft saying only that more details will be shared “soon.”
Another feature announced on Tuesday for Copilot+ PC owners is improved Windows Search. This lets users describe what they’re looking for — such as the contents of photos — without needing to remember an actual file name or get the spelling right. The improved search, which can be performed offline thanks to the Copilot+ NPUs, will be available first with File Explorer before coming to Windows Search and Settings in the coming months, Microsoft said.
Improved Windows Search allows users to describe what they’re looking for rather than having to find a specific file.
Microsoft
The Windows Search feature “could be a real boon to users,” said Tom Mainelli, IDC’s group vice president for device and consumer research.
“We all spend an inordinate amount of time either filing things so we can find them later or searching for things that we failed to file well,” he said. “This new search feature, as demonstrated, makes it much easier to find what you need quickly so you can stay in the flow of your work.”
There are also new AI features coming to two Windows apps, Paint and Photos.
In Photos, the super resolution tool lets users enhance low quality images, upscaling photos to 4K resolution in seconds.
Coming to Paint are two editing tools — generative fill and erase. “Using an adjustable brush, you can remove unwanted or distracting elements in your image or add new ones, exactly where you want them,” Pavan Davuluri, Microsoft’s corporate vice president for Windows and devices, said in a blog post. “We’ve also improved the underlying diffusion-based model to deliver better results faster, and with built-in moderation, it’s a creative experience you can trust.”
The new Copilot+ features are unlikely to prompt the average consumer or IT decision-maker to rush out and buy a new PC, said Mainelli. The aging PC installed base is more of a driving factor, with many commercial customers still relying on Windows 10 devices acquired four or more years ago. “Windows 10 EOS is in October 2025, so many companies are moving toward a refresh,” he said.
But for those planning an upgrade, the additional capabilties make Copilot+ devices more compelling. “These new features could make buyers who are already contemplating new PC purchases consider moving up the stack to buy a Copilot+ PC,” said Mainelli.
“These new AI features also position Microsoft and Windows to keep existing users from defecting to Apple and the Mac, which will see the rollout of Apple Intelligence in the coming weeks and months.”
Microsoft also announced the rollout of the Windows 11 24H2 update to customers on Tuesday. This version includes features such as Energy Saver, designed to reduce energy use and extend battery life; enhancements to hearing aid support with Bluetooth LE Audio such as audio preset controls and ambient sounds; and Wi-Fi 7 compatibility.
We live in a multi-device world. At a minimum, you almost certainly have both a computer and a phone — and potentially many more devices than that!
And when it comes to transferring files between your Windows PC and whatever phone you’re using, you’re absolutely spoiled for choice. Microsoft, Google, and Apple have all developed their own ways to send files back and forth between a phone and computer, and you might not even need any of those systems to get the job done.
The real question is just which method makes the most sense for you. I’ll walk you through the best options so you can figure that out and be as productive as possible on both your phone — be it an Android device or an iPhone — and your PC.
Want more PC advice? My free Windows Intelligence newsletter delivers all the best Windows tips straight to your inbox. Plus, you’ll get free copies of Paul Thurrott’s Windows 11 and Windows 10 Field Guides (a $10 value) just for subscribing!
Windows-to-phone file transfer option #1: Cloud storage
For most people and situations, cloud file storage is generally the best way to access files across multiple devices. It’s also a great way to back things up, in a sense. Your files aren’t just stored on one device, so you’ll always have a copy if your computer dies.
You can of course use Microsoft OneDrive, Google Drive, or Apple’s iCloud Drive to store files on cloud servers and easily access them on your devices. They’re all cross-platform — although iCloud Drive is only available for Windows PCs and Apple devices. Apple’s software isn’t a great option if you use an Android phone — no surprise there — though it does work well on Windows PCs, which is a pleasant twist.
While cloud file storage has become more common, many users still store files locally, especially on PCs. If you don’t trust these services and want more privacy, I recommend looking at encrypted cloud storage tools. For example, you might try Proton Drive or another encrypted cloud storage app.
Windows-to-phone file transfer option #2: Automatic photo uploads
Many cloud photo storage services — including Google Photos, Microsoft OneDrive, and Apple’s iCloud Photos — can automatically upload photos as you take them on your phone. No matter what other Windows-to-phone file transfer methods you’re using, taking advantage of this option can be a great way to quickly access camera-captured images on your PC.
For example, if you use OneDrive, you’ll find photos you’ve taken on your phone in File Explorer under the “Gallery” view at the top-left corner of the File Explorer window on Windows 11. If you use iCloud Photos with an iPhone, you can activate iCloud Photo integration in the Windows Photos app on both Windows 10 and 11.
Google Photos doesn’t integrate well with Windows anymore — you can’t see your Google Photos in either File Explorer or the Photos app — but you can access your photos on the Google Photos website or install the OneDrive app on your Android phone and set up automatic photo uploads to OneDrive.
The Gallery view is the quickest way to find synced photos from your phone — if they’re in OneDrive.
Chris Hoffman, IDG
Windows-to-phone file transfer option #3: Phone Link (Android only)
Microsoft includes a “Phone Link” app with both Windows 10 and 10 PCs. It provides a central location for many PC-to-phone features, including texting from your PC and accessing its notifications. It works best with Android phones — Apple won’t let Microsoft integrate with iPhones in such a deep way.
If you have an Android phone, though, the Phone Link app gives you a quick and wireless way to access the entire photo library on your phone. On some Android devices — including Samsung Galaxy phones, but not Google Pixel phones — you can even drag-and-drop files to this window to transfer them. If you have an iPhone, you’ll find at least some useful features, too — such as texting from your PC — but not file or photo transfers.
You can also use the Intel Unison app, which works similarly and is a good alternative to the Phone Link app. I’ve heard from some readers of my free Windows Intelligence newsletter who find this app works more reliably with their PC and phone. (Although Intel makes the app, I’ve actually used it on an AMD-powered PC.) It’s worth a try if you’re interested in this type of app, but experience some sort of issue or compatibility challenge with Phone Link.
The Phone Link app works better for access to your photo library than your files.
Chris Hoffman, IDG
Windows-to-phone file transfer option #4: Quick Share (Android only)
If you have an Android phone and a Windows PC, you can make your Windows PC play nicely with Google’s built-in Android Quick Share feature — whether you’re using a Pixel phone, a Galaxy phone, or any other type of Android device. Just install Google’s Quick Share app for Windows and set it up. With a few clicks, your PC will appear as a “Quick Share” target for fast and easy sharing from your phone. You can use the Quick Share app in Windows to send files from your PC to your Android phone, too. It all happens wirelessly.
Windows PCs also have their own built-in “Nearby Sharing” feature, but it only works between multiple Windows PCs — both Windows 10 and Windows 11 — but not, strangely enough, any Android or iOS devices.
Google’s Quick Share app is a quick-and-convenient way to make Windows work with Android’s built-in wireless file-sharing system.
Chris Hoffman, IDG
Windows-to-phone file transfer option #5: iTunes File Sharing (iPhone only)
While Google’s Quick Share won’t work with iPhones, Apple does offer a wireless file transfer feature that works between Windows PCs and iPhones.
The File Sharing feature is built into the iTunes app, which you can install on Windows PCs. You can pair your iPhone with your PC via a USB cable or wirelessly. Then, you can use File Sharing in iTunes to transfer files.
Windows-to-phone file transfer option #6: The USB cable
Sometimes, the old ways are the most convenient. Despite rumors of the iPhone or other phones potentially dropping their charging ports, modern smartphones do still have physical ports. And they’re not just for charging; they work for Android file transfers, too.
Once you’ve made that connection, your phone — Android or iPhone — will appear as a device in the Windows File Explorer app. (You might have to unlock your phone or enable file transfers first.) You can then move files as you would with any other storage device.
Windows-to-phone file transfer option #7: Cross-platform tools
Want to use a cross-platform tool that quickly sends files over the network with very little setup? Try LocalSend. It’s a free, open-source tool for Windows, Android, iPhone, and a variety of other platforms, including macOS and Linux. After installation, with a few clicks or taps, you can send files back and forth between devices — all over the local network, with no cloud servers involved.
If you’d like a web-based alternative that doesn’t require an app installation, try Snapdrop. Assuming your computer and phone are on the same local network, they’ll be able to see each other and transfer files. Again, this works entirely over the local network — and you don’t need to install anything.
Windows-to-phone file transfer option #8: The USB-C drive (seriously!)
While USB drives don’t get the love they used to, they’re actually more useful than ever — especially if both your PC and your Android phone or iPhone all have USB-C ports.
Yes, you can get USB drives that plug into both the USB-C port on your laptop and the USB-C port on your phone. Then you can move files back and forth the old-fashioned way — using the File Explorer app on your computer and a Files app on your phone. This works for both Android phones and iPhones.
The workplace file-transfer asterisk
If you’re using a computer for work, your employer likely has a preferred way for you to access files and might not appreciate you moving your own copies around between your devices, so take care when accessing sensitive corporate data.
Be sure to follow your employer’s policies and consider whether you should be accessing any business files on a shared data server rather than moving them back and forth between devices yourself.
But take it from someone who’s tried connecting to Windows file shares from an Android phone: I recommend the above options, which are much easier to set up and use.
Get even more Windows tips, tricks, and app recommendations with my Windows Intelligence newsletter — three things to try every Friday and a free in-depth Windows Field Guides as a special welcome bonus!
Did you ever watch the early 2000s TV series Scrubs?
The show revolved around a young doctor named JD who always meant well but often got lost in his own head and ended up making ill-advised decisions. In one episode, he started seeing a fantastical opera singer who’d show up over his shoulder and sing an emphatic “MISTAAAAAKE!!!” every time he did something dumb.
This week, as I’m chewing over a colossal incoming ChromeOS pivot and the confounding logic behind it, I can’t help but hear that same operatic refrain sounding in my head — over the shoulder of Google itself, who like JD, generally seems to mean well but frequently gets in its own way.
Join me in a quick preemptive sigh, and let me explain.
[Psst: If you like level-headed insight, check out my free Android Intelligence newsletter. Three things to know and try every Friday — straight from me to you.]
The Google-scented command center at ChromeOS’s core
First, we need just a teensy bit of super-specific context to set the stage here.
Since its start, y’see, Google’s ChromeOS platform has been deliberately different from the standard desktop computing setup.
We could spend days discussing the many ways Chromebooks aren’t like most computers. But if you’re here and reading this column, you’re probably well aware of all that stuff. (If you aren’t, here’s a primer you can catch up with on your own.)
For the purposes of the pivot we’re probing today, the part of the ChromeOS experience that’s relevant is the button that’s lived in place of the standard Caps Lock keyboard key since the very first Chromebook computer — even before it was called a Chromebook — and that’s the Search button, also known as the Launcher or Everything key.
From the get-go, Google wanted to emphasize that Chromebooks were all about making it easy to find what you needed (y’know, as Google has traditionally been known to do), and it wanted to drive home the point that these funky new computers were all about cutting away the fat and eliminating the long-accepted elements of computing that no one actually still wanted in our modern-day world.
So, away went the Caps Lock key and in its place grew that simple-seeming Search button. Initially, that button pulled up a pretty basic web-based search prompt, but over time, it expanded to become an all-in-one app-launching, answer-finding mecca — kind of like an even more capable and effective version of what Microsoft’s Windows-key-connected Start menu strives to be.
As a result, the Search key became at least occasionally known as the Launcher key at some point along the way. And then, in 2020, Google made its boldest move yet: It brought Google Assistant into that same arena and rebranded the Search/Launcher key as the Everything Button — a single streamlined spot for finding or doing practically anything.
With its new powers coming into play, that button … could almost be described as a “Google Button.” Tap it, and in the one box that comes up, you can:
Search the web
Search your local computer storage
Search your Drive file storage
Search for documents, spreadsheets, and presentations in your web-based Docs, Sheets, and Slides collections
Search for a system-level setting that you want to modify
Search for an app to run on your own device — no matter what type of app it is — or search for a new app to install from the Google Play Store
Perform any imaginable action via the Google Assistant
And, critically:
[The addition of Assistant] makes the idea of this “Everything Button” — the “Google Button” — feel powerful and complete. Quite honestly, it’s something you resent not having when you work on ChromeOS and then go back to a more traditional operating system environment. …
ChromeOS is on the brink of becoming the place where Google’s best capabilities come together to form a whole new kind of connected experience. It’s an exciting new start for intelligent desktop computing — and beyond that, it shows us the type of thoroughly connected Google experience Android could, should, and hopefully one day will also provide.
That brings us to today and the head-scratching move Google just made — one that seems poised to bring an outsized shake-up to ChromeOS’s core and the very notion of what the platform represents.
ChromeOS and the end of the Everything era
So here it is: Google’s pulling that long-standing, distinctive Search/Launcher/Everything key from the most prominent spot on the Chromebook’s keyboard and putting a new “Quick Insert” key into its place.
In the same Caps-Lock-associated stall will now reside a function that feels mostly like an excuse to cram more Gemini-branded generative-AI gobbledygook into everyone’s faces and try to convince us that it’s, like, totally The Future™ and something we should be leaning on every hour of every day.
To its credit, Google at least isn’t turning the button into a full-fledged Gemini button. Instead, it’s making it a multifaceted source for inserting different types of content into text fields throughout the ChromeOS environment. That means you can use it to call up emojis, GIFs, files, and photos — and, of course, to summon Gemini’s Help Me Write system for generating text of questionable quality and soon also Gemini’s AI image generating system, too. But it seems pretty clear that those last two factors are the driving cause for this genesis.
The once-prominent Everything Button, meanwhile, is being demoted down to a smaller “G”-branded key off to the side of the spacebar — a shift that’ll start with the newly announced Samsung Galaxy Chromebook Plus and then seemingly show up on other new ChromeOS devices from there.
As my Windows-Intelligence-writing colleague Chris Hoffman put it, this feels like the equivalent of Microsoft replacing the Windows key with a button dedicated to its Copilot AI assistant. Suffice it to say, that’d be a move most Windows-preferring persons wouldn’t exactly celebrate.
For ChromeOS, the comparison might be even more extreme — because that Everything Button really was both a representation of the platform’s very philosophy and a hugely important practical advantage only Google-centric software could provide. And while the function itself isn’t going away entirely, moving it out of that prime position seems like a silly and shortsighted move that’s bound to backfire.
On the most surface level, people who use Chromebooks are gonna be pretty miffed when their next device has a different button in the place they’ve been trained for years to tap for — well, everything. That’s a lot of muscle memory to ask folks to change, especially for the purpose of swapping in a function they likely don’t want or need in such a prominent position. (Again, imagine if Microsoft did this with the Start button.)
But perhaps more troubling yet, on a philosophical level, this speaks volumes about Google’s changing priorities for the ChromeOS experience — along with the experience around most of its products and services.
And, on that level, maybe this move shouldn’t seem like such a surprise.
And while Google itself hasn’t shared specific stats around Gemini’s adoption or its continued level of use by folks who try it, more and more signs suggest regular ol’ individual users and businesses alike are growing increasingly skeptical of the value this type of technology has to offer.
And yet — well, the gauntlet’s clearly been thrown down here. Google, like so many other tech companies, has gone all in on this stuff as the key to its future. And it’s determined to make us start using it and start seeing the value of things like “creative brainstorming” with its fact-challenged AI bot, information retrieving from a type of technology that can’t tell fact from fiction, and other such tasks most of us don’t see as being part of our daily workflow. It’s determined to make Chromebooks the devices for using all that Google AI glitz instead of the devices for getting actual work — the types of real-world, productivity-oriented work most of us are doing — done effectively.
Now, let’s level with each other: If this new “Quick Insert” key had come into existence alongside the spacebar — taking the spot of the dedicated (and already redundant, plus seemingly soon-to-be irrelevant) Assistant key on certain devices — it wouldn’t have seemed like such a facepalm-inducing problem, even if it might have been a mildly irksome addition.
But having it take over that prime placement — one so closely associated with ChromeOS’s identity and arguably its most important function — while having that Everything Button bump down to a much less prominent spot? That, in particular, is what makes this feel like such an ill-advised decision. It makes it feel like something people who actually use Chromebooks are gonna resent and find incredibly annoying. And it makes it feel like something Google itself might ultimately end up backtracking on another few years down the road.
More than anything, it makes it feel like something that should cause a fantastical opera singer to show up over Google’s shoulder and sing an emphatic “MISTAAAAAAAAAAKE!”
For now, though, all we can do is sigh — and hang onto the Chromebooks we already own, without this change in place, for as long as they stay supported.
Get even more no-nonsense Google knowledge with my free Android Intelligence newsletter — three new things to know and try directly in your inbox every Friday.
Microsoft on Tuesday confirmed it is no longer producing the HoloLens 2, the company’s second-generation augmented reality headset first launched five years ago at Mobile World Congress (MWC) in Barcelona.
At the time of launch, analysts predicted the new device could build momentum for augmented reality (AR) technology, which had so far failed to get serious traction. This is something that, for the most part, has not materialized.
A Microsoft spokesperson said the company has also “signaled a last time to buy for customers and partners. Support for HoloLens 2, including security updates, will end on Dec. 31, 2027.”
The spokesperson added that Microsoft “will continue to invest in mixed reality opportunities with first-party software solutions and services, partnering with the broader mobile phone and mixed reality hardware ecosystem. In addition, we remain fully committed to the IVAS program with the US Department of Defense.”
The IVAS program was launched three years ago. Microsoft said in a blog at the time that “the United States Army announced that it will work with [it] on the production phase of the Integrated Visual Augmentation System (IVAS) program as it moves from rapid prototyping to production and rapid fielding. The IVAS headset, based on HoloLens and augmented by Microsoft Azure cloud services, delivers a platform that will keep soldiers safer and make them more effective.”
Beginning of the end
Early last year, the company, facing macroeconomic uncertainly and slowing growth, confirmed it was laying off 100 employees working on its HoloLens, Surface laptop, and Xbox products, which essential closed down that division.
Anshel Sag, principal analyst at Moor Insights & Strategy, said the decision to cease production is a “formal acknowledgment of something that most of the industry had already been quite aware of for a while. Microsoft had significant layoffs in the Mixed Reality division and jettisoned the MRTK (Mixed Reality Toolkit) framework that powered much of the HoloLens’ software.”
It was pretty clear, he said, that “Microsoft was no longer investing in AR from a hardware side and only wanted to be a software provider, being a launch partner for Apple on Vision Pro, and also having productivity tools and gaming for Meta Quest.”
Who picks up the slack?
According to Sag, “Microsoft’s strategy has long been hardware agnostic thanks to its approach to OpenXR and embracing more open-source software, so many of Microsoft’s partners could potentially port some of their work to other enterprise AR platforms out there. The biggest problem I see is that there aren’t many standalone AR platforms out there that are a likely successor to the HoloLens 2 other than the Digilens ARGO.”
Digilens, said Sag, is “both a waveguide supplier and a headset maker, and seems to have gained a lot of momentum recently with many of Microsoft’s past partners, and I believe is best positioned from a hardware and software perspective to help past HoloLens 2 customers. Not only that, but at AWE 2024 this year, Digilens was the first to demonstrate Google’s Gemini running on any AR headset.”
While other companies like RealWear and ThirdEye do exist, he said, “they are less powerful platforms and may deliver a different kind of experience than HoloLens wearers are expecting. RealWear is assisted reality using a monocular LCD, and ThirdEye uses waveguides with see-through AR, but it only features an XR1 chipset that will likely need remote rendering for improved graphics.”
Enterprise AR use case shows real promise
Scott Bickley, research practice lead at Info-Tech Research Group, described the move by Microsoft as “ unfortunate, because the augmented reality use case for enterprise purposes in the industrial space held real promise. In my opinion, the R&D justification was built atop much broader and deeper virtual reality use cases that were never grounded in ‘reality’ to begin with.”
It may, he said, also “be a blessing in disguise if the alternatives can meet this need and emerge from the Social Media space at a more realistic price point, such as the Quest series of products from Meta, priced in the hundreds of dollars vs $3,500 for a HoloLens.”
To date, said Bickley,” the adoption of HoloLens is pathetic, with maybe a couple hundred thousand units sold across all generations of the product. Stack that against an investment likely in the hundreds of millions of dollars, maybe even a billion, and the ROI just never materialized.”
The need for augmented-reality-based solutions in the manufacturing and industrial space is a real gap,” he said, “however, that use case alone was not enough to power continued R&D costs from Microsoft.”
The World Wide Web Foundation, the organization whose mission has been to make the web safer and more accessible, has shut down, according to The Register. The foundation, which close its virtual doors Sept. 27, says its mission has largely been fulfilled and other organizations can take over the work.
When the organization was founded in 2009, just over 20% of the world’s population had access to the internet, with few groups working to change that reality. Today, that number has climbed to around 70%, and many organizations are working to raise it higher.
The foundation’s co-founders, World Wide Web inventor Sir Tim Berners-Lee and Rosemary Leith, said in a statement posted on the Foundation’s site that there are other challenges they want to focus on.
In particular, they write, is the social media companies’ model of commoditizing user data and concentrating power on the platforms, which runs counter to Berners-Lee’s original vision for the web. The foundation was wound down so he can focus on decentralized technologies such as the Solid Protocol, a specification that allows users to securely store data in decentralized data storage units known as Pods.
That technology has been under development since at least 2015.
The World Wide Web Foundation, the organization whose mission has been to make the web safer and more accessible, has shut down, according to The Register. The foundation, which close its virtual doors Sept. 27, says its mission has largely been fulfilled and other organizations can take over the work.
When the organization was founded in 2009, just over 20% of the world’s population had access to the internet, with few groups working to change that reality. Today, that number has climbed to around 70%, and many organizations are working to raise it higher.
The foundation’s co-founders, World Wide Web inventor Sir Tim Berners-Lee and Rosemary Leith, said in a statement posted on the Foundation’s site that there are other challenges they want to focus on.
In particular, they write, is the social media companies’ model of commoditizing user data and concentrating power on the platforms, which runs counter to Berners-Lee’s original vision for the web. The foundation was wound down so he can focus on decentralized technologies such as the Solid Protocol, a specification that allows users to securely store data in decentralized data storage units known as Pods.
That technology has been under development since at least 2015.
Microsoft on Tuesday announced several updates to its free Microsoft Copilot and paid-for Copilot Pro services aimed at making the personal AI assistant more powerful and easier to converse with.
Among the updates is Copilot Vision. Built natively into Microsoft’s Edge browser, the Vision feature lets Copilot see what a user sees when surfing the web. It can then respond to queries about the contents of a web page in natural language — highlighting reviews to help choose a film on Rotten Tomatoes, to give one of Microsoft’s examples, or assisting with research.
“We believe Copilot can go beyond answering basic questions and generating content, to offering more complete support for you and your tasks,” Yusuf Mehdi, Microsoft’s corporate vice president and consumer chief marketing officer, said in a pre-recorded press briefing.
The service will be limited to a list of pre-approved websites initially, said Microsoft. The company’s AI models won’t be trained on the content Copilot views.
“Increasingly, generative AI assistants are becoming multi-modal (language, vision and voice) and have personalities that can be configured by the consumers,” said Jason Wong, distinguished vice president analyst at Gartner. “We will see even more anthropomorphism of AI in the coming year.”
Mehdi said Microsoft has taken steps to “respect and protect” user privacy when accessing Copilot Vision, which is turned off by default. “You must actively choose to enable the Copilot feature,” he said. “You have clear notification it is on, no conversations or content are stored beyond the active session, and none of the Copilot Vision interactions will be used for training.”
The feature will initially roll out in the United States via Copilot Labs, a new service where paid Copilot Pro subscribers can test upcoming AI capabilities. Copilot Pro costs $20 per month.
Another experimental feature available in Copilot Labs is Think Deeper, which enables Copilot to “reason” and answer more complex questions.
“Think Deeper takes more time before responding, allowing Copilot to deliver detailed, step-by-step answers to challenging questions,” Microsoft’s Copilot Team said in a blog post. “We’ve designed it to be helpful for all kinds of practical, everyday challenges like comparing two complex options side by side. Should I move to this city or that? What type of car best suits my needs? And so on.”
Think Deeper is available now to a limited number of Copilot Pro customers in Australia, Canada, New Zealand, the United Kingdom and the United States.
Microsoft has also announced a refresh of the Microsoft Copilot mobile app, with a UI that is “leaner, simpler, warmer, and all around more approachable,” said Mehdi. The new Copilot app rolls out today.
Conversations with the AI assistant will be more realistic and natural with the introduction of Copilot Voice, Microsoft said. The revamped voice interface promises faster responses and the ability to interrupt when the Copilot is speaking; users can also now select from four different voices to interact with when talking with the Copilot assistant.
“With the new Copilot Voice, you’ll have a smoother and more engaging conversation, because responses are faster and you can easily interrupt and direct your experience,” said Mehdi.
One of the Copilot voices can also be chosen to read out a Copilot Daily news digest — a summary of news from authorized content sources. (Microsoft has partnered with Reuters, Financial Times, German publisher Axel Springer and others.) It will also provide weather forecasts, with a reminder function also in the works.
Copilot Voice is initially available in English in Australia, Canada, New Zealand, the United Kingdom, and the United States. It will expand to more regions and languages soon, Microsoft said. Copilot Daily is rolling out now starting in the United States and the United Kingdom with more countries coming soon.
To help new users get started, Microsoft has released Copilot Discover, which provides guidance on the AI assistant’s features and “conversation starter” suggestions.
Microsoft Copilot’s new Discover feature provides guidance on the AI assistant and conversation starters.
Microsoft
The introduction of realistic AI assistants is part of a wider trend, said Wong. Gartner predicts that, by 2026, 80% of the top 100 consumer brands will offer anthropomorphized generative AI agents to drive consumer loyalty.
It’s not just Microsoft Copilot; Google Gemini, OpenAI’s ChatGPT, and X.ai Grok are all developing multi-modal agents that will “entertain, inform and connect the consumer to relevant services and products,” said Wong. “This is the next frontier — and battleground — of customer experience.”
Microsoft on Tuesday announced several updates to its free Microsoft Copilot and paid-for Copilot Pro services aimed at making the personal AI assistant more powerful and easier to converse with.
Among the updates is Copilot Vision. Built natively into Microsoft’s Edge browser, the Vision feature lets Copilot see what a user sees when surfing the web. It can then respond to queries about the contents of a web page in natural language — highlighting reviews to help choose a film on Rotten Tomatoes, to give one of Microsoft’s examples, or assisting with research.
“We believe Copilot can go beyond answering basic questions and generating content, to offering more complete support for you and your tasks,” Yusuf Mehdi, Microsoft’s corporate vice president and consumer chief marketing officer, said in a pre-recorded press briefing.
The service will be limited to a list of pre-approved websites initially, said Microsoft. The company’s AI models won’t be trained on the content Copilot views.
“Increasingly, generative AI assistants are becoming multi-modal (language, vision and voice) and have personalities that can be configured by the consumers,” said Jason Wong, distinguished vice president analyst at Gartner. “We will see even more anthropomorphism of AI in the coming year.”
Mehdi said Microsoft has taken steps to “respect and protect” user privacy when accessing Copilot Vision, which is turned off by default. “You must actively choose to enable the Copilot feature,” he said. “You have clear notification it is on, no conversations or content are stored beyond the active session, and none of the Copilot Vision interactions will be used for training.”
The feature will initially roll out in the United States via Copilot Labs, a new service where paid Copilot Pro subscribers can test upcoming AI capabilities. Copilot Pro costs $20 per month.
Another experimental feature available in Copilot Labs is Think Deeper, which enables Copilot to “reason” and answer more complex questions.
“Think Deeper takes more time before responding, allowing Copilot to deliver detailed, step-by-step answers to challenging questions,” Microsoft’s Copilot Team said in a blog post. “We’ve designed it to be helpful for all kinds of practical, everyday challenges like comparing two complex options side by side. Should I move to this city or that? What type of car best suits my needs? And so on.”
Think Deeper is available now to a limited number of Copilot Pro customers in Australia, Canada, New Zealand, the United Kingdom and the United States.
Microsoft has also announced a refresh of the Microsoft Copilot mobile app, with a UI that is “leaner, simpler, warmer, and all around more approachable,” said Mehdi. The new Copilot app rolls out today.
Conversations with the AI assistant will be more realistic and natural with the introduction of Copilot Voice, Microsoft said. The revamped voice interface promises faster responses and the ability to interrupt when the Copilot is speaking; users can also now select from four different voices to interact with when talking with the Copilot assistant.
“With the new Copilot Voice, you’ll have a smoother and more engaging conversation, because responses are faster and you can easily interrupt and direct your experience,” said Mehdi.
One of the Copilot voices can also be chosen to read out a Copilot Daily news digest — a summary of news from authorized content sources. (Microsoft has partnered with Reuters, Financial Times, German publisher Axel Springer and others.) It will also provide weather forecasts, with a reminder function also in the works.
Copilot Voice is initially available in English in Australia, Canada, New Zealand, the United Kingdom, and the United States. It will expand to more regions and languages soon, Microsoft said. Copilot Daily is rolling out now starting in the United States and the United Kingdom with more countries coming soon.
To help new users get started, Microsoft has released Copilot Discover, which provides guidance on the AI assistant’s features and “conversation starter” suggestions.
Microsoft Copilot’s new Discover feature provides guidance on the AI assistant and conversation starters.
Microsoft
The introduction of realistic AI assistants is part of a wider trend, said Wong. Gartner predicts that, by 2026, 80% of the top 100 consumer brands will offer anthropomorphized generative AI agents to drive consumer loyalty.
It’s not just Microsoft Copilot; Google Gemini, OpenAI’s ChatGPT, and X.ai Grok are all developing multi-modal agents that will “entertain, inform and connect the consumer to relevant services and products,” said Wong. “This is the next frontier — and battleground — of customer experience.”
Apple management and security services provider Jamf unveiled a series of tools and features to support Apple admins at its well-attended JNUC event Oct. 1, with a focus on AI, security, and all-new solutions to make it easier to manage large Apple fleets.
“In today’s environment, support of hybrid and remote work is the norm and the need for protecting one’s environment is a must. Jamf recognizes the responsibility of an Apple admin has only grown more complex,” said Jamf CEO John Strosahl.
This year’s announcements certainly seem to reflect the increasing scale of challenges in distributed environments. “We’re streamlining the user experience, making security compliance easier than ever to achieve, and even providing each customer with a seasoned Jamf expert,” Strosahl added.
What did Jamf announce at JNUC 2024?
Improvements discussed at JNUC included:
AI Assistant.
Declarative Device Management.
Compliance Benchmarks.
Self Service+.
Apple’s enterprise-focused director of product marketing, Jeremy Butcher, joined Jamf leadership on stage to share insights into what Apple is itself doing to support enterprise deployments of its products.
These span the gamut of the company’s products, from new APIs and automated enrollment for Vision Pro to new features in Apple Business/Schools Manager that make it possible for admins to disable Activation Lock on managed devices. They also include management tools to enable or disable Apple Intelligence. “There’s obviously so much more, but I think most of you have probably been living it for a while,” he said as he left the stage.
With that, let’s take a look at what’s new:
What is AI Assistant?
Jamf CTO Beth Tschida arguably shared the most significant news. Jamf last year began working with generative AI as it attempted to build tools to optimize Apple admin workflows. Tschida explained the motivation: “All of you are in the middle of a rapidly evolving ecosystem,” she said. “Information comes at you at an overwhelming rate.”
The Jamf AI Assistant aims to help navigate all that data. “Think of it like having a Jamf expert at your side to help you make better decisions,” she said during the keynote speech.
AI Assistant is a powerful natural language interface that will soon be available with retrieval-augmented-generation (RAG) functionality in its initial beta offering. Full functionality and availability in admin portals is set for early 2025.
AI Assistant combines a vast knowledge base powered by RAG and direct integration with Jamf’s product APIs. What that means is that the AI can gather, analyze, and present the most relevant information — and can also actually do things for admins, such as creating subgroups of users for policies. What’s noteworthy about the implementation is that when it does perform a task, it explains what it has done and why in a side window; it’s a big deal, given the black-box decision-making practiced by some AI tools. Enterprise users, in particular, need to know why a certain decision was made.
“AI Assistant will have the ability to decode and contextualize security alerts, providing context about their severity and potential impact, suggest next steps, and take direct action, while keeping a human informed and in control,” said Tschida. “Within seconds, AI Assistant provides a thoughtful response, drawing from its vast knowledge base.”
The bottom line? What in the past would have taken IT admins many steps can now be handled in a few clicks using a natural language request.
AI Assistant has another set of tools: it can help admins identify patterns in breaches and integrate with Jamf’s security features. That’s a big deal, as it makes for faster response times, more accurate threat assessments, and tougher security.
Declarative Device Management with a twist
Jamf has long been an advocate for Declarative Device Management (DDM); like Apple, it believes DDM to be the future of device management. At JNUC, it announced improvements to its Blueprints features, touting a future-ready approach to managing device settings, commands, app installations, and restrictions — all through DDM.
Molly Mosely, Jamf vice president for product strategy, explained what this is capable of: “You can choose common task templates or build your own. You can drag-and-drop items to build your own custom blueprint, managing everything from Safari extensions to passcodes to use of external storage, and more.”
If the demo from JNUC is to be believed, Blueprints should empower Apple admins to easily and swiftly apply policies across their entire fleets (or parts of those fleets). The company can also make new APIs from Apple accessible across all Jamf users just by adding the appropriate API within the blueprint interface.
Compliance Benchmarks
Another useful set of tools to manage an uncertain world helps admins ensure macOS systems are security compliant. Built on the macOS Security Compliance Project and Jamf Compliance Editor, Compliance Benchmarks in Jamf Pro “simplifies building, managing, auditing, and reporting on CIS benchmark compliance,” the company said.
Available first to Macs (coming later to iPads and iPhones), Compliance Benchmarks bake in key compliance measures and gives admins an immediate view of where they and each device are in terms of maintaining such compliance.
The idea seems solid. It enables admins to ensure industry standards are met when it comes to such compliance. “You shouldn’t have to be a security expert to feel confident your data is protected,” Jamf said.
This takes away the complexity of managing multiple products, with there is more to come. Jamf confirmed it is working with partners to give admins much deeper insight into activity on their fleets using telemetry data, enabling much more in depth compliance management and control. By the end of the year, you’ll be able to audit your Macs like never before.
Self Service+
Jamf has offered a Self Service solution for a while. Self Service+ builds on those features, delivering them through a user-focused application that lets those using managed devices find their own way. This means a company-branded, curated overview of apps and content can be made available. What’s new is that end users can also monitor all their notifications and security alerts within the portal. That makes it easier to ensure employees can find what they need and stay informed without needing to work through multiple apps.
It also makes deployment and provisioning of apps and services a great deal easier for IT.
Apple management and security services provider Jamf unveiled a series of tools and features to support Apple admins at its well-attended JNUC event Oct. 1, with a focus on AI, security, and all-new solutions to make it easier to manage large Apple fleets.
“In today’s environment, support of hybrid and remote work is the norm and the need for protecting one’s environment is a must. Jamf recognizes the responsibility of an Apple admin has only grown more complex,” said Jamf CEO John Strosahl.
This year’s announcements certainly seem to reflect the increasing scale of challenges in distributed environments. “We’re streamlining the user experience, making security compliance easier than ever to achieve, and even providing each customer with a seasoned Jamf expert,” Strosahl added.
What did Jamf announce at JNUC 2024?
Improvements discussed at JNUC included:
AI Assistant.
Declarative Device Management.
Compliance Benchmarks.
Self Service+.
Apple’s enterprise-focused director of product marketing, Jeremy Butcher, joined Jamf leadership on stage to share insights into what Apple is itself doing to support enterprise deployments of its products.
These span the gamut of the company’s products, from new APIs and automated enrollment for Vision Pro to new features in Apple Business/Schools Manager that make it possible for admins to disable Activation Lock on managed devices. They also include management tools to enable or disable Apple Intelligence. “There’s obviously so much more, but I think most of you have probably been living it for a while,” he said as he left the stage.
With that, let’s take a look at what’s new:
What is AI Assistant?
Jamf CTO Beth Tschida arguably shared the most significant news. Jamf last year began working with generative AI as it attempted to build tools to optimize Apple admin workflows. Tschida explained the motivation: “All of you are in the middle of a rapidly evolving ecosystem,” she said. “Information comes at you at an overwhelming rate.”
The Jamf AI Assistant aims to help navigate all that data. “Think of it like having a Jamf expert at your side to help you make better decisions,” she said during the keynote speech.
AI Assistant is a powerful natural language interface that will soon be available with retrieval-augmented-generation (RAG) functionality in its initial beta offering. Full functionality and availability in admin portals is set for early 2025.
AI Assistant combines a vast knowledge base powered by RAG and direct integration with Jamf’s product APIs. What that means is that the AI can gather, analyze, and present the most relevant information — and can also actually do things for admins, such as creating subgroups of users for policies. What’s noteworthy about the implementation is that when it does perform a task, it explains what it has done and why in a side window; it’s a big deal, given the black-box decision-making practiced by some AI tools. Enterprise users, in particular, need to know why a certain decision was made.
“AI Assistant will have the ability to decode and contextualize security alerts, providing context about their severity and potential impact, suggest next steps, and take direct action, while keeping a human informed and in control,” said Tschida. “Within seconds, AI Assistant provides a thoughtful response, drawing from its vast knowledge base.”
The bottom line? What in the past would have taken IT admins many steps can now be handled in a few clicks using a natural language request.
AI Assistant has another set of tools: it can help admins identify patterns in breaches and integrate with Jamf’s security features. That’s a big deal, as it makes for faster response times, more accurate threat assessments, and tougher security.
Declarative Device Management with a twist
Jamf has long been an advocate for Declarative Device Management (DDM); like Apple, it believes DDM to be the future of device management. At JNUC, it announced improvements to its Blueprints features, touting a future-ready approach to managing device settings, commands, app installations, and restrictions — all through DDM.
Molly Mosely, Jamf vice president for product strategy, explained what this is capable of: “You can choose common task templates or build your own. You can drag-and-drop items to build your own custom blueprint, managing everything from Safari extensions to passcodes to use of external storage, and more.”
If the demo from JNUC is to be believed, Blueprints should empower Apple admins to easily and swiftly apply policies across their entire fleets (or parts of those fleets). The company can also make new APIs from Apple accessible across all Jamf users just by adding the appropriate API within the blueprint interface.
Compliance Benchmarks
Another useful set of tools to manage an uncertain world helps admins ensure macOS systems are security compliant. Built on the macOS Security Compliance Project and Jamf Compliance Editor, Compliance Benchmarks in Jamf Pro “simplifies building, managing, auditing, and reporting on CIS benchmark compliance,” the company said.
Available first to Macs (coming later to iPads and iPhones), Compliance Benchmarks bake in key compliance measures and gives admins an immediate view of where they and each device are in terms of maintaining such compliance.
The idea seems solid. It enables admins to ensure industry standards are met when it comes to such compliance. “You shouldn’t have to be a security expert to feel confident your data is protected,” Jamf said.
This takes away the complexity of managing multiple products, with there is more to come. Jamf confirmed it is working with partners to give admins much deeper insight into activity on their fleets using telemetry data, enabling much more in depth compliance management and control. By the end of the year, you’ll be able to audit your Macs like never before.
Self Service+
Jamf has offered a Self Service solution for a while. Self Service+ builds on those features, delivering them through a user-focused application that lets those using managed devices find their own way. This means a company-branded, curated overview of apps and content can be made available. What’s new is that end users can also monitor all their notifications and security alerts within the portal. That makes it easier to ensure employees can find what they need and stay informed without needing to work through multiple apps.
It also makes deployment and provisioning of apps and services a great deal easier for IT.
