On-device AI is the way to go. No privacy leak. Doesn’t have server and networking costs.
This specific use case (looking things up in Start menu and settings) is a good one, since finding out which setting to tweak is a major PITA.
Apple just announced at WWDC embedding Foundation Models on phones. Except they will allow apps to access them and give them custom prompts. This doesn’t go quite as far.
On-device AI is the way to go. No privacy leak. Doesn’t have server and networking costs.
This specific use case (looking things up in Start menu and settings) is a good one, since finding out which setting to tweak is a major PITA.
Apple just announced at WWDC embedding Foundation Models on phones. Except they will allow apps to access them and give them custom prompts. This doesn’t go quite as far.