The long-awaited overhaul of Apple’s siri is on the horizon, poised to become significantly more powerful and intuitive thanks to a strategic partnership with Google and the integration of Google’s Gemini models. Apple confirmed this week that upcoming Siri features will be driven by the advanced capabilities of Gemini, marking a pivotal shift in Apple’s approach to virtual assistants.
The anticipation surrounding an improved Siri isn’t new. Hints of these developments first surfaced during WWDC 2024, followed by a now-deleted iPhone 16 ad showcasing enhanced features. However,the launch of Gemini Personal Intelligence provides a tangible preview of the potential that lies ahead.
Drawing Personal Information From Your Apps
At the heart of Gemini’s enhanced functionality is its ability to access and process information from a wide array of sources to deliver highly personalized responses. Google yesterday launched a beta version of what it calls Personal Intelligence, connecting to apps like Gmail, Calendar, Drive, Google Photos, YouTube, Search, Shopping, News, Maps, Google Flights, and Hotels. This allows Gemini to understand user context and needs far better than previous iterations.
Personal Intelligence can retrieve specific details from text,photos,or videos in your Google apps to customize Gemini responses. This includes Google Workspace (Gmail, Calendar, Drive, etc), Google Photos, your youtube watch history, and of all of the various Google search services you’ve used (Search, Shopping, news, Maps, Google Flights, and hotels).
Apple’s implementation will mirror this functionality, drawing data from Apple’s own ecosystem of apps – Mail, Calendar, Photos, and Notes – to offer a similarly personalized experience.
Josh Woodward, Gemini’s head, illustrated the power of this integration with a practical example: needing tire information for his minivan. gemini not only identified the correct tire size but also offered personalized recommendations based on past family road trip destinations found within google Photos, even locating the vehicle’s license plate in his photo library. This demonstrates a level of proactive assistance far exceeding the capabilities of typical chatbots.
Addressing the Hallucination Problem
A significant challenge with large language models is the potential for “hallucinations” – instances where the AI generates incorrect or nonsensical information. This risk is amplified when the AI relies on personal data.Google is addressing this concern within Personal Intelligence by providing clarity into Gemini’s reasoning. Users will be able to see the underlying assumptions made by the AI and have the opportunity to verify or correct them.
you also won’t have to guess where an answer comes from: Gemini will try to reference or explain the information it used from your connected sources so you can verify it. If it doesn’t, you can ask it for more information.And if a response feels off, just correct it on the spot (“Remember, I prefer window seats”).
Furthermore, users can opt to recieve responses without personalization, ensuring a neutral output when desired. This layered approach aims to build user trust and mitigate the risks associated with AI-generated inaccuracies.
Privacy Protection
Recognizing the sensitivity of personal data, Google has designed Personal Intelligence with privacy as a core principle. The feature requires explicit user opt-in, and users maintain control over which apps are connected.
Connecting your apps is off by default: you choose to turn it on, decide exactly which apps to connect, and can turn it off anytime.
Google emphasizes that data remains within the Google ecosystem, and Apple is expected to adopt a similar approach, restricting access to data solely within the user’s apps and iCloud account. This commitment to data security is crucial for fostering user confidence.
Video Run-Through
For a detailed visual demonstration of these new features, 9to5Google provides an informative 8-minute video:
The anticipated integration of Gemini into Apple’s Siri promises a significant upgrade to the virtual assistant’s capabilities. By accessing and intelligently utilizing data from users’ Apple apps and iCloud accounts, the new siri aims to become a truly intuitive and personalized tool. The deployment, whether running on-device or via Apple’s Private Cloud Compute servers, signals a commitment to a more intelligent and responsive user experience.
Image: Google
FTC: We use income earning auto affiliate links. More.
