New developer APIs hint at ‘Personal Context’ for Apple Intelligence coming in iOS 18.4

New developer APIs in iOS 18.4 hint at the coming Personal Context feature – now apps can tell Siri what she's looking at.

The first look at Personal Context for Apple Intelligence is here as APIs available in the iOS 18.4 developer betas allow apps to further their content for the system to understand. This sets the stage for the most significant update to Siri so far, where all your apps can provide Siri with the available views and content to work with – in a secure and private manner, too.

As first mentioned by Prathamesh Kowarkar on Mastodon, there is now a suite of APIs in beta that associate an app’s unique content, called an entity, with a specific view – this allows Siri to read what’s indexed on-screen and use it with other app’s actions when triggered by a command.

APIs like this are necessary for the coming Siri update to actually do what Apple says Apple Intelligence is capable of – now that the functionality is here, however, it’s up to developers to implement everything to make sure the experience works well.

Here are the new pages:

If these APIs are in beta now, it stands to reason they’ll leave beta after iOS 18.4 releases in full – which means Personal Context might be coming as early as iOS 18.4.

Check out the post from Kowarkar on Mastodon.

Update: Nope – it’s officially delayed.

Posts You Might Like

App Shortcuts Work on HomePod in iOS 17 »
New in iOS 17 – HomePod gets proper support for App Shortcuts, letting you access a wide range of Siri actions with your voice-only.
How to migrate from custom intents to App Intents »
Tyler Hillsman shared the Tech Talk from Apple that guides developers through the process updating from older Shortcuts APIs to the newer App Intents.
Entity Enhancements: Help Siri AI Better Understand Your Apps’ Content
With Siri AI, Apple has updated App Intents to better understand data from your apps – with IntentValueRepresentation, RelevantEntities, EntityCollection, and SyncableEntity.
Teach Siri AI to Share Structured Types Without Known Formats Across Apps with ValueRepresentation
Some apps have unique types that Siri AI can't understand by default – ValueRepresentation helps teach the system about your type.