New developer APIs hint at ‘Personal Context’ for Apple Intelligence coming in iOS 18.4

New developer APIs in iOS 18.4 hint at the coming Personal Context feature – now apps can tell Siri what she's looking at.

The first look at Personal Context for Apple Intelligence is here as APIs available in the iOS 18.4 developer betas allow apps to further their content for the system to understand. This sets the stage for the most significant update to Siri so far, where all your apps can provide Siri with the available views and content to work with – in a secure and private manner, too.

As first mentioned by Prathamesh Kowarkar on Mastodon, there is now a suite of APIs in beta that associate an app’s unique content, called an entity, with a specific view – this allows Siri to read what’s indexed on-screen and use it with other app’s actions when triggered by a command.

APIs like this are necessary for the coming Siri update to actually do what Apple says Apple Intelligence is capable of – now that the functionality is here, however, it’s up to developers to implement everything to make sure the experience works well.

Here are the new pages:

If these APIs are in beta now, it stands to reason they’ll leave beta after iOS 18.4 releases in full – which means Personal Context might be coming as early as iOS 18.4.

Check out the post from Kowarkar on Mastodon.

Update: Nope – it’s officially delayed.

Posts You Might Like

How to migrate from custom intents to App Intents »
Tyler Hillsman shared the Tech Talk from Apple that guides developers through the process updating from older Shortcuts APIs to the newer App Intents.
Teach Siri AI to Share Structured Types Without Known Formats Across Apps with ValueRepresentation
Some apps have unique types that Siri AI can't understand by default – ValueRepresentation helps teach the system about your type.
Apple’s developer APIs for Shortcuts are way better this year
Roundup of App Intents developer sessions from WWDC’24
Check out links to every session relevant to App Intents available at WWDC for 2024.