Apple model combines vision understanding and image generation »

Apple researchers have published a study on a new model "Manzano" that represents improved quality and performance compared to current versions.
Apple model combines vision understanding and image generation »

From Marcus Mendes on 9to5Mac:

In the study titled MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer, a team of nearly 30 Apple researchers details a novel unified approach that enables both image understanding and text-to-image generation in a single multimodal model.

Mendes gives a detailed explanation of the paper’s results – Apple’s image generation is “comparable” to GPT-4o in some tests, for example:

As a result of this approach, “Manzano handles counterintuitive, physics-defying prompts (e.g., ‘The bird is flying below the elephant’) comparably to GPT-4o and Nano Banana,” the researchers say.

We can basically see here that Apple’s models are a year behind where they want to be – but potentially catching up thanks to new research.

View the original.

Posts You Might Like

15 iPhone Shortcuts YOU Requested: Auto-Texting, Alarms, Music, and More! »
15 iPhone Shortcuts YOU Requested: Auto-Texting, Alarms, Music, and More! »
Stephen Robles continues his Shortcuts series on YouTube by building shortcuts off listener requests – a great watch as always.
Preparing Your App for Apple Intelligence: My Conference Talk from NSSpain 2024
Preparing Your App for Apple Intelligence: My Conference Talk from NSSpain 2024
Watch my full presentation about Apple Intelligence from NSSpain – this is the perfect primer ahead of new features arriving soon.
Shortcuts Showdown on The Vergecast »
Shortcuts Showdown on The Vergecast »
Stephen Robles appeared on the Vergecast for a Shortcuts Showdown Debate with David Pierce – I linked to the various chapters for their discussion.
YouTuber Personas Take FaceTime Call on Apple Vision Pro
YouTuber Personas Take FaceTime Call on Apple Vision Pro
YouTuber iJustine joined MKBHD and Brian Tong in a FaceTime call to demo their Personas created with Apple Vision Pro.