Apple model combines vision understanding and image generation »

Apple researchers have published a study on a new model "Manzano" that represents improved quality and performance compared to current versions.

From Marcus Mendes on 9to5Mac:

In the study titled MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer, a team of nearly 30 Apple researchers details a novel unified approach that enables both image understanding and text-to-image generation in a single multimodal model.

Mendes gives a detailed explanation of the paper’s results – Apple’s image generation is “comparable” to GPT-4o in some tests, for example:

As a result of this approach, “Manzano handles counterintuitive, physics-defying prompts (e.g., ‘The bird is flying below the elephant’) comparably to GPT-4o and Nano Banana,” the researchers say.

We can basically see here that Apple’s models are a year behind where they want to be – but potentially catching up thanks to new research.

View the original.

Posts You Might Like

Shortcuts Showdown on The Vergecast »
Stephen Robles appeared on the Vergecast for a Shortcuts Showdown Debate with David Pierce – I linked to the various chapters for their discussion.
Apple Tests ‘Apple GPT,’ Develops Generative AI Tools to Catch OpenAI »
According to Bloomberg, Apple is testing their own generative AI tool called "Ajax" internally – here's why I think it needs to take advantage of Shortcuts.
13 Features of iOS 13: Shortcuts (Six Colors)
If Apple wants its headset to win, it needs to reinvent the app »
David Pierce of The Verge takes a look at Apple's approach to apps in lieu of a rumored headset – and how the ecosystem needs to change.