Apple model combines vision understanding and image generation »

Apple researchers have published a study on a new model "Manzano" that represents improved quality and performance compared to current versions.
Apple model combines vision understanding and image generation »

From Marcus Mendes on 9to5Mac:

In the study titled MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer, a team of nearly 30 Apple researchers details a novel unified approach that enables both image understanding and text-to-image generation in a single multimodal model.

Mendes gives a detailed explanation of the paper’s results – Apple’s image generation is “comparable” to GPT-4o in some tests, for example:

As a result of this approach, “Manzano handles counterintuitive, physics-defying prompts (e.g., ‘The bird is flying below the elephant’) comparably to GPT-4o and Nano Banana,” the researchers say.

We can basically see here that Apple’s models are a year behind where they want to be – but potentially catching up thanks to new research.

View the original.

Posts You Might Like

Announcing My WWDC Meetup: Apple Intelligence Automators at CommunityKit
Announcing My WWDC Meetup: Apple Intelligence Automators at CommunityKit
Join me post-WWDC at the Hyatt House near Apple Park to discuss Apple Intelligence, App Intents, and Shortcuts!
Bike: Automate with Shortcuts »
Bike Outliner for Mac has added 14 new actions to Shortcuts to automate your outlines, including a video tutorial.
PSA: AI Terminal bots can query macOS Spotlight using mdfind
PSA: AI Terminal bots can query macOS Spotlight using mdfind
For anyone using Claude Code or OpenClaw, try querying Spotlight with Apple's own Terminal tool `mdfind.`
The Future of App Development: Artificial Intelligence and App Intents (feat. Connor Hammond)
The Future of App Development: Artificial Intelligence and App Intents (feat. Connor Hammond)
AI consultant and app developer Connor Hammond joins me to talk about the future of app development in a world of AI, particularly in relation to Apple's App Intents APIs.