Apple model combines vision understanding and image generation »

Apple researchers have published a study on a new model "Manzano" that represents improved quality and performance compared to current versions.
Apple model combines vision understanding and image generation »

From Marcus Mendes on 9to5Mac:

In the study titled MANZANO: A Simple and Scalable Unified Multimodal Model with a Hybrid Vision Tokenizer, a team of nearly 30 Apple researchers details a novel unified approach that enables both image understanding and text-to-image generation in a single multimodal model.

Mendes gives a detailed explanation of the paper’s results – Apple’s image generation is “comparable” to GPT-4o in some tests, for example:

As a result of this approach, “Manzano handles counterintuitive, physics-defying prompts (e.g., ‘The bird is flying below the elephant’) comparably to GPT-4o and Nano Banana,” the researchers say.

We can basically see here that Apple’s models are a year behind where they want to be – but potentially catching up thanks to new research.

View the original.

Posts You Might Like

iPhone 15 Pro Action Button Option for Shortcuts Potentially Revealed in iOS 17 Code »
iPhone 15 Pro Action Button Option for Shortcuts Potentially Revealed in iOS 17 Code »
Code has been found suggesting the Action button is coming to the next iPhone – here’s why I think the Shortcuts support needs to be improved.
Automating Devices with Elgato Stream Deck via Apple Shortcuts »
Automating Devices with Elgato Stream Deck via Apple Shortcuts »
Daniel Raffel shares his experience setting up HomeKit devices as a single-press toggle in Shortcuts – so he can control his lights via Stream Deck.
Use This Automation To Protect Your iPhone If Stolen While Unlocked
Use This Automation To Protect Your iPhone If Stolen While Unlocked
Diego Jimenez has put together a clever shortcut for securing your iPhone using the Lock Screen action that works as a Personal Automation when Airplane Mode is activated.
How to Use Custom File Names for Screenshots on an iPhone »
How to Use Custom File Names for Screenshots on an iPhone »
MakeUseOf has put together a guide on how to use the Take Screenshot action in Shortcuts to give your captures a custom filename.