A mysterious new image generation model is beating models from Midjourney, Black Forest Labs, and OpenAI on the crowdsourced Artificial Analysis benchmark.
An image generation model is a conceptual understanding of how light from a scene is converted into an image. There are two types of image generation:
- Unconditional generation: Generating new images from an existing dataset without any specific conditions.
- Conditional image generation: Generating samples based on a specific label or condition from the dataset.
The model, which goes by the name “red_panda,” is around 40 Elo points ahead of the next-best-ranking model, Black Forest Labs’ Flux1.1 Pro, on Artificial Analysis’ text-to-image leaderboard. Artificial Analysis uses Elo, a ranking system originally developed to calculate the relative skill level of chess players, to compare the performance of the various models it tests.[1]
An image reportedly generated by red_panda. Image Credits:Deedy Das(opens in a new window)
Similar to the community AI benchmark Chatbot Arena, Artificial Analysis ranks models through crowdsourcing. For image models, Artificial Analysis selects two models at random and feeds them a unique prompt. Then it presents the prompt and resulting images, and users choose which they think better reflects the prompt.
Image Credits:Artificial Analysis
Granted, there’s some bias in this voting process. Artificial Analysis’ voters are AI enthusiasts, for the most part, and their choices might not reflect the preferences of the wider community of generative AI users.
But red_panda is also one of the better-performing models on the leaderboard in terms of its generation speed. The model takes a median of around 7 seconds to generate an image — over 100 times faster than OpenAI’s DALL-E 3.
Another image reportedly from red_panda. Image Credits:Neuralithic(opens in a new window)
So, where did red_panda come from? Which company made it? And when can we expect it be released? All good questions. AI labs increasingly use community benchmarks to drum up anticipation ahead of an announcement, though, so it might not be long before we find out.
This article is shared at no charge for educational and informational purposes only.
Red Sky Alliance is a Cyber Threat Analysis and Intelligence Service organization. We provide indicators of compromise information via a notification service (RedXray) or an analysis service (CTAC). For questions, comments or assistance, please contact the office directly at 1-844-492-7225, or feedback@redskyalliance.com
Weekly Cyber Intelligence Briefings:
- Reporting: https://www.redskyalliance.org/
- Website: https://www.redskyalliance.com/
- LinkedIn: https://www.linkedin.com/company/64265941
Weekly Cyber Intelligence Briefings:
REDSHORTS - Weekly Cyber Intelligence Briefings
https://register.gotowebinar.com/register/5378972949933166424
[1] https://techcrunch.com/2024/10/28/a-mysterious-new-image-generation-model-has-appeared/
Comments