OpenAI’s latest update to ChatGPT has introduced native image generation, but users have already discovered a peculiar glitch. While the AI has no trouble generating images of “sexy men,” it refuses to create images of “sexy women”, citing content policy restrictions. OpenAI CEO Sam Altman has acknowledged the issue, calling it a bug and promising a fix.
ChatGPT’s odd double standard
The issue came to light when a user on X (formerly Twitter) tested the feature by requesting images of both a “sexy man” and a “sexy woman.” The AI successfully generated the former but blocked the latter, explaining that it violated OpenAI’s content guidelines.
When pressed for a reason, ChatGPT responded with a lengthy explanation, arguing that “sexy” when applied to men is often seen as confidence, style, or physique, whereas for women, it can lean into objectification. This justification didn’t sit well with users, who pointed out the inconsistency.
Sam Altman promises a fix—but not without a joke
The controversy caught the attention of Sam Altman, who responded directly to the viral post. Calling it “a bug”, Altman confirmed that the restriction on generating “sexy women” was not intentional and would be fixed soon. However, he also couldn’t resist adding a tongue-in-cheek remark, reacting to the AI’s generated male image with: “Hot guy though!”
Altman also reminded users that ChatGPT’s new image feature is still rolling out, meaning some users might experience delays or inconsistencies while it becomes more widely available.
What’s next for GPT-4o’s Image Generation?
The image-generation function in ChatGPT is powered by GPT-4o, OpenAI’s latest and most advanced model. Unlike earlier versions that relied on DALL-E, this new tool is built directly into ChatGPT, making it easier for users to create and modify images.
According to OpenAI, GPT-4o’s training data includes proprietary partnerships with companies like Shutterstock, along with publicly available data. The AI also allows users to customize images with options like transparent backgrounds, aspect ratios, and precise color choices using hex codes.
While the "sexy women" bug is expected to be patched soon, the debate over bias in AI-generated content is far from over.
