arXiv Releases StruPO: Structure-Aware Prompt Optimization for Text-to-Image Generation

Summary:arXiv has released a new research paper introducing StruPO, a structure-aware prompt optimization method for text-to-image generation. StruPO leverages a calibrated scene graph as a shared representation to convert structural feedback into a training signal, optimizing prompts to preserve semantic consistency in the generated images. The method demonstrates significant improvements in faithfulness and aesthetic quality across multiple benchmarks, particularly in handling complex relationships. T

---

Technical Mechanism Analysis

The core innovation of StruPO lies in using a structured scene graph as a shared representation to convert user feedback on images into actionable structured signals. The scene graph, with its nodes and edges representing objects and their relationships in the image, provides clear semantic guidance for prompt optimization. Specifically, StruPO achieves prompt optimization through the following steps:

1. Scene Graph Calibration: First, the user's text request is parsed to generate a calibrated scene graph that specifies the objects, attributes, and relationships to be preserved in the image.
2. Structured Feedback Processing: The scene graph is modified through deletion, reordering, and insertion operations to adjust the prompt. These operations ensure that the modified prompt remains semantically consistent with the original request.
3. Image Generation and Evaluation: The modified prompt is used to generate an image, and through smooth reward shaping and image averaging techniques, the generated image is optimized for both faithfulness and aesthetic quality.

Engineering Trade-offs and Performance

StruPO has been evaluated across multiple benchmarks and compared with existing prompt optimization methods such as iterative structural feedback, diffusion model fine-tuning, and inference-time attention control. The results show that StruPO excels in the faithfulness-aesthetics trade-off, particularly in handling complex relationships, where the generated images significantly outperform those from other methods in terms of relational fidelity.

However, StruPO also has some limitations. For instance, the calibration and modification of the scene graph require significant computational resources, especially when dealing with large datasets. Additionally, StruPO is highly dependent on the quality of the generation model; if the model itself is biased, StruPO may not fully compensate for it.

Developer Implementation and Deployment Recommendations

For developers, StruPO offers a new approach to prompt optimization, particularly in applications requiring high-precision image generation, such as virtual reality, game development, and advertising design. Here are some deployment recommendations:

1. Resource Optimization: Due to the high computational resource requirements of StruPO, it is recommended to perform resource optimization during deployment, such as using distributed computing or mixed-precision training techniques.
2. Model Integration: When integrating StruPO with existing generation models, it is important to ensure that the model's output is semantically consistent with the scene graph to fully leverage StruPO's advantages.
3. User Feedback Mechanism: Establishing an effective user feedback mechanism is crucial to continuously adjust and optimize StruPO's prompt optimization strategy based on user needs.

Conclusion

StruPO demonstrates the great potential of structured feedback in text-to-image prompt optimization, providing a new solution for improving the quality of AI-generated images. Despite some limitations, its innovation and practicality make it an important advancement in the field of AI image generation.

---

Source: ArXiv AI (cs.AI) (2026-10-28)

— END —

Tags: #StruPO Follow #Text-to-Image Follow #Prompt Optimization Follow #Structured Feedback Follow #AI Image Generation Follow