Controllable Zero-Shot Photo Customization through Scene-Aware Inversion
PDF

Keywords

Controllable Image Editing
Inversion Fidelity
Edit Locality
Scene Consistency
Control Strength
Evaluation

Abstract

Controllable Image Editing is advancing through efforts to align performance with evidence quality, resource limits, and transfer across settings. The discussion is organized around preserving identity and scene structure while exposing useful controls without per-image training. It synthesizes 1 focal paper with 11 independently retrieved publications reviewed against traceable publication metadata. The analysis is organized around inversion fidelity, edit locality, scene consistency, control strength, and evaluation. To avoid reading results from heterogeneous studies as exchangeable, the review compares problem boundaries, design logic, and conditions of validation. Across the literature, the comparison suggests that advances in controllable image editing become credible when representation, objective, and evaluation protocol are evaluated together and when uncertainty about distribution shift is reported explicitly. The resulting account aligns method selection to downstream risk and the conditions that weaken external validity, and proposes a research agenda centered on clear comparators, adversarial conditions, and inspectable evidence.

PDF

References

Ren, M., Vaddamanu, P., Xu, J., & Frade, F. D. L. T. (2025). CusEnhancer: A Zero-Shot Scene and Controllability Enhancement Method for Photo Customization via ResInversion. arXiv preprint arXiv:2509.20775.

Xu, Y., Zhai, B., Zhang, C., Li, M., Li, Y., & Du, S. (2025). Diff-PC: Identity-preserving and 3D-aware controllable diffusion for zero-shot portrait customization. Information Fusion, 117, 102869. https://doi.org/10.1016/j.inffus.2024.102869

Tang, X., Li, R., & Fan, X. (2026). ZeroScene: A Zero‐Shot Framework for 3D Scene Generation from a Single Image and Controllable Texture Editing. Computer Graphics Forum. https://doi.org/10.1111/cgf.70419

Akdemir, K., Shi, J., Kafle, K., Price, B. L., & Yanardag, P. (2026). Plot’n Polish: Zero-Shot Story Visualization and Disentangled Editing with Text-to-Image Diffusion Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(3), 1694-1702. https://doi.org/10.1609/aaai.v40i3.37147

Zhao, X., Kong, W., Liu, Z., Wang, M., & Li, Y. (2025). CDZL: a controllable diversity zero-shot image caption model using large language models. Signal, Image and Video Processing, 19(4). https://doi.org/10.1007/s11760-025-03871-9

Hamrani, A., & Godavarty, A. (2025). Self-Attention Diffusion Models for Zero-Shot Biomedical Image Segmentation: Unlocking New Frontiers in Medical Imaging. Bioengineering, 12(10), 1036. https://doi.org/10.3390/bioengineering12101036

Wu, N. (2024). Attribute binding enhancement improvement for diffusion model based zero-shot image segmentation. Applied and Computational Engineering, 86(1), 116-124. https://doi.org/10.54254/2755-2721/86/20241585

Rahman, S., Khan, S., & Porikli, F. (2018). A Unified Approach for Conventional Zero-Shot, Generalized Zero-Shot, and Few-Shot Learning. IEEE Transactions on Image Processing, 27(11), 5652-5667. https://doi.org/10.1109/tip.2018.2861573

Zhang, F., Chen, J., Zhou, H., & Xu, C. (2026). Enhancing Representation Inversion and Alignment for Zero-Shot Composed Image Retrieval. IEEE Transactions on Multimedia, 1-13. https://doi.org/10.1109/tmm.2026.3702526

Song, Y., Kim, J., Park, W., Shin, W., Rhee, W., & Kwak, N. (2025). Harmonizing Visual and Textual Embeddings for Zero-Shot Text-to-Image Customization. Proceedings of the AAAI Conference on Artificial Intelligence, 39(19), 20549-20557. https://doi.org/10.1609/aaai.v39i19.34264

Chu, J., Yu, X., & Lu, W. (2026). Zero-Shot Low-Light Image Enhancement via Diffusion with Joint Frequency and Spatial Guidance. Applied Sciences, 16(16), 8329. https://doi.org/10.3390/app16168329

Kakinuma, Y., Miyata, T., Hosono, K., & Kinoshita, H. (2026). Integrating Latent and Pixel Diffusion Models for Zero-Shot Image Inpainting. Nonlinear Theory and Its Applications, IEICE. https://doi.org/10.1587/nolta.2026ncp0007

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Copyright (c) 2026 Eugene Barrett, Harold Fletcher, Jerry Burke (Author)