Generative User Interface for the Mobile Apps: Image Synthesis with VAEs, GANs, and Stable Diffusion

Introduction of the neural network models in creating intelligent mobile user interfaces poses a new challenge for researchers and the application developers. Each year, using the generative models in automatic image generation becomes more and more important. Developing interfaces based on the element images and the entire screen is considered an innovation solution in design. The paper presents results of testing the Variational Autoencoder (VAE), Generative Adversarial Network (GAN) and Stable Diffusion models aimed at studying these approaches potential in creating the user interfaces. To compare the approaches, it analyzes the obtained images as the user interfaces based on the usability metrics. The analysis makes it possible to formulate recommendations for selecting suitable models for various applications and highlights the areas for further research.