Poem2Pic Poetry and Art
Poetry is food for the soul. On the other hand, an image is worth a thousand words. With Poem2Pic, one blends poetry with art. Poem2Pic enables the generation of an image based on a poem. In particular, Flan-T5, a large language model (LLM), is used to generate a very short summary of an input poem. The summary is then fed to Stable Diffusion in order to generate an image. The final image is displayed to the user. The project used Langchain to interface with the LLM. The user interface is built using Streamlit. The source code and live demo are available at https://huggingface.co/spaces/barunsaha/poem2pic Poem2Pic is primarily aimed at having fun. However, it might find potential applications in the self-publishing industry, for example. In addition, artists as well as the vast poetry community on Twitter and Instagram might find it useful to.