Prompt Extend: Extending stable diffusion prompts with suitable style cues using text generation

Name of Project: Prompt Extend

Proposal in one sentence: Text generation model to extend stable diffusion prompts with suitable style cues.

Description of the project and what problem it is solving:

To generate beautiful images, currently available diffusion models usually require complex prompts with additional style cues added to them.

So I’ve made this text generation model that helps with prompt engineering by expanding on the main idea of a prompt and generating suitable style cues to add to the prompt.

Example:

You could play with it on HuggingFace Space

Here’s the GitHub repo for the project, and I’ve also uploaded the model on HuggingFace Hub.

Grant Deliverables:

  • I’m currently using the GPT-2 architecture for the tokenizer and the model I’ve trained; in the future, I’m looking to experiment with different architectures like GPT-NeoX to improve the model.
  • Improving and expanding the dataset of prompts and training future models on it.

Squad

Partho Das. So far, it is a personal project.

  • Twitter handle: daspartho_

  • Discord handle: daspartho#3367

  • ETH mainnet wallet address for potential funds: 0xb70003E35ec3368c1B1BA82aa64C3687A730e107

Grants for the project will help me to develop this further.

2 Likes

I think that this may help you with your task.

2 Likes

I’ll check it out, thank you!