7 ms·

Can you write a prompt to optimize prompts? Seems like an LLM should be able to judge a prompt, and collaboratively work with the user to improve it if necessa

Can you write a prompt to optimize prompts? Seems like an LLM should be able to judge a prompt, and collaboratively work with the user to improve it if necessary.

chopete3 1y ago
I use Grok to write the prompts. Its excellent. I think human created prompts are insufficient in almost all cases. Write your prompt in some shape and ask grok Please rewrite this prompt for higher accuracy -- Your prompt
- AlecSchueler 1y ago
  Wouldn't you be better doing it with almost anything other than Grok? How do you know it won't introduce misinformation about white genocide into your prompt?
  - skort 1y ago
    If someone keeps choosing to use the "mechahitler chatbot" at this point, I don't think they care about what misinformation goes into their prompt.
  - chopete3 1y ago
    Any llm is fine. Grok had the latest model available for free use. Thats all. Gpt5 produces similar result too. We have to read the result of course.
AlexC04 1y ago
100% yes! There've been some other writers who've been doing parallel work around that in the last couple weeks. https://www.dbreunig.com/2025/06/10/let-the-model-write-the-prompt.html https://www.dbreunig.com/2025/06/10/let-the-model-write-the-... is an example. You can see the hands on results in this hugging face branch I was messing around in: here is where I tell the LLM to generate prompts for me based on research so far https://github.com/AlexChesser/transformers/blob/personal/vibe-engineering-research/.devcontext/architecture/04-additonal-research-prompts.md#create-prompts-folder-and-per-recommendation-prompts https://github.com/AlexChesser/transformers/blob/personal/vi... here is the prompts that produced: https://github.com/AlexChesser/transformers/tree/personal/vibe-engineering-research/.devcontext/architecture/prompts https://github.com/AlexChesser/transformers/tree/personal/vi... and here is the result of those prompts: https://github.com/AlexChesser/transformers/tree/personal/vibe-engineering-research/.devcontext/architecture/onboarding https://github.com/AlexChesser/transformers/tree/personal/vi.... (also look at the diagram folders etc..)
CuriouslyC 1y ago
This is pretty much DSPy.
user3939382 1y ago
The LLM is basically a runtime that needs optimized input bc the output is compute bottlenecked. Input quality scales with domain knowledge, specificity and therefore human time input. You can absolutely navigate an LLMs attention piecemeal around a spec until you build an optimized input.
slt2021 1y ago
yes, just prepend your request to llm with "Please give me a well-structured LLM prompt that will solve this problem..."
gerad 1y ago
GPT 5 prompt optimizer: https://platform.openai.com/chat/edit?models=gpt-5&optimize=true https://platform.openai.com/chat/edit?models=gpt-5&optimize=...
- claw-el 1y ago
  What’s the benefit for GPT 5 model not to optimize the prompt they get directly instead of relying on this optimizer?

Can you write a prompt to optimize prompts? Seems like an LLM should be able to judge a prompt, and collaboratively work with the user to improve it if necessary.

chopete3 1y ago

I use Grok to write the prompts. Its excellent. I think human created prompts are insufficient in almost all cases. Write your prompt in some shape and ask grok Please rewrite this prompt for higher accuracy -- Your prompt

AlecSchueler 1y ago
Wouldn't you be better doing it with almost anything other than Grok? How do you know it won't introduce misinformation about white genocide into your prompt?
- skort 1y ago
  If someone keeps choosing to use the "mechahitler chatbot" at this point, I don't think they care about what misinformation goes into their prompt.
- chopete3 1y ago
  Any llm is fine. Grok had the latest model available for free use. Thats all. Gpt5 produces similar result too. We have to read the result of course.

AlexC04 1y ago

100% yes! There've been some other writers who've been doing parallel work around that in the last couple weeks. https://www.dbreunig.com/2025/06/10/let-the-model-write-the-prompt.html https://www.dbreunig.com/2025/06/10/let-the-model-write-the-... is an example. You can see the hands on results in this hugging face branch I was messing around in: here is where I tell the LLM to generate prompts for me based on research so far https://github.com/AlexChesser/transformers/blob/personal/vibe-engineering-research/.devcontext/architecture/04-additonal-research-prompts.md#create-prompts-folder-and-per-recommendation-prompts https://github.com/AlexChesser/transformers/blob/personal/vi... here is the prompts that produced: https://github.com/AlexChesser/transformers/tree/personal/vibe-engineering-research/.devcontext/architecture/prompts https://github.com/AlexChesser/transformers/tree/personal/vi... and here is the result of those prompts: https://github.com/AlexChesser/transformers/tree/personal/vibe-engineering-research/.devcontext/architecture/onboarding https://github.com/AlexChesser/transformers/tree/personal/vi.... (also look at the diagram folders etc..)

CuriouslyC 1y ago

This is pretty much DSPy.

user3939382 1y ago

The LLM is basically a runtime that needs optimized input bc the output is compute bottlenecked. Input quality scales with domain knowledge, specificity and therefore human time input. You can absolutely navigate an LLMs attention piecemeal around a spec until you build an optimized input.

slt2021 1y ago

yes, just prepend your request to llm with "Please give me a well-structured LLM prompt that will solve this problem..."

gerad 1y ago

GPT 5 prompt optimizer: https://platform.openai.com/chat/edit?models=gpt-5&optimize=true https://platform.openai.com/chat/edit?models=gpt-5&optimize=...

claw-el 1y ago
What’s the benefit for GPT 5 model not to optimize the prompt they get directly instead of relying on this optimizer?