6 ms·

Thank you! Yeah, it is surprising how magic words can impact the performance of LLMs

• swyx 4mo ago
  do you actually know or are you just guessing
  • nezaj 4mo ago
    Funny enough we added this in awhile back when it seemed more conclusive that this does matter. But I was curious and just did an adhoc eval. Here's a version with the aesthetic line included https://with-aes.vercel.app/ https://with-aes.vercel.app/ Here's a version without the line https://wo-aes.vercel.app/ https://wo-aes.vercel.app/ Everything else is the same. Will let y'all be the judge which is better. Both where made in one-shot with this prompt: Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages.
    • swyx 4mo ago
      hard to try bc with-aes has a login wall lol
      • nezaj 4mo ago
        Agreed. It is curious how the agent got nudged to add auth in that one. I did another ad-hoc but this time I added "Use guest auth" to the prompt. This way you don't need to enter an email. Full prompt below Create a habit tracking app where users can create habits, mark daily completions, and visualize streaks. Include features for setting habit frequency (daily/weekly), viewing completion calendars, and tracking overall progress percentages. Use guest auth Aesthetic version: https://with-aes-guest-auth.vercel.app/ https://with-aes-guest-auth.vercel.app/ Non-aesthetic version: https://wo-aes-guest-auth.vercel.app/ https://wo-aes-guest-auth.vercel.app/ I'd give the edge to the aesthetic one.