6 ms·
I built a custom chat UI for llama3 on groq
- rats 2y agoI was tired of getting rate limited when using Anthropic models like Claude, so I decided to build my own custom chat UI. Not being a developer, what looked like a simple task quickly turned into a sisyphean endeavor, especially trying to fix CSS. But with the help of Claude and GPT-4, (almost) everything is possible now. In my day-to-day use, I often use snippets of prompts that I have to copy-paste here and there, so I added them as variables (just clicking on a variable will insert it into the text field and it will expand during runtime). Yesterday, I saw that Groq added llama3 support, and it is not only very good but also blazingly fast. You need to try it to believe it: https://customchat.vercel.app https://customchat.vercel.app (it uses my API key on a free tier, so the worst that can happen is the rate limit, which is generous on Groq).
- cranberryturkey 2y agocheckout open-webui its runs ontop of ollama