ajhai

6 ms·

1.
Inference Engineering by Philip Kiely – Digital Download(baseten.co)
2 points by ajhai 1mo ago|0 comments
2.
by ajhai 1mo ago
Anthropic has just announced extending the limits through August 31st with plans to make the new limits permanent. https://xcancel.com/ClaudeDevs/status/2089798442306711646
3.
LearnVector – Andrew Ng's AI company building one‑to‑one learning experiences(learnvector.ai)
269 points by ajhai 2mo ago|173 comments
4.
by ajhai 1y ago
https://x.com/ajhai/status/1899528923303809217 something I have been working on for a few months now.
5.
by ajhai 1y ago
It is inference latency most of the time. These VLA models take in an image + state + text and spit out a set of joint angle deltas. Depending on the model being used, we may get just one set of joint angle deltas or a series of them. In or
6.
by ajhai 2y ago
Building a wheeled robot with arms to help automate household chores - https://x.com/ajhai/status/1891933005729747096 I have been working with LLMs and VLMs to automate browser based workflows among other things f
7.
Langrocks: Open-Source Toolchain with Computer Access and Browser for LLM Agents(langrocks.com)
2 points by ajhai 2y ago|0 comments
8.
Show HN: Langrocks – tools like computer access, browser etc., for LLM agents(github.com)
3 points by ajhai 2y ago|0 comments
9.
by ajhai 2y ago
I've tested Q4 on M1 and it works though the quality may not likely be the same as you'd expect as others have pointed out on the issue.
10.
by ajhai 2y ago
You can already run these models locally with Ollama (ollama run llama3.1:latest) along with at places like huggingface, groq etc. If you want a playground to test this model locally or want to quickly build some applications with it, you c
11.
by ajhai 2y ago
You can actually do this with LLMStack ( https://github.com/trypromptly/LLMStack ) quite easily in a no-code way. Put together a guide to use LLMStack with Ollama last week - https://docs.trypromptly.com/
12.
Build No-Code Generative AI Apps with Ollama, Llama3 and LLMStack(docs.trypromptly.com)
4 points by ajhai 2y ago|0 comments
13.
Show HN: Compare Groq and Llama-3-70B with GPT-4 Turbo(trypromptly.com)
7 points by ajhai 2y ago|0 comments
14.
by ajhai 2y ago
If anyone is looking to try it out quick without local installation, we added Llama-8B model to Promptly playground. Please check it out at https://trypromptly.com/playground .
15.
by ajhai 2y ago
Sorry missed this. It was hidden behind login before. It should now be reachable.
16.
by ajhai 2y ago
If you are looking to play with the model without installing it locally, we've added it our playground at https://trypromptly.com/playground .
17.
Realtime Avatars with Retrieval Augmented Generation(docs.trypromptly.com)
1 points by ajhai 3y ago|0 comments
18.
by ajhai 3y ago
Put together a guide on how to do this with your own avatar and posted at https://news.ycombinator.com/item?id=39053304
19.
Realtime Avatars with RAG [video](youtube.com)
1 points by ajhai 3y ago|1 comments
20.
Realtime Avatars with Retrieval Augmented Generation(llmstack.ai)
3 points by ajhai 3y ago|0 comments
21.
by ajhai 3y ago
We can get a lot done with vector db + RAG before having to finetune or custom models. There are a lot of techniques to improve RAG performance. Captured a few of them a while back at https://llmstack.ai/blog/retrieval-
22.
by ajhai 3y ago
We have recently added support to query data from SingleStore to our agent framework, LLMStack ( https://github.com/trypromptly/LLMStack ). Out of the box performance performance when prompting with just the table schema
23.
by ajhai 3y ago
Gemini Pro compares to GPT 3.5.. their biggest model that competes with GPT-4 is called Gemini Ultra and they say that's coming early next year.
24.
by ajhai 3y ago
https://github.com/trypromptly/LLMStack - started working on this as a wrapper over OpenAI's endpoints for another product and it gradually became this. Another project I worked on for my own use was a network iso
25.
by ajhai 3y ago
This will hopefully improve the startup times for FFmpeg when streaming from virtual display buffers. We use FFmpeg in LLMStack (low-code framework to build and run LLM agents) to stream browser video. We use playwright to automate browser
26.
by ajhai 3y ago
I've been using Django as my main choice for web projects for over ten years. The reason I like it so much is because it comes with a lot of built-in features that one needs to ship web projects to production. For example, I was first
27.
Meta is putting AI chatbots everywhere(theverge.com)
2 points by ajhai 3y ago|2 comments
28.
by ajhai 3y ago
We built https://github.com/trypromptly/LLMStack to serve exactly this persona. A low-code platform to quickly build RAG pipelines and other LLM applications.
29.
by ajhai 3y ago
Kudos to the team for a very detailed notebook going into things like pipeline evaluation wrt performance and costs etc. Even if we ignore the framework specific bits, it is a great guide to follow when building RAG systems in production. W
30.
by ajhai 3y ago
There are a lot of things that goes on in production to scale any service to handle that level of requests. But Django as a web framework is good at what it does. It comes in with most things that one needs to put web apps in production. We

More ›